An open source object storage server with Amazon S3 compatible API
An open source object storage server with Amazon S3 compatible API
Yet another Index Gateway
YIG is a SODA Foundation project
At its core, Yig extend minio backend storage to allow more than one ceph cluster work together and form a super large storage resource pool, users could easily enlarge the pool`s capacity to EB level by adding a new ceph cluser to this pool. Benifits are avoiding data movement and IO drop down caused by adding new host or disks to old ceph cluster as usual way. To accomplish this goal, Yig need a distribute database to store meta infomation. Now already Support Tidb,MySql.
How to build?
Require:
Steps:
mkdir -p $GOPATH/src/github.com/journeymidnight
cd $GOPATH/src/github.com/journeymidnight
git clone [email protected]:yig/yig.git
cd $YIG_DIR
go get ./...
go buildbuild rpm package
yum install ceph-devel
sh package/rpmbuild.shBefore running Yig, requirments below are needed:
Deploy at least a ceph cluster with two specify pools named 'tiger' and 'rabbit' are created. About how to deploy ceph, please refer https://ceph.com or our [Sample]
Deploy a TiDB/Mysql, then create tables. [Sample]
MariaDB [(none)]> create database yig
MariaDB [(none)]> source ../yig/integrate/yig.sqlDeploy yig-iam used for user management and authorize request. If Yig is running in Debug Mode, request will not sent to yig-iam. So this deployment is optional, but in real factory environment, you still need it.
Deploy a standalone Redis instance used as cache for better performance. This deployment is optional but strong recommend
yum install redisMain config file of Yig is located at /etc/yig/yig.toml by default
……Ceph config files
Combine your ceph cluster config file [/etc/ceph/ceph.conf] with [/etc/ceph/ceph.client.admin.keyring] together, then put it to the location which 'CephConfigPattern' specified, a sample is below
[global]
fsid = 7b3c9d3a-65f3-4024-aaf1-a29b9422665c
mon_initial_members = ceph57
mon_host = 10.180.92.57
auth_cluster_required = cephx
auth_service_required = cephx
auth_client_required = cephx
filestore_xattr_use_omap = true
osd pool default size = 3
osd pool default min size = 2
osd pool default pg num = 128
osd pool default pgp num = 128
[client.admin]
key = AQCulvxWKAl/MRAA0weYOmmkArUm/CGBHX0eSA==
Start server:
cd $YIG_DIR
sudo ./yigOR
systemctl start yigPlease refer our wiki for other information
No open issues yet, or sync has not completed.