HNHacker News
TopNewBestAskShowJobs

taisgeal

2 karma · joined February 13, 2017

submissionscomments
taisgeal··on Ask HN: Glusterfs or ceph on Digitalocean block storage?
You can add storage by expanding the lsyncd droplet(remote) or by using Block Storage(local) on your web droplets and expanding that.

I have found this to be more cost effective than anything else I have tried.

taisgeal··on Ask HN: Glusterfs or ceph on Digitalocean block storage?
Sorry for Unison, I should point out that I use fcron for running Unison every 5 seconds. This on average syncs 15-20 20Mb files every 5 seconds without any issue. This is similar to what you describe in terms of load.
taisgeal··on Ask HN: Glusterfs or ceph on Digitalocean block storage?
and I am also Digital Ocean customer. It has meant I can completely remove a whole storage layer and has reduced my droplet bill overall by 20%.
taisgeal··on Ask HN: Glusterfs or ceph on Digitalocean block storage?
Don't use either. I tried and failed with both. Expensive hardware and a PhD required to go through all the config options. When I did get both to work, they were very slow and I kept getting replication issues and bricks that wouldn't heal.

This cost two months of my life and I was not flavur of the month with my employer.

I eventually tried lsyncd ( https://axkibe.github.io/lsyncd/) and it works like a charm. It took me about a week to get a decent setup going, but it has never let me down since, can handle large numbers of small files (similar to yours) and smaller numbers of large files. I use unison ( https://www.howtoforge.com/tutorial/unison-file-sync-between...) for web server pairs.