We are only using 40% of our cpu, and 50% of our memory.
I can easily add extra CPUs and Memory if needed. We recently added extra memory to deal with the instabilities. (Check the latest announcement on the memory, and why your display picture is throwing a 404 π₯). I'm terribly sorry about that!
I did a "how I'm hosting reddthat here": https://reddthat.com/post/19103
Honestly I never expected it to blow up as it did π
. Especially with people actually funding our little adventure. I originally bought a 12 month server which cost just under $120 which I had thought would be enough for a slow and gradual increase of users.
The next plan is to scale out all the services to their own server. So we have Lemmy & lemmy-ui, Pictrs (pictures), Postgres (database). Biggest memory hog is lemmy, due to the spikes and coming in 0.18.1 will be an in memory cache. Biggest cpu hog is pictrs, as we have to convert the images -> webp, or gifs -> webm & soon to be videos. I'd like to scale out pictrs to have multiple instances but it is currently impossible as it uses an internal kv-store which is unable to be accessed by multiple instances. That will allow us to scale out each of the server to allocate more memory per item that is needed.
Ideally i'd like to run a docker-swarm, have each service scaled. But the only ones that could be possibly done like that (at this time) is lemmy and lemmy-ui. Which will be the first ones we do, but having the docker-swarm with only 2 of the services would just add complexity when it isn't needed. Plus, they have some internal configuration files, so i'd need to build the deployment pipleline to build the config into our containers. Not hard, but not a huge priority.
π I got plans, and now we got funding. Worst comes to worse, I'll throw extra cpu & memory at this box until it's stupidly huge as a temporary measure (which is what other lemmy instances have done), and then migrate the services to other servers at a later date.
Tiff