!announcements@lemmygrad.ml
For community-wide announcements, such as new subs, etc.
!announcements
@lemmygrad.mlImage upload (and also download) were not working for the last few hours. This has been a recurring problem but I think I have finally found the real cause so it should not happen again. Sorry for the inconvenience.
We’re finally federating! 🎉
We are doing some maintenance related to the image upload/serving service.
This will take some time. I am guessing maybe 6 hours.
During this period image uploads won't work and old images won't be displayed properly.
Really sorry about this. But thankfully, as far as I can see, this is the last infrastructure related maintenance we have to do.
Thanks for understanding.
Edit: Gonna have to postpone this because of personal reasons. For now images should be working fine.
I am sure many of us have noticed that the site had problems over the last four or five days.
The downtimes were caused because of unrecoverable hardware issues with our server. The result was that he had to rebuild the setup from scratch on a machine and restore from a backup. We have also switched to a new provider since the previous one was consistently causing issues.
After this was done, image uploads were still broken for some time. There was no good fix for this because one of the database files used by pictrs had become corrupted due to the aforementioned hardware issues. To resolve this, we had to use an non-corrupted database file from a very old backup. Now image uploads should work fine. The downside is that images uploaded recently will not show up properly. There is not fix for this other than to reupload these images. Sorry about this.
Most of the technical problems with the site should be fixed now.
There is one maintenance task remaining related to moving the image storage to a new S3 provider which will require some downtime. We will inform about this beforehand.
Thanks for your patience.
Follow-up for https://lemmygrad.ml/post/939916.
Some of you thought we got hacked so we have removed taglines for now. People also complained about some taglines being too long which also makes sense.
We might add them later in the future but for now we have removed them.
Thanks for the feedback.
Our VPS shat the bed yet again, and due to a ton of disk-related errors, I had to restore from the last daily backup, so a few hours of data are missing.
This is not the first time this has happened, so we're officially done with this VPS, and will migrate to something else in a few days.
Again, I apologize, and special thanks to @ksynwa@lemmygrad.ml for getting us back up so quickly.
Image uploading and downloading will be down for a while. Gonna try my best to do it without bringing the site down. Sorry for the inconvenience it will inevitably cause.
EDIT: 2023-06-23T04:07:57+00:00: Going to take down pictrs now. There is a chance it might break the site.
EDIT: 2023-06-25T04:21:57+00:00: Site did not break. Migration has begun. Should take one to three hours in my estimate.
EDIT: 2023-06-25T05:54:00+00:00: Migrations still ongoing.
EDIT: 2023-06-25T06:36:17+00:00: Final stretch. Image upload will work now. Old images will be back Soon(TM).
EDIT: 2023-06-25T07:42:07+00:00: Old images are coming back online. Migration should be done in 10-20 minutes.
EDIT: 2023-06-25T07:49:35+00:00: It is done.
Like my post yesterday , I have made yet another bot, and I think people are gonna like this one.
The new friend is @ArtBot@lemmygrad.ml. Mention this fellow in a comment and give it a prompt and it will use stable diffusion to generate some images for you. I'll show it off a bit in the comments.
Edit: the bot now only replies to posts and comments in the AI art community.