lemmy.blahaj.zone has defederated from lemmynsfw.com after discovering a community which they believed had CSAM (Child Sexual Abuse Material).
They demanded that the community and its members be purged, which lemmynsfw.com refused stating that they couldn't find any evidence of CSAM.
Both sides think they're in the right on this one and I expect more instances will want to react one way or the other.
It has been another eventful week.
What does this have to do with Lemmy, you ask? Plenty:
As of writing this, lemmy.fmhy.ml is down and it's unclear what will happen to lemmy.ml and lemmygrad.ml.
lemmy.fmhy.ml have announced that user data is safe, though changing domain names is a huge pain for re-federation and nobody really knows how that will work yet.
If you are unable to access communities that used to reside on lemmy.fmhy.ml - this is why.
In general, it's a good idea to stay away from country specific TLDs when hosting an instance, epecially if you don't reside in those countries.
This one unfortunately comes with the territory once you reach a certain size. If you've been struggling to reach lemmy.world recently, this is probably why.
Fixing this kind of issue will lead to massive performance benefits for large instances and improve resilience.
Related:
What did I miss?
We had an outage, Lemdit fell over while I was asleep so bad timing. It looks like it was down for about 4 hours.
I'll look into what caused it, I have a script that tries to automatically recover Lemdit from the usual crash, but something else happened here.
Anyway if you tried to access it and couldn't - sorry! It's back now.
Edit:
I believe this was caused by cache depleting all available RAM (impressive considering we've got 128 GB allocated). This isn't normally supposed to cause an issue as cache is meant to be cleared to make room for app usage, but in practice it can be problematic and it's likely what got everything to fall over.
I've got a cron job in place that will clear cache daily now so this won't happen again.
Here's a graph if you're curious, the outage occurred ~3:30AM, the drop you see is me restarting the VM:
I'm curious to get your thoughts on Lemmy. What is your impression so far? Are you enjoying it? What would you like to see different?
If you're using Lemdit, then I'm really interested to get your feedback on what your experience is like. Is there anything we can improve? Any other suggestions or ideas?
It feels like I've been spamming these updates recently, but it has been an eventful week for Lemmy and it's worth being on the version that has the least holes in it.
Unless there is a compelling security concern or they fix the broken theme appearance, I'm going to start limiting these updates to once a week going forward.
I’m about to perform this update in the next 10 minutes, all things going well there should be no downtime/instability.
The DB is backed up, I’ll post an update here once everything’s done.
@delendum
@lemdit.com