https://owncloud.com/infinite-scale/
Infinite Scale is a new data platform with a focus on performance, scalability, security and governance. Microservice-based, database-less and written in Go.
Technically this isn't actually a seafile issue, however the upload client really should have the ability to run checksums to compare the original file to the file that is being synced to the server (or other device).
I run docker in a VM that is hosted by proxmox. Proxmox manages a ZFS array which contains the primary storage that the VM uses. Instead of making the VM disk 1TB+, the VM disk is relatively small since its only the OS (64GB) and the docker containers mount a folder on the ZFS array itself which is several TBs.
This has all been going really well with no issues, until yesterday when I tried to access some old photos and the photos would only load half way. The top part would be there but the bottom half would be grey/missing.
This seemed to be randomly present on numerous photos, however some were normal and others had missing sections. Digging deeper, some files were also corrupt and would not open at all (PDFs, etc).
Badness alert....
All my backups come from the server. If the server data has been corrupt for a long time, then all the backups would be corrupt as well. All the files on the seafile server originally were synced from my desktop so when I open the file locally on the desktop it all works fine, only when I try to open the file on seafile does it fail. Also not all the files were failing only some. Some old, some new. Even the file sizes didn't seem to consistently predict if it would work on not.
Its now at the point where I can take a photo from my desktop, drag it into a seafile library via the browser and it shows successful upload, but then trying to preview the file won't work and downloading that very same file back again shows the file size about 44kb regardless of the original file size.
Google/DDG...can't find anyone that has the same issue...very bad
Finally I notice an error in mariadb: "memory pressure can't write to disk" (paraphrased).
Ok, that's odd. The ram was fine which is what I assumed it was. HD space can't be the issue since the ZFS array is only 25% full and both mariadb and seafile only have volumes that are on the zfs array. There are no other volumes...or is there???
Finally in portainer I'm checking out the volumes that exist, seafile only has the two as expected, data and database. Then I see hundreds of unused volumes.
Quick google reveals docker volume purge
which deletes many GBs worth of volumes that were old and unused.
By this point, I've already created and recreated the seafile docker containers a hundred times with test data and simplified the docker compose as much as possible etc, but it started working right away. Mariadb starts working, I can now copy a file from the web interface or the client and it will work correctly.
Now I go through the process of setting up my original docker compose with all the extras that I had setup, remake my user account (luckily its just me right now), setup the sync client and then start copying the data from my desktop to my server.
I've got to say, this was scary as shit. My setup uploads files from desktop, laptop, phone etc to the server via seafile, from there borg backup takes incremental backups of the data and sends it remotely. The second I realized that local data on my computer was fine but the server data was unreliable I immediately knew that even my backups were now unreliable.
IMHO this is a massive problem. Seafile will happily 'upload' a file and say success, but then trying to redownload the file results in an error since it doesn't exist.
Things that really should be present to avoid this:
Looking for a self hosted YouTube front end with automatic downloader. So you would subscribe to a channel for example and it would automatically download all the videos and new uploads.
Jellyfin might be able to handle the front end part but not sure about automatic downloads and proper file naming and metadata
The jellyfin app (self hosted video streaming) app on steam deck (installed via desktop mode->discovery as a flat pack) doesn't seem to register as 'playing' with the os. The screen will dim after a few mins.
I'm 'playing' the jellyfin app as a non steam game in game mode.
I know I can disable screen dimming in the settings but is there a way to have it auto detect when a video is playing and prevent the screen from dimming?
Any suggestions for roasted decaf beans I can get Canada?
https://forums.servethehome.com/index.php?threads/qotom-denverton-fanless-system-with-4-sfp.41331/page-2=
A place to discuss servers, storage and networking
https://www.phoronix.com/news/FFmpeg-CLI-MT-Merged
https://github.com/CyferShepard/Jellystat
Jellystat is a free and open source Statistics App for Jellyfin - GitHub - CyferShepard/Jellystat: Jellystat is a free and open source Statistics App for Jellyfin
I'm wondering if I can get a device that enables zwave over Ethernet/wifi and connect that to my home assistant setup?
Basically I have a home assistant setup in my house. I want to add a few simple things to my parents place but I want it to all be on the same HA instance.
On the router in my parents place, I can install wireguard to connect it to my LAN. So now my parents network is the same as my LAN network.
I'm looking for a device that can connect to zwave and then send that info over the LAN to my home assistant. Does such a thing exist? Thanks.
By local control, I mean if the Z-wave hub is down will the switch still work as a dumb switch and turn the lights on/off?
This is the product I would like to get, but can't find if they allow 'dumb switch' operation. Does anyone have experience with these? https://byjasco.com/ultrapro-z-wave-in-wall-smart-switch-with-quickfit-and-simplewire-white
Thanks!
@Lem453
@lemmy.ca