@xtremeownage
@lemmyonline.comhttps://www.youtube.com/watch?v=WmXH2tWnYLE
Go to https://buyraycon.com/cleetusmcfarland for 15% off your order! Brought to you by Raycon.The Rat Rod Supra is INSANE.... it will shock anyone, even if t...
https://www.youtube.com/watch?v=PsDNvLaDfxo
New Shirts Just Posted!!! The Leroy vs. Atom giveaway is LIVE on http://cleetusmcfarland.com Every $5 spent = 1 entry to the giveaway!Leroy Jr. is now FULLY ...
https://www.youtube.com/watch?v=RTAINAqD8XI
Grab some G54 merch here - https://www.en.garage54.ru/Turning a Lada into a lawn mower one part at a time.For business inquiries: promotion@garage54.ru
Sorry for the ~30 seconds of downtime earlier, however, we are now updated to version 0.18.4.
Base Lemmy Changes:
https://github.com/LemmyNet/lemmy/compare/0.18.3...0.18.4
Lemmy UI Changes:
https://github.com/LemmyNet/lemmy-ui/compare/0.18.3...0.18.4
Official patch notes: https://join-lemmy.org/news/2023-08-08_-_Lemmy_Release_v0.18.4
So, last month, my kubernetes cluster decided to literally eat shit while I was out on a work conference.
When I returned, I decided to try something a tad different, by rolling out proxmox to all of my servers.
Well, I am a huge fan of hyper-converged, and clustered architectures for my home network / lab, so, I decided to give ceph another try.
I have previously used it in the past with relative success with Kubernetes (via rook/ceph), and currently leverage longhorn.
I installed and configured ceph, using Kube01, and Kube05.
I used a mixture of 5x 970 evo / 970 evo plus / 980 NVMe drives, and expected it to work pretty decently.
It didn't. The IO was so bad, it was causing my servers to crash.
I ended up removing ceph, and using LVM / ZFS for the time being.
Here are some benchmarks I found online:
https://docs.google.com/spreadsheets/d/1E9-eXjzsKboiCCX-0u0r5fAjjufLKayaut_FOPxYZjc/edit#gid=0
https://www.proxmox.com/images/download/pve/docs/Proxmox-VE_Ceph-Benchmark-202009-rev2.pdf
The TLDR; after lots of research- Don't use consumer SSDs. Only use enterprise SSDs.
I ended up ordering 5x 1T Samsung PM863a enterprise sata drives.
After, reinstalling ceph, I put three of the drives into kube05, and one more into kube01 (no ports / power for adding more then a single sata disk...).
And- put the cluster together. At first, performance wasn't great.... (but, was still 10x the performance of the first attempt!). But, after updating the crush map to set the failure domain to OSD rather then host, performance picked up quite dramatically.
This- is due to the current imbalance of storage/host. Kube05 has 3T of drives, Kube01 has 1T. No storage elsewhere.
BUT.... since this was a very successful test, and it was able to deliver enough IOPs to run my I/O heavy kubernetes workloads.... I decided to take it up another step.
Can you guess which drive is the samsung 980 EVO, and which drives are enterprise SATA SSDs? (look at the latency column)
The next goal, is to properly distribute OSDs.
Since, I am maxed out on the number of 2.5" SATA drives I can deploy... I picked up some NVMe.
5x 1T Samsung PM963 M.2 NVMe.
I picked up a pair of dual-spot half-height bifurcation cards for Kube02. This will allow me to place 4 of these into it, with dedicated bandwidth to the CPU.
The remaining one, will be placed inside of Kube01, to replace the 1T samsung 980 NVMe.
This should give me a pretty decent distribution of data, and with all enterprise drives, it should deliver pretty acceptable performance.
More to come....
https://www.home-assistant.io/blog/2023/08/02/release-20238/
Sentence triggers can now contain wildcards, a brand new event entity, all services are now translated into your language, generate images with OpenAI's DALL-E using Assist, and more!
https://www.home-assistant.io/blog/2023/08/02/release-20238/
Sentence triggers can now contain wildcards, a brand new event entity, all services are now translated into your language, generate images with OpenAI's DALL-E using Assist, and more!
https://www.home-assistant.io/blog/2023/08/02/release-20238/
Sentence triggers can now contain wildcards, a brand new event entity, all services are now translated into your language, generate images with OpenAI's DALL-E using Assist, and more!
https://www.youtube.com/watch?v=UfKFv5A6rhY
New Shirts Just Released!!! The Leroy vs. Atom giveaway is LIVE on http://cleetusmcfarland.com Every $5 spent = 1 entry to the giveaway!Jet sprint is definit...