My #homelab pretty much started like everyone else's: "I need to a place to store all digital valuables." (Google lost some of my most precious photos). Oh and I want to run PiHole. Oh and...
Then, a long time ago (but not in a galaxy far away) @geerlingguy got me all excited about useful stuff on a energy sipping cluster with his series on #Kubernetes.
Then the algorithm recommended @technotim and suddenly I needed to make everything redundant.
Now I have a 10 node, ARM based #HashiCorpNomad cluster, a 48 port switch, NAS, archive for the NAS, and an offsite backup for the NAS.
The cluster runs stuff that my entire family finds useful daily (even if they don't know about it), and in it's clustery way, makes sure stuff keeps running.
And I spent today installing a new (to me) UPS into my home lab, which caused an attempt at better "cable" management (I failed).
This was a good #nerd sunday. Thanks @geerlingguy & @technotim
@suquamish @geerlingguy @technotim what are the details regarding your NAS archive and backup solutions?
Also do you have a distributed file system set up to allow for services to move to other nodes while still keeping state?
Curious about your redundancy solutions too as I'm also running a nomad cluster at home, though a bit limited by the number of nodes st the moment.
@geerlingguy has a great article on backups: https://www.jeffgeerling.com/blog/2021/my-backup-plan
My archive is essentially a rsync clone of the primary NAS, making it a hot backup. From there I make sure I push stuff up to Google's cold storage (in encrypted and compressed form) weekly. In a catastrophic event, might loose a weeks worth of data.
There's no distributed filesystem within #HashiCorpNomad (not like Ceph in Kubernetes), instead I use the NAS to maintain state in the services, and it works well.
@suquamish @geerlingguy you can use distributed file systems with nomad as well, seaweedfs for instance. I was curious if that was what you were doing since you mentioned redundancy.
I also run backups to a remote node at my folks house and to multiple nodes at home, all with borgmatic in an automated client/server setup using consul and nomad.