This repo is for my homelab (that is, the infrastructure that I run in the home). This sits in a 25U Startech open rack.
The underlying platform is Proxmox VE 7 + a Ceph cluster. On top I run a Kubernetes cluster, an OPNSense VM, and misc others. It is managed with Terraform IaC, and lots of glue and duct tape.
Kubernetes runs on Talos Linux and is managed with Flux (GitOps)
The rack:
| Device | CPU | RAM | OS | Disks | NICs |
|---|---|---|---|---|---|
| 1 x Supermicro 847 36 bay 4U X10DRi-T4+ a.k.a Fatman | 2 x Intel Xeon E5-2630L 10c/20t | 356GB | Proxmox 7 | Ceph: 2 x 2TB NVMe 970 Evo Plus, ZFS for about 200TiB raw | Intel X540 4 x 10GBase-T |
| 1 x Node 304 w/ Supermicro X11SDV a.k.a Lilslim | 1 x Intel Xeon D-2141I | 160GB | Proxmox 7 | Ceph: 2 x 2TB NVMe 970 Evo Plus through QDA-U2MP, 1 x 1TB QVO SATA SSD | Intel X722 2 x 10GBase-T, Intel X540 2 x 10GBase-T |
| 2 x Intel NUC10i7FNK (slim) | 1 x i7-10710U 6c/12t | 64GB | Proxmox 7 | Ceph: 1 x 1TB NVMe 970 Evo Plus | Thunderbolt Sonnet solo 10GbE |
| 1 x Intel NUC10i7FNH (fat) | 1 x i7-10710U 6c/12t | 64GB | Proxmox 7 | Ceph: 1 x 1TB NVMe 970 Evo Plus, 1 x 1TB QVO SATA SSD | Thunderbolt QNAP 10GbE SFP+ |
I have a 1 gig symmetric FTTH link, my GPON is in bridge, that goes in my switch and gets VLAN'd, then my OPNSense picks it up.
| Device | Details |
|---|---|
| APC UPS SMT3000RMI2UNC | 3000VA UPS for the whole rack |
| Unifi Switch Enterprise XG 24 | Main 10gig switch |
| Unifi Switch XG 6PoE | 10gig PoE switch, to be decomissioned |
| TP-Link Omada OC200 | Omada controller |
| TP-Link Omada TL-SG3428MP | Main 1gig switch |
| 2 x TP-Link Omada EAP660 HD | APs for upstairs & downstairs |
| PiKVM | KVM for non-IPMI nodes (i.e. NUCs) |
| 4 x Reolink 811A | security cams |
| 2 x Dahua IPC-HFW5541E-SE w/ starlight chip | security cams |
This was all made possible by the wonderful Kubernetes @Home Discord community. Come join us!