News for hackers. Stuff that matters.
Re:Home Lab Beginners guide by smallmancontrov on Friday March 08, 2024 @09:58AM (#39641595)
I've been thinking about upgrading my current "homelab" (just an old PC), and I've been waiting for a small form factor with an integrated power supply and a bunch of NVMe slots. Does that exist yet?
Re:Home Lab Beginners guide by CharlesW on Friday March 08, 2024 @10:18AM (#39641808)
> …I've been waiting for a small form factor with an integrated power supply and a bunch of NVMe slots. Does that exist yet?

Have you considered using a NAS as your homelab? I run a few containers (no VMs yet, although I can) and just do that on my QNAP.

The TBS-h574TX (https://www.qnap.com/en-us/product/tbs-h574tx) has five E1.S/M.2 slots. The HS-453DX-8G has two SATA 3.5-inch drive bays and two M.2 2280 SATA SSD slots (https://www.qnap.com/en/product/hs-453dx), and the TBS-h574TX. Or you can just throw SATA SSDs into any NAS.

Re:Home Lab Beginners guide by smallmancontrov on Friday March 08, 2024 @10:46AM (#39642133)
These NASbooks are sooooo close to what I want!

My problem is that none of them have an internal power supply. They all require a power adapter that's decidedly less easy to source than an IEC cord. I have had 3 separate experiences where I give someone instructions to grab a box and the power adapter... and they show up with the box and without the power adapter (or with a power adapter in a box of similar power adapters and no volt/amp/size rating on the box to disambiguate). In short, the internal power supply is something I actually care about.

Re:Home Lab Beginners guide by bombcar on Friday March 08, 2024 @10:55AM (#39642216)
It's harder and harder to find small computers with internal power, because they've found that nobody counts the power brick in the "size" (remember the original Xbox?).

The best bet might be to wait until they've all finalized on USB-C.

Re:Home Lab Beginners guide by smallmancontrov on Friday March 08, 2024 @11:02AM (#39642322)
Yep, that's probably how it has to be. Hopefully USB4NET can save us from "gigabit ethernet is enough for everyone," too.
Re:Home Lab Beginners guide by buybackoff on Friday March 08, 2024 @10:23AM (#39641855)
It's easier to turn an OptiPlex into NAS. Actually you could pass-through entire SATA stack as a PCI device into TruNAS running in Proxmox VM so it sees SATA ports natively, with all goodies such as SMART.
Re:Home Lab Beginners guide by znpy on Friday March 08, 2024 @11:43AM (#39642844)
If you just need to run a few containers, you might want to take a look at TrueNas (Scale) rather than Proxmox.
Re:Home Lab Beginners guide by belthesar on Friday March 08, 2024 @03:33PM (#39646066)
Depending on the use case, this is definitely an option. I personally prefer using Proxmox under my Container Orchestration hardware because, as it seems to always eventually do, my home lab has become production, and being able to do software patches of the underlying system without service outages is really desirable. I've been agonizing and going back and forth between various potential solutions for this for a couple months now, with the most recent attempt being "Deploy k3s, with a fully separate control plane from the worker nodes, and run all of those atop a Proxmox cluster because being able to migrate VMs across nodes and also stand up isolated workloads to test out other solutions makes changing things in the future far less risky".

That said, I was running the Homelab on effectively a single Unraid hyperconverged NAS/compute layer before then, and that worked wonders for quite a long time. I wouldn't consider Unraid my first choice now, given the advancements in TrueNAS SCALE in the time since I chose it as the solution, but the concept of NAS + Container Orchestrator as hyperconverged homelab today is quite attractive.

Re:Home Lab Beginners guide by justinclift on Sunday March 10, 2024 @10:42AM (#39659518)
> ... being able to do software patches of the underlying system without service outages is really desirable.

Yeah, that's what I was looking at Proxmox (8.x) for recently as well, but it never made it through basic qualification testing. VM migration's would randomly hang forever about 25% of the time. Definitely not a case of bad network interconnect either. :(

I'm using Ryzen 5000 series cpus on all the test gear though, and recently saw a mention that it may have been a known problem that's fixed. But not super keen on wasting more time.

What sort of cpus are your hosts using, and are you using your VMs with Ceph as their storage? :)

Re:Home Lab Beginners guide by belthesar on Tuesday March 12, 2024 @06:57PM (#39685939)
Great question! I haven't gotten that far yet. I have Proxmox running on a 12th gen i5 currently, and my other two compute nodes, a 3rd gen i7 laptop and a 7th gen i5, are currently still serving production workloads, so I haven't had a chance to set up a cluster yet. That said, I don't mind limiting features to lowest common denominator for the k3s control plane node, as I don't need gobs of power for it or advanced CPU features, and I imagine that's the pain you might be facing (though I'm new to Proxmox, so who can say?)

That said, I do have a NAS that I can provide both NFS and iSCSI storage to, so I imagine if I run NFS as the backing storage, I shouldn't have to worry about clustered file systems. Each compute does have local storage, but the plan is to provide that via a CSI for workloads that don't need to be highly available or where fault tolerance isn't a concern.

Re:Home Lab Beginners guide by justinclift on Friday March 15, 2024 @08:31PM (#39722151)
As a data point, the vm migration hangs aren't happening in testing any more. Looks like there really was a fix added to Proxmox recently.

Can proceed with more testing now. :)

Re:Home Lab Beginners guide by buybackoff on Friday March 08, 2024 @10:03AM (#39641643)
For my homelab, I bought OptiPlex 7000 with 3 NVMe slots (one PCIe 4.0, one 3.0, one 3.0 short 2242), 1 PCI x16, 1 PCI x4, 3 SATA and 3 DisplayPorts for 300 EUR near 2 years ago.

It was so good actually that I've made it my main PC. I already had 3 monitors and this SFF just worked fine with them. No games of course.

I also have Precision Tower with Xeon/64GB ECC RAM and 1 native NVMe slot. I use PCI-to-NVMe adapters there (2 slots), it works well with ZFS mirror.

Re:Home Lab Beginners guide by Andrex on Friday March 08, 2024 @02:50PM (#39645499)
OptiPlex seemed to be the best option when I was browsing around.
Re:Home Lab Beginners guide by jhickok on Friday March 08, 2024 @10:17AM (#39641796)
I think you could DIY that, but I found getting a few little PCs can be stuffed in a drawers with some holes drilled in the back. Haven't complained about suffocation yet! I bought some Bee-Link mini PCs with pretty impressive specs. No idea if I am now being spied on by China.
Re:Home Lab Beginners guide by natebc on Friday March 08, 2024 @12:26PM (#39643365)
Maybe give this thing a look? it's newish and a little expensive but pretty dang well equipped. (not internally powered though)

https://store.minisforum.com/products/minisforum-ms-01

Re:Home Lab Beginners guide by jay-saint on Friday March 08, 2024 @07:46PM (#39648275)
After massively overthinking things for my homelab / firewall, I am ordering one this weekend, just deciding which cpu.
Re:Home Lab Beginners guide by buybackoff on Friday March 08, 2024 @08:01PM (#39648362)
It's a mobile CPU (with H). Unless it's fanless it will sound like a rocket lunch. Or it will be thermal-throttled with any sustained load. And it looks too expensive.
Re:Home Lab Beginners guide by unregistereddev on Friday March 08, 2024 @03:35PM (#39646105)
There are SFF PC's with integrated power supplies that have a few PCIe slots. PCIe -> NVME adapters are readily available (not my website or article, but posting a link to a review site seemed more genuine than posting Newegg or Amazon links to specific products): https://thunderboltlaptop.com/best-nvme-pcie-adapters/
Re:Home Lab Beginners guide by buybackoff on Friday March 08, 2024 @05:45PM (#39647418)
The cheapest from Amazon works well. Just make sure it matches PCI Gen and slot overall for throughput, e.g. PCI 3.0 x4 are fine for NVMe 3.0, but for NVMe 4.0 more is needed.
Re:Home Lab Beginners guide by justinclift on Sunday March 10, 2024 @10:34AM (#39659437)
For the "bunch of NVMe slots", the OWC PCIe NVMe adapters look interesting:

* https://eshop.macsales.com/shop/ssd/owc-accelsior-4m2 (4x NVMe drives)

* https://eshop.macsales.com/shop/ssd/owc-accelsior-8m2 (8x NVMe drives)

I'd personally get them without drives included, as the OWC drives seem pretty expensive.