My lab is in a constant state of flux.   I am going to try and keep this page up to date with the tech I’m running.  My setup is spread across the local stuff running in the garage and “the cloud” a Mix of AWS and Cloudflare

Obviously with homelab’s everyone has different requirements and also opinions. My lab has grown organically over the last 10 years some kit has been purchased new. A lot has been bought off eBay or second hand and some has been donated. If I was starting from scratch it would look quite different I think.

I have a number of requirements some of them are hard requirements and others I try and meet if possible.

  • Must be able to run vSphere (HCL preferred)
  • IPMI/Remote management preferred
  • Rack Mount Preferred
  • Ability to achieve a low power configuration for 24×7 Operations
  • Noise isn’t really a factor due to locating the lab in a garage
  • Heat Output isn’t a factor
  • GPU is a nice to have

Physical Hardware

All hardware lives in a StarTech 25U Openframe Server Rack

Compute

SuperMicro 2027TR with 4x nodes

Node 1&2

Component Description
Model Supermicro X9DRT
CPU 2x Intel Xeon E5-2670
RAM 192GB
NIC 0 Mellanox ConnectX-3 40Gb/s Dedicated vMotion Adaptor
NIC 1 Intel I350 Gigabit Network Connection
NIC 2 Intel I350 Gigabit Network Connection
NIC 3 Intel Ethernet Controller XXV710 for 25GbE SFP28 Direct Connect iSCSI
NIC 4 Intel Ethernet Controller XXV710 for 25GbE SFP28 ( Not Used)
Boot Volume 16GB USB

Nodes 1 and 2 are part of a vSphere Cluster running VMware ESXi, 7.0.3, 19898904  . This is effectively the management cluster and runs all of the workloads that I need on 24×7

Node 3 and 4 are dedicated to vCloud Director but are not always running.

Node 3

Component Description
Model Supermicro X9DRT
CPU 2x Intel Xeon E5-2670
RAM 192GB
NIC 0 Mellanox ConnectX-3 40Gb/s Dedicated vMotion Adaptor
NIC 1 Intel I350 Gigabit Network Connection
NIC 2 Intel I350 Gigabit Network Connection
NIC 3
NIC 4
Boot Volume 16GB USB

Node 4

Component Description
Model Supermicro X9DRT
CPU 2x Intel Xeon E5-2670
RAM 128GB
NIC 0 Mellanox ConnectX-3 40Gb/s Dedicated vMotion Adaptor
NIC 1 Intel I350 Gigabit Network Connection
NIC 2 Intel I350 Gigabit Network Connection
NIC 3
NIC 4
Boot Volume 16GB USB

Node 5 (Low Power Management) Occasionally if I know I won’t be doing any work in the lab I move some workloads to this node and turn off all the Supermicro nodes

Component Description
Model Dell T20
CPU Intel Xeon E3-1225V3 3.2GHz Quad Core
RAM 32 GB
NIC 0 QNAP QM2-2P10G1TB
NIC 1 Intel I350 Gigabit Network Connection
Storage 1 128GB + 500 GB NVMe located on the QM2-2P10G1TB
Boot Volume 16 GB. USB

Node 6 Extra Low power node

HP Microserver Gen8 Component Description
CPU Intel Celeron G1610T  2.3Hz Dual Core 
RAM 16GB 
Storage  
 NIC 0
 NIC 1 Intel I350 Gigabit Network Connection
 NIC 2 Intel I350 Gigabit Network Connection
Boot Volume 16GB USB 

Network Attached Storage

I have a number of storage devices from off-the-shelf Synology devices to homebuilt servers. Although I list them as storage devices they typically also have VM’s or docker containers running in them as well

Hostname Model NVMe Capacity (TB) SSD Capacity (TB) HDD Capacity (TB)
Synology DS918+ 0 3.5
DX517 Expansion bay
(Connected to the DS918+)
0 0 21
DS216+ 0 0 2
HP Z840 (Truenas Scale) 2 0 6
Total TB 2 3.5 29

Physical Network

Model Description
Watchguard M200 Core Firewall
Watchguard XTM330 Secondary Firewall
Ubiquiti Unify US-24 Core Switch

Wireless Network

Ap Model Description
Unifi AC-Pro Access Point

WAN Network

Zen Internet ADSL Internet connection with a public /29 and Three 5G Connection both of these are connected to the Watchguard M200

Sophos UTM (Virtual) (retired to just spam filtering duties)

Workloads

Docker/K8s

A collection of standalone and Docker Stacks. In no particular order some of these run on the Synology some within TrueNas and some on Some Raspberry Pi3’s

General Containers

Cloudflared

Guacamole

PHPipam

PiHole

Netdata

Monica

Portainer

WordPress x3

Reactive Resume

Magical Goodall

Heimdall

watchtower

Uptime Kuma

Media Management Containers

Ombi

Tautulli

Radarr

Sonarr

Youtube-dl

Gaps

Tdarr

Unmanic