Ask HN: Home Server Setup?

I’d like to build a machine learning server for home experiments (I briefly considered cloud providers but I want to get back building a pc from scratch, that’s part of the project). These will be mostly training midsize models and experiment with automl. With a 3090/4090 I may even get to work on larger datasets etc…

My main problem is space in the house. I’m planning to place the cabinet next to the broadband router and connect it through ethernet. However there’s no room for a desk and monitor over there.

Hence the idea of using the pc headless and connect to it from a laptop on the same network.

What’s the best way to go in this case? Simply ssh into the machine and work? A fancy solution like anydesk or even a proxmox cluster?

This is a hobby project so I’m happy to experiment. Also, suggestions on the best GPU? I’m leaning toward either RTX3090 or 4090 on the basis of VRAM only.