Do the examples in the repo run inference on Mac?
1,878 karma · joined February 7, 2012
Do the examples in the repo run inference on Mac?
I was pretty disappointed to find out that none of the ms-01 ms-a1 or ms-a2 have a ATX power button header. This means you need to solder wires to the tiny tactile switch and connect those to something like a pi-kvm to get true power control/status and ipmi/redfish
Just seems like something simple they could have easily included if they wanted to really target the homelab space
Ships with aarch64 Ubuntu 24.04.
Tons of cores and RAM.
Very quiet and small
UEFI bootloader - I installed Ubuntu 25.10 and ESXi arm edition just by booting the ISO
usb-c power input (kinda cool)
Insane connectx 200GbE RoCE networking
10GbE Ethernet
Oh and an nvidia gpu with cuda and access to 128GB of unified memory
It would be perfect if it had some kind of BMC or IPMI/redfish and an exposed PCIE slot. But this thing is an awesome arm64 workstation no doubt.
May try to install to a USB drive and hang another gpu off the nvme port just to see what happens
First time I have seen this. Incredible music and intense gfx all packaged under 64k? Impressive as hell.
The Unity project matters to me so I am formally allocating aborsy to work on it.
Curious though how you offer idrac to customer, do you have another OOB BMC for the idrac? Or is this internal engineering context
Even ignoring GPU details spark is an awesome little quiet powerhouse arm64 workstation that is 100% Linux first
$1,295.00
https://www.balticnetworks.com/products/mikrotik-crs812-ddq-...
Crostini and Android apps make it really versatile. I run the dev channel and there are all kinds of interesting features and experiments to play with. Arch instead of Debian for crostini.
Was really disappointed when framework discontinued it, but it seems like chromeos is converging into Android.
The flip side is that we now have crostini for Android. Chromeos android subsystem has not been updated to be able run it if you are wondering, heh.
It works the same way, there is a Linux terminal application that runs Debian inside a VM. They recently added a button to launch a display window. This then functions as your "monitor" and applications you launch that provide a GUI display there.
Still experimenting with it not clear if you can launch android inside that with waydroid or similar
IDRAC is miles ahead of SMC/MEGARAC. It's not even close.
The kicker is that they each have 2.5GbE Ethernet with POE! This allows me to power control them by power cycling the switch port.
I then have a webhook that gets hit from MAAS. They pxe and get provisioned with an os image, the same images also work on large real servers, so this is a pretty awesome mini lab for testing and tinkering.
https://github.com/vinceliuice/Yosemite-gtk-theme
If you want a macOS theme with insane quality on Linux this guy's work is the pinnacle.
Linux is Linux Windows offers Wsl1 and Wsl2 integration
The closest thing macOS has in any official capacity is their containers project, running each container in a VM for "security" at the expense of poor resource allocation and no compatibility with table stakes tooling like compose.