Any particular reason not to run this model on a single Jetson AGX Orin 64GB?
GP Core count is much lower than than the 4090 but it still does 275 int8 TOPS for only $2k
GP Core count is much lower than than the 4090 but it still does 275 int8 TOPS for only $2k