You need an entire rack or two worth of Groq systems to get this performance, because the only memory the system has is on-chip SRAM (220MB). If you're trying to run on a small number of systems, you need local DRAM or HBM, which Groq doesn't have.
No comments yet.