There are rumors that the K2 model Groq is serving is quantized or otherwise produces lower-quality responses than expected due to some optimization, FYI.
I tested it and the speed is incredible, though.
I tested it and the speed is incredible, though.
But then, same for humans yes?