matanyal

Hey y'all, we have a discord now for more discussion and announcements: https://discord.com/invite/TQcy5EBdCP

When you have a pile of hardware and silicon Intellectual Property, patents, etc, IMO it's pretty clever. However, I'm a Groq Engineer, and I'm mega-biased.

We intend to be very competitive on cost, power, hardware, TCO, whatever it is. Custom-built silicon+hardware has the advantage in this space.

Thanks! Feel free to join our discord for more announcements and demos! https://discord.com/invite/TQcy5EBdCP

We are great for image embedding (and audio, with more to come!) There is no reason you should be forced to use graphics cards intended for gaming for any AI workload.

Thanks!

Groq Engineer here as well; we actually built our compiler to compile pytorch, TensorFlow, and Onnx natively, so a lot of the amazing work being done by y'all isn't building much of a moat. We got LLama2 working on our hardware in just a couple of days!

More info about Groq: https://groq.com/lpu-inference-engine/

Reading is one thing, but think about stuff like website generation, searching for information in massive datasets, real-time audio chats that don't sound like the AI misheard everything with a pause, and stuff like that.

It told me "Yeehaw Ridem Cowboy" was potentially problematic, which is news to me living out west.

Interesting, no mention of Groq for number 6.

Hey Jeff,

Good to see that y'all are still pushing in the right direction! I left between the layoffs to pursue some innovation in the semiconductor space, but I look back fondly on my time at Twilio (Sendgrid)!

Building APIs into businesses is no easy task, but I'm glad that there are those still fighting the good fight, even if the field changes. Best of luck to the Twilio of the future!