Toolhacker logo
Innovative 🚀 | Solutions 💡 | Empowering 💪 | You 🙋
Groq AI Chips

Groq: A New Era in AI Chip Design?

Feb 22, 2024 | Generative AI

We just tested Llama 2 70B-4K large language model (LLM) running on a Groq LPU Inference Engine, with LPU standing for Language Processing Unit. We tested a simple query, “What is AI singularity?” and the answer came back mind-blowingly fast! 🤯 Could Groq’s AI LPU chip give Nvidia’s GPUs a run for their money?

Given that Nvidia lifted the fortunes of the entire stock market today, that is a fascinating question indeed! 🧐

Stay tuned for more updates.

Michael Tchong

Michael Tchong

Founder, Author, Adjunct Professor, Futurist

Michael is the founder of Toolhacker LLC, an innovation speaker and adjunct professor at the University of San Francisco, futurist, and author of “Ubertrends — How Trends And Innovation Are Transforming Our Future.” He is also the founder of four ahead-of-the-wave startups, including MacWEEK, Atelier Systems, CyberAtlas, and ICONOCAST.