Groq: A New Era in AI Chip Design?

We just tested Llama 2 70B-4K large language model (LLM) running on a Groq LPU Inference Engine, with LPU standing for Language Processing Unit. We tested a simple query, “What is AI singularity?” and the answer came back mind-blowingly fast! 🤯 Could Groq’s AI LPU chip give Nvidia’s GPUs a run for their money?

Given that Nvidia lifted the fortunes of the entire stock market today, that is a fascinating question indeed! 🧐

Stay tuned for more updates.

← previous post next post →

Michael Tchong

Founder, Author, Adjunct Professor, Futurist

Michael is the founder of Toolhacker LLC, an innovation speaker and adjunct professor at the University of San Francisco, futurist, and author of “Ubertrends — How Trends And Innovation Are Transforming Our Future.” He is also the founder of four ahead-of-the-wave startups, including MacWEEK, Atelier Systems, CyberAtlas, and ICONOCAST.