by Michael Tchong | Feb 22, 2024 | Generative AI
We just tested Llama 2 70B-4K large language model (LLM) running on a Groq LPU Inference Engine, with LPU standing for Language Processing Unit. We tested a simple query, “What is AI singularity?” and the answer came back mind-blowingly fast! 🤯 Could Groq’s AI LPU...