With the seismic shift in AI toward deploying or running models – known as inference – developers and enterprises alike can experience instant intelligence with Groq. We provide fast AI inference in the cloud and in on-prem AI compute centers. We power the speed of iteration, fueling a new wave of innovation, productivity, and discovery. Groq was founded in 2016 to build technology to advance AI because we saw this moment coming. 

The Groq Language Processing Unit, the LPU, is the technology that meets this moment. The LPU delivers instant speed, unparalleled affordability, and energy efficiency at scale. Fundamentally different from the GPU – originally designed for graphics processing – the LPU was designed for AI inference and language. Groq technology can be accessed by anyone via GroqCloud™, while enterprises and partners can choose between cloud or on-prem AI compute center deployment. We are committed to deploying millions of LPUs, providing access to the value of AI to the world. Our first-generation LPU is available and shipping today, with more innovations to come.

Groq started with the breakthrough idea of a software-first approach to designing AI hardware. We started with first principles resulting in the LPU, the foundation for all of our product offerings.  The LPU delivers the highest quality and fastest throughput for AI inference, at a more affordable price point and with better energy efficiency than other solutions in the market today. Groq offers developers and enterprises the ability to get started quickly. Developers and enterprises can explore GroqCloud™ and get an API key to start building new AI applications today.  GroqRack™ Compute Cluster is ideal for those enterprises that need on-prem solutions for their own cloud or AI Compute Center.