Provider
Groq
Ultra-Fast Inference with LPU Hardware
Free Tier
Free: API with rate limits.
Website
groq.com ↗
Why Choose Groq
Groq custom-designed LPU hardware delivers dramatically faster inference than GPUs — often 10x faster. Their free API gives developers access to this breakthrough technology.
Details
Models, Limits & Getting Started
Available Models
Llama 3 70B, Llama 3 8B, Mixtral 8x7B, Gemma 2 9B.