Groq

“Get API key” opens Groq’s console where you can sign in, claim free credits, and generate your key. “Documentation” shows how to set it up and call the API.

Ultra-fast LLM inference using LPU hardware. Supports Llama 3, Mixtral, and Gemma.

from groq import Groq

client = Groq(api_key="YOUR_KEY")
res = client.chat.completions.create(
    model="llama3-8b-8192",
    messages=[{"role": "user", "content": "Hello"}]
)
print(res.choices[0].message.content)