Skip to main content Execute Groq production deployment checklist and rollback procedures.
Use when deploying Groq integrations to production, preparing for launch,
or implementing go-live procedures.
Trigger with phrases like "groq production", "deploy groq",
"groq go-live", "groq launch checklist".
npx skills add jeremylongshore/claude-code-plugins-plus-skills --skill groq-prod-checklist ai automation claude-code devops mcp ai-agents
Groq Production Checklist
Overview
Complete pre-launch checklist for deploying Groq-powered applications to production. Covers API key security, model selection, rate limit planning, fallback strategies, and monitoring setup.
Prerequisites
Staging environment tested with Groq API
Groq Developer or Enterprise plan (free tier is not suitable for production)
Production API key created in console.groq.com
Monitoring and alerting infrastructure ready
Pre-Deployment Checklist
API Key & Auth
Model Selection
max_tokens set to actual expected output size (not context max)
Rate Limit Planning
Error Handling
Fallback & Degradation async function completionWithFallback(messages: any[]) {
try {
return await groq.chat.completions.create({
model: "llama-3.3-70b-versatile",
messages,
timeout: 15_000,
});
} catch (err: any) {
if (err.status === 429 || err.status >= 500) {
console.warn("Groq primary failed, trying fallback model");
try {
return await groq.chat.completions.create({
model: "llama-3.1-8b-instant",
messages,
timeout: 10_000,
});
} catch {
console.error("Groq fully unavailable, degrading gracefully");
return { choices: [{ message: { content: "Service temporarily unavailable. Please try again." } }] };
}
}
throw err;
}
}
Health Check Endpoint // /api/health or /healthz
export async function GET() {
const checks: Record<string, any> = { status: "healthy" };
const start = performance.now();
try {
await groq.chat.completions.create({
model: "llama-3.1-8b-instant",
messages: [{ role: "user", content: "OK" }],
max_tokens: 1,
temperature: 0,
});
checks.groq = { status: "connected", latencyMs: Math.round(performance.now() - start) };
} catch (err: any) {
checks.status = "degraded";
checks.groq = { status: "error", error: err.status || err.message };
}
return Response.json(checks, { status: checks.status === "healthy" ? 200 : 503 });
}
Monitoring Setup
Spending Controls
Documentation
Go-Live Verification set -euo pipefail
# Pre-flight checks
echo "1. Groq API status..."
curl -sf https://status.groq.com > /dev/null && echo "OK" || echo "ISSUE"
echo "2. Production key valid..."
curl -sf https://api.groq.com/openai/v1/models \
-H "Authorization: Bearer $GROQ_API_KEY_PROD" | jq '.data | length'
echo "3. Health endpoint..."
curl -sf https://your-app.com/api/health | jq .
echo "4. Rate limit headroom..."
curl -si https://api.groq.com/openai/v1/chat/completions \
-H "Authorization: Bearer $GROQ_API_KEY_PROD" \
-H "Content-Type: application/json" \
-d '{"model":"llama-3.1-8b-instant","messages":[{"role":"user","content":"ping"}],"max_tokens":1}' \
2>/dev/null | grep -i "x-ratelimit-remaining"
Error Handling Alert Condition Severity API errors spike 5xx rate > 5/min P1 Latency degraded p95 > 1000ms P2 Rate limited 429 count > 5/min P2 Auth failure Any 401 error P1 Spending near cap >90% of monthly budget P3
Resources
Next Steps For version upgrades, see groq-upgrade-migration.
Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.
Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.
Set up and use 1Password CLI (op). Use when installing the CLI, enabling desktop app integration, signing in (single or multi-account), or reading/injecting/running secrets via op.
CLI to manage emails via IMAP/SMTP. Use `himalaya` to list, read, write, reply, forward, search, and organize emails from the terminal. Supports multiple accounts and message composition with MML (MIME Meta Language).
Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.
Create or update AgentSkills. Use when designing, structuring, or packaging skills with scripts, references, and assets.
Set up and use 1Password CLI (op). Use when installing the CLI, enabling desktop app integration, signing in (single or multi-account), or reading/injecting/running secrets via op.
CLI to manage emails via IMAP/SMTP. Use `himalaya` to list, read, write, reply, forward, search, and organize emails from the terminal. Supports multiple accounts and message composition with MML (MIME Meta Language).