기본 콘텐츠로 건너뛰기

Groq API Free Tier: Rate Limits, Costs and When to Upgrade

Summary: Groq's Free plan gives you a real, no-card API key with daily caps that are generous for prototypes but tight for anything with users: on GPT-OSS 120B it's 30 requests a minute, 1,000 a day and 8K tokens a minute. The pay-as-you-go Developer plan lifts those caps sharply, keeps per-token prices low and adds Batch, Flex and spend limits. This breakdown shows exactly where the free limits bite, what the same work costs once you pay, and how Groq compares with Cerebras, the other fast-inference API people usually weigh it against.

What you actually get on the Free plan

You sign up at console.groq.com, open API Keys, create a key and start calling the API. A payment method only comes into play when you upgrade to the Developer tier, so the Free plan is genuinely free rather than a trial that converts.

The catch is the limits. Groq measures usage in requests per minute (RPM), requests per day (RPD), tokens per minute (TPM) and tokens per day (TPD), plus audio seconds per hour and per day (ASH/ASD) for speech-to-text. Whichever ceiling you hit first stops you. These are the base Free plan numbers on Groq's rate-limits page today for the models most people use:

  • openai/gpt-oss-120b and openai/gpt-oss-20b: 30 RPM, 1K RPD, 8K TPM, 200K TPD.
  • qwen/qwen3.8-27b: 30 RPM, 1K RPD, 8K TPM, 200K TPD.
  • openai/gpt-oss-safeguard-20b: 3 RPM, 1K RPD, 2K TPM, 200K TPD.
  • whisper-large-v3 and whisper-large-v3-turbo: 20 RPM, 2K RPD, 7.2K audio seconds per hour (two hours of audio) and 28.8K per day (eight hours).
  • Orpheus text-to-speech (English and Arabic Saudi): 10 RPM, 100 RPD, 1.2K TPM, 3.6K TPD.

Limits apply to your whole organization, not to each person or key. Creating a second key for a teammate doesn't give you a second allowance.

Where the free caps bite first

For chat-style work the binding limit is usually TPM, not requests. Prompt and completion tokens both count, so 8K tokens a minute disappears quickly once you send long system prompts, retrieved documents or chat history. A single request carrying a 6K-token context leaves room for very little else in that minute, even though you've used only one of your 30 requests.

The daily 200K-token budget is the second wall. It's plenty for testing a feature, running a hobby bot or wiring up an agent framework, but a small app with real users will hit it on a busy day. Speech is more forgiving: eight hours of audio a day is enough to transcribe a decent backlog of meetings or podcast episodes for free.

One thing that stretches the free tier: prompt caching

Groq caches shared prompt prefixes automatically on the GPT-OSS models, and cached tokens don't count toward your rate limits. Keep the stable part of your prompt (system instructions, tool definitions, reference text) at the start and identical between calls, and put the changing user input at the end. Groq notes that cache hits aren't guaranteed and that cached tokens are still subtracted after processing, so heavy parallel requests can still hit the limit.

How to read your limits and stop guessing

  1. Check your organization's real numbers. The docs table is a summary with exceptions. Your exact values are on Settings → Limits in the console. If you hover over TPM and see an "X in / Y out" breakdown, your organization also has separate input and output token caps.
  2. Read the response headers. Every response includes x-ratelimit-remaining-requests and x-ratelimit-remaining-tokens. A detail that trips people up: the requests headers refer to your daily request limit, while the tokens headers refer to your per-minute token limit.
  3. Handle 429 properly. When you exceed a limit, the API returns 429 Too Many Requests. The retry-after header (in seconds) is only set on that 429, so wait at least that long before retrying instead of hammering the endpoint.
  4. Watch usage. Dashboard → Usage shows consumption by model, which tells you whether one feature is eating your allowance.

The model-name gotcha in 2026

If you're following an older tutorial, check the model ID before blaming rate limits. Groq's deprecations page shows that llama-3.1-8b-instant and llama-3.3-70b-versatile were shut down on August 16, 2026 for free and Developer-tier usage. The suggested replacements are openai/gpt-oss-20b for Llama 3.1 8B and openai/gpt-oss-120b for Llama 3.3 70B. (The page originally pointed to qwen/qwen3.6-27b as the other option, but that model has since been deprecated in favor of qwen/qwen3.8-27b.) On the Models page both Llama models are now listed as Enterprise-only.

The confusing part is that the Quickstart code samples I checked on 2026-11-01 still use llama-3.3-70b-versatile. On a free or Developer account, swap that string for openai/gpt-oss-120b before running the sample.

What the Developer plan costs

Groq doesn't sell monthly or annual subscriptions for the API, so there's no billing-period toggle to worry about. The Developer plan is pure pay-as-you-go: you add a card, US bank account or SEPA debit account and pay per token or per hour of audio. Upgrading costs nothing up front. New accounts are invoiced when cumulative usage crosses $1, $10, $100, $500 and $1,000; after that you get one monthly invoice. Groq doesn't charge for amounts under $0.50, and you can downgrade back to Free from Settings → Billing after paying any outstanding usage.

Current list prices per million tokens from Groq's Models page:

  • GPT-OSS 120B: $0.15 input, $0.60 output.
  • GPT-OSS 20B: $0.075 input, $0.30 output.
  • Qwen3.8 27B: $0.80 input, $4.00 output.
  • Whisper Large V3: $0.111 per hour of audio; Whisper Large V3 Turbo: $0.04 per hour.

To put that in perspective, a day that uses 1 million input tokens and 200K output tokens on GPT-OSS 120B comes to $0.15 + $0.12 = $0.27 at list price. That's five times the Free plan's daily token budget on that model. Cached input tokens get a 50% discount, and so does the Batch API (the two discounts don't stack).

The Developer plan's base limits for GPT-OSS 120B jump to 1K RPM, 500K RPD and 250K TPM with no daily token cap listed. Whisper Large V3 goes to 300 RPM and 200K audio seconds per hour.

Three Developer-only tools worth knowing

  • Flex tier: add "service_tier": "flex" to a request for 10x the on-demand rate limits at the same price. The trade-off is that, when flex capacity runs out, requests fail fast with status 498 and capacity_exceeded, so you need jittered backoff and retries. "auto" lets Groq pick the best tier available to you.
  • Batch API: 50% cheaper, with a processing window you set from 24 hours to 7 days, and it doesn't touch your normal rate limits. Good for evaluations, bulk classification and backfills.
  • Spend limits: under Settings → Billing → Limits, click Add Limit, enter a monthly USD budget and add email alerts (Groq suggests 50%, 75% and 90%). Only an organization owner on a paid tier can set this.

Groq vs Cerebras: free allowance and paid tiers

Cerebras is the obvious alternative because it also sells very fast inference for GPT-OSS 120B. The big difference is the free side: Cerebras says plainly that it has no permanently free tier. Prices below are list prices from each company's official pages on 2026-11-01. Both are usage-based, with no monthly or annual plan.

Option Cost to start GPT-OSS 120B limits GPT-OSS 120B price (per 1M tokens) Worth knowing
Groq Free $0, no payment method needed 30 RPM, 1K RPD, 8K TPM, 200K TPD Free within limits Doesn't expire; no Batch, Flex or spend limits
Groq Developer Pay as you go, billed in arrears 1K RPM, 500K RPD, 250K TPM $0.15 in / $0.60 out Flex (10x limits), Batch (-50%), spend limits, chat support
Cerebras Free Trial One-time $5 credit after adding a payment method 5 RPM, 30K uncached TPM, 90K total TPM, 1M TPH, 1M TPD Paid from the $5 credit Credit expires after 30 days; access pauses when it runs out
Cerebras Developer Buy pay-as-you-go credits 1K RPM, 1M uncached TPM, 3M total TPM, no hourly/daily caps $0.35 in / $0.75 out Labeled for development and evaluation, not production

In short: Groq is cheaper per token on GPT-OSS 120B and the only one of the two that's free indefinitely. Cerebras gives far more tokens per minute on its paid tier and counts only uncached tokens against its main limit. Also note that the model IDs differ: Groq uses qwen/qwen3.8-27b, while Cerebras uses qwen-3.8-27b.

Editor's note

Good fit: developers prototyping chat features, agents or transcription who want a free key that doesn't expire, and small projects that can live within 1,000 requests and 200K tokens a day.

Not a good fit: anything user-facing with unpredictable traffic on the Free plan (one busy hour can lock you out until the minute or day resets), or teams that need Llama models without an Enterprise contract.

Common errors and fixes:

  • 429 Too Many Requests: you've hit RPM, RPD, TPM or TPD. Read retry-after, trim long prompts (TPM is usually the culprit) and keep stable prompt prefixes so caching helps.
  • Requests fail with an old model name: Llama 3.1 8B and 3.3 70B are gone for free and Developer accounts. Use openai/gpt-oss-20b or openai/gpt-oss-120b.
  • 498 capacity_exceeded: only happens on the Flex tier. Retry with backoff or drop back to on_demand.
  • 400 with blocked_api_access: you've reached your own spend limit. Raise or remove it on the Limits page, or wait for the reset on the 1st of the month. Spend tracking lags 10 to 15 minutes, so you can slightly overshoot the cap.
  • Can't find the spend-limits page: it doesn't exist on the Free plan and needs organization-owner permission.

Server errors (500, 502, 503) aren't charged, so retrying them doesn't cost extra. You'll find screenshots of the official Groq and Cerebras pages I used at the end of this post.

FAQ

Is the Groq API really free?

Yes. The Free plan needs no payment method and doesn't expire, but every model has per-minute and per-day caps. You pay only if you upgrade to the Developer plan, and then only for what you use.

Can I use the OpenAI SDK with Groq?

Yes. Groq's API is mostly OpenAI-compatible. Point the client's base_url at https://api.groq.com/openai/v1, pass your Groq key, and use a Groq model ID such as openai/gpt-oss-120b. A few OpenAI features aren't supported, so check the compatibility page if a parameter is rejected.

When should I upgrade from Free to Developer?

Upgrade when you regularly hit the daily token cap, need more than 8K tokens a minute for long contexts, or want Batch processing and a spend limit. With no upfront fee and a low per-token price, the main reason to wait is if you don't want a card on file yet.

Related on lightmind24: OpenRouter Free Models: Limits, Fees and When to Pay, Tavily vs Exa vs Brave Search API: Free Tiers and Real Costs, and Deepgram vs AssemblyAI vs Gladia: Speech-to-Text API Costs.

Start on the Free plan, watch your token headers, and upgrade the day the daily cap starts shaping your product decisions.

Images: screenshots of Groq's public documentation (console.groq.com/docs) and Cerebras' public pricing page (cerebras.ai), captured by lightmind24.

Last verified: 2026-11-01

Sources: Groq Rate Limits, Groq Models, Groq Billing FAQs, Groq Spend Limits, Groq Flex Processing, Groq Service Tiers, Groq Batch API, Groq Prompt Caching, Groq Deprecations, Groq Quickstart, Groq OpenAI Compatibility, Groq Error Codes, Cerebras Rate Limits, Cerebras Pricing.

Uploaded Image Uploaded Image Uploaded Image Uploaded Image

댓글

이 블로그의 인기 게시물

브루(Vrew) 요금제 정리: 무료 200크레딧으로 어디까지 쓸 수 있나

요약: 영상 자막 편집기 브루(Vrew)는 2026년 4월 22일부터 기능별 사용량 대신 '통합 크레딧' 하나로 요금을 매겨요. 무료 플랜은 매달 200크레딧이 들어오는데, 음성 분석(자동 자막)만 쓰면 최대 200분 분량이라 짧은 영상 몇 편은 충분하지만, 영상 초반의 Vrew 마크를 지우려면 유료 플랜이 필요해요. 이 글은 브루 공식 가격 페이지와 고객센터 공지를 2026년 10월 23일에 다시 확인해, 크레딧 계산법과 플랜 고르는 기준을 정리했어요. 목차 브루 요금 구조: 통합 크레딧이란 1크레딧으로 할 수 있는 일 무료 플랜으로 되는 것과 안 되는 것 유료 플랜 4종 비교표 월 구독·연 구독·기간 이용권, 무엇이 이득일까 상황별 추천: 학생·직장인·유튜버 크레딧이 모자랄 때: 사용 기록 지우개 업그레이드·환불 전에 알아둘 규칙 운영자 메모, 자주 묻는 질문 1. 브루 요금 구조: 통합 크레딧이란 예전 브루는 플랜마다 음성 분석 몇 분, AI 목소리 몇 자, 번역 몇 자처럼 기능별 한도를 따로 줬어요. 그런데 보이저엑스(브루 운영사)가 실제 이용 데이터를 보니 한두 가지 기능만 집중해서 쓰는 사람이 훨씬 많았다고 해요. 그래서 2026년 4월 22일 업데이트부터는 플랜마다 정해진 크레딧을 받고, 어떤 기능에 쓸지는 내가 정하는 방식으로 바뀌었어요. 플랜별 매달 지급량은 Free 200 · Light 2,000 · Standard 10,000 · Business 12,000크레딧 이에요. 공식 공지에 따르면 무료 사용자는 매달 1일에, 유료 사용자는 매월 결제일에 충전되고, 남은 크레딧은 다음 달로 넘어가지 않아요. 바뀐 뒤 무엇이 좋아졌나 공지에 나온 예시가 이해하기 쉬워요. Standard 플랜에서 AI 목소리만 쓰면 예전에는 최대 50만 자였지만, 지금은 1만 크레딧을 모두 AI 목소리에 몰아 쓸 수 있어 최대 100만 자가 돼요. 반대로 여러 기능을 골고루 쓰는 사람은 크레딧이 기능끼리 ...

에이닷 전화 vs 익시오: 통화 녹음·AI 요약, 내 통신사·폰에 맞는 앱 고르기

요약: 통화 녹음과 AI 요약을 쓰고 싶다면 먼저 내 통신사와 휴대폰 종류부터 확인해야 해요. LG유플러스 고객은 무료 앱 익시오, SKT 고객은 에이닷 전화가 가장 기능이 많고, 다른 통신사의 아이폰 사용자는 iOS에 들어 있는 기본 통화 녹음·전사 기능이 현실적인 선택이에요. 이 글은 2026-10-30에 SKT·LG유플러스·Apple 공식 페이지와 도움말을 직접 확인해 세 가지를 비교했어요. 왜 '앱 기능'보다 '내 조건'을 먼저 봐야 할까요 통화 요약 앱 비교 글을 보면 기능 목록부터 나열하는 경우가 많아요. 그런데 실제로 써 보려는 사람에게 가장 먼저 걸리는 건 기능이 아니라 이용 조건 이에요. 익시오는 LG유플러스 고객 전용이고, 에이닷 전화는 누구나 설치할 수 있지만 통역콜·baro 같은 기능은 SKT 고객에게만 열려 있어요. 아이폰은 운영체제 구조상 앱이 통화를 마음대로 녹음하기 어려워서, 통신사 앱이 안 되면 iOS 기본 기능에 기대야 해요. 그래서 이 글은 "어떤 앱이 제일 좋은가"보다 "내 통신사·내 폰에서 무엇을 쓸 수 있나" 순서로 정리했어요. 기능 차이는 그다음이에요. 한눈에 비교: 에이닷 전화 vs 익시오 vs 아이폰 기본 통화 녹음 구분 에이닷 전화 (SKT) 익시오 ixi-O (LG유플러스) 아이폰 기본 통화 녹음 (Apple) 누가 쓸 수 있나 통신사 구분 없이 앱 설치 가능. 단, 통역콜·baro·그룹통화 발신 등은 SKT 고객 전용 U+ 모바일 고객. 타 통신사, 만 14세 미만, 선불요금제 고객은 제한 (공식 사이트 FAQ상 알뜰폰 중 KB리브엠은 예외) 지원 국가·언어의 iPhone 사용자. 1명과 통화할 때만 녹음 가능 지원 OS·기기 Android 10 이상, iOS 16 이상 iOS 17 이상 iPhone 12 이상 / Android...

타입캐스트 vs 클로바더빙: 수익 나는 채널에 쓸 때 무료·유료 조건 비교

요약 타입캐스트와 클로바더빙은 둘 다 글만 입력하면 한국어 AI 목소리를 만들어 주는 서비스지만, 무료로 쓸 수 있는 범위가 꽤 다릅니다. 클로바더빙 무료는 매달 15,000자까지 쓸 수 있는 대신 수익이 생기는 채널에는 쓸 수 없고, 타입캐스트 무료는 처음에 주는 약 5분 분량의 다운로드로 끝나는 체험판에 가깝습니다. 광고 수익이 붙은 유튜브나 쇼핑몰 영상에 넣을 목소리라면 처음부터 유료 플랜 조건을 보고 고르는 편이 안전합니다. 왜 이 두 서비스를 같이 비교하나 쇼츠 내레이션, 수업 자료 더빙, 상품 소개 영상처럼 "내 목소리 대신 AI 목소리"가 필요할 때 한국 사용자들이 가장 많이 찾는 곳이 네오사피엔스의 타입캐스트 와 네이버의 클로바더빙 입니다. 기능 소개만 보면 비슷해 보이지만, 실제로 문제가 되는 건 음질보다 "이 목소리를 내 채널에 써도 되나" 입니다. 그래서 이 글은 기능 나열보다 무료 사용 범위, 출처 표기 의무, 유료 플랜 가격과 다운로드 한도를 중심으로 정리했습니다. 모든 수치는 2026년 10월 25일에 두 서비스의 공식 요금 페이지와 고객센터 도움말에서 직접 다시 확인한 내용입니다. 한눈에 보는 비교표 항목 타입캐스트 무료 타입캐스트 베이직 클로바더빙 Free 클로바더빙 Standard 월 요금 0원 9,900원 (연간 결제 시 10% 할인) 0원 19,900원 (네이버 클라우드 플랫폼에서 결제) 무료·포함 사용량 음성 생성·재생 무제한, 다운로드는 최초 3,000크레딧(약 5분) 1회 지급 월 30,000크레딧(약 60분) 월 15,000자, 다운로드 월 20회, 프로젝트 누적 5개 (매월 1일 갱신) 월 30,000자, 다운로드 월 40회, 프로젝트 누적 20개 쓸 수 있...