FREE AI INDEX / 统一产品界面我的收藏提交资源 ↗

FreeLLM 免费 AI 资源索引FreeLLM Free AI Index / 资源详情Offer details

Groq · free plan rate limitsGroq · free plan rate limits

Groq · InternationalGroq

✓ 实测通过✓ Network verified国内外均可用China + global国内 759ms · 海外 93msChina 759ms · Global 93ms✓ 接口已验证 · 512ms✓ Endpoint verified · 512ms

这个资源提供什么What this offer provides

Groq's official rate limits documentation publishes a 'Free Plan Limits' table with per-model RPM, RPD and TPM caps (for example openai/gpt-oss-120b: 30 RPM, 1K RPD, 8K TPM), alongside a paid Developer plan for higher limits.Groq's official rate limits documentation publishes a 'Free Plan Limits' table with per-model RPM, RPD and TPM caps (for example openai/gpt-oss-120b: 30 RPM, 1K RPD, 8K TPM), alongside a paid Developer plan for higher limits.

关键信息Key details

免费方式Free methodFree plan with per-model RPM / RPD / TPM limits (e.g. gpt-oss-120b: 30 RPM · 1K RPD · 8K TPM)Free plan with per-model RPM / RPD / TPM limits (e.g. gpt-oss-120b: 30 RPM · 1K RPD · 8K TPM)
有效期ValidityOngoing free plan; exact limits per model can changeOngoing free plan; exact limits per model can change
访问条件AccessGroq account; rate limits apply at organization levelGroq account; rate limits apply at organization level
最后核验Last checked2026-09-17

快速上手Quick start

Call hosted models on Groq's OpenAI-compatible API under the free plan limitsFollow the model-specific steps to register, create a key and connect the model.

✓

注册与接入步骤Registration and access steps

准备条件Prerequisites

  • Groq account
  • API key from the Groq console
  1. Create a Groq account and generate an API key in the consoleCreate a Groq account and generate an API key in the console
  2. Send an OpenAI-compatible chat completion request and stay within the per-model free plan rate limitsSend an OpenAI-compatible chat completion request and stay within the per-model free plan rate limits
4

发送第一条请求Send first request

使用下方命令开始调用。Use the command below to make your first request.

可复制命令Copyable command
export GROQ_API_KEY="你的 Key"
curl https://api.groq.com/openai/v1/chat/completions --header "Authorization: Bearer $GROQ_API_KEY" --header 'Content-Type: application/json' --data '{"model":"openai/gpt-oss-20b","messages":[{"role":"user","content":"Hello"}]}'

详细操作步骤Detailed operation paths

每条路径都拆成前置条件、步骤、可复制命令和验证动作;免费条件仍以官方页面实时状态为准。curl 命令按 macOS / Linux shell 编写,Windows 用户可使用同页的 Python 或 Node.js 示例。Each path includes prerequisites, steps, copyable commands and a validation action; free terms still follow the provider's live official policy. The curl examples use a macOS/Linux shell; Windows users can run the Python or Node.js examples on this page.

Groq OpenAI 兼容 API

api

EndpointEndpoint
https://api.groq.com/openai/v1
认证Authentication
Authorization: Bearer API key
额度与限制Limits

调用额度与限流按提供商当前控制台和官方文档为准;免费条件可能按模型、账号和地区变化。

前置条件Prerequisites

  • 已注册 Groq ConsoleGroq Console
  • 已创建 API keyAPI key
  • 已阅读当前 Free Plan LimitsFree Plan Limits

操作步骤Steps

  1. 创建密钥

    在 Groq Console 的 API Keys 页面创建密钥,并保存为 GROQ_API_KEY 环境变量。

  2. 确认模型与限制

    从官方 Models 页面选择当前可用模型,再按 Rate Limits 页面控制 RPM、RPD 和 TPM。

    操作Action:打开 https://console.groq.com/docs/models

  3. 发送测试请求

    使用官方支持的模型 ID 发起一次短请求。

    命令已在上方「快速上手」给出。The copyable command already appears in Quick start above.

    预期结果Expected:返回 choices,并在超限时得到明确的 rate-limit 响应。

  4. Python SDK 示例

    安装 OpenAI SDK;在运行环境设置 GROQ_API_KEY,示例代码通过环境变量读取密钥。

    可复制命令Copyable command
    python -m pip install -U openai
    
    import os
    from openai import OpenAI
    
    client = OpenAI(
        api_key=os.environ["GROQ_API_KEY"],
        base_url="https://api.groq.com/openai/v1",
    )
    response = client.chat.completions.create(
        model="openai/gpt-oss-20b",
        messages=[{"role": "user", "content": "用一句话解释 API 是什么。"}],
    )
    print(response.choices[0].message.content)

    预期结果Expected:终端打印模型生成的回复;再到提供商控制台确认请求状态和额度扣减。

  5. Node.js SDK 示例

    安装 OpenAI SDK;在运行环境设置 GROQ_API_KEY,示例代码通过环境变量读取密钥。

    可复制命令Copyable command
    npm install openai
    
    import OpenAI from "openai";
    
    const client = new OpenAI({
      apiKey: process.env.GROQ_API_KEY,
      baseURL: "https://api.groq.com/openai/v1",
    });
    const response = await client.chat.completions.create({
      model: "openai/gpt-oss-20b",
      messages: [{ role: "user", content: "用一句话解释 API 是什么。" }],
    });
    console.log(response.choices[0].message.content);

    预期结果Expected:Node.js 打印模型生成的回复;再到提供商控制台确认请求状态和额度扣减。

验证动作Validation

GET /openai/v1/models 返回 HTTP 200,并确认目标模型仍在官方模型列表。

常见问题Common issues
  • 401:检查 API Key、环境变量和认证 Header。401: API Key、 Header。
  • 404:从官方模型清单复制当前模型 ID,并确认 endpoint 与账号地域一致。404: ID, endpoint 。
  • 429:查看当前限流和配额重置说明,降低请求频率后再重试。429: , 。

官方来源Official sources

免费模型逐个看Free models by entry

模型Model上下文窗口Context window免费额度Free quota备注Notes
canopylabs/orpheus-arabic-saudicanopylabs/orpheus-arabic-saudi
Preview · Arabic text-to-speechPreview · Arabic text-to-speech
4,000 tokens4,000 tokens10 RPM · 100 RPD · 1.2K TPM · 3.6K TPD10 RPM · 100 RPD · 1.2K TPM · 3.6K TPDAudio model; free-plan limits are measured in text tokens here.Audio model; free-plan limits are measured in text tokens here.
canopylabs/orpheus-v1-englishcanopylabs/orpheus-v1-english
Preview · English text-to-speechPreview · English text-to-speech
4,000 tokens4,000 tokens10 RPM · 100 RPD · 1.2K TPM · 3.6K TPD10 RPM · 100 RPD · 1.2K TPM · 3.6K TPDAudio model; free-plan limits are measured in text tokens here.Audio model; free-plan limits are measured in text tokens here.
meta-llama/llama-prompt-guard-2-22mmeta-llama/llama-prompt-guard-2-22m
Preview · prompt moderationPreview · prompt moderation
512 tokens512 tokens30 RPM · 14.4K RPD · 15K TPM · 500K TPD30 RPM · 14.4K RPD · 15K TPM · 500K TPDPrompt Guard model.Prompt Guard model.
meta-llama/llama-prompt-guard-2-86mmeta-llama/llama-prompt-guard-2-86m
Preview · prompt moderationPreview · prompt moderation
512 tokens512 tokens30 RPM · 14.4K RPD · 15K TPM · 500K TPD30 RPM · 14.4K RPD · 15K TPM · 500K TPDPrompt Guard model.Prompt Guard model.
openai/gpt-oss-120bopenai/gpt-oss-120b
Production · reasoning and browser/code toolsProduction · reasoning and browser/code tools
131,072 tokens131,072 tokens30 RPM · 1K RPD · 8K TPM · 200K TPD30 RPM · 1K RPD · 8K TPM · 200K TPDOpenAI GPT-OSS 120B.OpenAI GPT-OSS 120B.
openai/gpt-oss-20bopenai/gpt-oss-20b
Production · reasoning and browser/code toolsProduction · reasoning and browser/code tools
131,072 tokens131,072 tokens30 RPM · 1K RPD · 8K TPM · 200K TPD30 RPM · 1K RPD · 8K TPM · 200K TPDOpenAI GPT-OSS 20B.OpenAI GPT-OSS 20B.
openai/gpt-oss-safeguard-20bopenai/gpt-oss-safeguard-20b
Preview · safety classificationPreview · safety classification
131,072 tokens131,072 tokens30 RPM · 1K RPD · 8K TPM · 200K TPD30 RPM · 1K RPD · 8K TPM · 200K TPDSafety-tuned GPT-OSS 20B.Safety-tuned GPT-OSS 20B.
qwen/qwen3.8-27bqwen/qwen3.8-27b
Preview · text and reasoningPreview · text and reasoning
131,042 tokens131,042 tokens30 RPM · 1K RPD · 8K TPM · 200K TPD30 RPM · 1K RPD · 8K TPM · 200K TPDQwen 3.8 27B.Qwen 3.8 27B.
whisper-large-v3whisper-large-v3
Production · speech-to-textProduction · speech-to-text
—(音频模型,无文本上下文窗口)—( , )20 RPM · 2K RPD · 7.2K ASH · 28.8K ASD20 RPM · 2K RPD · 7.2K ASH · 28.8K ASDAudio seconds per hour/day; not a text-context model.Audio seconds per hour/day; not a text-context model.
whisper-large-v3-turbowhisper-large-v3-turbo
Production · speech-to-textProduction · speech-to-text
—(音频模型,无文本上下文窗口)—( , )20 RPM · 2K RPD · 7.2K ASH · 28.8K ASD20 RPM · 2K RPD · 7.2K ASH · 28.8K ASDAudio seconds per hour/day; not a text-context model.Audio seconds per hour/day; not a text-context model.

额度以官方页面和控制台实时显示为准;公测或限免额度可能随时调整。Quota follows the official page and console; preview or limited free access can change.

FreeLLM 实测FreeLLM test · freellm-text-v2 · 22 题 · 7 维度 · 2026-10-19

FreeLLM 模型实测FreeLLM model test

我们用自己的账号直接调用该平台得到的结果(同渠道实测)。Results from calling this platform directly with our own key.

模型Model综合分Score成功率Success首 token p50TTFT p50生成速度Tokens/s报告Report
gpt-oss-120bopenai/gpt-oss-120b95100%202 msp95 466 ms481 token/s报告Report →
qwen3.8-27bqwen/qwen3.8-27b82100%136 msp95 451 ms476 token/s报告Report →
gpt-oss-20bopenai/gpt-oss-20b7795%228 msp95 654 ms755 token/s报告Report →
allam-2-7ballam-2-7b9 受失败影响affected by failures77%252 msp95 447 ms1116 token/s报告Report →

gpt-oss-120b

openai/gpt-oss-120b · Groq · 默认思考模式thinks by default
95分pts
综合分Score95 / 100
成功率Success rate100%(22/22 题有回答)
首 token p50 / p95TTFT p50 / p95202 ms / 466 ms
生成速度(中位)Tokens/s (median)481 token/s
  • 中文知识Chinese knowledge100
  • 推理数学Reasoning & math100
  • 代码Coding100
  • 指令格式Format following100
  • 长文本Long context100
  • 工具调用Tool calling100
  • 防幻觉Anti-hallucination67
首字极快Very fast first token高吞吐High throughput中文知识满分Full marks: Chinese knowledge推理数学满分Full marks: Reasoning & math代码满分Full marks: Coding默认长思考,响应慢Thinks by default, slower

又快又准的全能选手,唯一失分是编造了《红楼梦》第 121 回。

适合Good for
实时对话、代码、工具调用
不建议Avoid for
涉及冷门事实、需要严格不编造的场景

qwen3.8-27b

qwen/qwen3.8-27b · Groq
82分pts
综合分Score82 / 100
成功率Success rate100%(22/22 题有回答)
首 token p50 / p95TTFT p50 / p95136 ms / 451 ms
生成速度(中位)Tokens/s (median)476 token/s
  • 中文知识Chinese knowledge100
  • 推理数学Reasoning & math40
  • 代码Coding100
  • 指令格式Format following100
  • 长文本Long context100
  • 工具调用Tool calling100
  • 防幻觉Anti-hallucination67
首字极快Very fast first token高吞吐High throughput中文知识满分Full marks: Chinese knowledge代码满分Full marks: Coding指令格式满分Full marks: Format following

首字最快的一档(约 0.14 秒),代码和工具调用满分,但数学陷阱题(9.11 vs 9.9)答错。

适合Good for
低延迟聊天、代码、工具调用
不建议Avoid for
数值比较、逻辑题

gpt-oss-20b

openai/gpt-oss-20b · Groq · 默认思考模式thinks by default
77分pts
综合分Score77 / 100
成功率Success rate95%(21/22 题有回答)
首 token p50 / p95TTFT p50 / p95228 ms / 654 ms
生成速度(中位)Tokens/s (median)755 token/s
  • 中文知识Chinese knowledge33
  • 推理数学Reasoning & math80
  • 代码Coding100
  • 指令格式Format following100
  • 长文本Long context50
  • 工具调用Tool calling100
  • 防幻觉Anti-hallucination67
首字极快Very fast first token高吞吐High throughput代码满分Full marks: Coding指令格式满分Full marks: Format following工具调用满分Full marks: Tool calling默认长思考,响应慢Thinks by default, slower中文知识弱Weak: Chinese knowledge

查看该平台全部 4 个实测模型(含不可用端点)All 4 tested models on this platform →

方法:同一套 22 道固定题、temperature=0、全部自动评分;测试节点:GitHub Actions 托管运行器(美国)。数字只代表该时间点、我们的账号和该测试节点,地区与账号不同结果会不同。Method: the same 22 fixed cases, temperature 0, auto-graded; vantage: GitHub Actions (US). Numbers reflect that run, our accounts and that vantage only. 完整报告Full report →

官方来源Official sources

Official Free Plan Limits currently lists qwen/qwen3.8-27b, openai/gpt-oss-120b, openai/gpt-oss-20b and other active models. Groq decommissioned groq/compound and groq/compound-mini on 2026-09-21; qwen/qwen3.6-27b was retired on 2026-09-14 and replaced by qwen/qwen3.8-27b.Official Free Plan Limits currently lists qwen/qwen3.8-27b, openai/gpt-oss-120b, openai/gpt-oss-20b and other active models. Groq decommissioned groq/compound and groq/compound-mini on 2026-09-21; qwen/qwen3.6-27b was retired on 2026-09-14 and replaced by qwen/qwen3.8-27b.

相关资源Related resources