grok-4 vs gemini-2.5-flash
Side-by-side comparison of grok-4 and gemini-2.5-flash — benchmarks, pricing, context window and capabilities. Both are accessible through Requesty's unified API. grok-4 outperforms gemini-2.5-flash on 8 of 8 shared benchmarks.
xAI Corp.
grok-4
Input / 1M
$3.00
Output / 1M
$15.00
Context
256K
Model ID
xai/grok-4
gemini-2.5-flash
Input / 1M
$0.30
Output / 1M
$2.50
Context
1.0M
Model ID
google/gemini-2.5-flash
Benchmark comparison
MMLU Proknowledge
grok-487.5%
gemini-2.5-flash78.4%
GPQA Diamondreasoning
grok-487.5%
gemini-2.5-flash68.3%
HumanEvalcoding
grok-493.8%
gemini-2.5-flash88.5%
SWE-Bench Verifiedcoding
grok-472.5%
gemini-2.5-flash53.2%
MATHmath
grok-494.1%
gemini-2.5-flash85.3%
AIME 2024math
grok-490.1%
gemini-2.5-flash72.1%
MMMUmultimodal
grok-477.9%
gemini-2.5-flash72.5%
LiveBenchreasoning
grok-475.4%
gemini-2.5-flash64.2%
τ-bench Retailagentic
grok-4—
gemini-2.5-flash61.5%
Scores sourced from official model cards, Artificial Analysis, and public leaderboards. Benchmarks measure specific skills and don't capture every aspect of model quality.
Pricing & specifications
| grok-4 | gemini-2.5-flash | |
|---|---|---|
| Input price / 1M | $3.00 | $0.30 |
| Output price / 1M | $15.00 | $2.50 |
| Context window | 256K tokens | 1.0M tokens |
| Max output | — | 66K tokens |
| Vision input | Yes | Yes |
| Tool calling | Yes | Yes |
| Reasoning | — | Yes |
| Prompt caching | Yes | Yes |
| Computer use | Yes | — |
| Provider | xAI Corp. | Google LLC (Gemini API) |
Questions people ask
Is grok-4 better than gemini-2.5-flash?
grok-4 outperforms gemini-2.5-flash on 8 of 8 shared benchmarks. See the benchmark comparison above for specifics — grok-4 and gemini-2.5-flash have different strengths across reasoning, coding, math and multimodal tasks.
Which is cheaper — grok-4 or gemini-2.5-flash?
gemini-2.5-flash is cheaper. grok-4 costs $3.00/$15.00 per 1M input/output tokens, while gemini-2.5-flash costs $0.30/$2.50.
Can I use grok-4 and gemini-2.5-flash through the same API?
Yes. Requesty provides a single OpenAI-compatible API that routes to both. Change just the "model" parameter to switch — "xai/grok-4" or "google/gemini-2.5-flash" — no other code changes needed.
What are the context windows?
grok-4 supports up to 256K tokens of context. gemini-2.5-flash supports up to 1.0M tokens. Longer context means you can feed larger documents or codebases in a single prompt, though quality often degrades past 128K for most models.
Switch between grok-4 and gemini-2.5-flash with one line of code
Requesty provides a single OpenAI-compatible API for 400+ models. Change the model parameter, not your code.
Get started free