grok-4 vs gemini-2.5-pro
Side-by-side comparison of grok-4 and gemini-2.5-pro — benchmarks, pricing, context window and capabilities. Both are accessible through Requesty's unified API. grok-4 outperforms gemini-2.5-pro on 7 of 8 shared benchmarks.
xAI Corp.
grok-4
Input / 1M
$3.00
Output / 1M
$15.00
Context
256K
Model ID
xai/grok-4
gemini-2.5-pro
Input / 1M
$1.25
Output / 1M
$10.00
Context
1.0M
Model ID
google/gemini-2.5-pro
Benchmark comparison
MMLU Proknowledge
grok-487.5%
gemini-2.5-pro86.2%
GPQA Diamondreasoning
grok-487.5%
gemini-2.5-pro84.0%
HumanEvalcoding
grok-493.8%
gemini-2.5-pro93.2%
SWE-Bench Verifiedcoding
grok-472.5%
gemini-2.5-pro63.8%
MATHmath
grok-494.1%
gemini-2.5-pro91.4%
AIME 2024math
grok-490.1%
gemini-2.5-pro88.0%
MMMUmultimodal
grok-477.9%
gemini-2.5-pro81.7%
LiveBenchreasoning
grok-475.4%
gemini-2.5-pro73.6%
τ-bench Retailagentic
grok-4—
gemini-2.5-pro69.8%
Scores sourced from official model cards, Artificial Analysis, and public leaderboards. Benchmarks measure specific skills and don't capture every aspect of model quality.
Pricing & specifications
| grok-4 | gemini-2.5-pro | |
|---|---|---|
| Input price / 1M | $3.00 | $1.25 |
| Output price / 1M | $15.00 | $10.00 |
| Context window | 256K tokens | 1.0M tokens |
| Max output | — | 66K tokens |
| Vision input | Yes | Yes |
| Tool calling | Yes | Yes |
| Reasoning | — | Yes |
| Prompt caching | Yes | Yes |
| Computer use | Yes | — |
| Provider | xAI Corp. | Google LLC (Gemini API) |
Questions people ask
Is grok-4 better than gemini-2.5-pro?
grok-4 outperforms gemini-2.5-pro on 7 of 8 shared benchmarks. See the benchmark comparison above for specifics — grok-4 and gemini-2.5-pro have different strengths across reasoning, coding, math and multimodal tasks.
Which is cheaper — grok-4 or gemini-2.5-pro?
gemini-2.5-pro is cheaper. grok-4 costs $3.00/$15.00 per 1M input/output tokens, while gemini-2.5-pro costs $1.25/$10.00.
Can I use grok-4 and gemini-2.5-pro through the same API?
Yes. Requesty provides a single OpenAI-compatible API that routes to both. Change just the "model" parameter to switch — "xai/grok-4" or "google/gemini-2.5-pro" — no other code changes needed.
What are the context windows?
grok-4 supports up to 256K tokens of context. gemini-2.5-pro supports up to 1.0M tokens. Longer context means you can feed larger documents or codebases in a single prompt, though quality often degrades past 128K for most models.
Switch between grok-4 and gemini-2.5-pro with one line of code
Requesty provides a single OpenAI-compatible API for 400+ models. Change the model parameter, not your code.
Get started free