Gemma 4 26B-A4B · vLLM · NVFP4 + EAGLE3 · conc 1

status: done

Configuration

Modelgoogle/gemma-4-26B-A4B-it
CompanyGoogle
FamilyGemma
Parameters26B / 4B (MoE)
EnginevLLM + EAGLE3 (speculative decoding)
Quant / precisionNVFP4
Why this quantNVIDIA NVFP4 base (modelopt) + RedHatAI's official EAGLE3 speculator (RedHatAI/gemma-4-26B-A4B-it-speculator.eagle3) — the EAGLE3 line of the crossover figure.
Downloadnvidia/Gemma-4-26B-A4B-NVFP4
Context window65536
Input modalitiestext, image (served text-only here)

Measured results

Prefill tok/s91.85
Decode tok/s50.07
Peak memory (GB)109.03 (system MemAvailable delta (10s sampling) — vLLM static KV reservation (util 0.85) + EAGLE3 head)
Completed2026-07-03 17:54 +0800

Full run command

VLLM_IMAGE=vllm/vllm-openai:nightly-aarch64 scripts/bench-vllm-serving.sh nvidia/Gemma-4-26B-A4B-NVFP4 65536 1 300 300 256 \
  --speculative-config '{"model":"RedHatAI/gemma-4-26B-A4B-it-speculator.eagle3","method":"eagle3","num_speculative_tokens":3}'
# 62/300 prompts (hit the time cap), 0 errors, 302.4s. ready after 347s. TTFT median 103.2 ms, TPOT median 19.0 ms, req thr 0.205/s.
# SpecDecoding: mean acceptance length 2.02 (1.82-2.40) · avg draft acceptance 34% (27-47%) · per-position ~0.56/0.30/0.15.

gemma-4-26b-a4b Google Gemma NVFP4 16-40B conc-1

Notes

Decode 50.07 tok/s aggregate at concurrency 1. NVFP4 + RedHatAI EAGLE3 speculator, conc 1, for the crossover figure.

  • Image (pinned): vllm/vllm-openai:nightly-aarch64 @ sha256:e414712fdc04… — the SINGLE image for all 24 cells of this figure. Ready after 347 s.
  • Workload: ShareGPT V3, concurrency 1. 62/300 completed, 0 errors before the 300 s time cap.
  • Throughput: decode 50.07 tok/s aggregate, prefill 91.85 tok/s. TTFT median 103.2 ms, TPOT median 19.0 ms, req throughput 0.205/s.
  • Spec-decode acceptance: mean acceptance length 2.02 (1.82-2.40) · avg draft acceptance 34% (27-47%) · per-position ~0.56/0.30/0.15 (num_speculative_tokens=3).
  • Memory: 109.03 GB = vLLM --gpu-memory-utilization 0.85 reservation, not the model footprint.