Qwen3.8-27B · SGLang · NVFP4 + DFlash2 · conc-16
status: blocked
Configuration
| Model | Qwen/Qwen3.8-27B |
|---|
| Company | Alibaba |
|---|
| Family | Qwen |
|---|
| Parameters | 27B (dense, hybrid linear-attn) |
|---|
| Engine | SGLang + DFlash2 (speculative decoding) |
|---|
| Quant / precision | NVFP4 |
|---|
| Why this quant | Same Spark-recipe NVFP4 target (RadixArk/Qwen3.8-27B-NVFP4) as the DSpark line, but DFlash2 block-diffusion draft (z-lab/Qwen3.8-27B-DFlash2 @50307d4) on the derived lmsysorg/sglang:qwen38-27b-dflash2 image. mem-fraction-static 0.90. conc-16 point of the ShareGPT sweep (client conc 1/2/4/8/16/32). |
|---|
| Download | RadixArk/Qwen3.8-27B-NVFP4 |
|---|
| Context window | 262144 |
|---|
| Input modalities | text, image, video (served text-only here) |
|---|
Measured results
| Prefill tok/s | — |
|---|
| Decode tok/s | — |
|---|
| Peak memory (GB) | — |
|---|
| Completed | 2026-08-20 05:25 +0800 |
|---|
Full run command
# Not run — memory ceiling. Last attempted boot used MAX_CONCURRENT_REQUESTS=5.
cd ~/Desktop/Qwen3.8-27B-SGLang-DGX-Spark
MAX_CONCURRENT_REQUESTS=5 ./start-dflash.sh
python3 ~/Desktop/autobench/scripts/bench-serving.py \
--base-url http://127.0.0.1:8888 --model qwen3.8-27b-sglang \
--dataset ~/Desktop/autobench/benchmark_data/ShareGPT_V3_unfiltered_cleaned_split.json \
--num-prompts 1000 --max-seconds 900 --concurrency 16 --max-tokens 256
qwen3.8-27b
Alibaba
Qwen
NVFP4
16-40B
Spark recipe
conc-16
Notes
BLOCKED — memory ceiling, same wall as c8. DFlash2 extra_buffer uses 5 GDN slots/req, so 16 running needs 80 mamba slots; even 8 running died at conc-2 and 4 running died at conc-4. Not attempted.