Thriving Thriving C++ C+ Python PY
↑ 29 ?
qwen38-rtx-pro-6000 lEWFkRAD/qwen38-rtx-pro-6000

Reproducible Qwen3.8 deployments on one RTX PRO 6000: Flash-Next W4 PLE, SGLang patches, benchmarks, and field reports.

HEALTH ? 68 / Stable
// solo builder benchmarksblackwellllm-inferencequantizationqwensglang ?

// readme

Qwen3.8 Β· One RTX PRO 6000 project homepage Β· Documentation

Single-GPU inference reports, reproducibility artifacts, and experimental inspection tools.

Qwen3.8 on a single RTX PRO 6000

Independent deployment reports, reproducibility artifacts, and benchmark receipts for running large Qwen3.8 models and related inference experiments on one NVIDIA RTX PRO 6000 Blackwell Workstation Edition.

November 3 β€” 262K production context

The production default now configures eight 262,144-token sessions with resident INT8 KV, all 24,576 GPU experts, matched vision and 8,192-token prefill chunks. Seven normal production canaries passed, including a 259,999-token request and its repeated prefix. Full eight-way deep generation remains unqualified; the operator explicitly approved this default after those test limits were reported. Results, deployment and full test data. A later credential update is approved and live; fresh recovery checks passed. [Recovery…