Apps & Tools
Qwen3.8-27B MTP
Unlock +33-39% decode speed for Qwen3.8-27B with a single llama.cpp flag.
bySudo su
Open source
Qwen3.8-27B MTP media is blocked
Allow external media to connect to the provider and play this content.
Description
A repository providing the recipe, paired benchmarks, and a probe tool to enable Multi-Token Prediction (MTP) speculative decoding for Qwen3.8-27B. It includes community-derived tuning rules for maximizing inference throughput across various GPU architectures from Pascal to Blackwell.
Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.