Qwen3.8-Flash-Next-APEX-GGUF

All projects

Apps & Tools

Qwen3.8-Flash-Next-APEX-GGUF

Optimized APEX quantized GGUF weights to run the 177B Qwen MoE model on consumer hardware.

bymudler

Playable

Qwen3.8-Flash-Next-APEX-GGUF media is blocked

Allow external media to connect to the provider and play this content.

Description

A set of high-efficiency quantizations for the Qwen3.8-Flash-Next 177B parameter Mixture of Experts model. Using the APEX methodology, it optimizes VRAM usage by allocating bits based on layer sensitivity, allowing the 'Nano' tier to fit on a single 48GB card despite the massive parameter count.

Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.

Details

Why this is interesting: Technical feat showing how 177B parameter models can be intelligently compressed via layer-sensitivity analysis to run…
Attributed to: @mudler
Built with: V4.1 Flash Gemini 3.8 Flash Cyber 3.8 Flash Ling 3.0 Flash Fin Omni 1.1 Flash Qwen3.8-Flash-Next Qwen3.8-27B Gemini 3.7 Flash Qwen3.7 Flash 3.6 Flash 3.5 Flash Cyber Step 3.7 Flash Gemini 3.5 Flash 2.5 Flash Qwen3 8B Qwen3 30B-A3B Qwen3 14B
Links: huggingface.co
View tweet
Tags: #llm #gguf #quantization #moe

Discovered: X
First posted: X · Sep 11, 2026
Listed: Added 2h ago
Build: Strong
Models: Strong