Apps & Tools
Unsloth 1-bit Kimi K3 GGUF
Extreme 1-bit dynamic quantization of Moonshot AI's 2.8T parameter Kimi K3 LLM.
PlayableOpen source
Unsloth 1-bit Kimi K3 GGUF media is blocked
Allow external media to connect to the provider and play this content.
Description
Unsloth has released optimized GGUF quants for Kimi K3, a massive 2.8T parameter model (104B active). By using dynamic 1-bit and 2-bit quantization, they reduced the model size by up to 62% while maintaining near-SOTA accuracy, making local execution feasible on high-end hardware like DGX Stations and Mac Studios.
Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.