Apps & Tools
NVMe-to-PCIe RAM Adapter
High-speed NVMe-to-PCIe storage rig for LLM expert offloading
by0xSero
Is this your creation?
Description
A hardware and software configuration using an ASUS Hyper M.2 Gen 5 card and Samsung 990 Pro SSDs to enable expert offloading for large language models. The setup aims to run 35B+ parameter models like Qwen 3.6 on systems with limited VRAM (8-12GB) by leveraging high PCIe bandwidth for weights.
Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.