Apps & Tools
tiny-llm
Build a high-performance LLM serving system from scratch with MLX on Apple Silicon
Is this your creation?
PlayableOpen source
Description
A hands-on systems engineering course that teaches how to build an LLM inference stack. It covers implementing multi-head attention, KV caching, quantization, and SIMD matrix operations, culminating in a mini vLLM-style server and a local coding agent.
Descriptions, tags, and model credits may be AI-generated or inferred from public sources and can be incomplete or wrong. Learn more.