Upgrade to 0.6.2
MiRMiR 0.6.2 makes Metal faster and broader, and Mirmir for Mac smaller. All native crates and Mirmir for Mac move to 0.6.2 together; configuration, protocol 2 and the HTTP API are unchanged.
cargo install mirmir --version 0.6.2 --locked
mirmir --version
Restart the runtime after upgrading.
What changes
- Faster Metal. Prefill keeps long contexts in full chunks, decode attends over a persistent K/V history shared by concurrent requests, and K/V admission is bounded by pending prefill, so deep, concurrent requests fit in memory. On an Apple M5 Pro, mirmir is ahead of MLX-LM on Qwen3.6-35B-A3B and Gemma 4 26B-A4B; see the benchmarks.
- More models on Metal. Dense linear-attention models, dense GELU Gemma models, Nemotron-H state-space hybrids and the pixel-shuffle vision encoder of Nemotron Omni run on Metal.
- Mirmir for Mac is about 76 MB instead of 320 MB and runs on macOS 26.2 or later. Its Metal kernels compile on first use: the first request after installing or updating the app, or after a macOS update, takes a moment longer.
Building from source
MLX 0.32.4 remains the native requirement. Workmir’s scripts/mlx/setup.sh
builds it with Metal JIT for macOS 26.2 and applies a fix for its JIT
d-split attention kernel; a prebuilt MLX 0.32.4 works as before.