Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Upgrade to 0.6.2

MiRMiR 0.6.2 makes Metal faster and broader, and Mirmir for Mac smaller. All native crates and Mirmir for Mac move to 0.6.2 together; configuration, protocol 2 and the HTTP API are unchanged.

cargo install mirmir --version 0.6.2 --locked
mirmir --version

Restart the runtime after upgrading.

What changes

  • Faster Metal. Prefill keeps long contexts in full chunks, decode attends over a persistent K/V history shared by concurrent requests, and K/V admission is bounded by pending prefill, so deep, concurrent requests fit in memory. On an Apple M5 Pro, mirmir is ahead of MLX-LM on Qwen3.6-35B-A3B and Gemma 4 26B-A4B; see the benchmarks.
  • More models on Metal. Dense linear-attention models, dense GELU Gemma models, Nemotron-H state-space hybrids and the pixel-shuffle vision encoder of Nemotron Omni run on Metal.
  • Mirmir for Mac is about 76 MB instead of 320 MB and runs on macOS 26.2 or later. Its Metal kernels compile on first use: the first request after installing or updating the app, or after a macOS update, takes a moment longer.

Building from source

MLX 0.32.4 remains the native requirement. Workmir’s scripts/mlx/setup.sh builds it with Metal JIT for macOS 26.2 and applies a fix for its JIT d-split attention kernel; a prebuilt MLX 0.32.4 works as before.