Upgrade to 0.6.0
MiRMiR 0.6.0 adds remote access to the runtime, the Mirmir for Mac app, and
image input for Nemotron Omni on CUDA. mirtal, mircuda, mircup, libmir,
their support crates and mirmir move to 0.6.0 together.
cargo install mirmir --version 0.6.0 --locked
mirmir --version
mirmir config validate
Restart the runtime after upgrading: attaching a new client does not replace a running server.
What changes
- Remote access.
mirmir remote enableserves the runtime over TLS with scoped API keys; clients use--remoteor Mirmir for Mac. Nothing listens remotely until you enable it. See Remote access. - Mirmir for Mac. A native menu bar and window app; see Mirmir for Mac.
- Nemotron Omni images on CUDA. Checkpoints with the RADIO vision encoder
accept images through
/v1/chat/completions. The vision weights now count toward the model’s resident memory; on a shared GB10, lower the model’skv_blocksif smaller models no longer fit beside it. Metal reports image input for these checkpoints as unavailable. Images are sized by the checkpoint processor’s rule; for the few aspect ratios where that rule would exceed the patch budget (very long, thin images), MiRMiR fits the grid to the budget instead, so those images use fewer image tokens than the Hugging Face processor reports. - Telemetry memory. Host RAM and the accelerator budget are reported separately with a typed memory pool (runtime protocol 2). The HTTP dashboard JSON keeps its shape.
- Local model paths.
ListLocalModelsreports canonical paths, so models reached through a symlinked cache show the right state.
gRPC clients
The private runtime protocol is now version 2. A client built for protocol 1
is refused with a request to update. The removed telemetry fields are listed in
mirmir/docs/protocol.md.
Configuration
New optional keys: server.remote_bind, server.remote_tls_cert and
server.remote_tls_key. Existing configuration files stay valid.
Rust consumers
Update the libmir requirement to 0.6.0. Source changes from 0.5.5:
| Public API | Required adaptation |
|---|---|
libmir_models::layout::VisionPipeline | New variant PixelShuffleEncoder; add an arm or a wildcard to exhaustive matches. |
libmir_models::layout::VisionConfig | New variant PixelShuffleEncoder(PixelShuffleVisionConfig). |
libmir_models::layout::ImageProcessorConfig | New variant PixelShuffle(PixelShuffleImageProcessorConfig). |
libmir::PreparedVisionPrompt | New variant PixelShuffle; add an arm or a wildcard to exhaustive matches. |
libmir_metal::engine::hybrid_moe | Moved to libmir_metal::engine::hybrid::moe. |
libmir_metal::engine::hybrid_linear_moe | Moved to libmir_metal::engine::hybrid::linear_moe. |