Keyboard shortcuts

Press ← or → to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

Upgrade to 0.6.0

MiRMiR 0.6.0 adds remote access to the runtime, the Mirmir for Mac app, and image input for Nemotron Omni on CUDA. mirtal, mircuda, mircup, libmir, their support crates and mirmir move to 0.6.0 together.

cargo install mirmir --version 0.6.0 --locked
mirmir --version
mirmir config validate

Restart the runtime after upgrading: attaching a new client does not replace a running server.

What changes

  • Remote access. mirmir remote enable serves the runtime over TLS with scoped API keys; clients use --remote or Mirmir for Mac. Nothing listens remotely until you enable it. See Remote access.
  • Mirmir for Mac. A native menu bar and window app; see Mirmir for Mac.
  • Nemotron Omni images on CUDA. Checkpoints with the RADIO vision encoder accept images through /v1/chat/completions. The vision weights now count toward the model’s resident memory; on a shared GB10, lower the model’s kv_blocks if smaller models no longer fit beside it. Metal reports image input for these checkpoints as unavailable. Images are sized by the checkpoint processor’s rule; for the few aspect ratios where that rule would exceed the patch budget (very long, thin images), MiRMiR fits the grid to the budget instead, so those images use fewer image tokens than the Hugging Face processor reports.
  • Telemetry memory. Host RAM and the accelerator budget are reported separately with a typed memory pool (runtime protocol 2). The HTTP dashboard JSON keeps its shape.
  • Local model paths. ListLocalModels reports canonical paths, so models reached through a symlinked cache show the right state.

gRPC clients

The private runtime protocol is now version 2. A client built for protocol 1 is refused with a request to update. The removed telemetry fields are listed in mirmir/docs/protocol.md.

Configuration

New optional keys: server.remote_bind, server.remote_tls_cert and server.remote_tls_key. Existing configuration files stay valid.

Rust consumers

Update the libmir requirement to 0.6.0. Source changes from 0.5.5:

Public APIRequired adaptation
libmir_models::layout::VisionPipelineNew variant PixelShuffleEncoder; add an arm or a wildcard to exhaustive matches.
libmir_models::layout::VisionConfigNew variant PixelShuffleEncoder(PixelShuffleVisionConfig).
libmir_models::layout::ImageProcessorConfigNew variant PixelShuffle(PixelShuffleImageProcessorConfig).
libmir::PreparedVisionPromptNew variant PixelShuffle; add an arm or a wildcard to exhaustive matches.
libmir_metal::engine::hybrid_moeMoved to libmir_metal::engine::hybrid::moe.
libmir_metal::engine::hybrid_linear_moeMoved to libmir_metal::engine::hybrid::linear_moe.