Native inference, from app to library

MiRMiR 0.3.0 is a native local model runtime with a terminal dashboard, an optional browser dashboard, a command-line interface, and an OpenAI-compatible HTTP server. libmir is the embeddable Rust inference library underneath it.

Use these docs to operate MiRMiR or build your own native application on the same model discovery, loading, generation, K/V cache, Metal, and CUDA layers.

Run MiRMiRInstall the 0.3.0 binary, inspect a compatible checkpoint, and start a local chat. Use the HTTP APIConnect existing OpenAI clients to chat, embeddings, reranking, and streaming endpoints. Embed libmirLoad a checkpoint and stream native inference directly from a Rust program. See the runtimeManage models and inspect throughput, latency, memory, K/V cache, and activity.

Choose a surface

Surface	Use it when
TUI	You want an interactive terminal workflow with no browser.
Web dashboard	You want the same local runtime controls and telemetry in a browser.
CLI	You need scripts, machine-readable output, or repeatable benchmarks.
HTTP API	An existing application already understands OpenAI-style requests.
`libmir`	A Rust application needs direct ownership of models and sessions.

MiRMiR and libmir are pre-1.0. These pages describe version 0.3.0. Support claims require complete checkpoint and backend validation; planned formats are not described as available.

The stack

your application
      |
      +-- HTTP / SSE --> mirmir server --+
      +-- TUI / CLI --> private gRPC ----+--> libmir --> Metal / CUDA
      +-- Rust API -----------------------+

MiRMiR owns the application, configuration, transport, dashboards, model catalog, and telemetry. Interactive and scripted clients attach to the same local runtime or start a temporary one when needed. libmir owns checkpoint discovery, tokenization, generation semantics, sessions, scheduling, cache policy, and backend adapters.

Keyboard shortcuts

MiRMiR Docs

Native inference, from app to library

Choose a surface

The stack