CLI reference

Running mirmir without a subcommand opens the TUI. Commands expose the same runtime for servers, scripts, model management, configuration, and benchmarks.

Every interactive or one-shot client first tries the local private protocol. If no runtime exists, it starts a temporary one and shuts down only that owned instance when the command finishes. Use mirmir serve when models and runtime state must persist across clients.

Command	Purpose
`mirmir serve`	Persistent private gRPC runtime and optional HTTP/Web server.
`mirmir status`	Health, loaded models, and latest telemetry as JSON.
`mirmir prompt`	Stream or benchmark one prompt.
`mirmir model …`	Search, inspect, download, load, unload, and remove models.
`mirmir config …`	Initialize, show, edit, validate, set, remove, and test config.

Serve

mirmir serve
mirmir serve --no-http
mirmir serve --http-bind 127.0.0.1:9090

MIRMIR_HTTP_BIND supplies the same per-process override as --http-bind.

Prompt and benchmarks

Input comes from exactly one of --prompt, --prompt-file, or --stdin. Generation parameters include --max-tokens, --temperature, --top-p, --top-k, --repetition-penalty, and --seed.

printf 'Explain continuous batching.' | mirmir prompt \
  --stdin --model qwen --warmup 1 --samples 5 --json --csv result.csv

--no-stream buffers the final completion. JSON benchmark output contains raw samples and aggregate E2E, TTFT, prefill, and decode distributions.

Model lifecycle

mirmir model list
mirmir model inspect MODEL
mirmir model search QUERY --limit 20
mirmir model pull OWNER/REPO --revision REVISION
mirmir model load MODEL [--force]
mirmir model unload MODEL
mirmir model remove OWNER/REPO

Selectors may be a configured alias, repository ID, local model key, or checkpoint path where the command permits it.

Configuration

mirmir config init
mirmir config show
mirmir config edit
mirmir config validate
mirmir config set KEY [VALUE]
mirmir config remove hugging_face.token
mirmir config test hugging_face.token

When a server is running, commands that change configuration use it as the sole writer.

Runtime ownership

Invocation	Runtime behavior
`mirmir serve`	Owns a persistent runtime until interrupted.
`mirmir`	Attaches to the persistent runtime or owns a temporary TUI runtime.
`mirmir model …`	Uses the shared runtime or owns one for the model operation.
`mirmir prompt …`	Uses the shared runtime or owns one for generation and benchmarks.
`mirmir status`	Reads an already running server and does not start one.