Run your first model

MiRMiR can search Hugging Face, download a snapshot into its managed cache, inspect compatibility, and load it into accelerator memory.

Search and download

mirmir model search "Qwen 2.5" --limit 10
mirmir model pull Qwen/Qwen2.5-0.5B-Instruct

Search results are ranked by the execution contract discovered by libmir and by a conservative estimate of whether the checkpoint fits this machine.

For gated repositories, configure a Hugging Face token without placing the secret directly in shell history:

printf '%s' "$HF_TOKEN" | mirmir config set hugging_face.token
mirmir config test hugging_face.token

Inspect and load

mirmir model inspect Qwen/Qwen2.5-0.5B-Instruct
mirmir model load Qwen/Qwen2.5-0.5B-Instruct

Inspection identifies the task, tokenizer, tensor layout, memory requirement, configured K/V cache, and safe context capacity before loading weights. --force bypasses only the conservative memory-fit rejection; it cannot make an unsupported execution contract valid.

Generate

Open the TUI and select Chat, or use the non-interactive path:

mirmir prompt \
  --model Qwen/Qwen2.5-0.5B-Instruct \
  --prompt "Explain paged K/V cache in three sentences."

For a reproducible measurement:

mirmir prompt \
  --model Qwen/Qwen2.5-0.5B-Instruct \
  --prompt "Explain paged K/V cache." \
  --seed 7 --temperature 0 --warmup 1 --samples 5 --json

Unload or remove

mirmir model unload Qwen/Qwen2.5-0.5B-Instruct
mirmir model remove Qwen/Qwen2.5-0.5B-Instruct

Removing is destructive and requires the model to be unloaded first.