InferLlama

Find and run open-source AI models locally.

Featured models

Quick start with the CLI

Pull and run any model with one command

Install the CLI, pull a model from the catalogue, and start chatting in your terminal — no cloud account required.

$curl -fsSL https://cli.inferllama.com/install.sh | bash
$inferllama pull llama-3.1-8b
$inferllama run llama-3.1-8b
Loading model…
You: Hello!
Assistant: Hi! How can I help?