Installation

Using pip

The easiest way to install llms.py is using pip:

pip install llms-py

Pull and run the latest image:

docker pull ghcr.io/servicestack/llms:latest

docker run -p 8000:8000 -e GROQ_API_KEY=$GROQ_API_KEY ghcr.io/servicestack/llms:latest

curl -O https://raw.githubusercontent.com/ServiceStack/llms/refs/heads/main/docker-compose.yml

OPENROUTER_API_KEY=sk-or-...
GROQ_API_KEY=gsk_...
GOOGLE_FREE_API_KEY=AIza...

docker compose up -d

If you've cloned the repository:

git clone https://github.com/ServiceStack/llms

cd llms

docker compose -f docker-compose.local.yml up -d --build

Setup environment variables for the providers you want to use.

To update to the latest version:

pip install llms-py --upgrade

After upgrading, it's recommended to also upgrade any external extensions:

llms --update all

For Docker:

docker pull ghcr.io/servicestack/llms:latest

New versions sometimes include changes to llms.json config which isn't automatically updated.

Use the --reset option to reset the default configuration files back to its factory defaults. Available reset options (config, providers, all):

config - Reset ~/.llms/llms.json to default

llms --reset config

providers - Reset ~/.llms/providers.json and ~/.llms/providers-extra.json

llms --reset providers