llms.py

Lightweight OpenAI compatible CLI, server gateway and OSS Open WebUI alternative for Local and Cloud LLMs

Get StartedView on GitHub

Quick Install

pip install llms-py

šŸ’¬ Simple Chat

Ask questions directly from the command line

terminal
$ llms "What is the capital of France?"
Paris is the capital of France. It's located in the north-central part of the country and is known for its art, fashion, gastronomy, and culture. The city is home to iconic landmarks like the Eiffel Tower, the Louvre Museum, and Notre-Dame Cathedral.

Run Server

llms --serve 8000

šŸ’¬ ChatGPT-like Interface

Modern, fast, and privacy-focused web UI for all your local and remote LLMs

llms.py main chat interface showing conversation with AI

Ready to Get Started?

Install llms.py and start chatting with 160+ AI models in minutes

šŸ“š View DocumentationView on GitHub
šŸŖ¶ Ultra-Lightweight

Single file with just one aiohttp dependency. Perfect for ComfyUI and minimal environments.

šŸŒ Multi-Provider

Access 160+ models from OpenAI, Anthropic, Google, Grok, Groq, Ollama, and more.

šŸ’» ChatGPT-like UI

Fast, privacy-focused web interface with dark mode and built-in analytics.