flama

The production framework for Predictive and Generative AI. Serve any model as an API in one line, with OpenAI/Anthropic/Ollama-compatible endpoints, a built-in chat UI, and native MCP.

CategorySearch & Web
Authorvortico
Stars304
LanguagePython
LicenseApache-2.0
Last update2026-10-13
Sourcehttps://github.com/vortico/flama

Tags: anthropic, asgi, chatbot, domain-driven-design, generative-ai, inference, llm, llm-serving, machine-learning, mcp, mlops, mlx, model-context-protocol, model-serving, ollama, openai-api, python, rust, vllm, web-framework

Maintain this project? Get it featured.

Alternatives to flama

ECC affaan-m · ★280691 · JavaScript
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
hermes-agent NousResearch · ★254242 · Python
The agent that grows with you
open-webui open-webui · ★155861 · Python
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
cc-switch farion1231 · ★144984 · Rust
A cross-platform desktop All-in-One assistant for Claude Code, Codex, OpenCode, OpenClaw, Grok Build & Hermes Agent. Only official website: ccswitch.io
ragflow infiniflow · ★92313 · Go
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
deer-flow bytedance · ★83939 · Python
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.