Rapid-MLX
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
- Category
- AI Agent Frameworks
- Author
- raullenchai
- Stars
- 3988
- Language
- Python
- License
- NOASSERTION
- Last update
- 2026-10-17
- Source
- https://github.com/raullenchai/Rapid-MLX
Tags: anthropic-api, apple-silicon, claude-code, coding-agents, continuous-batching, inference-server, llm-inference, llm-server, lm-studio-alternative, local-ai, local-llm, macos, mcp, mlx, mlx-lm, ollama-alternative, omlx-alternative, openai-compatible, speculative-decoding, tool-calling
Maintain this project? Get it featured.
Alternatives to Rapid-MLX
rea morluto · ★297908 · TypeScript
Reverse engineer anything with agents, from app behavior down to native binaries.
ponytail DietrichGebert · ★165474 · JavaScript
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
gemini-cli google-gemini · ★107413 · TypeScript
An open-source AI agent that brings the power of Gemini directly into your terminal.
paperclip paperclipai · ★103337 · TypeScript
The open-source app everyone uses to manage agents at work
orca stablyai · ★94779 · TypeScript
Orca is the place for working with a fleet of agents (e.g. Grok Bot, Codex). Run any coding agent with your own subscription. Available on desktop, mobile and remote runtime.