Rapid-MLX

Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.

CategoryAI Agent Frameworks
Authorraullenchai
Stars3984
LanguagePython
LicenseNOASSERTION
Last update2026-10-16
Sourcehttps://github.com/raullenchai/Rapid-MLX

Tags: anthropic-api, apple-silicon, claude-code, coding-agents, continuous-batching, inference-server, llm-inference, llm-server, lm-studio-alternative, local-ai, local-llm, macos, mcp, mlx, mlx-lm, ollama-alternative, omlx-alternative, openai-compatible, speculative-decoding, tool-calling

Maintain this project? Get it featured.

Alternatives to Rapid-MLX

rea morluto · ★278898 · TypeScript
Reverse engineer anything with agents, from app behavior down to native binaries.
deepseek-harness deepseek-ai · ★250738 · TypeScript
DeepSeek Harness: Everything is a Plugin.
ponytail DietrichGebert · ★164692 · JavaScript
Makes your AI agent think like the laziest senior dev in the room. The best code is the code you never wrote.
gemini-cli google-gemini · ★107398 · TypeScript
An open-source AI agent that brings the power of Gemini directly into your terminal.
paperclip paperclipai · ★102899 · TypeScript
The open-source app everyone uses to manage agents at work
orca stablyai · ★93851 · TypeScript
Orca is the ADE for working with a fleet of parallel agents. Run any coding agent with your own subscription. Available on desktop, mobile and remote runtime.