osaurus
Active·★ 5.5k·MIT·Updated 2026-05-29
★ LLM Infra★ API Integration
AI edge infrastructure for macOS. Run local or cloud models, share tools across apps via MCP, and power AI workflows with a native, always-on runtime.
Osaurus is an AI edge runtime for macOS, designed to run local and cloud models and expose shared tools via its MCP server. It provides a native, always-on foundation for AI applications and workflows on Apple Silicon.
#AI Edge Runtime#macOS Native#Local LLM Inference#API Gateway#Agent Framework#Plugin System#On-device AI#Speech-to-text
01
Features
01Local LLM Inference with MLX Runtime for Apple Silicon
02Multi-API Compatibility (OpenAI, Anthropic, Ollama, etc.)
03MCP Server for AI Agent Tooling and Remote MCP Providers aggregation
04Advanced 4-layer persistent memory system with hybrid search
05Integrated on-device Voice Input and Transcription with VAD Mode
02
Compatibility
macOS (Apple Silicon)
Platform
Verified via docs
Apple Foundation Models
Integration
Verified via docs
OpenAI API
API Standard
Verified via docs
Anthropic API
API Standard
Verified via docs
MCP Server
Protocol
Verified via docs
MLX Runtime
LLM Runtime
Verified via docs
03
Quick start
1
$ brew install --cask osaurus
04
Use cases
↳Automate complex multi-step tasks with AI agents using 'Work Mode' for code refactoring, debugging, or research.
↳Create personalized AI assistants with custom prompts, tools, and themes for various roles like Code Assistant or Creative Writer.
↳Automate recurring AI tasks and workflows such as daily journaling, weekly reports, or file organization via Watchers.
↳Integrate local and cloud Large Language Models for development and personal use via compatible API endpoints.
05
Alternatives
Related searches
Comments
Log in to leave a comment
- PPhoenix BrownApr 27, 2026
The infrastructure coverage is surprisingly complete — ai edge infrastructure for macos. Runs fine on Python 3.11.
- DDakota LewisApr 24, 2026
Integrates cleanly into solid workflows. The maintainers are responsive to issues.
- RRiver KimApr 18, 2026
The edge coverage is surprisingly complete. The maintainers are responsive to issues.
- Morgan LeeMar 19, 2026
The macos integration saves writing a lot of boilerplate. Would recommend for clean use cases.