osaurus: Osaurus is an AI edge runtime for macOS, leveraging Apple Silicon for optimized local inference and connecting to various cloud models. It provides a native foundation for AI applications, exposing tools via the Model Context Protocol (MCP) and supporting custom assistants and automated workflows.; lemonade: Lemonade is an SDK designed to help users discover and run local AI applications by serving optimized Large Language Models directly from their GPUs and NPUs. It offers acceleration for various hardware, supports multiple model formats, and integrates with popular AI apps via an OpenAI-compatible API.
Building and deploying AI applications and workflows locally on macOS
Running LLMs locally on personal computers with hardware acceleration