AgentIndex icon
AgentIndex
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Submit Tool
ToolsMCP ServersHOTCategoriesTrendingNewBest ListsCompareGuides
Home/
LLM Infra/
OGAM
OGAM logo

OGAM

Active·★ 3.3k·MIT·Updated 2026-10-27
★ Trending

Off Grid AI is an app that runs AI on your phone or Mac, offline, with the README stating that no data leaves the device. It combines text generation (Qwen 3, Llama 3.2, Gemma 3, Phi-4 and any GGUF model you bring), on-device Stable Diffusion image generation, vision models (SmolVLM, Qwen3-VL, Gemma 3n), on-device Whisper voice input, document analysis, and tool calling for web search, a calculator, date and time, device info and knowledge-base search. Projects can hold PDFs and text that are chunked and embedded on-device with a bundled MiniLM model and stored in SQLite.

It also supports GPU and NPU acceleration (OpenCL on Adreno, Metal on Apple Silicon, with the Hexagon NPU on Snapdragon), which the README itself marks experimental: only Q4_0 and Q8_0 quants are accelerated, other quants fall back to CPU, and some architectures produce garbled output. It can connect to OpenAI-compatible servers on your network such as Ollama and LM Studio, shows per-model memory use, and has a download manager. The README gives performance ranges, for example 15-30 tok/s on CPU on flagship phones, tested on Snapdragon 8 Gen 2/3 and Apple A17 Pro.

The app is on Google Play and the App Store, and you can build from source with `git clone` and `npm install`. The README also advertises an optional Pro tier (voice replies, personas, draft-then-approve actions, phone-Mac sync) priced at $69 once or $49 a year, so the free app and the paid features are separate. The code is MIT licensed and was last pushed on 2026-10-12. This review is based on the README and repository data; we have not run it ourselves.

This write-up is based on the project's README and public repository data. We have not hand-tested the tool. Data as of 2026-10-27.

License
MIT
Latest release
v0.0.118 · 2026-10-23
Last commit
2026-10-27
Contributors
14
Forks
324
Open issues and PRs
143
First published
2026-01-29

Source: GitHub, npm and PyPI public APIs.

#On-device AI#Offline LLM#Image Generation#Vision AI#Speech-to-Text#Tool Calling#RAG
$ Install
$ git clone https://github.com/off-grid-ai/OGAM.git && cd OGAM && npm install
↗ Visit site★ GitHub
01

Features

01On-device Text Generation with various LLMs
02Local Stable Diffusion for Image Generation
03Camera-based Vision AI for scene and document analysis
04Function calling with built-in tools (web search, calculator, knowledge base)
05On-device RAG for document analysis and knowledge retrieval
02

Why choose it

+Text, image generation, vision, voice input, tools and document analysis all run on-device, with no data leaving the phone per the README
+Runs any GGUF model, can also use Ollama or LM Studio servers on your network, and shows per-model memory use
+Local knowledge base: PDFs are chunked and embedded on-device and stored in SQLite
+Available on Google Play and the App Store, or build from source; MIT; last push 2026-10-12
03

Trade-offs

!GPU and NPU acceleration is marked experimental by the README itself: only Q4_0 and Q8_0 quants are accelerated and some architectures garble output
!Models are several GB and a phone has limited RAM, so large models may not load
!Voice replies, personas, approved actions and sync are in a paid Pro tier ($69 once or $49 a year)
!Speed figures come from the project's own tests on a few devices
05

Maintenance check

ActiveChecked: 2026-10-27
Last commit
2026-10-27
Commits, last 90 days
100+
Releases, last 90 days
18
Latest release
v0.0.118 (2026-10-23)
Open issues
143
Recent issues with at least one comment
1/3
Commits per week, last 12 weeks
Commits per week, last 12 weeks: 158, 219, 111, 37, 33, 305, 16, 12, 72, 69, 232, 2

Oldest week on the left; the latest four weeks are orange. Source: GitHub commit activity.

Status rule: archived on GitHub = Archived; last commit within 90 days = Active; 91 to 365 days = Slowing; older = Stale. All figures come from the GitHub API on the date shown.

Most discussed open issues

  • #375 [Bug] v0.0.94 very slow31 comments · 2026-05-25
  • #364 [Bug] UI very slow to respond even when no model is loaded16 comments · 2026-05-18
  • #187 [Bug] web_search issue&model first token generation issue13 comments · 2026-03-16
  • #93 [Feature] Add Persistent Local RAG Knowledge Base10 comments · 2026-03-02
  • #23 Release on F-Droid10 comments · 2026-02-15

Issue titles are quoted from GitHub. Open the link to check whether a problem still applies to the version you use.

04

Who it fits

Pick it if
  • You want chat, image generation, vision and voice input on your phone or Mac, offline, with no data leaving the device.
  • You want to bring any GGUF model or connect to Ollama or LM Studio on your network.
  • You want a local knowledge base: PDFs are embedded on-device and stored in SQLite.
Look elsewhere if
  • You need voice replies: they are in the paid Pro tier ($69 once or $49 a year).
  • You rely on GPU or NPU acceleration: the README marks it experimental, only Q4_0 and Q8_0 quants are accelerated, and some architectures garble output.
  • Your phone has little RAM: models are several GB.
06

How it differs

runanywhere-sdks logovs runanywhere-sdks★ 10.3k

RunAnywhere gives developers SDKs for on-device AI in their own apps. Off Grid AI is a ready app.

Full comparison →
07

Compatibility

Android
Platform
Verified via docs
iOS
Platform
Verified via docs
macOS
Platform
Verified via docs
Node.js 20+
Build Runtime
Verified via docs
JDK 17
Android Build
Verified via docs
Xcode 15+
iOS Build
Verified via docs
08

Quick start

1
$ git clone https://github.com/off-grid-ai/OGAM.git
2
$ cd OGAM
3
$ npm install
09

Use cases

↳Use as a private, offline AI assistant for chatting and brainstorming.
↳Generate images and text for creative projects without cloud dependency.
↳Analyze local documents (PDFs, text files) and ask questions using the knowledge base.
↳Interact hands-free with the AI using on-device voice input and text-to-speech (Pro feature).
↳Perform AI tasks locally, ensuring zero data leaves your device for privacy-sensitive applications.
10

Alternatives

⚡Top VS:
VSrunanywhere-sdks★10.3k→VSbetter-chatbot★1.2k→VSosaurus★8.1k→VSRapid-MLX★4.0k→
runanywhere-sdks logo
runanywhere-sdks★ 10.3k
Production ready toolkit to run AI locally
VSCompare→
better-chatbot logo
better-chatbot★ 1.2k
Just a Better Chatbot. Powered by Agent & MCP & Workflows.
VSCompare→
osaurus logo
osaurus★ 8.1k
AI edge infrastructure for macOS. Run local or cloud models, share tools across apps via MCP, and power AI workflows with a native, always-on runtime.
VSCompare→
Rapid-MLX logo
Rapid-MLX★ 4.0k
Rapid-MLX is an open-source (Apache 2.0) OpenAI- and Anthropic-compatible LLM inference server for Apple Silicon, built on MLX, focused on reliable tool calling for coding agents. Up to 4× faster than Apple's MLX (mlx-lm) on the same weights.
VSCompare→
GPT Researcher logo
GPT Researcher★ 30.3k
An autonomous agent that conducts deep research on any data using any LLM provider, producing detailed reports with citations from web and local sources.
VSCompare→
lemonade logo
lemonade★ 6.0k
Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk
VSCompare→
Cherry Studio logo
Cherry Studio★ 53.0k
A powerful desktop client for multiple LLMs. Supports local and cloud models.
VSCompare→
cua logo
cua★ 31.1k
Open-source infrastructure that gives AI agents computers they can use: sandboxed desktops and VMs, drivers for operating native apps, SDKs and benchmarks for computer-use agents.
VSCompare→
See all alternatives →

Featured in these lists

  • Best Open-Source Voice Assistants and Speech Tools

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Why choose it03Trade-offs05Maintenance check04Who it fits06How it differs07Compatibility08Quick start09Use cases10Alternatives
off-grid-ai /
OGAM
↗

MIT mobile and Mac app that runs chat, image generation, vision, voice and tools fully on-device, with a paid Pro tier

3.3k324MIT
Last commit1d ago
StatusActive
CategoryLLM Infra
Contributors14
Latest releasev0.0.118
Links
Documentation↗Discussion↗Issues↗Releases↗
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
Best by use caseAboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

MCP ServersCode AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.