AgentIndex icon
AgentIndex
ToolsCategoriesTrendingNewCompare
Submit Tool
Home/
LLM Infra/
houtini-lm
houtini-lm logo

houtini-lm

Active·★ 91·MIT·Updated 2026-04-21
★ Trending★ LLM Infra★ API Integration

Local or Cloud LLM support via MCP for your AI assistant with Houtini-LM - uses OpenAPI API for LM Studio, Cloud API and Ollama Compatibility. Save tokens by offloading some grunt work for your API - our tool description helps claude decide what work to assign and why.

Houtini LM connects Claude Code to a local LLM server or any OpenAI-compatible API, offloading bounded tasks to reduce token costs. It provides tools, performance tracking, and model routing for efficient delegation. Claude remains the orchestrator for complex reasoning, while cheap local models handle grunt work.

#ai-agents#claude-mcp#code-generation#developer-tool#developer-tools#lm-studio#lm-studio-mcp#local-llm
$ Install
$ npx -y @houtini/lm
↗ Visit site★ GitHub
01

Features

01Offload bounded tasks to local or cloud LLMs
02Model discovery with HuggingFace metadata enrichment
03Real-time performance tracking (TTFT, tokens/s)
04Structured JSON output via grammar-based sampling
05Think-block stripping for models like GLM and Nemotron
02

Compatibility

LM Studio
Local Server
Verified via docs
Ollama
Local Server
Verified via docs
vLLM
Local Server
Verified via docs
llama.cpp
Local Server
Verified via docs
DeepSeek
Cloud API
Verified via docs
Groq
Cloud API
Verified via docs
03

Quick start

1
$ npx -y @houtini/lm
04

Use cases

↳Generate test stubs
↳Code review and bug finding
↳Draft commit messages
05

Alternatives

MetaGPT logo
MetaGPT★ 68.4k
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
vs →
cua logo
cua★ 17.3k
Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).
vs →
agents-best-practices logo
agents-best-practices★ 1.1k
Provider-neutral Agent Skill for Codex, Claude Code, and agentic harness design.
vs →
holaOS logo
holaOS★ 5.4k
The agent environment for long-horizon work, continuity, and self-evolution.
vs →
awesome-claude logo
awesome-claude★ 250
HeyClaude is a curated registry and distribution surface for Claude and AI-workflow assets: agents, MCP servers, skills, commands, hooks, rules, guides, tools, jobs, Raycast feeds, static data exports, and an npm MCP package.
vs →
initrunner logo
initrunner★ 38
Define AI agent roles in YAML and run them anywhere: CLI, API server, or autonomous daemon
vs →
qveris-agent-toolkit logo
qveris-agent-toolkit★ 229
Open-source toolkit for the QVeris capability routing network: CLI, MCP server, Python SDK, skills, and REST API docs for agents to discover, inspect, call, and audit real-world tools.
vs →
awesome-mcp logo
awesome-mcp★ 11
🚀 Discover and explore a curated list of MCP servers, tools, and resources for AI assistants, enhancing your development and productivity.
vs →
See all alternatives →

Related searches

houtini-lm AlternativesBest LLM Infra Tools 2026Open Source LLM Infrahoutini-lm Tutorialhoutini-lm Vs Competitorsai-agentsclaude-mcpcode-generation

Comments

Log in to leave a comment
  • M
    Marlowe WilsonMay 3, 2026

    Switching between local and cloud LLMs via MCP without changing agent code is very useful

  • D
    Drew GarciaApr 21, 2026

    Local inference fallback when cloud APIs are slow or expensive works transparently

  • R
    Riley WhiteMar 28, 2026

    Good for keeping costs down on routine tasks while using cloud for complex ones

  • D
    Drew PatelMar 5, 2026

    The OpenAPI integration means any local model with a REST endpoint just works

On this page
01Features02Compatibility03Quick start04Use cases05Alternatives
Stats
GitHub Stars★ 91
Last commit1mo ago
StatusActive
LicenseMIT
CategoryLLM Infra
Trend (30d)
+3.6↑ 0.5%
Links
Documentation↗Discussion↗Issues↗Releases↗

Deploy on DigitalOcean — Get $200 Free Credit

Ad
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
QYSGitHubBuy me a coffee ☕

Browse by Category

Code AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.