AgentIndex icon
AgentIndex
ToolsCategoriesTrendingNewCompareGuides
Submit Tool
ToolsCategoriesTrendingNewCompareGuides
Home/
LLM Infra/
LLM-VM
LLM-VM logo

LLM-VM

★ 491·Updated 2024-05-14
★ Trending

The Anarchy LLM-VM is an optimized backend designed to run open-source LLMs with modern features like tool usage and persistent memory. It acts as a virtual machine for human language, coordinating models, data, prompts, and tools to optimize batch calls and support various architectures.

#LLM#Open Source AI#Inference Optimization#Agent#Python#Coding#Communication
$ Install
$ pip install llm-vm
↗ Visit site★ GitHub
01

Features

01Implicit Agents
02Inference Optimization
03Task Auto-Optimization
04Library Callable
05HTTP Endpoints
02

Compatibility

chat_gpt
Supported
Verified via docs
gpt
Supported
Verified via docs
neo
Supported
Verified via docs
llama2
Supported
Verified via docs
bloom
Supported
Verified via docs
opt
Supported
Verified via docs
03

Quick start

1
$ pip install llm-vm
04

Use cases

↳Accelerate AGI development and prototyping
↳Reduce costs for running and testing LLM models locally
↳Flexibly switch and evaluate different open-source LLM models
05

Alternatives

cua logo
cua★ 29.0k
Open-source infrastructure that gives AI agents computers they can use: sandboxed desktops and VMs, drivers for operating native apps, SDKs and benchmarks for computer-use agents.
Cherry Studio logo
Cherry Studio★ 52.5k
A powerful desktop client for multiple LLMs. Supports local and cloud models.
ragflow logo
ragflow★ 91.9k
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Context7 logo
Context7★ 62.8k
MCP Server that provides up-to-date code documentation for LLMs and AI code editors.
GitHub MCP Server logo
GitHub MCP Server★ 33.5k
GitHub's official MCP Server. Allows AI agents to interact directly with your GitHub repositories (read files, search code, issues).
n8n logo
n8n★ 206.7k
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
Brave Search MCP logo
Brave Search MCP★ 1.5k
Allow your AI Agent to search the real-time internet using Brave Search API. Essential for getting up-to-date information.
Microsoft AutoGen logo
Microsoft AutoGen★ 61.3k
A framework that enables the development of LLM applications using multiple agents that can converse with each other to solve tasks.
See all alternatives →

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Compatibility03Quick start04Use cases05Alternatives
Stats
GitHub Stars★ 491
Last commit2y ago
StatusNo updates in 1y+
License—
CategoryLLM Infra
Trend (30d)
+19.6↑ 3.6%
Links
Documentation↗Discussion↗Issues↗Releases↗

Deploy on DigitalOcean — Get $200 Free Credit

Ad
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
AboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

Code AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.