LLM-VM
Active·★ 491·Updated 2024-05-14
★ Trending
irresponsible innovation. Try now at https://chat.dev/
The Anarchy LLM-VM is an optimized backend designed to run open-source LLMs with modern features like tool usage and persistent memory. It acts as a virtual machine for human language, coordinating models, data, prompts, and tools to optimize batch calls and support various architectures.
#LLM#Open Source AI#Inference Optimization#Agent#Python#Coding#Communication
01
Features
01Implicit Agents
02Inference Optimization
03Task Auto-Optimization
04Library Callable
05HTTP Endpoints
02
Compatibility
chat_gpt
Supported
Verified via docs
gpt
Supported
Verified via docs
neo
Supported
Verified via docs
llama2
Supported
Verified via docs
bloom
Supported
Verified via docs
opt
Supported
Verified via docs
03
Quick start
1
$ pip install llm-vm
04
Use cases
↳Accelerate AGI development and prototyping
↳Reduce costs for running and testing LLM models locally
↳Flexibly switch and evaluate different open-source LLM models
05
Alternatives
MetaGPT★ 68.4k
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
cua★ 17.3k
Open-source infrastructure for Computer-Use Agents. Sandboxes, SDKs, and benchmarks to train and evaluate AI agents that can control full desktops (macOS, Linux, Windows).
ragflow★ 81.5k
RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create a superior context layer for LLMs
Context7★ 56.4k
MCP Server that provides up-to-date code documentation for LLMs and AI code editors.
GitHub MCP Server★ 30.3k
GitHub's official MCP Server. Allows AI agents to interact directly with your GitHub repositories (read files, search code, issues).
n8n★ 190.2k
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.
Related searches
Comments
Log in to leave a comment
No comments yet. Be the first!