LLM-VM
★ 493·MIT·Updated 2024-05-14
The Anarchy LLM-VM is an optimized backend designed to run open-source LLMs with modern features like tool usage and persistent memory. It acts as a virtual machine for human language, coordinating models, data, prompts, and tools to optimize batch calls and support various architectures.
LLM-VM sits in the LLM Infra category, so it is usually better judged by workflow fit, deployment style, and team needs than by isolated features alone. Based on the available metadata, it leans most clearly toward Implicit Agents. A representative use case is Accelerate AGI development and prototyping. The listed license is MIT. GitHub stars are currently 492. Relevant tags include LLM, Open Source AI.
#LLM#Open Source AI#Inference Optimization#Agent#Python#Coding#Communication
01
Features
01Implicit Agents
02Inference Optimization
03Task Auto-Optimization
04Library Callable
05HTTP Endpoints
02
Why choose it
+Implicit Agents
+Inference Optimization
+Accelerate AGI development and prototyping
+Supports 7 platforms or runtime environments.
03
Trade-offs
!The final decision should still be made through side-by-side comparison with similar tools.
04
Compatibility
chat_gpt
Supported
Verified via docs
gpt
Supported
Verified via docs
neo
Supported
Verified via docs
llama2
Supported
Verified via docs
bloom
Supported
Verified via docs
opt
Supported
Verified via docs
05
Quick start
1
$ pip install llm-vm
06
Use cases
↳Accelerate AGI development and prototyping
↳Reduce costs for running and testing LLM models locally
↳Flexibly switch and evaluate different open-source LLM models
07
Alternatives
chatarena★ 1.6k
ChatArena (or Chat Arena) is a Multi-Agent Language Game Environments for LLMs. The goal is to develop communication and collaboration capabilities of AIs.
codefuse-chatbot★ 1.3k
An intelligent assistant serving the entire software development lifecycle, powered by a Multi-Agent Framework, working with DevOps Toolkits, Code&Doc Repo RAG, etc.
rlcard★ 3.6k
Reinforcement Learning / AI Bots in Card (Poker) Games - Blackjack, Leduc, Texas, DouDizhu, Mahjong, UNO.
ir-sim★ 1.2k
A Python-based lightweight robot simulator designed for navigation, control, and reinforcement learning
Comments
Log in to leave a comment
No comments yet. Be the first!