llama-cpp-agent

llama-cpp-agent is a Python framework for interacting with LLMs running via llama.cpp. It provides a unified interface for chat, structured function calls, and JSON-formatted output — including models not explicitly fine-tuned for function calling. Developers can define tools and callable functions that the agent invokes directly, making it practical for building local agentic workflows without cloud dependencies.

llama-cpp-agent sits in the LLM Infra category, so it is usually better judged by workflow fit, deployment style, and team needs than by isolated features alone. Based on the available metadata, it leans most clearly toward Structured function calls for models running via llama.cpp. A representative use case is Building local agentic pipelines with open-source LLMs. The listed license is NOASSERTION. GitHub stars are currently 659. Relevant tags include agent-framework, Communication.