Vision and multimodal AI tools for image understanding, generation, and processing multiple input modalities.
Vision and multimodal tools let AI work with images, documents, screens and video, not just text. They include GUI agents that see and operate a desktop, document intelligence libraries that extract text and structure from PDFs and images, and integrations that bring models into visual tools such as image-generation pipelines.
Check which modalities a tool actually handles and how: some rely on a vision-language model, others on OCR and layout analysis. For GUI agents, look at supported operating systems and safety controls, since they act directly on your screen. For document extraction, test on your own files; accuracy on tables and scanned pages varies a lot between tools.
Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.
| Name | Tagline | Category | Stars | License | Updated |
|---|
UI-TARS-desktopMost PopularEssential··· Vision / Multimodal ·The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra | The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra | Vision / Multimodal | ★ 39.4k | Apache-2.0 | 2026-10-09 |
MeshroomMost PopularEssential··· Vision / Multimodal ·Node-based Visual Programming Toolbox | Node-based Visual Programming Toolbox | Vision / Multimodal | ★ 13.0k | NOASSERTION | 2026-10-27 |
mcp-sequentialthinking-toolsTrending Vision / Multimodal ·🧠 An adaptation of the MCP Sequential Thinking Server to guide tool usage. This server provides recommendations for which MCP tools would be most effective at each stage. | 🧠 An adaptation of the MCP Sequential Thinking Server to guide tool usage. This server provides recommendations for which MCP tools would be most effective at each stage. | Vision / Multimodal | ★ 586 | MIT | 2026-10-25 |
ComfyUI-CopilotComfyUIAI Assistant Vision / Multimodal ·An AI-powered custom node for ComfyUI designed to enhance workflow automation and provide intelligent assistance | An AI-powered custom node for ComfyUI designed to enhance workflow automation and provide intelligent assistance | Vision / Multimodal | ★ 5.6k | MIT | 2026-09-11 |
groundingLMMMultimodal AIComputer Vision Vision / Multimodal ·[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks. | [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks. | Vision / Multimodal | ★ 969 | Apache-2.0 | 2026-09-05 |
maroReinforcement LearningMulti-Agent Systems Vision / Multimodal ·Multi-Agent Resource Optimization (MARO) platform is an instance of Reinforcement Learning as a Service (RaaS) for real-world resource optimization problems. | Multi-Agent Resource Optimization (MARO) platform is an instance of Reinforcement Learning as a Service (RaaS) for real-world resource optimization problems. | Vision / Multimodal | ★ 928 | MIT | 2025-04-24 |
CodeFuse-muAgentAgent FrameworkKnowledge Graph Vision / Multimodal ·An Innovative Agent Framework Driven by KG Engine | An Innovative Agent Framework Driven by KG Engine | Vision / Multimodal | ★ 777 | NOASSERTION | 2025-01-15 |
kreuzbergEssentialTrending Vision / Multimodal ·A polyglot document intelligence framework with a Rust core. Extract text, metadata, and structured information from PDFs, Office documents, images, and 50+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server. | A polyglot document intelligence framework with a Rust core. Extract text, metadata, and structured information from PDFs, Office documents, images, and 50+ formats. Available for Rust, Python, Ruby, Java, Go, PHP, Elixir, C#, TypeScript (Node/Bun/Wasm/Deno)- or use via CLI, REST API, or MCP server. | Vision / Multimodal | ★ 9.5k | MIT | 2026-10-27 |
PPTAgentTrending Vision / Multimodal ·An Agentic Framework for Reflective PowerPoint Generation | An Agentic Framework for Reflective PowerPoint Generation | Vision / Multimodal | ★ 5.2k | MIT | 2026-10-26 |
Code2VideoVideo GenerationAI Agents Vision / Multimodal ·Video generation via code | Video generation via code | Vision / Multimodal | ★ 2.2k | MIT | 2026-08-24 |
virtualhomeSimulationEmbodied AI Vision / Multimodal ·API to run VirtualHome, a Multi-Agent Household Simulator | API to run VirtualHome, a Multi-Agent Household Simulator | Vision / Multimodal | ★ 644 | MIT | 2026-05-20 |
ai-doc-genHidden Gem Vision / Multimodal ·AI-powered multi-agent system that automatically analyzes codebases and generates comprehensive documentation. Features GitLab integration, concurrent processing, and multiple LLM support for better code understanding and developer onboarding. | AI-powered multi-agent system that automatically analyzes codebases and generates comprehensive documentation. Features GitLab integration, concurrent processing, and multiple LLM support for better code understanding and developer onboarding. | Vision / Multimodal | ★ 767 | MIT | 2026-07-21 |
mcp-client-cliCLILLM Vision / Multimodal ·A simple CLI to run LLM prompt and implement MCP client. | A simple CLI to run LLM prompt and implement MCP client. | Vision / Multimodal | ★ 675 | MIT | 2025-12-02 |
CradleAI AgentsGeneral Computer Control Vision / Multimodal ·The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements. | The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation, in a standardized general environment with minimal requirements. | Vision / Multimodal | ★ 2.6k | MIT | 2024-11-07 |
DirectorEssential Vision / Multimodal ·AI video agents framework for next-gen video interactions and workflows. | AI video agents framework for next-gen video interactions and workflows. | Vision / Multimodal | ★ 1.6k | MIT | 2026-01-23 |
Awesome-GUI-AgentMultimodal AIGUI Agents Vision / Multimodal ·💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents. | 💻 A curated list of papers and resources for multi-modal Graphical User Interface (GUI) agents. | Vision / Multimodal | ★ 1.2k | — | 2025-08-17 |
short-video-makerVideo GenerationText-to-Speech Vision / Multimodal ·Creates short videos for TikTok, Instagram Reels, and YouTube Shorts using the Model Context Protocol (MCP) and a REST API. | Creates short videos for TikTok, Instagram Reels, and YouTube Shorts using the Model Context Protocol (MCP) and a REST API. | Vision / Multimodal | ★ 1.4k | MIT | 2025-06-21 |
aiflowyAI AgentJava Vision / Multimodal ·AIFlowy is an enterprise-grade AI application development platform based on Java, comparable to products like Dify and Coze. | AIFlowy is an enterprise-grade AI application development platform based on Java, comparable to products like Dify and Coze. | Vision / Multimodal | ★ 791 | NOASSERTION | 2026-06-15 |
bladesAI AgentGo Vision / Multimodal ·Blades is a Go-based multimodal AI Agent framework. | Blades is a Go-based multimodal AI Agent framework. | Vision / Multimodal | ★ 819 | MIT | 2026-08-14 |
TACTICHidden Gem Vision / Multimodal ·Open source remote collaboration platform used for configuring and deploying enterprise Workflow solutions. | Open source remote collaboration platform used for configuring and deploying enterprise Workflow solutions. | Vision / Multimodal | ★ 499 | NOASSERTION | 2026-05-24 |