AgentIndex icon
AgentIndex
ToolsCategoriesTrendingNewCompareGuides
Submit Tool
ToolsCategoriesTrendingNewCompareGuides
Home/
Vision / Multimodal/
UI-TARS-desktop
UI-TARS-desktop logo

UI-TARS-desktop

Active·★ 39.2k·Apache-2.0·Updated 2026-10-08
★ Most Popular★ Trending★ Essential

This ByteDance repository hosts TARS, an open-source multimodal AI agent stack with two projects. Agent TARS is a general multimodal agent with a CLI and web UI that combines GUI-agent vision with DOM-based browser control and MCP tools, aiming to complete tasks the way a person would. UI-TARS Desktop is a native desktop application that lets a vision-language model, driven by the UI-TARS and Seed-VL series models, operate your local computer, a remote computer or a browser with mouse and keyboard.

It suits developers and researchers exploring computer-use agents: automating GUI tasks in desktop apps that have no API, multi-step browser tasks such as comparing and booking travel, or prototyping agents that see the screen. UI-TARS Desktop works on Windows and macOS and in the browser, with screenshot-based recognition and real-time status feedback; Agent TARS runs headful in a web UI or headless as a server and can mount additional MCP servers.

Getting started: run Agent TARS with `npx @agent-tars/cli@latest` (Node.js 22+ for a global install) and pass your model provider and API key, for example Volcengine or Anthropic. UI-TARS Desktop is a separate desktop app; follow its quick start to download it and configure a vision-language model endpoint.

#GUI Agent#Desktop App#Multimodal AI#Automation#Cross-Platform
$ Install
$ npx @agent-tars/cli@latest
↗ Visit site★ GitHub
01

Features

01Native GUI agent that sees the screen and interacts with desktop applications
02Multimodal LLM-powered visual understanding of any UI
03Browser automation and shell command execution built in
04MCP integration for extending agent capabilities with custom tools
05Cross-platform desktop app with web UI option
02

Why choose it

+Operates any GUI through vision, including desktop apps without APIs.
+Two complementary tools: a desktop GUI agent and a general multimodal agent with CLI, web UI and MCP support.
+Supports local, remote computer and browser operators.
+Backed by ByteDance's UI-TARS research models; Apache-2.0 licensed.
03

Trade-offs

!GUI agents act directly on your screen with your permissions; supervise them and avoid running them on machines with sensitive sessions.
!Vision-based control is slower and less deterministic than API or DOM automation, and results depend on the model you use.
!You need access to a capable vision-language model, either hosted or self-deployed, which can be costly to run.
04

Compatibility

macOS
Supported
Verified via docs
Windows
Supported
Verified via docs
Linux
Supported
Verified via docs
05

Quick start

1
$ npx @agent-tars/cli@latest
06

Use cases

↳Automating desktop GUI workflows that don't have APIs by seeing and clicking the UI
↳Building multimodal agents that combine screen understanding with web and file operations
↳Running AI-assisted computer tasks through natural language instructions on desktop
07

How it compares

≈vs Cua: Cua provides the computers (sandboxed desktops, VMs and drivers) for any agent; UI-TARS Desktop is itself the agent that operates a computer.
≈vs Playwright MCP: Playwright MCP automates browsers through structured page data; UI-TARS works from screenshots and can also control native apps.
≈vs Windows MCP: Windows MCP exposes Windows computer-use tools to an MCP client; UI-TARS Desktop bundles its own vision model and agent.
08

Alternatives

Meshroom logo
Meshroom★ 13.0k
Node-based Visual Programming Toolbox
mcp-sequentialthinking-tools logo
mcp-sequentialthinking-tools★ 588
🧠 An adaptation of the MCP Sequential Thinking Server to guide tool usage. This server provides recommendations for which MCP tools would be most effective at each stage.
worldmonitor logo
worldmonitor★ 88.1k
Real-time global intelligence dashboard. AI-powered news aggregation, geopolitical monitoring, and infrastructure tracking in a unified situational awareness interface
GitHub MCP Server logo
GitHub MCP Server★ 33.5k
GitHub's official MCP Server. Allows AI agents to interact directly with your GitHub repositories (read files, search code, issues).
Gemini CLI logo
Gemini CLI★ 107.3k
An open-source AI agent that brings the power of Gemini directly into your terminal. Supports native MCP.
awesome-n8n-templates logo
awesome-n8n-templates★ 25.8k
Supercharge your workflow automation with this curated collection of n8n templates! Instantly connect your favorite apps-like Gmail, Telegram, Google Drive, Slack, and more-with ready-to-use, AI-powered automations. Save time, boost productivity, and unlock the true potential of n8n in just a few clicks.
keep logo
keep★ 12.4k
The open-source AIOps and alert management platform
hexstrike-ai logo
hexstrike-ai★ 12.5k
HexStrike AI MCP Agents is an advanced MCP server that lets AI agents (Claude, GPT, Copilot, etc.) autonomously run 150+ cybersecurity tools for automated pentesting, vulnerability discovery, bug bounty automation, and security research. Seamlessly bridge LLMs with real-world offensive security capabilities.
See all alternatives →

Comments

Log in to leave a comment

No comments yet. Be the first!

On this page
01Features02Why choose it03Trade-offs04Compatibility05Quick start06Use cases07How it compares08Alternatives
Stats
GitHub Stars★ 39.2k
Last commit1d ago
StatusActive
LicenseApache-2.0
CategoryVision / Multimodal
Trend (30d)
+1.5k↑ 4.8%
Links
Documentation↗Discussion↗Issues↗Releases↗

Deploy on DigitalOcean — Get $200 Free Credit

Ad
© 2026 AgentIndex.app|Built by a 10-year iOS Developer.
AboutContactAdvertisePrivacy PolicyTerms of UseQYSGitHubBuy me a coffee ☕

Browse by Category

Code AssistantWorkflow AutomationRAG / Knowledge BaseMulti-AgentBrowser AutomationLLM InfraDev ToolingObservability

Not affiliated with Anthropic, OpenAI or Microsoft.