AgentIndex icon
AgentIndex
coder_eval logo
coder_eval
★ 154
vs
unity-mcp logo
unity-mcp
★ 15.3k

coder_eval vs unity-mcp

coder_eval: Coder Eval runs a real coding agent (Claude Code, Codex, Antigravity, OpenCode or Pi) in a sandbox against declarative YAML tasks and scores the files and commands it produced. It supports weighted 0.0-1.0 criteria, skill-trigger checks, A/B experiments and cost telemetry, and can gate CI on agent quality.; unity-mcp: MCP for Unity integrates AI assistants like Claude and VS Code Copilot with the Unity Editor using the Model Context Protocol. This allows developers to use Large Language Models to manage assets, control scenes, edit scripts, and automate various tasks within Unity, streamlining game development workflows.

01

TL;DR

coder_eval logo
coder_evalDev Tooling · ★ 154

Benchmark coding agents on your own domain tasks

Read coder_eval full review →
unity-mcp logo
unity-mcpDev Tooling · ★ 15.3k
When to choose:
  • You develop games in Unity and want AI assistants (Claude, Cursor) to manage assets, inspect hierarchy, edit C# scripts, and run Editor commands via MCP.
  • You want to automate scene setup, prefab creation, and repetitive Unity Editor tasks using natural language.
When to skip:
  • You use Unreal Engine or Godot; unity-mcp connects strictly to the Unity Editor.
  • You only write gameplay C# logic outside of Unity and do not need Editor-level RPC integration.
Read unity-mcp full review →
02

Side-by-Side Comparison

Field
coder_eval logocoder_eval
unity-mcp logounity-mcp
Category
Dev Tooling
Dev Tooling
Stars
★ 154
★ 15.3k
License
Apache-2.0
MIT
Install Command
uv tool install coder-eval
Unity Package Manager → Add from git URL: https://github.com/CoplayDev/unity-mcp.git?path=/MCPForUnity#main
Updated
1d ago
4d ago
Open Source
Yes
Yes
Website
↗ Visit
↗ Visit
GitHub
↗ GitHub
↗ GitHub
Tags
agent-evaluation, agent-skills, agent-testing
Unity, LLM, AI Assistant
03

Features

coder_eval logocoder_eval
01Declarative YAML tasks with pinned dependencies and success criteria
02Sandboxed execution with resource limits
03Weighted 0.0-1.0 scoring, including LLM-graded rubrics and skill_triggered checks
04A/B experiments across agents, models, tools and prompts
05Telemetry for every tool call, token count and cost
unity-mcp logounity-mcp
01Natural Language Control over Unity
02Comprehensive Unity Toolset (assets, scenes, scripts, etc.)
03Automation of Repetitive Workflows
04Extensible with Various MCP Clients
05Seamless AI Assistant Integration
04

Use Cases

coder_eval logocoder_eval
↳Benchmark coding agents on your own domain tasks
↳Verify that a skill actually triggers in the agent you ship for
↳Fail CI builds when agent or skill quality regresses
unity-mcp logounity-mcp
↳Rapidly creating and prototyping Unity applications using natural language.
↳AI-driven management of Unity assets, scenes, and scripts.
↳Automating complex or repetitive Unity development workflows.
05

Best For

coder_eval logocoder_eval
—
unity-mcp logounity-mcp
Most PopularEssentialTrending
FAQ

FAQ

What is the difference between coder_eval and unity-mcp?
Both coder_eval and unity-mcp are in the Dev Tooling category. coder_eval has 154 stars, while unity-mcp has 15.3k stars.
Which is better, coder_eval or unity-mcp?
The best choice depends on your use case. Choose coder_eval if Benchmark coding agents on your own domain tasks, and unity-mcp if Rapidly creating and prototyping Unity applications using natural language..
Is coder_eval free or open source?
Yes, coder_eval is open source on GitHub (Apache-2.0).
Is unity-mcp free or open source?
Yes, unity-mcp is open source on GitHub (MIT).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related

Alternatives to coder_eval →Alternatives to unity-mcp →coder_eval details →unity-mcp details →unity-mcp vs GitHub MCP Server →blender-mcp vs unity-mcp →