AgentIndex icon
AgentIndex
PyWry logo
PyWry
★ 99
vs
coder_eval logo
coder_eval
★ 154

PyWry vs coder_eval

PyWry: PyWry is a cross-platform rendering engine and desktop UI toolkit for Python with one API and three output targets: a native window through PyTauri, a Jupyter widget, and a browser tab served by FastAPI. It requires Python 3.10 to 3.14.; coder_eval: Coder Eval runs a real coding agent (Claude Code, Codex, Antigravity, OpenCode or Pi) in a sandbox against declarative YAML tasks and scores the files and commands it produced. It supports weighted 0.0-1.0 criteria, skill-trigger checks, A/B experiments and cost telemetry, and can gate CI on agent quality.

01

TL;DR

PyWry logo
PyWryDev Tooling · ★ 99

Prototype an interactive data app in a notebook and ship it as a desktop app

Read PyWry full review →
coder_eval logo
coder_evalDev Tooling · ★ 154

Benchmark coding agents on your own domain tasks

Read coder_eval full review →
02

Side-by-Side Comparison

Field
PyWry logoPyWry
coder_eval logocoder_eval
Category
Dev Tooling
Dev Tooling
Stars
★ 99
★ 154
License
Apache-2.0
Apache-2.0
Install Command
pip install pywry
uv tool install coder-eval
Updated
1w ago
1d ago
Open Source
Yes
Yes
Website
↗ Visit
↗ Visit
GitHub
↗ GitHub
↗ GitHub
Tags
aggrid, anywidget, chat-application
agent-evaluation, agent-skills, agent-testing
03

Features

PyWry logoPyWry
01Native window using the OS webview, not Qt or Electron
02Jupyter widget that works in JupyterLab, VS Code and Colab
03Optional MCP extra for agent integration
coder_eval logocoder_eval
01Declarative YAML tasks with pinned dependencies and success criteria
02Sandboxed execution with resource limits
03Weighted 0.0-1.0 scoring, including LLM-graded rubrics and skill_triggered checks
04A/B experiments across agents, models, tools and prompts
05Telemetry for every tool call, token count and cost
04

Use Cases

PyWry logoPyWry
↳Prototype an interactive data app in a notebook and ship it as a desktop app
↳Build dashboards and chat interfaces in Python
coder_eval logocoder_eval
↳Benchmark coding agents on your own domain tasks
↳Verify that a skill actually triggers in the agent you ship for
↳Fail CI builds when agent or skill quality regresses
FAQ

FAQ

What is the difference between PyWry and coder_eval?
Both PyWry and coder_eval are in the Dev Tooling category. PyWry has 99 stars, while coder_eval has 154 stars.
Which is better, PyWry or coder_eval?
The best choice depends on your use case. Choose PyWry if Prototype an interactive data app in a notebook and ship it as a desktop app, and coder_eval if Benchmark coding agents on your own domain tasks.
Is PyWry free or open source?
Yes, PyWry is open source on GitHub (Apache-2.0).
Is coder_eval free or open source?
Yes, coder_eval is open source on GitHub (Apache-2.0).
Cloud Infrastructure
Ad

Deploy on DigitalOcean

Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.

Claim $200 Free Credit
→

Related

Alternatives to PyWry →Alternatives to coder_eval →PyWry details →coder_eval details →