SkillEvaluator
★ 3.3k
vs
SkillSpector
★ 26.6k
SkillEvaluator vs SkillSpector
SkillEvaluator: SkillEvaluator checks agent skills through independent validation, deduplication and live-evaluation tiers. It can compare agent runs with and without a skill to measure task impact.; SkillSpector: SkillSpector scans AI agent skills for suspicious patterns, vulnerabilities and prompt-injection risks using static analyzers and optional LLM analysis. It accepts repositories, URLs, archives and local files and can emit terminal, JSON, Markdown or SARIF results.
01
TL;DR
SkillEvaluatorDev Tooling · ★ 3.3k
Validate a new skill before distribution.
SkillSpectorSecurity & Safety · ★ 26.6k
When to choose:
- You need an additional pre-installation review step with source locations.
- You can review findings and document narrow baseline decisions.
When to skip:
- You need automatic proof that a skill is safe to execute.
- You expect static matching to reliably distinguish quotation and intent.
02
Side-by-Side Comparison
Field
Category
Dev Tooling
Security & Safety
Stars
★ 3.3k
★ 26.6k
License
Apache-2.0
Apache-2.0
Install Command
—
uv tool install git+https://github.com/NVIDIA/skillspector.git
Updated
Today
2d ago
Open Source
Yes
Yes
Tags
agent-evaluation, agent-plugins, agent-security
agent-security, agent-skills, agentic-ai
03
Features
01Run deterministic quality checks without an API key.
02Detect duplicated or overlapping guidance.
03Compare skill-enabled and baseline agent runs.
04Integrate changed-skill checks into CI workflows.
01Static analysis with optional LLM semantic checks
02Repository, URL, archive and local-file inputs
03JSON, Markdown and SARIF reporting
04Baselines and suppression for accepted findings
04
Use Cases
↳Validate a new skill before distribution.
↳Find overlapping instructions in a skill collection.
↳Measure whether a skill improves task outcomes.
↳Reviewing third-party skills before installation
↳Adding skill scans to CI workflows
↳Tracking new findings against a baseline
05
Best For
—
Most Popular
FAQ
FAQ
What is the difference between SkillEvaluator and SkillSpector?
Both SkillEvaluator and SkillSpector are in the Dev Tooling category. SkillEvaluator has 3.3k stars, while SkillSpector has 26.6k stars.
Which is better, SkillEvaluator or SkillSpector?
The best choice depends on your use case. Choose SkillEvaluator if Validate a new skill before distribution., and SkillSpector if Reviewing third-party skills before installation.
Is SkillEvaluator free or open source?
Yes, SkillEvaluator is open source on GitHub (Apache-2.0).
Is SkillSpector free or open source?
Yes, SkillSpector is open source on GitHub (Apache-2.0).
Cloud Infrastructure
AdDeploy on DigitalOcean
Host your MCP servers, Docker containers, and AI agents with $200 free credit over 60 days.
→