evaluate-report

v2026.09.24

View evaluation results and benchmark reports for a skill or plugin. Use when reviewing past eval results, comparing benchmark runs, or tracking quality trends.

GitHub
Install command
npx skhub add laurigates/evaluate-report
Markdown
SKILL.md

/evaluate:report

View evaluation results and benchmark reports for a skill or plugin.

When to Use This Skill

Use this skill when...Use alternative when...
Want to see results from a past evaluationNeed to run new evaluations -> /evaluate:skill
Comparing benchmark runs over timeWant improvement suggestions -> /evaluate:improve
Reviewing quality trends for a pluginNeed structural compliance -> plugin-compliance-check.sh

Parameters

Parse these from $ARGUMENTS:

ParameterDefaultDescription
<target>requiredplugin/skill-name for skill or plugin-name for plugin
--latesttrueShow most recent benchmark only
--historyfalseShow all benchmark iterations
--comparefalseCompare current vs previous benchmark

Execution

Step 1: Resolve target

Determine if $ARGUMENTS refers to a skill or plugin:

  • Contains /: treat as plugin-name/skill-name, look for <plugin>/skills/<skill>/eval-results/benchmark.json
  • No /: treat as plugin-name, look for <plugin>/eval-results/plugin-benchmark.json

If the target file does not exist, report that no evaluation results are available and suggest running /evaluate:skill or /evaluate:plugin-batch.

Step 2: Load results

Skill-level report (--latest or default): Read benchmark.json and display:

## Evaluation Report: <plugin/skill-name>

**Last run**: <timestamp>
**Runs per eval**: N

| Metric | With Skill | Baseline | Delta |
|--------|-----------|----------|-------|
| Pass Rate | 85% | 42% | +43% |
| Duration | 14s | 12s | +2s |

### Per-Eval Results

| Eval ID | Description | Pass Rate | Failures |
|---------|-------------|-----------|----------|
| eval-001 | Basic usage | 100% | — |
| eval-002 | Edge case | 67% | assertion X |

Skill-level history (--history): Read history.json and display improvement iterations:

## Evaluation History: <plugin/skill-name>

| Version | Date | Pass Rate | Changes |
|---------|------|-----------|---------|
| v3 (current) | 2026-03-04 | 85% | Improved step 3 instructions |
| v2 | 2026-03-01 | 72% | Added error handling |
| v1 | 2026-02-28 | 55% | Initial evaluation |

Skill-level comparison (--compare): Read current and previous benchmarks, show delta:

## Comparison: <plugin/skill-name>

| Metric | Previous | Current | Delta |
|--------|----------|---------|-------|
| Pass Rate | 72% | 85% | +13% |
| Duration | 16s | 14s | -2s |

Improved evals: eval-002, eval-004
Regressed evals: none

Plugin-level report: Read plugin-benchmark.json and display:

## Plugin Report: <plugin-name>

| Skill | Evals | Pass Rate | Status |
|-------|-------|-----------|--------|
| skill-a | 4 | 100% | PASS |
| skill-b | 3 | 67% | NEEDS WORK |

**Overall**: 82% pass rate
**Skills evaluated**: N / M total

Agentic Optimizations

ContextCommand
Find skill benchmarkcat <plugin>/skills/<skill>/eval-results/benchmark.json | jq .summary
Find plugin benchmarkcat <plugin>/eval-results/plugin-benchmark.json | jq .summary
Check for historycat <plugin>/skills/<skill>/eval-results/history.json | jq '.iterations | length'
List available resultsfind <plugin> -name benchmark.json -o -name plugin-benchmark.json

Quick Reference

FlagDescription
--latestMost recent benchmark (default)
--historyShow all iterations
--compareCompare current vs previous
Discovery
Tags

No tags published for this skill.

Version
Latest version metadata

Version

v2026.09.24

Published

Sep 24, 2026

Category

Uncategorized

License

MIT

Source path

evaluate-plugin/skills/evaluate-report

Default branch

main

Latest commit

1668324

Tree SHA

b2d4cc3