mcpbeat

Diff Skill

serpro69/claude-toolbox-diff-skill

| Compare two versions of a skill's instructions to detect degradations and complexity increases. Asymmetric check — only regressions count. Additions, clarifications, and strengthenings are not degradations. Compares HEAD → working tree by default. Walks the full reachable file set from SKILL.md via markdown links. Produces a report file under docs/reviews/diff-skill/ and an inline summary.

5k tokens
context cost
the whole folder, loaded on every use
14
files
instructions only
0
copies elsewhere
how many repositories repackaged it
147
stars on the repo
on the repository, not the skill itself

Install

one command, takes just this skill from the repository
npx skills add https://github.com/serpro69/claude-toolbox --skill diff-skill

What comes with it

15 944 bytes besides the instruction
diff-process.md
evals/clean-refactor/eval.json
evals/clean-refactor/test-files/after/review-process.md
evals/known-degradation/eval.json
evals/known-degradation/test-files/after/example-process.md
evals/known-degradation/test-files/after/shared-conventions.md
evals/known-degradation/test-files/before/example-process.md
evals/known-degradation/test-files/before/shared-conventions.md
shared-capy-knowledge-protocol.md

The instruction itself

5 sections, as written by the author

<!-- codex: tool-name mapping applied. See .codex/scripts/session-start.sh -->

Diff Skill Instructions

Goal: Detect whether an edit to a skill's markdown instructions introduced degradations or made the skill harder for an LLM to follow.

Two judgment axes:

  • Degradation (asymmetric) — load-bearing instruction dropped, constraint weakened, verification step removed, scope narrowed, required output dropped, or reference broken. Content relocated but preserved is neutral.
  • Complexity — split into _regressions_ (introduced or worsened by the edit, affects verdict) and _pre-existing advisories_ (exist regardless of the edit, surfaced as improvement opportunities, does NOT affect verdict).

Conventions

  • Read capy knowledge base conventions at shared-capy-knowledge-protocol.md.

Required Outputs

  • [ ] Report written to docs/reviews/diff-skill/<slug>-<sha-a>-<sha-b>.md
  • [ ] Inline summary presented (under 10 lines: verdict, finding counts, report path)
  • [ ] Capy indexed under kk:review-findings if any degradation or complexity regression findings exist (skip on clean results and pre-existing advisories)

Invocation

$kk:diff-skill <skill-name>

Convenience shortcut: resolves klaude-plugin/skills/<skill-name>/SKILL.md. If not found, asks the user for the skill directory path.

Defaults: HEAD (before) → working tree (after). User can specify different refs in the prompt.

Workflow

Mandatory order — load instructions before acting on subject matter. The phases below are strictly sequential. Do not read skill content, build file sets, or produce judgments until you have loaded and internalized the full process file. The only early contact with the target skill is its name and SKILL.md path — enough to validate, not enough to judge.

See diff-process.md for the detailed step-by-step process.

How to use it

Copy the folder

Take serpro69/claude-toolbox-diff-skill from the repository into ~/.claude/skills for personal use, or into .claude/skills inside a project.

Check the name does not clash

The agent identifies a skill by the name field in its header. Two skills with the same name cannot sit side by side — one of them will be ignored.