mcpbeat Sign in

Behavioral Evals Agent Skill

Guidance for creating, running, fixing, and promoting behavioral evaluations. Use when verifying agent decision logic, debugging failures, debugging prompt steering, or adding workspace regression tests.

624 tokens
context cost
SKILL.md, read when the skill is used
7
files
plus fonts, images or templates
0
copies elsewhere
how many repositories repackaged it
106 350
stars on the repo
on the repository, not the skill itself

Install

one command, takes just this skill from the repository
npx skills add https://github.com/google-gemini/gemini-cli --skill behavioral-evals

What comes with it

15 723 bytes besides the instruction
assets/interactive_eval.ts.txt
assets/standard_eval.ts.txt
references/creating.md
references/fixing.md
references/promoting.md
references/running.md

The instruction itself

8 sections, as written by the author

Behavioral Evals

Overview

Behavioral evaluations (evals) are tests that validate the agent's decision-making (e.g., tool choice) rather than pure functionality. They are critical for verifying prompt changes, debugging steerability, and preventing regressions.

> [!NOTE]

> Single Source of Truth: For core concepts, policies, running tests, and general best practices, always refer to evals/README.md.


🔄 Workflow Decision Tree

  • Does a prompt/tool change need validation?
  • *No* -> Normal integration tests.
  • *Yes* -> Continue below.
  • Is it UI/Interaction heavy?
  • *Yes* -> Use appEvalTest (AppRig). See creating.md.
  • *No* -> Use evalTest (TestRig). See creating.md.
  • Is it a new test?
  • *Yes* -> Set policy to USUALLY_PASSES.
  • *No* -> ALWAYS_PASSES (locks in regression).
  • Are you fixing a failure or promoting a test?
  • *Fixing* -> See fixing.md.
  • *Promoting* -> See promoting.md.

📋 Quick Checklist

1. Setup Workspace

Seed the workspace with necessary files using the files object to simulate a realistic scenario (e.g., NodeJS project with package.json).

  • *Details in creating.md*

2. Write Assertions

Audit agent decisions using rig.setBreakpoint() (AppRig only) or index verification on rig.readToolLogs().

  • *Details in creating.md*

3. Verify

Run single tests locally with Vitest. Confirm stability locally before relying on CI workflows.

  • *See evals/README.md for running commands.*

📦 Bundled Resources

Detailed procedural guides:

  • creating.md: Assertion strategies, Rig selection, Mock MCPs.
  • fixing.md: Step-by-step automated investigation, architecture diagnosis guidelines.
  • promoting.md: Candidate identification criteria and threshold guidelines.

Other skills for the same job

different authors, same section of the catalogue
Webapp Testing
by anthropics
vendor ×15

Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.

978 tokens scripts
Finishing A Development Branch
by ZhanlinCui
×9

Use when implementation is complete, all tests pass, and you need to decide how to integrate the work - guides completion of development work by presenting structured options for merge, PR, or cleanup

1.1k tokens
Test Driven Development
by w95
×9

Use when implementing any feature or bugfix, before writing implementation code

2.5k tokens
Systematic Debugging
by ratacat
×9

Use when encountering any bug, test failure, or unexpected behavior, before proposing fixes

2.5k tokens scripts
Verification Before Completion
by ZhanlinCui
×8

Use when about to claim work is complete, fixed, or passing, before committing or creating PRs - requires running verification commands and confirming output before making any success claims; evidence before assertions always

1.1k tokens
Backtest Expert
by BaggaT236
×3

Expert guidance for systematic backtesting of trading strategies. Use when developing, testing, stress-testing, or validating quantitative trading strategies. Covers "beating ideas to death" methodology, parameter robustness testing, slippage modeling, bias prevention, and interpreting backtest results. Applicable when user asks about backtesting, strategy validation, robustness testing, avoiding overfitting, or systematic trading development.

2.2k tokens scripts
Adaptyv
by christophacham
×3

Cloud laboratory platform for automated protein testing and validation. Use when designing proteins and needing experimental validation including binding assays, expression testing, thermostability measurements, enzyme activity assays, or protein sequence optimization. Also use for submitting experiments via API, tracking experiment status, downloading results, optimizing protein sequences for better expression using computational tools (NetSolP, SoluProt, SolubleMPNN, ESM), or managing protein design workflows with wet-lab validation.

1.1k tokens
Aeon
by christophacham
×3

This skill should be used for time series machine learning tasks including classification, regression, clustering, forecasting, anomaly detection, segmentation, and similarity search. Use when working with temporal data, sequential patterns, or time-indexed observations requiring specialized algorithms beyond standard ML approaches. Particularly suited for univariate and multivariate time series analysis with scikit-learn compatible APIs.

2.9k tokens

How to use it

Copy the folder

Take google-gemini/behavioral-evals from the repository into ~/.claude/skills for personal use, or into .claude/skills inside a project.

Check the name does not clash

The agent identifies a skill by the name field in its header. Two skills with the same name cannot sit side by side — one of them will be ignored.