Skip to main content

Agent evaluation plan

What it does

Designs a pre-launch evaluation plan for an agent from its instructions text, skills, capabilities, knowledge sources and sample requests: a behaviour contract of testable statements quoted from the text, test prompts by scenario family and tier with setup, expected behaviour, pass and fail criteria and red flags, a red-flag catalogue, a blank scoring sheet, a coverage table and a go or no-go checklist the owner completes and decides. Use when the user asks to "write test cases for my agent", "how do I evaluate this agent before launch", "build a test plan for the agent", "what should I check before publishing this agent" or "give me a go no-go checklist". Do not use for finding injection or leakage exposures in the instructions, use agent-instructions-red-team instead; do not use for reviewing one SKILL.md, use skill-file-reviewer instead. Drafts for human review; never approves, authorises or signs off.

How to install it

In the web interface, open Context, then Skills, then Import, and choose Upload skill folder.

On the command line, copy the folder into .agents/skills/ in your project, or into ~/.vibe/skills/ to have it everywhere.

This skill ships 1 reference file. Take the whole folder, not just the SKILL.md. The skill reads those files while it runs, and without them it fails in a way that is hard to spot.

Read the full skill in the source repository, part of awesome-mistral-vibe-skills, CC BY-SA 4.0. Not affiliated with, or endorsed by, Mistral AI.