Skip to main content

Metric definition audit

Collect every definition of a metric in use across your documents and show where they disagree.

The prompt
Find every definition of METRIC NAME in the material I am pointing you
at, and show where they disagree.

One row per definition you find:

  Source. Document, dashboard or thread, with its date and owner if
  stated.
  Definition. Quoted. If a document uses the metric without defining
  it, that is a row too, with the definition column marked USED BUT NOT
  DEFINED.
  Numerator. What is counted.
  Denominator. What it is counted against, if anything.
  Population. Who or what is included, and who is excluded.
  Window. The period, and whether it is calendar or rolling.
  Filters. Anything excluded: test accounts, internal users, cancelled
  rows, a region.

Then the disagreements. For each pair of definitions that differ, one
line naming the field they differ on and what the difference would do
to the number. Bigger or smaller, and roughly by how much if the
material lets you say.

Then Questions the documents cannot answer. Things only the owner of
each definition can settle, one question per owner, named.

Rules. Do not pick a correct definition. Do not write a new one. Where
a document implies a definition without stating it, mark it INFERRED
and show the sentence you inferred from.

How to use it

Run this in Work mode. It expects to read sources and produce something you can check.

Use when two teams report the same metric with different numbers and you need to find out whether they are measuring the same thing.

Vibe prepares and drafts. You verify and decide. Ask for a citation on every finding: a confident answer is not evidence.

What you get back

One row per definition found with its source and date, a disagreement matrix, and a list of the questions the documents cannot answer.

What it writes

Nothing. This one only answers.

From the source file in awesome-mistral-vibe-prompts, CC BY-SA 4.0. Not affiliated with, or endorsed by, Mistral AI.