Skip to content
Learn · Prompt

Prompt regression eval skeleton

Generate an eval harness for a prompt you're about to change in production.

engineering
Given the prompt below and 3-5 example inputs, generate a regression eval harness in TypeScript:

1. A `Case` type with input + expected properties of the output (not the literal output — properties: tone, structure, factual claims, refusal-or-not).
2. An array of 10 cases derived from the examples (mutate them: edge cases, adversarial inputs, length extremes, missing fields).
3. An `assertOutput` function that runs property checks and returns a pass/fail list.
4. A runnable `main` that prints a table.

No external eval framework. Just plain TS.

PROMPT:
"""
{{prompt}}
"""

EXAMPLE INPUTS:
"""
{{examples}}
"""