Private preview · 0.2.0-preview.1
Evaluator
Did behavior satisfy an expectation?
Evaluator judges a bounded Trace snapshot against a defined expectation set. It is distinct from Trace and never changes effect truth. The Evaluator is a future P3 interactive surface; this page is static documentation.
What it adds
An application or test harness supplies a bounded projection and expectations such as “the request stopped before dispatch when the warehouse label was ambiguous” or “the verifier used the exact label identity.” PASS, FAIL, and INDETERMINATE describe the expectation comparison, not the business result.
A PASS means the projection satisfies the expectation. A FAIL means it does not. INDETERMINATE means the projection cannot decide. None is a production-readiness claim, effect truth, or permission to make a customer claim.
Example
A warehouse workflow expects one dispatch, one independent read-back, and zero redispatches when printing a shipping label. An Evaluator can fail the expectation if a test Trace shows two dispatches, even if the authoritative system eventually contains the label. Conversely, an UNKNOWN effect can be the honest lifecycle result while an expectation passes. Evaluation belongs to testing; truth belongs to verification.
The host defines expectations and supplies the approved Trace projection. The Evaluator does not rerun operations, contact a provider, inspect private provider state, or repair a record. Missing, stale, malformed, or privacy-truncated Trace should produce INDETERMINATE.