agent-evaluation 6

OMK — Observe. Measure. Know. Evidence-backed knowledge changes for AI applications.

LLM-as-a-Verifier for dsh with the Best-of-N conversation mode built in: rank N candidates with a fine-grained verifier (expected grade over the logprob distribution), on demand via the verify tool or automatically on every turn of a Best-of-N session. In

Replay real DeepSeek Harness turns against Standard, Minimal, Anchored, or plugin candidates with frozen request-surface evidence

Agent evaluation platform: benchmark YAML, headless run orchestration, trace-based metrics, and run reports

DeepSeek Harness plugin and bundled Skill for safely evolving Cordis Candidates with Harbor.

Paired experiments and promotion gates for DSH plugins.