Skip to content

evaluation 8

  • dsh-evidence-arena v0.1.0 Verified Web UI 2

    Evidence-first multi-model coding comparison workbench for DeepSeek Harness

    dsh plugin add dsh-evidence-arena
  • dsh-plugin-compare v0.1.0 Verified Web UI 1

    Controlled A/B comparisons and evidence-backed reports for DeepSeek Harness plugins and presets.

    dsh plugin add dsh-plugin-compare
  • dsh-trapstreet v0.7.0 Verified 1

    Check which DeepSeek Harness plugins actually loaded, and look up public evaluation boards on trapstreet.run

    dsh plugin add @trapstreet/dsh-trapstreet
  • dsh-plugin-judge v0.1.1 Verified Web UI

    Plugin value auditor for DeepSeek Harness: judge a plugin before install and audit installed ones — heuristic scan + LLM judge, with model-switch re-audit reminders. · DSH 插件价值裁判:装前判断值不值得装,装后审计是否还该留,模型切换时提醒复核。

    dsh plugin add dsh-plugin-judge
  • dsh-livebench-panel v0.2.36 Verified Web UI

    DSH web plugin: a LiveBench tab in the Trajectory view (right of 对话/轨迹). Run LiveBench evaluations against every model configured in the DeepSeek Harness — pick provider/model, category, task, release and question range from dropdowns, watch progress, and

    dsh plugin add dsh-livebench-panel
  • dsh-touchstone v0.2.0 Verified Web UI

    DSH 试金石:给「自改造」补上评测这一环——用一套金标准用例,把改动前 vs 改动后跑一遍、打分、对比,好就留、不好就撤。

    dsh plugin add dsh-touchstone
  • dsh-verdict v0.5.1 Verified Web UI

    Measure whether a dsh setup change actually helped: register repeatable cases, run them, and diff the results before and after you change rules, skills, or models.

    dsh plugin add dsh-verdict
  • dsh-bakeoff v0.1.0 Verified

    DSH 插件:同一任务、同一代码基线,多 Variant(模型/Preset)并行对照实验、EvidenceReceipt 对比与胜出 Patch 导出

    dsh plugin add dsh-bakeoff