OCDocker.Workbench.Ablation module

Read-only ablation analysis helpers for Workbench result manifests.

OCDocker.Workbench.Ablation.build_ablation_analysis(root, *, baseline_run_id=None, candidates=None, metrics=None, max_depth=6)[source]

Compare adopted OCScore ablation runs against a reference run.

Parameters:

  • root (str or pathlib.Path) – Workbench root or result manifest file to scan.

  • baseline_run_id (str or None) – Optional explicit reference run id. If omitted, a non-ablation run such as train is selected when available.

  • candidates (tuple[str, ...] or list[str] or None) – Optional ablation run ids or policy names. If omitted, every detected ablation policy is compared.

  • metrics (tuple[ParetoObjective, ...] or list[ParetoObjective] or None) – Optional comparison metrics. If omitted, numeric metrics are inferred.

  • max_depth (int) – Maximum directory depth below root to scan.

Returns:

Read-only ablation analysis payload.

Return type:

WorkbenchAblationAnalysis

OCDocker.Workbench.Ablation.parse_ablation_metric(value)[source]

Parse an ablation metric specification.

Parameters:

value (str) – Metric selection in metric or metric:min|max form.

Returns:

Parsed metric objective.

Return type:

ParetoObjective

OCScore ablation comparison

The ablation analysis helper scans an adopted Workbench workspace, detects train/ablations/<policy> source paths recorded by adoption, selects a non-ablation reference run such as train when possible, and compares each policy against that reference. The analysis is read-only and does not launch, stop, copy, or modify OCScore jobs or outputs.

ocdocker workbench ablations workbench-runs --metric auc:max --metric validation.loss:min
ocdocker workbench ablations workbench-runs --baseline train --candidate no_shape_core

The same payload is exposed by the local API at /api/ablations and by the browser dashboard decision view at /app. The dashboard renders the ablation table, a centered delta bar chart for the selected rank metric, and a metric-direction heatmap for the selected decision metrics.

Expanded feature-set similarity across protocols—Jaccard on policy-expanded columns, family rollups, and cluster overlays—is provided separately by OCDocker.Workbench.AblationProtocolSimilarity at /api/ablation-protocol-similarity.