OCDocker.OCScore.Analysis.Metrics package

Submodules

• OCDocker.OCScore.Analysis.Metrics.Bootstrap module
  • bootstrap_ci()
• OCDocker.OCScore.Analysis.Metrics.Calibration module
  • LOGIT_CLIP
  • logits_to_probabilities()
  • clip_probabilities()
  • expected_calibration_error()
  • evaluate_calibration_metrics()
  • reliability_curve_points()
  • ProbabilityCalibrator
  • is_calibration_metric_key()
  • apply_calibration_report_mode_to_metrics()
  • collect_calibration_report_issues()
  • validate_calibration_report_mode()
  • extract_calibration_metrics()
  • build_calibration_report_section()
  • merge_calibration_metrics()
  • enrich_dudez_export_metrics()
  • calibration_metric_names()
• OCDocker.OCScore.Analysis.Metrics.Ranking module
  • DEFAULT_SCREENING_COMPARISON_METRICS
  • orient_scores()
  • is_valid_ranking_scores()
  • score_ranking_diagnostics()
  • bedroc()
  • rie()
  • aggregate_group_metric()
  • evaluate_screening_metrics_by_group()
  • evaluate_scoring_functions_by_group()
  • enrichment_factor()
  • ndcg_at_fraction()
  • groupwise()
  • pr_auc()
  • riep()
  • roc_auc()
  • threshold_at_precision()
  • top_fraction_precision()
  • top_k_precision()
  • binary_threshold_youden()
  • confusion_counts()
  • classification_metrics_at_threshold()
  • aggregate_group_classification_metrics()
  • evaluate_screening_metrics()

Module contents

Metrics package for model evaluation and validation.

Usage:

import OCDocker.OCScore.Analysis.Metrics as ocstatmetrics

Modules

• Bootstrap: Bootstrap confidence intervals for metrics.

• Ranking: Core ranking metrics (ROC/PR/EF, etc.).

• Calibration: Brier, log loss, ECE, and Platt/isotonic calibrators for OCScore.