Template - Model Bakeoff

CSV template for comparing evaluator configurations by criterion family.

CSV2 lines582 BSHA-256 271c3846fbe9...templateauthoring

Table preview

experiment_idrun_datecontract_idbenchmark_versionmodel_providermodel_namemodel_versionjudge_roleprompt_template_idprompt_template_versionreasoning_modetemperaturesamples_per_itemreference_timingcandidate_order_policyensemble_policycriterion_macro_f1critical_false_accept_ratestrong_positive_false_reject_rateevidence_span_precisionevidence_span_recallpositive_finding_precisionomission_recallbrier_scoreececoverage_at_target_riskmean_latency_msmean_cost_per_casenotes
EXP-001criterion_adjudicatordefault01laterandomizednone

Raw CSV

experiment_id,run_date,contract_id,benchmark_version,model_provider,model_name,model_version,judge_role,prompt_template_id,prompt_template_version,reasoning_mode,temperature,samples_per_item,reference_timing,candidate_order_policy,ensemble_policy,criterion_macro_f1,critical_false_accept_rate,strong_positive_false_reject_rate,evidence_span_precision,evidence_span_recall,positive_finding_precision,omission_recall,brier_score,ece,coverage_at_target_risk,mean_latency_ms,mean_cost_per_case,notes
EXP-001,,,,,,,criterion_adjudicator,,,default,0,1,late,randomized,none,,,,,,,,,,,,,