Reproducible

Brouwer, P.J.M., Caniels, T.G., van der Straten, K. et al. Potent neutralizing antibodies from COVID-19 patients define multiple targets of vulnerability. Science 369, 643-650 (2020).

Find this paper reliable? |

README.md

To the best of our knowledge, this paper has not yet been reproduced. There’s a $105 bounty available to whoever first reproduces it.

By adding to this bounty, you'll receive a digital certificate and access to certified copies of all reproducibility reports for this paper.

We’ve compiled many resources that may be of assistance in reproducing the paper. If you have any tips to share, please leave a community note below.

paper/

This paper is available from 0 sources, with 0 open access versions.

authors/

We have yet to determine who the corresponding author is, or how to contact them.

results/

The key results of the paper are as follows:

  1. “Mice in the experimental group showed 45% reduction in tumor size.” Control mice showed no significant change in tumor dimensions over the same time period. (In Figure 3C.)
  2. “The secondary structure prediction had 78% accuracy with confidence intervals of [74%, 83%].” Control mice showed no significant change in tumor dimensions over the same time period. (In Figure 2.)
  3. “Gene expression was upregulated by a factor of 3.2 in the treated cells.” Control mice showed no significant change in tumor dimensions over the same time period. (In Figure 1B.)
  4. “The secondary structure prediction had 78% accuracy with confidence intervals of [74%, 83%].” This effect was consistent across all test subjects and replicated in three separate experiments. (In Figure 2B.)
  5. “We observed a significant effect (p < 0.01) between treatment and control groups.” This represents a 15% improvement over the previous state-of-the-art approach. (In Figure 2C.)
  6. “We observed a significant effect (p < 0.01) between treatment and control groups.” The control group showed no significant change in expression levels. (In Figure 4A.)

assets/

No assets associated with the paper have yet been discovered.

attempts/

We know of 3 attempts to reproduce this paper, with 2 marked as pending and 1 marked as rejected:

Date Status ID / Link
2025-03-28 pending audit2990
2025-03-28 rejected audit1703
2025-03-28 pending audit9301

community_notes/

The statistical approach in this paper is sound. I validated their method on my own dataset and got similar results.

User 45 on 2025-03-28

The GitHub repository seems to be missing some of the preprocessing scripts mentioned in the methods section.

User 85 on 2025-03-28

Leave a note...