Nature: Comment: A controlled trial for reproducibility

Andy · Mar 11, 2020

In 2016, the US Defense Advanced Research Projects Agency (DARPA) told eight research groups that their proposals had made it through the review gauntlet and would soon get a few million dollars from its Biological Technologies Office (BTO). Along with congratulations, the teams received a reminder that their award came with an unusual requirement — an independent shadow team of scientists tasked with reproducing their results.

Thus began an intense, multi-year controlled trial in reproducibility. Each shadow team consists of three to five researchers, who visit the ‘performer’ team’s laboratory and often host visits themselves. Between 3% and 8% of the programme’s total funds go to this independent validation and verification (IV&V) work. But DARPA has the flexibility and resources for such herculean efforts to assess essential techniques. In one unusual instance, an IV&V laboratory needed a sophisticated US$200,000 microscopy and microfluidic set-up to make an accurate assessment.
Click to expand...

https://www.nature.com/articles/d41586-020-00672-7

Hutan · Mar 11, 2020

the Nature article said:

These costs are high, but we think they are an essential investment to avoid wasting taxpayers’ money and to advance fundamental research towards beneficial applications.
Click to expand...

Wouldn't it be fantastic if universities were each required to operate a unit or two just replicating research in a particular field - and there was government funding for it. Bread and butter funding for universities; students get training, and rubbish research would be less likely to cause expensive failures when applied in the real world.

Log in or Sign up

Nature: Comment: A controlled trial for reproducibility

Andy Committee Member

Hutan Moderator Staff Member

Share This Page

Log in or Sign up

Nature: Comment: A controlled trial for reproducibility

Andy Committee Member

Hutan Moderator Staff Member

Share This Page

Useful Searches