reproducibility
NSF to Consider Proposals on Reproducibility and Replicability in Science
On October 25, the National Science Foundation (NSF) released a Dear Colleague Letter reaffirming the agency’s commitment to the findings of a 2019 report from the National Academies of Sciences, Engineering, and Medicine (NASEM) titled Reproducibility and Replicability in Science. This report was aimed at providing clear research practices and guidelines to recreate scientific results through multiple research methods and to identify ways to improve public confidence in scientific findings (see previous COSSA coverage). In addition, the NSF letter notes that the agency may be interested in funding proposals for research addressing reproducibility and replicability in science. NSF is especially…
NASEM Report Analyzes Factors for Reproducibility and Replicability in Scientific Research
In response to a Congressional directive to conduct a comprehensive study of issues related to reproducibility and replicability of scientific research, the National Academies of Sciences, Engineering, and Medicine has released a new report, Reproducibility and Replicability in Science. The consensus study report defines the terms “reproducibility” – or getting similar results using the same research methods – and “replicability” – getting similar results across multiple research methods – as they relate to research practices. The report sets forth several steps on how to improve the reproducibility and replicability of research, including identifying clear descriptions of how the reported result…
National Academies Launches Reproducibility and Replicability Study
The National Academies of Sciences, Engineering, and Medicine held the first meeting of the study committee on Reproducibility and Replicability in Science on December 12 and 13. The study is sponsored by the National Science Foundation (NSF) and is statutorily required by a provision in the American Innovation and Competitiveness Act. The committee will work to identify factors that affect reproducibility and replication, highlight best practices, and ascertain the extent of issues affecting reproducibility and replication. More information about project can be found here. Back to this issue’s table of contents.
NIH Issues Notice on Enhancing Reproducibility
On June 9, the National Institutes of Health (NIH) Office of Extramural Research (OER) issued a Notice (NOT-OD-15-103) in an effort to clarify and revise application instructions and review criteria “to enhance reproducibility of research findings through increased scientific rigor and transparency.” The release of the Notice is to raise awareness and begin “culture shifts in the scientific community.” In a June 9 blog post, Sally Rockey, NIH Deputy Director for Extramural Research, and Larry Tabak, Principal Deputy Director of NIH, explained, “These changes will prompt applicants and reviewers to consider issues, which—if ignored—may impede the transparency needed to reproduce key…
NIGMS Advisory Council Approves New Grant Mechanism, Discusses Reproducibility
At the September meeting of the National Institute of General Medical Sciences (NIGMS) Advisory Council, director Jon Lorsch provided an update on a number of issues, including the National Institutes of Health’s (NIH) data reproducibility efforts, the NIGMS strategic planning process, and an overview of the impacts of the previous NIH budget-doubling period “on the biomedical research ecosystem.” In addition, the Council approved the Institute’s concept clearance to create the new Maximizing Investigators’ Research Award (MIRA), clearing the way for NIGMS to proceed. Reproducibility Lorsch noted that reproducibility is not a single issue but an issue of reproducibility of data,…