Societal impact assessment
Abundance Potential
Preregistration in biology works best when it leaves room for discovery
Assessment takeaway
Unknown · insufficient evidence
The target is the article’s central adapted-preregistration approach. Its clearest conditional abundance pathway is improved scientific capability through more transparent research decisions. The potential contribution to human wellbeing is indirect; the packet does not support scoring affordability and access, reach and fairness, or environmental effects. The recommendations and reported implementation experience do not establish measured societal outcomes.
This describes conditional potential, not a probability or measured outcome. Unknown values are not zero, and harms are not subtracted from the total.
Assessment scope
- Development
- An adapted preregistration approach for experimental biology that prioritizes advance analysis plans, inclusion and exclusion rules, and transparent records of deviations while allowing practical flexibility in data collection.
- Baseline
- Experimental biology research without a consistent practice of preregistering analysis and inclusion or exclusion decisions or recording deviations transparently.
- Population
- Researchers conducting exploratory and confirmatory experimental biology, with downstream users of biomedical and life-science evidence as indirect beneficiaries.
- Geography
- Experimental biology globally; the packet’s implementation example is in Brazil and its cited attitudes survey concerns animal researchers in Switzerland.
- Target assumptions
- Potential benefits depend on researchers adopting proportionate preregistration, labeling unplanned analyses, and recording deviations. The assessment assumes these practices could improve the transparency and credibility of research, but does not assume measured improvements in research outcomes.
Five dimensions
- Human wellbeing
- 1/4 · If greater transparency and less selective analysis lead to more credible biomedical evidence, the approach could indirectly support better downstream decisions. This is a limited, conditional pathway; the article provides no measured health or wellbeing effects. Sources: evidence-2905, evidence-2906, evidence-2912
- Affordability and access
- Unknown · The evidence does not assess effects on the cost or accessibility of essentials or useful capabilities.
- Reach and fairness
- Unknown · The evidence does not assess who would adopt or benefit from the approach, or whether effects would be distributed fairly.
- Environment and resources
- Unknown · The evidence does not assess environmental effects or resource use.
- Scientific capability
- 2/4 · Advance analysis plans and transparent inclusion or exclusion rules could make research decisions easier to distinguish and evaluate, supporting scientific credibility. The contribution is bounded by implementation difficulties and the fact that preregistration alone does not prevent selective reporting; the article does not measure a comparative improvement. Sources: evidence-2905, evidence-2906, evidence-2907, evidence-2908, evidence-2912
Evidence, confidence and timing
Evidence maturity
Finding: Early speculative. The packet presents a qualitative argument and recommendations, alongside a report of implementation difficulties. It provides no measured comparison of the adapted approach’s effects.
Societal benefit: Early speculative. Benefits for research transparency and credibility are proposed, but downstream societal gains are indirect and not measured in the packet.
Confidence: Low. The evidence is a qualitative recommendation, not a measured comparison. The implementation report has no deviation rate and is limited to one multicenter effort; the article also notes that selective reporting can persist.
Conditional time horizon: Unknown. The packet gives no estimate for adoption or for when any downstream benefit might occur. It reports barriers and low trial of the practice in one survey population, but that does not establish a timeline.
Possible benefits
- Preregistering decisions can help readers distinguish plans made before data collection from analyses or hypotheses developed afterward, potentially reducing opportunities for HARKing. Sources: evidence-2906
- Prespecified analysis plans and inclusion or exclusion rules could limit some opportunities for p-hacking and make research decisions more transparent. Sources: evidence-2908
- Registered Reports can bring peer review to the protocol stage and provide in-principle acceptance regardless of eventual results, which the article presents as a way to reduce the influence of results on publication decisions. Sources: evidence-2909
Risks and possible harms
- Added workload, delays, reduced flexibility, and concern about being scooped may burden researchers or discourage adoption. Excessive prespecification may also hinder necessary adjustments during complex or exploratory lab work. Affected groups: Experimental biology researchers, especially those working with complex, exploratory, non-standard, or still-developing methods. Sources: evidence-2908, evidence-2910
- Preregistration alone cannot prevent selective reporting; discarded experiments or data may still be selected under post hoc criteria, limiting the expected credibility benefit. Affected groups: Researchers and downstream users of experimental and biomedical evidence. Sources: evidence-2912
Distribution and adoption
Who might be excluded
- Distribution of benefits remains uncertain.
Adoption barriers
- The article reports concerns about workload, delays, reduced flexibility, and scooping. A survey of animal researchers in Switzerland found mostly negative views and that 10% had tried preregistration; this result is specific to that survey population. Sources: evidence-2910
- In the Brazilian Reproducibility Initiative, researchers reportedly struggled to define some decisions and validity criteria in advance and frequently departed from their protocols. Sources: evidence-2907
Assumptions and conditions that could change the assessment
- Researchers can identify and prespecify analysis choices and inclusion or exclusion rules while retaining enough flexibility to adapt data collection when needed. Sources: evidence-2908
- Transparent records, labels for unplanned analyses, and logs of discarded experiments would be used and made available in ways that help readers assess decisions. Sources: evidence-2911, evidence-2912
- Comparative implementation evidence showing whether the approach improves transparency or research reliability, while documenting deviations and selective reporting, would support revising the benefit scores and confidence. Sources: evidence-2905, evidence-2907, evidence-2912
- Evidence that adoption barriers are manageable across different experimental settings and research populations would support revising the assessment of reach and adoption constraints. Sources: evidence-2907, evidence-2910
Citations
- evidence-2905 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source
- evidence-2906 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source
- evidence-2907 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source
- evidence-2908 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source
- evidence-2909 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source
- evidence-2910 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source
- evidence-2911 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source
- evidence-2912 · When and how is preregistration in experimental biology worth the effort? · O; l; a; v; o; ; B; .; ; A; m; a; r; a; l · 10.1371/journal.pbio.3004129 · Captured publisher article text · Open source