Importance of Preregistration in Research
Discover the significance of preregistration in research, which helps combat irreproducibility by outlining research plans before data collection. Learn about its benefits, impact on confirmatory vs. exploratory research, and how it addresses issues like P-hacking and HARKing.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
PREREGISTRATION Sandra Gesing Center for Research Computing, University of Notre Dame sandra.gesing@nd.edu RDA 11thPlenary Meeting, 22 March 2018 Thanks to Center for Open Science! Natalie Meyers and David Mellor cos.io/prereg
The Problem The combination of a strong bias toward statistically significant findings and flexibility in data analysis results can lead to irreproducible research
What is Preregistration? A time-stamped, read-only version of your research plan created before you begin data collection.
What is Preregistration? A time-stamped, read-only version of your research plan created before you begin data collection. It contains: Hypothesis Data collection procedures Manipulated and measured variables Statistical model Inference criteria
When the research plan undergoes peer review before results are known, the preregistration becomes part of a Registered Report
What problems does preregistration fix? 1. The file drawer effect 2. P-Hacking: Unreported flexibility in data analysis 3. HARKing: Hypothesizing After Results are Known Dataset Hypothesis
What problems does preregistration fix? Preregistration makes the distinction between confirmatory (hypothesis testing) and exploratory (hypothesis generating) research more clear.
Confirmatory vs. Exploratory Analysis Context of confirmation Context of discovery Traditional hypothesis testing Pushes knowledge into new Results held to the highest areas/ data-led discovery standards of rigor Finds unexpected relationships Goal is to minimize false Goal is to minimize false positives negatives P-values interpretable P-values meaningless
Example workflow Theory driven, a- priori expectations Create Preregistration Collect New Data Confirmation Phase Hypothesis testing Discovery Phase Exploratory research Hypothesis generating
FAQs Can t someone scoop my ideas?
FAQs Can t someone scoop my ideas? 1. Date-stamped preregistrations make your claim verifiable. 2. By the time you ve preregistered, you are ahead of any possible scooper. 3. Embargo your preregistration.
Tips for writing up preregistered work 1. Include a link to your preregistration (e.g. https://osf.io/f45xp) 2. Report the results of ALL preregistered analyses 3. ANY unregistered analyses must be transparent
THANK YOU! Learn more: cos.io/prereg
