IEEE VIS 2024 Content: Merits and Limits of Preregistration for Visualization Research

Merits and Limits of Preregistration for Visualization Research

Lonni Besançon - Linköping University, Norrköping, Sweden

Brian Nosek - University of Virginia, Charlottesville, United States

Tamarinde Haven - Tilburg University, Tilburg, Netherlands

Miriah Meyer - Linköping University, Nörrkoping, Sweden

Cody Dunne - Northeastern University, Boston, United States

Mohammad Ghoniem - Luxembourg Institute of Science and Technology, Belvaux, Luxembourg

Download preprint PDF
Download camera-ready PDF

Room: Bayshore I

2024-10-14T16:00:00ZGMT-0600Change your timezone on the schedule page
2024-10-14T16:00:00Z
Exemplar figure, described by caption below
In this position paper, we summarize the 2022 panel's discussions and arguments for the wider visualization and human-computer interaction community, point to useful resources, and discuss implications along with any needed community-driven efforts.
Abstract

The replication crisis has spawned a revolution in scientific methods, aimed at increasing the transparency, robustness, and reliability of scientific outcomes. In particular, the practice of preregistering study designs has shown important advantages. Preregistration can help limit questionable research practices, as well as increase the success rate of study replications. Many fields have now adopted preregistration as a default expectation for published studies. In 2022, we set up a panel ``Merits and Limits of User Study Preregistration'' with the overall goal of explaining the concept of preregistration to a wide VIS audience and discussing its suitability for visualization research. We report on the arguments and discussion of this panel in the hope that it can benefit the visualization community at large.All materials and a copy of this paper are available on our OSF repository at https://osf.io/wes57/.