As psychology embraces practices such as data sharing, preregistration, and registered reports, her work examines two key challenges that remain unaddressed. First, while preregistration is becoming more common, there is a lack of established practices for planning and transparently reporting analyses involving latent variable models. Second, current methodological research, particularly simulation studies, does not adequately account for the analytical flexibility that contributes to result heterogeneity. These issues hinder the adoption of open science practices, pose challenges to research validity, and limit the broader impact of methodological advancements.

Dr. Flake will present her recent work on integrating multiverse analysis into simulation studies and highlight the importance of considering decision-making in analysis pipelines as a fundamental component of methodological development. She will conclude with insights for methodologists interested in contributing to ongoing reform efforts and will invite discussion from the audience.

About Jessica Flake

Starting from February 20, Dr. Jessica Flake will spend two weeks at the University of Amsterdam as a SoBe DSC Visiting Fellow. Jessica has been at the forefront of the Open Science movement and has applied open science ideas to the domain of psychological measurement and methodology. She has recently advocated for transparency and reproducibility in simulation studies, and is well known for her paper on questionable research practices in measurement: Measurement Schmeasurement: Questionable Measurement Practices and how to avoid them.