Within & Between

Within&Between Podcast
Within & Between

A podcast about the methods and metascience of developmental science, cohosted by Jessica Logan @jarlogan and Sara Hart @saraannhart. We talk about developmental sciencing, including data collection, data analysis, research methods, and open science, as well as life in academia. Think about it like a lab meeting where you don’t have to do the readings and never have to present. ​

  1. 12/06/2023

    S4E11: Revisiting Preregistration and Registered Reports

    In this episode, Jess and Sara reckon with what the preregistration revolution means in developmental science. We first visited preregistration and registered reports in Season 3. Since then, we’ve been a part of many preregistrations and registered reports, and have reviewed and handled them as editors. Through that process, we’ve noticed that questions often come up about whether something is really a preregistration and whether some studies or analyses can or should be preregistered.  We mention:  Several definitions: Open Science Framework:  “Preregistration is the practice of documenting your research plan at the beginning of your study and storing that plan in a read-only public repository”. APA: “Preregistration allows researchers to specify and share the details of their research in a public registry before conducting the study.” IES - no definition, just that you should do it; it’s part of the SEER standards.  REES similarly just says “REES is designed to increase transparency of and access to information about both ongoing and completed efficacy and effectiveness studies.” Even the preregistration revolution article doesn’t include a definition. The closest it gets (about ⅓ of the way through the article is “Preregistration of an analysis plan is committing to analytic steps without advance knowledge of the research outcomes.”  Paper about preregistering exploratory analyses: Compares it to a funded sea voyage:  https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7098547/  Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. This episode was recorded 9/10/2023.

    44 min
  2. 08/17/2023

    S4E9: Common Data Elements? What are those?

    Related to this podcast's interests in data sharing, this week Jess and Sara talk about common data elements initiatives. These are movements that are hoping to get all of the researchers in the same field or subfield to agree to a given set of assessments, measures, procedures, and/or reporting metrics (Think: Everyone who measures mother’s education would ask the same stem question with the same eight category responses, which would be coded and reported in the same way).  We’ll talk about different types of initiatives, the reasons why proponents think it’s a great idea, and what major concerns might come up. Sara also gives us a mini lecture introducing genome-wide association studies. Trust us, it’s related!  In this episode, we talk about:  The NIH Common Data Elements Program: https://heal.nih.gov/data/common-data-elements  NIH Common Measures website: https://www.phenxtoolkit.org/  A paper about the NIMH common data elements: Barch, D. M., Gotlib, I. H., Bilder, R. M., Pine, D. S., Smoller, J. W., Brown, C. H., ... & Farber, G. K. (2016). Common measures for National Institute of Mental Health funded research. Biological Psychiatry, 79(12), e91-e96. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4968690/ What’s the difference between common measures and common metrics:  de Beurs, E., Boehnke, J. R., & Fried, E. I. (2022). Common measures or common metrics? A plea to harmonize measurement results. Clinical Psychology & Psychotherapy, 29(5), 1755-1767. Paper describing the openly available Project KIDS data: Van Dijk, W., Norris, C. U., Al Otaiba, S., Schatschneider, C., & Hart, S. A. (2022). Exploring individual differences in response to reading intervention: Data from Project KIDS (Kids and Individual Differences in Schools). Journal of Open Psychology Data, 10(1). Educational attainment GWAS paper data harmonization appendix: https://static-content.springer.com/esm/art%3A10.1038%2Fs41588-022-01016-z/MediaObjects/41588_2022_1016_MOESM1_ESM.pdf   Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded July 9, 2023.

    59 min
  3. 07/05/2023

    S4E8: LIVE EPISODE! So you measured something twice, now what?

    Measuring change is our first ever LIVE EPISODE! Recorded at the Association for Psychological Science conference with a live conference audience! Over here in the developmental sciences, we are often trying to measure or predict how much people grow and change over time. To do that, we’ll sometimes measure a skill or ability twice (for kids, maybe that’s once near the beginning of the school year and once at the end of the school year). In this episode, Jess and Sara talk about options for statistically modeling and predicting change between two timepoints. We talk about two basic models: the simple difference scores and residualized gain scores, explain why we can’t just measure people at post test, and conclude that the question is important in making your decision. Have a listen as we get to take some related questions from the audience.  Things we mentioned:  If you are working in the latent space and have a measurement model at each time point, you may need to establish measurement invariance across time. To do so, you can follow steps in Brown (2015; pp. 259–265).  Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Publications. Connect with the podcast on twitter @within_between, or email us letters about developmental science at withinandbetweenpod@gmail.com. More episodes and podcast information at WithinandBetweenPod.com. Follow Dr. Hart on twitter @Saraannhart Follow Dr. Logan on twitter @Jarlogan. Our theme music was composed by Jason Flowers. Our logo was created by Nathan Archer. Recorded May 27th, 2023.

    48 min
4.8
out of 5
36 Ratings

About

A podcast about the methods and metascience of developmental science, cohosted by Jessica Logan @jarlogan and Sara Hart @saraannhart. We talk about developmental sciencing, including data collection, data analysis, research methods, and open science, as well as life in academia. Think about it like a lab meeting where you don’t have to do the readings and never have to present. ​

You Might Also Like

To listen to explicit episodes, sign in.

Stay up to date with this show

Sign in or sign up to follow shows, save episodes, and get the latest updates.

Select a country or region

Africa, Middle East, and India

Asia Pacific

Europe

Latin America and the Caribbean

The United States and Canada