Diaries of Social Data Research Katherine A. Keith, Naitian Zhou, & Lucy Li

In this episode, we speak to Christian Baden, Christian Pipal, and Mariken van der Velden about their 2022 journal paper in Communications Methods and Measures, titled, “Three Gaps in Computational Text Analysis Methods for Social Sciences: A Research Agenda”. They co-authored this paper with Martijn Schoonvelde, and the authors span several disciplines, from communication to political science.

We discuss the challenges and joys of writing for a cross-disciplinary audience, how their frustrations with the validity of computational methods are shared across fields with different methodological conventions, and how this paper laid the groundwork for a larger project on European political text analysis.

Our guests on this episode are Diyi Yang, assistant professor at the School of Interactive Computing, and David Muchlinski, assistant professor in the Sam Nunn School of International Affairs, both at Georgia Tech. We discuss their EMNLP 2021 paper, "Latent Hatred: A Benchmark for Understanding Implicit Hate Speech." This paper is co-authored with Mai ElSherief, Caleb Ziems, Vaishnavi Anupindi, Jordyn Seybolt, and Munmun De Choudhury.

Diyi and David reveal that the annotation process behind this paper took two years and incorporated domain expertise on the broader context around hateful language. That is, an understanding of the social groups who produce this language allowed for better categorization and interpretation of implicit hate. We also discuss the cross-discipline connections they’ve forged in the past and present, and the ongoing challenges this type of work poses for computational methods.

This episode features Ted Underwood, a professor in the School of Information Sciences and Department of English at the University of Illinois Urbana-Champaign, and David Bamman, an associate professor at UC Berkeley’s School of Information. We discuss their 2018 Cultural Analytics paper co-authored with literary studies PhD student Sabrina Lee, titled “The Transformation of Gender in English-Language Fiction.”

We trace how Twitter brought Ted and David together as collaborators, and the email that sparked the beginnings of this project. They describe how this paper uses predictive modeling for an unconventional purpose, and various “means of interrogating data.” They also provide tips for establishing collaborative relationships, and advocate using substantive research questions to motivate learning technical skills.

Our guests in this episode are Ryan Gallagher, a PhD Candidate in Network Science at Northeastern University, and Brooke Foucault Welles, an Associate Professor in Communication Studies and the Network Science Institute at Northeastern University. We discuss their 2019 CSCW paper, "Reclaiming Stigmatized Narratives: The Networked Disclosure Landscape of #MeToo" with co-authors Elizabeth Stowell and Andrea G. Parker.

We talk about their substantive motivation for focusing on #metoo, the networked counter public, and hashtags' influence on social change. Ryan and Brooke also walk us through the advantages of pairing qualitative and quantitative work, weaving ethics throughout every stage of the research process, dealing with missing Tweets, and taking seriously both the "computational" and "social science" sides of CSS.

This episode features Dora Demszky, a PhD student in Linguistics at Stanford University. Dora works at the intersection of natural language processing and education. We discuss her ACL 2021 paper titled "Measuring Conversational Uptake: A Case Study on Student-Teacher Interactions", co-authored with Jing Liu, Zid Mancenido, Julie Cohen, Heather Hill, Dan Jurafsky, and Tatsunori Hashimoto.

Dora's work is motivated by creating tools that are useful for educators, so her research is not only descriptive or predictive, but also applicable to classrooms. She talks about managing large interdisciplinary teams, approaching research with care, and working with actual teachers to annotate data.

Our guest in this episode is Deen Freelon, Associate Professor at the University of North Carolina in the School of Journalism and Media. We chat about his 2020 Social Science Computer Review Paper "Black Trolls Matter: Racial and Ideological Asymmetries in Social Media Disinformation" with co-authors Michael Bossetta, Chris Wells, Josephine Lukito, Yiping Xia, and Kirsten Adams.

Deen also talks about writing a "behind the scenes" book chapter about the process of making this paper, being one of the first movers in the discipline of computational methods for communication studies, and how he learns programming best when it is connected to the goals of his project. He emphasizes that many of his great research ideas come from reading deeply and recommends devoting at least half a day a week solely to reading.