The Thesis Review Sean Welleck

Yulia Tsvetkov is a Professor in the Allen School of Computer Science & Engineering at the University of Washington. Her research focuses on multilingual NLP, NLP for social good, and language generation.
Yulia's PhD thesis is titled "Linguistic Knowledge in Data-Driven Natural Language Processing", which she completed in 2016 at CMU.

We discuss getting started in research, then move to Yulia's work in the thesis that combines ideas from linguistics and natural language processing. We discuss low-resource and multilingual NLP, large language models, and great advice about research and beyond.

- Episode notes: www.wellecks.com/thesisreview/episode46.html

- Follow the Thesis Review (@thesisreview) and Sean Welleck (@wellecks) on Twitter

- Find out more info about the show at www.wellecks.com/thesisreview

- Support The Thesis Review at www.patreon.com/thesisreview or www.buymeacoffee.com/thesisreview

Luke Zettlemoyer is a Professor at the University of Washington and Research Scientist at Meta. His work spans machine learning and NLP, including foundational work in large-scale self-supervised pretraining of language models.

Luke's PhD thesis is titled "Learning to Map Sentences to Logical Form", which he completed in 2009 at MIT. We talk about his PhD work, the path to the foundational Elmo paper, and various topics related to large language models.

- Episode notes: www.wellecks.com/thesisreview/episode45.html

- Follow the Thesis Review (@thesisreview) and Sean Welleck (@wellecks) on Twitter

- Find out more info about the show at www.wellecks.com/thesisreview

- Support The Thesis Review at www.patreon.com/thesisreview or www.buymeacoffee.com/thesisreview

Hady Elsahar is a Research Scientist at Naver Labs Europe. His research focuses on Neural Language Generation under constrained and controlled conditions.

Hady's PhD was on interactions between Natural Language and Structured Knowledge bases for Data2Text Generation and Relation Extraction & Discovery, which he completed in 2019 at the Université de Lyon.

We talk about his phd work and how it led to interests in multilingual and low-resource in NLP, as well as controlled generation. We dive deeper in controlling language models, including his interesting work on distributional control and energy-based models.

- Episode notes: www.wellecks.com/thesisreview/episode44.html

- Follow the Thesis Review (@thesisreview) and Sean Welleck (@wellecks) on Twitter

- Find out more info about the show at www.wellecks.com/thesisreview

- Support The Thesis Review at www.patreon.com/thesisreview or www.buymeacoffee.com/thesisreview

Swarat Chaudhuri is an Associate Professor at the University of Texas. His lab studies problems at the interface of programming languages, logic and formal methods, and machine learning.

Swarat's PhD thesis is titled "Logics and Algorithms for Software Model Checking", which he completed in 2007 at the University of Pennsylvania.

We discuss reasoning about programs, formal methods & safer machine learning systems, and the future of program synthesis & neurosymbolic programming.

- Episode notes: www.wellecks.com/thesisreview/episode43.html

- Follow the Thesis Review (@thesisreview) and Sean Welleck (@wellecks) on Twitter

- Find out more info about the show at www.wellecks.com/thesisreview

- Support The Thesis Review at www.patreon.com/thesisreview or www.buymeacoffee.com/thesisreview

Charles Sutton is a Research Scientist at Google Brain and an Associate Professor at the University of Edinburgh. His research focuses on deep learning for generating code and helping people write better programs.

Charles' PhD thesis is titled "Efficient Training Methods for Conditional Random Fields", which he completed in 2008 at UMass Amherst. We start with his work in the thesis on structured models for text, and compare/contrast with today's large language models. From there, we discuss machine learning for code & the future of language models in program synthesis.

- Episode notes: https://cs.nyu.edu/~welleck/episode42.html

- Follow the Thesis Review (@thesisreview) and Sean Welleck (@wellecks) on Twitter

- Find out more info about the show at https://cs.nyu.edu/~welleck/podcast.html

- Support The Thesis Review at www.patreon.com/thesisreview or www.buymeacoffee.com/thesisreview

Talia Ringer is an Assistant Professor with the Programming Languages, Formal Methods, and Software Engineering group at University of Illinois Urbana-Champaign. Her research focuses on formal verification and proof engineering technologies.

Talia's PhD thesis is titled "Proof Repair", which she completed in 2021 at the University of Washington.

We discuss software verification and her PhD work on proof repair for maintaining verified systems, and discuss the intersection of machine learning with her work.

- Episode notes: https://cs.nyu.edu/~welleck/episode41.html

- Follow the Thesis Review (@thesisreview) and Sean Welleck (@wellecks) on Twitter

- Find out more info about the show at https://cs.nyu.edu/~welleck/podcast.html

- Support The Thesis Review at www.patreon.com/thesisreview or www.buymeacoffee.com/thesisreview