AI Education Podcast Dan Bowen and Ray Fleming

This week we set the episode timer for 15 minutes, and managed to get through just five papers before the buzzer went off! So we have plenty more papers to discuss in future episodes...
ENHANCING K-12 STUDENTS’ PERFORMANCE IN CHEMISTRY THROUGH CHATGPT-POWERED BLENDED LEARNING IN THE EDUCATION 4.0 ERA https://library.iated.org/view/ORTIZDEZARATE2024ENH
 
Empowering student self-regulated learning and science education through ChatGPT: A pioneering pilot study https://bera-journals.onlinelibrary.wiley.com/doi/pdfdirect/10.1111/bjet.13454
 
ChatGPT “contamination”: estimating the prevalence of LLMs in the scholarly literature https://arxiv.org/abs/2403.16887
 
Monitoring AI-Modified Content at Scale: A Case Study on the Impact of ChatGPT on AI Conference Peer Reviews https://arxiv.org/abs/2403.07183
 
Large language models are able to downplay their cognitive abilities to fit the persona they simulate https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0298522
 

Assessment - Chris Goodall
In this episode of the AI Education Podcast, host Dan converses with Chris Goodall, the head of digital education at the Bourne Education Trust in England. They discuss the integration of AI into education, how it can be used to enhance teaching and learning processes, and the impact of personalized AI tools on students and educators.
The conversation covers practical applications of AI, the ongoing need for teacher and student adaptation to new technologies, as well as ethical considerations and future possibilities for AI in education.
Chris Goodalls Linkedin profile here: Chris Goodall | LinkedIn
Practical Advice for embedding IT in school: Embedding AI use in school 

Research Update - 31st May 2024 Honestly folks, we've been trying to keep. We really have. But we have so much great content in the fortnightly (or is it bi-weekly?) interviews, that we've had to bite the bullet and switch to weekly podcasts, so that we can still fit in the Research Updates!
Going forwards you'll get a longer interview-style podcast once every two weeks, and a shorter 15-20 minute "Research Update" podcast every two weeks. Filling your Fridays with AI in Education podcast joy!
Here's the links to all the research papers discussed this week:
Remote Proctoring: Understanding the Debate https://link.springer.com/referenceworkentry/10.1007/978-3-031-54144-5_150#DOI
 
Large language model-powered chatbots for internationalizing student support in higher education https://arxiv.org/abs/2403.14702
 
ChatGPT in Veterinary Medicine: A Practical Guidance of Generative Artificial Intelligence in Clinics, Education, and Research https://arxiv.org/abs/2403.14654
 
Investigation of the effectiveness of applying ChatGPT in Dialogic Teaching Using Electroencephalography https://arxiv.org/abs/2403.16687
 
An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Project https://arxiv.org/abs/2403.18679
 
An MIT Exploration of Generative AI https://mit-genai.pubpub.org/
MIT - Massachusetts Institute of Technology - have just published a series of really interesting papers about the impact of generative AI on  a number of industries, and dive into the implications for society, education, human interaction and other areas. I actually think the whole set are interesting - and they're really easy to get - you can read them on the web, or get a PDF, an ebook, or even an audio book of every one!
 
We talked about the 3 education ones:
When Disruptive Innovations Drive Educational Transformation: Literacy, Pocket Calculator, Google Translate, ChatGPT https://mit-genai.pubpub.org/pub/6chtnd56/release/3?readingCollection=0e231e9c

 
Generative AI and K-12 Education: An MIT Perspective https://mit-genai.pubpub.org/pub/4k9msp17/release/1?readingCollection=0e231e9c
 
Generative AI and Creative Learning: Concerns, Opportunities, and Choices https://mit-genai.pubpub.org/pub/gj6eod3e/release/2?readingCollection=0e231e9c
 

This week we continue our series on Assessment and AI. Ray talks with Jason Lodge from The University of Queensland, and who must have the longest business card in Australia, as he's Associate Professor of Educational Psychology in School of Education and Deputy Associate Dean in the Faculty of Humanities, Arts and Social Sciences!
 
The conversation talks about the challenges of assessment, and the options for rethinking assessment - and then we go deeper into Jason's views on the future of learning and assessment.
 
Jason's a great guest to share his experiences, as during 2023 he was on the TEQSA group of experts that came together to produce a report on assessment for Australian universities, Assessment reform for the age of artificial intelligence
https://www.teqsa.gov.au/guides-resources/resources/corporate-publications/assessment-reform-age-artificial-intelligence
 
Working on policy and guidance in an area where technology is developing so rapidly - and students are racing ahead of institutions, was interesting and Jason talks about the group dynamic. One of the interesting notes he talks about is the mindset: "The mantra we kept returning to is that we weren't trying to develop a map, but a compass. This is the direction we think we might need to head here."

AI and the Future of Assessment: Transforming Educational Practices Episode Overview: In this episode of the AI Education Podcast, hosts Dan and Ray, alongside guests Adam Bridgman and Danny Liu, dive into the evolving landscape of academic assessment in the age of artificial intelligence. Recorded in the University of Sydney's own studios, this discussion explores the significant shifts in assessment strategies and the integration of AI in educational settings.
Guest Introductions:
Professor Adam Bridgeman: Pro Vice Chancellor Educational Innovation at the University of Sydney - focused on enhancing teaching quality across the university. [University bio] Professor Danny Liu: Professor of Educational Technologies - dedicated to empowering educators to improve their teaching methods through innovative technologies. [University page - LinkedIn page] Key Topics Discussed:
The Persistence of Traditional Assessment Models: Despite the push to digital platforms during the COVID-19 pandemic, traditional assessment methods have largely remained unchanged, continuing the practice of replicating physical exam environments online. AI's Role in Rethinking Assessment: The guests discuss how AI challenges the conventional reasons for assessments, advocating for a paradigm shift towards assessments that truly measure student understanding and application of knowledge. Two-Lane Assessment Approach: Adam introduces a dual-lane strategy for assessment: Lane One: Ensures the rigorous verification of student competencies necessary in professional fields. Lane Two: Uses AI to foster skill development in using technology effectively, moving beyond traditional assessment forms to embrace innovative educational practices. Implementation Challenges and Solutions: The transition to new assessment models is recognised as a gradual process, needing careful planning and support for educators in rethinking their assessment strategies. Inclusivity and Access to Technology: Ensuring equitable access to AI tools for all students is highlighted as a critical aspect of the evolving educational landscape, emphasizing the need to support diverse student backgrounds and technological proficiencies. Future Outlook: The discussion concludes with reflections on the potential long-term impacts of AI on educational practices, the necessity of ongoing adaptation by educational institutions, and the importance of preparing students for a future where AI is seamlessly integrated into professional and everyday contexts. Further Reading:
We recommend these three articles from the team, that give more detail on the topics discussed
Where are we with generative AI as semester 1 starts?
What to do about assessments if we can’t out-design or out-run AI?
Embracing the future of assessment at the University of Sydney

It's time to start a new series, so welcome to Series 8!
This episode is the warm up into the series that's going to be focused on Assessment. We'll interview some fascinating people about what's happening in school and university assessment, how we might think differently about assessing students, and what you can be thinking about if you're a teacher.
There's no shownotes, links or anything else for your homework for this episode - just listen and enjoy!
Dan and Ray