Episoder
-
In September, the Toddle team organised "AI for AussieEd", a week-long series of professional development sessions for teachers, which had thousands of attendees for the virtual sessions.This episode "Driving Innovation in Australian Schools" was part of the week, and brings you the experiences of three educators, in conversation with podcast hosts Dan and Ray
The guests are:
Rachel Saunders, Primary School Learning Leader at Concordia College in Adelaide Ryan Elwell, Director of Digital Pedagogies & Online Safety Education at the ACT Education Directorate Matt Heinrich, Director of Learning Technologies and ICT at St Michaels Grammar School in MelbourneIt was a great discussion, and because it was recorded as a live webinar, we had lots of audience questions coming in online, so in the second half of the episode, you're going to hear questions coming in the chat from live listeners.
As usual, hosts Dan and Ray brought along their own contributions to the discussion:
Dan came with his deep pedagogical knowledge and insightful education conversation.
Ray brought his Buzzword Bingo card
-
This week's episode has a lot more news than research. But the research that we spend a bit of time on is the insights on how students in Australian universities are using AI. Really good insights for any educator or leader!
News
AI Detectors Falsely Accuse Students of CheatingâWith Big Consequences
https://www.bloomberg.com/news/features/2024-10-18/do-ai-detectors-work-students-face-false-cheating-accusationsEmpowering Education Leaders Toolkit
https://tech.ed.gov/education-leaders-ai-toolkit/TEQSA Guidance for universities
Danny Liu video https://bit.ly/students-aiResearchers say an AI-powered transcription tool used in hospitals invents things no one ever said
https://www.independent.co.uk/news/openai-ap-san-francisco-experts-microsoft-b2635996.htmlMore than a quarter of new code at Google is generated by AI - The Verge
https://www.theverge.com/2024/10/29/24282757/google-new-code-generated-ai-q3-2024Apple are launching their first devices with Apple Intelligence
https://www.wsj.com/video/series/joanna-stern-personal-technology/full-interview-apples-software-chief-craig-federighi-on-future-of-iphone-ai/756B8727-5FFB-422C-AE63-C4600272BD94?msockid=0a3b30f5f88b6061226e245bf9b96140Watch out for the Earning reports: Google just released and Microsoft do this week too. Always have a listen to these to find out about the momentum in AI.
Alphabet Q3 earnings call: CEO Sundar Pichai's remarks
Microsoft Fiscal Year 2025 First Quarter Earnings Conference Call
ResearchA Systematic Mapping Review at the Intersection of Artificial Intelligence and Self-Regulated Learning A call for increased theoretical grounding focus on motivation and diversifying context
https://www.researchgate.net/publication/382870027
Students perspectives on AI in higher education
Project website: https://aiinhe.org
Survey highlights: https://aiinhe.org/wp-content/uploads/2024/10/aiinhe_surveyinsights.pdf
Guidance for students: https://itali.uq.edu.au/files/31707/how-students-use-ai-guide-students.pdf
Guidance for academics: https://itali.uq.edu.au/files/31702/How-students-talk-about- gen-ai-guide-academics.pdf -
Manglende episoder?
-
Series 10, Episode 3
This week's episode is an interview with Dr Anna Denejkina, who's an interdisciplinary researcher and Associate Director at The Insight Centre. We discuss her research on youth engagement with generative AI. The conversation explores the multifaceted impact of AI technology in education, addressing benefits such as upskilling and accessibility, as well as concerns related to academic misconduct, job displacement, and misinformation. Key themes include gender disparity in confidence using AI, the importance of critical and empathetic thinking, and the evolving landscape of education assessments. The dialogue also highlights issues of loneliness, anxiety, and the growing equity gap driven by differences in AI adoption across various educational institutions.
Anna talks about her previous research on Young People's Perception and Use of Generative AI, which is a collaboration between The Insight Centre and YouthInsight. Here's a good summary article at The Research Society, and the full research here
We also mentioned the STEM tracker research, which is published by the Dept of Industry here
You can find all of Anna's research publications here
-
This week we cover a range of AI in Education related news and academic research papers. Here's all the links you need to read more about each of the topics we dicussed:
NewsAustralia's Voluntary AI Safety Standard
In September the Australian Government published:
Voluntary AI Safety Standard (68pg): https://www.industry.gov.au/publications/voluntary-ai-safety-standard
Proposals paper for introducing mandatory guardrails for AI in high-risk settings: https://consult.industry.gov.au/ai-mandatory-guardrails
Stanford's STORM
https://storm.genie.stanford.edu/
Students give English HSC exam an F over use of image with âhallmarksâ of AI
https://www.theguardian.com/australia-news/2024/oct/16/nsw-hsc-english-exams-2024-ai-image-paper-1
Investigation into the use of ChatGPT by a Child Protection worker - Office of the Victorian Information Commissioner
https://ovic.vic.gov.au/regulatory-action/investigation-into-the-use-of-chatgpt-by-a-child-protection-worker/
Research PapersTo what extent is ChatGPT useful for language teacher lesson plan creation?
https://arxiv.org/abs/2407.09974Have We Reached AGI? Comparing ChatGPT, Claude, and Gemini to Human Literacy and Education Benchmarks
https://arxiv.org/abs/2407.09573The Life Cycle of Large Language Models: A Review of Biases in Education
https://arxiv.org/abs/2407.11203The Future of Learning: Large Language Models through the Lens of Students
https://arxiv.org/abs/2407.12723How to Mitigate the Dependencies of ChatGPT-4o in Engineering Education
https://arxiv.org/abs/2407.12693StuGPTViz: A Visual Analytics Approach to Understand Student-ChatGPT Interactions
https://arxiv.org/abs/2407.12423Apostles, Agnostics and Atheists: Engagement with Generative AI by Australian University Staff
https://eprints.qut.edu.au/252079/ -
Welcome to the first Episode of Series 10, where we are going to take some time to review some of the fundamental changes we're going to be seeing as AI becomes more pervasive.
In this Episode we're taking a different approach, with Dan and Ray using Google's NotebookLM to create AI-delivered mini-podcasts about each other, which leads to a discussion about the backgrounds of both hosts, and a discussion about how this new AI might be used in education.
Obviously, both Dan and Ray conclude that AI won't replace them...yet!
For your own experiments, you can find NotebookLM at https://notebooklm.google.com/
The two mini podcasts in this episode were produced by simply feeding NoteBookLM with the hosts LinkedIn profiles (in PDF format - available as a download from any individual's LinkedIn page).
We'd love to hear how you're using NotebookLM, and other AI tech, in your work. The easiest way to get hold of us is via our LinkedIn page https://www.linkedin.com/company/ai-in-education-podcast/
And if you're enjoying the podcast, would now be a good time to leave a review in your podcast app - whether you're using Apple Podcasts, Google Podcasts or Spotify, we'd love it if you left a rating and review.
-
This week we're joined by the brains behind South Australia's EdChat chatbot. It was the first state in Australia to start pilot a custom built generative AI chatbot for their schools, and we spent some time with the team to understand the success story.
In the podcast, we heard from Simon Chapman (Director of Digital Architecture and Operations) and Cody Little (AI Technical specialist), both from the Department for Education South Australia
Find out more about the South Australia Department AI approach: Artificial intelligence (AI) in schools â information for parents and carers (education.sa.gov.au) and details on their trial - Nation-leading trial in SA schools to focus on the safe use of AI (education.sa.gov.au)
Microsoft have written a case study on their News Centre here: Learning in the AI era: How South Australiaâs Department for Education is empowering students and teachers with AI in the classroom - Microsoft Australia News Centre Video of their amazing work: Department for Education South Australia | Reimagine Education 2024 9 News report : Artificial intelligence set to shake-up South Australian high schools (9news.com.au) AI Safety - AI content safety Towards the end of the episode we also talked about Career chat: SA Career Chat -
Unbelievably, it's our 5th Anniversary (AI-nniversary?) and to mark the milestone of an AI podcast that's had more pivots than a robot's legs, and more chat than a chatbot, we've pulled together some of the top episodes from the 108 episodes of the podcast so far, and got the band back together (regretfully, we were unable to persuade Beth Worral, who co-hosted in 2022-2023, to come back for our party podcast - she'd reached escape velocity), so you'll hear Dan, Ray and Lee reminiscing like old men in a shed.
Great Guests & Top Episodes
Our very first guest - Microsoft's Troy Waller in AI for Accessibility in 2019
Our most listened episode from 2019 and very first external guest - the brilliant Dr David Kellerman in Using AI to personalise learning at UNSW Sydney
Our top 2020 episode was A Brief History of AI, which looked backin to the human obsession with creating artificial replicas of themselves. When did it start, who started it, what is the AI winter and how did it accelerate so quickly in the last 10 years. (And even faster in the last 4 years since?)
In 2021, another great guest topped our episode charts, with Feel the force: Emerge to the future with Sly Lee as Sly talked about his work around VR and AR and the mergeing of physical and virtual worlds
For 2022, it was the Christmas edition that hit the heights, with all four co-hosts - Beth, Lee, Dan & Ray - together for the quizzically named Christmas, Infinite Monkeys and everything
By 2023, we were back on solid pedagogy again, with the episode AI - The fuel that drives insight in K12 with Travis Smith (the kind of title a marketing manager would love?)
And, although we've not yet reached the end of 2024 and we've got some great episodes ahead, the top episode this far is University of Sydney and the future of assessment with Danny Liu and Adam Bridgman
We also had fond memories of:
The AI in Popular Culture episode from 2020 Martin O'Sullivan's tales from Turing House School in From AI Detectors to Heartwarming Help: Two Tales of AI in a school Elle Graham (aka Woodes) in Music, Creativity and Minecraft with Woodes Practical lessons from chatbot land with The Search for the Education Holy Grail in NSW, with the stories shared by Dan Hart and Michelle Michael -
News
This week's news we rushed through includes "Study Buddy or Influencer?", the Australian Parliamentary Inquiry into the use of Gen AI in the Australia Education System
https://www.aph.gov.au/Parliamentary_Business/Committees/House/Employment_Education_and_Training/AIineducation/ReportNSW EduChat has been extended for all teachers in all New South Wales Schools - https://www.innovationaus.com/nsw-teachers-to-get-time-saving-genai-tool/
Learn more about the NSW EduChat chatbot in the first episode of Series 9Microsoft announced Copilot Wave 2
https://www.microsoft.com/en-us/microsoft-365/blog/2024/09/16/microsoft-365-copilot-wave-2-pages-python-in-excel-and-agents/OpenAI's new model o1-preview came out - and it's much, much better and logical reasoning and maths
Find out what people think by looking at what Ethan Mollick is saying about it (and, as I suggest on the podcast, keenly watch Dan Hart's posts as he's benchmarking it now in the context of EduChat)Google released a podcast-generator as part of NotebookLM, which turns any kind of paper/book etc into a short podcast. To find out what it's like I gave it the top research paper from the podcast last time and you can compare it versus me! There's a quick demo review by Ethan here and you can login and have a play directly here: https://notebooklm.google.com/ (it has two main uses, because on top of this autopodcast, it's original purpose was to allow you give it a pile of documents and it can work with all of them at the same time for q&a, summaries etc)
Research
Here's the links to all nine papers we discussed in this week's episode:
Generative AI in Real-World Workplaces
https://www.microsoft.com/en-us/research/uploads/prodnew/2024/07/Generative-AI-in-Real-World-Workplaces.pdfCan Large Language Models Make the Grade?
https://dl.acm.org/doi/10.1145/3657604.3664693PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection
https://arxiv.org/abs/2406.16288The global landscape of academic guidelines for generative AI and Large Language Models
https://arxiv.org/abs/2406.18842"Is ChatGPT a Better Explainer than My Professor?": Evaluating the Explanation Capabilities of LLMs in Conversation Compared to a Human Baseline
https://arxiv.org/abs/2406.18512Perceived Impact of Generative AI on Assessments: Comparing Educator and Student Perspectives in Australia, Cyprus, and the United States
https://www.sciencedirect.com/science/article/pii/S2666920X24000729Jill Watson: Scaling and Deploying an AI Conversational Agent in Online Classrooms
https://dilab.gatech.edu/publications/jill-watson-scaling-and-deploying-an-ai-conversational-agent-in-online-classrooms/
https://dilab.gatech.edu/test/wp-content/uploads/2024/05/ITS2024_JillWatson_paper.pdfIntegrating AI in College Education: Positive yet Mixed Experiences with ChatGPT
https://arxiv.org/abs/2407.05810The AI Companion in Education: Analyzing the Pedagogical Potential of ChatGPT in Computer Science and Engineering
https://arxiv.org/abs/2407.05205 -
This week's guest is Professor Phillip Dawson, who is Co-Director of the Centre for Research in Assessment and Digital Learning at Deakin University in Australia.
In addition to Phill's website, we recommend following Phill on LinkedIn, or Twitter, where shares a lot of his work on the future of assessment, and also his passion project - The Peer Revue - where Phill combines his passion for academic research with his work in Improv Comedy. Every month he hosts a research who talks about their professional research, which is then turned into comedy gold by his improv team at The Improv Conspirancy Theatre (highly recommend keeping an eye out for this if you're in Melbourne)
You can find Phill's research papers here on Google Scholar, and his LinkedIn feed has his books and his contributions to other advice and consultations in the education sector
Phil mentions a number of researchers and their work in the podcast. Here's the links:
James Reason's work on the Swiss Cheese model for failure of complex systems "The contribution of latent human failures to the breakdown of complex systems"
You can either read the original research paper or this easier to grasp Wikipedia article "The Swiss Cheese Mode"Kiata Rundle's work on then applying this to academic integrity - you can find all of her papers on Google Scholar
Alfie Kohn "Punished by Rewards" - https://www.mv.helsinki.fi/home/hotulain/Punished.pdf
Phill mentioned Deci & Ryan's work, so here's a good place to start reading on Self-Determination Theory
And here's a starting point if you need it for reading about Vygotsky's Zone of Proximal Development
Then Phill mentioned the book Thanks for the Feedback, but Stone & Heen, which is on Amazon here
-
Series 9, Episode 9 - Homework and Sex News How do people actually use ChatGPT?
How do people use ChatGPT? We analyzed real AI chatbot conversations - The Washington Post
Make AI tools to reduce teacher workloads, tech companies urgedhttps://www.theguardian.com/education/article/2024/aug/28/make-ai-tools-to-reduce-teacher-workloads-tech-companies-urged
New AI in Teams - and it's all freehttps://www.linkedin.com/posts/miketholfsen_ai-edtech-microsoftteams-activity-7236817645625335809-08OC
https://aka.ms/TeamsEDUAIQuickGuide
Research Papers Large Language Model as an Assignment Evaluator: Insights, Feedback, and Challenges in a 1000+ Student Coursehttps://arxiv.org/abs/2407.05216
Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classroomshttps://arxiv.org/abs/2406.07571
Evaluating ChatGPT-4 Vision on Brazil's National Undergraduate Computer Science Examhttps://arxiv.org/abs/2406.09671
Generative AI Can Harm Learninghttps://papers.ssrn.com/sol3/papers.cfm?abstract_id=4895486
ChatGPT, Copilot, Gemini, SciSpace and Wolfram versus higher education assessments: an updated multi-institutional study of the academic integrity impacts of Generative Artificial Intelligence (GenAI) on assessment, teaching and learning in engineeringhttps://www.tandfonline.com/doi/epdf/10.1080/22054952.2024.2372154
How critically can an AI think? A framework for evaluating the quality of thinking of generative artificial intelligencehttps://arxiv.org/abs/2406.14769
Analyzing Large Language Models for Classroom Discussion Assessmenthttps://arxiv.org/abs/2406.08680
Student Perspectives on Using a Large Language Model (LLM) for an Assignment on Professional Ethicshttps://arxiv.org/abs/2406.11858
ChatGPT as Research Scientist: Probing GPT's Capabilities as a Research Librarian, Research Ethicist, Data Generator and Data Predictorhttps://arxiv.org/abs/2406.14765
70B-parameter large language models in Japanese medical question-answeringhttps://arxiv.org/abs/2406.14882
I don't trust you (anymore)! -- The effect of students' LLM use on Lecturer-Student-Trust in Higher Educationhttps://arxiv.org/abs/2406.14871
Large Language Models in Student Assessment: Comparing ChatGPT and Human Gradershttps://arxiv.org/abs/2406.16510
-
This week we hear from Professor Rose Luckin, from University College London and Educate Ventures Research
In the podcast, Rose mentioned the 1% project in Finland from 2020 - here's some reporting on it
Through Educate Ventures Research there are a range of AI consultancy and training services for schools, including the AI Readiness Online Course for teachers
Rose also has a monthy newsletter "The Skinny on AI for Education" which has an extensive reading list every edition, on a number of AI topics, not just what's happening in education. -
News TEQSA's new paper on Academic Integrity & AI
The evolving risk to academic integrity posed by generative artificial intelligence: Options for immediate action
https://www.teqsa.gov.au/sites/default/files/2024-08/evolving-risk-to-academic-integrity-posed-by-generative-artificial-intelligence.pdf
State of Generative AI in the Enterprise: An Australian Perspectivehttps://www.deloitte.com/au/en/services/consulting/analysis/state-generative-ai-enterprise.html
Research A review on the use of large language models as virtual tutorshttps://arxiv.org/abs/2405.11983
Jill Watson: A Virtual Teaching Assistant powered by ChatGPThttps://arxiv.org/abs/2405.11070
An empirical study to understand how students use ChatGPT for writing essays and how it affects their ownershiphttps://arxiv.org/abs/2405.13890
Intelligent Tutor: Leveraging ChatGPT and Microsoft Copilot Studio to Deliver a Generative AI Student Support and Feedback System within Teamshttps://arxiv.org/abs/2405.13024
Large Language Models as Partners in Student Essay Evaluationhttps://arxiv.org/abs/2405.18632
Grade Like a Human: Rethinking Automated Assessment with Large Language Modelshttps://arxiv.org/abs/2405.19694
Designing Prompt Analytics Dashboards to Analyze Student-ChatGPT Interactions in EFL Writinghttps://arxiv.org/abs/2405.19691
Experiences from Integrating Large Language Model Chatbots into the Classroomhttps://arxiv.org/abs/2406.04817
Delving into ChatGPT usage in academic writing through excess vocabularyhttps://arxiv.org/abs/2406.07016
Understanding Students' Acceptance of ChatGPT as a Translation Tool: A UTAUT Model Analysishttps://arxiv.org/abs/2406.06254
-
BONUS EPISODE ! We'd love to meet more of our listeners in person, so here's a list of events over the next few weeks when Dan, Ray, or Dan and Ray are speaking about AI in Education. One of the things that makes the podcast special is the amazing stories we get from our guests, and there's more stories than fit into an episode, and we're always on the lookout for more. So come and say hi at any of these events, and per haps we can share an untold story, or you can tell us yours!
August
19 August - Melbourne - Ray
Melbourne EdTech Summit
Ray's on the panel discussing "The Transformed Learning Landscape Through AI" at this event for edtech companies and universities
21 August - Sydney - Ray - Free event
The Future of Human AI - IATD
If you're in Sydney, the Institute of Applied Technology has scheduled the perfect event on Wednesday evening (starting at 6PM). Ray's hosting the free learning session "The Future of Human AI", designed for the thousands of small businesses and employees around Western Sydney who want to make sense of the AI hype and start to understand what everybody else is talking about. If you're a teacher, you'll also walk away with some good ideas of how businesses are using AI to help with your discussion of AI in the classroom
23 August - Sydney - Dan
AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today
Organised by friends of the podcast Matt Esterman and Nick Jackson at WSU's Parramatta campus, it'll be a festival of ideas from a great lineup of teachers. Dan's one of the speakers, and will be wearing his Microsoft badge on the day, talking about all the latest great tech announcements from that world.
September
3 September - Online - Dan - Free event
Build a Bot in Copilot Studio
Doing his day job, Dan's taking part in this online workshop designed to help Microsoft Copilot users build their own bot. Like Build a Bear workshop, but with less bear and more bot. Open to any Microsoft customers in Australia and New Zealand.
4 September - Christchurch, NZ - Ray
NZ Tertiary ICT Conference
For New Zealand listeners Ray's heading over the ditch to deliver a keynote called "AI, why?" at the annual conference for digital teams of universities and polytechnics. If you're going to be there, please say Hi!
12-13 September - Adelaide - Ray
HE FEST 24
Ray's taking part in the "Marketing, Recruitment, Advancement and AI in Higher Education Conference" in Adelaide. Ray's on a panel discussion "The place of AI in university " with Eddie Major, on applications of AI beyond teaching and learning, and then delivering the closing keynote, grandly titled "The future of HE - The future of higher education in a world where gen AI is ubiquitous"
16-19 September - Online - Dan and Ray - Free event
Toddle's AI for AussieEd online event
The toddle team have pulled together 20 speakers from across Australia, who will be talking about assessment, LMSs, chatbots, the AI Framework for schools, leadership and data-driven learning. And tacked on right at the end of the run, at 5:15 on the 19th, we're going to have a crack at a live podcast recording
-
In this episode of the AI in Education podcast, hosts Dan and Ray welcome Amanda Bickerstaff, an experienced educator, keynote speaker, researcher, and founder of AI for Education. Amanda shares her journey from traditional teaching to embracing AI during her time in Australia and the US. She explains the transformative potential of generative AI in creating rubrics and personalizing learning while highlighting the current limitations and necessary steps toward adoption. Amanda advocates for building AI literacy, addressing teacher fears and misconceptions, and embracing creativity. The discussion also explores the future of AI in education, particularly in personalised tutoring, and the importance of understanding biases and data privacy. Amanda emphasises meeting educators where they are and the potential of AI in saving time and enhancing teaching practices.
Amanda's LinkedIn Profile: Amanda Bickerstaff | LinkedIn
AI for Education site: AI for Education
AI prompt library: Prompt Library
Webinar archive: AI Webinars for Educators
Free resources for teachers: Downloadable Resources00:00 Guest Introduction: Amanda Bickerstaff
01:17 Amanda's Background and Journey
02:53 The Role of AI in Education
04:56 Challenges and Misconceptions in AI Adoption
06:05 Building AI Literacy and Addressing Fears
12:51 The Future of Personalised Learning
22:13 Exciting Developments and Final Thoughts
30:29 Conclusion and Closing Remarks -
Holy smokes, we missed the party that should have been Episode 100! So now we're going to have a belated party episode later. Oh well, this week's episode is not to be stopped, so yet again Dan and Ray discuss the most interesting research on the use of AI in Education from the recent publications. But before that we started with a quick news summary. All the links are here:
News
Californiaâs proposed law against AI replacing human professorshttps://www.universityworldnews.com/post.php?story=20240702214317879
Animated AI Teaching Assistants Coming to Morehousehttps://www.insidehighered.com/news/tech-innovation/artificial-intelligence/2024/07/09/animated-ai-tas-are-coming-morehouse
Khanmigo for all!https://x.com/khanacademy/status/1813665014911316237
Sign up for Khanmigo for Teachers in English: blog.khanacademy.org/khanmigo-world
Open AI
https://techcrunch.com/2024/08/07/this-week-in-ai-openais-talent-retention-woes/Research Papers
SUMMATIVE EXAMS WITH THE USE OF CHATGPT: VISION OR REALISTIC ALTERNATIVE TO TRADITIONAL EXAMS?https://library.iated.org/view/BAUME2024SUM
Note that this paper is one of the few that I'll flag that's behind a journal paywall. If you donât have access, I'd suggest asking the author, Matthias Baume from TUM, if he's happy to share a copy
The great detectives: humans versus AI detectors in catching large language model-generated medical writinghttps://edintegrity.biomedcentral.com/articles/10.1007/s40979-024-00155-6
Jae Q. J. Liu, Kelvin T. K. Hui, Fadi Al Zoubi, Zing Z. X. Zhou, Curtis C. H. Yu, Jeremy R. Chang, Arnold Y. L. Wong - The Hong Kong Polytechnic University
Dino Samartzis, Rush University Medical Center
Leveraging Large Language Model as Simulated Patients for Clinical Educationhttps://arxiv.org/abs/2404.13066
Yanzeng Li1 , Cheng Zeng2,3 , Jialun Zhong1 , Ruoyu Zhang1 , Minhao Zhang1 , Lei Zou1â 1Wangxuan Institute of Computer Technology, Peking University 2School of Computer Science, Wuhan University. 3CureFun Co.
Automated Assessment of Encouragement and Warmth in Classrooms Leveraging Multimodal Emotional Features and ChatGPThttps://arxiv.org/abs/2404.15310
"ChatGPT Is Here to Help, Not to Replace Anybody" -- An Evaluation of Students' Opinions On Integrating ChatGPT In CS Courseshttps://arxiv.org/abs/2404.17443
Bruno Pereira Cipriano and Pedro Alves
Lusofona University, COPELABS, Lisbon, Portugal
Math Multiple Choice Question Generation via Human-Large Language Model Collaborationhttps://arxiv.org/abs/2405.00864
Jaewook Lee, Andrew Lan - University of Massachusetts Amherst
Digory Smith, Simon Woodhead - Eedi
ChatGPT in Data Visualization Education: A Student Perspectivehttps://arxiv.org/abs/2405.00748
Nam Wook Kim, Grace Myers - Boston College; Hyung-Kwon Ko - KAIST; Benjamin Bach - INRIA
A Careful Examination of Large Language Model Performance on Grade School Arithmetichttps://arxiv.org/abs/2405.00332
Automated Generation of High-Quality Medical Simulation Scenarios Through Integration of Semi-Structured Data and Large Language Modelshttps://arxiv.org/abs/2404.19713
Scott Sumpter CHSOS, Canadian Surgical Technology and Advanced Robotics, London Health Sciences Centre
Outsmarting Artificial Intelligence in the ClassroomâIncorporating Large Language Model-Based Chatbots into Teachinghttps://publications.aaahq.org/iae/article/doi/10.2308/ISSUES-2023-064/12560
Juliane Wutzler, Worms University of Applied Sciences
University Studentsâ Self-Reported Reliance on ChatGPT for Learning: a Latent Profile Analysishttps://www.sciencedirect.com/science/article/pii/S2666920X24000468
Ana Stojanov, Qian Liu , Joyce Hwee Ling Koh - University of Otage
-
This episode of the AI in Education podcast features an interview with Anthony England, the Director of Innovative Learning Technologies at Pymble Ladies College in Sydney.
Anthony, known for his impressive shirt collection and his kind-hearted approach to education, shares his insights on the challenges and opportunities presented by AI in assessment and personalisation of the learning experience for students.
Anthony shares his vision for AI-driven personalised tutors, and how AI can assist in providing contextual and personalised feedback to students. We also cover the role of AI in helping teachers manage their workload and provide timely feedback.
When we get onto the community of learning, we hear about Anthony's AI-driven agenda to better connect with parents, and bringing them into the community of learning - they become engaged rather than merely recipients of messages.
Anthony talked about some of the events where he's a speaker, and the next ones to look out for him at are:
EduTech Expo, in Melbourne on 14th August
The Educator to Entrepreneur pipeline: Making your idea a solution The AI in Education Conference, at Western Sydney University on 23rd August
AI in Education Conference | Teaching Tomorrow: Harnessing AI Tools Today -
In this episode Dan and Ray speak to Michelle Michael and Dan Hart from the New South Wales Department of Education about their world leading trial of AI, called NSWEduChat.
Michelle is the NSW Department of Education Director: Education Support, Rural Initiatives and Gen AI. Her LinkedIn profile is here.
Dan is the Head of AI at the NSW DoE. His LinkedIn profile is here
Some of the resources that the team talked about in the episode are below:
NSWEduChat landing page: NSWEduChat
NSW Department of Education: AI in Education - Artificial intelligence in education (nsw.gov.au)
NSW Department of Education: Guidelines regarding the use of generative AI: Guidelines regarding the use of generative AI (nsw.gov.au)
Safeguard personal information: Manage personal information effectively and de-identify it to protect privacy.
Techniques for de-identification: Use data anonymization and masking to remove or alter personal information.
Verify and edit AI content: Ensure accuracy and suitability of AI-generated content, aligning with ethical principles, teaching standards and quality teaching.
Stay up-to-date with training: Attend training and professional learning on cybersecurity, data breach response, and child protection.
Use effective prompting: Create clear and specific prompts to improve the quality and relevance of AI-generated output.
Future Frontiers - Education for an AI world: e-book: Future Frontiers e-book
NSW DoE Future Frontiers landing page: Education for a Changing World
-
From AI Detectors to Heartwarming Help: Two Tales of AI in a school
Series 8 Episode 11
In this episode of the AI in Education podcast, hosts Ray Fleming and Dan Bowen interview Martin O'Sullivan, a UK headteacher and lifelong friend of Dan. They talk about two contrasting stories from Martin's schoolâone highlighting the frustration in the application of AI when students were accused of cheating, and the other illustrating the compassionate use of AI to help a student undergoing cancer treatment participate in classes remotely via an AI-enabled robot. The discussion emphasises the complexities and ethical considerations of integrating AI in education.
00:00 Introduction
02:32 Martin's Background and School
03:50 AI in Education: Martin's Journey
05:59 Challenges with AI Detectors
09:23 Emotional Impact on Students
11:45 Reflections on AI in Assessment
We discussed two assessment topics that have been in previous episodes:
Sydney University's approach to assessment with Lane 1 and Lane 2 assessments - in Series 8 Episode 2 The AI Assessment Scale research - in Series 8 Episode 722:34 Heartwarming Story: AI Robot for Student
There's more reporting on this story on the BBC website
27:10 Conclusion and Final Thoughts
-
Another episode rounding up the latest news and research on AI in Education. The links below go straight to all the news stories and research papers discussed this week NEWS Victorian "Generative Artificial Intelligence Policy" for government schools.
https://www2.education.vic.gov.au/pal/generative-artificial-intelligence/policy
Meeting the AI Skills Boomhttps://techcouncil.com.au/wp-content/uploads/Meeting-the-AI-Skills-Boom-2024.v2.pdf
LAUSD shelves its hyped AI chatbot to help students after collapse of firm that made ithttps://www.latimes.com/california/story/2024-07-03/lausds-highly-touted-ai-chatbot-to-help-students-fails-to-deliver
A class above: UNSW Sydney uses AI to power personalised paths to student successhttps://news.microsoft.com/en-au/features/a-class-above-unsw-sydney-uses-ai-to-power-personalised-paths-to-student-success/
Research Detecting ChatGPT-Generated Essays in a Large-Scale Writing Assessment: Is There a Bias Against Non-Native English Speakers?https://www.sciencedirect.com/science/article/abs/pii/S0360131524000848#bib23
GenAI Detection Tools, Adversarial Techniques and Implications for Inclusivity in Higher Educationhttps://arxiv.org/abs/2403.19148
Avoiding embarrassment online: Response to and inferences about chatbots when purchases activate self-presentation concernshttps://myscp.onlinelibrary.wiley.com/doi/10.1002/jcpy.1414
Navigating the Ethical Landscape of Multimodal Learning Analytics: A Guiding Frameworkhttps://osf.io/preprints/edarxiv/adxuq
How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responseshttps://arxiv.org/pdf/2405.00970
AI Conversational Agent Design for Supporting Learning and Well-Being of University Studentshttps://osf.io/preprints/edarxiv/w4rtf
The Neglected 15%: Positive Effects of Hybrid Human-AI Tutoring Among Students with Disabilitieshttps://osf.io/preprints/edarxiv/y52ew
The GPT Surprise: Offering Large Language Model Chat in a Massive Coding Class Reduced Engagement but Increased Adopters Exam Performanceshttps://osf.io/preprints/osf/qy8zd
The Future of Feedback: Integrating Peer and Generative AI Reviews to Support Student Workhttps://osf.io/preprints/edarxiv/x3dct
Is ChatGPT Transforming Academics' Writing Style?https://arxiv.org/abs/2404.08627
Can AI Provide Useful Holistic Essay Scoring?https://osf.io/preprints/osf/7xpre
Read the excellent article about this paper in the Heching Report
Best Practices for Using AI When Writing Scientific Manuscriptshttps://pubs.acs.org/doi/epdf/10.1021/acsnano.3c01544
A real-world test of artificial intelligence infiltration of a university examinations system: A âTuring Testâ case studyhttps://journals.plos.org/plosone/article?id=10.1371/journal.pone.0305354
-
Continuing our Series 8, focused on the topic of assessment, and the impact of AI, roving reporter Ray visits Fitzroy, Victoria, to interview Dan Ingvarson, a notable founder and executive consultant in the field of AI in education, whilst co-host Dan (Welsh Dan?) joins remotely. Dan (Ingvarson) discusses his background and extensive work in AI policy and education technology, touching upon his involvement in various global initiatives including the Edsafe Alliance and Educational Services Australia. The conversation looks into the complexities of modern educational assessment, focusing on how generative AI can transform traditional assessment practices. He highlights the obstacles teachers face with current assessment methods and how AI could help alleviate some of these challenges by offering more personalised and authentic evaluations. The podcast also touches on the potential for AI to support teachers in creating effective rubrics and improving the overall quality of education through better data analytics. Ray and (Welsh) Dan emphasise the importance of evolving curricula to incorporate these advanced AI methodologies while discussing broader implications for student learning and teacher workload. 00:00 Introduction and Welcome 00:47 Meet Dan Ingvarsson: AI Guru 02:26 The Evolution of AI in Education 03:46 Deep Dive into Assessment 06:46 Challenges and Opportunities in AI-Assisted Assessment 19:21 Ensuring Authenticity in Student Work 23:28 Future of AI in Education 31:31 Practical Tips for Teachers 33:47 Conclusion and Final Thoughts
- Vis mere
