Enhancing Peer Review with ChatGPT: Exploring AI Feedback Integration
Delve into the potential of using ChatGPT in peer review processes to enhance feedback quality, address ethical considerations, develop critical thinking skills, personalize feedback, and more, fostering effective and ethical academic practices.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
ASKING FOR WHAT YOU WANT: CHATGPT & THE PEER REVIEW PROCESS RIT CENTER FOR TEACHING AND LEARNING FALL SYMPOSIUM, 11.1.2024 PHIL SHAW, FACULTY FELLOW FOR GATEWAY COURSE STUDENT SUCCESS
RATIONALE FOR INTEGRATING GEN-AI IN PEER REVIEW PROCESS TIME PROCESS ITERATIONS CUSTOMIZATION PEER(?) JUST WHAT YOU WANT TO KNOW
Name & Description Knowledge CUSTOM GPT Instructions (ASK FOR WHAT YOU WANT!) Available for Premium Users, but distributable to anyone with link. The purpose of this GPT is to provide feedback on academic writing and research. The feedback I would appreciate the most is related to 1) integration of primary and secondary research, 2) sentence clarity, 3) unnecessary repetitions, 4) overall structure of the paper, and 5) additional sources that you think are related to my research area. All citations and formatting should conform to APA 7th Edition. Please tailor the feedback as appropriate for an undergraduate student in their first or second year. https://chatgpt.com/g/g- eZSoWYCmX-peer-reviewgpt
Here are some discussion questions to explore how faculty might effectively incorporate ChatGPT into peer review processes: Enhancing Feedback Quality Enhancing Feedback Quality: How could ChatGPT be used to help students provide more constructive, specific feedback in peer reviews? What are some ways to train students to use AI to add depth to their critique? Ethics and Integrity Ethics and Integrity: How should we address ethical considerations around AI use in peer review? Are there aspects of peer review, like originality and student ownership, that might be compromised? AI for Preliminary Reviews AI for Preliminary Reviews: Could ChatGPT serve as a preliminary reviewer, offering students AI-generated feedback before or alongside human peer feedback? What are potential benefits or downsides? Developing Critical Thinking Developing Critical Thinking: In what ways can using ChatGPT in peer review teach students to think more critically about their own feedback? How can we help students distinguish between AI suggestions and their own analytical insights? Personalization in Feedback Personalization in Feedback: How might AI support tailoring feedback to each student s specific writing goals? Can ChatGPT be used to help students focus on individual strengths and areas for growth? Training and Guidelines Training and Guidelines: What kinds of guidelines or training would be helpful to ensure students use ChatGPT thoughtfully in peer review? Should there be protocols to ensure that AI feedback is applied ethically and accurately? Assessment of AI Assessment of AI- -Generated Feedback Generated Feedback: How should faculty assess the quality and impact of AI-generated feedback in student revisions? Are there specific indicators that show ChatGPT s use is constructive rather than obstructive? Student Perception and Motivation Student Perception and Motivation: How do students perceive the role of ChatGPT in their learning processes? Do they view it as supportive, or might it decrease motivation to engage deeply in the peer review? Scaffolding for Effective Use Scaffolding for Effective Use: What scaffolding might be necessary for students to benefit from ChatGPT in a peer review process, particularly for those less familiar with AI tools? These questions could spark valuable conversations around the role of AI in fostering more effective, engaging, and ethical peer review practices in academic settings.