Baseline Study on Online Course Quality and Services at NMSU
Conducted at New Mexico State University, the study aimed to establish a baseline for future research on online course quality and services. The research project focused on institutional perceptions, student satisfaction, instructional quality, and academic enrollment. The study utilized the Noel Levitz PSOL Survey to gather data and evaluate the impact of Quality Matters on course quality. The project timeline included obtaining buy-in from colleges, submitting an IRB application, collaborating with Noel Levitz for survey distribution, and analyzing responses to assess the influence of Quality Matters on course quality.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
The Noel Levitz PSOL Survey at NMSU: A Baseline for Future Research 7thAnnual QM National Conference November 1-4, 2015 Sharon Lalla, Ed.D. & Susie Bussmann, Ph.D. Instructional Innovation & Quality (IIQ), New Mexico State University
Our Goal Start a research project to get a baseline about online course quality and services QM NonQM Institutional Perception Services Student Instructional Academic Enrollment
Our Alternative Hypothesis Courses influenced by Quality Matters will have a positive effect on quality
How did we start? Get Buy-in from Colleges (Pilot) Nov. 2014 Nov. 2014 Add 4 questions
How did we start? Submit IRB Application Dec. 2014 Collaborate with Noel Levitz and distribute Survey Jan.- April 2015
The Noel Levitz (NL) PSOL Survey 26 NL Questions 6 QM and 4 NMSU Questions Importance to me 1 - not important at all 2 - not very important 3 - somewhat unimportant 4 - neutral 5 - somewhat important 6 - important 7 - very important N/A - does not apply My level of Satisfaction 1 - not satisfied at all 2 - not very satisfied 3 - somewhat dissatisfied 4 - neutral 5 -somewhat satisfied 6 - satisfied 7 - very satisfied N/A - not available/not used
Questions about Quality QM Questions 1. This institution s online courses are of high quality. 2. Courses have clear instruction about getting started and where to begin. 3. Technologies required in my courses are readily available, provided or easily downloaded. 4. Navigation in the online courses is logical, consistent, and efficient. 5. Course learning objectives, and instructions on how to meet them, are made clear. 6. Courses are well-designed, readable and not distracting.
Questions about Quality Our Questions: 7. The purchase of course materials is a worthwhile investment. 8. The learning experience is engaging and supportive. 9. Courses use a variety of instructional materials such as audio, video, transcripts, etc. 10. Course assignments are meaningful and relevant.
Data Collection 533 (16%) out of 3,270 students responded to the survey 450 424/2750 (15%) 400 350 300 250 QM NonQM 200 109/520 (21%) 150 100 50 0 Responses
Findings Strengths in online services Challenges in online services Mixed qualitative responses regarding quality of courses
Our Goal Start a research project to get a baseline about online course quality and services QM NonQM Institutional Perception Services Student Instructional Academic Enrollment
Qualitative Responses Please enter any comments you would like to share with this institution. 154 (29%) responses
Qualitative Responses History of Online Courses at NMSU Conflicted Responses Excellent, Fair, Poor Across colleges I do not think that this survey is set up very well to obtain accurate results. Half my classes have great instructors, who respond timely and have very nicely set up online classes. Other instructors are terrible and do not respond and often times the online course conflicts with the syllabus. As a result, it is difficult to answer about all classes with just one question. I either give a higher rating than some online courses deserve or a lower rating than others deserve.
Common Themes About Quality 1. Course Organization 2. Instructor Feedback 3. Instructor Interaction 4. Instructor Response 5. Instructor (Social) Presence 6. Instructor Engagement 7. Work Overload 8. Canvas Training 9. Online Teacher Training (Design/Delivery) 10.Consistency
Common Themes Quality Course Organization Some of the courses have been well organized and others have not been and have been difficult to navigate. Instructor Feedback On a positive note though, my instructor has been very timely with the grading of assignments and always provides practical and meaningful feedback. Instructor Interaction I have VERY good and VERY bad experiences in online classes. Some classes are perfectly fine, some are exceptionally great, and a couple have been wastes of time; incorporating out of date textbooks, lack of professor-student interaction/feedback.
Common Themes Quality Instructor Response For example, the instructors do not reply to emails in a timely manner or at all (I have yet to receive replies from my current professors on emails I sent several weeks ago Instructor (Social) Presence I have been very pleased with the program thus far. The teachers and staff are excellent and I loved coming down to see the University even though I am taking my online classes in Canada. I feel connected to the University and am so pleased I choice NMSU. Instructor Engagement Many faculty are not very engaged in student learning.
Common Themes Quality Work Overload The on-line classes seem to require so very much work that it is really hard to take a full-time schedule compared to taking in-class classes on campus since I have done both. Canvas Training My only other pet peeve, which should not be misconstrued to be less irritating than the previous, is PROFESSORS WHO DON'T KNOW HOW TO USE CANVAS OR EVEN BE AN ONLINE INSTRUCTOR!!! Online Teacher Training (Design/Delivery) A few instructors might benefit from training on how to facilitate online courses and the importance of timely feedback.
Results of Goal/Hypothesis Goal: Start a research project to get a baseline about online course quality and services About online course services Student perceptions of quality Alternative Hypothesis: Courses influenced by Quality Matters will have a positive effect on quality Unproven
Closing the Loop Disseminate the results to administration, faculty, students. Disseminate the results to academic support, student support, instructional, and enrollments services. Add online teaching to our PD. Revisit lens for further research.
Whats Next for Measuring Impact? 1. Redesign: Pilot study in Business College 2. Research trends in retention, student satisfaction, and grade improvement in QM recognized courses 3. Work with NMSU System-Wide QM Coordinators to evaluate COP 4. Possibly Conduct Noel Levitz PSOL Survey for Entire University
Thank you for attending. QUESTIONS?
Contact Information Sharon Lalla, Co-Principal Investigator Email: slalla@nmsu.edu Susie Bussmann, Co-Principal Investigator Email: suceppib@nmsu.edu New Mexico State University
