LMS Assessment Summary of Results - March 2022
The LMS assessment project aims to evaluate leading LMS products for the University's evolving needs, post-COVID-19. Discover insights on Blackboard, Canvas, and D2L from industry and peer perspectives.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
LMS ASSESSMENT SUMMARY OF RESULTS MARCH 2022
DRIVERS FOR LMS ASSESSMENT PROJECT: The needs of the campus prior to and post COVID-19 have evolved, and faculty and students are looking for things such as an intuitive user experience and modern interface. This project is to assess leading LMS products on the market including the updated version of Blackboard and recommend a path to best meet the needs of the University. - Blackboard Learn (current version) is not perceived as meeting the needs of our faculty and students - Academic departments are shifting towards alternative LMS solutions - User Research showed students struggling with lack of course standardization - Lack of accessibility capabilities make for a disproportionate experience for those needing them LMS Products Considered: - Blackboard Ultra - Canvas - D2L (Brightspace) 2
LMS ASSESSMENT STEPS Market Research Gartner Peer Interviews with Higher Ed Institutions: Stanford, NYU, MIT, Purdue, Georgetown, Arizona State University, Notre Dame & UCLA Committee Process & Testing Prioritized Features & Use Cases for Teaching & Learning Review of Qualifications and Disqualifications Vendors presented Demos based on the committee's prioritized Features & Use Cases Testing and Surveys were conducted in Sandbox Environment 1 on 1 support provided weekly by vendors 3
MUST HAVE: The List Below Ranked as Must Have in the Survey 1. 2. 3. 4. 5. 6. 7. 8. 9. Course Administration Course Creation Exams/Quizzes/Assessment Grading and Rubrics Communication Tools Course Support Header Accessibility Participation Tools Course Website/Web Our Office in New Jersey
INDUSTRY & PEER INSIGHTS Research & Advisory sessions held in July 2020 & February 2021. USC spoke to 8 other higher education peers, including public and private R1 schools who have recently made a change. MARKET INSIGHTS MASSIVE DEBT AND CAPITAL ISSUES HAVE BOGGED DOWN BLACKBOARD ALONG WITH POOR ADOPTION OF THE BLACKBOARD ULTRA PRODUCT HIGH TURNOVER AT CANVAS HAS SLOWED DOWN PRODUCT DEVELOPMENT. MANY UNIVERSITIES HAVE CITED POOR WORKING RELATIONSHIP WITH THE VENDOR, NOT FEELING WANTED OR TAKEN SERIOUSLY RECOMMENDATION WAS TO WAIT AND SEE HOW CANVAS AND D2L CONTINUE TO OPERATE AND IMPROVE (2020/2021) Update 11/2022: Market analyst Phil Hill (Phil on EdTech) recently reported that D2L has outpaced Canvas for the first time in new implementations in N. America and Europe. This trend is expected to continue through 2023. SCHOOL TAKEWAWAYS SCHOOLS WERE SPLIT IN THEIR TOOL PREFERENCE; SOME HAVE GONE TO CANVAS AND OTHERS TO D2L. CANVAS WAS MORE PREVALENT. LMS TEAM SIZE SHOULD BE REVIEWED. MOST UNIVERSITIES HAD A MINIMUM OF 3-5 INSTRUCTIONAL DESIGNERS AND 3-5 DEVELOPERS MULTIPLE SCHOOLS (4) EXPRESSED DISSATISFACTION WITH CANVAS SUPPORT, WITH SOME DIVESTING FROM THE SERVICE (STANFORD) FACULTY LED PROGRAMS WERE COMMON CONVERSION IS MADE EASIER BY USING PARTNER 5 PILOTS WERE A GOOD TOOL FOR SOME TOOLS TO PHASE ROLL OUT
RESULTS The Committee is in favor of D2L as it scored the best in Ease of Use, Accessibility and had a strong Product Roadmap and Support model. Bright Space by D2L was the leader in each phase of the assessment from market studies through our hands-on evaluations in the sand box environments. While the support team selected Black Board as the leader, the margin was very narrow while the instructors and students gave Bright Space a significant lead in features, ease of use and alignment of their roadmap with that of USC. Canvas, the current market leader, was seen by the Committee as adequate, but not well aligned with the future of learning as seen by USC. For this reason, it is seen as a good backup should we discover some major flaw with Bright Space during our future testing. Blackboard Learn, the current LMS, was seen by students and instructors as not meeting their needs for features, ease of use or mobile support. The Blackboard team failed to convince the Committee that Ultra was sufficiently improved to mitigate these complaints. An in-dept RFP will be required to ensure all technical and cost requirements are considered in this decision. 6
