Overview of 2017 ILO Survey Results and Methodology
Explore the results of the 2017 ILO Survey, which assessed student learning in various areas such as critical thinking, communication, and global awareness. The survey methodology, participant demographics, and graduation trends are also detailed.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Background Survey items derived from Mesa ILOs and operational definitions Indirect assessment of student learning upon completion of a degree or certificate program Student reflections on development in ILO areas
Mesa ILOs (2017) 1. Critical Thinking 2. Global Awareness 3. Personal Awareness and Civic Responsibility 4. Self-Awareness and Interpersonal Skills 5. Communication 6. Technological Awareness
Survey Instrument 6 Likert scale matrix questions (1 per ILO) Ratings on a 5-point scale Open-ended comment boxes for each ILO 6 additional open-ended items Success factors, challenges, recommendations Students asked to rate the degree to which their experiences at Mesa improved their skills/abilities in each area 2 1 3 4 5 Improved slightly No Improved moderately Improved Improved to a great degree improvement
Survey Screenshot Example: Global Awareness
Methodology Survey sent to students in May 2016 Data collection: May 2016 One invitation, two reminders Target population: students applying for graduation during spring semester N=1,567 students Survey invitation sent via email to 1,565 students
Survey Participants 453 students responded to the survey invitation 391 students completed the survey Response rate= 25% Ethnicity Gender 32% 20% 12% 11% 9% Male, 34% 6% 5% 1% 1% 1% Female, 59% Other/ No response, 7% Asian American Indian or Alaskan Native African American Filipino Latino/a Middle Eastern Pacific Islander Caucasian Multiple Other/No Response Ethnicities
Graduation Semester & Award Anticipated Graduation Semester Anticipated Educational Awards Other (please specify) 5% Summer 2015 1% Fall 2015 12% Associate degree only 73% Certificate only 7% Spring 2016 82% No response <1% No response <1% Both degree and certification 20%
Summary of Responses by ILO ILO Skill Improvement Scale Average Ratings Critical Thinking 3.94 Personal Awareness 3.85 Global Awareness 3.75 Communication 3.69 Self-Awareness 3.69 Technological Awareness 3.66 1 2 3 4 5 Not at all To a great degree
Communication Communication Average Skill Improvement Ratings Analyze written information 3.82 Express my thoughts in writing 3.80 Effectively convey thoughts when speaking to others 3.74 Analyze visual information such as charts and graphics 3.64 Analyze visual information such as art forms 3.47 1 2 3 4 5 To a great degree Not at all
Communication Analyze visual information such as art forms 3.7 Express my thoughts in writing 3.9 Effectively convey thoughts when speaking to others 3.9 Analyze visual information such as charts and graphics 3.8 Analyze written information 3.9 0 1 2 3 4 5
Critical Thinking Critical Thinking Average Skill Improvement Ratings Effectively interpret information presented to me 4.02 Draw my own conclusions based on the available evidence 3.98 Evaluate information for validity 3.95 Construct arguments based on a variety of information sources 3.91 Evaluate information for bias 3.90 Explain my position on a topic to others 3.90 Apply the principles I learned to solve real-world problems 3.87 1 2 3 4 5 To a great degree Not at all
Critical Thinking Explain my position on a topic to others 4.0 Construct arguments based on a variety of information sources 4.1 Draw my own conclusions based on the available evidence 4.0 Apply the principles I learned to solve real-world problems 4.0 Effectively interpret information presented to me 4.0 Evaluate information for bias 3.9 Evaluate information for validity 4.0 0 1 2 3 4 5
Global Awareness Global Awareness Average Skill Improvement Ratings Be mindful of the diverse background of others in my personal interactions 3.83 Act with sensitivity toward others from diverse cultural backgrounds 3.75 Assess the impact of human behavior on the world's resources 3.72 Act with civility toward others even if I disagree with them 3.69 1 2 3 4 5 To a great degree Not at all
Global Awareness Act with civility toward others even if I disagree with them 3.9 Assess the impact of human behavior on the world s resources 3.9 Act with sensitivity toward others from diverse cultural backgrounds 4.0 Be mindful of the diverse backgrounds of others in my personal interactions 4.0 0 1 2 3 4 5
Personal Awareness Personal Awareness Average Skill Improvement Ratings Set personal goals for myself 4.07 Set career goals for myself 4.06 Identiy areas for personal growth 3.97 Take initiative in order to complete a task 3.91 Work with others to achieve a common goal 3.82 Understand the impact my actions have on others 3.75 Identify my role in society 3.68 Make healthy choices 3.51 1 2 3 4 5 To a great degree Not at all
Personal Awareness Identify areas for personal growth 4.1 Make healthy choices 3.6 Take initiative in order to complete a task 4.0 Work with others to achieve a common goal 3.9 Set career goals for myself 4.2 Set personal goals for myself 4.1 Understand the impact my actions have on others 3.8 Identify my role in society 3.8 0 1 2 3 4 5
Self-Awareness Self-Awareness Average Skill Improvement Ratings Work effectively as a member of a team 3.78 Collaborate with others in a variety of settings 3.75 Develop meaningful relationships with my instructors 3.68 Develop meaningful relationships with my peers 3.55 1 2 3 4 5 To a great degree Not at all
Self-Awareness Work effectively as a member of a team 3.9 Collaborate with others in a variety of settings 3.9 Develop meaningful relationships with my instructors 3.9 Develop meaningful relationships with my peers 3.7 0 1 2 3 4 5
Technological Awareness Technological Awareness Average Skill Improvement Ratings Utilize technology to enhance my own learning 3.75 Communicate effectively using technology (i.e., office and technicaly software, social media) 3.66 Identify areas in which I would like to develop my technology skills 3.56 1 2 3 4 5 To a great degree Not at all
Technological Awareness Communicate effectively using technology (i.e., office and technical software, social media) 3.8 Identify areas in which I would like to develop my technology skills 3.8 Utilize technology to enhance my own learning 3.9 0 1 2 3 4 5
Popular Programs of Study (Among Respondents) Psychology (35) Business Administration (23) Other Business (16) Sociology (11) Interior Design (10)
What Did Students Say Most Influenced Their Success @ Mesa? Instructional faculty (132) Students own motivation (80) Support of family, and friends (48) School services, programs, and resources (27) Counselors (24)
Top Challenges While at Mesa Time management (78) Personal challenges (66) Academics (64) Parking and transportation (30) Course availability (24) Instructional styles and approaches (24)
