Graduate Tracer Studies and Benchmarking Workshop Overview
This content provides an overview of the Graduate Tracer Studies and Benchmarking workshop conducted on May 9, 2018. It includes objectives, pre-survey results, timeline, terms of reference, and updates related to the study methodology, data collection, analysis, and capacity building workshops. The workshop aims to improve quality and relevance in institutions through a holistic approach. Pre-survey results from participating ACEs across 11 countries are also detailed.
Download Presentation

Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
Graduate Tracer Studies and Benchmarking ACE Workshop, May 09, 2018
Outline Graduate Tracer Studies Objectives Update Pre-survey results Timeline Benchmarking Objectives Update Terms of Reference for participating institutions Timeline
Graduate Tracer Studies: Objectives Develop a graduate tracer study methodology (master s and PhD graduates) to give an overview of the state of employability of graduates Conduct related exercises to obtain the needed data, analysis and reporting Facilitate capacity building workshops to discuss the reports and train universities Work closely with the benchmarking team to ensure a holistic approach to improving quality and relevance in SSA institutions 4
Graduate Tracer Studies: Update A pre-survey was conducted to determine: Interest of ACEs in participating and their contact details Whether data should be collected at ACE or Institutional level Degree level of graduates to be targeted (undergrads, master s, doctoral) The type of information centers are interested in obtaining from such a survey Best mode of survey delivery Most attractive incentives for graduates to participate Finalizing procedures for bringing on board MyCOS 5
Graduate Tracer Studies: Pre-Survey Results 25 out of 46 ACEs across 11 countries responded to the survey (8 ACE Is and 17 ACE IIs) ACE Center Institution SMA Institut de Math matiques et de Sciences Physiques ACE I B nin Kwame Nkrumah University of Science and Technology (KNUST) University of Ghana University of Benin, Benin City University of Jos Redeemer's University African University of Science and Technology Obafemi Awolowo University RWESCK ACE I Ghana WACCBIP CERHI ACEPRD ACEGID PAMI OAU-PARK ACE I Ghana ACE I Nigeria ACE I Nigeria ACE I Nigeria ACE I Nigeria ACE I Nigeria 6
Graduate Tracer Studies: Pre-Survey Results (ACE II) ACE Center CDT-Africa CESAAM ACEII-PTRE CEPHEM Aquafish CS-OGET ACEIoT ACEESD ACEITLMS IRPM & BTD WISE - Futures CREATES SACIDS PHARMTRAC ACALISE MARCCI ACE for Sust.. Mining Institution Addis Ababa University Egerton University Moi University University of Malawi ACE II Ethiopia ACE II Kenya ACE II Kenya ACE II Malawi ACE II Malawi ACE II Mozambique ACE II Rwanda ACE II Rwanda ACE II Rwanda ACE II Tanzania ACE II Tanzania ACE II Tanzania ACE II Tanzania ACE II Uganda ACE II Uganda ACE II Uganda ACE II Zambia Lilongwe University of Agriculture and Natural Resources Universidade Eduardo Mondlane University of Rwanda University of Rwanda University of Rwanda- College of Education Sokoine University of Agriculture Nelson Mandela African Inst. of Sci. & Tech. (NM-AIST) Nelson Mandela African Inst. of Sci. & Tech. (NM-AIST) Sokoine University of Agriculture Mbarara University of Science and Technology Uganda Martyrs University Makerere University Copperbelt University 7
Graduate Tracer Studies: Pre-Survey Results How many cohorts have already graduated from your ACE? ACE I (3 centers graduated 1 cohort; 5 centers graduated 2 cohorts); ACE II (3 centers graduated 2 cohorts; 2 centers graduated 4 cohorts; 1 center graduated 5 cohorts) 12 11 10 8 8 6 4 3 2 2 1 0 0 zero one cohort two cohorts three cohorts four cohorts five cohorts + 8
Graduate Tracer Studies: Pre-Survey Results Number of graduates in each cohort ACE II ACE I 152 160 140 120 140 115 120 108 120 100 78 100 80 81 80 70 80 60 60 40 40 15 9 20 16 10 9 20 4 8 10 0 0 2017 Undergraduate 2016 2015 2014 2017 Master's 2016 Master's PhDs PhDs 9
Graduate Tracer Studies: Pre-Survey Results If you have graduated at least one cohort, please estimate the number of graduates for each cohort who are 1) master s 2) PhDs 3) undergraduates (if applicable). 885 graduates across all ACEs (50% master s; 6% PhDs; 44% undergrads) 72% 260 300 250 52% 159 200 39% 120 83% 115 150 22% 80 84% 70 100 9% 26 5% 19 11% 15 11% 9 6% 8 5% 4 50 0 2017 2016 2015 2014 Undergraduate Master's PhDs 10
Graduate Tracer Studies: Pre-Survey Results For each cohort, please indicate the number of graduates for whom you have the contact information (email and/or phone number)? 81% or 358 out of 443 master s graduates, and 89% or 51 out of 57 PhD graduates and 100% for the undergrads 250 79% (206/260) 200 81% 150 (128/159) 100 85% (22/26) 89% (17/19) 100% (15/15) 50 100% (9/9) 100% (8/8) 100% (4/4) 0 2017 2016 2015 2014 Master's PhDs 11
Graduate Tracer Studies: Pre-Survey Results What kind of information do you wish to obtain from a tracer study? Info. Desired from Tracer Study 1. Employment status/employability Frequency 15 Info. Desired from Tracer Study Job satisfaction Employer satisfaction/suggestions for improvement Contact/demographic information Length of job search Current position at employer Interest in continuing education at center Interest in donating Publications Entrepreneurship Frequency 2 11 2. Skill competency/requirement/gap 3. Suggestions for/satisfaction with teaching & learning improvement 4. Salary/performance/promotion information 5. Type of employment 2 10 2 1 1 6 4 1 4 6. Additional academic training 1 1 1 4 7. Social/economic contributions 3 8. Current location 12
Graduate Tracer Studies: Pre-Survey Results What are the method(s) of survey delivery that in your opinion will have the greatest response rates from your graduates? 17 out of 25 believe emails; What are examples of incentives you would recommend to be given to graduates who take the survey, in order to obtain the greatest response rates? (i.e. what rewards would be most attractive)? The Examples of Incentives Fellowship/scholarship/conference funding Free lectures/workshops/resources for alumni Survey results Mobile/internet top up Alumni gatherings/networking No incentive University appreciation letter Mentor current students Raffle/prize Academic transcript Frequency 10 8 4 2 2 1 1 1 1 1 13
Graduate Tracer Studies: Proposal Based on these results, we determined: Data can be collected at ACE (pilot); Scale up possible at institutional level 25 ACEs are interested; 11 have 0 graduates Master s degree level of graduates (2016 & 2017) to be targeted for pilot Survey will focus on employment, skills, and evaluation of teaching & learning Best mode of survey delivery: Emails (primary); Calls (secondary) Most attractive incentives for graduates to participate: scholarships, center resources Other ACES can still join, the pilot particularly those who have graduated 1 or more cohorts and have their contact details 14
Graduate Tracer Studies: Timeline Develop the standard methodology (variable indicator system) of the graduate tracer study for both master s and doctoral graduates. June 2018 Consultations on methodology with ACEs and other Higher education stakeholders- July 2018 Survey questions translated and transferred onto online platform Aug 2018 Survey period for master s graduates only (pilot with only ACEs) Sep Nov 2018 Dissemination of results and regional workshops Dec 2018/ 2019 (tbc) 15
Benchmarking 16
Benchmarking: Objectives (i) Facilitate benchmarking, graduate tracer studies, student surveys and other relevant exercises under the initiative that are relevant for the SSA higher education sector and based on global best practices; (i) Support the SSA higher education sector by providing capacity building opportunities for higher education institutions and government agencies/ministries in quality data management, including its collection, analysis, interpretation and its strategic use; and (i) Invest in key partnerships that would add value through financial, technical and/or other in- kind support to the Hub s activities, ensuring it remains relevant and sustainable. 17
Benchmarking: Update Secured some funding to support Benchmarking host institution and technical assistance Expressions of interest for host institution applications Technical Assistance firm Shanghai Ranking have been contracted (as of last week) Soliciting list of interested universities and national agencies. So far: Universities: Botswana (1), Cameroon (6), DRC (6), Ethiopia (9), Gabon (?),Ghana (5), Kenya (3), Niger (?), Nigeria (?), Lesotho (1), Malawi(5), Mauritania (1), Rwanda (1), Senegal (?), Tanzania (49), Uganda (3), Zambia (2) 18
Benchmarking: Terms of Reference Eligibility Expected outcomes Existence of a comprehensive and functional Management Information System (MIS) for the university A private, public, research or teaching university based in sub-Saharan Africa Head of University willing to sign a commitment letter for the participation of the university Evidence of trained staff that understand how to collect, analyze and use data to inform the university s policy makers Commitment to submit required data Improvements in quality and relevance of the university s programs evidenced by interventions that improve at least 2 indicators each year Willingness and commitment of the university to make practical and relevant changes informed by the results from the benchmarking and graduate tracer studies exercise Improvement in relevance of programs at the university as evidenced by positive outcome of graduate tracer studies in subsequent years of participation Agree that the results will be made public 19
Benchmarking: Timeline Update of institutional benchmarking methodology and development of a data verification scheme - May 2018 Institutional Benchmarking data collection June August 2018 Development of national higher education system benchmarking methodology - July 2018 Consultations on national higher education system benchmarking methodology with other Higher Education stakeholders- Aug 2018 National system level data collection Aug - Sept 2018 Data cleaning and verification Sep Oct 2018 Overall and individual reports ready and disseminated - Dec 2018/early 2019 Regional and national level workshops - 2019 20
Questions, Comments, Feedback? ebentil@worldbank.org 21