AEA’s Professionalization Journey: Presentation to AEA Business Meeting
This presentation outlines the professionalization journey of the American Evaluation Association (AEA), focusing on the development of competencies, historical milestones, and the incorporation of evaluator standards. It details the steps taken, challenges faced, and the ongoing efforts to enhance professional standards within the evaluation field.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
You are allowed to download the files provided on this website for personal or commercial use, subject to the condition that they are used lawfully. All files are the property of their respective owners.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author.
E N D
Presentation Transcript
AEAs Professionalization Journey: Presentation to AEA Business Meeting November 4, 2021 November 4, 2021 Susan Tucker, Chair AEA Professionalization & Competencies Working Group
AEA First 2 steps in AEA s journey Professionalization Charge AGENDA P&C Working Group update Starting Step 3 Resources Q&A
AEA professionalization charge in 2021 Define professionalization Discuss competencies & professionalization with members Incorporate 2018 AEA Evaluator Competencies into AEA programs/initiatives 3
AEA Competencies Do NOT exclude qualified people from the field Are NOT a credentialing or assessment system Are NOT perfect nor set in stone 4
1. Evaluation norms, standards, principles Framework of competencies, capabilities, qualifications for individual evaluators Defined process for determining whether the required competencies, capabilities, qualifications are met by individuals 2. approaching professionalization: 3. Davies & Bruemmer 2015
AEAs Professionalization History: Phase 1 Developing/Adopting Foundational Documents Developing/Adopting Foundational Documents Program Evaluation Standards (3rd ed.) 2011 AEA Public Statement on Cultural Competence 2011 AEA Guiding Principles (revised) 2018 ongoing Update cycle to be established by AEA board
AEA Evaluator Competencies: Phase 2 Developing/Adopting Competencies Developing/Adopting Competencies Studied competency sets worldwide Created draft competencies (V1) by facilitating an engagement design Held listening posts at AEA 2015 & revised draft (V2) 2015 Conducted 15+ focus groups, webinars, and listening posts Created discussion guides for TIGs and Affiliates Established dedicated email address for feedback 2016 Surveyed 7400 members Presented results at AEA17 & international VOPEs 17% response rate (n = 1225) 2017 Revised draft competencies (V3) to address 2017 survey data AEA Board approval May 2018 2018 Published learnings in New Directions for Evaluation (Winter 2020, Number 168) 2020
What we now have Common language and criteria for defining evaluation practice A way to make clear the defining/unique characteristics of our professional practice An inclusive approach to provide multiple pathways for entry 2 Steps on path to professionalization completed Evidence, Use & Culture Standards Competencies 10
AEA is entering the final step in professionalization Reflect on where we are: align steps Continue inclusive, iterative work toward professionalization Clarify next steps Solicit engagement/ involvement EVALUATE 3 STAGES 1. Guiding values & core documents 2. Competencies 3. Using & validating competencies
How: P&C Working Group BUILD OUR WG AND OUR COMMUNITIES OF PRACTICE BUILD ON COMPETENCY TASK FORCE WORK ORGANIZE LEARNING EVENTS/WEBINARS ENACT OUR CHARGE ENGAGE AEA MEMBERS, PARTNERS & BEYOND 12
P&C Working Group Members Chair: Susan Tucker, E&D Associates LLC Sandra Ayoo, Asst Professor, University of North Carolina, Greensboro Dugan Fraser, Global Evaluation Initiative, World Bank Celeste Ghiano, Universidad Nacional de San Juan (Argentina), ReLAC, PETAS Rhoda Goremucheche, CLEAR, University of Witwatersrand, SA & SAMEA Keiko Kuji-Shikatani, Ministry of Education, CES & EvalGender+ Alexey Kuzmin, Process Consulting Company & Russian Evaluation Association Virginia Lamprecht, US Agency for International Development Anisha Lewis, AEA Executive Director Veronica Olazabel, Rockefeller Foundation & AEA President-Elect Donna Podems, OtherWise & AEA IOCE representative Laurie Stevahn, Professor, Seattle Univ Beeta Tahmassebi, Vice President of Strategic Initiatives, EnCompass; President of Washington Evaluators, Exec Director of ELC Elizabeth Taylor-Schiro, Asst Professor, Univ of Minnesota Lauren Wildschut, Academic Coordinator, Evaluation Studies, Stellenbosch Univ
Phase 3: Six P&CWG tasks & work so far 1. EPTF & board collaboration, align & review core docs USE: Engage with AEA Board to address ongoing P&C policy & support EVOLVE: Update competencies on a regular basis as evaluation practice changes over time 1 2. Crosswalk AJE article, 2022 webinar, work with TIG Council & PDWG to use INSTITUTIONALIZE: Integrate competencies within AEA: proposals, conference, other PD ALIGN: Start with crosswalk of foundational documents 2 EXPAND BEYOND COMPETENCY DOMAINS: Address job function, levels of expertise, contextual and developmental levels 3. Support emerging evaluators, create P&C TIG 3 ENGAGE: Develop voluntary processes evaluators can use in specific contexts to self-reflect & engage with others, Design materials that highlight and reinforces interconnections among AEA foundational documents 4. AEA 2021 engage session 4 5. create TIG or CoP for P&C research, AEA 2021 ROE sessions RESEARCH: Organize & support P&C research community 5 6. Joint work with VOPEs: SAMEA, CES, UKES, IOCE ADVOCATE: Advocate for professionalizing evaluation via global dialogue DISSEMINATE: Expand competencies documentation & disseminate 6
Questions to explore : What are your initial reactions? Are we consistent with our values? Where are our gaps and blind spots? What are potential risks to consider? Who is interested in participating any parts of this work? What can we learn to design next steps? What other questions should we be asking?
Next steps: All 4 Core documents need to be reviewed/updated more regularly Crosswalk revealed gaps we need to address in our core documents Review should include coordinated & regular crosswalks to identify gaps/inconsistencies Comparison of core documents reveal different goals: some attend to evaluator and some attend to evaluation Clarify overlapping concepts: context vs culture We need to be clearer about what each of these terms mean Align competencies with task forces and working groups Will require redesign of conference and PD model to reach differing member needs also an opportunity to reach out to commissioners and others engaged in evaluation but not labeling themselves as such Expand Competency work beyond Program Evaluators: Address job function, levels of expertise, contextual and developmental levels Engagement: Affects proposals and clustering and members feeling included TIG Council critical Collaborations across Task Forces and Working Groups needed P&C use and support: Financial implications to support career arc from entry onwards motivations of academic evaluators differ from practitioners Research base is critical along with tensions involved in validation Requires more targeted global partnering
CONTACT Susan Tucker, Chair AEA Professionalization & Competencies Task Force sutucker1@mac.com
AEA website: STAY TUNED FOR FOLLOW-UP ENGAGEMENT OPPORTUNITIES The 2018 AEA Evaluator Competencies (Brochure disseminated at Eval18) https://www.eval.org/Portals/0/Docs/AEA%20Evalua tor%20Competencies.pdf The American Evaluation Association s Program Evaluator Competencies Special Issue of New Directions for Evaluation, Winter 2020, Number 168 https://onlinelibrary.wiley.com/toc/1534875x/2020/ 2020/168 September 2018 AEA Webinar introducing board-approved competencies to members Spring 2022 AEA Webinar planned by P&C Working Group Some AEA Competency Resources 20
