Evaluation & Assessment

This cross-cutting theme focuses on improving the effectiveness, sustainability, and scale of programs by sharing data on what works and what doesn’t, and methodologies for monitoring, evaluation, and impact assessment.   Improved practices in this area promise to provide stakeholders with enhanced understanding of which interventions have meaningful impact, what the likely return on investment will be, and how to design and implement improved monitoring and evaluation initiatives.

Where are we now?

As the YEO field matures, pilot programs and anecdotal data have given way to increasingly sophisticated approaches to program measurement and learning. These advances are critical to scale, replication, policy and government partnership initiatives. However, more work remains. Confusion about the purpose and practice of monitoring, evaluation and assessment, and the way it can contribute to learning with an organization or program still exists.  A common language for this area along with standardized measures of cost and benefit are also necessary to ensure discussions are productive and evaluations reflect a common framework of practice.

Trends and emerging practices

  • Donors are advocating for more rigorous evaluation to ensure greater accountability and learning.
  • Although randomized controlled trials (RCTs) are the gold standard, they can be expensive and time consuming, leading some donors to find quasi-experimental and impact evaluations very appealing, while others invest more significantly in M&E activities.
  • For corporations and foundations, evaluations are important to measure the social value proposition and social impact of their investments to consumers, customers, and employees.
  • More implementers are recognizing the importance of investing in good M&E, so they can demonstrate to donors their organization's social value proposition, particularly to impact investors.
  • More organizations are successfully using mixed methods approaches (both quantitative and qualitative data) to M&E.
  • Survey and focus group tools should be tested and finalized with young people for tools to achieve greater reliability and validity.
  • Data from young people should be triangulated with data from significant adults in their lives (such as parents, guardians, and teachers) to contextualize its meaning and importance.
  • More organizations are recognizing that existing M&E staff may not have the skills set required to engage young people, so training on how to conduct youth-inclusive M&E is important. 
  • Young people are not homogeneous, so questions need to be framed differently for young men and young women, youth from urban and rural communities, and/or youth from different socio-economic groups.

 

Five Steps to More Meaningful Youth Engagement

My name is Matthew French and I work for JBS International, Inc. This blog draws upon research conducted under contract with USAID’s office of Education (read the full youth engagement report here), as well as my own experiences working with young people.

Save the Date: Improving the Quality of EGRA Data: A Consultation to Inform USAID Guidance on the Administration of Early Grade Reading Assessments

Event host(s)/organization(s): 
USAID Global Reading Network
Event Date: 
Mar 5, 2015 (All day) to Mar 6, 2015 (All day)

The Global Reading Network is hosting a two-day panel discussion focused on designing, administering, and analyzing early grade reading assessments.

Review of Development Partner Support for African Union Youth Employment and Education Priorities

This report provides an overview of efforts of the African Union (AU) and its development partners to strengthen education in Africa, in the context of the urgent and growing youth employment challenge facing the Continent. It begins with an overview of the AU’s role, structure, and main strategic frameworks and priorities as they relate to youth employment and education.

Resource Type: 
Report

Open Source Software Expands Reach of Vocational Training in Rwanda

At the 2014 Global Youth Economic Opportunities, Michelle Ell of Global Communities shares the open-source software that they used in Rwanda to rapidly collect, analyze, and store data to achieve a major scale-up of a vocational training initiative.

Resource Type: 
Presentation

A Ganar Impact Evaluation

At the 2014 Global Youth Economic Opportunities Summit under the Monitoring and Evaluation session "There's no I in IEs," Karen Towers, USAID Education Team Leader, presents findings from the mid-project impact evaluation of the A Ganar Program. The session highlighted the challenges that occur when implementing Randomized Control Trial impact evaluations.

Resource Type: 
Presentation

Monitoring and Evaluation in the Development Sector

KPMG’s Monitoring and Evaluation (M&E) Survey polled more than 35 respondents from organizations responsible for over US$100 billion of global development expenditure. The survey reflects perspectives from M&E leaders on the current state, including approaches, resources, use of technology and major challenges facing a variety of funders and implementers.

Resource Type: 
Report

M&E Reinvented: Validate Results, Inform Practice, Improve Outcomes in Real Time

At the 2014 Global Youth Economic Opportunities Summit under the Monitoring and Evaluation session "M&E Reinvented," Dr. Teresa Derrick-Mills, Senior Research Associate at the Urban Institute, presented the new M&E approach "Rapid Cycle Evaluation." Rapid Cycle Evaluation uses evaluation research methods to quickly determine whether an intervention is effective. It can be used to provide decision-makers with timely, actionable, and compelling evidence of what changes lead to improved outcomes.

Resource Type: 
Presentation

Using Mobile Data Capture for M&E in Malawi, Ethiopia, and Rwanda

At the 2014 Global Youth Economic Opportunities Summit under the Monitoring & Evaluation session "Integrating Elecontronic Data Collection into M&E Practices," Megan Noel from John Snow, Inc. presents on the Supply Chains for Community Case Management and its experience in using two mobile data collection tools: Magpi and cStock. Magpi was used by the project to collect M&E data using smartphones while cStock was a routine logistics management information system designed by the project and used for M&E in Malawi.

Resource Type: 
Presentation

The Global Youth Wellbeing Index: European Launch Event (London, November 25th)

Event host(s)/organization(s): 
Hilton Worldwide, the Center for Strategic and International Studies, and the International Youth Foundation
Event Date: 
Nov 25, 2014 (08:30am to 11:00am)

The European Launch of the Global Youth Wellbeing Index

Tuesday, 25 November, 2014, 8:30am—11:00am
Central London

AGENDA

WELCOMING REMARKS

Simon Vincent
Hilton Worldwide Area President for Europe, the Middle East, and Africa

William Reese
President and CEO, International Youth Foundation

PRESENTATION OF THE INDEX

Dr. Nicole Goldin
Principal Author, Global Youth Wellbeing Index; Founder, NRG Advisory

RESPONSE PANEL

BLOG: How Can Children and Youth Become Financially Capable Adults?

Originally posted on poverty-action.org, October 22, 2014.

Pages

Subscribe to RSS - Evaluation & Assessment