English
Farmer Field Business Schools and Village Savings and Loan Associations for promoting climate-smart agriculture practices: Evidence from rural Tanzania
How can stakeholders (e.g., governments and their extension services, private sector, policy makers and NGOs) effectively stimulate the adoption of climate-smart agricultural (CSA) practices among small-scale farmers in developing countries? Changes in temperatures and rainfall lead to new risks of drought as well as erratic and excess rainfall (Ericksen et al., 2011; WMO, 2020). Many farmers experience climate change as a threat since crop yields that farmers needed to sustain themselves are adversely affected (IPCC, 2014; WMO, 2020). At the same time, the agricultural sector also contributes to climate change since agricultural greenhouse gas (GHG) emissions (nitrous oxide, methane, and carbon dioxide) are among the significant drivers of global warming (CCAFS, 2021). Read More...
Impact of Tipping Point Initiative, a social norms intervention, in addressing child marriage and other adolescent health and behavioral outcomes in a northern district of Bangladesh
Written by Tipping Point’s research partner, the International center for diaorrheal disease research, Bangladesh, this impact report provides the methodology for the three-arm cluster randomized control trial, results of that trial that assessed the impact of the Tipping Point model, and implications for the field. Read More...
Impact Evaluation Summary of Tipping Point Nepal
This brief summarizes the methods, key findings, and results and the implications of the Tipping Point impact evaluation in Kapilvastu and Rupandehi, Nepal. Read More...
Gender Norms Study: Women-led Micro and Small Businesses – Peru
Social Norms are the rules that govern behavior. Gender norms are social norms defining acceptable and appropriate actions for women and men in a given group or society. They are embedded in formal and informal institutions, nested in the mind, and produced and reproduced through social interaction. They play a role in shaping women and men’s (often unequal) access to resources and freedoms, thus affecting their voice, power, and sense of self. The purpose of this study was to identify gender barriers, perceptions and factors that limit shared responsibility in the home and which influence the low participation of men in domestic and care work. Read More...
Gender Norms Study: Women-led Micro and Small Businesses – Pakistan
Social Norms are the rules that govern behavior. Gender norms are social norms defining acceptable and appropriate actions for women and men in a given group or society. They are embedded in formal and informal institutions, nested in the mind, and produced and reproduced through social interaction. They play a role in shaping women's and men’s (often unequal) access to resources and freedoms, thus affecting their voice, power, and sense of self. The purpose of this study was to gain quantitative and qualitative information about gender norms faced by women entrepreneurs in Pakistan related to childcare responsibilities and financial decision-making and responsibility, which impact a woman’s ability to run and grow her own business Read More...
Gender Norms Study: Women-led Micro and Small Businesses – Vietnam
Social Norms are the rules that govern behavior. Gender norms are social norms defining acceptable and appropriate actions for women and men in a given group or society. They are embedded in formal and informal institutions, nested in the mind, and produced and reproduced through social interaction. They play a role in shaping women and men’s (often unequal) access to resources and freedoms, thus affecting their voice, power and sense of self. The purpose of this study was to gain quantitative and qualitative information about social and gender norms affecting women entrepreneurs in Vietnam related to childcare responsibilities, who should be the breadwinner and who is upholding these norms. Read More...
Learning From Failure 2022
In 2019 and 2020, CARE published Learning from Failures reports to better understand common problems that projects faced during implementation. Deliberately looking for themes in failure has helped CARE as an organization and provides insight on what is improving and what still needs troubleshooting. This report builds on the previous work to show what we most need to address in our programming now.
As always, it is important to note that while each evaluation in this analysis cited specific failures and areas for improvement in the project it reviewed, that does not mean that the projects themselves were failures. Of the 72 evaluations in this analysis, only 2 showed projects that failed to deliver on more than 15% of the project goals. The rest were able to succeed for at least 85% of their commitments. Rather, failures are issues that are within CARE’s control to improve that will improve impact for the people we serve.
To fully improve impact, we must continue to include failures in the conversation. We face a complex future full of barriers and uncertainties. Allowing an open space to discuss challenges or issues across the organization strengthens CARE’s efforts to fight for change. Qualitative analysis provides critical insights that quantitative data does not provide insight into the stories behind these challenges to better understand how we can develop solutions.
CARE reviewed a total of 72 evaluations from 65 projects, with 44 final reports published between February 2020 and September 2021 and 28 midterm reports published between March 2018 and October 2020. Seven projects had both midterm and final evaluations at the time of this analysis. For ease of analysis, as in previous years, failures were grouped into 11 categories (see Annex A, the Failures Codebook for details).
Results
The most common failures in this year’s report are:
• Understanding context—both in the design phase of a project and refining the understanding of context and changing circumstances throughout the whole life of a project, rather than a concentrated analysis phase that is separate from project implementation. For example, an agriculture project that built it’s activities assuming that all farmers would have regular internet access, only to find that fewer than 10% of project participants had smartphones and that the network in the area is unreliable, has to significantly redesign both activities and budgets.
• Sustainability—projects often faced challenges with sustainability, particularly in planning exit strategies. Importantly, one of the core issues with sustainability is involving the right partners at the right time. 47% of projects that struggled with sustainability also had failures in partnership. For example, a project that assumed governments would take over training for project participants once the project closed, but that failed to include handover activities with the government at the local level, found that activities and impacts are not set up to be sustainable.
• Partnerships—strengthening partnerships at all levels, from government stakeholders to community members and building appropriate feedback and consultation mechanisms, is the third most common weakness across projects. For example, a project that did not include local private sector actors in its gender equality trainings and assumes that the private sector would automatically serve women farmers, found that women were not getting services or impact at the right level.
Another core finding is that failures at the design phase can be very hard to correct. While projects improve significantly between midterm and endline, this is not always possible. There are particular kinds of failure that are difficult to overcome over time. Major budget shortfalls, a MEAL plan that does not provide quality baseline data, and insufficient investments in understanding context over the entire life of a project are less likely to improve over time than partnerships and overall MEAL processes.
Some areas also showed marked improvements after significant investments. Monitoring, Evaluation, Accountability, and Learning (MEAL), Gender, Human Resources, and Budget Management are all categories that show improvements over the three rounds of learning from failures analysis. This reflects CARE’s core investments in those areas over the last 4 years, partly based on the findings and recommendations from previous Learning From Failure reports. Specifically, this round of data demonstrates that the organization is addressing gender-related issues. Not only are there fewer failures related to gender overall, the difference between midterm and final evaluations in gender displays how effective these methods are in decreasing the incidence of “failures” related to engaging women and girls and looking at structural factors that limit participation in activities.
Another key finding from this year’s analysis is that projects are improving over time. For the first time, this analysis reviewed mid-term reports in an effort to understand failures early enough in the process to adjust projects. Projects report much higher rates of failure at midterm than they do at final evaluation. In the projects where we compared midline to endline results within the same project, a significant number of failures that appeared in the mid-term evaluation were resolved by the end of the project. On average, mid-term evaluations reflect failures in 50% of possible categories, and final evaluations show failures in 38% of possible options. Partnerships (especially around engaging communities themselves), key inputs, scale planning and MEAL are all areas that show marked improvement over the life of the project.
Read More...
As always, it is important to note that while each evaluation in this analysis cited specific failures and areas for improvement in the project it reviewed, that does not mean that the projects themselves were failures. Of the 72 evaluations in this analysis, only 2 showed projects that failed to deliver on more than 15% of the project goals. The rest were able to succeed for at least 85% of their commitments. Rather, failures are issues that are within CARE’s control to improve that will improve impact for the people we serve.
To fully improve impact, we must continue to include failures in the conversation. We face a complex future full of barriers and uncertainties. Allowing an open space to discuss challenges or issues across the organization strengthens CARE’s efforts to fight for change. Qualitative analysis provides critical insights that quantitative data does not provide insight into the stories behind these challenges to better understand how we can develop solutions.
CARE reviewed a total of 72 evaluations from 65 projects, with 44 final reports published between February 2020 and September 2021 and 28 midterm reports published between March 2018 and October 2020. Seven projects had both midterm and final evaluations at the time of this analysis. For ease of analysis, as in previous years, failures were grouped into 11 categories (see Annex A, the Failures Codebook for details).
Results
The most common failures in this year’s report are:
• Understanding context—both in the design phase of a project and refining the understanding of context and changing circumstances throughout the whole life of a project, rather than a concentrated analysis phase that is separate from project implementation. For example, an agriculture project that built it’s activities assuming that all farmers would have regular internet access, only to find that fewer than 10% of project participants had smartphones and that the network in the area is unreliable, has to significantly redesign both activities and budgets.
• Sustainability—projects often faced challenges with sustainability, particularly in planning exit strategies. Importantly, one of the core issues with sustainability is involving the right partners at the right time. 47% of projects that struggled with sustainability also had failures in partnership. For example, a project that assumed governments would take over training for project participants once the project closed, but that failed to include handover activities with the government at the local level, found that activities and impacts are not set up to be sustainable.
• Partnerships—strengthening partnerships at all levels, from government stakeholders to community members and building appropriate feedback and consultation mechanisms, is the third most common weakness across projects. For example, a project that did not include local private sector actors in its gender equality trainings and assumes that the private sector would automatically serve women farmers, found that women were not getting services or impact at the right level.
Another core finding is that failures at the design phase can be very hard to correct. While projects improve significantly between midterm and endline, this is not always possible. There are particular kinds of failure that are difficult to overcome over time. Major budget shortfalls, a MEAL plan that does not provide quality baseline data, and insufficient investments in understanding context over the entire life of a project are less likely to improve over time than partnerships and overall MEAL processes.
Some areas also showed marked improvements after significant investments. Monitoring, Evaluation, Accountability, and Learning (MEAL), Gender, Human Resources, and Budget Management are all categories that show improvements over the three rounds of learning from failures analysis. This reflects CARE’s core investments in those areas over the last 4 years, partly based on the findings and recommendations from previous Learning From Failure reports. Specifically, this round of data demonstrates that the organization is addressing gender-related issues. Not only are there fewer failures related to gender overall, the difference between midterm and final evaluations in gender displays how effective these methods are in decreasing the incidence of “failures” related to engaging women and girls and looking at structural factors that limit participation in activities.
Another key finding from this year’s analysis is that projects are improving over time. For the first time, this analysis reviewed mid-term reports in an effort to understand failures early enough in the process to adjust projects. Projects report much higher rates of failure at midterm than they do at final evaluation. In the projects where we compared midline to endline results within the same project, a significant number of failures that appeared in the mid-term evaluation were resolved by the end of the project. On average, mid-term evaluations reflect failures in 50% of possible categories, and final evaluations show failures in 38% of possible options. Partnerships (especially around engaging communities themselves), key inputs, scale planning and MEAL are all areas that show marked improvement over the life of the project.
Read More...
Solar Harnessed Entrepreneurs (SHE) Baseline Assessment: Promoting Productive Use of Energy (PUE) for Women and Girls in Sierra Leone
This report presents findings from a baseline assessment conducted to provide contextual analysis of the Solar Harnessed Entrepreneurs (SHE) project’s target population, capturing initial data against selected indicators in the project Results Framework. The SHE project aims to provide women groups and individual run enterprises with a package of support, including financing for energy-enabled appliances, training in their use and an enhanced market access and linkages with the aim to leverage the new access to energy for business growth. The ideal setting of the project is to cover over 330 newly enabled businesses by engaging 7,120 women, living in Sierra Leone’s mini-grid locations.
Although quantitative data collection was largely used to get primary information using structured questionnaires for personal interviews, the research team also used qualitative methods through Key Informant Interviews (KIIs), with respondents drawn from the renewable energy sector/mini-grid power stations. The study also used Focus Group Discussion (FGD) guides to interview Project’s target groups and individual women entrepreneurs in the study areas. The coverage of the assessment was to include twenty (20) communities in all seven (7) intervention districts (Bo, Bonthe, Moyamba, Pujehun, Kambia, Koinadugu and Bombali), but based on initial targets for the first phase of implementation, only sixteen (16) communities were reached during the assessment.
Read More...
Although quantitative data collection was largely used to get primary information using structured questionnaires for personal interviews, the research team also used qualitative methods through Key Informant Interviews (KIIs), with respondents drawn from the renewable energy sector/mini-grid power stations. The study also used Focus Group Discussion (FGD) guides to interview Project’s target groups and individual women entrepreneurs in the study areas. The coverage of the assessment was to include twenty (20) communities in all seven (7) intervention districts (Bo, Bonthe, Moyamba, Pujehun, Kambia, Koinadugu and Bombali), but based on initial targets for the first phase of implementation, only sixteen (16) communities were reached during the assessment.
Read More...
Evaluating Systems-level change and impact Findings from the evaluation of the Humanitarian Assistance Program (PAH) in Ecuador
CARE’s ten-year strategy, Vision 2030, seeks to deepen the organizational focus on systems-level change and impact, recognizing that this is essential to expanding CARE’s reach and fulfilling our mission to save lives, defeat poverty and achieve social justice. To support this, CARE launched a systems-level impact initiative to measure the effect of our programs that have influenced or changed systems, and the impact of this systems-change on people’s lives. The initiative also increased capacity across the CARE confederation to design, finance and implement high-quality systems change programs, and to strengthen the focus on systems-level change within our Country Office organizational frameworks and strategies. Four CARE Country Offices were selected to evaluate a project or program, and to synthesize the results for national and global learning. Read More...
Evaluating Systems-level change and impact Findings from the evaluation of the Seizing the Moment project in Ethiopia
CARE’s ten-year strategy, Vision 2030, seeks to deepen the organizational focus on systems-level change and impact, recognizing that this is essential to expanding CARE’s reach and fulfilling our mission to save lives, defeat poverty and achieve social justice. To support this, CARE launched a systems-level impact initiative to measure the effect of our programs that have influenced or changed systems, and the impact of this systems-change on people’s lives. The initiative also increased capacity across the CARE confederation to design, finance and implement high-quality systems change programs, and to strengthen the focus on systems-level change within our Country Office organizational frameworks and strategies. Four CARE Country Offices were selected to evaluate a project or program and to synthesize the results for national and global learning. Read More...