Endline Report
Pakistan Multi-sector Integrated Emergency Response – Phase 2
Care Pakistan, Thardeep Rural Development Programme (TRDP) and Fast Rural Development Programme (FRDP) jointly implemented DEC funded project titled, “Multi-Sector Integrated Emergency Response project to support the recovery of flood-affected people in Districts Dadu and Badin, Sindh province. The primary goal of the project was to deliver a comprehensive range of services to recover the needs of individuals affected by the floods. This initiative aimed to enhance the affected population's resilience and aid in their recovery from the aftermath of the floods. The following five project outcomes were designed to deliver an integrated response to the needs generated by the damages caused by the floods in terms of 1) Water, Sanitation and Hygiene (WASH), 2) Education, 3) Protection, 4) Livelihood and 5) MPCA:
•
Increased access to clean drinking water for flood affected communities in target areas and provide better facilities for vulnerable groups.
•
Improved learning environment for children enrolled in schools in flood affected target area
•
Increased protection services to communities
•
Increased livelihood support to communities
•
Awareness raising and capacity building regarding the DRR.
CARE Pakistan intended to conduct endline evaluation of the project and contracted a consultancy firm, CDMSD to assess performance of the project on Organization for Economic Co-operation and Development (OECD) and Development Assistance Committee (DAC) OECD-DAC criteria (Relevance, Effectiveness, Efficiency, Impact and Sustainability) and document its achievements, challenges, best practices, and the learning aspects for all stakeholders, with the aim of informing future similar programming. Further to assess the project strategies and interventions on and their quality criteria with specific focus on DNH, participation, inclusion and accountability strategies of the project.
The consultant employed a mixed approach comprised of qualitative and quantitative data to collect primary data and desk review for secondary data collection. 404 households were interviewed through sample beneficiary survey beside 10 FGDs with men and women and 16 Key Informant Interview conducted with project staff and relevant stakeholders. Appropriate quality control measures were put in place to ensure completeness and accuracy of the collected data. Read More...
•
Increased access to clean drinking water for flood affected communities in target areas and provide better facilities for vulnerable groups.
•
Improved learning environment for children enrolled in schools in flood affected target area
•
Increased protection services to communities
•
Increased livelihood support to communities
•
Awareness raising and capacity building regarding the DRR.
CARE Pakistan intended to conduct endline evaluation of the project and contracted a consultancy firm, CDMSD to assess performance of the project on Organization for Economic Co-operation and Development (OECD) and Development Assistance Committee (DAC) OECD-DAC criteria (Relevance, Effectiveness, Efficiency, Impact and Sustainability) and document its achievements, challenges, best practices, and the learning aspects for all stakeholders, with the aim of informing future similar programming. Further to assess the project strategies and interventions on and their quality criteria with specific focus on DNH, participation, inclusion and accountability strategies of the project.
The consultant employed a mixed approach comprised of qualitative and quantitative data to collect primary data and desk review for secondary data collection. 404 households were interviewed through sample beneficiary survey beside 10 FGDs with men and women and 16 Key Informant Interview conducted with project staff and relevant stakeholders. Appropriate quality control measures were put in place to ensure completeness and accuracy of the collected data. Read More...
Adolescent Girls’ Education in Somalia (AGES) Endline evaluation
This evaluation of CARE International’s Adolescent Girls Education in Somalia (AGES) programme concludes a four-and-a-half-year effort to track the programme’s impact on various cohorts of girl learners. The evaluation is preceded by three previous evaluations: a baseline (BL) round in late 2019, a Midline 1 (ML1) round in early 2022, and a Midline 2 (ML2) round in early 2023. Three key outcomes for girls are measured through this study: 1) learning outcomes, as measured by numeracy and literacy skills; 2) transitions outcomes, measured by girls’ trajectories since first surveyed, such as whether a girl has progressed in grade levels, or secured gainful employment after their participation in the AGES programme; and 3) sustainable change emerging from shifts in social norms at the community and individual level, as well as strengthened institutional capacities to support inclusive education.
In addition, the programme’s theory of change (ToC) posits that several intermediate outcomes mediate the effect of programme interventions on the primary outcomes. As such, this study also examines progress on several intermediate outcomes: 1) attendance rates, 2) quality of teaching practices, 3) girls’ leadership and life skills, 4) school management and governance, 5) community support for girls’ education, 6) girl’s self-efficacy, 7) strengthened economic circumstances for female youth, and finally, 8) access to social support services.
Importantly, this study comprises evaluations for three separate groups of girls, all recruited into the study at various points in time. The study began with an original baseline cohort of girls participating in the formal education (FE), Alternative Basic Education (ABE), and Non-Formal Education (NFE) programmes. These girls were recruited from schools in the following states, or geographic zone: Banadir, South West State, and Jubaland. The ABE programme focused on accelerated education of basic skills to enable girls to transition into the formal education system, while the NFE programme aimed to equip girls with the skills – both hard and soft – needed to pursue livelihoods, though some NFE girls also transition to the formal education system. These initial groups – whom we collectively refer to as Cohort 1 (C1) or the baseline cohort – were first recruited at BL in 2019, and were funded by the UK’s Girls’ Education Challenge (GEC) fund.
Two further cohorts, funded by USAID, were later introduced. Cohort 4, or C4, NFE girls were introduced into the study at ML1, while Cohort 5, or C5, NFE girls were introduced to the study at ML2. As such, unlike the C1 girls, we take the ML1 and ML2 evaluation rounds as the cohort-specific baselines for C4 and C5 NFE girls, respectively, and compare changes in main and intermediate outcomes from those rounds to EL. The USAID expansion of the NFE programming also meant the C4 and C5 Read More...
In addition, the programme’s theory of change (ToC) posits that several intermediate outcomes mediate the effect of programme interventions on the primary outcomes. As such, this study also examines progress on several intermediate outcomes: 1) attendance rates, 2) quality of teaching practices, 3) girls’ leadership and life skills, 4) school management and governance, 5) community support for girls’ education, 6) girl’s self-efficacy, 7) strengthened economic circumstances for female youth, and finally, 8) access to social support services.
Importantly, this study comprises evaluations for three separate groups of girls, all recruited into the study at various points in time. The study began with an original baseline cohort of girls participating in the formal education (FE), Alternative Basic Education (ABE), and Non-Formal Education (NFE) programmes. These girls were recruited from schools in the following states, or geographic zone: Banadir, South West State, and Jubaland. The ABE programme focused on accelerated education of basic skills to enable girls to transition into the formal education system, while the NFE programme aimed to equip girls with the skills – both hard and soft – needed to pursue livelihoods, though some NFE girls also transition to the formal education system. These initial groups – whom we collectively refer to as Cohort 1 (C1) or the baseline cohort – were first recruited at BL in 2019, and were funded by the UK’s Girls’ Education Challenge (GEC) fund.
Two further cohorts, funded by USAID, were later introduced. Cohort 4, or C4, NFE girls were introduced into the study at ML1, while Cohort 5, or C5, NFE girls were introduced to the study at ML2. As such, unlike the C1 girls, we take the ML1 and ML2 evaluation rounds as the cohort-specific baselines for C4 and C5 NFE girls, respectively, and compare changes in main and intermediate outcomes from those rounds to EL. The USAID expansion of the NFE programming also meant the C4 and C5 Read More...
Supporting meaningful civic engagement for improved accountability by leveraging digital technologies (Ref: ISAF-II) 2019-2023
This is the end of project Evaluation for CARE’s Implementation of Social Accountability Framework (ISAF) Project. Phase two of the ISAF was implemented in five target provinces (Ratank Kiri, Mondul Kiri, Koh Kong Kratie, and Stung Treng) over 50 months (2019-2024). ISAF II aimed to reduce poverty through democratic, inclusive, and equitable local governance and more accessible and equitable public service delivery. ISAF II worked with local Non-governmental Organisation (LNGOs) that were provided grants through the project and citizens of the five targeted provinces who received improved services (commune, health centres and primary schools).
Objective of the Evaluation
The overall objective of the end of project evaluation is to provide a full assessment of the intended goals and objectives of the action including the treatment of key evaluation questions and using the six Organisation for Economic Co-operation and Development / Development Assistance Committee (OECD DAC) criteria; relevance, coherence, effectiveness, efficiency, impact, and sustainability. The evaluation also aims to capture best practices, challenges, and lessons learned during the project intervention, and provide clear recommendations for CARE, the National Committee for Sub-national Democratic Development (NCDD), European Union (EU), World Bank and other relevant Development Partners and stakeholders for future interventions. The evaluation will measure the impact and progress against the project’s logical framework. The evaluation will assess all three sectors (commune administration, health centres, and school services) in all five selected provinces under CARE’s mandate.
End of project respondents were chosen from key project participants: citizens, youth (aged 15 to 30 years old), local authorities/services providers (commune and district levels, healthcare centres and primary schools) and Community Accountability Facilitators (CAFs). A total of 649 respondents were interviewed for the evaluation. Data collection was conducted with a team of 10 data collectors in December 2023. Read More...
Objective of the Evaluation
The overall objective of the end of project evaluation is to provide a full assessment of the intended goals and objectives of the action including the treatment of key evaluation questions and using the six Organisation for Economic Co-operation and Development / Development Assistance Committee (OECD DAC) criteria; relevance, coherence, effectiveness, efficiency, impact, and sustainability. The evaluation also aims to capture best practices, challenges, and lessons learned during the project intervention, and provide clear recommendations for CARE, the National Committee for Sub-national Democratic Development (NCDD), European Union (EU), World Bank and other relevant Development Partners and stakeholders for future interventions. The evaluation will measure the impact and progress against the project’s logical framework. The evaluation will assess all three sectors (commune administration, health centres, and school services) in all five selected provinces under CARE’s mandate.
End of project respondents were chosen from key project participants: citizens, youth (aged 15 to 30 years old), local authorities/services providers (commune and district levels, healthcare centres and primary schools) and Community Accountability Facilitators (CAFs). A total of 649 respondents were interviewed for the evaluation. Data collection was conducted with a team of 10 data collectors in December 2023. Read More...
Lafiyayyan Yara (Healthy Child) – Reducing Infections Disease Among Children Under Five (RIDCU) Bade LGA, Yobe State
The Lafiyayyan Yara (Healthy Child): Reducing Infectious Disease among Children under Five (RIDCU-5) project was a 27-month private donor funded project implemented from October 2021 through December 2023. The project strengthened health systems in Bade Local Government Area (LGA) of Yobe state by providing required equipment and medication for health facilities, increasing capacity of health personnel to use approved diagnostic methods, and engaging the community to improve uptake of health services.
The primary objective of the evaluation was to assess the project's performance and document its achievements, challenges, and best practices to guide future similar programming; and provide recommendations to CARE Nigeria and its partners to make informed decisions and enhance the effectiveness and efficiency of future initiatives.
Effectiveness
Evidence from the desk review showed that the project made remarkable progress towards reducing mortality in under-5 children through a community-based health systems strengthening approach that ensures that communities receive a core package of services. The major factors that influenced the effectiveness and achievement of the project results were the use of community structures (community health volunteers, model mothers, and community-based surveillance focal points), capacity building, the referral system and the Social Analysis and Action (SAA) approach through community dialogues, supportive supervision, routine monitoring visits and facility health promotion session. The SAA approach also helped to shift practices related to family planning, immunization and poor health seeking behavior, as evidenced from the qualitative findings.
Efficiency
In both the design and implementation of the project activities, CARE International RIDCU5 team ensured that the project was efficient. The project design allowed the RIDCU5 project to train and work with community members as volunteers and adequately build their capacity and work collaboratively with local partners and relevant stakeholders. The use of community structures and local partners made the project implementation cost effective and created the opportunity for sustainability.
7
The project’s design engaged community volunteers1 to serve as model mothers, community-based surveillance focal points, feedback and accountability volunteers, and community health volunteers, has enabled the project to increase community mobilization through a cost-effective approach. Through the community referral system, and health promotion sessions, many women were reached through the activities of the community volunteers.
Impact
Findings showed that the objectives and activities of the CARE RIDCU5 project were relevant in addressing the humanitarian needs of Bade Local Government communities. The weekly dialogue session with model mothers helped to address social norms and practices that negatively impact maternal and child health and the strengthened detection and referral of infectious disease (acute respiratory illness, malaria, diarrhea, and measles) through community-based surveillance (CBS) that included door-to-door visits and referrals for care. Also, health promotion sessions and supportive supervision in the 22 health facilities of the implementation contributed to quality of services. The project was able to respond largely to the needs of the target groups, including Community Health Workers (licensed and volunteers); children under five and their caregivers; pregnant and postpartum women and adolescent girls through support to strengthen referral systems, community engagement approaches to improve health behaviors and accountability of the health system as well as capacity building and provision of supplies and equipment to improve health service delivery.
Sustainability
The involvement of community volunteers assisted in the community ownership of the project. At present, community volunteers and community leaders, who benefited from the training conducted by CARE International, are engaged in community mobilization and awareness creation among community members on various aspects of the project. Respondents reported that that through the knowledge gained from CARE international, they were able to strengthen their cooperation among each other. The project has also built the capacity of the local partners and community members in a sustainable way through supportive supervision and training for health care workers and volunteers to improve and enhance their capacity to diagnose and detect infectious diseases. Read More...
The primary objective of the evaluation was to assess the project's performance and document its achievements, challenges, and best practices to guide future similar programming; and provide recommendations to CARE Nigeria and its partners to make informed decisions and enhance the effectiveness and efficiency of future initiatives.
Effectiveness
Evidence from the desk review showed that the project made remarkable progress towards reducing mortality in under-5 children through a community-based health systems strengthening approach that ensures that communities receive a core package of services. The major factors that influenced the effectiveness and achievement of the project results were the use of community structures (community health volunteers, model mothers, and community-based surveillance focal points), capacity building, the referral system and the Social Analysis and Action (SAA) approach through community dialogues, supportive supervision, routine monitoring visits and facility health promotion session. The SAA approach also helped to shift practices related to family planning, immunization and poor health seeking behavior, as evidenced from the qualitative findings.
Efficiency
In both the design and implementation of the project activities, CARE International RIDCU5 team ensured that the project was efficient. The project design allowed the RIDCU5 project to train and work with community members as volunteers and adequately build their capacity and work collaboratively with local partners and relevant stakeholders. The use of community structures and local partners made the project implementation cost effective and created the opportunity for sustainability.
7
The project’s design engaged community volunteers1 to serve as model mothers, community-based surveillance focal points, feedback and accountability volunteers, and community health volunteers, has enabled the project to increase community mobilization through a cost-effective approach. Through the community referral system, and health promotion sessions, many women were reached through the activities of the community volunteers.
Impact
Findings showed that the objectives and activities of the CARE RIDCU5 project were relevant in addressing the humanitarian needs of Bade Local Government communities. The weekly dialogue session with model mothers helped to address social norms and practices that negatively impact maternal and child health and the strengthened detection and referral of infectious disease (acute respiratory illness, malaria, diarrhea, and measles) through community-based surveillance (CBS) that included door-to-door visits and referrals for care. Also, health promotion sessions and supportive supervision in the 22 health facilities of the implementation contributed to quality of services. The project was able to respond largely to the needs of the target groups, including Community Health Workers (licensed and volunteers); children under five and their caregivers; pregnant and postpartum women and adolescent girls through support to strengthen referral systems, community engagement approaches to improve health behaviors and accountability of the health system as well as capacity building and provision of supplies and equipment to improve health service delivery.
Sustainability
The involvement of community volunteers assisted in the community ownership of the project. At present, community volunteers and community leaders, who benefited from the training conducted by CARE International, are engaged in community mobilization and awareness creation among community members on various aspects of the project. Respondents reported that that through the knowledge gained from CARE international, they were able to strengthen their cooperation among each other. The project has also built the capacity of the local partners and community members in a sustainable way through supportive supervision and training for health care workers and volunteers to improve and enhance their capacity to diagnose and detect infectious diseases. Read More...
Impact Case Study and Documentation of the Tea, Herbs and Spices Farmer’s Situation and Experiences in the Phase I of Her Money, Her Life Project Implementation
CARE International's two-year Her Money, Her Life (HMHL) project (2021-2023), funded by Bloomberg Philanthropies, aims to empower and economically uplift women farmers in Tanzania's tea sub-sector. In collaboration with Kazi Yetu Limited and key industry partners, the project targets 150,000 individuals, including 30,000 tea smallholder farmers (80% women). HMHL project builds on CARE's Agri Fund model with aim of investing in women to increase independence and economic opportunities to boost quality, quantity and diversification in Tanzania’s tea sub-sector. The impact study, conducted by Solveris Consulting Limited in November 2023, assesses the project's outcomes across seven districts in four regions, offering valuable insights into its effectiveness.
carried out by Kazi Yetu, funded by the project's grant. This ROI is expected to be more than doubled (188%) in 2025. The partnership between Kazi Yetu and stakeholders
ix
significantly impacts the specialty tea sector, showcasing rapid grant recovery/factory’s investment rate of return within 2.5 years. The project fosters economic viability and tangible benefits for farmers, contributing to positive transformation in livelihoods. Kazi Yetu's project interventions, highlighted by the SSTC demonstration factory, bring substantial and lasting benefits to farmers. Premium prices for green leaf tea sales, employment opportunities, and transformative training initiatives have significantly increased income for women tea farmers. The project's emphasis on value addition, including a solar dryer in Bumbuli, enhances product quality and market opportunities. Diversification into tea, herbs and spices production and commissions from bulk orthodox tea sales further contribute to income streams. The project's impact extends nationally, shaping the tea strategy and promoting specialty tea. The success of SSTC has catalysed national interest, leading to scaling efforts and increased global recognition for Tanzanian tea, enhancing market opportunities. Effectiveness of Village Savings and Loan Associations (VSLAs) on Collective Investment: VSLAs demonstrate a significant 30% increase in women's involvement from 46% during baseline to 60% now, indicating successful interventions that contribute to economic resilience and social cohesion. Regional variations underscore localized impacts. Additionally, the study reveals that the majority of respondents (87%) comprising 89% females and 84% males reported their VSLAs engaging in collective investments using mobilised savings. This level of collective engagement in collective investments through VSLAs is approximately double the baseline figure (47%). The investments take various forms, including small businesses, transportation equipment, and livestock husbandry. Further evidence suggests that collective investments have enhanced VSLAs' capital, improved members' access to loans, and overall increased income through dividends from collective investments. Read More...
carried out by Kazi Yetu, funded by the project's grant. This ROI is expected to be more than doubled (188%) in 2025. The partnership between Kazi Yetu and stakeholders
ix
significantly impacts the specialty tea sector, showcasing rapid grant recovery/factory’s investment rate of return within 2.5 years. The project fosters economic viability and tangible benefits for farmers, contributing to positive transformation in livelihoods. Kazi Yetu's project interventions, highlighted by the SSTC demonstration factory, bring substantial and lasting benefits to farmers. Premium prices for green leaf tea sales, employment opportunities, and transformative training initiatives have significantly increased income for women tea farmers. The project's emphasis on value addition, including a solar dryer in Bumbuli, enhances product quality and market opportunities. Diversification into tea, herbs and spices production and commissions from bulk orthodox tea sales further contribute to income streams. The project's impact extends nationally, shaping the tea strategy and promoting specialty tea. The success of SSTC has catalysed national interest, leading to scaling efforts and increased global recognition for Tanzanian tea, enhancing market opportunities. Effectiveness of Village Savings and Loan Associations (VSLAs) on Collective Investment: VSLAs demonstrate a significant 30% increase in women's involvement from 46% during baseline to 60% now, indicating successful interventions that contribute to economic resilience and social cohesion. Regional variations underscore localized impacts. Additionally, the study reveals that the majority of respondents (87%) comprising 89% females and 84% males reported their VSLAs engaging in collective investments using mobilised savings. This level of collective engagement in collective investments through VSLAs is approximately double the baseline figure (47%). The investments take various forms, including small businesses, transportation equipment, and livestock husbandry. Further evidence suggests that collective investments have enhanced VSLAs' capital, improved members' access to loans, and overall increased income through dividends from collective investments. Read More...
“FORTALECIENDO EL MOVIMIENTO DE TRABAJADORAS REMUNERADAS DEL HOGAR A TRAVÉS DEL APRENDIZAJE Y LA TECNOLOGÍA
Resumen ejecutivo
Descripción general Este documento expone un resumen de los hallazgos de la evaluación externa del proyecto “Fortaleciendo el Movimiento de Trabajadoras del Hogar a través del Aprendizaje y la Tecnología”- MovTRH&Tech, financiado por Cummins e implementado en dos fases entre el 2019 y el 2023 en Colombia, México, Brasil y Perú. Usando los criterios de evaluación que propone la OCDE, el informe presenta una valoración de los alcances estratégicos del proyecto, así como, lecciones aprendidas, buenas prácticas conclusiones y recomendaciones.
Hallazgos La pertinencia del proyecto se destaca desde su diseño, ya que, respondió a las necesidades de los movimientos de TRHs, incluyó acciones diferenciadas por país y empleó un enfoque participativo, adaptándose a contextos específicos. Se alineó con prioridades de instituciones y programas, contribuyendo a los ODS 5 y 8, la implementación del Convenio 189 de la OIT, leyes nacionales en México, Perú, Colombia y Brasil, los objetivos del Programa Regional Igual Valor Iguales Derechos, la visión 2030 de CARE y sus indicadores y la iniciativa Cummins Powers Women, entre otros.
El diseño de las aplicaciones contribuyó a la pertinencia, ya que, fueron diseñadas de manera participativa y diferenciada para cada país llevando a que respondieran a las necesidades propias de cada contexto. Así mismo, las campañas de comunicación y marketing contribuyeron a la pertinencia pues su desarrollo fue centrado en la experiencia y participación de las TRH, lo que constituyó un importante éxito para lograr sensibilización a diferentes públicos y ampliar el alcance esperado en un comienzo.
Strengthening the Domestic Workers Movement Through Learning and Technology (Phase III)
This document presents a summary of the findings of the external evaluation of the project “Strengthening the Domestic Workers Movement through Learning and Technology” - MovTRH&Tech, funded by Cummins and implemented in two phases between 2019 and 2023 in Colombia, Mexico, Brazil and Peru. Using the evaluation criteria proposed by the OECD, the report presents an assessment of the strategic scope of the project, as well as lessons learned, good practices, conclusions and recommendations.
Findings The relevance of the project stands out from its design, since it responded to the needs of the HRT movements, included actions differentiated by country and used a participatory approach, adapting to specific contexts. It was aligned with priorities of institutions and programs, contributing to SDGs 5 and 8, the implementation of ILO Convention 189, national laws in Mexico, Peru, Colombia and Brazil, the objectives of the Equal Value Equal Rights Regional Program, vision 2030 of CARE and its indicators and the Cummins Powers Women initiative, among others.
The design of the applications contributed to relevance, since they were designed in a participatory and differentiated way for each country, ensuring that they responded to the needs of each context. Likewise, the communication and marketing campaigns contributed to relevance since their development was focused on the experience and participation of HRT, which constituted an important success in raising awareness among different audiences and expanding the scope initially expected. Read More...
Descripción general Este documento expone un resumen de los hallazgos de la evaluación externa del proyecto “Fortaleciendo el Movimiento de Trabajadoras del Hogar a través del Aprendizaje y la Tecnología”- MovTRH&Tech, financiado por Cummins e implementado en dos fases entre el 2019 y el 2023 en Colombia, México, Brasil y Perú. Usando los criterios de evaluación que propone la OCDE, el informe presenta una valoración de los alcances estratégicos del proyecto, así como, lecciones aprendidas, buenas prácticas conclusiones y recomendaciones.
Hallazgos La pertinencia del proyecto se destaca desde su diseño, ya que, respondió a las necesidades de los movimientos de TRHs, incluyó acciones diferenciadas por país y empleó un enfoque participativo, adaptándose a contextos específicos. Se alineó con prioridades de instituciones y programas, contribuyendo a los ODS 5 y 8, la implementación del Convenio 189 de la OIT, leyes nacionales en México, Perú, Colombia y Brasil, los objetivos del Programa Regional Igual Valor Iguales Derechos, la visión 2030 de CARE y sus indicadores y la iniciativa Cummins Powers Women, entre otros.
El diseño de las aplicaciones contribuyó a la pertinencia, ya que, fueron diseñadas de manera participativa y diferenciada para cada país llevando a que respondieran a las necesidades propias de cada contexto. Así mismo, las campañas de comunicación y marketing contribuyeron a la pertinencia pues su desarrollo fue centrado en la experiencia y participación de las TRH, lo que constituyó un importante éxito para lograr sensibilización a diferentes públicos y ampliar el alcance esperado en un comienzo.
Strengthening the Domestic Workers Movement Through Learning and Technology (Phase III)
This document presents a summary of the findings of the external evaluation of the project “Strengthening the Domestic Workers Movement through Learning and Technology” - MovTRH&Tech, funded by Cummins and implemented in two phases between 2019 and 2023 in Colombia, Mexico, Brazil and Peru. Using the evaluation criteria proposed by the OECD, the report presents an assessment of the strategic scope of the project, as well as lessons learned, good practices, conclusions and recommendations.
Findings The relevance of the project stands out from its design, since it responded to the needs of the HRT movements, included actions differentiated by country and used a participatory approach, adapting to specific contexts. It was aligned with priorities of institutions and programs, contributing to SDGs 5 and 8, the implementation of ILO Convention 189, national laws in Mexico, Peru, Colombia and Brazil, the objectives of the Equal Value Equal Rights Regional Program, vision 2030 of CARE and its indicators and the Cummins Powers Women initiative, among others.
The design of the applications contributed to relevance, since they were designed in a participatory and differentiated way for each country, ensuring that they responded to the needs of each context. Likewise, the communication and marketing campaigns contributed to relevance since their development was focused on the experience and participation of HRT, which constituted an important success in raising awareness among different audiences and expanding the scope initially expected. Read More...
Women, Youth and Resilience Project Final Evaluation Outcome Harvesting: Understanding Changes in livelihoods, Gender Based Violence (GBV) and Government Accountability for Gender Equality.
The project was implemented by CARE International in Austria, Care International in Uganda, and two local partners, the Community Empowerment for Rural Development (CEFORD) and THRIVEGulu between 2021 and 2024 and is being followed up by a similar five-year project called the Gender Equality and Resilience Project (GEAR) to be implemented in Uganda and Rwanda. This is important to note as the findings from this final evaluation have implications for the programming of GEAR.
The main objective of this final evaluation is to assess effectiveness, impact and sustainability of the WAYREP project. It offers an understanding of the extent to which WAYREP achieved its stated objectives and it answers the five evaluation questions set out in the Evaluation Matrix (see Annex 2). The evaluation results will inform the programming of GEAR, WAYREP’s follow on program in Uganda and Rwanda.
The project successfully met its planned objectives, expected results, and indicators, demonstrated through the results below.
1.1: Enhanced Sustainable and Dignified Livelihood for Women and Youth
Over the five years, WAYREP significantly increased the average weekly income (49.6%) and by the end of the project, income gains surpassed the national average (Finding A). The increase in income was closely tied to an increase in confidence and self-reliance. While various groups of beneficiaries (e.g., refugees, youth, older beneficiaries, GBV survivors) experienced increases in their confidence, it was young women who experienced more significant gains in their self-confidence. These wins stemmed from their membership to savings groups and their newfound ability to earn an income (Finding H).
Although income gains were seen across beneficiary groups, gender and youth disparities were observed; men reported higher average earnings across Income Generating Activities (IGAs) compared to women
11
(Finding C) and younger beneficiaries in the 15-19 age group reported heightened engagement in income generation activities, compared to beneficiaries in the 20-30 age bracket (Finding B). While young people appear to have experienced more significant wins in participation, their average weekly income was lower than older beneficiaries (Finding D). Younger adults (20-30) were also less likely to develop business plans compared to older participants (31-45) (Finding E).
Specific differences were observed in Omugo Settlement in terms of income earning opportunities. Overall, in Omugo Settlement beneficiaries participated less in savings groups (Finding F) and were able to save less money compared to their peers in Arua City, Gulu City and Omugo Sub County. This is important, as the lower savings values have the risk of limiting refugees' ability to access capital to grow their businesses (Finding I). That said, South Sudanese refugees in Omugo settlement experienced unique wins from their increased economic status and improved their relationships with the host community. This is significant as it highlights the project's positive impact on social cohesion, particularly in locations where relationships between the refugee and host community relationships were strained (Finding F).
The final evaluation found that financial management practices and savings habits improved across all four locations. While most savings groups still preferred traditional savings systems that included a locked box kept in a member’s house, in Gulu and Arua City savers were experimenting with mobile savings that offered increased security, flexibility and accountability (Finding G). This points to the potential for greater exploration of mobile savings systems in GEAR, WAYREP’s follow on program, especially in locations which have already started to adopt this practice.
1.2: Evidence of WAYREP Achieving Reduced Acceptance for Gender Based Violence in Communities
The final evaluation found a decrease in experience of GBV from 28% at baseline (2021) to 20.7% at endline (2024) and a similar rejection of intimate partner violence (IPV), from 71.6% at baseline, to 77.1% at endline (Finding J). The project's strong focus on economic empowerment (Section 1.1 above) had a positive effect on the confidence and self-resilience of women and young (Finding H) which intern contributed to a positive shift in social norms and facilitated a reduction in the acceptability of violence (Finding K).
1.3: Evidence of WAYREP Providing Enhanced Support to GBV Survivors
The increase in GBV reporting (Finding L) suggests that survivors felt more comfortable coming forward, due to the project's efforts to raise awareness and improve survivors access to support. Beneficiaries reported there was now more support available for survivors of violence (Finding L) and improved access to mechanisms for expressing dissatisfaction with inappropriate treatment by local authorities or service providers (Finding M). The findings suggest that the project empowered survivors to seek help and enabled them to hold service providers to account (Finding L, M).
1.4: Evidence of WAYREP Achieving Increased Accountability by the Government of Uganda to Implement Relevant Frameworks for Women and Girls’ Protection and Rights
Women and girls across all four locations reported increased capacity to advocate for their rights (Finding N). The project had a strong contribution to this result and motivated and supported the Government of Ugandan (GoU) and key religious and cultural leaders to implement or strengthen frameworks to protect women's and girls' rights (Finding O). These changes intern created a more enabling environment for women and girls in Uganda and provided a supportive legal framework for them to advocate for their rights Read More...
The main objective of this final evaluation is to assess effectiveness, impact and sustainability of the WAYREP project. It offers an understanding of the extent to which WAYREP achieved its stated objectives and it answers the five evaluation questions set out in the Evaluation Matrix (see Annex 2). The evaluation results will inform the programming of GEAR, WAYREP’s follow on program in Uganda and Rwanda.
The project successfully met its planned objectives, expected results, and indicators, demonstrated through the results below.
1.1: Enhanced Sustainable and Dignified Livelihood for Women and Youth
Over the five years, WAYREP significantly increased the average weekly income (49.6%) and by the end of the project, income gains surpassed the national average (Finding A). The increase in income was closely tied to an increase in confidence and self-reliance. While various groups of beneficiaries (e.g., refugees, youth, older beneficiaries, GBV survivors) experienced increases in their confidence, it was young women who experienced more significant gains in their self-confidence. These wins stemmed from their membership to savings groups and their newfound ability to earn an income (Finding H).
Although income gains were seen across beneficiary groups, gender and youth disparities were observed; men reported higher average earnings across Income Generating Activities (IGAs) compared to women
11
(Finding C) and younger beneficiaries in the 15-19 age group reported heightened engagement in income generation activities, compared to beneficiaries in the 20-30 age bracket (Finding B). While young people appear to have experienced more significant wins in participation, their average weekly income was lower than older beneficiaries (Finding D). Younger adults (20-30) were also less likely to develop business plans compared to older participants (31-45) (Finding E).
Specific differences were observed in Omugo Settlement in terms of income earning opportunities. Overall, in Omugo Settlement beneficiaries participated less in savings groups (Finding F) and were able to save less money compared to their peers in Arua City, Gulu City and Omugo Sub County. This is important, as the lower savings values have the risk of limiting refugees' ability to access capital to grow their businesses (Finding I). That said, South Sudanese refugees in Omugo settlement experienced unique wins from their increased economic status and improved their relationships with the host community. This is significant as it highlights the project's positive impact on social cohesion, particularly in locations where relationships between the refugee and host community relationships were strained (Finding F).
The final evaluation found that financial management practices and savings habits improved across all four locations. While most savings groups still preferred traditional savings systems that included a locked box kept in a member’s house, in Gulu and Arua City savers were experimenting with mobile savings that offered increased security, flexibility and accountability (Finding G). This points to the potential for greater exploration of mobile savings systems in GEAR, WAYREP’s follow on program, especially in locations which have already started to adopt this practice.
1.2: Evidence of WAYREP Achieving Reduced Acceptance for Gender Based Violence in Communities
The final evaluation found a decrease in experience of GBV from 28% at baseline (2021) to 20.7% at endline (2024) and a similar rejection of intimate partner violence (IPV), from 71.6% at baseline, to 77.1% at endline (Finding J). The project's strong focus on economic empowerment (Section 1.1 above) had a positive effect on the confidence and self-resilience of women and young (Finding H) which intern contributed to a positive shift in social norms and facilitated a reduction in the acceptability of violence (Finding K).
1.3: Evidence of WAYREP Providing Enhanced Support to GBV Survivors
The increase in GBV reporting (Finding L) suggests that survivors felt more comfortable coming forward, due to the project's efforts to raise awareness and improve survivors access to support. Beneficiaries reported there was now more support available for survivors of violence (Finding L) and improved access to mechanisms for expressing dissatisfaction with inappropriate treatment by local authorities or service providers (Finding M). The findings suggest that the project empowered survivors to seek help and enabled them to hold service providers to account (Finding L, M).
1.4: Evidence of WAYREP Achieving Increased Accountability by the Government of Uganda to Implement Relevant Frameworks for Women and Girls’ Protection and Rights
Women and girls across all four locations reported increased capacity to advocate for their rights (Finding N). The project had a strong contribution to this result and motivated and supported the Government of Ugandan (GoU) and key religious and cultural leaders to implement or strengthen frameworks to protect women's and girls' rights (Finding O). These changes intern created a more enabling environment for women and girls in Uganda and provided a supportive legal framework for them to advocate for their rights Read More...
End Phase Evaluation: Epidemic Control and Reinforcement of Health Services (ECRHS) Phase II Project in Sierra Leone
The Epidemic Control and Reinforcement of Health System Services (ECRHS) project is funded under the German Financial Cooperation (BMZ) with Sierra Leone through KfW. Two phases have been successfully completed during the project implementation. The first phase of the project was launched in November 2015 and ended in 2018. The first phase was originally designed to respond to the Ebola outbreak. The second phase of the ECRHS project was considered an extended phase of the ECRHS I; and started in January 2019. Whereas the primary focus of ECRHSI was on public health emergency response, the aim of phase II of ECRHS is the sustainable establishment of an epidemiological control system, whilst also strengthening the performance of the health system with a focus on reproductive health / self-determined family planning. The purpose of this report therefore is to present findings of the final evaluation of the ECRHS II programme evaluation which was carried out with the general objective of ‘assessing the result and impact of the project goal and outcomes in targeted northern region of Sierra Leone’. Read More...
REPORT END PHASE EVALUATION (Epidemic Control and Reinforcement of Health Services (ECRHS) Phase 1 Programme in Sierra Leone) Ebola Emergency Response April
This report presents findings from the end phase evaluation of the Epidemic Control and Reinforcement of Health Services (ECRHS) Phase 1 Programme in Sierra Leone, which was implemented from November 2015 to December 2018. The aim of the Programme is to ‘Improve the health status of the population of Sierra Leone’. The Programme was originally designed to provide response to the Ebola outbreak in Sierra Leone, but also considered a longer-term view and worked towards putting in place preparations putting in place preparations for the transition of an extended health system strengthening (HSS) effort. Read More...