Somalia
Adolescent Girls’ Education in Somalia (AGES) Midline evaluation
Original Baseline Cohorts
Learning outcomes among the original baseline cohorts are mixed. The FE and ABE cohorts showed substantial learning gains at ML1 and continue to perform above their baseline levels, but have experienced significant backsliding in both literacy and numeracy since ML1. This learning loss is concerning, and is coupled with a failure, even at ML1, to meet the learning benchmarks established at baseline.1 C1 NFE girls, on the other hand, have shown no learning improvements since baseline on either literacy or numeracy, in either the ML1 or ML2 rounds.
Learning gains among FE girls include an increase in literacy of 20.5 points since baseline, compared to an expected (benchmarked) achievement of 29.7 points. This cohort came closer to meeting the numeracy targets, gaining 15.3 points since baseline, compared to an expected improvement of 18.5 points. ABE girls have also failed to meet their benchmarks, but by larger margins, falling short of the literacy and numeracy benchmarks by 15.4 points and 11.5 points, respectively.
An important caveat when assessing learning outcomes concerns differential exposure to schooling among the cohorts. Girls who remained enrolled in FE consistently improved considerably, but the cohort’s overall scores are reduced by the number of girls who dropped out over time; the same is true of ABE and NFE girls.2 While even consistent attenders generally failed to meet improvement benchmarks, these differential gains underscore the importance of continuous enrolment to achieving the programme’s learning goals.
C4 NFE Cohort
Improving learning outcomes—numeracy and Somali literacy—are at the centre of the AGES programme’s goals. C4 NFE girls were enrolled before ML1 and completed the 10-month NFE programme. At the ML2 evaluation point, in the aggregate, we find that both numeracy and literacy scores improved significantly from a low base set of scores at ML1. The C4 NFE girls improved their average numeracy scores from 21.1 points to 49.6 points, and average literacy scores increased by 18.3 points to 34.9 points.
Examining changes in learning outcomes by region, C4 NFE girls in Banadir, Lower Shabelle, and Middle Shabelle improved their numeracy scores from 24.6 to 28.2 points on average while in Bay C4 NFE girls only improved by 2.3 points on average. With regard to literacy scores, C4 NFE girls in Banadir and Lower Shabelle improved their literacy scores 23.2 and 24.9 points, respectively, while scores in Bay stagnated with only a 1.8 point increase. Girls from Bay scored significantly higher than girls from all other regions at ML1, but by ML2 the numeracy and literacy gains were minimal and not statistically significant. Read More...
Learning outcomes among the original baseline cohorts are mixed. The FE and ABE cohorts showed substantial learning gains at ML1 and continue to perform above their baseline levels, but have experienced significant backsliding in both literacy and numeracy since ML1. This learning loss is concerning, and is coupled with a failure, even at ML1, to meet the learning benchmarks established at baseline.1 C1 NFE girls, on the other hand, have shown no learning improvements since baseline on either literacy or numeracy, in either the ML1 or ML2 rounds.
Learning gains among FE girls include an increase in literacy of 20.5 points since baseline, compared to an expected (benchmarked) achievement of 29.7 points. This cohort came closer to meeting the numeracy targets, gaining 15.3 points since baseline, compared to an expected improvement of 18.5 points. ABE girls have also failed to meet their benchmarks, but by larger margins, falling short of the literacy and numeracy benchmarks by 15.4 points and 11.5 points, respectively.
An important caveat when assessing learning outcomes concerns differential exposure to schooling among the cohorts. Girls who remained enrolled in FE consistently improved considerably, but the cohort’s overall scores are reduced by the number of girls who dropped out over time; the same is true of ABE and NFE girls.2 While even consistent attenders generally failed to meet improvement benchmarks, these differential gains underscore the importance of continuous enrolment to achieving the programme’s learning goals.
C4 NFE Cohort
Improving learning outcomes—numeracy and Somali literacy—are at the centre of the AGES programme’s goals. C4 NFE girls were enrolled before ML1 and completed the 10-month NFE programme. At the ML2 evaluation point, in the aggregate, we find that both numeracy and literacy scores improved significantly from a low base set of scores at ML1. The C4 NFE girls improved their average numeracy scores from 21.1 points to 49.6 points, and average literacy scores increased by 18.3 points to 34.9 points.
Examining changes in learning outcomes by region, C4 NFE girls in Banadir, Lower Shabelle, and Middle Shabelle improved their numeracy scores from 24.6 to 28.2 points on average while in Bay C4 NFE girls only improved by 2.3 points on average. With regard to literacy scores, C4 NFE girls in Banadir and Lower Shabelle improved their literacy scores 23.2 and 24.9 points, respectively, while scores in Bay stagnated with only a 1.8 point increase. Girls from Bay scored significantly higher than girls from all other regions at ML1, but by ML2 the numeracy and literacy gains were minimal and not statistically significant. Read More...
Somali Girls Education Promotion Project Transition (SOMGEP-T) Baseline
CARE International launched SOMGEP and, following its successful completion, continued its programming through Somali Girls’ Education Promotion Project – Transition (SOMGEP-T). The project, which began on May 1 2017 and is expected to close on October 31 2021, builds on evidence from SOMGEP and seeks to further address barriers and challenges Somali girls face related to attendance and learning outcomes. At proposal stage, the project was expected to reach a total of 27,146 marginalised girls; calculations based on up to date enrolment data indicate that the project is estimated to reach 27,722 in-school girls across 148 primary schools and 53 secondary schools in Somaliland, Puntland, and Galmudug, as well as 5,140 out-of-school girls in the same locations.
SOMGEP-T aims to bring about sustainable improvements to the learning and transition outcomes of marginalised Somali girls. To address barriers and the causes of marginalisation, the SOMGEP-T Theory of Change (ToC) focuses on four key outputs: (1) Improved access to post-primary options, (2) Supportive school practices and conditions for marginalised girls, (3) Positive shifts on gender and social norms at community and individual girl level, and (4) Enhanced MoEs’ capacity to deliver quality and relevant formal and informal education. Outputs are expected to contribute to the achievement of the project’s four intermediate outcomes of attendance, retention, improved quality of teaching, and life skills development, which will in turn contribute to the long-term goals of improving learning outcomes, boosting transition rates, and ensuring the sustainability of changes brought about by the project.
The SOMGEP-T evaluation uses a mixed-methods, quasi-experimental design, involving a longitudinal panel of girls with a non-randomly assigned comparison group. The baseline sample comprises 76 schools, with 38 intervention schools and 38 comparison schools. The primary findings from the evaluation are summarised below. Read More...
SOMGEP-T aims to bring about sustainable improvements to the learning and transition outcomes of marginalised Somali girls. To address barriers and the causes of marginalisation, the SOMGEP-T Theory of Change (ToC) focuses on four key outputs: (1) Improved access to post-primary options, (2) Supportive school practices and conditions for marginalised girls, (3) Positive shifts on gender and social norms at community and individual girl level, and (4) Enhanced MoEs’ capacity to deliver quality and relevant formal and informal education. Outputs are expected to contribute to the achievement of the project’s four intermediate outcomes of attendance, retention, improved quality of teaching, and life skills development, which will in turn contribute to the long-term goals of improving learning outcomes, boosting transition rates, and ensuring the sustainability of changes brought about by the project.
The SOMGEP-T evaluation uses a mixed-methods, quasi-experimental design, involving a longitudinal panel of girls with a non-randomly assigned comparison group. The baseline sample comprises 76 schools, with 38 intervention schools and 38 comparison schools. The primary findings from the evaluation are summarised below. Read More...
Somali Girls Education Promotion Project – Transition (SOMGEP-T) Midline Round 2
The long-term goal of SOMGEP-T is to bring about sustainable improvements to the learning and transition outcomes of marginalised Somali girls. Marginalised girls who are targeted under SOMGEP-T are expected to exhibit meaningful improvements in learning outcomes (literacy, numeracy, and financial literacy) and transition outcomes (transition rate) as compared to a comparison group; targeted schools, communities and government institutions are expected to demonstrate indications of sustainability. The project targets the underlying causes of marginalization, specifically through influencing stakeholder attitudes and promoting social change at the household, school, community and policy/governance levels.
Three general observations emerge from the aggregate learning analysis. The first is the program’s apparent impact on financial literacy. When using the pure longitudinal panel of all the individuals who overlap between Baseline and Midline Round 2, the impact is a substantive 8.4 percentage in favour of intervention schools. Secondly, increases in numeracy outcomes are systematically higher among intervention girls. The panel consisting of girls who have been enrolled since baseline has improved their results on average by 4.6 points more than the comparison group since the baseline. This divergence has almost entirely occurred between the two midline evaluation rounds, likely because impacts of the program in this regard are not immediate. Thirdly, despite indications of program impact in financial literacy and numeracy, literacy outcomes in comparison schools have often shown more marked improvement than intervention schools since the baseline. Read More...
Three general observations emerge from the aggregate learning analysis. The first is the program’s apparent impact on financial literacy. When using the pure longitudinal panel of all the individuals who overlap between Baseline and Midline Round 2, the impact is a substantive 8.4 percentage in favour of intervention schools. Secondly, increases in numeracy outcomes are systematically higher among intervention girls. The panel consisting of girls who have been enrolled since baseline has improved their results on average by 4.6 points more than the comparison group since the baseline. This divergence has almost entirely occurred between the two midline evaluation rounds, likely because impacts of the program in this regard are not immediate. Thirdly, despite indications of program impact in financial literacy and numeracy, literacy outcomes in comparison schools have often shown more marked improvement than intervention schools since the baseline. Read More...
Somali Girls Education Promotion Program Transition (SOMGEP-T) Midline
Despite ongoing efforts, learning outcomes in Somalia remain among the lowest in the region, particularly for girls. Boys and girls contend with different gender and social norms that tend to undermine their ability to stay in school, study and advance from grade to grade. Girls in Somalia are living in an environment undergoing deep transitions in social and gender norms, where traditional norms expecting women to primarily care for children in the home and assume responsibility for household tasks, and placing little value or emphasis on education for women coexist with new roles for women as entrepreneurs, heads of household and main breadwinners at home, thus increasing demand on girls’ education. Since the time of the baseline, rural-rural migration has increased, predominantly as a result of economic hardship that has persisted among households that have been most heavily affected by drought. At the level of national government, MoE personnel tend to change frequently, leading to lack of continuity over time, but there is also increased funding for educational initiatives. It is in this context that CARE International launched SOMGEP and, following its successful completion, continued its programming through Somali Girls’ Education Promotion Project – Transition (SOMGEP-T). The project, which began on May 1 2017 and is expected to close on October 31 2021, builds on evidence from SOMGEP and seeks to further address barriers and challenges Somali girls face related to attendance and learning outcomes. At proposal stage, the project was expected to reach a total of 27,146 marginalised girls; calculations based on up to date enrolment data indicate that the project is estimated to reach 27,722 in-school girls across 148 primary schools and 53 secondary schools in 22 target districts in Somaliland, Puntland, and Galmudug, as well as 5,140 out-of-school girls in the same locations.
SOMGEP-T aims to bring about sustainable improvements to the learning and transition outcomes of marginalised Somali girls. To address barriers and the causes of marginalisation, the SOMGEP-T Theory of Change (ToC) focuses on four key outputs: (1) Improved access to post-primary options, (2) Supportive school practices and conditions for marginalised girls, (3) Positive shifts on gender and social norms at community and individual girl level, and (4) Enhanced MoEs’ capacity to deliver quality and relevant formal and informal education. Outputs are expected to contribute to the achievement of the project’s four intermediate outcomes of attendance, retention, improved quality of teaching, and life skills development, which will in turn contribute to the long-term goals of improving learning outcomes, boosting transition rates, and ensuring the sustainability of changes brought about by the project.
The SOMGEP-T evaluation uses a mixed-methods, quasi-experimental design, involving a longitudinal panel of girls with a non-randomly assigned comparison group. The present study describes the results after four months of exposure to the intervention for in-school girls and presents the baseline findings for girls attending an alternative learning program (ALP). The midline sample comprises 63 schools, with 32 intervention schools and 31 comparison schools, plus 32 ALP sites (17 shared with the midline sample, 15 unique to the ALP sample). The primary findings from the evaluation are summarised below. Read More...
SOMGEP-T aims to bring about sustainable improvements to the learning and transition outcomes of marginalised Somali girls. To address barriers and the causes of marginalisation, the SOMGEP-T Theory of Change (ToC) focuses on four key outputs: (1) Improved access to post-primary options, (2) Supportive school practices and conditions for marginalised girls, (3) Positive shifts on gender and social norms at community and individual girl level, and (4) Enhanced MoEs’ capacity to deliver quality and relevant formal and informal education. Outputs are expected to contribute to the achievement of the project’s four intermediate outcomes of attendance, retention, improved quality of teaching, and life skills development, which will in turn contribute to the long-term goals of improving learning outcomes, boosting transition rates, and ensuring the sustainability of changes brought about by the project.
The SOMGEP-T evaluation uses a mixed-methods, quasi-experimental design, involving a longitudinal panel of girls with a non-randomly assigned comparison group. The present study describes the results after four months of exposure to the intervention for in-school girls and presents the baseline findings for girls attending an alternative learning program (ALP). The midline sample comprises 63 schools, with 32 intervention schools and 31 comparison schools, plus 32 ALP sites (17 shared with the midline sample, 15 unique to the ALP sample). The primary findings from the evaluation are summarised below. Read More...
Somali Girls Education Promotion Project Transition (SOMGEP-T) Endline Evaluation
The Somali Girls’ Education Promotion Project – Transition (SOMGEP-T), funded by UK’s Foreign and Commonwealth Development Office (FCDO) and USAID, was implemented from 2017-2022 in rural and remote areas of Somaliland, Puntland, and Galmudug, reaching an estimated 20,000 girls and 10,000 boys directly and another 20,000 students through indirect benefits. The implementation of SOMGEP-T followed on the successes of SOMGEP (2013-17, funded by FCDO), with a particular focus on enhancing learning outcomes and transition rates for marginalised adolescent girls. SOMGEP-T was implemented by a consortium formed by CARE International, ADRA, local women’s rights network NAGAAD, and local non-governmental organisations HAVOYOCO (a youth-led committee) and TASS. The project’s activities were conducted in close collaboration with state- and national-level Ministries of Education, responding to priority areas identified in state and Federal-level sector development plans.
SOMGEP-T used a mixed-methods, quasi-experimental design for impact measurement. The endline evaluation sample included 69 primary schools, split between 37 intervention and 32 comparison schools. Additionally, a pre-post evaluation design was used to assess progress on accelerated education programming. Data collection took place in an additional 32 Alternative Learning Programme (ALP) centres and 35 Accelerated Basic Education (ABE) centres, which are located in the same communities as SOMGEP-T intervention schools. In total, the endline sample included 1,802 girls and their households, 965 of whom were re-contacted from the baseline and interviewed successfully. The endline data collection took place in December 2021.
Learning
A few key findings emerged from the learning analysis. Firstly, although improvements were observed in numeracy, Somali literacy, English literacy, and financial literacy amongst girls in intervention schools, these improvements were also simultaneously observed in girls in comparison schools. Secondly, learning improvements occurred largely within the first two years of the programme, prior to the ML2 evaluation – a finding which can largely be attributed to the COVID-19 pandemic and the resulting long-running school closures that occurred between the ML2 and endline evaluations.
At the endline, it became evident that SOMGEP-T had a much larger impact on learning among a few specific groups of ultra-marginalised girls, especially those marginalised along multiple overlapping axes, such as girls from relatively poor or pastoralist households who were out-of-school at the baseline, girls with physical disabilities, and the lowest-performing students at the baseline. For instance, girls from pastoralist households who were out-of-school at baseline gained an average of 10.8 percentage points in Somali literacy, over and above the comparison group. A similar, but less stark, pattern was observed in average numeracy scores (3.9 percentage points over and above the comparison group). In both cases gains among this subgroup were larger than among other out-of-school girls or pastoralist girls who were already in school when the programme started. Read More...
SOMGEP-T used a mixed-methods, quasi-experimental design for impact measurement. The endline evaluation sample included 69 primary schools, split between 37 intervention and 32 comparison schools. Additionally, a pre-post evaluation design was used to assess progress on accelerated education programming. Data collection took place in an additional 32 Alternative Learning Programme (ALP) centres and 35 Accelerated Basic Education (ABE) centres, which are located in the same communities as SOMGEP-T intervention schools. In total, the endline sample included 1,802 girls and their households, 965 of whom were re-contacted from the baseline and interviewed successfully. The endline data collection took place in December 2021.
Learning
A few key findings emerged from the learning analysis. Firstly, although improvements were observed in numeracy, Somali literacy, English literacy, and financial literacy amongst girls in intervention schools, these improvements were also simultaneously observed in girls in comparison schools. Secondly, learning improvements occurred largely within the first two years of the programme, prior to the ML2 evaluation – a finding which can largely be attributed to the COVID-19 pandemic and the resulting long-running school closures that occurred between the ML2 and endline evaluations.
At the endline, it became evident that SOMGEP-T had a much larger impact on learning among a few specific groups of ultra-marginalised girls, especially those marginalised along multiple overlapping axes, such as girls from relatively poor or pastoralist households who were out-of-school at the baseline, girls with physical disabilities, and the lowest-performing students at the baseline. For instance, girls from pastoralist households who were out-of-school at baseline gained an average of 10.8 percentage points in Somali literacy, over and above the comparison group. A similar, but less stark, pattern was observed in average numeracy scores (3.9 percentage points over and above the comparison group). In both cases gains among this subgroup were larger than among other out-of-school girls or pastoralist girls who were already in school when the programme started. Read More...
SOMALI RELIEF AND RECOVERY PROGRAM-SRRP
Due to repeated climate shocks, continued conflict, and protracted displacement mean that Somalia remains one of the most prolonged humanitarian crises in the world. Over 4.2 million people, including 2.5 million children are estimated to need humanitarian assistance and protection in 2019. Significant displacement and destitution driven by the 2016/17 drought and protracted conflict have left more than 1.5 million people across Somalia facing acute food insecurity through June 2019 with 903,100 children under the age of five are likely to be malnourished in 2019 including 138,200 who are likely to be severely malnourished. Women and children like in many other instances of conflicts represented the majority of the 2.6 million people displaced across the country.
The Somalia Relief and Recovery Project-SRRP's main goal was to address the most urgent and basic needs of drought-affected communities in Bari, Galgaduud, Lower Juba, Mudug, Sanaag, Hiraan, and Sool regions that have been severely affected by the recurrent drought crisis. In particular, the project aimed to improve access to safe water and hygiene in drought-affected communities, provide temporary employment opportunities, deliver treatment services for acutely malnourished children and pregnant and lactating women, provide basic health services, and protection services. The project also aimed at improving coordination through the Somalia NGO consortium to a concert and coordinate efforts to adequately address the recurrent humanitarian challenges in Somalia. Read More...
The Somalia Relief and Recovery Project-SRRP's main goal was to address the most urgent and basic needs of drought-affected communities in Bari, Galgaduud, Lower Juba, Mudug, Sanaag, Hiraan, and Sool regions that have been severely affected by the recurrent drought crisis. In particular, the project aimed to improve access to safe water and hygiene in drought-affected communities, provide temporary employment opportunities, deliver treatment services for acutely malnourished children and pregnant and lactating women, provide basic health services, and protection services. The project also aimed at improving coordination through the Somalia NGO consortium to a concert and coordinate efforts to adequately address the recurrent humanitarian challenges in Somalia. Read More...
END LINE REVIEW FOR HBCC PROJECT: INCLUSIVE COMMUNITIES: CHANGING BEHAVIORS TO RESPOND TO COVID-19
The end-line survey was commissioned by CARE International in Somalia to assess the overall change outcomes of the COVID-19 Hygiene Behavior Change Campaign as per the project’s theory of change and to identify key lessons learned for the campaign that could inform future strategies. The project was implemented through an extensive mass media, digital and interpersonal hygiene promotion information, and messaging campaign in communities and institutions supported by the provision of water supply and handwashing kits and infrastructure as well as provision of relevant Personal Protective Equipment-PPE, as per the context. Read More...
EMERGENCY FOOD SECURITY PROGRAM-EFSP II
This end-of-project evaluation study was carried out between August and September 2021. The overall purpose of the evaluation was to assess the extent to which the program had achieved its strategic objective of improved food security for drought-affected households in the target locations. This included the use of the OECD- DAC criteria, more specifically Relevance and Appropriateness, Efficiency and Effectiveness as well as the project’s impact on the community. Read More...
Somalia Resilience Program (SomRep) Endline Assessment
The Somalia Resilience Program (SomReP) is intended to enhance the resilience of vulnerable households and communities in Southern Somalia against cyclical shocks and stressors. SomReP is a consortium of seven international non-governmental organisations (INGOs). The program’s activities focus on improving livelihoods and increasing adaptive capacities of communities and households in Somalia.
On behalf of SomReP, Forcier Consulting is conducting Third Party Monitoring (TPM) of the program in two districts in South Central Somalia: Baidoa, Bay Region and Afgooye, Lower Shabelle Region. This document represents the initial main findings of the end line of the TPM. The end line report will report trends in program results after the program’s completion. Further, the status of the indicators will be compared to the baseline and midline values.
The data collection for this midline study was collected in August 2019. All data was collected, cleaned, and analysed by Forcier Consulting. Analyses compare midline and baseline data to end line results to identify trends among the results. This report follows the structure of the midline and baseline assessments, which was conducted by Forcier Consulting in 2017 and 2018.
A total of 1,590 program beneficiaries were surveyed, including 58% female and 42% male respondents. Respondents were sampled in urban/peri-urban, pastoral, agro-pastoral, and IDP livelihood zones. The vast majority of respondents were household heads, with an average age of 37 years. A large majority of participants had attended madrasa only (70%), and the average household size was 4.3 members.
Overall, the findings are positive for many program areas, however conditions varied over the period of the study; there was some recovery from the very severe 2016/2017 drought in 2018, but deterioration into 2019. These poor conditions created challenges for program beneficiaries. As a result, the analyses in the end line study show some mixed results. One limitation of the study is that the negative effects of the drought cannot be differentiated from the positive effects of the program. Read More...
On behalf of SomReP, Forcier Consulting is conducting Third Party Monitoring (TPM) of the program in two districts in South Central Somalia: Baidoa, Bay Region and Afgooye, Lower Shabelle Region. This document represents the initial main findings of the end line of the TPM. The end line report will report trends in program results after the program’s completion. Further, the status of the indicators will be compared to the baseline and midline values.
The data collection for this midline study was collected in August 2019. All data was collected, cleaned, and analysed by Forcier Consulting. Analyses compare midline and baseline data to end line results to identify trends among the results. This report follows the structure of the midline and baseline assessments, which was conducted by Forcier Consulting in 2017 and 2018.
A total of 1,590 program beneficiaries were surveyed, including 58% female and 42% male respondents. Respondents were sampled in urban/peri-urban, pastoral, agro-pastoral, and IDP livelihood zones. The vast majority of respondents were household heads, with an average age of 37 years. A large majority of participants had attended madrasa only (70%), and the average household size was 4.3 members.
Overall, the findings are positive for many program areas, however conditions varied over the period of the study; there was some recovery from the very severe 2016/2017 drought in 2018, but deterioration into 2019. These poor conditions created challenges for program beneficiaries. As a result, the analyses in the end line study show some mixed results. One limitation of the study is that the negative effects of the drought cannot be differentiated from the positive effects of the program. Read More...