Final evaluation CRS MALAWI WALA PROGRAM 2009-2014 Volume I – Main Report Wellness and Agriculture for Life Advancement (WALA) 2009-2014 A Title II MYAP Funded by USAID Food for Peace August 2014 This assessment was made possible by the support of the American People through the United States Agency for International Development (USAID), Office of Food for Peace (FFP). The contents of this report are the sole responsibility of the WALA program and do not necessarily reflect the views of USAID or the United States Government i Final Evaluation CRS Malawi WALA Program Acknowledgments The members of the final evaluation team wish to extend our gratitude to WALA program staff, CRS and other PVOs, and Government of Malawi officials for all the support received during the final evaluation conducted toward the end of 2013. All shared documentation and insights in an effort to ensure that the WALA final evaluation can account for its overall performance toward its donor and beneficiaries, as well as provide a valuable learning opportunity for all involved. While it is not possible to thank all individuals who have assisted, the Team is particularly grateful to Jayachandran Vasudevan (Head of M&E and Knowledge Management), who has been the focal person for the final evaluation team in almost all matters, starting from the design of quantitative survey instruments for the endline survey, qualitative tools for the final evaluation team’s visit to Malawi, sharing of program documentation, and the detailed planning and logistics serving the entire field visit. The final evaluation team would like to thank USAID/FFP staff in Washington and Pretoria, particularly the M&E team, for their technical assistance before, during and after the exercise. At the same time, we would also like to acknowledge the excellent support received from all PVOs, who worked tirelessly to accommodate the many requests for information and meetings from the final evaluation team. We also offer special thanks to the entire quantitative and qualitative teams fielded by CRS and TANGO International for their dedication and excellent work in collecting information. We are also indebted to the individuals and families who gave freely of their time and company to be interviewed by our teams. Without their generosity and openness in welcoming us into their homes and sharing invaluable information about their lives, this important review would not have been possible. We sincerely hope that our findings, conclusions, and recommendations enable WALA to fine-tune its exit strategy in the coming months and guide future proposals of integrated food security and nutrition programs in Malawi, starting with the next round of Title II programs in Malawi (2014-18). Finally, the team wants to acknowledge the important work conducted by two TANGO staff members: Lloyd Owen Banwart, who provided technical supervision to endline survey data collection and conducted processing and analysis and the quantitative bivariate and multivariate analysis related to the final evaluation, comparing baseline with endline results; and Monica Mueller, who has edited the main report and annexes. TANGO International final evaluation team Rene Verduijn, Team Leader Jeanne Downen Tamsin Walters John Wyeth ii Final Evaluation CRS Malawi WALA Program Table of Contents Executive Summary .................................................................................................................................................. vii 1. Introduction ....................................................................................................................................................... 1 2. Objectives and Methodology ......................................................................................................................... 1 2.1 Objectives of the Final Evaluation ............................................................................................................... 1 3. Overview of the Programmatic Context and Implementation .............................................................. 2 3.1 Vulnerability Context ..................................................................................................................................... 2 3.2 Program Description ...................................................................................................................................... 4 3.3 Targeting ........................................................................................................................................................... 5 3.4 WALA Implementation Experience ........................................................................................................... 8 4. Program Effectiveness .................................................................................................................................... 10 4.1 WALA Progress at Impact Level ............................................................................................................... 10 4.2 SO1 – MCHN ................................................................................................................................................ 16 Introduction ........................................................................................................................................................ 16 Performance ....................................................................................................................................................... 16 Sustainability ....................................................................................................................................................... 19 4.3 SO2 – AgNRM, Irrigation, Livestock and Fish Farming ....................................................................... 20 Introduction ........................................................................................................................................................ 20 Performance – AgNRM ................................................................................................................................... 20 Sustainability – AgNRM.................................................................................................................................... 24 Performance – Small-scale Irrigation ............................................................................................................ 24 Sustainability – Small-scale Irrigation ............................................................................................................ 26 Performance – Livestock and Fisheries ........................................................................................................ 26 Sustainability – Livestock and Fisheries ........................................................................................................ 27 Performance – Village Savings and Loans Groups ..................................................................................... 27 Sustainability – Village Savings and Loans Groups ..................................................................................... 31 Performance – Agribusiness ........................................................................................................................... 31 Sustainability – Agribusiness ........................................................................................................................... 35 4.4 SO3 – Disaster Risk Reduction ................................................................................................................. 35 Introduction ........................................................................................................................................................ 35 Performance – Community Mechanisms ..................................................................................................... 36 Sustainability – Community Mechanisms ..................................................................................................... 38 Performance – Safety Nets and FFW ........................................................................................................... 39 Sustainability – Safety Nets and FFW ........................................................................................................... 40 4.5 Cross-cutting Issues ..................................................................................................................................... 40 Good Governance ............................................................................................................................................ 40 Gender ................................................................................................................................................................. 41 Mainstreaming HIV/AIDS Considerations ................................................................................................... 42 Environmental Monitoring and Impact Mitigation ..................................................................................... 43 iii Final Evaluation CRS Malawi WALA Program 5. Program Processes ......................................................................................................................................... 44 5.1 Program Management .................................................................................................................................. 44 5.2 Staffing.............................................................................................................................................................. 45 5.3 Program Coordination ................................................................................................................................ 45 5.4 Knowledge Management ............................................................................................................................. 47 5.5 Monitoring and Evaluation .......................................................................................................................... 48 5.6 Partnerships .................................................................................................................................................... 49 5.7 Financial Management .................................................................................................................................. 49 5.8 Commodity Management ............................................................................................................................ 50 5.9 Monetization .................................................................................................................................................. 51 6. Evaluation Findings .......................................................................................................................................... 51 Findings SO1 – MCHN .................................................................................................................................... 51 Findings SO2 – AgNRM, Irrigation, Livestock and Fish Farming, VSL and Agribusiness .................. 52 Findings SO3 – Disaster Risk Reduction ..................................................................................................... 55 7. Conclusions and Recommendations .......................................................................................................... 55 Conclusions – SO1 MCHN ............................................................................................................................... 55 Recommendations – SO1 MCHN ................................................................................................................... 56 Conclusions – SO2 AgNRM, Irrigation, Livestock, Fisheries, VSL, and Agribusiness ......................... 56 Recommendations – SO2 AgNRM, Irrigation, Livestock, Fisheries, VSL, and Agribusiness .............. 58 Conclusions – SO3 Disaster Risk Reduction ................................................................................................ 59 Recommendations – SO3 Disaster Risk Reduction .................................................................................... 59 iv Final Evaluation CRS Malawi WALA Program List of Tables Table 1: WALA population-based indicators, baseline to endline comparison ........................................... x Table 2: WALA beneficiary summary as of November 2013 .......................................................................... 6 Table 3: WALA population-based indicators, baseline to end-line comparison ....................................... 12 Table 4: Strategic outcomes by first year of household engagement with WALA (WALA CBO households) ................................................................................................................................................................ 13 Table 5: Strategic outcome indicators by number of household WALA activities................................... 14 Table 6: SO1.1 outcome by WALA CBO groupa ............................................................................................. 15 Table 7: SO1.2 outcome by WALA CBO groupa ............................................................................................. 16 Table 8: SO1 activities in terms of Specific Objectives target numbers reached...................................... 17 Table 9: Overview of achievements in outcome indicators under SO2 (Agriculture): baseline versus endline ......................................................................................................................................................................... 21 Table 10: Overview of achievements in outcome indicators under SO2 Irrigation, comparing baseline versus endline values ................................................................................................................................................ 25 Table 11: Disaster risk reduction survey data analysis .................................................................................... 35 Table 12: Life of program budget data................................................................................................................. 50 List of Figures Figure 1: Current estimated food security outcomes, July 2012, per FEWS NET ..................................... 2 Figure 2: WALA program targeting of communities with multiple interventions ...................................... 5 Figure 3: Map of WALA program areas and implementing PVOs .................................................................. 6 Figure 4: First year of engagement for all WALA beneficiary households, by % of total, by year (2009- 2013) .............................................................................................................................................................................. 8 Figure 5: Household participation in specific WALA activities, as reported by respondents .................. 9 Figure 6: Household membership community-based organizations supported by WALA ..................... 10 Figure 7: Community-based Farmer Extension System ................................................................................... 22 Figure 8: Perception of shock preparedness relative to five years ago .......................................................37 Figure 9: WALA flowchart: WALA conceptual framework of critical linkages between program activities and by SO .................................................................................................................................................. 47 v Final Evaluation CRS Malawi WALA Program List of Acronyms ACA Agribusiness Community Agent ACPC Area Civil Protection Committee ADC Area Development Committee ADRA Adventist Development and Relief Agency AgNRM Agriculture and Natural Resource Management ARR Annual Results Report ASP Agribusiness Service Provider CA Conservation Agriculture CAHW Community Animal Health Worker CATCH Consortium Administration and Technical Capacity Hub CBO Community-Based Organization CCFLS Community Complementary Feeding and Learning Sessions CDSO Crude Degummed Soy Bean Oil CGV Care Group Volunteer C-MIS Consortium Management Information System CRS Catholic Relief Services C-SAFE Consortium for Southern Africa Food Security Emergency CSB Corn soy blend CSI Civil Society Index DAHLD Department of Animal Health and Livestock Development DCOP Deputy Chief of Party DCPC District Civil Protection Committee DRR Disaster Risk Reduction EASPM Economic Activity Selection, Planning, and Management EI Emmanuel International EPA Extension Planning Areas FANTA Food and Nutrition Technical Assistance FEF Farmer Extension Facilitator FFA Food for Assets FFP Food for Peace FFW Food for Work FGD Focus Group Discussion FISP Farm Input Subsidy Program GDP Gross Domestic Product GMP Growth Monitoring and Promotion GNI Gross National Income GoM Government of Malawi GVH Group Village Head HAS Health Surveillance Assistant HDDS Household Dietary Diversity Score HHN Health, Hygiene, and Nutrition HP Health Promoter HSA Health Surveillance Assistant IEC Information, Education, and Communication IEE Initial Environmental Examination I-LIFE Improving Livelihoods through Increasing Food Security IMPACT Positive Action for Community Transformation IPC Integrated Phase Classification IPTT Indicator Performance Tracking Table IR Intermediate Results ITT Indicator Tracking Table IYCF Infant and Young Child Feeding KII Key Informant Interview LOA Life of Activity M&E Monitoring and Evaluation vi Final Evaluation CRS Malawi WALA Program MCHN Maternal and Child Health and Nutrition MDG Millennium Development Goals MDHS Malawi Demographic and Health Survey MoAFS Ministry of Agriculture and Food Security MoH Ministry of Health MoAHFP Months of Adequate Household Food Provisioning MTE Midterm Evaluation MYAP Multi-Year Assistance Program NAC National Aquaculture Centre NGO Non-governmental Organization NRM Natural Resource Management OVC Orphans and Vulnerable Children PCI Project Concern International PG Producer Group PHHS Post-Harvest Handling and Storage PSP Private Sector Providers PVO Private Voluntary Organizations RFA Request for Application SUN Scaling Up Nutrition SFP Supplementary Feeding Program SO Strategic Objective TA Traditional Authority TLC Total Land Care TOT Training-of-Trainers TQC Technical Quality Coordinator TWG Technical Working Group U5 Under five (years of age) VCPC Village Civil Protection Committee VDC Village Development Committee VHC Village Health Committee VSL Village Savings and Loans WALA Wellness and Agriculture for Life Advancement WDC Watershed Development Committee WILA Water for Irrigation and Life Advancement WMC Water Management Committee WOTR Watershed Organization Trust WVI World Vision International vii Final Evaluation CRS Malawi WALA Program Executive Summary Introduction The Republic of Malawi is a landlocked country in southern Africa. The country has large freshwater resources and high agricultural potential. Climatic shocks affect the country frequently and constrain economic growth. As recently as 2004-2005, severe drought necessitated a costly humanitarian response to meet the basic food needs of an estimated 40 percent of the population. In recent years, lack of crop diversification, poor yields, and dependence on rain-fed farming have been key factors in the deterioration of the food security situation. High population growth (over three percent) further contributes to increasing pressure for poor households to cultivate marginal and less fertile lands, particularly in densely populated districts in the south where food insecurity is the worst. Smallholder, rain-fed maize production is the predominant agricultural activity and the livestock sub-sector remains underdeveloped. Furthermore, poverty is widespread in the predominantly rural population. Catholic Relief Services (CRS) Malawi began implementation of the Wellness and Agriculture for Life Advancement (WALA) program in July 2009, with an ending date of June 2014. This five-year USAID-funded PL480 Title II program is through Food for Peace (FFP) and implemented in the eight most food insecure districts in the south of Malawi. WALA is implemented by a consortium of nine Private Voluntary Organizations (PVOs) led by CRS Malawi as the grant holder. The seven implementing PVOs are Africare, Chikwawa Diocese, Emmanuel International, Project Concern International, Save the Children, Total Land Care, and World Vision International. Another partner, ACDI-VOCA, provides technical support on agribusiness. TANGO International, Inc., a consulting firm based in Tucson, Arizona, USA, was contracted to conduct the final evaluation. The primary purpose of the final evaluation is to assess the program’s overall performance under each of its specific Strategic Objectives (SOs). The evaluation took place during the fourth quarter of 2013, i.e., the second quarter of Year 5 of the program. Objectives of the Final Evaluation The objective of the final evaluation is to assess the impact of WALA program strategies and interventions implemented since June 2009 in achieving its three SOs and related intermediate results (IRs) in eight districts in southern Malawi. The evaluation assessed the program results and how program management and implementation affected and/or supported program achievements. This evaluation will inform future FFP and USAID development programming in Malawi. The specific objectives were to: 1. Carry out a comparative analysis (bivariate and multivariate) of baseline and endline surveys1 to assess the changes in the indicators (program result) as outlined in the indicator performance tracking table (IPTT); 2. Identify program strategies, structures, systems and interventions that contributed to or impeded the achievement of intended results of program interventions and links between inputs and results with gender focus; 3. Assess the effectiveness and efficiency of technical, managerial and resource management strategies; 4. Assess progress made in responding to the midterm evaluation recommendations 5. Assess the synergy between various WALA program components including linkages with Government of Malawi (GoM) and other development programs, and how the linkages enhance the program performance; 6. Assess the sustainability of the program outcomes; 1 Baseline and endline survey reports and data sets will be made available, and these surveys were designed and implemented according to the FANTA/FFP guidelines. viii Final Evaluation CRS Malawi WALA Program 7. List the major successes and challenges faced by the WALA program and how well these challenges were addressed; 8. Extract and report on lessons learned to inform future FFP program designs; 9. Make specific recommendations on improving strategies and program interventions for future programming and/or scale-up. Design and Objectives WALA is a five-year Title II Multi-Year Assistance Program (MYAP) funded by USAID to prevent and mitigate food insecurity in southern Malawi. WALA targets the most vulnerable communities and households, ensuring holistic provision of services to the selected groups. In the original design, targeted groups comprise households that have the following attributes: small and marginal farms, female-headed, host chronically ill persons (tuberculosis and HIV/AIDS), food insecure, and/or host orphans. WALA is implemented in the eight most food insecure districts of southern Malawi: Nsanje, Chikwawa, Thyolo, Mulanje, Zomba, Machinga, Chiradzulu and Balaka. CRS Malawi, through the Consortium Administration and Technical Capacity Hub (CATCH), has led the management and implementation of the program. Goal: The goal of WALA is to improve the food security of 214,974 chronically food insecure households in 39 Traditional Authorities (TAs) in eight districts in southern Malawi by 2014 through strategic objectives in maternal and child health and nutrition (SO1); agriculture, natural resource management, irrigation, and economic activity (SO2); and disaster risk reduction (SO3). Each SO and its main corresponding activities are listed below. SO1: Maternal and Child Health and Nutrition (MCHN) Target: 170,724 vulnerable households have improved MCHN status. Main activities:  Application of the Care Group model, a community-based health service provision strategy employed to increase the coverage and quality of health and nutrition services. All health and nutrition interventions below are implemented through this model.  The Community Complementary Feeding and Learning Sessions approach is used to enhance the nutritional skills of mothers of children under five and pregnant and lactating women.  Strengthening of the Ministry of Health (MoH) through capacity building, provision of resources, and collaboration in key activities.  Strengthening the capacity of community-based organizations (CBOs2) to undertake and sustain development activities, such as village health committees. SO2: Agriculture, Natural Resource Management (AgNRM), Irrigation, and Economic Activity Target: 147,500 smallholder farming households have improved livelihood status. Main activities:  Formation of farmer groups or producer groups.  Demonstration sites approach used to enhance agricultural production and promote improved farming practices, e.g., crop diversification, and watershed management.  Small-scale irrigation, focusing on high-quality, nutritious crops, has been scaled up and integrated with other WALA components. Stream diversions for gravity systems and shallow wells for treadle pump systems are commonly utilized.  Village Savings and Loans (VSLs) have been employed to increase household incomes and facilitate linkages with micro-enterprises in order to boost economic development.  Farming as a business has been promoted through agribusiness groups by strengthening linkages between small-scale farmers and the private sector and helping farmers to take part in collective marketing. 2 In this report, the term CBO is used to indicate any operational groups or formations often established and supported by the program in WALA Group Village Heads (GVH) and communities. ix Final Evaluation CRS Malawi WALA Program  Formation of livestock groups to boost the number of households with livestock including goat, pig, chicken, and fish.  Strengthening the capacity of CBOs to undertake and sustain development activities, such as formation of water users committees and marketing clubs. SO3: Disaster Risk Reduction (DRR) Target: 273 targeted communities have improved capacity to withstand shocks and stresses. Main activities:  Food safety net: provision of food aid to chronically ill beneficiaries who are targeted for other WALA interventions.  Empowerment of communities on DRR and mitigation.  Good governance elements such as the Participatory Planning, Monitoring and Evaluation exercises, and conflict management.  Strengthening the capacity of local governance structures such as Village Civil Protection Committees (VCPC) and Area Civil Protection Committees. The program has a number of crosscutting themes that include:  Expanded knowledge management.  Mainstreaming of HIV/AIDS into all WALA key activities.  Gender mainstreaming in all key WALA activities.  Environmental protection. Main Evaluation Questions: Findings IMPACT To what extent did the program achieve the intended goal, objectives and results? Title II programs typically combine strategies to improve maternal, child health, and nutrition status; improve livelihood status, to build up assets and strengthen resilience; and improve capacities of communities to withstand shocks and stresses (e.g., through DRR). Table 1 compares baseline and endline survey values for program population-based indicators, indicating percent change and whether or not the observed change is statistically significant. x Final Evaluation CRS Malawi WALA Program Table 1: WALA population-based indicators, baseline to endline comparison IPTT REF No Indicators 2009 Baseline Survey 2013 Target 2013 End-line Survey End-line Confidence Interval 2009 to 2013 Lower Upper Difference SO1: 170,724 vulnerable households have improved maternal and child health, and nutrition status 1.1 % stunted (HAZ < -2) children 6-59 months of age (Impact) 42.4% 36.0% 37.1% 34.9% 39.3% -5.3*** 1.2 % underweight (WAZ < -2) children 0-59 months of (Impact) 17.6% 16.0% 11.3% 9.9% 12.7% -6.3*** 1.3 % of children aged 0-59 months in Growth Monitoring and Promotion (GMP) gaining weight in past 3 months (Impact) 59.6% 75.0% 72.2% 67.7% 76.7% 12.6*** SO 2: 147,500 smallholder farming households have improved livelihood status 2.1 Average months of adequate household food provisioning (Impact) 9.35 11 9.36 9.3 9.5 0.01 2.2 Average household Dietary Diversity Score (HDDS) (Impact) 4.29 9 4.5 4.4 4.6 0.21*** SO3: 273 targeted communities have improved capacity to withstand shocks and stresses 3.1 % of household reported losses of livelihood assets due to shocks and stresses (Impact) (Population) (WALA) (GoM – MoAFS) 7.8% 8.0% 6.8% 5.9% 7.8% -1.0 ***p<0.01, **p<0.05, *p<0.10, statistically different than the 2009 baseline point estimate xi Final Evaluation CRS Malawi WALA Program Improved Nutritional Status Anthropometric measurements of children under five are considered a proxy for the nutritional status of the entire population. The quantitative data clearly show a marked improvement in chronic malnutrition and in underweight over the program period, with the target for underweight (11 percent) surpassed and that for HAZ (37 percent) almost achieved. This compares positively with the picture at national level: in the last Malawi Demographic and Health Survey (MDHS) (2010), chronic malnutrition (HAZ) was estimated at 47 percent and underweight at 13 percent. Household Food Access Household food access is defined by USAID as the ability to acquire sufficient quality and quantity of food to meet all household members’ nutritional requirements for productive lives. There are proxy measures of quantitative and qualitative aspects of food requirements. Both population-based indicators – household dietary diversity score (HDDS) and months of adequate household food provisioning (MoAHFP) – focus on the desired outcome of improved food access: improved household food consumption. Progress on both of these indicators between baseline and endline has been limited. The HDDS improvement was statistically significant – although well below target – while MoAHFP did not improve. It is important to note that the program, and the whole of Malawi for that matter, suffered two major shocks and stresses in 2012 (continuing into 2013). These incidents may help to explain these results as they had significant implications for people’s ability to access food. The shock is related to the economic crisis, which saw price inflation in key producer and consumer goods after the 50 percent devaluation of the Malawian Kwacha (MWK) in May 2012. The April 2013 Malawi Price Bulletin from FEWS Net shows maize prices at markets throughout the country considerably higher for the 2012/2013 season (more than 300% higher in some markets) compared to the previous year and the five-year average. The stress is related to lack of and erratic rainfalls, which meant that farmers saw production fall for their main crops. In August 2013, FEWS Net reported increased food insecurity due to reduced crop yields because of a combination of flooding, prolonged dry spells and early cessation of rainfall during the 2012/2013 season and decreased production in the coming months. It is unfortunate that no data are available for individual years to be able to ascertain whether there is a trend, but it can be safely assumed that purchasing power has since significantly deteriorated (see also Section 3.1 comparing Gross National Income (GNI) data 2009-2013). It is important to consider that without WALA interventions, the negative impacts of these shocks and stresses on household food consumption could have been far worse, as suggested by endline data: for example, WALA households have an HDDS of 4.8 while non-WALA households have a HDDS of 3.9; similarly, WALA households have 9.5 months of adequate food provisioning compared to 9.1 months for non-WALA households. How have WALA program activities improved the ability of program beneficiary households and communities to be able to mitigate, adapt to and recover from food security shocks and stresses? Progress on the program’s last population-based indicator (percentage of household reported losses of livelihood assets due to shocks and stresses) has been positive despite effects of the economic and climatic setbacks in 2012. This SO received approximately one-third of the WALA agriculture and health sector funding. WALA households report that they are better prepared for shocks because of increased savings (31.2 percent) and increased household assets (30.1 percent) relative to when the program began, compared to 20 percent of non-WALA households in both categories. WALA uses a livelihoods framework and has incorporated into its design all three resilience capacities (i.e., absorptive, adaptive, and transformative). Thus, while the impact of WALA support may not yet be fully realized, the large investments made in capacity development of CBOs, community volunteers and facilitators and individual recipients of training and technical support are likely to lead to future benefits and increased resilience capacities. xii Final Evaluation CRS Malawi WALA Program BENEFICIARY SATISFACTION How satisfied were beneficiaries with the program? The interviews conducted with CATCH, PVOs, and beneficiaries in the field showed general satisfaction with the program. The immediate benefits to beneficiary households have been palpable under all SOs. These include the agricultural inputs, Food for Work (FFW), and safety nets for vulnerable groups (25,000 beneficiaries); technical support; and the establishment and strengthening of CBOs, which have obtained better prices for most participating farmers through collective purchasing of inputs and selling of outputs. There was also almost universal satisfaction with the VSL program, and general satisfaction with collective marketing experience. The comprehensive approach of Title II programs – focusing on all aspects of health, hygiene, nutrition, food production and marketing, and DRR has clearly changed many households’ livelihoods for the better. The program’s main emphasis on skills transfer rather than handouts received criticism from some. It was observed that the safety net program was relatively small and could have been larger, particularly given the observed economic shock and drought conditions. Vulnerable households with chronically ill and orphans and vulnerable children (OVC) may not have benefitted as much as others from skills transfer activities due to multiple demands on their limited time and labor. RELEVANCE How relevant were program activities and beneficiary targeting, considering the needs of the target population? The mission found that the Title II program design – a combination of MCHN, livelihood support, and DRR appropriate to the needs of the entire population – extended beyond the original target of assisting only chronically food insecure and very poor households. Most of the program is in technical support – without many free inputs – in Community Complementary Feeding and Learning Sessions (CCFLS), Care Groups and agriculture. This fits a self-selection approach that invites all who are willing to learn. In the future, it may be necessary to take specific account of the special needs of the very poorest and the most remote, tailoring approaches to these groups, and using other approaches with those who are not quite so disadvantaged. Special attention may be required on monitoring the very poorest groups supported by these program activities in their advances along a development pathway, from being dependent on safety nets to being included in CBOs focused on productive means (such as producer groups). The pressure on land and vegetation by a large and growing population is an important factor that requires intensifying agricultural production while promoting local action for environmental protection. All activities promoted by WALA are thus relevant and appropriate for this context, including MCHN, agricultural production (Conservation Agriculture (CA)), post-harvest handling and storage, and collective marketing. All programs were developed together with, and were approved by the GoM. Implementation was conducted in close coordination with relevant ministries (e.g., Ministry of Agriculture and Food Security and Ministry of Health). EFFECTIVENESS How effective were program activities and implementation? Both the quantitative and qualitative data provide evidence of an overall effective program, although there was indication of some variation in performance on the ground. The final evaluation team attributes this variation to the following factors:  Use of a volunteer extension system that generally lacks in-depth support, and where the success of on-the-job training depends very much on 1) the motivation and ability of individuals and 2) the support given by Farmer Extension Facilitators (FEFs) to lead farmers, and by Health Promoters (HPs) to Community Group Volunteers (CGVs);  A self-help approach that is not popular with poor and very poor households – for some, due to lack of household members who are able to take advantage of program offerings; xiii Final Evaluation CRS Malawi WALA Program  The gradual rollout of the program, which meant that communities were in different stages of implementation;  Different PVO capacities, with differences in remuneration packages and, most importantly, differences in ratios of staff versus volunteers versus beneficiaries. Successful implementation of the WALA model was usually observed in those communities that had frequent and consistent technical support over a three-year period, with implementation starting in the first two years of the program cycle. Based on baseline-endline comparisons and confirmed by observations and interviews in the field, non-WALA households generally saw smaller improvements in particular areas than WALA households. The program design uses a volunteer extension system (through the Care Group and producer group models). This is an excellent strategy because it utilizes volunteers who work with their own communities and contribute to the sustainability of outcomes by retaining and passing on the knowledge and experience they have gained. However, it is clear that training needs to be on-going, with messages – especially complex ones – continually refreshed and revisited if the volunteers are to remain a useful resource for their community over the long term. The final evaluation team considers that insufficient resources have been made available to training and extension material to empower the agriculture volunteers. Moreover, volunteers’ contributions – for five years in a row – should receive even more recognition in future programs through certificates and program identification items such as T-shirts, bags, umbrellas, etc. It is planned that WALA will provide certificates to HPs before program end, and this may extend to CGVs. COORDINATION How well did the program coordinate with other food security and humanitarian programming, with the host country government and with the donor? The final evaluation team finds that WALA has overall provided a good example of program implementation through a partnership model. Partners include eight PVOs, CATCH, GoM, and USAID. Coordination and communication with other programs (some of which are similar in design) has been mostly through government-led sectoral committees, which have enabled the harmonization of extension approaches. The program (mainly through CATCH but also individual PVOs) has coordinated its work well with the GoM, particularly at sub-national level: the location of CATCH outside the capital has reduced its potential reach and impact at the national level. However, excellent examples of collaboration with GoM include the collaboration on national guidelines for the sector in Conservation Agriculture (to be adopted before end of the program) and Community Animal Health Working Training Manual. In addition, WALA nutritionists have played an integral role in development of the Scaling Up Nutrition (SUN) strategy for Malawi, providing technical support and sensitizing the MoH on the Care Group model. SUSTAINABILITY How sustainable are program outcomes? The program has invested significantly in the establishment of, and technical and management support to, various CBOs. Some of these have good chances to be sustained over time. Examples include the Water User Committees, Watershed Development Committees, VSL groups, and VCPCs in areas frequently impacted by natural shocks (e.g., floods). Others that are likely to be sustained over time include VSL groups and (possibly to a lesser extent) marketing clubs, where immediate benefits are to be expected. The outcomes in MCHN and AgNRM depend largely on a system of volunteers, supervised by more highly qualified and trained community members who usually receive stipends. Without this supervision, it is uncertain that many of these Care Groups or producer groups will continue to operate. On the other hand, some xiv Final Evaluation CRS Malawi WALA Program level of sustainability was built in from the start, as these volunteers come from – and will stay in – their own communities. The absence of good reference material for AgNRM will reduce the effectiveness of demonstration to additional smallholder farmers that would enable wider adoption of new technologies. Much of the infrastructure built under irrigation, watershed development and roads activities will be sustained for some time, particularly the structures that are linked to the CBOs, which can organize the community to maintain and repair them. Finally, WALA is part of a broad effort to improve food security among poor and very poor households in southern Malawi. Programs with a similar design focusing on livelihoods and/or food security and nutrition have been implemented and are likely to be implemented in the future. As such, it is likely that a number of the WALA beneficiary households will receive some level of support in similar areas (e.g., MCHN, CA and VSL) in the future. What exit strategies were incorporated into program design and what strategies were implemented? Since the Midterm Evaluation (MTE), the program has prioritized and incorporated exit strategies into all components. Discussions with various beneficiary communities and partners have been conducted to generate exit plans. The GoM is rightly seen as a key partner to engage with for improving opportunities for continued support. WALA has engaged with the GoM from the start but the capacity of GoM to take over delivery of activities is limited. One example where partnership has worked is under SO2: some FEFs have agreed to continue as lead farmers in the national agricultural extension system. WALA has specifically targeted some of the volunteers and retrained them as private service providers (e.g., Community Animal Health Workers). This provides them with income-generating opportunities that will give them an incentive to continue their work after the end of the program. CROSS-CUTTING ISSUES How well were gender considerations integrated into program design and implementation? WALA has had a gender strategy in place since the start of the program and has since produced guidance for each sector. However, the gender strategy does not include an in-depth contextual analysis of the situation specific to Malawi or the districts in which WALA is working. WALA’s operational areas are varied and cover patrilineal, matrilineal, as well as both Muslim and Christian societies. A more comprehensive understanding of some of the important cultural differences between these groups in terms of gender could usefully inform program design and development. However, “WALA was designed to ensure a greater role and involvement of women in economically productive activities and male involvement in health” (ARR FY13), and in terms of this limited goal, it has been successful. How were HIV/AIDS and environmental issues addressed? Mainstreaming HIV/AIDS Overall, HIV/AIDS programming is mainstreamed well in MCHN activities and taken into consideration in SO2 and SO3 activities. WALA staff (SO1) work very closely with Positive Action for Community Transformation (IMPACT), with PVO staff usually sharing the same office space and coordinating well on promotional activities such as Community Health Days. In the majority of districts, health promoters make regular visits to HIV support groups to talk about nutrition and the importance of antiretroviral therapy, preventing mother-to-child transmission, growth monitoring and promotion for children and positive healthy living. They often work alongside clients and encourage members of HIV support groups to join WALA activities such as VSL and home gardens. xv Final Evaluation CRS Malawi WALA Program Referrals are made between HIV support groups and CGs. CGVs provide home follow-up to those affected by HIV and AIDS. In particular, the CG support and attention to growth faltering assists in early identification of children with HIV who need enhanced nutritional support and health care. In terms of SO2, many aspects of conservation agriculture promoted by WALA are sensitive to the needs of people living with HIV, such as the minimum tillage and soil cover practices, which save hard labor and time in the field. In addition, intercropping and homestead gardens under the program support this population by providing foods that are more nutritious. Under SO3, training in initial assessment to identify hazards, and interventions for preventing or reducing the impact of disasters, incorporates information on the effects of disasters on handicapped, ill, elderly, and other vulnerable people and how to mitigate negative impacts for these populations. The safety net program is specifically targeted to the chronically ill, elderly or those caring for OVCs. However, the evaluation found that the most highly vulnerable households appear to be less able to take advantage of group activities that are meant to facilitate transition out of safety nets support into more sustainable livelihoods. Environmental Monitoring and Impact Mitigation Overall, the program has performed very well on monitoring environmental impacts identified during the Initial Environmental Examination, as observed by the MTE and the final evaluation team. Relevant WALA activities include: (1) promotion of fuel-efficient stoves that emit less smoke; (2) watershed development; (3) mitigation measures in irrigation schemes; (4) applying water-catchment protection principles; (5) promotion of CA to reduce soil erosion and improve soil organic matter content; and (6) promotion of environmental protection measures by VCPCs. Lessons Learned Design/ implementation: Title II programs are comprehensive MCHN, household food security and DRR programs that typically target a large number of beneficiaries. WALA is no exception to this. This implies that implementation modalities for reaching beneficiaries should be fairly simple and straightforward. WALA has depended largely on community volunteers for delivery of various technical services to the final beneficiary. Future programs should be aware that sufficient extension materials should be made available at this level to maximize opportunities for success, and that sufficient incentives are needed to incentivize volunteers to undertake the work conscientiously for a number of years. It is clear that extension module development needs to be prioritized early (e.g., five modules plus sessions on Supplemental Feeding Program and CCFLS) so that rollout is smooth and on time and does not cause lengthy delays in implementation. Moreover, the design and conduct of various training programs through a training-of-trainers system takes additional time. Hygiene and sanitation interventions should include the entire community, as they are not specific to pregnant and lactating women and families with children under five, and given the role of men as decision-makers in communities (whether or not they are direct program beneficiaries). Improved orientation and engagement of village heads and Village Health Committees in these activities might lead to greater adoption of behavior changes across the community. The new MoH/SUN Care Groups (CLANS) will aim to engage the entire community in each targeted village, including youth, who are the parents of the future. As to the AgNRM interventions, WALA should focus on fewer innovations and provide more in￾depth support to their adoption. The design should be kept simple with focus on an extension program. Consideration should be given to allowing the communities some power of choice over which technologies they favor in order to increase chances for success with the chosen technologies. Program Management: CATCH is a central support structure overseeing and guiding the xvi Final Evaluation CRS Malawi WALA Program implementation of a standardized approach; it constitutes a separate administrative and management entity responsive to the donor, distinct from the CRS country office. This novel approach for Malawi has been considered a success and may be considered for future programs with several PVOs. Similarly, it has proven beneficial to the group that the technical leads are together in CATCH (in Blantyre), in close proximity to the field, which facilitates frequent face-to-face interaction between CATCH, PVOs, and partners such as the GoM. Staffing: Frequent staff turnover has been a problem for WALA, in part due to the highly competitive labor market within Malawi and between development partners. The following lessons learned should be considered for future success: (1) a central recruitment function for CATCH staff would have aided efficiency in staffing; from the start (2) retention schemes should be implemented early in the program; (3) the outsourcing of technical support to service providers (such as with the irrigation component) may be more efficient/ effective than recruitment of individual experts. Monitoring and Evaluation (M&E): WALA did a very good job of designing and implementing an M & E system that tracked the quantitative indicators and provided the financial accountability requested by the donor. It also developed additional indicators to address qualitative issues, but they were not implemented in a way that provided systematic documentation of program quality. Given the donor’s emphasis on tracking quantitative outputs and financial accountability, the emphasis on quantitative monitoring is understandable. On the other hand, monitoring program quality – including systematic documentation of what worked and how well, and what did not work – is vital because the depth and quality of interventions is crucial in determining sustainability of results. Systematic performance monitoring of quality, and building learning platforms for exchange with other programs (inside and outside USAID) should be a priority. Summary Conclusions and Recommendations Conclusions – SO1 MCHN  SO1 was effective in offering a preventative approach to under nutrition while including responsive components (CCFLS and SFP) for children whose nutritional status is deteriorating.  Key to its success has been the extended reach of the community-based Care Group implementation model, with knowledge, resources, and services accessible to all pregnant women and caregivers of under-5 children in the community. The focus on demonstration in CCFLS, on stoves, on hygiene and sanitation infrastructure, and the promotion of community￾based GMP, are strong positive elements.  Leadership for implementation has been largely delegated to health promoters and CGVs based in their own communities, which has contributed to community ownership and sustainability. WALA has greatly assisted the outreach capacity of the MOH.  Nevertheless, the quantitative data suggest that the Care Group model may still have some way to go before it will achieve “saturation coverage” in WALA program areas.  Engagement with the district-level MOH has been strong, but varies at field level. This is largely attributed to WALA’s broad geographical reach, combined with a lack of financial resources and time to train and incorporate all HSAs in the program areas or extend orientation to VHCs.  The MCHN sector has had inadequate responsibility for ensuring strong performance of SFP within WALA, and this activity, largely delegated to the commodities team for oversight of food distribution, has been poorly structured and implemented. Recommendations – SO1 MCHN  PVOs should start in all sites in the first two years rather than use phased expansion. This would enable consistent rollout of modules, provide sufficient time to adopt behavior changes, and facilitate Care Group graduation and MOH-supported handover in Year 5.  Greater engagement of the MOH should be sought from the start of the program to ensure ownership, inclusion of HSAs/ VHCs in activities and training, and effective and timely handover. xvii Final Evaluation CRS Malawi WALA Program  Availability of water for hygiene, sanitation, and kitchen gardens and safe water for household consumption were emphasized as key constraints to program implementation and impact. A future program should incorporate interventions to improve access to safe water.  WALA should assume greater responsibility for providing technical support to the MOH in SFP, as well as ensure effective performance monitoring of sites where it is distributing SFP food. Ideally, oil and CSB should be pre-mixed prior to distribution to ensure the child receives the correct ration and that oil is not diverted into the household pot.  CGVs should be recognized for their work and commitment and rewarded with small incentives over the course of the program, including bags, occasional drinks at meetings, and certificates. Conclusions – SO2 Agriculture and Natural Resource Management, Irrigation, Livestock and Fish Farming  The package of WALA interventions, such as promoting improved seed varieties, crop cultivation and soil conservation technologies linked to CA, is relevant and appropriate, while there is a clear limitation to its expansion based on shortage of feeder and mulching material.  The AgNRM component started during the first year but did not progress well due to TQC changes. As a consequence, PVOs initially lacked strategic guidance.  The sheer breadth of AgNRM activities to implement has stretched WALA’s capacity on the ground, which reduced potential impacts on program targets.  The volunteer extension system is an excellent strategy but WALA has not invested enough in training and IEC material for volunteers, which has led to an inability to maximize opportunities for knowledge transfer and adoption of promoted technologies and behaviors.  Equity is an issue with different support packages provided to different WALA communities and households.  Results are mixed. Some progress has been made in areas such as irrigation and the adoption of new technologies, but their contribution to overall food security status is limited. The 2012 crop failures in southern Malawi and the economic crisis likely had a significant effect on the results.  Behavior change has been slow, particularly the adoption of certain promoted CA technologies.  Staff changes at CATCH and PVO, including changes to TQCs, have negatively affected the rollout and coherent vision for program priorities.  Lead farmers, who are volunteers, have received too little support from WALA to become real agents of change benefitting other smallholder farmers.  Technical manuals have been produced but simple extension tools to help the learning process on the ground (posters, leaflets, drawings) are missing.  A lack of inputs after the first year may have led to a decrease in the effective use of demo plots. The use of demo plots is a practical solution for engaging volunteers, although it leads to decreased visibility of promoted technologies. Recommendations – SO2 Agriculture and Natural Resource Management, Irrigation, Livestock and Fish Farming  WALA should focus on fewer innovations and provide more in-depth support to their adoption. The design should be kept simple, focused on extension and communities should be allowed some choice over technologies.  In addition to site-specific irrigation technologies, WALA should consider other technologies such as drip irrigation and garden sacks.  A workshop is suggested to discuss the impact and sustainability of various WALA models to enable future Title II programs that build on experiences and lessons learned from WALA.  It should become a priority to develop extension material (e.g., simplified messages from the CAHW training manual) for the next phase of Title II programs, or by the GoM.  Outsourcing of essential technical backstopping (similar to support provided under Agricane) may be considered if dependence on individuals becomes a risk to achieving results. xviii Final Evaluation CRS Malawi WALA Program Conclusions – SO2 VSL and Agribusiness VSL  VSLs are popular and successful, and most targets have been met or almost met.  The target number of men in groups has not been met. However, men are interested in the VSLs and their absence from meetings does not detract from its reach or effectiveness.  PSPs are providing a needed service. The system should ensure that the PSPs remain motivated to continue and expand their work with the groups and be motivated to start new groups.  Networks have been established, but will need some kind of technical backstopping in the future.  The very poorest households, which are supposed to be a focus of the program, may not be able to benefit from this activity even though the value of shares is already very low in some VSLs. Agribusiness  The agribusiness activities have made an important contribution to the income of participating farmers in terms of improved prices from collective marketing and reduced costs through collective purchase of inputs.  The proportion of group member farmers participating in collective marketing is a little lower than targeted but the final evaluation team does not consider this a serious issue. Collective marketing is less successful in remote areas.  Some of the collective marketing disappointments have helped farmers appreciate the risks involved in working with the market and the need for caution when dealing with buyers.  In general, caution needs to be exercised when creating expectations amongst farmers. Where risks are involved, they need to be made clear.  It would have been preferable if WALA had included a greater number of buyers in its activities so it could reduce reliance on those few with whom it had built relationships. Recommendations – SO2 VSL and Agribusiness VSL  The program should follow up on leads to establish long-term technical backstopping for the VSL PSP networks.  It may be appropriate to remind some of the VSL groups as to why some best practices, such as maximum individual loan amounts, are recommended, and encourage them to be followed. Agribusiness  WALA should continue to work to find an entity that can organize the marketing fairs in future.  WALA should continue to work hard to train the ASPs and ensure their comfort within their scope of work and their income-earning activities before the withdrawal of the program. Conclusions – SO3 Disaster Risk Reduction  WALA’s focus on DRR is highly appropriate, given frequent disasters that are major contributors to chronic food insecurity and persistent poverty in southern Malawi.  Overall, WALA has performed well under SO 3. The program has built community capacity in disaster preparedness and response, strengthened linkages among GoM DRR mechanisms, provided reliable safety nets to the most vulnerable households, and has facilitated the construction of infrastructure that has positive economic and environmental impacts.  The delayed start to DRR activities means that many VCPC groups have not had adequate time to build strong capacity or to change the perspective on DRR in their communities.  Sustainability of WALA-supported VCPCs depends in part on continuing support from the GoM. The new national DRR policy provides funding for preparedness and response and WALA VCPCs should be well positioned to take advantage of the small grants scheme under the new policy.  The poorest households and most vulnerable households may find it difficult to find the time to broaden their participation in other WALA activities as intended without additional support. xix Final Evaluation CRS Malawi WALA Program  The FFW activities are appropriate and play an important complementary role in DRR and in improving productivity in communities.  The combination of defined criteria for participation and community-based targeting that appears to work well in some of the communities, but does not appear to be applied by all communities. Recommendations – SO3 Disaster Risk Reduction  Prior to exit, ensure that VCPCs have the necessary skills to apply successfully to the small grants scheme that will be funded under the new national DRR policy.  Refresher training should help VCPCs find ways to identify and incorporate new information into their repertoire to maintain community interest in their message.  Keep DRR as an integrated activity but provide for a separate budget for training and community-based risk reduction activities, as well as training materials.  If funds are inadequate to carry out activities, focus on more disaster-prone areas.  Prior to program exit, increase the number of DRR training manuals provided to ACPCs. Safety Nets  The next program should consider significantly increasing the number of safety net beneficiaries, especially the chronically ill.  The program should consider additional technical and material support to safety net beneficiaries to help them take advantage of other program activities that will reduce their vulnerability. Food for Work  Work with FFW communities on formulating infrastructure maintenance plans that have an organized approach to maintenance, articulating roles, responsibilities, and a timetable, especially with regard to roads. 1 Final Evaluation CRS Malawi WALA Program 1. Introduction Catholic Relief Services (CRS) began implementing the Wellness and Agriculture for Life Advancement (WALA) program in July 2009. This five-year USAID-funded PL480 Title II program funded through Food for Peace (FFP) and implemented in the eight most food insecure districts in the south of Malawi will end by June 2014. WALA is implemented by a consortium of nine Private Voluntary Organizations (PVOs) led by CRS Malawi as the grant holder. The seven implementing PVOs are Africare, Chikwawa Diocese, Emmanuel International (EI), Project Concern International (PCI), Save the Children, Total Land Care (TLC),3 and World Vision International (WVI). Another partner, ACDI-VOCA, provides technical support on agribusiness. TANGO International, Inc., a consulting firm based in Tucson, Arizona, USA, has been contracted to conduct the final evaluation of the program. The primary purpose of the final evaluation is to assess the program’s overall performance under each of its specific Strategic Objectives (SOs). The evaluation took place during the fourth quarter of 2013, i.e., the second quarter of the fifth year of implementation. This report describes the background and context of the program; main objectives of the exercise; its methodology, which includes a quantitative endline survey and qualitative data collection; main findings regarding program achievements and challenges; and recommendations to be considered for future programs of similar scope. A compendium of annexes accompanies this narrative report. 2. Objectives and Methodology 2.1 Objectives of the Final Evaluation The objective of the final evaluation is to assess the impact of WALA program strategies and interventions implemented since June 2009 in achieving its three SOs and related intermediate results (IRs) in eight districts in southern Malawi. The evaluation assessed the results of program and how the program management and implementation affected and/or supported program achievements. This will inform future Food for Peace and USAID development programming in Malawi. The specific objectives were: 1. To carry out a comparative analysis (bivariate and multivariate) of baseline and endline surveys4 to assess the changes in the indicators (program result) as outlined in the indicator performance tracking table (IPTT); 2. To identify program strategies, structures, systems and interventions that contributed to or impeded the achievement of intended results of program interventions and links between inputs and results with gender focus; 3. To assess the effectiveness and efficiency of technical, managerial and resource management strategies; 4. To assess progress made in responding to the midterm evaluation recommendations 5. To assess the synergy between various WALA program components including linkages with Government of Malawi and other development programs (e.g., Positive Action for Community Transformation (IMPACT), Water for Irrigation for Life Advancement (WILA), MCHN+), and how the linkages enhance the program performance; 6. To assess the sustainability of the program outcomes; 7. To list the major successes and challenges faced by the WALA program and how well these challenges were addressed; 3 Replacing the Salvation Army from the original proposal. 4 Baseline and endline survey reports and data sets will be made available, and these surveys were designed and implemented according to the FANTA/FFP guidelines. 2 Final Evaluation CRS Malawi WALA Program 8. To extract and report on lessons learned to inform future Food for Peace program designs; 9. To make specific recommendations on improving strategies and program interventions for future programming and/or scale-up. Additional evaluation questions were included in the Scope of Work (Annex 2) and have been reworked in an evaluation matrix (Annex 3). These key questions were used for developing individual tools and protocols. Annex 4 provides a summary of responses to key questions. A matrix of key questions asked of key respondents is presented in Annex 5 followed by a schedule of key informant interviews and focus group discussions in Annex 6. Details on the evaluation approach, methodology, and study limitations are in Annex 7. 3. Overview of the Programmatic Context and Implementation 3.1 Vulnerability Context The Republic of Malawi is a landlocked country in Southern Africa. The country has large freshwater resources and high agricultural potential. Climatic shocks affect the country frequently and constrain economic growth. As recently as 2004-2005, severe drought resulted in a costly humanitarian response to meet the basic food needs of 40 percent of the population. Other challenges include high population density and growth, a single annual rainy season, and environmental degradation (e.g., soil degradation and deforestation). Lack of crop diversification, poor yields, and dependence on rain-fed farming are key factors in worsening food security in recent years. High population growth (over three percent, per current estimates of the National Statistics Office) further contributes to increasing pressure for poor households to cultivate marginal and less fertile lands, particularly in densely populated districts in the south where food insecurity is the worst. Smallholder rain-fed maize production is predominant and the livestock sub-sector remains underdeveloped. Poverty is widespread in the predominantly rural population. Small average landholdings and significant deforestation have also dramatically diminished Malawi’s soil productivity due to increasingly intensive cultivation and soil erosion. Climate change threatens to further exacerbate these factors. Deforestation linked to unsustainable use of biomass fuel and traditional agricultural land-use practices is eroding the country’s progress. Food Availability Between 2006 and 2010, the country experienced bumper crops for maize due to favorable climatic conditions, an expansion of areas under cultivation, and an input subsidy scheme that has reached a very large number of smallholder farmers (see text box on FISP, below). Malawi’s agriculture Gross Domestic Product (GDP) increased by six percent during those years. Key economic indicators, including inflation, tax rates, and domestic and external debt levels, have remained stable throughout this period (FTF 2011). The prevalence of undernourished in Malawi (the official Millennium Development Goal (MDG) 1 hunger indicator) has also seen a gradual decline over time, from 46 percent in 1992-1994 to 28 percent in 2003-2005 and 20 percent for 2011-2013. The country – and particularly the southern parts of Malawi – has seen worsening conditions since 2012. The FEWS Net-supported Integrated Phase Classification (IPC) maps provided in Annex 8 Figure 1: Current estimated food security outcomes, July 2012, per FEWS NET 3 Final Evaluation CRS Malawi WALA Program provide an overview of the food security conditions for the period when WALA has been operational (2009-2013).5 This time series shows levels of moderate food insecurity in some districts in the south throughout this period. The worst conditions seem to have started in 2012 (Figure 1), which saw large parts of the south with reduced harvests due to late and erratic rains. These “stressed”6 conditions are shown to have continued throughout 2013 as well. Conditions are expected to improve again with the next main harvest (from April 2014) based on good rains forecasted for the current rainy season. The IPC maps further indicate that without humanitarian assistance in the past two years the IPC classification would have deteriorated to the level of “crisis” (IPC Phase 3) for much of the south and for other parts of the country as well. The combination of less favorable weather conditions in 2012 coincided with the devaluation of the Kwacha by almost 50 percent and with GoM President Banda’s decision to decouple the currency from the US dollar in May 2012 to kick-start the Malawian economy. Subsequently, the costs for all essential goods rose dramatically due to increased prices for imports such as fuel. This has been a challenge for poor households that have limited scope for diversifying income opportunities. The deterioration in living standards is likely to have reduced any of the positive outcome and impact of the WALA program such as household food provisioning and people’s ability to purchase inputs such as improved seeds, fertilizer bags, and tools. Food Access As most smallholder farmers are dependent on rain-fed production and rainfall is erratic, 60 percent of farmers are dependent on food purchases in the market. While most stakeholders have seen FISP as generally very successful, the economic crisis has also had detrimental effects on the ability of the GoM to purchase inputs and reach out to farmers. The program decreased in size in recent years, with farmers having greater difficulties accessing agricultural inputs. This resulted in a below-average 2012 cereal and cash crop production in southern Malawi. Reduced crop production limits household food stocks and informal on- and off-farm labor opportunities (ganyu). Moreover, stricter border controls imposed on migration to Mozambique have also likely limited labor income further. The devaluation of the Kwacha in 2012 has resulted in high retail prices for maize, driven in part by the impact of currency devaluation. The southern region is particularly affected, as it is a deficit area that receives most of its food from central and northern Malawi. Therefore, transportation costs (which increased by more than 30 percent) play an important role in determining cereal prices (FEWSNET Web site 2013). The effects can be observed in Malawi’s Gross National Income (GNI) 5 The IPC is a set of standardized tools that aims at providing a "common currency" for classifying the severity and magnitude of food insecurity, and is used in many African and Asian countries. For more information, see www.ipcinfo.org. Additional details about food security in Malawi can be found at http://www.fews.net/pages/country.aspx?gb=mw 6 “Stressed” is the descriptor for Phase 2 (of five phases) in the IPC. Higher-number phases indicate higher levels of food insecurity. Farm Input Subsidy Program (FISP) Malawi has won international recognition for its implementation of the FISP introduced in 2005. The program aimed to ease financial constraints of poor smallholder farmers to enhance their productivity and household food security status. Farming households received vouchers for 100 kg of fertilizer, 2 kg of hybrid maize seed or 4 kg of open pollinated maize seed. Others received legume seed. The number of households receiving fertilizer coupons has averaged 1.7 million since the program’s introduction. The FISP is an expanded version of the Starter Pack Programme, implemented between 1998-1999 and 2004-2005 with support from international development partners. In 2012, following the devaluation of the Kwacha and the subsequent economic downturn, only 1.4 million farmers received vouchers while only 140,000 metric tons of fertilizer was purchased for distribution – a reduction of 30,000 tons from the year before. Source: AfDB report 2011; IFPRI Discussion Paper (2012); IRIN (2011) 4 Final Evaluation CRS Malawi WALA Program per capita, which steadily increased from USD320 in 2009 to USD340 in 2010 and USD360 in 2011 but reverted to 2009 levels in 2012 (World Bank 2013). Markets In general, markets for staple crops function poorly, especially for maize, and lead to high seasonal variation in staple food prices and decreased productivity. With only small percentages of maize reaching the markets, small changes in the quantity of grain traded have a major impact on prices. When yields are high, farm gate prices are often low and may not be sufficient to cover costs of production; when yields are low, subsequent high prices can prevent adequate household consumption (FTF 2011). Food Utilization The toll of food insecurity in Malawi manifests most significantly in the poor nutritional status of its children. Nearly half of Malawian children under five years of age are stunted, indicating a high level of chronic malnutrition. The diet of Malawians is mainly composed of cereals, primarily maize, starchy roots (cassava and potatoes) and starchy fruit (plantain). Fruits and vegetables complement the diet. Overall, dietary energy supply is barely sufficient to meet population energy requirements and more than a third of the population is undernourished. Moreover, the diet lacks diversity and is poor in micronutrient￾rich foods (FAO Malawi Country Profile 2013). The HIV/AIDS epidemic, infectious diseases, malnutrition, and limited access to basic health care are among the major factors contributing to high infant and under-five mortality rates. The maternal mortality ratio remains very high: 675 per 100,000 live births (MDHS 2010). In the context of high morbidity and the HIV/AIDS epidemic, access to health services is still limited, and the lack of material and human resources further constrains the quality of services (AfDB 2011). While the country is on track to meet the MDG on child mortality and has managed to reverse the trend on HIV/AIDS, Malawi is off track on three MDGs: universal primary education, maternal health, and gender equality and women empowerment. 3.2 Program Description Program History WALA is the successor of another Title II development assistance program entitled: “Improving Livelihoods through Increasing Food Security” (I-LIFE) that was implemented from October 2005 – June 2009, led by CRS and CARE. A number of successful interventions and approaches that were piloted and refined under I-LIFE – including Village Savings and Loans (VSL) (though with the Private Sector Providers (PSP) approach; see below), the Care Group approach (see Annex 9), and the interventions associated with irrigation – were incorporated into the WALA design. While carrying over the successful interventions, WALA shifted the geographic focus to the eight southernmost districts not covered by I-LIFE, where food insecurity was estimated as most acute.7 Five of the WALA PVOs were already members of the I-LIFE Consortium and thus provided necessary institutional memory.8 While WALA has integrated lessons learned from I-LIFE, its roots can be traced back further to the program implemented in Malawi (and neighboring countries) by the Consortium for Southern Africa Food Security Emergency (C-SAFE). C-SAFE responded to the immediate food security crisis with targeted food assistance to vulnerable groups, including households affected by HIV/AIDS. Transitional interventions focused on Food for Assets programming to build productive assets at the household and community level. The C-SAFE membership included World Vision International, EI, Catholic Relief Services, CARE, and ADRA. C-SAFE was also funded by USAID FFP. 7 One of the eight districts (Thyolo) was covered by I-LIFE WVI. However, the WALA program is located in different areas (Traditional Authorities). 8 CRS, Save the Children, EI, Africare and WVI. 5 Final Evaluation CRS Malawi WALA Program Program Description WALA is a five-year Title II Multi-Year Assistance Program (MYAP) funded by USAID to prevent and mitigate food insecurity in southern Malawi. WALA targets the most vulnerable communities and households, ensuring holistic provision of services to the selected groups. In the original design, targeted groups are comprised of households that have small and marginal farms, are female-headed, host chronically ill persons (tuberculosis and HIV/AIDS), are food insecure, and/or host orphans. WALA is implemented in the eight most food insecure districts of southern Malawi: Nsanje, Chikwawa, Thyolo, Mulanje, Zomba, Machinga, Chiradzulu and Balaka. CRS/Malawi, through the Consortium Administration and Technical Capacity Hub (CATCH), has led the management and implementation of the program. Goal: The goal of WALA is to improve the food security of 214, 974 chronically food insecure households in 39 Traditional Authorities in eight districts in southern Malawi by 2014 through strategic objectives in maternal and child health and nutrition (MCHN) (SO1); agriculture, natural resource management (NRM), Irrigation and Economic Activity (SO2); and Disaster Risk Reduction (SO3). Figure 2: WALA program targeting of communities with multiple interventions 3.3 Targeting The WALA program has targeted 215,000 chronically food insecure households in 39 Traditional Authorities within five livelihoods zones and eight districts in southern Malawi (Figure 3). 6 Final Evaluation CRS Malawi WALA Program Figure 3: Map of WALA program areas and implementing PVOs District Implementing PVOs Balaka Project Concern International Machinga Project Concern International Emmanuel International Zomba Save the Children Emmanuel International Chiradzulu Save the Children Mulanje Africare Thyolo World Vision Chikwawa Chikwawa Diocese Nsanje Total Land Care The program has no uniform targeting strategy, which was also noted in the midterm evaluation. Beneficiaries and beneficiary households are targeted differently under each SO. Table 2 summarizes beneficiary types by SO and the numbers that the program has been able to reach. Table 2: WALA beneficiary summary as of November 2013 IR or SO 1.1 Type of Beneficiary Total Beneficiaries through FY13 Breakdown by Sex LOA Target IR 1.1 Practices Households with pregnant or lactating women and children U5 152,550 HH NA 170,724 IR 1.2 Services 152,550 HH and 206,700 children U5 NA 170,724 SO 1 MCHN 152,550 HH NA 170,724 SO 2 ANRM 153,622 HHs* 147,500 IR 2.1 Crop Production/ Irrigation/ livestock, etc. Initially only smallholder farm households with <1 hectare of land, later opened up to all. 116,400 HHs 67,290 women and 49,120 men 147,500 IR 2.2 Financial Initially only smallholder farm 92,710 HHs 62,470 women and 27,240 men 103,400 Mzimba Kasungu Lilongwe Mangochi Chitipa Rumphi Dedza Dowa Chikwawa Ntcheu Mchinji Zomba Machinga Karonga Nkhotakota Nkhata Bay Salima Balaka Ntchisi Mwanza Nsanje Mulanje Thyolo Blantyre Phalombe Chiradzulu Likoma MOZAMBIQUE ZAMBIA TANZANIA 0 50 100 Kilometers 7 Final Evaluation CRS Malawi WALA Program Services households with <1 hectare of land, later opened up to all. IR 2.3 Marketing Smallholder farm households with less than one hectare of land 27,210 HHs - 20,600 SO3 DRR Communities 251 NA 273 IR 3.1 DRR Individuals trained 7560 3,400 women and 4,120 men - IR 3.2 Food Distribution Individual food recipients FY10: 8,220; FY11: 17,055; FY12: 17,145; FY13: 8,409 FY13: 4,600 women and 3,815 men 8,197 (annual safety net target) Program Total Chronically food insecure households 226,580 (IPTT ARR 2013) NA 214,970 *This figure includes HHs in PG or VSL or irrigation or marketing or livestock (source: November 2013 data file). Note that:  SO1 targets all pregnant and lactating women and children under five years of age without regard to their socio-economic status, as health, hygiene, and nutrition (HHN). Behavior change is envisioned for all households, not just the poorest ones.  The Supplementary Feeding Program under WALA was targeted based on referrals from clinics, hospitals, or Health Surveillance Assistants (HSAs) in the community;  SO2 (Agriculture and NRM plus VSL) initially targeted smallholder farmers owning less than one hectare of land but have opened up participation to all farming households that are willing to engage in WALA activities. In short, the program has moved away from specific targeting of the chronically food insecure (and very poor) to allow enrollment of all people from targeted communities. There is a lot to say in favor of this approach, particularly given that a large majority (approximately 90 percent of the population) is considered either poor (