BALOCHISTAN AGRICULTURE PROJECT (BAP) FINAL EVALUATION OCTOBER 31, 2016 This publication was produced for review by the United States Agency for International Development. It was prepared by (in alphabetical order) Muhammed Danish, Izhar Hunzai, Zohra Khanum, Samar Erum Nadeem, Niaz Murtaza, Muhammad Qasim Jan, Paul Schoen, and Shahid Umar, Management Systems International, a Tetra Tech Company. BALOCHISTAN AGRICULTURE PROJECT (BAP) FINAL EVALUATION Contracted under Order No. AID-391-C-15-00004 Performance Management Support Contract DISCLAIMER This report is made possible by the support of the American people through the United States Agency for International Development (USAID). The contents are the sole responsibility of Management Systems International and do not necessarily reflect the views of USAID or the United States Government. BAP FINAL EVALUATION iii CONTENTS Acronyms....................................................................................................................................... v Project Summary ......................................................................................................................... vi Executive Summary...................................................................................................................... 1 Evaluation Purpose and Questions.................................................................................................................1 Project Background............................................................................................................................................1 Key Findings and Conclusions.........................................................................................................................1 Summary of Recommendations.......................................................................................................................2 Evaluation Purpose and Questions.............................................................................................. 3 Evaluation Purpose .............................................................................................................................................3 Evaluation Questions.........................................................................................................................................3 Project Background ...................................................................................................................... 4 Development Hypothesis and Theory of Change ......................................................................................5 Evaluation Methods and Limitations........................................................................................... 5 Data Collection...................................................................................................................................................5 Data Analysis........................................................................................................................................................8 Evaluation Limitations........................................................................................................................................8 Findings and Conclusions.............................................................................................................. 9 Evaluation Question 1: Relevance and Effectiveness..................................................................................9 Evaluation Question 2: Sustainability ...........................................................................................................19 Evaluation Question 3: Women’s Empowerment ....................................................................................25 Conclusions .................................................................................................................................. 28 Recommendations ...................................................................................................................... 30 Community and Market Development........................................................................................................30 Women’s Empowerment................................................................................................................................31 Strengthening Public Sector...........................................................................................................................32 Annexes........................................................................................................................................ 33 Annex 1: Evaluation Scope of Work............................................................................................................33 Annex 2: Assignment Work Plan..................................................................................................................50 Annex 3: Data Collection Instruments........................................................................................................71 Annex 4: List of Documents Reviewed.................................................................................................... 185 Annex 5: Financial Analysis of FMCs in 2012.......................................................................................... 187 Annex 6: Two Qualitative Case Studies from the Field....................................................................... 189 Annex 7: Respondent Profiles.................................................................................................................... 190 Annex 8: Findings........................................................................................................................................... 196 BAP FINAL EVALUATION iv List of Tables Table 1: Project Summary............................................................................................................................................... vi Table 2: Project Beneficiaries Survey Sample Design................................................................................................6 Table 3: Changes in Average Income Between 2009 and 2015 ...........................................................................12 Table 4: Changes in Livestock Productivity Between 2009 and 2015 ................................................................14 Table 5: Perceived Sustainability of Participatory Organizations.........................................................................21 List of Figures Figure 1: Map of Project Activities for All Phases.................................................................................................... vii Figure 2: Relevance of Project Interventions............................................................................................................10 Figure 3: Proportion of GVAP by Project Component..........................................................................................14 Figure 4: Most Effective Internventions......................................................................................................................15 Figure 5: Per Unit Profits of FMCs and Non-Supported Enterprises..................................................................17 Figure 6: Changes in Communities’ Capacity............................................................................................................18 Figure 7: Perceived Sustainability of Results – Women .........................................................................................19 Figure 8: Sustainability Qualitative Responses..........................................................................................................20 Figure 9: Factors Frequently Mentioned Ensuring Sustainability ..........................................................................20 Figure 10: Will Participatory Organizations Survive? (By Respondent Type)...................................................21 Figure 11: Maturity Index – Sustainability ..................................................................................................................22 Figure 12: Institutionalization in Government Departments ................................................................................23 Figure 13: Replication of Project Activities...............................................................................................................24 Figure 14: Factors Affecting Replicability ...................................................................................................................24 Figure 15: Perceived Effect on Women’s Economic Empowerment...................................................................26 Figure 16: Perceived Effect on Women’s Social Empowerment..........................................................................26 BAP FINAL EVALUATION v ACRONYMS AOR Agreement Officer’s Representative AusABBA Australian Assistance to Agricultural Development in Balochistan Border Areas AusAID Australian Agency for International Development AWP Assignment Work Plan BAP Balochistan Agriculture Project CO Community Organization COR Contracting Officer’s Representative CPI Consumer Price Index DO Development Objective DoA Department of Agriculture EGA Economic Growth and Agriculture Office, USAID/Pakistan EQ Evaluation Question FAO Food and Agriculture Organization of the United Nations FFS Farmer Field School FMC Farmers’ Marketing Collective GI Group Interview GoB Government of Balochistan GoP Government of Pakistan GVAP Gross Value of Agricultural Product IPM Integrated Pest Management IR Intermediate Result KII Key Informant Interview MAXQDA Max Qualitative Data Analysis (software program) MCO Men’s Community Organization MIS Management Information System MMO Mutual Marketing Organization MNFSR Ministry of National Food Security and Research (GoP) MSI Management Systems International NARC National Agriculture Research Council NGO Non-governmental Organization PERFORM Performance Management Support Contract PPAF Pakistan Poverty Alleviation Fund Rs. Pakistan Rupees SOW Scope of Work USABBA United States Assistance to Balochistan Border Areas USAID United States Agency for International Development WASH Water, Sanitation, and Hygiene WCO Women’s Community Organization BAP FINAL EVALUATION vi PROJECT SUMMARY Table 1 summarizes basic information about the Balochistan Agriculture Project (BAP). TABLE 1: PROJECT SUMMARY Title/Field Project/Activity Information Contract/agreement numbers Cooperative Agreement #: 391-A-00-09-01122 Contracting/Agreement Officer’s Representative (COR/AOR) - Start date January1, 2009 Completion date December 31, 2016 Location Eight districts of province Balochistan border areas Implementing partner(s) Food and Agriculture Organization (FAO) USAID/Pakistan Mission Strategic Framework objectives addressed DO 2: Improved economic status of focus populations IR 2.1: Improved economic performance of focus enterprises IR 2.1.2: Improved skill development and job placement IR 2.1.3: Increased use of modern technology and management practices IR 2.2.2: Strengthened private sector and civil society engagement in policy-making Budget - BAP FINAL EVALUATION vii The map in Figure 1 illustrates (in green) the districts in which the Balochistan Agricultural Project (BAP) operates. The districts of Mustang, Loralai, and Killa Saifullah represented those in the pilot phase. Quetta and Zhob were added in phase 1 and Pishin, Musakhail, and Sherani in phase 2. FIGURE 1: MAP OF PROJECT ACTIVITIES FOR ALL PHASES Source: BAP, 2016 BAP FINAL EVALUATION 1 EXECUTIVE SUMMARY Evaluation Purpose and Questions PERFORM’s final evaluation of the Balochistan Agriculture Project (BAP) provided an independent third party assessment of the project’s achievements and the extent to which promising results reported in the midterm and previous evaluations have been sustained. USAID/Pakistan will use recommendations and lessons learned to inform future agricultural development programming in Pakistan. The evaluation was designed to determine the extent to which the project design and implementation contributed to, or detracted from, effectiveness, relevance, engagement of women, and replication and sustainability of results. The evaluation questions were phrased in terms of the relevance of design choices and the effectiveness of implementation approaches in the context of achieving expected results in the Balochistan context. Each question was designed to highlight what worked and what did not work and identified unanticipated results and lateral impact on non-beneficiaries. Project Background BAP is the third phase of a 10-year agricultural development project that evolved through a pilot phase focused on community development and food security, to a second phase focused on increasing surpluses and connecting farmers to markets, to a third phase that emphasized transitioning beneficiary farmers to commercially oriented business enterprises. To implement this strategy, the project focused on developing community organizations; introducing technologies and practices relevant to increasing crop and livestock productivity, including activities specifically designed to engage and benefit women; and developing value chains and markets. Key Findings and Conclusions Question 1: To what extent was the project design appropriate in achieving the desired results? Relevance: The project focused on numerous beneficiary types including members of community organizations (COs), entrepreneur members of farmers’ marketing collectives (FMCs), and government. The evaluation concluded that the project had focused on and adapted interventions to the needs of all three, gaining the greatest success and perception of relevance from members of COs. In terms of support to FMC members, the project was particularly relevant as they moved from informal organizations to businesses with a high potential for sustainability. Over 915 COs were formed, of which around 75 are FMCs, and a further 7 or 8 have become mutual marketing organizations (MMOs), with a more formal, registered organizational structure than FMCs. Effectiveness: In terms of meeting its objectives for income growth (men and women) and increasing crop and livestock productivity, the project has shown positive results. Beneficiaries’ average annual income has increased by 189 percent in nominal terms (from Rs. 395,557 to Rs. 1,141,361), crop productivity has increased by 296 percent on average (from 4.13 to 16.38), and livestock productivity has increased by an average of 296 percent (from 9.69 to 38.37).1 Fruit and vegetable crops, rather than staples, drove advances in crop productivity. Beneficiaries attributed their gains largely to new skills, improved access to markets, and improved inputs. Additionally, the improvement in crop productivity is 1 The analysis defined productivity as the ratio of gross revenue to production costs. BAP FINAL EVALUATION 2 in part plausibly attributable to water-related project activities. The project generated $61.0 million in increased incomes for poor, rural households with a total outlay of $28.2 million (both expressed in 2015 dollars)—a net present value of $32.8 million and a return of $2.17 for every dollar spent. This increase in income is plausibly attributable to the project activities. Question 2: To what extent has the project design resulted in sustainable impacts? Three-quarters or more of beneficiaries believed they would continue project activities. When asked in qualitative interviews to describe how activities would continue, however, beneficiaries and stakeholders were less optimistic. More than half believed crop and livestock activities were sustainable, while less than half believed women’s activities and water activities would continue. It is notable that respondents viewed activities that required little or no investment (e.g., capacity building) as more sustainable than those that required relatively large investments (e.g., water infrastructure).2 Community development and improved market access emerged as the most-mentioned contributors to sustaining results. While project activities have succeeded in enhancing capacity within some relevant government departments, the sustainability of the improvements remains in doubt due to lack of money, motivation, and governments’ limited involvement in project implementation. Prospects for replication were also correlated with the level of investment required to adopt a practice or technology. Respondents reported observing more replication of crop, livestock, and women￾oriented activities than of water-related activities. Most replication occurred organically through personal contacts with neighbors or relatives. It is also notable that another project, Australian Assistance to Agricultural Development in Balochistan Border Areas (AusABBA), funded by the Australian government, has replicated the development approach of BAP. Question 3: To what extent did interventions improve the empowerment of women in the target regions? Sixty percent or more of women respondents reported improvements in their economic empowerment related to increased income and greater participation in household asset and expenditure decisions, but not in their ability to work or access markets outside the home. The project was less successful in empowering women socially with respect to their ability to express disagreement in the community or to assume leadership roles. Two-thirds, however, believed they had greater control over their future. Given the conservative nature of the Balochistan culture, even small improvements in women’s social empowerment represent important achievements. Summary of Recommendations Community and market development: COs are a useful entry mechanism for working in remote, isolated, and undeveloped areas, but the capacity of COs should be strengthened to make them more sustainable in future projects if their purpose as a social or economic instrument can be harnessed. FMCs were an effective approach, but future projects should begin these activities earlier and expand the activity to cover the entire value chain, including financial and market information services. Women’s empowerment: Future projects should place greater emphasis on progressively introducing innovative and market-focused women’s economic activities. There is a need to widen the inclusivity of 2 The evaluation team did not ask about sustainability over a given period of time and instead asked if the activity was sustainable without donor support. Farmers may have viewed water infrastructure as unsustainable if the community could not afford to replace or rehabilitate the infrastructure without external support even if they believed the infrastructure would last for decades. BAP FINAL EVALUATION 3 technological use by all community members, including women, to raise participation leading to female empowerment and emancipation socially and politically. Future projects should adopt an integrated approach towards social empowerment through building alliances with other relevant organizations. Strengthening public sector: Development projects cannot operate in isolation of national or local institutions, including those of government. Working with governments that have limited budgets or limited qualified personnel remains a challenge, but provides legitimacy and a framework for anchoring the changes that are needed. Despite their capacity constraints, governments have an implementation role to reinforce ownership, sustain their commitment, and continue the work beyond external financing and technical assistance. To this end, the Balochistan Agricultural Sector Policy and Strategy prepared by the project needs to be updated and the Government of Balochistan (GoB) encouraged to approve it quickly. EVALUATION PURPOSE AND QUESTIONS Evaluation Purpose PERFORM’s final evaluation of BAP provides an independent third party assessment of the project’s achievements and the extent to which promising results reported in the midterm and previous evaluations have been sustained. This final evaluation examines the effectiveness of the project’s development approach to determine whether and under what conditions it could be replicable and extracts lessons for ongoing and future USAID/Pakistan agricultural development activities. Evaluation Questions In collaboration with the USAID/Pakistan Economic Growth and Agriculture (EGA) team, the evaluation team refined the evaluation questions defined in the scope of work (SOW) (Annex 1) and agreed to the following questions as documented in the assignment work plan (Annex 2). Question 1: To what extent was the project design appropriate in achieving the desired results? a. Relevance: How well was the project focused on the needs of beneficiaries? The question assessed relevance from the perspectives of the GoB’s development priorities, the priority agriculture-oriented needs of target communities, and increasing women’s economic and social empowerment, all within the context of Balochistan’s political, economic, and social environment. b. Effectiveness: Did the project accomplish its objectives, especially given the shift from livelihoods to a more business-oriented approach? The evaluation assessed effectiveness relative to the five key anticipated outcomes identified in the project logframe (contained in the SOW in Annex 1): (1) increasing the incomes of target households by at least 20 percent; (2) increasing women’s income by at least 20 percent; (3) increasing crop productivity by at least 35 percent; (4) increasing livestock productivity by at least 20 percent; and (5) building the capacity of target communities to identify needs and problems collectively and seek external assistance. The evaluation examined the effectiveness of key project components, including crops, livestock, water, women-focused activities, and community and market development. BAP FINAL EVALUATION 4 Question 2: To what extent has the project design resulted in sustainable impacts? a. Are the activities and results likely to be sustained after the project is completed? The evaluation assessed the extent to which beneficiaries are likely to continue employing project￾promoted practices and sustain results in the absence of project support. It also identified conditions and factors that may enhance or deter prospects for sustainable results. b. Is the project “institutionalizing” or building local capacity to undertake similar activities? The evaluation explored whether project-supported GoB line departments have institutionalized the policies and practices that the project promoted, and the factors and conditions that contribute to or hinder prospects for sustainability. It also examined the extent to which participatory organizations— such as COs, FMCs, and MMOs—created under the project are likely to continue functioning after the project ends, and the factors and circumstances that may enhance or deter their sustainability. c. Replication: To what extent are the activities and results of the project replicable/ replicated? The evaluation assessed the replicability of project activities and the conditions under which they are replicated and replicable. It explored the frequency and magnitude with which farmers, community organizations, and others have benefitted indirectly from project activities. Question 3: To what extent did interventions improve the empowerment of women in the target regions? The evaluation examined women’s empowerment from the perspectives of economic opportunity, economic empowerment, social empowerment, and social change, and also assessed whether women’s community organizations (WCOs) have played a role in increasing women’s empowerment. PROJECT BACKGROUND BAP is the current iteration of a three-phase agricultural development project that began in 2005. The pilot phase was a food production initiative designed to alleviate food insecurity and poverty. In phase 1 (United States Assistance to Balochistan Border Areas – USABBA), the project continued activities designed to increase food production but also started to work on market development initiatives to enhance incomes. In phase 2 (BAP), the project emphasized transitioning project-supported community organizations (COs) to formal business-oriented agricultural and livestock enterprises. The project reports engaging about 17,162 households directly and benefitting an additional 28,600 households indirectly. These households represented about 320,000 individuals, or 2.5 percent of the total Balochistan population of 13 million.3 BAP works in eight districts of Balochistan close to the Afghan border.4 It started in three districts during the pilot phase in 2005 (Killa Saifullah, Loralai, and Mastung), and added two more districts (Quetta and Zhob) in the USABBA phase, and three more (Sherani, Musakhail, and Pishin) in the BAP phase. It focused on capacity building, technological innovation, farm management, and value chain 3 Maqbool Ahmed, Ghulam Dastageer, Sher Ali Khan, and Mahvish Ahmad, “A numbers game: Is census delayed justice denied?,” Herald, September 02, 2016, http://herald.dawn.com/news/1153406. 4 At the time of the final evaluation, BAP was still operative. BAP FINAL EVALUATION 5 development. In addition, the project added a policy component to work with the GoB in light of the adoption of the 18th Amendment to the Constitution of Pakistan, which devolved many responsibilities in agriculture and livestock to the provincial government. BAP program activities cover the following major domains: community organizing; community and market development; and water, crops, and livestock. (See Annex 1 for the logical framework.) Development Hypothesis and Theory of Change The economic opportunities for poor agricultural households in the border areas of Balochistan are limited. Crop and livestock productivity is low, markets are highly undeveloped, household food insecurity is common, and household livelihoods are vulnerable and fragile. However, agriculture will remain the mainstay of household livelihoods in these areas of the province in the coming years. As a result, there is a need and scope to increase household incomes by improving crop and livestock productivity and strengthening market access and linkages. Thus, the overall development objective of the project has been to reduce poverty and increase peace and stability in the border areas of Balochistan. Through its activities, BAP seeks to address multiple key challenges faced by poor Balochistan farmers, such as low productivity levels (particularly due to crop failures and poor animal health); limited access to water and inefficient use of water; poorly managed, overgrazed, and degraded rangelands; a weak research and extension system; high post-harvest losses; weak and underdeveloped value chains; and a lack of market access and market connections. BAP made particular efforts to ensure that men and women shared equitably in project benefits. Along with introducing key interventions covering crop, livestock, water, and women-focused activities, the project formed and strengthened COs as the platforms through which it implemented activities. It formed separate COs for men and women to ensure that both could receive capacity-building support permissible in the context of Balochistan. COs also provided the vehicle for gathering people together to discuss community, household, social, and livelihood needs. The livelihoods approach, focused on increasing production through community organizations, was subsequently transformed into a market development approach, which focused on creating market opportunities for COs that had started producing surpluses and transforming some of the COs into registered, commercially oriented agricultural and livestock enterprises—farmers’ marketing collectives (FMCs) and mutual marketing organizations (MMOs).5 FMCs and MMOs cover numerous agricultural sub-sectors, including apples, grapes, mulberries, and wool. Members who came together to form these organizations received technical assistance, including business planning, organization techniques, financial accounting practices, packaging, and transport training. In terms of engagement with the market, the project has engaged beneficiaries in “walk the value chain” exercises and introduced them to potential buyers. So far, the project has supported around 80 FMCs, of which 7 have become registered MMOs. EVALUATION METHODS AND LIMITATIONS Data Collection The evaluation employed a mixed-methods approach that included collecting quantitative and qualitative data from multiple sources (i.e., project documents, research papers, beneficiaries, stakeholders, and 5 The only difference between FMCs and MMOs is that MMOs are formally registered organizations. BAP FINAL EVALUATION 6 experts). The evaluation team collected primary data through a survey of CO, FMC, and MMO members; group interviews (GIs) with beneficiaries, GoB line departments, and BAP field staff; and key informant interviews (KIIs) with various stakeholders. The mixed-methods approach ensured multiple levels of triangulation to help answer the evaluation questions. In total, the team developed seven data collection instruments which included two survey questionnaires (one for men and one for women) and five interview guides (Annex 3). Survey of Beneficiaries The evaluation team conducted a survey of a large number of project beneficiaries to ensure that findings are generalizable to the beneficiary population of the sampled districts. Since the project covered a large and remote geographic region with poor transportation infrastructure, the team adopted a multi-stage approach to select a sample of project beneficiaries it could feasibly visit within the fieldwork timeframe. In the first stage, the team purposively selected one district from each project phase (i.e., pilot, phase 1, and phase 2): Killa Saifullah (pilot), Zhob (phase 1 – USABBA), and Sherani (phase 2 – BAP). The selection process considered issues such as security, distance from Quetta, and the suitability of lodging for the team. In the second stage, the team randomly selected 14 women’s community organizations (WCOs),14 men’s community organizations (MCOs), and all FMCs/MMOs in each selected district. In the third stage, the team randomly selected five beneficiaries (CO, FMC, and MMO members) from each selected cluster. Additionally, to get a better representation of beneficiaries involved in the project’s market-oriented approach, the team surveyed all FMC and MMO members in Quetta, Mastung, Loralai, Sherani, and Zhob districts. Thus, the team selected a sample of 693 project beneficiaries to get estimates with a 5 percent margin of error with a 95 percent confidence level (Table 2). The sample for the survey included 220 women and 473 men. The survey instruments covered questions relating to the relevance, effectiveness, and sustainability of the project; respondents’ household income and expenditure; crop and livestock productivity; and perceptions regarding women’s empowerment. Annex 7 contains profiles of survey respondents. TABLE 2: PROJECT BENEFICIARIES SURVEY SAMPLE DESIGN District FMC and MMO Members CO Members MCO Members WCO Members Killa Saifullah (pilot district) 79 70 70 Zhob (USABBA district) 56 70 70 Sherani (BAP district) 41 70 70 Loralai, Mastung, Quetta 97 0 0 Totals 273 210 210 273 420 693 Key Informant Interviews The team conducted 40 semi-structured individual interviews with key informants associated with the project and external sector experts who could provide feedback on the project’s design, implementation, and results. The evaluation team purposively selected stakeholders and experts to capture specific expertise, experience, or perspectives. Stakeholders included representatives from BAP FINAL EVALUATION 7 USAID, the Australian Agency for International Development (AusAID), the Food and Agriculture Organization of the United Nations (FAO), the National Agriculture Research Council (NARC), the Ministry of National Food Security and Research (MNFSR), and the GoB (Annex 7). These interviews focused on developing a comprehensive understanding of the relevance, effectiveness, sustainability, and replicability of project components (crops, livestock, water, women-focused activities, and community and market development), unintended results, and changes in women’s empowerment. The evaluation team designed two instruments for these interviews, one for sector specialists, and one for managerial staff (Annex 3). Group Interviews The evaluation team conducted 23 semi-structured group interviews (GIs) with project beneficiaries (21 groups), district government officials (1 group), and an FAO project district team (1 group). The GIs with beneficiaries were conducted in the three sampled districts (Killa Saifullah, Zhob, and Sherani). In total, the team conducted seven group interviews in each sampled district including two each with MCO and WCO members and three with FMC/MMO members. The team used a project-generated enumeration list of each CO to randomly select four community members for each GI, and they purposively selected the district government officials and project staff. For a summary of GIs conducted, see Annex 7. GIs consisted of 4 participants each, except for the GI with the FAO project district team, which included 10 participants. In total, the GI sample included 98 participants, of which 74 were men and 24 were women. The team conducted GIs with male and female beneficiaries separately. These GIs focused on developing a deeper understanding of the relevance, effectiveness, sustainability, and replicability of project components (crops, livestock, water, women-focused activities, and community and market development), unintended results, and changes in women’s empowerment. The team designed four instruments for the GIs, one each for MCOs, WCOs, FMCs and MMOs, and district government and FAO staff (Annex 3). Case Studies The evaluation team also used case studies to capture unintended positive or negative and spillover effects. During the fieldwork, the team identified promising case studies with the help of information from KIIs, GIs, and project documents. For two case studies, see Annex 6. Secondary Review Besides collecting primary data, the evaluation team consulted secondary information maintained by the project (see Annex 4 for a bibliography). This included project documents, the project’s management information system (MIS), project-supported research reports, and the project calculations on the gross value of agricultural product (GVAP)6 to estimate the effects of activities on household and women’s income. 6 GVAP is a measure of the gross revenue attributable to project activities and serves as a practical proxy for the project’s contribution to household income. Its construction provides a plausible causal connection between individual project activities and household income. GVAP for each activity is the difference between GVAP with the intervention and what it would have been without the intervention—both estimates based on research (e.g., on differences in yields between local and improved seed varieties), field-validated assumptions about what farmers would have done without the interventions, and current market prices for agricultural and livestock products. The following example from the project’s documentation illustrates GVAP. “Suppose that the project provides a farmer with improved wheat seed sufficient to plant one hectare of land and that he would have planted a local variety of wheat on the same land if he had not received the improved variety. Further assume that one hectare of the local variety produces (on average) Rs. 30,000 of wheat and straw per hectare. This is the GVAP associated with what the farmer would have done without BAP FINAL EVALUATION 8 Data Analysis The survey yielded quantitative information regarding relevance, effectiveness, and sustainability of project activities; women’s empowerment; crop and livestock productivity; and household income and expenditures. The qualitative data provided additional depth of understanding, answering the questions of how and why project activities influenced intended outcomes. The evaluation team used descriptive statistics (frequencies, averages, and cross-tabulations) of the quantitative data to describe beneficiary characteristics and perceptions by type of CO. They used relevant statistical tests, such as the chi￾squared test and t-test, to see whether differences between disaggregate levels were significant. To calculate changes in income and productivity between 2009 and 2015, they compared the evaluation’s survey findings with those of the project’s 2009 baseline study. To undertake qualitative data analysis, the evaluation team used MAXQDA, a qualitative data analysis package, which facilitated coding, organizing, and extracting patterns from the qualitative data. They employed both deductive and inductive coding systems. Deductively, they developed a provisional code list based upon the conceptual framework, background documents, evaluation questions, and data collection instruments. As the team coded interview transcripts against this provisional list, other (inductive) codes emerged progressively from the data itself. Such inductive codes were empirically grounded in the data and helped identify data patterns. To integrate quantitative and qualitative data, the evaluation team used an explanatory approach. In this analysis, qualitative findings helped explain trends and findings in the quantitative data. That is, the quantitative data gave the “what” part of the information, and the team used the qualitative data to explain the “why” and “how” parts. The integration was designed to triangulate the quantitative with the qualitative data and help explain how and why project interventions affected the welfare of beneficiaries or how project interventions worked—or failed to work—as expected. Evaluation Limitations Notwithstanding the efforts of the evaluation team to obtain valid and reliable data, the evaluation has the following limitations. 1) Measuring incomes of small-scale farmers was difficult, as not all farmers held relevant written records, and survey respondents might not have given accurate income information due to response bias. 2) Agricultural production and income questions in the survey required a recall of up to one year or more—e.g., crop productivity in the last kharif season—which might have caused recall bias. 3) Findings from the survey are generalizable to the sampled districts only. The evaluation team took the following measures to mitigate these limitations. 1) To mitigate potential response bias, the evaluation team avoided directly asking questions about respondents’ household income. Instead, they asked about the respondents’ landholding, various inputs, quantities produced and sold, and market prices during the last year, and calculated household income based on this information. To mitigate the large variation in reported prices, the improved seed. Now assume that the GVAP associated with the improved [higher-yielding] variety is Rs. 44,000. The GVAP associated with distributing improved wheat seed is thus Rs. 14,000 – the difference between the GVAP for improved wheat and that for local wheat.” (Taken as it is from an internal USABBA Mission Report, pp. 9-10). For a detailed description of GVAP and the method used, see the internal USABBA Mission Report 2010. BAP FINAL EVALUATION 9 they used average market prices of livestock and crops to compute household income. 2) As suggested by Hassan (2005), 7 the team mitigated potential recall bias by structuring questions to facilitate recall and by training the survey enumerators to give the respondents enough time before answering the survey questions involving recall. 3) To mitigate the issue of generalizability, the team used other sources of data, such as GVAP, which apply to all project districts. During the analysis, the team found little reason to question the overall validity of the quantitative data and is confident in its quality. Moreover, the evaluation did not rigorously attribute observed changes to project activities but instead aimed for plausible attribution, i.e., providing a plausible rationale for ruling out other causes of changes in an indicator or a plausible explanation for how project activities contributed to changes in the indicator. FINDINGS AND CONCLUSIONS Evaluation Question 1: Relevance and Effectiveness Question 1: To what extent was the project design appropriate in achieving the desired results? Relevance How well was the project focused on the needs of beneficiaries? The evaluation examined relevance from the perspectives of the project’s relevance to government development priorities, the needs of the target communities, and the wider political and socio-economic context in which the project was implemented. Relevance to Household Needs The surveys of MCO and WCO members presented a list of project activities and asked respondents whether they had participated in each activity, and if so, whether the activity was relevant to addressing their household needs. Almost all (98 to 100 percent) of male and female respondents who participated in an activity identified the activity as relevant to their household needs (Annex 8). To elicit more nuanced perceptions of the relevance of project activities, the evaluation team asked MCO and WCO members in group interviews an open-ended question about how project activities addressed community problems. The most frequently mentioned crop- and water-related activities were skill development (training and capacity building) and improved inputs (e.g., seeds, plants, and poultry chicks) (Figure 2). For women-focused activities, respondents were most likely to identify improved 7 Eman Hassan, “Recall Bias Can Be a Threat to Retrospective and Prospective Research Designs,” The Internet Journal of Epidemiology 3, no. 2 (2006): 339-412. “Post-harvest losses result in 35 to 40 percent losses in fresh fruits and vegetables. FAO has brought more awareness to the farmers on the market side and has introduced new methods and good packaging materials, such as cardboard boxes to replace the old wooden boxes. So, I would say, the project has done much more on the marketing side, and farmers have benefitted more from reducing their post-harvest losses and are now selling their produce for good prices both in local markets and in other cities and provinces.” – KII, senior government officer, GoB BAP FINAL EVALUATION 10 inputs and skill development as relevant interventions. In livestock, respondents were most likely to mention skill development, disease control, and improved inputs. For market-oriented activities, they mentioned skill development and improved inputs most frequently. FIGURE 2: RELEVANCE OF PROJECT INTERVENTIONS Note: The percentages reflect the percentage of the n respondents who mentioned the intervention. Source: Group interviews with MCO, WCO, FMC, and MMO members, August–September 2016. Relevance to GoB Needs and Development Priorities The evaluation team conducted 36 KIIs with representatives of the MNFSR, relevant Government of Pakistan (GoP) departments, and federal agricultural research organizations (such as NARC) to inquire about the relevance of project activities to development priorities. Although the project operated largely autonomously from the provincial government, FAO-government cooperation at the district level was good. Both the federal and provincial governments believed project activities were highly relevant to their development priorities. Half of 36 key informants whom the evaluation team asked about the project’s relevance to the GoB believed that the project addressed the GoB’s development priorities in the agricultural sector. Fifty-eight percent of the 12 of these respondents who directly represented the GoB felt that the project was relevant to government priorities. To ensure its relevance to government priorities, the project consulted with government ministries, departments, and research and policy organizations. At the strategic level it gave the federal and provincial governments key roles on the project steering committee which met annually. With the help of the GoB Department of Agriculture (DoA), the project developed a “Provincial Agriculture Sector Policy and Strategy” with a roadmap for agrarian change. The purpose of this strategy was, as the former international project manager was quoted as saying, “to put intellectual thought on to the table.” The project also introduced innovative approaches such as farmer field schools (FFSs) to the extension services with the expectation that the GoB DoA would adopt this as part of its common practice. Project managers, however, made a conscious decision not to involve government directly in field “The project has created awareness among small farmers about their resource potential, technology for increasing productivity, value addition, and marketing. The livestock mandi [market] and the live weight [pricing] idea are examples. So I can say that the project has made a significant contribution in reviving the livestock sector, and has taken practical steps. Now it’s up to people in government, communities, and local business people to build on this foundation.” – KII, senior government officer, livestock BAP FINAL EVALUATION 11 implementation. They explained that, because of budget constraints, the GoB spent most of the budget allocated to agriculture on salaries (93 percent of the DoA budget, according to BAP senior KII interviews) and very little to support field operations, a situation that undermined desirable changes. This situation has not changed over the decade that BAP and its predecessor projects have been implemented. Conclusions: Relevance The project’s interventions over its long period of implementation appear highly relevant and appropriate to raising farmer production and encouraged, through capacity building, a greater awareness of commercializing agriculture and livestock practices. Training and inputs were particularly relevant across all project components. This is not surprising given that, on average, beneficiaries earned 69 percent of their household income from agricultural and livestock activities. The GoB also found project activities relevant to its development priories and needs. The project’s approach, i.e., consultation with government departments and research and policy organizations, and engaging the DoA in strategic planning, contributed to its relevance. The agricultural strategy the project developed with the GoB addressed a pressing need and, in the absence of any other plan or documented stratgy, this has provided a framework for discussion and an entry for the GoP and donors to support agricultural development in Balochistan. During design and development of the Provincial Agriculture Sector Policy and Strategy, FAO intensively cooperated with relevant GoB departments. Generally, FAO-GoB cooperation at the district level was good, and at the provincial level it could have been more intensive. Effectiveness Did the project accomplish its objectives, especially the shift from livelihoods to a more business￾oriented approach? The evaluation assessed effectiveness from the perspective of the project’s five key anticipated outcomes as identified in the logframe. These included increasing household income, increasing women’s income, increasing crop productivity, increasing livestock productivity, and improving the capacity of community members to identify needs and solve problems collectively. It also addressed the effectiveness of the project’s sequential development approach, which progressed from community development and livelihoods to a business-oriented approach. The analysis relies largely on survey data (the project’s 2009 baseline and the evaluation survey conducted in August 2016), the project’s GVAP estimates, and GIs with project beneficiaries to determine if and how activities were effective. “The most important contribution of the FAO project is that it has helped us in formulating the provincial agriculture policy. …This was our need, FAO helped us, and now our provincial agriculture policy is in its final shape …The credit for this also goes to the project.” – KII informant, Quetta “Definitely, activities were relevant. The best thing in the project was the formation of community organizations—men’s COs and women’s COs. They engaged with men first because it’s not an easy task to involve women in Balochistan. Women are confined to their homes; they don’t have enough mobility because of the existing systems in place. More so in Pashtun districts which are stricter in this regard. They formed men’s community organizations and built rapport with them, who then allowed the female facilitators to meet up with community women. Then, they gradually formed women’s COs in the villages.” – KII informant BAP FINAL EVALUATION 12 Household and Women’s Income Table 3 shows the comparison of reported incomes between 2009 and 2015 in nominal and real terms disaggregated by income source.8 Average household income increased by 189 percent in nominal terms (that reflect the combined effect of inflation, changes in product prices, and the impact of the project) and 66 percent in real (inflation adjusted) terms. Women’s income increased by 100 percent in nominal terms and 15 percent in real terms. Income from agricultural activities, the project’s primary focus, also increased substantially—by 261 percent (nominal)—while income from livestock increased by 59 percent in nominal terms. Based on average household sizes estimated from the survey data, per capita income increased from $1.319 to $2.18 per day, which moved the average household out of extreme poverty.10 Table 3 also shows an increase in agriculture’s contribution to total household income from 49 percent in 2009 to 62 percent in 2015, while livestock’s share fell from 12 percent to 7 percent. The greater growth in agricultural income relative to livestock reflects the project’s greater focus on crop (and water-related) activities relative to livestock. As Figure 3 illustrates, 52 percent of the total GVAP the project generated between 2009 and 2016 came from agriculture (34 percent from water-related activities and 18 percent from crop activities) and 36 percent came from livestock. The low contribution of livestock relative to agriculture also reflects the fact that households treat livestock as an asset and intend it for household consumption more than as a source of income. In fact, only 12 percent of respondents to the evaluation’s household survey reported income from livestock. TABLE 3: CHANGES IN AVERAGE INCOME BETWEEN 2009 AND 2015 Income Source 2009 Baseline 2015 Final Evaluation % Change in Nominal Income % Change in Real Income Rs. 2009 (Nominal) Rs. 2015a (Real) % of Total Amount % of Total Total income 395,557 688,269 100% 1,141,361 100% 189% 66% Agriculture 195,587 340,321 49% 706,462 62% 261% 108% Livestock 47,419 82,509 12% 75,339 7% 59% -9% Women’s income 42,715 74,324 11% 85,231 7% 100% 15% Other sources 109,836 191,115 28% 274,329 24% 150% 44% Source: BAP 2009 baseline report and BAP survey. a. Values from 2009 are inflated using a factor of 1.74 based on reported CPI figures for Pakistan. Source: Pakistan Bureau of Statistics. The income analysis also found substantial differences between the sampled districts. Zhob registered a 518 percent increase in average nominal income (255 percent in real terms) and Killa Saifullah achieved a 8 USAID and BAP project managers explained that targets for household and women’s income referred to nominal increases. 9 The project’s 2005 baseline survey estimated per capita income in project areas at $0.65. This implies an increase of 235 percent in per capita income between 2005 and 2015. 10 World Bank has the following definitions of poverty: extreme poverty (<$1.25 a day), moderate poverty ($1.25 - $4), vulnerability ($4 - $10), and middle class and rich (>$10). The project beneficiaries moved from the edge of being poor to the middle of moderate poverty. Source: World Bank. (2015). Global Monitoring Report 2015. Retrieved from: http://pubdocs.worldbank.org/en/503001444058224597/Global￾Monitoring-Report-2015.pdf BAP FINAL EVALUATION 13 239 percent nominal increase (95 percent in real terms). 11 The evaluation did not have the baseline data for Sherani necessary to calculate district-level changes in income. (See Annex 8.) Based on project-reported GVAP estimates—the only annual source of income estimates—the project generated $53.7 million in additional income for beneficiary households.12 To generate this income, the project spent $22.2 million. In terms of current (2015) values, the project spent $28.2 million to generate $61.0 million in income—$32.8 million more than the project cost. The ratio of benefits to costs is 2.17 which implies that the project generated $2.17 (in present value terms) for each dollar spent. Crop and Livestock Productivity The 2009 and 2016 surveys also provided the data necessary to calculate changes in crop and livestock productivity. The analysis defined productivity as the ratio of gross revenue to production costs. For crops, the analysis calculated gross revenue as the market value of all crops produced and not lost to spoilage, and production costs as the total cost of all inputs, including labor. For livestock, the analysis defined revenue as the market value of animals sold, consumed in the household, or given away, and production costs as the share of total production costs attributable to the animals sold, eaten, or given away. The team adopted this approach for livestock productivity to separate the productive value of livestock from its value as an asset or store of wealth. The analysis found that aggregate crop productivity (i.e., all crops combined) increased by an average of 296 percent—from 4.13 in 2009 to 16.38 in 2015 (Annex 8). The analysis also found a greater increase for horticultural crops than for staple crops. For instance, the productivity of grapes, carrots, apples, and apricots improved by 709 percent, 575 percent, 393 percent, and 245 percent, respectively, while the productivity of wheat, barley, and maize changed by -40 percent, -37 percent, and 49 percent, respectively (Annex 8).13 Greater improvements in the productivity of horticultural crops may reflect the project’s emphasis on water-related activities—such as land leveling and dykes, lined storage tanks, lined/piped irrigation canals, and karez rehabilitation—which facilitate production of higher value (relative to staples) horticultural crops. As Figure 3 illustrates, 34 percent of the total GVAP the project generated between 2009 and 2016 came from water-related activities, a finding that emphasizes the importance of water-related activities in improving crop productivity and income. 11 The evaluation team could find no reason for this difference. 12 Pakistan rupees converted to U.S. dollars using the exchange rates applicable to each year. 13 It is important to note that, because agricultural output depends, to a large extent, on weather and other external factors, point estimates of production are less meaningful than trends and may be misleading. However, the evaluation did not have access to data to calculate trends in production. BAP FINAL EVALUATION 14 FIGURE 3: PROPORTION OF GVAP BY PROJECT COMPONENT The analysis also found that the project exceeded its target of increasing average livestock productivity by 20 percent. The evaluation team calculated productivity for the four most common animals (sheep, goats, cattle, and poultry). Aggregate (all animals) productivity increased by 296 percent. By animal type, productivity increased most for poultry and least for cattle, on which the project did not focus (Table 4). TABLE 4: CHANGES IN LIVESTOCK PRODUCTIVITY BETWEEN 2009 AND 2015 Animal 2009 2015 % Change (2009-2015) Goat 8.9 30.2 240% Sheep 11.8 45.0 282% Cattle 6.5 14.5 123% Poultry 10.2 75.9 643% Total 9.7 38.4 296% Source: BAP 2009 baseline report and BAP survey. To elicit more nuanced perceptions of the effectiveness of the project activities, the evaluation team asked MCO and WCO members in group interviews to describe the mechanisms through which project activities had affected their household income and crop and livestock productivity. Figure 4 summarizes the results. The main themes that emerged from the open-ended responses identified technical and managerial trainings; access to markets; improved inputs (e.g., higher-yielding seed varieties); and better irrigation systems as the most effective project activities. For livestock activities, respondents most frequently identified access to markets (e.g., organizing mandis, eliminating middlemen, exposure visits); improved inputs (e.g., poultry chicks); and disease control (improved animal health care) as the most significant contributors to improving livestock productivity. BAP FINAL EVALUATION 15 FIGURE 4: MOST EFFECTIVE INTERNVENTIONS Source: Evaluation team interviews, 2016. In terms of specific technologies, GI and KII respondents often cited the introduction of sheep shearing equipment and solar incubators for female-run poultry enterprises as effective activities. Key informants reported that the DoA has adopted both. The DoA also reported interest in promoting FFS and integrated pest management (IPM), both introduced by the project. Other project intervention areas that have been effectively adopted by the DoA include livestock mandis and the introduction of the live weight measurement of animals to promote transparent market sales. Effectiveness of the Development Approach The project’s pilot phase focused on organizing communities and helping them improve livelihoods and food security by increasing their agricultural and livestock production. As it progressed into the USABBA and BAP phases, the project began to focus on improving beneficiaries’ access to markets and transitioning them to viewing farming as a business, a strategy that culminated in it establishing FMCs and MMOs as business-oriented enterprises. The evaluation team used the project’s financial assessments of the FMCs, the evaluation survey data, and GIs with FMC and MMO members to determine whether they earned higher incomes than beneficiaries who were members of COs. “Because of chicken distribution and livestock feed by FAO, our household women increased their income by selling eggs and wool.” – MCO member, Killa Saifullah “[The] theory of change for the program over the 12 years has been a series of ‘regeneration steps.’ It was redesigned several times through its life, which was a necessary process in such a long project. The [project] carried out a lot of studies into sustainability and found the developmental pathway was something like the following: Change the farming systems to develop business skills of farmers. Overall though, the project focused on changing people’s attitudes.” – KII, FAO consultant BAP FINAL EVALUATION 16 Disaggregating the evaluation’s household survey data by type of organization (i.e., CO versus FMC or MMO) shows that FMC and MMO members earned significantly higher incomes than CO members (t=6.70, p<0.01).14 Specifically, on average, FMC and MMO members earned 47 percent more (Rs. 420,389) than CO members annually. Since the evaluation was not able to establish a counterfactual (i.e., what FMC and MMO members would have earned had they not been FMC or MMO members), the analysis is unable to determine whether selection bias (e.g., FMC and MMO members were more progressive or wealthier than CO farmers) instead of project activities explains the difference in incomes. However, the survey data showed no significant differences between FMC or MMO and CO members in terms of amount of land owned (p=0.89), household size (p=0.81), or number of animals owned (p=0.06). While this is not conclusive evidence of the absence of selection bias, it does suggest that FMC and MMO members were not greatly different from CO members in some important respects. The project’s financial analysis of FMCs and MMOs corroborates the evaluation survey findings. The analysis found that project-supported FMCs earned more than similar enterprises that did not engage with the project (Figure 5).15 The difference between FMCs and similar non-supported enterprises is particularly evident for apple- and grape-focused FMCs. For example, project-supported apple FMCs generated 67 percent (in Quetta) and 23 percent (in Killa Saifullah) greater profits than similar non￾supported businesses. Similarly, a project-supported grape FMC in Mastung generated 48 percent higher profits than a similar non-supported business. FIGURE 5: PER UNIT PROFITS OF FMCs AND NON-SUPPORTED ENTERPRISES Source: FAO (2013). Erskin-Smith, R. (2013). Balochistan Agriculture Project: Aid Memoir. Unpublished Report. See Annex 5 of this report. Note: Units are 18 kilogram (kg) box for apples, 8 kg box for grapes, and 35 kg bag for cauliflower. 14 The p-value represents the probability that the observed difference between the incomes of COs and FMCs/MMOs is due to chance instead of true differences between the groups. In this case, the chance is less than 1 percent. This implies a chance of more than 99 percent that the observed difference reflects a real difference between the two groups. Standard thresholds for statistical significance are p=0.05 (a 95 percent chance that the difference is real) and p=0.10 (a 90 percent chance that the difference is real). Most analyses do not consider p-values greater than 0.10 to reflect suitably strong evidence of differences. 15 An international business development consultant conducted this study. In this study, the author systematically compared per unit profits earned by FMCs and non-project enterprises. The analysis controlled for observable business characteristics so it compared incomes for FMCs with the incomes of similar businesses. Full reference: Erskin-Smith, R. (2013). Balochistan Agriculture Project: Aid Memoir. Unpublished Report. BAP FINAL EVALUATION 17 Capacity of Community Organizations The evaluation’s survey of CO members asked respondents whether the project had increased the capacity of their community to collectively identify their needs and problems and seek assistance from government and other partners to resolve these problems. Eighty-six percent of respondents (90 percent of 473 men and 79 percent of 220 women) reported that the project has increased their community’s capacity to identify needs and problems. Somewhat fewer respondents (77 percent overall, 78 percent of men, and 76 percent of women) said their capacity to seek external assistance to solve problems had improved (Figure 6). FIGURE 6: CHANGES IN COMMUNITIES’ CAPACITY Source: Evaluation survey, August 2016. Women are significantly less likely than men to say that the project increased their community’s capacity to identify their needs (chi-squared=4.61, p<0.05). This could be because the project did less with WCOs than with MCOs and it is more difficult to engage women than men in community development in Balochistan. There was no significant difference between men’s and women’s responses to the question about seeking external assistance (chi-squared=0.03, p=0.80). Consistent with the survey findings, 76 percent of 98 GI respondents (84 CO members, 10 BAP staff, and 4 GoB line department staff) also indicated that the project increased COs’ capacities to identify needs and problems and seek external assistance. Conclusions: Effectiveness The evaluation team concluded that training and inputs were particularly effective interventions for increasing crop and livestock productivity and thus household incomes. Additionally, in the Balochistan “Because of the formation of COs, we are now linked with wholesale markets and developed linkages with institutions.” – MCO member, Killa Saifullah “CO is working with external agencies on different projects ... currently they are working with an organization named WESS [Water, Environment, and Sanitation Society] in implementing [a] WASH project. Under WASH projects they provided us health and hygiene sessions and established toilets, etc.” – WCO member, Killa Saifullah BAP FINAL EVALUATION 18 environment, crop production is inextricably tied to water availability, and water-related interventions played a large role in increasing crop productivity. Given that FMC members earn 47 percent more income than CO members and that there are no significant differences between these two groups on key socio-economic variables such as household size, animal herd size, and condition of household, the evaluation team concludes that the business-oriented approach was successful. The strategy of using COs as a means to rally target beneficiaries has provided them with an introduction to organization and encouraged economic and social change. Both have been important and contributed to project results. Without this instrument (i.e., the CO), working to develop a future cadre of entrepreneurial enterprise owners may not have been possible. The project has been able to design and deliver capacity-building initiatives for government, the community, women, and those who have the potential and interest in entrepreneurialism. Over 10 to 12 years, the project has worked with provincial counterparts and helped internalize institutional activities that support extension in agriculture, livestock, and water management. The project has been central in introducing technical solutions and inputs through training and market-based economics. Survey and qualitative interview respondents indicated that they considered these solutions to have been of high quality. The project was efficient in the sense that it generated $61.0 million in increased incomes for poor, rural households for an expenditure of $28.2 million (both in inflation-adjusted 2015 dollars)—$2.17 for every dollar spent. It is also important to mention that this increase in income is plausibly attributable to the project activities. This figure accounts for monetary benefits only and does not consider the non￾monetary benefits associated with community mobilization, women’s empowerment, improved nutrition, or stability. It is also based on current benefits only and does not consider the future benefits that arise from sustainable results. Evaluation Question 2: Sustainability To what extent has the project design resulted in sustainable impacts? Activities and Results Are the activities and results likely to be sustained after the project is completed? The surveys of MCO and WCO members presented a list of project activities. They asked respondents whether they had participated in each activity, and if so, whether positive results of the activity, if any, would continue after the project ends. Almost all (99 to 100 percent) of male respondents who participated in an activity said that the positive results of the project activities were sustainable. An overwhelming majority (at least 92 percent) of women also responded in the affirmative. Female survey respondents reported greater variation than men in the levels of perceived sustainability across women-focused activities and districts. Figure 7 illustrates district-level women’s responses related to four key women-focused project activities (food processing, kitchen gardening, animal feeding, and CO capacity building). Among the districts, women in Killa Saifullah reported the lowest levels of sustainability for kitchen garden and animal feeding activities. BAP FINAL EVALUATION 19 FIGURE 7: PERCEIVED SUSTAINABILITY OF RESULTS – WOMEN Source: Evaluation survey, August 2016. The responses from qualitative interviews (GIs with project beneficiaries and KIIs with stakeholders) concerning the sustainability of project activities displayed much greater variation across project components (Figure 8). Seventy-three percent of 80 GI respondents believed livestock activities were sustainable, 65 percent of 69 felt that crop activities were likely sustainable, and only 25 percent of 16 respondents felt that water-focused activities were. It is notable that respondents believed that water activities such as irrigation infrastructure and karez rehabilitation that involved large initial investments in infrastructure and continued maintenance were less sustainable than crop and livestock activities that were relatively low cost. FIGURE 8: SUSTAINABILITY QUALITATIVE RESPONSES Source: Evaluation interviews, August 2016. “I can’t afford continuing cultivation if I do not receive external help in the form of seeds and training.” – A female beneficiary BAP FINAL EVALUATION 20 On the other hand, crop and livestock activities included skills development, which can sustain even without new investment. In response to an open-ended question about factors ensuring sustainability, enhancement of the community’s capacity and development of private sector linkages (markets) emerged as the most frequently mentioned factors (Figure 9). FIGURE 9: FACTORS FREQUENTLY MENTIONED ENSURING SUSTAINABILITY Source: Evaluation interviews, August 2016. Building Local Capacity Is the project “institutionalizing” or building local capacity to undertake similar activities? The evaluation examined this question from the point of view of capacity created within both communities and relevant government departments. With respect to community capacity, the evaluation team reviewed the sustainability of the various types of participatory organizations created during the project. The survey asked respondents how likely (on a five-point Likert scale from very likely to very unlikely) their CO, FMC, or MMO was to continue to exist after the project ends. Table 5 reports the percentage of respondents who said that their CO was somewhat likely or very likely to continue to exist after project ends. Except in Killa Saifullah, FMC and MMO members reported higher levels of perceived sustainability than MCOs and WCOs.16 This may be because FMCs and MMOs (1) are formally registered organizations and (2) provide substantially greater economic benefits to members. TABLE 5: PERCEIVED SUSTAINABILITY OF PARTICIPATORY ORGANIZATIONS Organization Type Killa Saifullah (n=219) Sherani (n=181) Zhob (n=196) WCO 63% 67% 74% MCO 61% 83% 53% FMC/MMO 63% 93% 86% Source: Evaluation survey, August 2016. 16 The evaluation team could find no explanation for the results in Killa Saifullah. BAP FINAL EVALUATION 21 The responses from qualitative interviews reported in Figure 10 corroborate survey findings, as FMC and MMO members reported higher levels (81 percent of 36 respondents) of perceived sustainability than respondents from COs. FIGURE 10: WILL PARTICIPATORY ORGANIZATIONS SURVIVE? (BY RESPONDENT TYPE) Source: Evaluation survey, August 2016. The project’s maturity index provides another perspective on CO sustainability. The CO maturity assessment classified COs into four categories: mature, semi-mature, initial stage, and dormant.17 The maturity index assessment classified 30 percent of the 915 COs as mature, 28 percent as semi-mature, and 30 percent as still in an initial development stage, and 13 percent as dormant, meaning their members have not met in the last six months (Figure 11). 17 Mature COs are the self-sustaining men’s and women’s COs, FMCs, and MMOs also supporting neighboring non-project communities. Semi-mature COs are food-secure and profit-making men’s and women’s COs with some functional FMCs and MMOs. Initial stage COs are food-secure men’s and women’s COs and few functional FMCs. Dormant COs are those that lost interest in the community development process due to internal conflict or the security situation. For details, see USAID, COs Maturity Assessment: Balochistan Agriculture Project (n.d.). “It really takes four to six years for businesses to get established. But they did see up to 80 percent increase in revenue from sales of apples for example for FMCs in 2015.” – FAO senior consultant BAP FINAL EVALUATION 22 FIGURE 11: MATURITY INDEX – SUSTAINABILITY Source: BAP maturity assessment. To assess the institutionalization of practices, the survey of MCOs asked respondents about the extent to which the frequency of visits and quality of services by GoB agriculture and livestock officers changed due to the project. Figure 12 reports the percentage of respondents who said that the frequency and quality of visits of agriculture and livestock officers increased or increased significantly due to the project. Around 60 percent respondents said that the frequency of visits of agriculture and livestock officers had increased. More than half said that the quality of the services of agriculture and livestock officers had increased. The team’s analysis and validation interviews were not able to determine the cause of the substantial differences across districts, particularly between Sherani and Killa Saifullah. FIGURE 12: INSTITUTIONALIZATION IN GOVERNMENT DEPARTMENTS Source: Evaluation survey, August 2016. While these responses reveal that project activities have succeeded in enhancing capacity within some relevant government departments, interview respondents, including GoB officials, said that whether the improvements will sustain depends on the availability of resources, willingness of government, and full BAP FINAL EVALUATION 23 involvement of line departments in project implementation. Comments from government officials and FAO staff illustrate these sentiments. Fifty-nine percent of 34 KII respondents felt that the project has influenced GoB’s relevant policies. One example is the agricultural policy developed by the project at the request of the previous Balochistan chief minister, which has been waiting for approval ever since the change of the provincial government early in 2016. The adoption of this policy, with suitable changes in areas such as water subsidies and climate change adaptation, can go a long way in strengthening capacities within relevant government departments. Replication To what extent are the activities and results of the project replicable? Replication is related to sustainability in two ways. First, organic replication implies that activities are valuable and practical—both necessary conditions for sustainability. Second, replication may contribute to building a critical mass of demand (e.g., for improved seeds) that can facilitate sustainability of beneficial activities. The evaluation reviewed the extent to which non-project households replicated project practices and the unintended benefits and harms produced by the project. In GIs with beneficiaries, the evaluation team asked respondents if they knew of instances where others had replicated project activities (Figure 13Error! Reference source not found.). Around three-fourths of respondents reported that they had observed neighbors or relatives replicating women-focused and livestock activities. Fewer (25 percent) reported replication of water-related activities. “The reason for not continuing is the lack of interest by the government.” – Government staff officer “The main constraints on how to sustain the project results involve the sheer scale of the problems in Balochistan and the financial limitations of the government.” – Government staff officer “The role of the provincial departments should not be limited to membership of the steering committee. The other strategy could be to give money to line departments and they implement the project instead of FAO. This way, the government will have enhanced ownership.” – Government staff officer “BAP is already working on a policy document which has been finalized and presented to the chief minister. The delay is due to the transition of chief ministers. We have already given it to the new chief minister but he has not presented it to the assembly.” – FAO staff BAP FINAL EVALUATION 24 FIGURE 13: REPLICATION OF PROJECT ACTIVITIES Source: Evaluation interviews, August 2016. To elicit more nuanced perceptions about factors contributing to replicability, the evaluation team asked beneficiaries in GIs an open-ended question about why they would continue project activities. For all activities, community interaction (e.g., meeting neighbors and relatives) emerged as the most frequently mentioned factor affecting replication of project activities (Figure 14). It is also important to mention that another project, AusABBA, funded by the Australian government, has replicated the development approach of BAP in other districts of Balochistan. FIGURE 14: FACTORS AFFECTING REPLICABILITY Source: Evaluation interviews, August 2016. Unintended Benefits and Harms In GIs with project beneficiaries and KIIs with project stakeholders, the evaluation team asked whether project activities had led to any unintended benefits or harm. Seventy-three percent of 100 respondents reported unintended benefits, while only 15 percent reported unintended harm. When asked to describe benefits, respondents most often mentioned economic benefits. For example, one project beneficiary noted that the introduction of pipe irrigation by the project increased the pipe business in the area. Another attributed growth in the paper carton business in his area to beneficiaries’ increased demand for packaging materials. BAP FINAL EVALUATION 25 Conclusions: Sustainability and Replicability Most project beneficiaries say they plan to sustain project activities and practices. When asked to describe conditions for sustainability, however, key informants see water-focused activities as having lower sustainability. In general, activities that require less external support or investment—such as crop (FFS and kitchen gardens) and livestock (mandis and live weight pricing) practices focusing on individual skills development—are more likely to be sustainable. Qualitative data suggests that the structure of COs, the capacity built, technical inputs, and linkages with other organizations are important in determining the continuation of COs. The institutionalization of capacities within relevant government departments can be another source of sustainability for project practices. Key informants noted that the project has built the capacities of government agriculture, livestock, and water departments to provide better services to communities, capacities reflected in more frequent and higher quality visits by extension workers. The sustainability of this capacity will require continued funding from the government and adoption of the new agricultural policy developed by the project. Similar to sustainability, replicability of project practices among non-project families was highest for project activities that required less external investment. Among beneficiaries, replication occurred largely organically through personal interactions with neighbors or relatives. By comparison, public sector efforts and private sector linkages were ineffective. Replication also occurred at the donor level: another project, AusABBA, funded by the Australian government, has replicated the development approach of BAP in additional districts in Balochistan. Evaluation Question 3: Women’s Empowerment To what extent did interventions improve the empowerment of women in the target regions? The evaluation examined women’s empowerment from the perspectives of economic opportunity, economic decision-making, and social empowerment and change. The surveys and GIs with WCO and MCO members asked questions related to women’s empowerment. To determine whether the project had improved women’s economic empowerment, the survey asked whether the project had improved women’s income, ability to make decisions about household assets, ability to make decisions about household expenditures, access to markets, and ability to work outside their homes. The data showed that women were significantly more likely than men to believe the project had empowered them on all indictors of economic empowerment (Figure 15). The project appears to have been most effective in increasing women’s incomes, involvement in decisions about household expenditures, and decisions about household assets. It contributed less to women’s access to markets and ability to work outside the home—both related to mobility, which is a particularly sensitive issue in the conservative culture of Balochistan. “Because of project installation of PVC [polyvinyl chloride] pipeline, the business of PVC pipeline has been started in the area.” – MCO member, Killa Saifullah “Due to high demand for paper cartons, the relevant business has started in the district.” – MMO member, Zhob BAP FINAL EVALUATION 26 FIGURE 15: PERCEIVED EFFECT ON WOMEN’S ECONOMIC EMPOWERMENT Source: Evaluation household survey, August 2016. To determine whether the project improved social empowerment, the survey asked respondents whether involvement in the project had improved women’s ability to express disagreement within their community, women’s confidence in their ability to improve their future, and their ability to take leadership roles in community activities. Overall, more than half of women surveyed reported improvement in some dimension of social and economic empowerment. As with measures of economic empowerment, women were more likely than men to perceive improvements in all the social empowerment indicators (Figure 16). However, across the board, women (and men) believed the project was more effective at improving economic empowerment than social empowerment. FIGURE 16: PERCEIVED EFFECT ON WOMEN’S SOCIAL EMPOWERMENT Source: Evaluation household survey, 2016. The large disparity between men’s and women’s responses on issues of economic and social empowerment may reflect the fact that few project-supported households included both men and women who were members of MCOs and WCOs, respectively. Therefore, the households of most male survey respondents did not contain a woman who was a member of a WCO and would have benefited from women-oriented project activities. The differences may also reflect the conservative nature of society in the project areas where the role of women in economic activities is constrained by men. BAP FINAL EVALUATION 27 To better understand the perceptions of WCO and MCO members and project stakeholders regarding women’s empowerment, the evaluation team asked participants in GIs and KIIs whether the project had improved women’s empowerment, and if so, how. Seventy-one percent of 62 respondents said that women’s participation in project activities increased household income. In response to the open-ended question about how the project had increased women’s empowerment, 42 percent of 44 respondents explained that it had increased women’s ability to make decisions about household finances, 39 percent believed that WCOs played a role in increasing women’s empowerment in the community, and 18 percent said that the project improved women’s ability to take a leadership role in the community.18 FAO staff provided examples of significant improvements in women’s social empowerment attributable to project activities. For instance, in 2008 it was impossible for a non-family male to meet with women’s groups. However, by the end of the project in 2015, many WCO members were willing to meet with male project staff and participate in project-sponsored meetings that included men. Conclusions: Women’s Empowerment The evaluation team concluded that the project improved women’s empowerment along both economic and social dimensions. Few men and women reported that the project increased women’s ability to work outside their homes or their access to markets, both of which run counter to the conservative culture of Balochistan. This also suggests that the improvements in the economic empowerment of women are largely related to home-based economic issues and less with activities that require mobility. The activities in which the project engaged women, such as kitchen gardening, animal keeping, and poultry, were largely traditional women’s activities, and the project had less success enhancing women’s engagement in more novel, market-based, and profitable activities. This may be due to the socially conservative culture and the fact that there was no women-specialized agency involved in the project to undertake extensive social awareness-raising and mobilization of men to try to reduce cultural barriers related to women’s economic empowerment. KIIs and GIs revealed the perception that the project improved women’s economic empowerment more than their social empowerment, with a minority of respondents reporting increases in two of three empowerment dimensions, i.e., expressing disagreement in the community and taking community leadership roles. This highlights the fact that the project has been less successful in producing improvements in social empowerment, which in turn may have undermined the extent of progress in economic empowerment, especially economic mobility. Crucially, only 39 percent of survey respondents felt that WCOs had played a role in enhancing women’s empowerment, suggesting the need to clarify and strengthen the WCOs’ role in this regard. Nonetheless, keeping in view the conservative nature of 18 The 44 respondents who provided information are the 71 percent of 62 respondents who said that the project had increased women’s empowerment. “Kitchen gardening is beneficial for women, but most women still believe that gender roles have not markedly changed, as women are taking ‘domestic’ decisions while men are responsible for decisions outside the house.” – MCO member, Zhob “In our culture, people do not allow/support their females in leadership roles at any kind of social/political level. In the community, only elder women get a chance to be in leadership roles and take decisions for the family.” – WCO member, Killa Saifullah “Through kitchen gardens, women have enough vegetables for household use on a daily basis. Women sell extra produce to nearby houses and other community members. Production and selling of different types of vegetables in the market has increased income.” – WCO member, Killa Saifullah BAP FINAL EVALUATION 28 the Balochistan culture, even small improvements in women’s social empowerment represent a substantial achievement. CONCLUSIONS Relevance of agricultural interventions: Respondents saw the project as relevant to community needs because of its agricultural focus as much as because of its focus on community development and organization. Project beneficiaries were farmers in a harsh, arid, and remote region of Pakistan where agriculture is challenging. Water scarcity results in low crop and livestock productivity. With input and output markets underdeveloped and infrastructure poor or absent, support interventions have had to be tailored to activities that are possible. Research and extension systems remain weak with limited outreach. Farmers have very little, if any, access to knowledge and information on improved technologies, practices, and opportunities for increasing crop and livestock productivity. Most poor, rural households in the project area are food deficient and devote as much as 80 percent of household expenditure to food items. Off-farm employment opportunities in rural areas are limited, and seasonal out-migration of male household members is common. The project targeted poor, rural men and women in households dependent on agriculture, who are engaged in crop and livestock production, and who face such harsh conditions.19 Cost-effectiveness: The project generated $61.0 million in increased incomes for poor, rural households with a total outlay of $28.2 million (both expressed in 2015 dollars). This amounts to a net present value (the present value of benefits minus the present value of costs) of $32.8 million and a return of $2.17 for every dollar spent. It is important to mention that this increase in income is plausibly attributable to the project activities. This figure accounts for monetary benefits only and does not consider the non-monetary benefits associated with community mobilization, women’s empowerment, improved nutrition, or stability. It is also based on current benefits only and does not consider the future benefits that arise from sustainable results. The community development approach: The project was highly relevant on a number of levels including government, community members, and the socio-economic context in which the project was implemented. Working in remote and difficult environments and within restrictive social arrangements, the approach of using community development was highly relevant and effective in ensuring local support. Capacity building, training, and ensuring that women were equally part of the development process has resulted in strong success in terms of encouraging full community involvement and greater empowerment. Collaboration with government: In project design and development of the Provincial Agriculture Sector Policy and Strategy, FAO intensively cooperated with relevant GoB departments. Generally, FAO-GoB cooperation was good at the district level but could have been more intensive at the provincial level. While working with poorly financed and under-resourced provincial governments, projects can collaborate with official institutions and support structural and policy changes where needed. This is not necessary for implementation, but is relevant because it ensures local ownership, is good institutional practice, and can lead to significant improvements in the services farmers and others 19 BAP Project Document (Project code: GCP/PAK/113/USA) (2009): 17. “Due to the project, I am also participating in financial decision-making in the household. Male members respect my opinion.” – WCO member BAP FINAL EVALUATION 29 in rural environments should be able to access. While working with government may be difficult, the partnership is vital to the economic and policy changes that will lead to opportunities that are feasible within enabling eco-political systems. Effectiveness of project components: Survey results and the project’s GVAP calculations found that the project has been effective in increasing crop and livestock productivity and beneficiaries’ income from crop (particularly fruit and vegetable) and livestock activities. This is true for households, women, and enterprises such as the FMCs. Crop and water-related activities contributed most to income and capacity building (knowledge), and inputs were the most effective types of interventions for both agriculture and livestock. Effectiveness of the development approach: The approach of shifting from community-focused development to commercially oriented support interventions was relevant as there was a need to demonstrate the potential for successful enterprises and link them to markets for sustainability. At the household level, kitchen gardening has provided the opportunity for quick wins through improved horticultural practices. Sustainability of activities and results: Project beneficiaries generally see project activities and practices as sustainable; however, when asked how activities would be sustained, GI and KII respondents are less optimistic, particularly about water activities. In general, activities that require little or no external support or investment—such as crop (FFS and kitchen gardens) and livestock (mandis and live weight pricing) practices focusing on individual skills development—are more likely to sustain. Activities that require further investment and external support—such as water structures—are less likely to sustain. Sustainability of COs: The sustainability of many project activities beyond those covering simple skills development of individuals will also depend on the sustainability of the project-initiated COs. While the majority of project beneficiaries feel their COs will survive, FAO’s analysis classifies 58 percent of COs as mature or semi-mature organizations and the remainder as either initial stage or dormant. The evaluation team is of the view that initial stage and dormant COs are less likely to sustain. However, FAO staff noted that they are developing an exit strategy that includes handing the 30 percent of COs that are in an initial stage of development over to local partners20 to enhance their prospects for sustainability. FMCs and MMOs are more likely to be sustainable than COs since they are formal organizations and provide tangible joint benefits such as economies of scale and market linkages. Sustainability of government capacity: The institutionalization of capacities within relevant government departments can be another source of sustainability for project practices. The project has built the capacities of government agriculture, livestock, and water departments to provide better services to communities, but their sustainability will require continued funding from the government and adoption of the new agricultural policy developed by the project. This policy, which the project developed at the request of the last government, has still not been approved by the new government, thus raising concerns about sustainability. Replication: Activities that require little or no external support or investment have been more widely replicated than those requiring major investment, such as water activities. Non-project farmers’ adoption of productivity-enhancing technologies and practices introduced by the project has happened mainly through their informal interaction with CO members. If FMC and MMO members are similar to CO members in terms of various socio-economic characteristics, as the data suggest, the business- 20 Examples include the Pakistan Poverty Alleviation Fund (PPAF) and the Aga Khan Network, which work with rural communities in Balochistan. BAP FINAL EVALUATION 30 oriented approach can be replicated. It is also important to mention that another project, AusABBA, funded by the Australian government, has replicated the development approach of BAP. Women’s economic empowerment: BAP created economic opportunity for women, which led to women’s economic empowerment, manifested through increased income and financial decision-making at the household level. Within economic empowerment, women’s income and control over decisions related to assets and expenditure showed the greatest increases. Women-specific project activities were focused on home-based income generation rather than access to markets and enterprise development. These included traditional and subsistence-oriented activities, such as kitchen gardens, poultry, and livestock. Mobility-related economic opportunities (access to markets and the ability to work outside the home) showed much less of an increase. Women’s social empowerment: Women’s economic empowerment has improved more than their social empowerment. Within social empowerment, women’s ability to improve their future showed the greatest increase, followed by the ability to express disagreement. Social empowerment is largely related to the individual and household levels rather than the community level. No significant change was observed regarding men’s perceptions about women’s status in the society, likely due to the conservative views about women in the region and the fact that most MCO members the team interviewed did not have women in the household who participated in women-focused project activities. Finally, WCOs provided a forum for organizing women and implementing project activities, but they did not engage in social mobilization for women’s empowerment. RECOMMENDATIONS The following recommendations represent general thematic areas for future consideration when planning projects that have short, medium, or long-term social and economic change objectives and operate in remote, insular environments such as Balochistan. Community and Market Development The community development approach (using COs) is a useful entry mechanism for working in remote, isolated, and undeveloped areas, but future projects should place more emphasis on strengthening the capacity of COs to make them more sustainable if their purpose as a social or economic institution is to continue (in other words, their purpose needs to be articulated very early in the process). COs should not be used simply as a way to deliver development projects but rather as a legitimate institution that binds communities together more purposively, giving them social status and their members the tools to resolve issues or encourage gathering for discussion, sharing, learning, and social events. Subjects for CO development would certainly be in administration, governance, the development of services, and the need to generate income to allow COs to function in the future. Given the success of the business-oriented approach, future projects should focus on creating more market-oriented activities so that a larger percentage of community members can join FMCs or MMOs. This may mean deeper capacity building and training in skills that can create a critical mass of entrepreneurialism. Capacity building should be part of the support to both FMCs and MMOs. Subjects would include areas such as consistency in quality and reliability of commodity supply, contracting, inspection, pricing, and general bookkeeping. To strengthen the project’s market development approach, future projects should focus on financial and market information services for FMCs and MMOs, allowing such enterprises to access existing financial products more easily but also to become more “banked.” In future projects, FMCs should be introduced BAP FINAL EVALUATION 31 much earlier as a working business entity, so that they can serve as demonstrations for commercial activities and get linked to services such as finance more quickly. Future projects should consider implementing a complete value chain approach that engages not just one or two players, but players all along the value chain. Projects should consider a systemic or systems approach as a way to change the input supply, production, processing and value adding, transport, and consumption levels of the value chain. The project’s work in the wool sector would be an excellent starting point to use as a model for other commodity value chains. As another example, expanding kitchen gardeners to become suppliers in the marketplace would offer enhanced opportunities for generating income for women while also addressing health and nutritional challenges. Value-added activities are important and areas where FMCs (male or female) can play a significant role. Government and development projects should be encouraged to assist producers and processors to improve food handling and increase income opportunities. With greater value-added activities, incomes will increase. To enhance the sustainability of activities, USAID should encourage future projects to link communities more strongly with public, private, and non-profit service providers and help them form networks.21 This can facilitate local community and local area planning and improve compatibility with local government planning and resource allocation, such as for roads, schools, or market construction. Women’s Empowerment Future projects should place greater emphasis on progressively introducing innovative and market￾focused women’s economic activities. There is a need to widen the inclusivity of technology use by all community members to raise participation but also to redress an imbalance in access to activities between men and women. Future projects should also place greater emphasis on strengthening the capacity and role of WCOs so that they can play a more active part in enhancing women’s economic and social empowerment. In addition, it would be important to establish FMCs run by women in identified value chains. Future projects should adopt an integrated approach to social empowerment through building alliances with relevant organizations. This will include working closely with civil society organizations and non￾governmental organizations (NGOs) operating in the same working space. Strengthening Public Sector Development projects cannot operate in isolation of national or local government institutions. However difficult the challenges might be, projects must engage with government agencies. Working with government institutions that operate with limited budgets or limited qualified personnel presents particular challenges but provides legitimacy and a framework for anchoring the changes that are needed for sustainability. Ensuring that government agencies become good partners facilitates implementation and permits transitional change to continue. Mechanisms to help achieve this include joint exercises, capacity building, and collaboration. The evaluation team suggests that despite capacity constraints, future similar projects engage more directly with government since relevant government departments 21 Examples of non-profit service providers include the Pakistan Poverty Alleviation Fund (PPAF) and the Aga Khan Network. BAP FINAL EVALUATION 32 play an important role in reinforcing ownership, sustaining their commitment, and continuing the project’s work beyond external financing and technical assistance. The public sector needs to be more open in terms of employing women to deliver services to women who are dependent on the land. To this end, the public sector needs to invest in building the capacity of women farmers and the extension workers that support them. The Balochistan Agricultural Sector Policy and Strategy prepared by BAP needs to be updated and the GoB encouraged to approve it quickly. The AusABBA project could serve as a vehicle for this. BAP FINAL EVALUATION 33 ANNEXES Annex 1: Evaluation Scope of Work BAP FINAL EVALUATION 34 BAP FINAL EVALUATION 35 BAP FINAL EVALUATION 36 BAP FINAL EVALUATION 37 BAP FINAL EVALUATION 38 BAP FINAL EVALUATION 39 BAP FINAL EVALUATION 40 BAP FINAL EVALUATION 41 BAP FINAL EVALUATION 42 BAP FINAL EVALUATION 43 BAP FINAL EVALUATION 44 BAP FINAL EVALUATION 45 BAP FINAL EVALUATION 46 BAP FINAL EVALUATION 47 BAP FINAL EVALUATION 48 BAP FINAL EVALUATION 49 BAP FINAL EVALUATION 50 Annex 2: Assignment Work Plan BAP FINAL EVALUATION 51 BAP FINAL EVALUATION 52 BAP FINAL EVALUATION 53 BAP FINAL EVALUATION 54 BAP FINAL EVALUATION 55 BAP FINAL EVALUATION 56 BAP FINAL EVALUATION 57 BAP FINAL EVALUATION 58 BAP FINAL EVALUATION 59 BAP FINAL EVALUATION 60 BAP FINAL EVALUATION 61 BAP FINAL EVALUATION 62 BAP FINAL EVALUATION 63 BAP FINAL EVALUATION 64 BAP FINAL EVALUATION 65 BAP FINAL EVALUATION 66 BAP FINAL EVALUATION 67 BAP FINAL EVALUATION 68 BAP FINAL EVALUATION 69 BAP FINAL EVALUATION 70 BAP FINAL EVALUATION 71 Annex 3: Data Collection Instruments BAP Final Evaluation Survey (Women)-2016 Form Code: _ _ _ / _ _ _ /_ _ _ / _ _ _ DD District Enu. Supervisor Introduction: Assalam O Alaikum, my name is ………..…………….., We are from …VTT Global…… we are here to Evaluate progress of Baluchistan Agricultural project implemented by FAO. Since, you are a member of CO/FMC/MMO, we would like to ask you a few questions. The entire process should not take more than 1 hour. اسالم عليکم زما نوم.............................دی زہ دہ Global VTTله طرفه راغلي يم چی يو تحقيقی ادارہ دہ. زما د راتلو مقصد د بلوچستان زرعي پروجيکټ جائزہ اخستل دی پرکوم چي FAO کار کړی دی. په کوم کي چی ته دہ MMO/FMC/CO ممبر يے۔ زہ لتا زہ يو سو پشتنی کوم. پہ دا سلسلہ کی ستا سہ قيمتی وخت اخلم۔ کہ پہ کوم سوال نہ سوے پوہ يی سے۔ ٗ دوبارہ پشتنہ کوا Objective: The objective of this survey is to learn about the agricultural and livestock practices of households in Baluchistan, how agriculture and livestock activities contribute to household income, and to collect data on other socioeconomic and demographic characteristics. د دې سروے مقصد دا دی چي په بلوچستان کي د زراعت او مالداري په حقله معلومات تر السہ کو. چي د زراعت او مالداري کارونو )چي پروجيکټ کړی دی( د کورنۍ په ګټه کي کردار لري ؟ او د سماجي او معاشي ژوند او نورو چارواو کاروبارو په حقله معلومات راغونډ کړو. Use of data: The data we collect will be used to learn how if and how the Baluchistan Agriculture Project is achieving its objectives and to improve the project so it better serves the needs of participating households. Only project staff will see the raw data and the project will never share your name or personal data with any other agency, organization, or individual. راغونډ شوي معلومات به د دې دپارہ استعماليږي چي پروجيکټ څہ حاصل کړی دی. او څنګه په ښه طريقہ په پروجيکټ کي شاملي کورنۍ خپل ضروريات پورہ کوی. Confidentiality: Your responses to the questions I ask are completely confidential. We will use your answers in project reports but never in a form that will identify you or members of your family. You may choose not to answer any question you don't want to answer. Just let me know if you don't want to answer a question and we'll move on to the next question. له تا څخه پوښتل سوي معلومات )جوابونه( به تر موږہ محدودہ وی دا بہ صرف د پروجيکټ په رپورټ کي استعمالہ وو. په هغه کي به نه ستا او نه ستا د کورنۍ د يو فرد نوم راځي. د کوم سوال چي ته جواب راکول نه غواړې نو پروا نۀ لري. BAP FINAL EVALUATION 72 a. Location information کوډCode نومName ضلع District تحصيل Tehsil کلی Village b. Questionnaire processing Task Date Completed Name Day Month Year انټرويو Interview څارونکي کتل check Supervisor ګډوډه کتل check Random دفتري کتل check Office د معلوماتو اندراج entry Data c. Household information Name of household head د کورنۍ د مشر نوم Name of respondent (if not head) د جواب ورکونکي نوم )که مشر نۀ وي( Relationship to head (if not head) Insert Code د کور له مشر سره رښته )که مشر نۀ وي( 1. Household .۱کورنۍ 2. Spouse .۲خاوند/ښځه 3. Son/daughter .۳زوی/لور 4. Son/daughter in law .۴خوشينه/اخشی 5. Brother / Sister .۵ورور/خور 6. Parent or Parent-in-law .۶والدين/خوسر، خواښي 7. Grandchild .۷نمسی 8. Grand Parent .۸نيکګان 9. Other relative .۹نور رشته داران 10. Other non-relative .۱۰نور هغه چي رشته داران BAP FINAL EVALUATION 73 d. Type of respondent: (Circle one number) (Enumerator, write name of CO/FMC/MMO) پر يوه باندي دائره ولګوه Code کوډ Type نوم Name قسم Date of Formation CO/FMC/MMO (Year) 1 CO 2 FMC 3 MMO e. What is the condition of your house? (Circle one number) پر يوه باندي دائره ولګوه قسمType کوډCode پوخ Pacca 1 کچه Katcha 2 نيم پوخ pacca Semi 3 Module K: Household Characteristics خصلتونه کورنۍ د Enumerator: Read this definition to the respondent. The next series of questions ask about the members of your household. By your household I mean all those who live in the same house for at least 5 days per week and who eat from the same table (share a common kitchen) and anyone who is living somewhere else but providing financial support to the household or living somewhere else but receiving financial support from the household. دا الندي سوالونه به ستاد کورنۍ په باره کي وي. ستا له کونۍ مراد هه ټول خلګ چي په هفته کي 5 شپې په يوه چارديواري کي ژوند کوي او پر يوه دسترخوان ډوډۍ خوري او هغه خلګ هم چي بل ځای هوسي او ستاو کورنۍ ته مالي امداد ورکوي يا يې اخلي. ستا په کورنۍ کي داسي څومره خلګ دي. K1. How many of the following individuals live in this household? ستا سو په کورنۍ کي څو خلګ اوسي؟ Gender Adult (>=18 years) Children (<18years) a B نارينه Male 1 ښځينهFemale 2 BAP FINAL EVALUATION 74 K2. Please tell me about yourself and about the head of the household:راکړی معلومات کي بارہ په کورنۍ او ځان خپل د K2. Please tell me about yourself and about the head of the household Is this person male or female? آيا دا سړی دی که ښځه؟ How old is this person (years) څو عمر يې دی؟ In what year was this person born? په کوم کال کي پيدا شوې ده؟ What is the highest grade this person completed in school? تعليم يې څو دی؟ What is the primary income￾earning activity of this person? د آمدن بنيادي ذريعه يې څه ده؟ What is the secondary income￾earning activity of this person? د آمدن بله ذريعه يې څه ده؟ Name 1 Male, 2 Female years Year (4 digits) see codes below see codes below see codes below a b c d E F g 1 Respondent 2 Household head (leave blank if respondent is the household head) Education codes Code 1 2 3 4 5 6 7 8 -9 Education attainment None Primary Middle Secondary Intermediate Undergraduate degree Graduate degree Master Don't know/refused انکاري / شپاړلسم څوارلسم ديارلسم دولسم لسم مډل پرائمري هيڅ نه نه يم خبر Income Codes Code: Income earning activities 1. Crop production زمينداري 2. Livestock مالداري 3. Commerce تجارت 4. Other business طالب علم Student 6. نوکر پيشه Employee 5. نورکاروبار 7. Unpaid housework 8. Retired 9. Looking for work 10. Others نور 11. None نه هيڅ 9. Don't know/refused انکاري / نه يم خبر BAP FINAL EVALUATION 75 Module B: Participation in Project Activities گڈون کی کارو پہ پروجیکٹ دہ]-9 = Don’t Know, -8 = No Response, -7 = Not Applicable] B1 Has your community organization participated in this activity? ستا سو سی او پہ دے کار کی برخه اخستې ده؟ Ask only if "yes" to "a". Did your household personally participate in this activity? ستاسو کورنۍ په دے کار کي برخه اخستې ده؟ Ask only if "yes" to "b". Was the activity relevant to your household needs? ايا دا کار ستاسو د کورنۍ سره مطابقت درلود ؟ Ask only if "yes" to "b". Did your household income increased from participating in this activity? په دا کار کي د برخی اخستوسہ ستاسو ده کورنئ پہ آمدن کی اضافہ وسوه؟ Ask only if "yes" to "b". Did your household benefit from participating in this activity in other ways? په دا کار کي د برخی اخستوسہ ستاسو د کورنۍ په ګټه کی آضافہ وسوه ؟ Ask only if "yes" to "b". Will the positive results from this activity sustain/continue for your household after the project ends? د دا پروجيکټ د ختميدو ورستہ بہ ہم تاسو ده دا کاره ګټه ترالسه کوی؟ 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know a b c d e f 1 Food processing training or market visits د خوراک د جوړولو تربيت يا ده مارکيټ کتل 2 Kitchen gardens (seed distribution or training, FFS) کورنئ باغيچہ )د تخم وېښل يا بيا تربيت او ٖ فارمر فيلڈ سکول( 3 وړۍ د وودلو training spinning Wool تربيت 4 Animal rearing training تنکي د حيوانانو پہ باره کی تربيت کول 5 Animal feeding (feed distribution or training) د شودو ده حيوانانو ده خوراک تربيت 6 Drinking water facility in village پہ کلی کی د څيښلو د اوبو بندوبست 7 Rug making (training or marketing) دغالۍ جوړول )تربيت او ده مارکيټ کتل( 8 Capacity building for marketing and linking to markets (exposure visit of FMCs) د مارکيټنگ او کاروبار کولو په حقله د FMC تربيتی دورے. BAP FINAL EVALUATION 76 B1 Has your community organization participated in this activity? ستا سو سی او پہ دے کار کی برخه اخستې ده؟ Ask only if "yes" to "a". Did your household personally participate in this activity? ستاسو کورنۍ په دے کار کي برخه اخستې ده؟ Ask only if "yes" to "b". Was the activity relevant to your household needs? ايا دا کار ستاسو د کورنۍ سره مطابقت درلود ؟ Ask only if "yes" to "b". Did your household income increased from participating in this activity? په دا کار کي د برخی اخستوسہ ستاسو ده کورنئ پہ آمدن کی اضافہ وسوه؟ Ask only if "yes" to "b". Did your household benefit from participating in this activity in other ways? په دا کار کي د برخی اخستوسہ ستاسو د کورنۍ په ګټه کی آضافہ وسوه ؟ Ask only if "yes" to "b". Will the positive results from this activity sustain/continue for your household after the project ends? د دا پروجيکټ د ختميدو ورستہ بہ ہم تاسو ده دا کاره ګټه ترالسه کوی؟ 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know a b c d e f 9 Poultry raising (poultry distribution, training, incubators) چرګان ساتل )چرګان وېښل، يا د چرګانو د ساتلو تربيت او دمشين څخه ايستل 10 Farmer Field Schools FFS (livestock) ده زميندارانو ده تربيت سکولونہ د حيوانانو ساتلو پہ باره کی BAP FINAL EVALUATION 77 Module H: Livestock مالداري H1 Animal type In the past 12 months, have members of your househol d owned any of the following animals? په تيرو 12مياشت و کي له الندني حيوانا نو څہ ستاسو کورنئ کم درلود؟ How many [animal type] does your househo ld currentl y own? ستا کورنۍ اوس څو دانې لري؟ How many [animal type] did your househol d own at this time last year? تېرکال تا په دې وخت کي څو دانې درلودې ؟ During the past 12 months, how many of these animals were born and survived on farm? په تېرو 12 مياشتو کي څومره حيوانا ن پيدا شوي دي؟ During the past 12 months, how many [animal type] did you sell? په تېرو 12 مياشتو کي څومره حيوانا ن تا خرڅ کړي دي. If "E" >0: Considering cash and the value of in￾kind payment, on average, how much did you earn from the sale of all of these animals (or carcasses)? اوسطا تا د يوه حيوان پر خرڅيدو څو ګټه کړې ده؟ During the past 12 months, how many of [animal type] did you eat or give away? په تيره 12 مياشتو کي څومره حيوانا ن تاپہ خپله خوړلي دي؟ How many of these animals died during the past 12 months (or would have died if you had not eaten them)? په تيرو 12 مياشتو کي ستا څو حيوانان مړه شوی دی؟ During the past 12 months, how many of [animal type] did you purchase ? په تېرو 12 مياشتو کي تا څو حيوانا ن واخستل ؟ If "f" >0: How much did you spend to buy these animals? تا څو روپۍ د حيوانا نو په اخستلو خرڅي کړې؟ During the past 12 months, how much did you spend on feed for [animal type]? په تيرو 12 مياشتو کي تا ده حيوانا نو پر خوراک څو روپئ ګاري کړے؟ During the past 12 months, how much did you spend on other costs for [animal type] such as veterinary supplies, taxes, and hired labor? نور دي په حيوانان و څومره خرڅ کړي دي؟ During the past 12 months, how much have you earned from the following activities...? په تيرو 12 مياشتو کي تالہ دے کاره څو پيسې وګټلے؟ 0 No 1 Yes Number Number Number Number Rs. /animal Number Number Number Rs. Rs. Rs. Rs Code A B C D E F G H I J K L M N وزے Goats 1 Goat milk وزې شودې وړۍWool ميږېSheep 2 رمه Cattle 3 Rental باړه اوښ Camel 4 Camel milk د اوښ شودې 5 Poultry چرګان Egg sales داګۍ خرڅالو 6 Rabbits سويان Honey sales دشاتو خرڅول نورOther 7 BAP FINAL EVALUATION 78 H2 During the past 12 months, how much have you earned selling cow milk? په تيرو 12 مياشتو کي ، تا دغواده شودو پہ خرڅولو څو ګټه وه کړه؟ Rs. H3 During the past 12 months, how much have you earned selling animal hides? په تيرو 12 مياشتو کي تا د پوستو پہ خرڅولو څو ګټه وه کړه ؟ Rs. BAP FINAL EVALUATION 79 Module I: Expenditure خرچه 11. How much did your household spent on food items in the last 7 days? په تېرو7ورځو کي تا په خوراکي شيانو څو روپۍ خرچ کړي دي؟ Rs. ________ 12. On each of the following: About how much did your household spend on __________ for domestic consumption during the last 30 days. په تېرو30 ورځو کي په الندني شيانو ستا کورنۍ تقريباً څومره خرڅه کړې ده؟ 0 Nothing - did not buy -9 Don't know - if "don't know" go to next item a .Rs په ډاکټر او دوايانو اخراجات care health/expenses Medical 1. 2. Gas/gas cylinder سلنډر ګيس Rs. 3. Electricity بجلۍ Rs. 4. Kerosene oil ګاسليټ Rs. 5. School and tuition fee ټيوشن ، سکول Rs. 6. Travel costs (fares, vehicle fuel and repair) خرڅونه سفر د Rs. .Rs په مېلسمتيا باندي خرڅه guests Entertaining 7. د کور کرايه :rent House 8. (Enter “0” if household does not pay rent) (If household does not pay rent monthly then calculate monthly rent) Rs. 13. On each of the following: About how much did your household spend on during the last 12 months. په تېرو12مياشتو کي ستا کورنۍ په الندني شيانو باندي څومره خرڅه کړې ده؟ 0 Nothing - did not buy -9 Don't know - if "don't know" go to next item a 1. Education (books, uniform, etc.) )وردۍ او کتابونه )تعليم Rs. 2. Clothing, shoes (excluding those required for school) ګوټونه او کپړے Rs. 3. Equipment and tools (including for agriculture) زار او اسباب Rs. .Rs د کور تعمير و مرمت repair house ,Construction 4. 5. Celebrations, social events (funerals, weddings, etc.) .Rs لمانځل، غونډي، )جنازې، ودونه او داسي نور( .Rs تحفے/خيرات/ زکوۃ Charity/Gifts 6. .Rs د اور لرګي/کوئله/ گيس Coal/Firewood 7. .Rs د حيوانانو خرڅې expenses Veterinary 8. 9. Fines and taxes ټيکس او جرمانې Rs. 10. Others نور Rs. BAP FINAL EVALUATION 80 Module J: Other Income آمدن نور J1. Other income activity In the past 12 months, have members of your household received income from activity? په تېرو 12 مياشتو کي ستاسو د کور ممبرانو له دې سرګرمي څخه آمدن اخستی دی؟ If "b"=yes: In the past 12 months, how much income have members of your household received income from this activity? په تېرو 12 مياشتو کي ستاسو کورنی لہ الندني ذرايعه څہ سو ګټه اخستې ده؟ If "b"=yes: Which household members were most involved in this activity? ستا له کورنۍ زه کم خلک په کار کي شامل وو؟ If "b"=yes: Which household members make decisions about how income from this activity is spent? د دې سرګرمي د آمدن او خرڅ فيصله ستاپه کورنۍ کي کم کسان کوي؟ 1 Yes 2 No Rs. 1 = Mostly men 2 = Mostly women 3 =Both men and women A B C D E 1 اوني شيان Knitting جوړول 2 Poultry Raising (Eggs or چرګان ساتل(Meat 3 Shop Keeping دوکارنداري 4 Formal Salary / Wages تنخواه / روزانه 5 Casual Labor/ Piece ليبرWork 6 Wool Spinning وړۍ ورسل ګلدوزي Embroidery 7 8 Selling processed agriculture products زرعي شيان)حاصال ت ( خرڅول 9 Rug Making غالۍ جوړول 10 Kitchen Gardening کورنۍ باغېچې نور ....... Others 11 BAP FINAL EVALUATION 81 د هر سوال څخه بعد دا پشتنه وکړئ. empowerment s'Women :L Module After reading each question, ask: Would you say it has increased significantly, increased, remained unchanged, decreased, or decreased significantly? (Circle one number) ستا په خيال: ډېر زيات شوی دی زيات شوی دی بدلون نه دی راغلی کم سوی دی يا ډېر کم سوی دی. )پر يوہ دائرہ ولګوی( Increased significantly ډېر زيات شوی دی Increase d زيات شوی دی Remained unchange d بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantly ډېر کم سوی دی QL1A. To what degree, if at all, has women's income changed due to the project? دپروجيکټ له وجي که د ښځو په آمدن کي که څه فرق راغلی دی،نو څومره دی؟ 5 4 3 2 1 QL1B. To what degree, if at all, has women's ability to make decisions about the household’s productive assets (e.g. livestock, inheritance; dowry; household savings) changed due to the project? دپروجيکټ له وجي که د ښځو دکورنۍ آثاثو په حقله د فيصلو مثالً مالداري،وراثت جهيز اختيار کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL1C. To what degree, if at all, has women's ability to make decisions about household expenditures changed due to the project? د پروجيکټ له وجي که د ښځو دکورنۍ آخراجاتو په حقله فيصلو کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL1D. To what extent, if at all, has women’s access to markets changed due to the project? د پروجيکټ له وجي که و مارکيټ ته د ښځو په رسايي کي څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL2B. To what degree, if at all, has women's ability to express disagreements within your community changed due to the project? د پروجيکټ له وجي که په ښځو کي د خپل په حق غوښتولو کي فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL2C. To what degree, if at all, has women's confidence in their ability to improve their future changed due to the project? د پروجيکټ له وجي که د ښځو په قابليت او اعتماد بهتر مستقل په باره کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 BAP FINAL EVALUATION 82 Increased significantly ډېر زيات شوی دی Increase d زيات شوی دی Remained unchange d بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantly ډېر کم سوی دی QL3A. To what extent, if at all, has women’s ability to work outside their home changed due to the project? د پروجيکټ له وجي که د ښځو په باهرني کاروبار کي د برخه اخستو په اختيار کي څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL3B. To what extent, if at all, has women’s ability to take leadership roles in community activities (social, political, etc.) changed due to the project? د دې پروجيکټ له وجه زنانو د کلي د مختلفه کارونو کي څو قدر د مشرئ حق ترالسه کړی دی؟ 5 4 3 2 1 QL3C. To what extent, if at all, has the frequency of violence against women changed within your community due to the project? د پروجيکټ له وجي ستاسو په عالقه کي د ښځو سره په رويو کي که څه تبديلي راغلې ده نو څومره؟ 5 4 3 2 1 Module M: Miscellaneous Project related questions After reading each question, ask: Would you say it has increased significantly, increased, remained unchanged, decreased, or decreased significantly? (Circle one number) د هر سوال څخه بعد دا پوښتنه وکړئ ستاسو په خيال ډېر زيات شوی دی زيات شوی دی بدلون نه دی راغلی کم شوی دی او که ډېر کم شوی دی؟ Increased significantly ډېر زيات شوی دی Increased زيات شوی دی Remained unchanged بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantl ډېر y کم سوی دی QM1A. To what extent, if at all, has the project changed the capacity of your community to identify needs and problems collectively? د پروجيکټ له وجي ستاسو د کلي خپل مشترکه ضروريات او مسائل پېژندلو په صالحيت کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM1B. To what extent, if at all, has the project changed the capacity of your community to seek external assistance from government and other partners to resolve these problems? دپروجيکټ له وجي که ستاسو د کلي د خلګو دمسائل د حل په باره کي د باهرني امداد د حاصلولو په صالحيت کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 BAP FINAL EVALUATION 83 Increased significantly ډېر زيات شوی دی Increased زيات شوی دی Remained unchanged بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantl ډېر y کم سوی دی QM2A. To what extent, if at all, did the frequency of visits by GoB agricultural officers to your community change due to the project? د پروجيکټ له وجي د زراعت د افسرانو په دورو کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM2B. To what extent, if at all, did the quality of visits (advice, services) by GoB agricultural officers to your community change due to the project? د پروجيکټ له وجي که د زراعت د افسرانو د دورور په معيار کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM2C. To what extent, if at all, did the frequency of visits by GoB livestock officers to your community change due to the project? د پروجيکټ له وجي که د الئيو سټاک د افسرانو په دورو کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM2D. To what extent, if at all, did the quality of visits (advice, services) by GoB livestock officers to your community change due to the project? د پروجيکټ له وجي که د الئيو سټاک د افسرانو د دورو په معيار کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM3A. To what extent, if at all, has your overall household income changed due to the project? د پروجيکټ له وجي که ستا د کورنۍ په آمدن کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM3B. To what extent, if at all, has your ability to meet your household expenditures changed due to the project? د پروجيکټ له وجي که د کورنۍ په اخراجات پوره کوولو په صالحيت کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 BAP FINAL EVALUATION 84 After reading each question, ask: Would you say it is very likely, somewhat likely, not sure, somewhat unlikely, or very unlikely? د هر سوال ويلو بعد وپوشتی.ډېر امکان لريتر څه حده امکان لري نه يم خبر، امکان نه لري  بالکل امکان نه لري؟ Very likely Some what likely Not sure Some what unlike ly Very unlikel y QM4A . How likely is your CO/FMC/MMO (select one which is applicable) to continue to exist after the project ends? څومره امکان لري چي د پروجيکټ له ختمېدو بعد MMO/FMC/COدوام ولري؟ 5 4 3 2 1 QM4B. How likely are you to continue to participate in CO/FMC/MMO (select one which is applicable) after the project ends? څومره امکان لري چي د پروجيکټ که ختمېدو بعد ته خپل شرکت په MMO/FMC/CO کي جاري وساتي 5 4 3 2 1 BAP FINAL EVALUATION 85 BAP Final Evaluation Survey (Men)-2016 Form Code: _ _ _ / _ _ _ /_ _ _ / _ _ _ DD District Enu. Supervisor Introduction: Assalam O Alaikum, my name is ………..…………….., We are from …VTT Global…… we are here to Evaluate progress of Baluchistan Agricultural project implemented by FAO. Since, you are a member of CO/FMC/MMO, we would like to ask you a few questions. The entire process should not take more than 1 hour. اسالم عليکم زما نوم.............................دی زہ دہ Global VTTله طرفه راغلي يم چی يو تحقيقی ادارہ دہ. زما د راتلو مقصد د بلوچستان زرعي پروجيکټ جائزہ اخستل دی پرکوم چي FAO کار کړی دی. په کوم کي چی ته دہ MMO/FMC/CO ممبر يے۔ زہ لتا زہ يو سو پشتنی کوم. پہ دا سلسلہ کی ستا سہ قيمتی وخت اخلم۔ کہ پہ کوم سوال نہ سوے يی سے۔ ٗ پوہ دوبارہ پشتنہ کوا Objective: The objective of this survey is to learn about the agricultural and livestock practices of households in Baluchistan, how agriculture and livestock activities contribute to household income, and to collect data on other socioeconomic and demographic characteristics. د دې سروے مقصد دا دی چي په بلوچستان کي د زراعت او مالداري په حقله معلومات تر السہ کو. چي د زراعت او مالداري کارونو )چي پروجيکټ کړی دی( د کورنۍ په ګټه کي کردار لري ؟ او د سماجي او معاشي ژوند او نورو چارواو کاروبارو په حقله معلومات راغونډ کړو. Use of data: The data we collect will be used to learn how if and how the Baluchistan Agriculture Project is achieving its objectives and to improve the project so it better serves the needs of participating households. Only project staff will see the raw data and the project will never share your name or personal data with any other agency, organization, or individual. راغونډ شوي معلومات به د دې دپارہ استعماليږي چي پروجيکټ څہ حاصل کړی دی. او څنګه په ښه طريقہ په پروجيکټ کي شاملي کورنۍ خپل ضروريات پورہ کوی. Confidentiality: Your responses to the questions I ask are completely confidential. We will use your answers in project reports but never in a form that will identify you or members of your family. You may choose not to answer any question you don't want to answer. Just let me know if you don't want to answer a question and we'll move on to the next question. له تا څخه پوښتل سوي معلومات )جوابونه( به تر موږہ محدودہ وی دا بہ صرف د پروجيکټ په رپورټ کي استعمالہ وو. په هغه کي به نه ستا او نه ستا د کورنۍ د يو فرد نوم راځي. د کوم سوال چي ته جواب راکول نه غواړې نو پروا نۀ لري. BAP FINAL EVALUATION 86 a. Location information کوډCode نومName ضلع District تحصيل Tehsil کلی Village b. Questionnaire processing Task Date Completed Name Day Month Year انټرويو Interview څارونکي کتل check Supervisor ګډوډه کتل check Random دفتري کتل check Office د معلوماتو اندراج entry Data c. Household information Name of household head د کورنۍ د مشر نوم Name of respondent (if not head) د جواب ورکونکي نوم )که مشر نۀ وي( Relationship to head (if not head) Insert Code د کور له مشر سره رښته )که مشر نۀ وي( 1. Household .۱کورنۍ 2. Spouse .۲خاوند/ښځه 3. Son/daughter .۳زوی/لور 4. Son/daughter in law .۴خوشينه/اخشی 5. Brother / Sister .۵ورور/خور 6. Parent or Parent-in-law .۶والدين/خوسر، خواښي 7. Grandchild .۷نمسی 8. Grand Parent .۸نيکګان 9. Other relative .۹نور رشته داران 10. Other non-relative .۱۰نور هغه چي رشته داران BAP FINAL EVALUATION 87 d. Type of respondent: (Circle one number) (Enumerator, write name of CO/FMC/MMO) پر يوه باندي دائره ولګوه Code نوم Name قسم Type کوډ Date of Formation CO/FMC/MMO (Year) 1 CO 2 FMC 3 MMO e. What is the condition of your house? (Circle one number) پر يوه باندي دائره ولګوه Code قسمType کوډ پوخ Pacca 1 کچه Katcha 2 نيم پوخ pacca Semi 3 Module K: Household Characteristics خصلتونه کورنۍ د Enumerator: Read this definition to the respondent. The next series of questions ask about the members of your household. By your household I mean all those who live in the same house for at least 5 days per week and who eat from the same table (share a common kitchen) and anyone who is living somewhere else but providing financial support to the household or living somewhere else but receiving financial support from the household. دا الندي سوالونه به ستاد کورنۍ په باره کي وي. ستا له کونۍ مراد هه ټول خلګ چي په هفته کي 5 شپې په يوه چارديواري کي ژوند کوي او پر يوه دسترخوان ډوډۍ خوري او هغه خلګ هم چي بل ځای هوسي او ستاو کورنۍ ته مالي امداد ورکوي يا يې اخلي. ستا په کورنۍ کي داسي څومره خلګ دي. K1. How many of the following individuals live in this household? ستا سو په کورنۍ کي څو خلګ اوسي؟ Gender Adult (>=18 years) Children (<18years) a B نارينه Male 1 ښځينهFemale 2 BAP FINAL EVALUATION 88 K2. Please tell me about yourself and about the head of the household: معلومات کي باره په کورنۍ او ځان خپل د راکړی K2. Please tell me about yourself and about the head of the household Is this person male or female? آيا دا سړی دی که ښځه؟ How old is this person (years) څو عمر يې دی؟ In what year was this person born? په کوم کال کي پيدا شوې ده؟ What is the highest grade this person completed in school? تعليم يې څو دی؟ What is the primary income￾earning activity of this person? د آمدن بنيادي ذريعه يې څه ده؟ What is the secondary income-earning activity of this person? د آمدن بله ذريعه يې څه ده؟ Name 1 Male, 2 Female years Year (4 digits) see codes below see codes below see codes below a b c d E F g 1 Respondent 2 Household head (leave blank if respondent is the household head) Education codes Code 1 2 3 4 5 6 7 8 -9 Education attainmen t None Primary Middle Secondary Intermediate Undergraduat e degree Graduate degree Master Don't know/refuse d شپاړلسم څوارلسم ديارلسم دولسم لسم مډل پرائمري هيڅ نه انکاري / نه يم خبر Income Codes Code: Income earning activities 1. Crop production زمينداري 2. Livestock مالداري 3. Commerce تجارت 4. Other business نورکاروبار نوکر Employee 5. طالب علم Student 6. پيشه 7. Unpaid housework 8. Retired 9. Looking for هيڅ نه None 11. نور Others 10. work 9. Don't know/refused نه يم خبر / انکاري BAP FINAL EVALUATION 89 Module B: Participation in Project Activities گڈون کی کارو پہ پروجیکٹ دہ]-9 = Don’t Know, -8 = No Response, -7 = Not Applicable] B1 Has the Balochistan Agriculture Project conducted or offered this activity in your community? ايا بلوچستان ايګريکلچر پروجيکټ ستاسو په کلي کي کارونه کړي دي Ask only if "yes" to "a". Did your household personally participate in this activity? د "هو" په صورت کي ستا کورنۍ ذاتي طور په دې سرګرمي کي حصه اخستې ده. Ask only if "yes" to "b". Was the activity relevant to your household needs په قطار بي کي د "هو" په صورت دا سرګرمي ستا د کورنۍ ضرورياتو سره ورته ده. Ask only if "yes" to "c". Did participating in the activity increase your household's income? په قطار بی کی د "ھو" په صورت دې سرګرمي ستا د کور په ګټه کي اضافه وکړه. Ask only if "yes" to "c". Did your household benefit from participating in this activity in other ways? د آمدن څخه عالوه له دې سرګرمي څخه تا يو بله ګټه واخسته. Ask only if "yes" to "d" or "e". In your opinion, will your household be able to sustain these positive results after the project ends? په قطار "ډي" کي د "هو" په صورت ستا په خيال به ستا کورنۍ کي د پروجکيټ د ختمېدو په صورت کي د پروجيکټ ښه اثرات جاري وساتي که نۀ. 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know a B c d e F 1 Increasing crop yields (improved seed distributed, training in productivity improvement) ده فصل پہ پيداوار کی ده زيتوالی ُ او ده بہترئ ده پاره تخم ويشل او ٹرينينگ( 2 Distributing plant material and training in cultivation of high value crops and establishment of Nurseries (i.e., vegetables, orchards) ده زيات پيداوار ده درختو او سبزيانو نياالن ويشل, نيال خانے جوڑول او ٹريننگ 3 Distributing plant material and training in cultivation of low delta crops (i.e., almond, olive, pomegranate and grapes) ده کم خرچہ فصل درختو نياالن ويشل او ٹريننگ لکہ)بادام، زيتون انار او انگور( BAP FINAL EVALUATION 90 B1 Has the Balochistan Agriculture Project conducted or offered this activity in your community? ايا بلوچستان ايګريکلچر پروجيکټ ستاسو په کلي کي کارونه کړي دي Ask only if "yes" to "a". Did your household personally participate in this activity? د "هو" په صورت کي ستا کورنۍ ذاتي طور په دې سرګرمي کي حصه اخستې ده. Ask only if "yes" to "b". Was the activity relevant to your household needs په قطار بي کي د "هو" په صورت دا سرګرمي ستا د کورنۍ ضرورياتو سره ورته ده. Ask only if "yes" to "c". Did participating in the activity increase your household's income? په قطار بی کی د "ھو" په صورت دې سرګرمي ستا د کور په ګټه کي اضافه وکړه. Ask only if "yes" to "c". Did your household benefit from participating in this activity in other ways? د آمدن څخه عالوه له دې سرګرمي څخه تا يو بله ګټه واخسته. Ask only if "yes" to "d" or "e". In your opinion, will your household be able to sustain these positive results after the project ends? په قطار "ډي" کي د "هو" په صورت ستا په خيال به ستا کورنۍ کي د پروجکيټ د ختمېدو په صورت کي د پروجيکټ ښه اثرات جاري وساتي که نۀ. 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know a B c d e F 4 Improving water harvesting infrastructure (land leveled and dikes/bunds constructed/rehabilitated, water diversion structures constructed/rehabilitated, micro catchment structures constructed) دې پروجيکټ ستاسو په عالقې کي د باراني اوبو جمع کولو لپاره کارونہ کړی دی لکہ)د مځکي هوارول، بندونه تړل، د باراني اوبو مخه نيول کوشنی تاالبونه جوړول(. 5 Increasing water available for agriculture (karez rehabilitated, irrigation tanks/channels lined, improved irrigation practices, high efficiency irrigation systems installed e.g. Drip Irrigation System) د زراعت دپاره د اوبو زياتول /ډېره ول )د کاريز صفايي د ابو ټينکياني جوړول، ويالې برابري ساتل، ويالې جوړول د فصل د اوبوولو په طريقه کي بهتري لک قطر اتی نظام ابپاشی. 6 On-farm water management, conservation and efficient utilization )د مځکي لپاره د اوبو بهتر انتظام )لکه د اوبو بچت( 7 Improving animal feeding practices (Feed, Fodder and Forage) د حيواناتو د خوراک په طريقه کار کي بهتري )چاره، شکرانہ فيڈز( BAP FINAL EVALUATION 91 B1 Has the Balochistan Agriculture Project conducted or offered this activity in your community? ايا بلوچستان ايګريکلچر پروجيکټ ستاسو په کلي کي کارونه کړي دي Ask only if "yes" to "a". Did your household personally participate in this activity? د "هو" په صورت کي ستا کورنۍ ذاتي طور په دې سرګرمي کي حصه اخستې ده. Ask only if "yes" to "b". Was the activity relevant to your household needs په قطار بي کي د "هو" په صورت دا سرګرمي ستا د کورنۍ ضرورياتو سره ورته ده. Ask only if "yes" to "c". Did participating in the activity increase your household's income? په قطار بی کی د "ھو" په صورت دې سرګرمي ستا د کور په ګټه کي اضافه وکړه. Ask only if "yes" to "c". Did your household benefit from participating in this activity in other ways? د آمدن څخه عالوه له دې سرګرمي څخه تا يو بله ګټه واخسته. Ask only if "yes" to "d" or "e". In your opinion, will your household be able to sustain these positive results after the project ends? په قطار "ډي" کي د "هو" په صورت ستا په خيال به ستا کورنۍ کي د پروجکيټ د ختمېدو په صورت کي د پروجيکټ ښه اثرات جاري وساتي که نۀ. 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes 0 = No , 1 = Yes -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know -9 = Don't know a B c d e F 8 Improving animal health practices/ vaccination د حيوانانو د صحت د بهتري دپاره کارونه، ويکسين کول. 9 Training of community animal health workers د حيوانانو د صحت لپاره ده ورکرانو ٹريننگ )کميونٹی انيمل هيلته ورکر ٹرينول( 10 Participating in livestock mandis په ګنج کي گڈون 11 Market Exposure Visits د مالداري او فصلو لپاره د مارکيټ په دوره کي حصه اخستل 13 Farmer Field Schools FFS زميندار فيلډ سکولونه 14 Capacity building for marketing: exposure visits (FMCs, MMOs) د مارکيټنگ او کاروبار کولو په حقله د MMO,FMC, تربيتی دورے. 15 Distribution of packing material for fruits and vegetables د ميو او سوزيانو د پا رہ د پيکنگ د سامان تقسيم 16 Distribution of kits and training for wool shearing د وڑی د سکوستلو دپارہ د مشينانو تقسيم او ٹريننگ BAP FINAL EVALUATION 92 Module C: Agricultural Land د کرهڼي مځکه C1. Did you cultivate any land in the most recent rabi or kharif seasons? If "no" go to livestock module تا د ګرمي يا د يخ په اوسني سيزن کي مځکه کرلې وہ؟ 0 = No 1 = Yes C2 How much agricultural land do you own? ته څومرہ زرعي مځکه لرې؟ How much agricultural land do you rent in? تا څومرہ مځکه په ټهيکه اخستې دہ؟ How much of the agricultural land you own or rent in is irrigated? (using karez, tubewell, river/stream) ته څومرہ د اوبولو مځکه لرے خپله يا په ټهيکه اخستے How much of the agricultural land you own or rent in is rain-fed? تا خپله او په ټهيکه اخستې څومرہ مځکه په خوشکاوہ ورکړے دہ؟ Considering all the land you own and the land you rent in, how much land did you cultivate during the last rabi and kharif seasons? تا د ګرمي او يخ په تېر سيزن کي خپله ټوله او په ټهيکه اخستې څومرہ مځکه کرلې وہ؟ Area Unit Area Unit Area Unit Area Unit Season Area Unit a B c d e f g h i j 1 Rabi Kharif Code: Area units: 1. Marla 2. Kanal 3. Biga/Jerub 4. Acre 5. Murrabba BAP FINAL EVALUATION 93 Module D: Production پيداوار D1. Rabi Season 2016ګرمي Which crops did you plant during the most recent rabi and kharif seasons? Enumertor: Enter codes for all crops the respondent planted in the appropriate rows. Keep asking "anything" else until they mention all crops. تا د ګرمي او يخ په تېر سيزن کي کم فصلونه کرلي وو؟ How much area did you plant to this crop in this season? تا په تېر سيزن کي د دې فصل څومره مځکه وکرله؟ Did you intercrop this crop with another crop? تا پر يوځای ) په يوه مځکه کي( دوه فصلونه کرلي وو؟ Which other crop did you plant? بل دي کم فصل کرلی وو؟ How much of the primary crop did you harvest in the most recent rabi or kharif season? تاد ګرمي او يخ په تېر سيزن کي څومره بنيادي فصل واخستی؟ How much of the secondary crop did you harvest in the most recent rabi or kharif season? Enter "0" if no harvest. تا د يخ او ګرمي په سيزن کي دويم ځل څومره فصل واخستی؟ Check that total area planted is not greater than the total land و ګوره چي ګرده کرل شوي مځکه تر مجموعي مځکه زياته نۀ شي. 0 No 1Yes see codes below کوډ الندي وګوره Quantity مقدار Unit (see codes below) Ask only if respondent reported intercropping. Crop (see codes below) Area Units if "no", go to h Quantity Unit A c d F g h i j k 1 2 3 4 5 BAP FINAL EVALUATION 94 D2. Kharif Season2015 يخ Which crops did you plant during the most recent rabi and kharif seasons? Enumertor: Enter codes for all crops the respondent planted in the appropriate rows. Keep asking "anything" else until they mention all crops. تا د ګرمي او يخ په تېر سيزن کي کم فصلونه کرلي وو؟ How much area did you plant to this crop in this season? تا په تېر سيزن کي د دې فصل څومره مځکه وکرله؟ Did you intercrop this crop with another crop? تا پر يوځای ) په يوه مځکه کي( دوه فصلونه کرلي وو؟ Which other crop did you plant? بل دي کم فصل کرلی وو؟ How much of the primary crop did you harvest in the most recent rabi or kharif season? تاد ګرمي او يخ په تېر سيزن کي څومره بنيادي فصل واخستی؟ How much of the secondary crop did you harvest in the most recent rabi or kharif season? Enter "0" if no harvest. تا د يخ او ګرمي په سيزن کي دويم ځل څومره فصل واخستی؟ Check that total area planted is not greater than the total land و ګوره چي ګرده کرل شوي مځکه تر مجموعي مځکه زياته نۀ شي. 0 No 1Yes see codes below کوډ الندي وګوره Quantity مقدار Unit (see codes below) Ask only if respondent reported intercropping. Crop (see codes below) Area Units if "no", go to h Quantity Unit A c d F g h i j k 1 2 3 4 5 BAP FINAL EVALUATION 95 Crops Code Code Name نوم Code Name نوم Code Name نوم Code Name نوم زردالو Apricot 25 مرچ Chilies 17 ميرګله Sunflower 9 غنم Wheat 1 پلم Plum 26 شمله مرچ Shimla 18 تمباکو Tobacco 10 وربشي Barley 2 شپتالو Peach 27 مټر Peas 19 ټماټر Tomato 11 دال Lenttil 3 انار Pomegranate 28 ګاجر Carrots 20 بند ګوبی Cabbage 12 جواری Maite 4 Other 21 ګل ګوبی Cauliflower 13 دال ماش Mash 5 Vegetables زيتون Olive 29 نوري سبزياني نوره مېوه Fruit Other 30 سيب Apple 22 پياز Onion 14 دال مونګ Mung 6 چاره Fodder 31 انګور Grapes 23 پټاټې Potato 15 زيره Cumin 7 داسي نور Others 32 بادام Almond 24 هندوانه Melon Water 16 خټکی Melon 8 Weight Code 8 7 6 5 4 3 2 1 Codeکوډ Unit Kilograms Mandis 50kg bags 100kg bags 16kg tin Krate Carton Other(kg) من کلو اکايي 50کلو تهيلې سل کلو کريټ19کلو 16کلو ټيم ګونۍ کاټن 19/8/6کلو نور BAP FINAL EVALUATION 96 Module E: Inputs (Seed and Fertilizer) کهاد او تخم Enumerator: Enter crop code in this column. Enter crop information on the same row as in "Production" module. How much [ask about each input below] did you use to plant this crop in this season? Enumerator: This question applies only to the cost of purchasing inputs. It does not include labor or other costs associated with applying inputs (e.g., planting, spraying, land leveling, etc.) تا په دا الندني شيانو کي د کومو کومو شيانو درختي او فصلونه استعمال کړي دي. Seed you saved from your own production? هغه تخم چي تا له خپله پيداواره محفوظه کړی دی؟ Local varieties you bought? ځايي قسمونه چي تا اخستي دي. )په پيسو(؟ Improved or certified seed you bought? بهتر يا باوري تخم چي تا اخستی دی؟ Total expenditure on chemical fertilizer you bought? کهاد چي تا اخستی دی؟ Total expenditure on pesticides, herbicides? دواياني زهر چي تا اخستي دي؟ Total expenditure on irrigation (including electricity for tubwells)? پر اوبو باندي سره له بجلۍ او تيلو؟ Other non￾labor expenses including transportati on? د مزدوری عالوه نور اخراجات سره له ټرانسپور ټه E1. Rabi Season Quantity in kg Quantity in kg Cost in Rs. Quantity in kg Cost in Rs. Quantity in kg Crop Cost in Rs. Cost in Rs. Cost in Rs. Cost in Rs. (see codes below) a b c d f G i j K l m 1 2 3 4 5 Total (Enumerator: ask and enter total if respondents cannot tell by crop) BAP FINAL EVALUATION 97 E2. Kharif Season Quantity in kg Quantity in kg Cost in Rs. Quantity in kg Cost in Rs. Quantity in kg Crop Cost in Rs. Cost in Rs. Cost in Rs. Cost in Rs. (see codes below) a b c d f G i j K l m 1 2 3 4 5 Total (Enumerator: ask and enter total if respondents cannot tell by crop) Crops Codes: Code Name نوم Code Name نوم Code Name نوم Code Name نوم زردالو Apricot 25 مرچ Chilies 17 ميرګله Sunflower 9 غنم Wheat 1 پلم Plum 26 شمله مرچ Shimla 18 تمباکو Tobacco 10 وربشي Barley 2 شپتالو Peach 27 مټر Peas 19 ټماټر Tomato 11 دال Lenttil 3 انار Pomegranate 28 ګاجر Carrots 20 بند ګوبی Cabbage 12 جواری Maite 4 Other 21 ګل ګوبی Cauliflower 13 دال ماش Mash 5 Vegetables زيتون Olive 29 نوري سبزياني نوره مېوه Fruit Other 30 سيب Apple 22 پياز Onion 14 دال مونګ Mung 6 چاره Fodder 31 انګور Grapes 23 پټاټې Potato 15 زيره Cumin 7 داسي نور Others 32 بادام Almond 24 هندوانه Melon Water 16 خټکی Melon 8 BAP FINAL EVALUATION 98 Module F: Inputs (Labor and Machinery) [-9 = Don’t Know, -8 = No Response, -7 = Not Applicable] F1. Enumerator: Enter crop code in this column. Enter crop information on the same row as in "Production" module. How much labor did you use to prepare the land and plant this crop in this season? Enumerator: Remind respondent about the following tasks for which labor may have been used (land preparation, planting). DO NOT include tasks that required machinery. تا په دې سيزن کي د دې فصل د کرلو اومځکي برابرولو لپاره څومزدوران نيولی وو. ؟ How much labor did you use to tend this crop in this season? Enumerator: Remind respondent about the following tasks for which labor may have been used (weeding, fertilizer/herbicide application). DO NOT include tasks that required machinery. د دې فصل د پالني لپاره تاڅو مزدوران په کار راوستلي وو.؟ How much labor did you use to harvest this crop in this season? Enumerator: Remind respondent about the following tasks for which labor may have been used (harvesting, picking, transportation from field to house). DO NOT include tasks that required machinery. د دې فصل راټولول/ رېبلو لپاره تا څو مزدوران په کار راوستلي وو؟ Did you use any machinery for these tasks? د دې کار دپاره تا مشينري استعما ل کړې وه؟ What was the cost of the machinery (including the operator)? پر مشيني آالتو خو روپۍ خرچه راغلې ده په دې کي د چلولو واال خرچه هم ده Unpaid family labor (including those of partners)? ستا د خپلي کورنۍ او د شريقانو دکورنۍ بې اجرته کسان Labor paid by the day. دروزانې واال څو ورځي در سره تېري کړې؟ Labor paid by the task د څو روپۍ کار دي په ټهيکه وکړئ Unpaid family labor? ستا د کورنۍ/شريکان بې اجرته کسان چي کار يې کړی وو؟ Labor paid by the day. د روزانې واال څو ورځي درسره تېري کړې؟ Labor paid by the task د څو روپۍ کار دي په ټهيکيدا ر وکړئ Unpaid family labor? ستا د کورنۍ بې اجرته کسان چي کار يې کړی وو؟ Labor paid by the day. د روزانې واال څو ورځي درسره تېري کړې؟ Labor paid by the task د څو روپۍ کار دي په ټهيکه وکړئ 0 No 1 Yes Do not include any costs already reported in columns "f", په" k", or "p". دې کي هغه خرچه مه اچوه کومه چي دي په قطار K,F يا P له مخکي ال اچولې ده. How much labor did you use to prepare the land and plant this crop in this season? How much labor did you use to tend this crop in this season? How much labor did you use to harvest this crop in this season? Rabi Season Code Unpaid family labor Labor paid by the day. Labor paid by the task Unpaid family labor? Labor paid by the day. Labor paid by the task Unpaid family labor? Labor paid by the day. Labor paid by the task 0 No 1 Yes Do not include any already cost reported Crop (see codes below) فصل )دا الندنی کوډ کتل( Number of persons د کسانو شمېره Total number of days ټولي ورځي Number of days ورځو شمېره Total cost in Rs. ټول خرڅ Total cost in Rs. ټول خرڅ Number of persons د کسانو شمير Total number of days ټولي ورځي Number of days ورځو شمېره Total cost in Rs. ټول لګښت Total cost in Rs. ټول خرڅ Number of persons د کسانو شمېر Total number of days ټولي ورځي Number of days ورځو شمېره Total cost in Rs. ټول خرڅ Total cost in Rs. ټول خرڅ f "no" go to next plot Total cost in Rs. ټول خرڅ A b c d e f g h i J k l m n o P q r 1 2 3 4 5 Total BAP FINAL EVALUATION 99 How much labor did you use to prepare the land and plant this crop in this season? How much labor did you use to tend this crop in this season? How much labor did you use to harvest this crop in this season? Kharif Season Code Unpaid family labor Labor paid by the day. Labor paid by the task Unpaid family labor? Labor paid by the day. Labo r paid by the task Unpaid family labor? Labor paid by the day. Labor paid by the task 0 No 1 Yes Do not include any costs already reported Crop (see codes below) فصل )دا الندنی کوډ کتل( Numbe r of person s د کسانو شمېره Total numbe r of days ټولي ورځي Numb er of days ورځو شمېره Total cost in Rs. ټول خرڅ Total cost in Rs. ټول خرڅ Numb er of person s د کسان و شمېر Total numbe r of days ټولي ورځي Numbe r of days ورځو شمېره Total cost in Rs. ټول لګښت Total cost in Rs. ټول خرڅ Number of persons د کسانو شمېر Total numb er of days Total numb er of days ټولي ورځي Numbe r of days ورځو شمېره Total cost in Rs. ټول خرڅ Total cost in Rs. ټول خرڅ f "no" go to next plot Total cost in Rs. ټول خرڅ a b c d e f g h i J k l m n o P q r 1 2 3 4 5 Total BAP FINAL EVALUATION 100 Module G: Allocation of Crops Produced استعمال فصل تيار د G1. Enumerator: Enter crop code in this column. Enter crop information on the same row as in "Production" module. Of the total amount of this crop you harvested, how much you did… Enumerator: make sure total amount equals amount harvested or explain differences. ستا د ټول پيداوار څومره حصه Of the quantity you sold … (ask only if respondent reported selling some of the crop) هغه مقدار چي تا خرڅ کړی Consume in your household? خپل په کورنۍ کي دي استعمال کړئ؟ Keep for livestock feed? د حيوانانو لپاره دي کښېښول؟ Keep for seed for next season? د را روان سيزن لپاره دي د تخم ريزي لپاره کښېښول؟ Give as gifts or barter for other goods? په تحفه يا د يو د يو بل شي په بدل کي دي ورکړئ؟ Give to laborers as payment? په مزدورۍ کي دي ورکړې؟ Give as share to partner? شريک له دي په حصه کي ورکړې؟ Lose to spoilage (do not include spoiled crops fed to livestock)? هغه چي د خرابي له وجي ضايع شو خو هغه خوراک نه چي حيوانانو ته دي ورکړی Sell? خرڅ دي کړی What was the price per unit sold? د يو يونټ قيمت څو؟ Who bought most of the crop you sold? ستا اکثره فصل چا واخستی؟ Where did you sell most of the crop you sold? خرڅ کړئ؟ تا اکثره فصل چيري Distance to the location where sold? د هغه ځای فاصله څو ده چيري چي تا فصل خرڅ کړئ؟ Crop (see codes below) Quan tity Unit (see code s belo w) Quan tity Unit (see code s belo w) Quan tity Unit (see code s belo w) Quan tity Unit (see code s belo w) Quan tity Unit (see code s belo w) Quan tity Unit (see code s belo w) Quan tity Unit (see code s belo w) Quan tity Unit (see code s belo w) Price (Rs.) Unit (see code s) see code s belo see wcode s belo w Kilo mete rs a b c d e f g h i j k h i l m n o p Q r s t 1 2 3 4 5 6 7 8 9 10 BAP FINAL EVALUATION 101 Weight Codes Buyer Codes Location Codes Code Weight units Code Buyer Code Location of sale: په مځکه کي gate Farm 1 زميندار Landlord 1 کلوګرام Kilograms 1 2 Mandis من 2 Input dealer دوکاندار 2 Vendor کاروباري لوکل مارکيټ market Local 3 ماشخور Middleman 3 کلو ګرام تهيلې50 bags kg 50 3 د ضلع مارکيټ market District 4 کارخانه (factory (Processor 4 د سل کلو ګونۍ bags kg 100 4 5 16 kg tins ټين ګرام کلو شپاړس 5 Retailer in main market دوکاندار پرچون د 5 Warehouse/Storage place د سټور ځای نور Other 6 د پرچون دوکاندار Wholesaler 6 کلو 19/16کريټ Krate 6 -9 خور د مارکيټ کميشن market in agent Commission 7 کلو 6/8/19کاټن Carton 7 Don't know/remember يم نه خبر / په ياد مي نه دي د کلي کميشن واال village in agent Commission 8 او نور (kg (Other 8 کورنۍ/ ياران friend/Household 9 د کلي دوکاندار shopkeeper Village 10 سرکار Government 11 12 Other, please specify نور نه يم خبر / په ياد مي نه دي remember/know t'Don -9 BAP FINAL EVALUATION 102 Module H: Livestock مالداري H1 Animal type In the past 12 months, have members of your househol d owned any of the following animals? په تيرو 12مياشت و کي له الندني حيوانا نو څہ ستاسو کورنئ کم درلود؟ How many [animal type] does your househo ld currentl y own? ستا کورنۍ اوس څو دانې لري؟ How many [animal type] did your househol d own at this time last year? تېرکال تا په دې وخت کي څو دانې درلودې ؟ During the past 12 months, how many of these animals were born and survived on farm? په تېرو 12 مياشتو کي څومره حيوانا ن پيدا شوي دي؟ During the past 12 months, how many [animal type] did you sell? په تېرو 12 مياشتو کي څومره حيوانا ن تا خرڅ کړي دي. If "E" >0: Considering cash and the value of in￾kind payment, on average, how much did you earn from the sale of all of these animals (or carcasses)? اوسطا تا د يوه حيوان پر خرڅيدو څو ګټه کړې ده؟ During the past 12 months, how many of [animal type] did you eat or give away? په تيره 12 مياشتو کي څومره حيوانا ن تاپہ خپله خوړلي دي؟ How many of these animals died during the past 12 months (or would have died if you had not eaten them)? په تيرو 12 مياشتو کي ستا څو حيوانان مړه شوی دی؟ During the past 12 months, how many of [animal type] did you purchase ? په تېرو 12 مياشتو کي تا څو حيوانا ن واخستل ؟ If "f" >0: How much did you spend to buy these animals? تا څو روپۍ د حيوانا نو په اخستلو خرڅي کړې؟ During the past 12 months, how much did you spend on feed for [animal type]? په تيرو 12 مياشتو کي تا ده حيوانا نو پر خوراک څو روپئ ګاري کړے؟ During the past 12 months, how much did you spend on other costs for [animal type] such as veterinary supplies, taxes, and hired labor? نور دي په حيوانان و څومره خرڅ کړي دي؟ During the past 12 months, how much have you earned from the following activities...? په تيرو 12 مياشتو کي تالہ دے کاره څو پيسې وګټلے؟ 0 No 1 Yes Number Number Number Number Rs. /animal Number Number Number Rs. Rs. Rs. Rs Code A B C D E F G H I J K L M N وزے Goats 1 Goat milk وزې شودې وړۍWool ميږېSheep 2 رمه Cattle 3 Rental باړه اوښ Camel 4 Camel milk د اوښ شودې 5 Poultry چرګان Egg sales داګۍ خرڅالو 6 Rabbit سويان Honey sales دشاتو خرڅول نورOther 7 BAP FINAL EVALUATION 103 H2 During the past 12 months, how much have you earned selling cow milk? په تيرو 12 مياشتو کي ، تا دغواده شودو پہ خرڅولو څو ګټه وه کړه؟ Rs. H3 During the past 12 months, how much have you earned selling animal hides? په تيرو 12 مياشتو کي تا د پوستو پہ خرڅولو څو ګټه وه کړه ؟ Rs. BAP FINAL EVALUATION 104 Module I: Expenditure خرچه 11. How much did your household spent on food items in the last 7 days? _________ .Rs په تېرو7ورځو کي تا په خوراکي شيانو څو روپۍ خرچ کړي دي؟ 12. On each of the following: About how much did your household spend on __________ for domestic consumption during the last 30 days. په تېرو30ورځو کي په الندني شيانو ستا کورنۍ تقريباً څومره خرڅه کړې ده؟ 0 Nothing - did not buy -9 Don't know - if "don't know" go to next item a .Rs په ډاکټر او دوايانو اخراجات care health/expenses Medical 1. 2. Gas/gas cylinder سلنډر ګيس Rs. 3. Electricity بجلۍ Rs. 4. Kerosene oil ګاسليټ Rs. 5. School and tuition fee ټيوشن ، سکول Rs. 6. Travel costs (fares, vehicle fuel and repair) خرڅونه سفر د Rs. .Rs په مېلسمتيا باندي خرڅه guests Entertaining 7. د کور کرايه :rent House 8. (Enter “0” if household does not pay rent) (If household does not pay rent monthly then calculate monthly rent) Rs. 13. On each of the following: About how much did your household spend on during the last 12 months. په تېرو12مياشتو کي ستا کورنۍ په الندني شيانو باندي څومره خرڅه کړې ده؟ 0 Nothing - did not buy -9 Don't know - if "don't know" go to next item a 1. Education (books, uniform, etc.) )وردۍ او کتابونه )تعليم Rs. 2. Clothing, shoes (excluding those required for school) ګوټونه او کپړې Rs. 3. Equipment and tools (including for agriculture) زار او اسباب Rs. .Rs د کور تعمير و مرمت repair house ,Construction 4. 5. Celebrations, social events (funerals, weddings, etc.) .Rs لمانځل، غونډي، )جنازې، ودونه او داسي نور( .Rs زکوٰۃ/ تحفے/خيرات/ Charity/Gifts 6. .Rs داور لرګي/کوئله گيس/ Coal/Firewood 7. .Rs د حيوانانو خرڅې expenses Veterinary 8. 9. Fines and taxes ټيکس او جرمانې Rs. 10. Others نور Rs. BAP FINAL EVALUATION 105 Module J: Other Income آمدن نور J1. Other income activity In the past 12 months, have members of your household received income from activity? په تېرو 12 مياشتو کي ستاسو د کور ممبرانو له دې سرګرمي څخه آمدن اخستی دی؟ If "b"=yes: In the past 12 months, how much income have members of your household received income from this activity? په تېرو 12 مياشتو کي ستاسو کورنی لہ الندني ذرايعه څہ سو ګټه اخستې ده؟ If "b"=yes: Which household members were most involved in this activity? ستا له کورنۍ څخه کم خلک په سرګرمي کي شامل وو؟ If "b"=yes: Which household members make decisions about how income from this activity is spent? د دې سرګرمي د آمدن د خرڅ فيصله ستاپه کورنۍ کي کم ممبران کوي؟ 1 Yes 2 No Rs. 1 = Mostly men 2 = Mostly women 3 =Both men and women A b C D E 1 باهرنی Remittances آمدن 2 Trading staple commodities or cash crops (middle man) ماشه خوري 3 Trading in Livestock (Middleman) د حيوانانو داللي 4 Casual labor/piece work د دالل په حيث د مزدورانو څخه ګټه تحفې Gifts 5 خپل کار business Own 6 7 Petty trade کوشنی کاروبار 8 Pension/social grants پينشن / امداد 9 Formal salary/wages تنخواه 10 Vegetable sales (middle man) د دالل په حيث د سبزي خرڅ 11 Small Scale Mining /Quarrying/Brick Making په کوشنی کچه څا وهل او خشتي جوړول 12 Cash Food or other assistance نقد، خورک يا نور امدن BAP FINAL EVALUATION 106 J1. Other income activity In the past 12 months, have members of your household received income from activity? په تېرو 12 مياشتو کي ستاسو د کور ممبرانو له دې سرګرمي څخه آمدن اخستی دی؟ If "b"=yes: In the past 12 months, how much income have members of your household received income from this activity? په تېرو 12 مياشتو کي ستاسو کورنی لہ الندني ذرايعه څہ سو ګټه اخستې ده؟ If "b"=yes: Which household members were most involved in this activity? ستا له کورنۍ څخه کم خلک په سرګرمي کي شامل وو؟ If "b"=yes: Which household members make decisions about how income from this activity is spent? د دې سرګرمي د آمدن د خرڅ فيصله ستاپه کورنۍ کي کم ممبران کوي؟ 1 Yes 2 No Rs. 1 = Mostly men 2 = Mostly women 3 =Both men and women A b C D E 13 Gathering Natural Products for sale e.g., Medicinal Herbs, د دوا .etc ,Mushrooms بوټي راغونډل او خرڅول 14 Collecting Scrap/Waste کچرهMaterial for resale کنډيScrapراټولول او بېرته خرڅول 15 Others (Including Fruit Trade) داسي نور ..... د هر سوال څخه بعد دا پشتنه وکړئ. empowerment s'Women :L Module After reading each question, ask: Would you say it has increased significantly, increased, remained unchanged, decreased, or decreased significantly? (Circle one number) ستا په خيال: ډېر زيات شوی دی زيات شوی دی بدلون نه دی راغلی کم سوی دی يا ډېر کم سوی دی. )پر يوہ دائرہ ولګوی( Increased significantly ډېر زيات شوی دی Increase d زيات شوی دی Remained unchange d بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantly ډېر کم سوی دی QL1A. To what degree, if at all, has women's income changed due to the project? دپروجيکټ له وجي که د ښځو په آمدن کي که څه فرق راغلی دی،نو څومره دی؟ 5 4 3 2 1 BAP FINAL EVALUATION 107 Increased significantly ډېر زيات شوی دی Increase d زيات شوی دی Remained unchange d بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantly ډېر کم سوی دی QL1B. To what degree, if at all, has women's ability to make decisions about the household’s productive assets (e.g. livestock, inheritance; dowry; household savings) changed due to the project? دپروجيکټ له وجي که د ښځو دکورنۍ آثاثو په حقله د فيصلو مثالً مالداري،وراثت جهيز اختيار کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL1C. To what degree, if at all, has women's ability to make decisions about household expenditures changed due to the project? د پروجيکټ له وجي که د ښځو دکورنۍ آخراجاتو په حقله فيصلو کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL1D. To what extent, if at all, has women’s access to markets changed due to the project? د پروجيکټ له وجي که و مارکيټ ته د ښځو په رسايي کي څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL2B. To what degree, if at all, has women's ability to express disagreements within your community changed due to the project? د پروجيکټ له وجي که په ښځو کي د خپل په حق غوښتولو کي فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL2C. To what degree, if at all, has women's confidence in their ability to improve their future changed due to the project? د پروجيکټ له وجي که د ښځو په قابليت او اعتماد بهتر مستقل په باره کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL3A. To what extent, if at all, has women’s ability to work outside their home changed due to the project? د پروجيکټ له وجي که د ښځو په باهرني کاروبار کي د برخه اخستو په اختيار کي څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QL3B. To what extent, if at all, has women’s ability to take leadership roles in community activities (social, political, etc.) changed due to the project? د دې پروجيکټ له وجه زنانو د کلي د مختلفه کارونو کي څو قدر د مشرئ حق ترالسه کړی دی؟ 5 4 3 2 1 BAP FINAL EVALUATION 108 Increased significantly ډېر زيات شوی دی Increase d زيات شوی دی Remained unchange d بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantly ډېر کم سوی دی QL3C. To what extent, if at all, has the frequency of violence against women changed within your community due to the project? د پروجيکټ له وجي ستاسو په عالقه کي د ښځو سره په رويو کي که څه تبديلي راغلې ده نو څومره؟ 5 4 3 2 1 Module M: Miscellaneous Project related questions After reading each question, ask: Would you say it has increased significantly, increased, remained unchanged, decreased, or decreased significantly? (Circle one number) د هر سوال څخه بعد دا پوښتنه وکړئ ستاسو په خيال ډېر زيات شوی دی زيات شوی دی بدلون نه دی راغلی کم شوی دی او که ډېر کم شوی دی؟ Increased significantly ډېر زيات شوی دی Increased زيات شوی دی Remained unchanged بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantl ډېر y کم سوی دی QM1A. To what extent, if at all, has the project changed the capacity of your community to identify needs and problems collectively? د پروجيکټ له وجي ستاسو د کلي خپل مشترکه ضروريات او مسائل پېژندلو په صالحيت کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM1B. To what extent, if at all, has the project changed the capacity of your community to seek external assistance from government and other partners to resolve these problems? دپروجيکټ له وجي که ستاسو د کلي د خلګو دمسائل د حل په باره کي د باهرني امداد د حاصلولو په صالحيت کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM2A. To what extent, if at all, did the frequency of visits by GoB agricultural officers to your community change due to the project? د پروجيکټ له وجي د زراعت د افسرانو په دورو کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM2B. To what extent, if at all, did the quality of visits (advice, services) by GoB agricultural officers to your community change due to the project? د پروجيکټ له وجي که د زراعت د افسرانو د دورور په معيار کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 BAP FINAL EVALUATION 109 Increased significantly ډېر زيات شوی دی Increased زيات شوی دی Remained unchanged بدلون نه دی راغلی Decrease کم d سوی دی Decreased significantl ډېر y کم سوی دی QM2C. To what extent, if at all, did the frequency of visits by GoB livestock officers to your community change due to the project? د پروجيکټ له وجي که د الئيو سټاک د افسرانو په دورو کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM2D. To what extent, if at all, did the quality of visits (advice, services) by GoB livestock officers to your community change due to the project? د پروجيکټ له وجي که د الئيو سټاک د افسرانو د دورو په معيار کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM3A. To what extent, if at all, has your overall household income changed due to the project? د پروجيکټ له وجي که ستا د کورنۍ په آمدن کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 QM3B. To what extent, if at all, has your ability to meet your household expenditures changed due to the project? د پروجيکټ له وجي که د کورنۍ په اخراجات پوره کوولو په صالحيت کي که څه فرق راغلی دی نو څومره؟ 5 4 3 2 1 After reading each question, ask: Would you say it is very likely, somewhat likely, not sure, somewhat unlikely, or very unlikely? د هر سوال ويلو بعد وپوشتی.ډېر امکان لريتر څه حده امکان لري نه يم خبر، امکان نه لري  بالکل امکان نه لري؟ Very likely ډېر امکان لري Some what likely تر څه حده امکان لري Not sure نه يم خبر Some what unlike ly امکا ن نه لري Very unlikel y بالکل امکان نه لري QM4A . How likely is your CO/FMC/MMO (select one which is applicable) to continue to exist after the project ends? څومره امکان لري چي د پروجيکټ له ختمېدو بعد MMO/FMC/COدوام ولري؟ 5 4 3 2 1 QM4B. How likely are you to continue to participate in CO/FMC/MMO (select one which is applicable) after the project ends? څومره امکان لري چي د پروجيکټ که ختمېدو بعد ته خپل شرکت په MMO/FMC/CO کي جاري وساتي 5 4 3 2 1 BAP FINAL EVALUATION 110 GUIDE FOR GROUP INTERVIEWS WITH WCOs BALOCHISTAN AGRICULTURE PROJECT A1. Village name: A2. UC name: A3. Tehsil name: A4. District name: A5. Group type: WCO’s A6. Language: A7. Date: A8. Start time: End time: A9. Venue: A10. City/district A11. Moderator name: A12. Note taker name: Note: As per transcription protocols, please assign alphabet “R” for respondents and if more than one respondent is answering a single question then assign alphanumeric code to denote each respondent’s response. e.g. R1, R2 et al., to differentiate responses. Assign the same code to each respondent in all questions. INTRODUCTION My name is ______________________. I work for a research organization based in Islamabad. We are conducting a study to assess the impact of Balochistan Agricultural Project (BAP) implemented by FAO in your area. BAP activities cover community organizing; water resource management; crop and livestock productivity, and value chain development and marketing. Through its activities, BAP seeks to address multiple key challenges faced by small farmers in Balochistan. The interview will take approximately 60-90 minutes. We will treat everything you say here with confidentiality. Nothing you say will be publicly attributed to you, and your names will not be given to anyone. Do I have your permission to record the interview? (Yes/No ____________) If all respondents say yes, continue the interview. If no, try to motivate respondents by answering their questions and explaining the importance of recording the interview. Respondent Code Name R1 R2 R3 R4 BAP FINAL EVALUATION 111 WOMEN-FOCUSED ACTIVITIES (WFAs): Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness”. Livestock-related WFAs will be covered later in the interview. 1. In your opinion, were WFAs (name activities) right things for/suitable to addressing important needs of women in your community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 2. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 3.] If yes, could you please describe how the project’s WFAs are suitable to addressing your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1): These questions relate to how well activities were implemented 3. Did your household’s participation in WFAs increase your household’s income? [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT PARTICIPATE IN THE ACTIVITY] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 4. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 5.] If yes, could you please describe how participating in WFAs increased your household’s income? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 112 Sustainability (EQ2) 5. Do you think your household will be able to sustain any increased income you’ve experienced from WFAs after the project ends? Only ask respondents who reported increases earlier. For others, mark “N/A” [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT REPORT AN INCREASE IN INCOME EARLIER] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 6. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 7.] If yes, could you please describe the conditions under which your household will be able to sustain increased income from WFAs after the project ends? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 7. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the WFAs introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 8. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 9.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] Livestock: 9. Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” BAP FINAL EVALUATION 113 10. In your opinion, were livestock activities suitable to addressing important needs of your community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 11. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 12.] If yes, could you please describe how the project’s livestock activities are suitable to addressing your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1): These questions relate to how well activities were implemented 12. Did your household’s participation in livestock-focused project activities increase your household’s income? [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT PARTICIPATE IN THE ACTIVITY] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 13. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 14.] If yes, could you please describe how participating in livestock-focused project activities increased your household’s income? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 114 Sustainability (EQ2) 14. Do you think your household will be able to sustain any increased income you’ve experienced after the project ends? Only ask respondents who reported increases earlier. For others, mark “N/A” [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT REPORT AN INCREASE IN PRODUCTIVITY OR INCOME] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 15. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 16.] If yes, could you please describe the conditions under which your household will be able to sustain increased livestock productivity and/or income from new crop practices after the project ends. If not, why not? [WRITE AN ANSWER] Replicability? (EQ2) 16. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the livestock practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 17. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 18.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 115 COMMUNITY DEVELOPMENT (CD) ACTIVITIES: Relevance (EQ1) 18. Were community organization activities suitable to addressing community problems? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 19. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 20.] If yes, could you please describe how these community- development-related project activities are suitable to solve your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) 20. Are community organizations effective, if at all, in identification of community problems and finding solutions to these problems with the help of external agencies? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 21. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 22.] If yes, could you please describe how COs were effective in this regard? If not, why not? [WRITE AN ANSWER] 22. Why did so few CO members join FMCs or MMOs? Under what conditions will more CO members join FMCs or MMOs? [WRITE AN ANSWER] BAP FINAL EVALUATION 116 Sustainability (EQ2) 23. Based on your experience, will your WCO survive after project ended without external support? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 24. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 25.] If yes, could you please describe how your WCO will survive after project ended without external support? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 25. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the community development activities introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 26. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 27.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 117 WOMEN’S EMPOWERMENT (EQ3) 27. Has women’s participation in project activities increased, if at all, household income? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 28. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 29.] If yes, could you please describe how women’s participation in these activities increased household income? If not, why so? [WRITE AN ANSWER] 29. Has women’s ability to make decisions about household finances increased, if at all, due to the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 30. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 31.] If yes, could you please describe how women’s ability to make such decisions has increased? What factors affect this? If not, why not? [WRITE AN ANSWER] 31. Have WCOs played any role, if at all, in increasing women’s empowerment in community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 118 32. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 33.] If yes, could you please describe how WCOs have empowered women in the community? If not, why not? [WRITE AN ANSWER] 33. Has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 34. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 35.] If yes, how has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? (By social change, we mean change in community values, norms, and ideologies that affects the economic and social participation and influence of women). If not, why not? [WRITE AN ANSWER] 35. Under what conditions wills the improvement, if any, in women’s empowerment sustain after the project ends? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 119 OVERALL EFFECTIVENESS (EQ1) 36. Have there been any unintended benefits from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 37. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 38.] If yes, please describe the unintended benefits? [WRITE AN ANSWER] 38. Has there been any unintended harm from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 39. If yes, please describe the unintended harm? [WRITE AN ANSWER] _____________________________________________________________________________ _____________________________________________________________________________ _____________________________________________________________________________ _____________________________________________________________________________ ______________________________________________________________ Is there any interesting case that you can narrate either about success, failure, unintended benefits or unintended harm due to any of the project activities? Thank you for your time! BAP FINAL EVALUATION 120 GUIDE FOR GROUP INTERVIEWS WITH MCOs BALOCHISTAN AGRICULTURE PROJECT A1. Village name: A2. UC name: A3. Tehsil name: A4. District name: A5. Language: A6. Date: A7. Start time: End time: A8. Venue: A9. City/district A10. Moderator name: A11. Note taker name: Note: As per transcription protocols, please assign alphabet “R” for respondents and if more than one respondent is answering a single question, assign alphanumeric code to denote each respondent’s response, e.g. R1, R2 et al., to differentiate responses. Assign the same code to each respondent in all questions. INTRODUCTION My name is ______________________. I work for a research organization based in Islamabad. We are conducting a study to assess the impact of Balochistan Agricultural Project (BAP) implemented by FAO in your area. BAP activities cover community organizing; water resource management; crop and livestock productivity; and value chain development and marketing. Through its activities, BAP seeks to address multiple key challenges faced by small farmers in Balochistan. The interview will take approximately 60–90 minutes. We will treat everything you say here with confidentiality. Nothing you say will be publicly attributed to you, and your names will not be given to anyone. Do I have your permission to record the interview? (Yes/No ____________) If all respondents say yes, continue the interview. If no, try to motivate respondents by answering their questions and explaining the importance of recording the interview. Respondent Code Name R1 R2 BAP FINAL EVALUATION 121 Respondent Code Name R3 R4 CROPS/ Water Management Activities (WMA): Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by the project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 1. In your opinion, were crop and WMA activities suitable/right things to addressing important needs of your community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 2. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 3.] If yes, could you please describe how the project’s crop and WMA activities are suitable/right things to addressing your community problems? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 122 Effectiveness (EQ1) . These questions relate to how well activities were implemented 3. Were the crop and WMA activities effective in increasing your household’s crop productivity? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 4. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 5.]. If yes, could you please describe how these crop and WMA focused project activities are effective in increasing crop productivity? If not, why not? [WRITE AN ANSWER] Sustainability (EQ2) 5. Will your household continue using the new crop and water management practices introduced by the project after the project ends? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 6. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 7.]. If yes, could you please describe how you think your household will continue these practices? What factors or conditions will influence this? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 123 Replicability? (EQ2) 7. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the crop and water management practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 8. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 9.]. If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] Livestock: Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 9. In your opinion, were livestock activities suitable/right things to addressing important needs of your community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 124 10. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 10.] If yes, could you please describe how the project’s livestock activities are suitable/right things to addressing your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) . These questions relate to how well activities were implemented 11. Were the livestock activities effective in increasing your household’s livestock productivity? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 12. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 13.]. If yes, could you please describe how these livestock-focused project activities are effective in increasing livestock productivity? If not, why not? [WRITE AN ANSWER] Sustainability (EQ2) 13. Will your household continue using the new livestock practices introduced by the project after the project ends? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 125 14. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 15.]. If yes, could you please describe how you think your household will continue these practices? What factors or conditions will influence this? If not, why not? [WRITE AN ANSWER] Replicability? (EQ2) 15. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the livestock practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 16. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 17.]. If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] COMMUNITY DEVELOPMENT (CD) ACTIVITIES: Relevance (EQ1) 17. Were community organization activities suitable/right things to addressing community problems? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 126 18. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 19.]. If yes, could you please describe how these community- development-related project activities are suitable/right things to solve your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) 19. Are community organizations effective, if at all, in identification of community problems and finding solutions to these problems with the help of external agencies? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 20. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 21.]. If yes, could you please describe how COs were effective in this regard? If not, why not? [WRITE AN ANSWER] 21. Why did so few CO members join FMCs or MMOs? [WRITE AN ANSWER] 22. Under what conditions will more CO members join FMCs or MMOs? [WRITE AN ANSWER] BAP FINAL EVALUATION 127 Sustainability (EQ2) 23. Based on your experience, will your MCO survive after project ended without external support? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 24. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 25.]. If yes, could you please describe how your MCO will survive after project ended without external support? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 25. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the community development activities introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 26. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 27.]. If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 128 WOMEN’S EMPOWERMENT (EQ3) 27. Has women’s participation in project activities increased, if at all, household income? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 28. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 29.]. If yes, could you please describe how women’s participation in these activities increased household income? If not, why so? [WRITE AN ANSWER] 29. Has women’s ability to make decisions about household finances increased, if at all, due to the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 30. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 31.]. If yes, could you please describe how women’s ability to make such decisions has increased? What factors affect their participation? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 129 31. Have WCOs played any role, if at all, in increasing women’s empowerment in community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 32. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 33.]. If yes, could you please describe how WCOs have empowered women in the community? If not, why not? [WRITE AN ANSWER] 33. Has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 34. If yes, how has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? (By social change, we mean change in community values, norms, and ideologies that affects the economic and social participation and influence of women). If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 130 35. Under what conditions wills the improvement, if any, in women’s empowerment sustain after the project ends? If not, why not? [WRITE AN ANSWER] OVERALL EFFECTIVENESS (EQ1) 36. Have there been any unintended benefits from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 37. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 38.]. If yes, please describe the unintended benefits? [WRITE AN ANSWER] 38. Has there been any unintended harm from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 131 39. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 40.]. If yes, please describe the unintended harm? [WRITE AN ANSWER] 40. Is there any interesting case that you can narrate either about success, failure, unintended benefits or unintended harm due to any of the project activities? Thank you for your time! BAP FINAL EVALUATION 132 GUIDE FOR GROUP INTERVIEWS WITH FMC/MMOs BALOCHISTAN AGRICULTURE PROJECT A1. Village name: A2. UC name: A3. Tehsil name: A4. District name: A5. Group type: (check one) FMC MMO A6. Language: A7. Date: A8. Start time: End time: A9. Venue: A10. City/district A11. Moderator name: A12. Notetaker name: Note: As per transcription protocols, please assign alphabet “R” for respondents and if more than one respondent is answering a single question, assign alphanumeric code to denote each respondent’s response, e.g. R1, R2 et al., to differentiate responses. Assign the same code to each respondent in all questions. INTRODUCTION My name is ______________________. I work for a research organization based in Islamabad. We are conducting a study to assess the impact of Balochistan Agricultural Project (BAP) implemented by FAO in your area. BAP activities cover community organizing; water resource management; crop and livestock productivity; and value chain development and marketing. Through its activities, BAP seeks to address multiple key challenges faced by small farmers in Balochistan. The interview will take approximately 60–90 minutes. We will treat everything you say here with confidentiality. Nothing you say will be publicly attributed to you, and your names will not be given to anyone. Do I have your permission to record the interview? (Yes/No ____________) If all respondents say yes, continue the interview. If no, try to motivate respondents by answering their questions and explaining the importance of recording the interview. Respondent Code Name R1 R2 R3 R4 BAP FINAL EVALUATION 133 CROPS AND WATER (ask only crop-related FMC/MMOs): Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by the project and not how well they were implemented. The latter will be covered under “Effectiveness”.) 1. In your opinion, were crop and related water activities right things for/suitable to addressing important needs of your community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 2. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 3.] If yes, could you please describe how the project’s crop/water activities were suitable in addressing your community’s problems? If not, why not. [WRITE AN ANSWER] Effectiveness (EQ1). These questions relate to how well activities were implemented. 3. Were the crop activities effective in increasing your household’s crop productivity? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 134 4. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 5.]. If yes, could you please describe how these crop/water-focused project activities were effective in increasing crop productivity? If not, why not? [WRITE AN ANSWER] Sustainability (EQ2) 5. Do you think your household will be able to sustain any increased income you’ve experienced after the project ends? Only ask respondents who reported increases earlier. For others, mark “N/A”. [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT REPORT AN INCREASE IN PRODUCTIVITY OR INCOME] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 6. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 7.]. If yes, could you please describe the conditions under which your household will be able to sustain increased income from new crop practices after the project ends? If not, why not? [WRITE AN ANSWER] Replicability? (EQ2) 7. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted crop practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 135 8. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 9.], could you please describe how non-project households learned of these practices. If not, why not? [WRITE AN ANSWER] LIVESTOCK (only ask livestock-related FMC/MMOs)/Wool-related activities have a separate section: Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness”.) 9. In your opinion, were livestock activities right things for/suitable in addressing the important needs of your community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 10. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 11.] If yes, could you please describe how the project’s livestock activities were suitable in addressing your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1). These questions relate to how well activities were implemented. 11. Were the livestock activities effective in increasing your household’s livestock productivity? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 136 12. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 13.]. If yes, could you please describe how these livestock-focused project activities are effective in increasing livestock productivity? If they are not effective, please explain why. [WRITE AN ANSWER] Sustainability (EQ2) 13. Do you think your household will be able to sustain any increased livestock productivity you’ve experienced after the project ends? Only ask respondents who reported increases earlier. For others, mark “N/A”. [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT REPORT AN INCREASE IN PRODUCTIVITY OR INCOME] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 14. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 15.]. If yes, could you please describe the conditions under which your household will be able to sustain increased livestock productivity and/or income from new crop practices after the project ends? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 137 Replicability? (EQ2) 15. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the livestock practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 16. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 17.]. If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] WOOL-FOCUSED ACTIVITIES (only ask FMC/MMOs which participated in Wool-focused activities) Relevance-EQ1 (Please explain to FMC/MMO members that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness”.) 17. In your opinion, were wool-focused activities right things for/suitable in addressing the important needs of your community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 138 18. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 19.] If yes, could you please describe how the project’s wool-focused activities were suitable in addressing your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1). These questions relate to how well activities were implemented. 19. Were the wool-focused activities effective in increasing your household’s income? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 20. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 21.]. If yes, could you please describe how these wool-focused project activities are effective in increasing your income? If they are not effective, please explain why. [WRITE AN ANSWER] Sustainability (EQ2) 21. Do you think you will be able to sustain any increased wool productivity after the project ends? [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT REPORT AN INCREASE IN PRODUCTIVITY OR INCOME] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 139 22. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 23.]. If yes, could you please describe the conditions under which you will be able to sustain increased wool productivity and/or income from new practices after the project ends? If not, why not? [WRITE AN ANSWER] Replicability? (EQ2) 23. Are you aware of any non-project households (i.e. those not involved in the FMC/MMO) that have adopted the wool-focused practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 24. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 25.]. If yes, could you please describe how non-project households learned of these practices? [WRITE AN ANSWER] COMMUNITY DEVELOPMENT (CD) ACTIVITIES: Relevance (EQ1) 25. Were community organization activities right things for/suitable in addressing community problems? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 140 26. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 27.]. If yes, could you please describe how these community- development-related project activities are suitable in solve your community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) 27. Are community organizations effective, if at all, in the identification of community problems and determining solutions to these problems with the help of external agencies? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 28. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 29.]. If yes, could you please describe how COs were effective in this regard? If not, why not? [WRITE AN ANSWER] 29. Were the value chain development project activities effective, if at all, in increasing profitability in markets? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 141 30. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 31.]. If yes, could you please describe how these value chain development project activities were effective in increasing incomes? If not why not? [WRITE AN ANSWER] 31. Could you please describe how these market-focused project activities can be made more effective in increasing market linkages? [WRITE AN ANSWER] 32. Why did so few CO members join FMCs or MMOs? [WRITE AN ANSWER] Sustainability (EQ2) 33. Based on your experience, will your FMC/MMO survive after the project ends, without external support? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 34. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 35.]. If yes, could you please describe how your FMC/MMO will survive after the project ends, without external support? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 142 35. Do you think your household will be able to sustain any increased profitability from markets you’ve experienced from value chain development activities after the project ends? Only ask respondents who reported increases earlier. For others, mark “N/A”. [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT REPORT AN INCREASE IN PRODUCTIVITY OR INCOME] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 36. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 37.]. If yes, could you please describe the conditions under which your household will be able to sustain increased income from value chain development activities after the project ends? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 37. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the value chain development activities introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 143 38. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 39.]. If yes, could you please describe how non-project households learned of these practices? If they did not learn, why not? [WRITE AN ANSWER] OVERALL EFFECTIVENESS (EQ1) 39. Have there been any unintended benefits from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 40. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 41.]. If yes, please describe the unintended benefits. [WRITE AN ANSWER] 41. Has there been any unintended harm from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 144 42. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 43.]. If yes, please describe the unintended harm. [WRITE AN ANSWER] 43. Is there any interesting case that you can narrate, either about success, failure, unintended benefits, or unintended harm due to any of the project activities? Thank you for your time! BAP FINAL EVALUATION 145 GUIDE FOR GROUP INTERVIEWS WITH FAO/DISTRICT STAFF BALOCHISTAN AGRICULTURE PROJECT A1. District name: A2. Group type: (Check one) FAO staff GOB staff A3. Language: A4. Date : A5. Start time: End time: A6. Venue : A7. Moderator name: A8. Note taker name: Note: As per transcription protocols, please assign alphabet “R” for respondents and if more than one respondent is answering a single question then assign alphanumeric code to denote each respondent’s response. e.g. R1, R2 et al., to differentiate responses. Assign the same code to each respondent in all questions. INTRODUCTION My name is ______________________. I work for a research organization based in Islamabad. We are conducting a study to assess the impact of Balochistan Agricultural Project (BAP) implemented by FAO in your area. BAP activities cover community organizing; water resource management; crop and livestock productivity, and value chain development and marketing. Through its activities, BAP seeks to address multiple key challenges faced by small farmers in Balochistan. The interview will take approximately 60-90 minutes. We will treat everything you say here with confidentiality. Nothing you say will be publicly attributed to you, and your names will not be given to anyone. Do I have your permission to record the interview? (Yes/No ____________) If all respondents say yes, continue the interview. If no, try to motivate respondents by answering their questions and explaining the importance of recording the interview. Respondent Code Name R1 R2 R3 R4 BAP FINAL EVALUATION 146 CROPS: Relevance-EQ1 (Please explain that these questions relate to whether suitable/right activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 1. In your opinion, were crop activities (name activities) suitable/right things to addressing important needs of community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 2. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 3.] If yes, could you please describe how the project’s crop activities are suitable/right things to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1): These questions relate to how well activities were implemented 3. Were the crop activities effective in increasing household’s crop productivity? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 4. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 5.] If yes, could you please describe how these crop-focused project activities are effective in increasing crop productivity? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 147 Sustainability (EQ2) 5. Will households continue using the new crop practices introduced by the project after the project ends? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 6. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 7.] If yes, could you please describe under what conditions you think households will continue these practices? If not, why not? [WRITE AN ANSWER] Replicability? (EQ2) 7. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the crop practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 8. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 9.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 148 WOMEN-FOCUSED ACTIVITIES (WFAs): Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable/right things activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 9. In your opinion, were WFAs suitable/right things to addressing important needs of women in community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 10. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 11.] If yes, could you please describe how the project’s WFAs are suitable/right things to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) . These questions relate to how well activities were implemented 11. Did household’s participation in WFAs increase household’s income? [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT PARTICIPATE IN THE ACTIVITY] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 12. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 13.] If yes, could you please describe how participating in WFAs increased household income? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 149 Sustainability (EQ2) 13. Will households continue using the WFAs introduced by the project after the project ends? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 14. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 15.] If yes, could you please describe how you think households will continue these practices? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 15. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the WFAs introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 16. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 17.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 150 Livestock: Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable/right activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 17. In your opinion, were livestock activities suitable/right things to addressing important needs of community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 18. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 19] If yes, could you please describe how the project’s livestock activities are suitable/right things to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) . These questions relate to how well activities were implemented 19. Were the livestock activities effective in increasing household livestock productivity? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 20. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 20.] If yes, could you please describe how these livestock-focused project activities are effective in increasing livestock productivity? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 151 Sustainability (EQ2) 21. Will households continue using the new livestock practices introduced by the project after the project ends? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 22. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 23.] If yes, could you please describe how you think households will continue these practices? If not, why not? [WRITE AN ANSWER] Replicability? (EQ2) 23. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the livestock practices introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 24. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 25.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 152 Water Management Activities: Relevance-EQ1 (Please explain that these questions relate to whether suitable/right things activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 25. In your opinion, were WMAs suitable/right things to addressing important needs of community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 26.] If yes, could you please describe how the project’s WMAs are suitable/right things to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1). These questions relate to how well activities were implemented 26. Were the WMAs effective in increasing household’s crop productivity? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 27. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 28.] If yes, could you please describe how these activities are effective in increasing crop productivity? If not, why not? BAP FINAL EVALUATION 153 Sustainability (EQ2) 28. Will households continue using the new water practices introduced by the project after the project ends? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 29. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 30.] If yes, could you please describe how you think households will continue these practices? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 30. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the WMAs introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 31. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 32] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 154 COMMUNITY DEVELOPMENT (CD) ACTIVITIES: Relevance (EQ1) 32. Were community organization activities suitable/right things to addressing community problems? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 33. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 34.] If yes, could you please describe how these community- development-related project activities are suitable/right things to solve community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) 34. Are community organizations effective, if at all, in identification of community problems and finding solutions to these problems with the help of external agencies? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 35. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 36.] If yes, could you please describe how COs were effective in this regard? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 155 36. Were the value chain development project activities effective, if at all, in increasing profitability in market? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 37. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 38.] If yes, could you please describe how these value chain development project activities are effective in increasing incomes? If not, why not? [WRITE AN ANSWER] 38. Could you please describe how these market-focused project activities can be made more effective in increasing market linkages? [WRITE AN ANSWER] 39. Why did so few CO members join FMCs or MMOs? [WRITE AN ANSWER] BAP FINAL EVALUATION 156 Sustainability (EQ2) 40. Based on your experience, will COFMC/MMOs survive after project ended without external support? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 41. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 42.] If yes, could you please describe how CO/FMC/MMOs will survive after project ended without external support? If not, why not? [WRITE AN ANSWER] 42. Do you think households will be able to sustain value chain/market development activities after the project ends? Only ask respondents who reported increases earlier. For others, mark “N/A” [CIRCLE ONE NUMBER FOR EACH RESPONDENT. ENTER N/A IF THE RESPONDENT DID NOT REPORT AN INCREASE IN PRODUCTIVITY OR INCOME] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 43. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 44.] If yes, could you please describe the conditions under which households will be able to sustain increased income from value chain development activities after the project ends? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 157 Replicability (EQ2) 44. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the value chain development activities introduced by the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 45. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 46.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] WOMEN’S EMPOWERMENT (EQ3) 46. Has women’s participation in project activities increased, if at all, household income? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 47. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 48.] If yes, could you please describe how women’s participation in these activities increased household income? If not, why so? [WRITE AN ANSWER] BAP FINAL EVALUATION 158 48. Has women’s ability to make decisions about household expenditures increased, if at all, due to the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 49. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 50.] If yes, could you please describe how women’s ability to make such decisions has increased? What factors affect their participation? If not, why not? [WRITE AN ANSWER] 50. Have WCOs played any role, if at all, in increasing women’s empowerment in community? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 51. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 52.] If yes, could you please describe how WCOs have empowered women in the community? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 159 52. Has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 53. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 54.] If yes, how has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? (By social change, we mean change in community values, norms, and ideologies that affects the economic and social participation and influence of women). If not, why not? [WRITE AN ANSWER] 54. Under what conditions wills the improvement, if any, in women’s empowerment sustain after the project ends? If not, why not? [WRITE AN ANSWER] OVERALL EFFECTIVENESS (EQ1) 55. Have the project activities undertaken any policy activities to influence GoB related policies? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 BAP FINAL EVALUATION 160 56. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 57.] If yes, please describe how effective these policies were? If not, why did the project not do so? [WRITE AN ANSWER] 57. Have there been any unintended benefits from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 58. [SKIP IF ALL RESPONDENTS SAY N/A TO QUESTION 59.] If yes, please describe the unintended benefits? [WRITE AN ANSWER] 59. Has there been any unintended harm from any of the project activities? [CIRLE ONE NUMBER FOR EACH RESPONDENT] Yes No N/A R1 1 2 99 R2 1 2 99 R3 1 2 99 R4 1 2 99 60. [SKIP IF ALL RESPONDENTS SAY N/A]. If yes, please describe the unintended harm? [WRITE AN ANSWER] BAP FINAL EVALUATION 161 Is there any interesting case that you can narrate either about success, failure, unintended benefits or unintended harm due to any of the project activities? Thank you for your time! BAP FINAL EVALUATION 162 GUIDE FOR KEY INFORMANT INTERVIEWS - SECTOR SPECIALISTS BALOCHISTAN AGRICULTURE PROJECT A1. Respondent name: A2. Agency/Organization: A3. Designation: A4. Source language: A5. Date : A6. Start time: End time: A7. Interview venue : A8. City/district A9. Interviewer name: A10. Note taker name: INTRODUCTION My name is ______________________. I work for MSI based in Islamabad. We are conducting a study to assess supported Balochistan Agricultural Project (BAP). (Not for USAID/FAO/AusAID): It is implemented by FAO in eight following districts of Balochistan: Killa Saifullah, Mastung, Loralai, Quetta, Zhob, Sherani, Pishin and Musakhel. BAP activities cover community organizing; water resource management; crop production and productivity, animal production and productivity, and value chain development and marketing. Through its activities, BAP seeks to address multiple key challenges faced by small farmers in Balochistan. The interview will take approximately 60-90 minutes. We will treat everything you say here with confidentiality. Nothing you say will be publicly attributed to you, and your names will not be given to anyone. Do I have your permission to record the interview? (Yes/No ____________) If participant says yes, continue the interview. If no, try to motivate participants by answering their questions and explaining the importance of recording the interview. Please cover sectors relevant to each respondent’s sectoral specialization only BAP FINAL EVALUATION 163 CROPS: Relevance-EQ1 (Please explain that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 1. In your opinion, were crop activities suitable to addressing important needs of community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 2. Were crop activities (name activities) the right thing to do to address important needs of community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 3. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 4.] If yes, could you please describe how the project’s crop activities are suitable to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) . These questions relate to how well activities were implemented 4. Were the crop activities effective in increasing household’s crop productivity? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 5. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 6.] If yes, could you please describe how these crop-focused project activities are effective in increasing crop productivity? If not, why not? [WRITE AN ANSWER] 6. Did household’s participation in crop-focused project activities increase household’s income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 BAP FINAL EVALUATION 164 7. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 8.] If yes, could you please describe how participating in crop-focused project activities increased household’s income? If not, why not? [WRITE AN ANSWER] Sustainability (EQ2) 8. Will households continue using the new crop practices introduced by the project after the project ends? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 9. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 10.] If yes, could you please describe under what conditions you think households will continue these practices? If not, why not? [WRITE AN ANSWER] 10. Do you think households will be able to sustain any increased crop productivity or income experienced after the project ends? Only ask RESPONDENT who reported increases earlier. For others, mark “N/A” [CIRLE ONE NUMBER] Yes No N/A 1 2 99 11. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 12.] If yes, could you please describe the conditions under which households will be able to sustain increased crop productivity and/or income from new crop practices after the project ends? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 12. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the crop practices introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 BAP FINAL EVALUATION 165 13. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 14.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] WOMEN-FOCUSED ACTIVITIES (WFAs): Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 14. In your opinion, were WFAs suitable to addressing important needs of women in community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 15. Were WFAs (name activities) the right thing to do to address important needs of women in community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 16. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 17.] If yes, could you please describe how the project’s WFAs are suitable to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) . These questions relate to how well activities were implemented 17. Did household’s participation in WFAs increase household’s income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 18. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 19.] If yes, could you please describe how participating in WFAs increased household income? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 166 Sustainability (EQ2) 19. Will households continue using the WFAs introduced by the project after the project ends? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 20. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 21.] If yes, could you please describe how you think households will continue these practices? If not, why not? [WRITE AN ANSWER] 21. Do you think households will be able to sustain any increased income experienced from WFAs after the project ends? Only ask RESPONDENT who reported increases earlier. For others, mark “N/A” [CIRLE ONE NUMBER] Yes No N/A 1 2 99 22. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 23.] If yes, could you please describe the conditions under which households will be able to sustain increased crop productivity and/or income from new crop practices after the project ends? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 23. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the WFAs introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 24. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 25.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 167 Livestock: Relevance-EQ1 (Please explain to communities that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 25. In your opinion, were livestock activities suitable to addressing important needs of community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 26. Were livestock activities (name activities) the right thing to do to address important needs of community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 27. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 28.] If yes, could you please describe how the project’s livestock activities are suitable to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) . These questions relate to how well activities were implemented 28. Were the livestock activities effective in increasing household livestock productivity? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 29. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 30.] If yes, could you please describe how these livestock-focused project activities are effective in increasing livestock productivity? If not, why not? [WRITE AN ANSWER] 30. Did household’s participation in livestock-focused project activities increase household’s income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 BAP FINAL EVALUATION 168 31. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 32.] If yes, could you please describe how participating in livestock-focused project activities increased household’s income? If not, why not? [WRITE AN ANSWER] Sustainability (EQ2) 32. Will households continue using the new livestock practices introduced by the project after the project ends? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 33. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 34.] If yes, could you please describe how you think households will continue these practices? If not, why not? [WRITE AN ANSWER] 34. Do you think households will be able to sustain any increased livestock productivity or income experienced after the project ends? Only ask RESPONDENT who reported increases earlier. For others, mark “N/A” [CIRLE ONE NUMBER] Yes No N/A 1 2 99 35. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 36.] If yes, could you please describe the conditions under which households will be able to sustain increased livestock productivity and/or income from new crop practices after the project ends. If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 36. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the livestock practices introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 BAP FINAL EVALUATION 169 37. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 38.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] Water Management Activities: Relevance-EQ1 (Please explain that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 38. In your opinion, were WMAs suitable to addressing important needs of community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 39. Were WMAs (name activities) the right thing to do to address important needs of community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 40. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 41.] If yes, could you please describe how the project’s WMAs are suitable to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1): These questions relate to how well activities were implemented 41. Were the WMAs effective in increasing household’s crop productivity? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 42. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 43.] If yes, could you please describe how these activities are effective in increasing crop productivity? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 170 43. Did household’s participation in WMAs increase household’s income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 44. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 45.] If yes, could you please describe how participating in WMAs increased household’s income. If not, why not? [WRITE AN ANSWER] Sustainability (EQ2) 45. Will households continue using the new water practices introduced by the project after the project ends? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 46. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 47.] If yes, could you please describe how you think households will continue these practices? If not, why not? [WRITE AN ANSWER] 47. Do you think households will be able to sustain any increased crop productivity or income experienced from WMAs after the project ends? Only ask RESPONDENT who reported increases earlier. For others, mark “N/A” [CIRLE ONE NUMBER] Yes No N/A 1 2 99 48. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 49.] If yes, could you please describe the conditions under which households will be able to sustain increased crop productivity and/or income from new WMAs after the project ends? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 171 Replicability (EQ2) 49. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the WMAs introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 50. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 51.] Skip if RESPONDENT SAYS NA. If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] COMMUNITY DEVELOPMENT (CD) ACTIVITIES: Relevance (EQ1) 51. Were community organization activities suitable to addressing community problems? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 52. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 53.] If yes, could you please describe how these community- development-related project activities are suitable to solve community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) 53. Are community organizations effective, if at all, in identification of community problems and finding solutions to these problems with the help of external agencies? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 54. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 55.] If yes, could you please describe how COs were effective in this regard? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 172 55. Did participation in community organization activities increase household income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 56. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 57.] If yes, could you please describe how did participation in these activities increase household incomes? If not, why not? [WRITE AN ANSWER] 57. Were the market-oriented community development project activities effective, if at all, in increasing linkages to market? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 58. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 59.] If yes, could you please describe how these market-focused project activities are effective in increasing market linkages? If not, why not? [WRITE AN ANSWER] 59. Were the value chain development project activities effective, if at all, in increasing incomes? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 60. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 61.] If yes, could you please describe how these value chain development project activities are effective in increasing incomes? If not, why not? [WRITE AN ANSWER] 61. Could you please describe how these market-focused project activities can be made more effective in increasing market linkages? [WRITE AN ANSWER] BAP FINAL EVALUATION 173 62. Why did so few CO members join FMCs or MMOs? [WRITE AN ANSWER] 63. Under what conditions will more CO members join FMCs or MMOs? [WRITE AN ANSWER] Sustainability (EQ2) 64. Based on your experience, will COFMC/MMOs survive after project ended without external support? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 65. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 66.] If yes, could you please describe how CO/FMC/MMOs will survive after project ended without external support? If not, why not? [WRITE AN ANSWER] 66. Will households continue to participate in CO/ FMC/MMO activities after project support has ended? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 67. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 68.] If yes, could you please describe how households will continue to participate in CO. FMC/MMO after project support has ended? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 174 68. Do you think households will be able to sustain any increased income you’ve experienced from market development activities after the project ends? Only ask RESPONDENT who reported increases earlier. For others, mark “N/A” [CIRLE ONE NUMBER] Yes No N/A 1 2 99 69. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 70.] If yes, could you please describe the conditions under which households will be able to sustain increased income from market development activities after the project ends? If not, why not? [WRITE AN ANSWER] 70. Do you think households will be able to sustain any increased income experienced from value chain development activities after the project ends? Only ask RESPONDENT who reported increases earlier. For others, mark “N/A” [CIRLE ONE NUMBER] Yes No N/A 1 2 99 71. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 72.] If yes, could you please describe the conditions under which households will be able to sustain increased income from value chain development activities after the project ends? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 72. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the community development activities introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 73. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 74.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 175 74. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the value chain development activities introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 75. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 76.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] 76. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the market development activities introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 77. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 78.] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] WOMEN’S EMPOWERMENT (EQ3) –Please ask gender specialists only 78. Has women’s participation in project activities increased, if at all, household income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 79. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 80.] If yes, could you please describe how women’s participation in these activities increased household income? If not, why so? [WRITE AN ANSWER] BAP FINAL EVALUATION 176 80. What factors if any, prevent women from engaging in income generation activities, in your community? [WRITE AN ANSWER] 81. Has women’s ability to make decisions about household assets increased, if at all, due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 82. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 83.] If yes, could you please describe how women’s ability to make such decisions has increased? What factors affect this? If not, why not? [WRITE AN ANSWER] 83. Has women’s ability to make decisions about household expenditures increased, if at all, due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 84. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 85.] If yes, could you please describe how women’s ability to make such decisions has increased? What factors affect their participation? If not, why not? [WRITE AN ANSWER] 85. Have WCOs played any role, if at all, in increasing women’s empowerment in community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 86. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 87.] If yes, could you please describe how WCOs have empowered women in the community? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 177 87. Has women’s ability to work outside their home changed, if at all due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 88. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 89.] If yes, how has the project contributed in improving women’s mobility and ability to work outside home? (e.g., access to health services, markets, education, business). If not, why not? [WRITE AN ANSWER] 89. Has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 90. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 91.] If yes, how has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? (By social change, we mean change in community values, norms, and ideologies that affects the economic and social participation and influence of women). If not, why not? [WRITE AN ANSWER] 91. Under what conditions wills the improvement, if any, in women’s empowerment sustain after the project ends? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 178 OVERALL EFFECTIVENESS (EQ1) 92. Have the project activities undertaken any policy activities to influence GoB related policies? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 [SKIP IF RESPONDENT SAYS N/A TO QUESTION 93.] If yes, please describe how effective these policies were? If not, why did the project not do so? [WRITE AN ANSWER] 93. Have there been any unintended benefits from any of the project activities? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 94. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 95.] If yes, please describe the unintended benefits? [WRITE AN ANSWER] 95. Has there been any unintended harm from any of the project activities? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 96. If yes, please describe the unintended harm? [WRITE AN ANSWER] Is there any interesting case that you can narrate either about success, failure, unintended benefits or unintended harm due to any of the project activities? Thank you for your time! BAP FINAL EVALUATION 179 GUIDE FOR KEY INFORMANT INTERVIEWS - SENIOR STAFF (FAO, USAID, Govt, AUSAID, NARC and MNFSR etc.) BALOCHISTAN AGRICULTURE PROJECT A1. Respondent name A2. Agency/Organization A3. Designation A4. Source language: A5. Date : A6. Start time: A7. End time: A8. Interview venue : A9. City/district A10. Interviewer name: A11. Note taker name: INTRODUCTION My name is ______________________. I work for MSI based in Islamabad. We are conducting a study to assess the impact of Balochistan Agricultural Project (BAP). (Not for USAID/FAO/AUSAID): It is implemented by FAO in eight following districts of Balochistan: Killa Saifullah, Mastung, Loralai, Quetta, Zhob, Sherani, Pishin and Musakhel. BAP activities cover community organizing; water resource management; project production and productivity, animal production and productivity, and value chain development and marketing. Through its activities, BAP seeks to address multiple key challenges faced by small farmers in Balochistan. The interview will take approximately 60-90 minutes. We will treat everything you say here with confidentiality. Nothing you say will be publicly attributed to you, and your name will not be given to anyone. Do I have your permission to record the interview? (Yes/No ____________) If respondent says yes, continue the interview. If no, try to motivate respondent by answering their questions and explaining the importance of recording the interview. BAP FINAL EVALUATION 180 Relevance-EQ1 (Please explain that these questions relate to whether suitable activities were chosen by project and not how well they were implemented. This latter issue will be covered under “Effectiveness” 1. In your opinion, were overall project activities suitable to addressing important needs of community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 2. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 2.] If yes, could you please describe how the project’s activities are suitable to addressing community problems? If not, why not? [WRITE AN ANSWER] Effectiveness (EQ1) . These questions relate to how well activities were implemented 3. Did household’s participation in project-focused project activities increase household’s income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 4. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 5] If yes, could you please describe how participating in project activities increased household’s income? If not, why not? [WRITE AN ANSWER] Sustainability (EQ2) 5. Will households continue using the new practices introduced by the project after it ends? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 6. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 7 ] If yes, could you please describe under what conditions you think households will continue these practices? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 181 7. Do you think households will be able to sustain any increased income experienced after the project ends? Only ask respondent who reported increases earlier in Q3. For others, mark “N/A” [CIRLE ONE NUMBER] Yes No N/A 1 2 99 8. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 9] If yes, could you please describe the conditions under which households will be able to sustain increased income from new project practices after the project ends? If not, why not? [WRITE AN ANSWER] Replicability (EQ2) 9. Are you aware of any non-project households (i.e. those not involved in the CO/FMC/MMO) that have adopted the practices introduced by the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 10. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 11] If yes, could you please describe how non-project households learned of these practices? If not, why not? [WRITE AN ANSWER] WOMEN’S EMPOWERMENT (EQ3) 11. Has women’s participation in project activities increased, if at all, household income? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 12. [SKIP IF RESPONDENTS SAYS N/A TO QUESTION 14 ] If yes, could you please describe how women’s participation in these activities increased household income? If not, why so? [WRITE AN ANSWER] BAP FINAL EVALUATION 182 13. What factors if any, prevent women from engaging in income generation activities, in the community? [WRITE AN ANSWER] 14. Has women’s ability to make decisions about household assets increased, if at all, due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 15. [SKIP IF RESPONDENTS SAYS N/A TO QUESTION 16] If yes, could you please describe how women’s ability to make such decisions has increased? What factors affect this? If not, why not? [WRITE AN ANSWER] 16. Has women’s ability to make decisions about household expenditures increased, if at all, due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 17. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 18] If yes, could you please describe how women’s ability to make such decisions has increased? What factors affect their participation? If not, why not? [WRITE AN ANSWER] 18. Have WCOs played any role, if at all, in increasing women’s empowerment in community? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 19. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 20] If yes, could you please describe how WCOs have empowered women in the community? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 183 20. Has women’s ability to work outside their home changed, if at all due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 21. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 22] If yes, how has the project contributed in improving women’s mobility and ability to work outside home? (e.g., access to health services, markets, education, business). If not, why not? [WRITE AN ANSWER] 22. Has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 23. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 25.] If yes, how has women’s ability to take leadership roles in community activities (social, political etc.) increased, if at all due to the project? (By social change, we mean change in community values, norms, and ideologies that affects the economic and social participation and influence of women). If not, why not? [WRITE AN ANSWER] 24. Under what conditions wills the improvement, if any, in women’s empowerment sustain after the project ends? If not, why not? [WRITE AN ANSWER] BAP FINAL EVALUATION 184 OVERALL EFFECTIVENESS (EQ1) 25. Have the project activities undertaken any policy activities to influence GoB related policies? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 [SKIP IF RESPONDENT SAYS N/A TO QUESTION 26.] If yes, please describe how effective these policies were? If not, why did the project not do so? [WRITE AN ANSWER] 26. Have there been any unintended benefits from any of the project activities? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 27. [SKIP IF RESPONDENT SAYS N/A TO QUESTION 28.] If yes, please describe the unintended benefits? [WRITE AN ANSWER] 28. Has there been any unintended harm from any of the project activities? [CIRLE ONE NUMBER] Yes No N/A 1 2 99 29. If yes, please describe the unintended harm? [WRITE AN ANSWER] Thank you for your time! BAP FINAL EVALUATION 185 Annex 4: List of Documents Reviewed Erskin-Smith, R. (2013). Balochistan Agriculture Project: Aid Memoir. Unpublished Report. FAO. (2009). The Balochistan Agriculture Project. Project Internal Document. FAO. (2011). USABBA Performance Management Plan, September 2011. Project Internal Document. FAO. 2011-14). Training Manuals (English and Urdu). Project Internal Document. FAO. (2012). Performance Management Plan, October 2012 (updated November 2012). Project Internal Document FAO. (2012). Balochistan Agriculture Project: Project Work Plan 2012. Project Internal Document. FAO. (2013). Balochistan Agriculture Project: Project Work Plan 2013. Project Internal Document. FAO. (2004). Pilot Phase – Food Security/Poverty Alleviation in Arid Agriculture Balochistan. Project Internal Document. FAO. (2014). Balochistan Agriculture Project: Project Work Plan 2014. Project Internal Document. FAO. (2015). Balochistan Agriculture Project: Project Work Plan 2015. Project Internal Document. FAO. (2015). Performance Evaluation of Farmer Marketing Collectives Report. Prepared by CHIP Training & Consulting Pvt. LTD. FAO. (2016) BAP Annual Work Plan. Project Internal Document. FAO. (2016). Balochistan Agriculture Project: Project Work Plan 2016. Project Internal Document. FAO. (2015). BAP Request for One Year No-Cost Extension. Project Internal Document. Farooq, U., Sharif, M., Taj. S., and Shah, N. (2014). Baseline Survey for Female Communities of Food Security and Poverty Alleviation in Arid Agriculture Balochistan. Food and Agriculture Organization of the United Nations. Farooq, U., Sharif, M., Taj. S., and Shah, N. (2014). Baseline Survey for Male Communities of Food Security and Poverty Alleviation in Arid Agriculture Balochistan. Food and Agriculture Organization of the United Nations. Government of Balochistan. (2011). Districts Development Profile. Retrieved from: http://balochistan.gov.pk/DistrictProfile/Profiles.htm Government of Balochistan. (2014). Baluchistan Agriculture Sector Policy and Strategy (with support from USAID BAP). Unpublished Report. Hassan, E. (2006). Recall Bias Can Be a Threat to Retrospective and Prospective Research Designs. The Internet Journal of Epidemiology 3(2): 339-412. Krieger, D. (2011). Balochistan Agriculture Project Baseline Report. Project Internal Document. Portmen, A. (2013). Balochistan Agriculture Project Value Chain Production Linkage Consult. Unpublished Report. USAID. (2005). Food Security and Poverty Alleviation in Arid Agriculture in Balochistan Project (2005 – 2008). Project Internal Document. BAP FINAL EVALUATION 186 USAID. (2008). BAP Grant and Cooperative Agreement – between FAO and USAID. Project Internal Document. USAID. (2008). Report on Evaluation of Food Security – Poverty Alleviation in Arid Agriculture Balochistan Project. Retrieved from: http://pdf.usaid.gov/pdf_docs/Pdacl739.pdf USAID. (2009). US Assistance to Agriculture in Balochistan Border Areas (2009 to 2012). Project Internal Document. USAID. (2010). United State Assistance Baluchistan Border Area’s (USABBA) Mission Report 2010. Project Internal Document. USAID. (2011). United State Assistance Baluchistan Border Area’s (USABBA) Evaluation Report. Project Internal Document. USAID. (2012). BAP Grant and Cooperative Agreement – between FAO and USAID. Project Internal Document. USAID. (2012). United State Assistance Baluchistan Border Area’s (USABBA) Evaluation Report Final, January 2012. Retrieved from: http://pdf.usaid.gov/pdf_docs/Pdact381.pdf USAID. (2012). Balochistan Agriculture Project Annual Report 2012. Project Internal Document. USAID. (2012-16). Quarterly Progress Reports BAP (for 2012, 2013, 2014, 2015, and two quarters in 2016). Project Internal Documents. USAID. (2013). Balochistan Agriculture Project Annual Report 2013. Project Internal Document. USAID. (2013). Balochistan Agriculture Project (BAP), Performance Management Plan November 2013. Project Internal Document. USAID. (2013). Balochistan Agriculture Project Semi-Annual Report Nov 2012 to April 2013. Project Internal Document. USAID. (2013). Balochistan Agriculture Project Semi-Annual Report May-Oct. 2013. Project Internal Document. USAID. (2014). Balochistan Agriculture Project Semi-Annual Report Nov 2013 to April 2014. Project Internal Document. USAID. (2014). Balochistan Agriculture Project Semi-Annual Report May-Oct 2014. Project Internal Document. USAID. (2014). Balochistan Agriculture Project Baseline Study. Unpublished Report. USAID. (2014). Balochistan Agriculture Project Annual Report 2014. Project Internal Document. USAID. (2014). COs Maturity Assessment – BAP. Project Internal Document. USAID. (2015). Balochistan Agriculture Project Annual Report 2015. Project Internal Document. Vinning, G. (2012). Balochistan Agriculture Project Interim Report. Unpublished Report. World Bank. (2015). Global Monitoring Report 2015. Retrieved from: http://pubdocs.worldbank.org/en/503001444058224597/Global-Monitoring-Report-2015.pdf BAP FINAL EVALUATION 187 Annex 5: Financial Analysis of FMCs in 2012 FMCs Financial Results 2012: Financial results of the FMCs marketing plans vis-à-vis non-FMC farmers: Quetta Name of FMC Product Markets Quantity Units Price (Rs./unit) Gross Sales (Rs) Costs (Rs) Net Sales (Rs) Unit Profit (Rs) % increase FMC vs. Non-FMC 2012 Farmers 2011 Apple Islamabad, Karachi, and Lahore 10,335 530 5,477,550 3,949,004 1,528,547 147.9 FMC 2012 Apple Islamabad 10,140 584 5,921,200 3,197,540 2,723,660 268.6 67% Non-FMC 2012 Apple Islamabad 1,950 530 1,033,500 719,754 313,746 160.9 Remarks: FM’s market analysis leading to selection of Islamabad wholesale market where prices are generally high due to expatriates and negotiation of commission at the reduced rate of 5% (normally 7% is charged) resulted into better gross and net sales both. Killa Saifullah Name of FMC Product Markets Quantity Units Price (Rs./unit) Gross Sales (Rs) Costs (Rs) Net Sales (Rs) Unit Profit (Rs) % increase FMC vs. Non-FMC 2012 FMC 2012 Apple Lahore, D. G. Khan, Faisalabad Multan, Quetta, and Islamabad 5,515 1,397 7,705,185 2,723,581 4,981,604 903.3 23% Non-FMC 2012 Apple Lahore, D. G. Khan, Multan, and Faisalabad 2,732 1,183 3,232,020 1,222,577 1,999,443 731.9 Remarks: FMC’s better marketing strategy like sending good quality produce to distant markets especially Lahore and Islamabad, and relatively low quality to Quetta resulted into better net sales. FMC has placed 1846 boxes in cod store for release during off-season when price will increase. BAP FINAL EVALUATION 188 Mastung Name of FMC Product Markets Quantity Units Price (Rs./unit) Gross Sales (Rs) Costs (Rs) Net Sales (Rs) Unit Profit (Rs) % increase FMC vs. Non-FMC 2012 FMC 2012 Grape Karachi, Khanpur/ Sadiqabad, and Faisalabad 7,700 43.34/kg 2,670,000 1,360,700 1,309,300 170.0 48% Non-FMC 2012 Grape Karachi, Khanpur/ Sadiqabad, and Faisalabad 7,700 43.34/kg 2,670,000 1,783,700 886,300 115.1 Remarks: FMC’s saving on packing material, transport and labor resulted into higher net income than non-FMC farmers. Loralai Name of FMC Product Markets Quantity Units Price (Rs./unit) Gross Sales (Rs) Costs (Rs) Net Sales (Rs) Unit Profit (Rs) % increase FMC vs. Non-FMC 2012 FMC Cauliflower Quetta, D. G. Khan, Multan 1,750 60.91 435,000 328,400 106,600 60.9 4% Non-FMC Cauliflower Quetta, D. G. Khan, Multan 2,400 58.64 594,600 453,872 140,728 58.6 Remarks: Improved grading and packing resulted into higher sales per bag of FMC farmers compared with non-FMC farmers. The originally planned volume and quality significantly decreased due to heavy rains damaging the crop and blocking road access to markets. Estimated 50% crop lost. Note: (1) Type of packing: apple – 18 kg wooden box; grape – 8 kg cardboard carton; and cauliflower – 35 kg polypropylene woven bag. (2) Price in Rupees per unit (box/carton/bag) BAP FINAL EVALUATION 189 Annex 6: Two Qualitative Case Studies from the Field Case Study 1: “The King of Seed” His first name is Shahinsha, which means the king. He is known as the “king of seed” among his circle of friends and customers. His name has become the brand name for the product he proudly sells. Shahinsha belongs to a farming family in a remote corner of Balochistan. He is also an agricultural graduate. “I came into contact with the FAO project when it was laying a demonstration plot for high￾yielding varieties of wheat seed in my village,” says Khan, recalling his Eureka moment. “I worked on the demonstration plot as a field assistant and a translator, and saw an opportunity to start my own business.” When he did some background checks, he found out that there were only three seed companies in the whole of Balochistan. “Because of the risk of kidnappings for ransom, outside companies are reluctant to come to our province, so the bulk of the wheat seed is imported from Punjab (a neighboring province) by local traders, which is often unsuited to local conditions, and unreliable.” Explaining his point, Khan says that farmers prefer to know the source of their seed, so that they can complain to the supplier when the quality is poor or germination is low. “If I start this business in my own area, people will trust me since they know me personally and also know that I am an agriculturist; they can easily contact me, if they had any problem,” Khan says of his rationale to enter the seed business. Khan then contacted the Federal Seed Certification Department (FSCD) and learned the procedure for setting up a private seed company. “I now supply certified seed to farmers and NGOs in my province, and also export to Afghanistan.” Explaining his business success, Khan says, “I started with my own farm, and now lease out 150 acres of land from other farmers in three districts to produce commercial wheat seed, which is certified by FSCD. The project gave me technical support and also twice gave me supply orders. Since 2014, I have earned Rs. 4 million. The demand for certified seed is high in Balochistan, but I want to go step by step,” says the budding King of Seed. Case Study 2: “The Pride of Her Husband” “My name is Bibi, I am from District Quetta and live with my extended family, just outside of Quetta city. Altogether, we are 24 members in our family. I am a member of our WCO since 2012. Out of 14 WCO members, 9 have been trained in scientific methods of vegetable cultivation. All of us have established our own vegetable gardens, with initial support from FAO. Through my training, I know seed selection, soil quality testing, sowing in raised beds, mulching, composting, insect identification, and many other technical tasks, which not even men know in our village. We grow many types of vegetables, such as tomatoes, cauliflower, cabbage, carrots, and cucumbers. Sometimes, FAO takes us to other villages to train other women. Initially, elders in the family were against my going out and being seen and talked to by unknown people at FAO, even when our trainers were all women. I pleaded with my husband that I only wanted to learn and be useful, so he relented and assured the family elders that he will personally accompany me for these training sessions, and he did. It was a life changing experience for me. Now, I am allowed to go with FAO’s female staff to train women in other villages. The vegetables that I grow in my home garden are well known for their productivity, high quality, taste, and the duration of the year they are available for. They are more than enough for our home needs and my husband sells the rest to a retail shop in the city. My family is very happy with my work, and when there are guests in our house they are very impressed by our vegetable garden, and the harvest we cook for them. Our children eat more fresh vegetables than they did before, and they are visibly healthy, really, with their rosy cheeks. My husband is very proud of me and supports what I do. He calls me ‘my pride,’ in our private moments.” BAP FINAL EVALUATION 190 Annex 7: Respondent Profiles STAKEHOLDER AND EXPERT IN-DEPTH INTERVIEWS Respondent Type Location Number of Interviews National Agriculture Research Council (NARC) Islamabad 3 Balochistan Agriculture Research Council (PARC) Quetta 2 Ministry of National Food Security and Research (MNFSR) Islamabad 1 Government of Balochistan (GoB) Quetta 5 USAID/Pakistan EGA Office Islamabad 2 FAO Country Office Islamabad 8 FAO BAP team Quetta 2 FAO BAP international experts N/A 3 Experts on Balochistan province, agriculture, water, etc. Quetta, Islamabad 7 AusAID Islamabad 1 Business development service providers Quetta 4 Other Islamabad 2 Total 40 GROUP INTERVIEWS Respondent Category No. of Interviews Participants Maximum Number of Participants WCOs 6 interviews, 2 in each district 3-4 participants per interview, each representing a different WCO 24 MCOs 6 interviews, 2 in each district 3-4 participants per interview, each representing a different MCO 24 FMC/MMO members 9 interviews, 3 in each district 3-4 participants per interview, preferably representing different FMCs 36 BAP project team 1 interview in Quetta Up to 12 participants representing each district and the central project management team 10 District government officials 1 interview in Quetta Up to 8 government officials, responsible for district level agriculture activities. 1 from each of the 8 project districts. 4 Business Development Service Providers (BDSPs) 1 interview in Quetta Up to 5 participants, each representing a different BDSP 0 Total 98 BAP FINAL EVALUATION 191 SURVEY SAMPLE Location MMO/FMC Members Non-FMC Members Men’s FMCs/MMOs Women’s FMCs/MMOs MCO Members WCO Members Killa Saifullah (pilot district) 79 - 70 70 Zhob (USABBA district) 56 - 70 70 Sherani (BAP district) 41 - 70 70 Quetta 16 10 - - Loralai 39 - - - Mastung 32 - - - Totals 263 10 210 210 273 420 693 DATA COLLECTION BY METHOD AND DISTRICT Data Collection Method District Total by Method Killa Saifullah Zhob Sherani Islamabad Quetta Loralai Mastung In-depth interview - - - 15 25 - - 40 Group interviews 7 7 7 - 2 - - 23 Survey 219 196 181 - 26 39 32 693 Total by location 226 203 188 17 54 39 32 756 BAP FINAL EVALUATION 192 Summary of Survey Data AGE BY GENDER (IN YEARS) Response Female Male Minimum age 16 17 Maximum age 70 74 Average age 34 38 Total sample 220 473 DISTRIBUTION OF HOUSEHOLD MEMBERS BY GENDER AND AGE GROUP Response Adult (>=18 year) Children (<18 year) Total Male 2,658 2,554 5,212 Female 2,255 2,099 4,354 Total 4,913 4,653 9,566 Note: Table represents the total number of members of interviewed households (total 693) distributed between age group (adult and children) by gender. EDUCATIONAL ATTAINMENT BY GENDER (FREQUENCY) Education Level Gender Total Female Male Do not know/refused 1 0 1 None 168 147 315 Primary 18 75 93 Middle 13 50 63 Secondary 8 81 89 Intermediate 4 50 54 Undergraduate degree 0 8 8 Graduate degree 3 27 30 Master 5 35 40 Total 220 473 693 BAP FINAL EVALUATION 193 GENDER BY DISTRICT (FREQUENCY) District Name Gender Total Female (n=220) Male Killa Saifullah 70 149 219 Zhob 70 126 196 Sherani 70 111 181 Quetta 10 16 26 Loralai 0 39 39 Mastung 0 32 32 Total 220 473 693 GENDER BY DISTRICT (PERCENTAGE) District Name Gender Total Female (n=220) Male (n=473) Killa Saifullah 32% 68% 32% Zhob 32% 57% 28% Sherani 32% 50% 26% Quetta 5% 7% 4% Loralai 0% 18% 6% Mastung 0% 15% 5% Total 32% 68% 100% CONDITION OF HOUSES BY DISTRICT (PERCENTAGE) District Pacca Katcha Semi Pacca Total Killa Saifullah 44% 35% 8% 32% Zhob 22% 28% 32% 28% Sherani 11% 22% 52% 26% Quetta 11% 3% 7% 4% Loralai 0% 6% 1% 6% Mastung 11% 5% 0% 5% Total 1% 86% 13% 100% BAP FINAL EVALUATION 194 RESPONDENT TYPE BY DISTRICT (PERCENTAGE) District Name Respondent Type Total CO (n=420) FMC (n=147) MMO (n=126) Killa Saifullah 33% 34% 23% 32% Zhob 33% 31% 8% 28% Sherani 33% 28% 0% 26% Quetta 0% 7% 13% 4% Loralai 0% 0% 31% 6% Mastung 0% 0% 25% 5% Total 61% 21% 18% 100% PRIMARY INCOME GENERATING ACTIVITIES BY GENDER (FREQUENCY) Activity Female Male Total Crop production 14 415 429 Livestock 45 21 66 Commerce 1 1 2 Other business 3 10 13 Employee 7 19 26 Retired 0 1 1 Looking for work 2 0 2 Other 5 5 10 None 143 1 144 Total 220 473 693 BAP FINAL EVALUATION 195 The FAO index is an indicator of sustainability. The index applies to both COs and FMCs. NUMBER OF COs BY MATURITY Maturity Classification Definition Number of COs Percentage of Total COs Mature Score of > 35 270 30% Semi-mature Score < 36 and > 20 260 28% Initial Score < 20 263 29% Dormant Members have not met in last 6 months 122 13% Source: FAO Maturity list of 915 COs, 2016 MATURITY OF COs BY DISTRICT Breakdown Pilot Phase Phase 1 Phase 2 Number of COs % of Total Number of COs % of Total Number of COs % of Total Number of districts 3 - 2 - 3 - Number of COs 481 - 200 - 234 - Of which: Mature 158 33% 49 25% 63 27% Semi-mature 154 32% 34 17% 72 31% Initial 169 35% 117 59% 99 42% Source: Calculated from FAO Maturity list of 915 COs, 2016 BAP FINAL EVALUATION 196 Annex 8: Findings MEN’S ACTIVITIES Activity Was the activity relevant to your household needs? Did participating in the activity increase your household's income? Did your household benefit from participating in this activity in other ways? Increasing crop yields (n=384) 100% 99% 98% Distributing plant material/training in HVC (n=292) 100% 100% 100% Distributing plant material/ training in Low delta crops (n=224) 100% 100% 100% Improving water harvesting infrastructure (n=238) 100% 100% 100% Increasing water available for agriculture (n=191) 100% 100% 100% On-farm water management (n=192) 100% 100% 100% Improving animal feeding practices (n=315) 100% 100% 100% Improving animal health practices/vaccination (n=297) 99% 99% 98% Training of community animal health workers (n=262) 100% 99% 98% Participating in livestock mandis (n=237) 98% 95% 96% Market Exposure Visits (n=231) 99% 98% 98% Farmer Field Schools (FFS) (n=176) 99% 98% 99% Capacity building for marketing (n=252) 100% 98% 99% Distribution of packing material/foods, vegetables (n=131) 100% 100% 99% Distribution of kits/trainings (wool shearing) (n=41) 100% 100% 100% Overall 100% 99% 99% Note: These are number of members who participate in the activity. BAP FINAL EVALUATION 197 WOMEN’S ACTIVITIES Activity Was the activity relevant to your household needs? Did participating in the activity increase your household's income? Did your household benefit from participating in this activity in other ways? Food processing training or market visits (n=162) 99% 86% 90% Kitchen gardens (seed distribution or training) (n=164) 99% 91% 91% Wool spinning training (n=78) 99% 94% 92% Animal rearing training (n=155) 99% 95% 97% Animal feeding (feed distribution or training) (n=160) 100% 94% 94% Drinking water facility in village (n=100) 100% 83% 97% Rug making (training or marketing) (n=22) 100% 100% 100% Capacity building for marketing and linking to markets (value chain analysis, establish FMCs, MMOs) (n=62) 100% 92% 92% Poultry raising (poultry distribution, training, incubators) (n=197) 100% 98% 99% Farmer Field Schools FFS (Livestock) (n=118) 99% 97% 97% Overall 100% 93% 95% Note: These are number of members who participate in the activity. YES RESPONSES TO WHETHER PROJECT ACTIVITIES WERE RELEVANT IN THE BALOCHISTAN CONTEXT Respondent Type Overall Project KIIs FAO Staff (n=10) 3 Government Staff (n=12) 7 Other (n=14) 8 Total 36 BAP FINAL EVALUATION 198 AVERAGE HOUSEHOLD NET INCOME BY DISTRICT Income Source 2009 Baseline 2015 Final Evaluation % Change Nominal Value (2009-2015) % Change Inflation Adjusted (2009– 2015) Rs. 2009 (Nominal) Rs. 2016 (Real) Amount Killa Saifullah 472,557 822,250 160,3019 239% 95% Zhob 175,867 306,009 108,7593 518% 255% Source: 2009 baseline report and BAP survey Note: Values from 2009 are inflated using a factor of 1.74 based on reported CPI figures for Pakistan. Pakistan bureau of statistics. The 2009 baseline did not collect data in Sherani. LIVESTOCK PRODUCTIVITY Animal 2009 2015 % Change Goat 8.9 30.2 240% Sheep 11.8 45.0 282% Cattle 6.5 14.5 123% Poultry 10.2 75.9 643% Total 9.7 38.4 296% LIVESTOCK PRODUCTIVITY – KILLA SAIFULLAH, 2009–2015 Animal 2009 2015 % Change Goat 6.8 18.9 178% Sheep 11.5 26.2 129% Cattle 6.0 8.0 34% Poultry 11.8 83.1 603% Total 9.2 24.2 162% LIVESTOCK PRODUCTIVITY – ZHOB, 2009–2015 Animal 2009 2015 % Change Goat 18.9 57.8 206% Sheep 35.0 56.9 63% Cattle 8.8 15.7 79% Poultry 2.9 73.9 2,440% Total 12.6 49.9 295% BAP FINAL EVALUATION 199 CROP PRODUCTIVITY Crop 2009 2015 % Change Wheat 5.85 3.51 -40% Barley 3.65 2.31 -37% Maize 3.59 5.33 49% Tomatoes 4.52 8.86 96% Onions 6.34 6.76 7% Chilies 5.89 19.65 234% Carrots 5.59 37.71 575% Apples 2.90 14.29 393% Grapes 2.78 22.48 709% Apricots 3.66 12.63 245% Total 4.13 16.38 297% CROP PRODUCTIVITY BY DISTRICT (2009), BAP HOUSEHOLD SURVEY Crop Killa Saifullah Loralai Mastung Sherani Quetta Zhob Total Wheat – local 4.51 9.96 3.87 13.49 4.47 7.28 Wheat – improved 4.89 4.51 0.53 4.41 Barley – local 3.29 4.16 3.65 Maize 3.38 4.44 1.99 3.59 Mash 3.53 2.13 0.13 2.93 Cumin 9.10 5.58 7.34 Tobacco 3.89 2.01 3.66 Tomatoes 4.47 6.33 3.72 2.89 4.52 Cauliflower 3.81 3.81 Onions 4.78 7.89 12.18 2.46 6.34 Potatoes 2.69 3.05 2.87 Chilies 4.75 7.30 5.12 5.89 Shimla 8.78 3.88 4.86 Peas 4.05 7.11 4.12 4.30 Carrots 5.37 6.80 1.40 5.59 Other vegetables 4.29 2.11 3.56 Apples 3.20 3.22 1.91 4.49 2.90 Grapes 2.78 2.78 Almonds 4.85 3.74 26.13 1.54 5.30 Apricots 3.14 5.46 3.66 Pomegranates 8.42 4.33 5.69 Other fruits 3.28 3.28 Total (all crops) 3.61 4.26 5.12 4.56 10.32 3.04 4.13 BAP FINAL EVALUATION 200 CROP PRODUCTIVITY (2016), EVALUATION HOUSEHOLD SURVEY Crop Killa Saifullah Loralai Mastung Sherani Quetta Zhob Total Wheat 2.36 3.74 2.77 4.35 3.35 3.51 Barley 2.31 2.31 Maize 5.33 5.33 Tomatoes 9.64 7.34 8.86 Onions 11.41 3.71 6.76 Chilies 19.65 19.65 Carrots 37.71 37.71 Apples 11.43 30.36 14.29 Grapes 32.89 11.16 22.48 Apricots 12.69 12.52 12.63 Pine nuts 116.62 116.62 Mulberries 78.97 78.97 Total (all crops) 11.00 32.06 22.69 10.30 34.29 19.58 16.38 % Change since 2009 204% 652% 343% 126% 232% 543% 296% PERCEIVED SUSTAINABILITY OF COs Category Members Killa Saifullah (n=219) Sherani (n=181) Zhob (n=196) Very Likely Very Likely Very Likely WCO 63% 67% 74% MCO 61% 83% 53% FMC/MMO 63% 93% 86% BAP FINAL EVALUATION 201 NUMBER OF COs EFFECTIVE IN IDENTIFYING AND FINDING SOLUTIONS TO PROBLEMS Response FMC/MMO (n=36) WCO (n=24) MCO (n=24) BAP project team (n=10) District Govt Officials (n=4) Total (n=98) Yes 31 19 15 8 1 74 NUMBER OF WCOs PLAYING A ROLE IN INCREASING WOMEN’S EMPOWERMENT FAO Staff (n=5) GoB (n=3) Other (n=10) WCO (n=24) MCO (n=20) District Govt Officials (n=4) 5 1 10 6 5 4 WOMEN’S EMPOWERMENT Type Outcome WCO Members (n=24) MCO Members (n=20) FAO Staff (n=5) Govt Staff (n=3) Other (n=10) Total (n=62) Economic empowerment (n=62) Women’s participation in project activities increased household income 20 10 4 1 9 44 Women’s ability to make decisions about the household’s finances increased 9 8 3 1 5 26 Social empowerment (n=62) WCOs played a role in increasing women’s empowerment 6 8 3 1 6 24 Women’s ability to take leadership roles in community activities increased 3 4 1 1 2 11 U.S. Agency for International Development 1300 Pennsylvania Avenue, NW Washington, DC 20523