From June-August, 2018, Graduating to Resilience conducted targeting exercises to identify eligible beneficiaries for the Activity. As part of this process, the team conducted two pilots and held After Action Reviews (AARs) daily to address challenges as they occurred. The Activity used a two-part Participatory Rural Appraisal (PRA) approach to identify eligible households, comprised of both Social Mapping and Poverty Wealth Ranking (PWR) exercises. This methodology relies heavily on community participation and engages community members and leaders in beneficiary selection, not only as sources of information but also as partners in gathering and analyzing information. The Social Mapping component involves walking through each village with leaders and community members to physically locate every HH and conduct a brief quantitative survey to assess the wealth of each HH. PWR brings together community members and leaders and allows for representatives to define wealth rankings (extremely poor, poor, moderate, and rich) and place every member of the community into one of the corresponding ranking based on their own wealth definitions.
PILOT TESTING OF PRA METHODOLOGY FOR TARGETING
The Activity team consulted extensively with the external evaluator as well as government stakeholders at all levels to refine the PRA methodology for targeting and ultimately for the identification of eligible households. In Figure 1, the main steps of the process are listed, as well as a quick summary of the results from each pilot.
The table below highlights some key lessons learned and their solutions implemented through the iterative learning process.
|The adapted PPI was not sensitive enough to determine economic status.||As a result, Activity partners revised the targeting approach. The team developed a 9 question Scorecard using the communities’ definitions of poor and extremely poor. This Scorecard was better adapted for the context.|
|Many households were left off the household list provided by village leaders and as a result were not part of the PRA exercises.||The team conducted the social mapping exercise first. This exercise included the Scorecard which allowed the team to validate the list provided by village leaders.|
|The issue surrounding land is extremely sensitive. Both refugee and host community members have had land taken from them since the start of the settlement in 2012. Participants reported that they were afraid that AVSI was coming to take their land and at times would not speak to enumerators.||The team changed their approach to mobilizing communities. When meeting with village leaders to explain the purpose of the social mapping and poverty wealth ranking, the team made sure local leaders understood the exercises and were able to clearly explain the purpose to community members.|
|Timing and scheduling of the targeting process had to take into account many factors, including other activities in the settlement and distances in the host community.||The team scheduled activities in the settlement taking into account WFP food distribution days. Refugee HHs tend to be closer in proximity than those in the host community. The additional time to travel from one house to another in the host community had to be considered during the PRA scheduling.|
SCALED-UP TARGETING APPROACH
After Pilot 2, the revised methodology was used at scale to identify eligible households for participation in the first cohort of the Activity, inclusive of a control group.
The Activity identified 25,140 eligible households through an innovative, participatory, and community-led process. 11,536 (46%) of these households are within the refugee settlement, whereas 13,604 (54%) are from the host community. A total of 195 villages (45 in the refugee settlement and 150 in the host community) have been reached by this exercise. Villages will be assigned as “treatment” or “control”, and from within the “treatment” villages a total of 6,600 households will be assigned to the three treatment arms. An additional 4,400 households will constitute two equally-sized control groups; 2,200 households in the “control” villages, and another 2,200 households in the “treatment” villages. This second control group will allow for the detection and measurement of possible spillover effects from the treatment groups.
Graduating to Resilience targets poor and extremely poor, but economically active households which are also chronically food insecure.
As shown in Table 2, the participatory approach to targeting is resource-intensive, both in terms of staffing and time.
TABLE 2. GRADUATING TO RESILIENCE TARGETING RESULTS
|HHs ASSESSED||ELIGIBLE HHs||NON ELIGIBLE HHs|
TABLE 3. OVERVIEW OF TARGETING RESOURCES AND LOGISTICS
NEXT-STEPS TO ENROLlMENT
The PRA methods described were not the end of the targeting effort. Once lists of eligible households were completed by the Activity team, they were handed over to the external evaluator for review and preparation for the baseline survey implementation. Subsequently, the external evaluator randomized villages into treatment and control categories and provided those results to Graduating to Resilience. Once baseline data collection is completed, the Activity team will return to each and every village and conduct a public lottery to assign selected households to one of the treatment arms or to the control group.
Figure 2. Pathway for beneficiary enrolment – Graduating to Resilience (Steps 1-3 cover the targeting phase)
SUMMARY LESSONS LEARNED
The lessons learned from the two pilots underlined the importance of the involvement of the local community, especially from the very beginning. Local leaders helped to mobilize community members and to answer questions, reducing the perception of the exercise being a census. The Activity benefited from the deep understanding of locally conceptualized poverty classifications to better align project objectives to reach the extreme poor in both refugee and host communities.
Reliable community lists and mapping of the household locations were difficult in both settings; direct observation through visiting each household should be carried out to ensure that extremely poor households are not excluded. This is essential as households frequently move from one location to another.
In addition to the community engagement, another positive aspect of the targeting process has been the engagement of coaches in the PRA. This early engagement allowed coaches to become familiar with the communities with whom they will work, meet and work closely with Graduating to Resilience staff prior to implementation, and increase their knowledge of the selection process should questions arise at later times. On the other hand, having coaches, numbering just under 200, on board very early on carries a cost implication. As part of the external evaluation, the Activity will conduct a cost-benefit analysis at the end of the activity and will see if this information can be determined. Stay tuned for more information regarding lessons learned from hiring over 260 local staff to fill the coaching and community based trainer positions.