Review of the dfat ending Violence Against Women (evaw) Program in Afghanistan
Download 392.87 Kb.
|
- Navigate this page:
- 1.1 Scope, Methodology, and Methods
- Approach and Methodology
- Methods
IntroductionThis report presents the findings of the midterm review of the Australian Department of Foreign Affairs and Trade (DFAT) Ending Violence Against Women (EVAW) Program in Afghanistan, undertaken by Adam Smith International. The review team comprised a Team Leader, National EVAW Expert, and Translator. The midterm review was initiated to examine achievements and identify potential ways to improve the EVAW program’s impact and sustainability. This review is intended to inform DFAT’s future decision-making for the EVAW program and policy dialogue with the Government of Afghanistan and relevant international and non-government stakeholders. The objectives of this independent review were twofold:
The team would like to express its appreciation of the logistical support provided by Adam Smith International in Kabul, as well as the support and inputs provided by DFAT, the Australian Embassy in Kabul, and the implementing partners of the DFAT EVAW program—the Afghanistan Human Rights Commission, Afghan Women’s Network, The Asia Foundation, UN Women, and UNFPA during the course of this review. We would also like to thank all the participants in this evaluation for their time and for sharing their invaluable perspectives and inputs for this review. 1.1 Scope, Methodology, and MethodsScopeThis review addresses the entire program and its activities since its commencement in June 2013. The primary focus of the review is the combined implications of the projects and whether the program activities and means of implementation have furthered the program towards achieving its intended outcomes and overall goal. A key focus of this review is whether the program contributes in terms of strengthening the systems in place for combating VAW at all levels, from the grassroots and traditional actors engaged in the projects to the institutional level that is the focus of much of the program, as well as whether this institutional support is sustainable through meaningful policy change, effective capacity development, and adequate buy-in from key stakeholders. This review also places considerable focus on the implementation arrangements and means of delivery and coordination in the project, as well as the monitoring and evaluation of the program. Approach and MethodologyThe overall tool informing the review was the evaluation matrix, which was aligned with the OECD-DAC criteria identified as priority criteria to DFAT at the midterm stage: effectiveness, sustainability, monitoring and evaluation, and efficiency (See Annex A: Evaluation Matrix). The questions in the matrix were based on the terms of reference for the review. Given the integrated approach of the program and the variety of implementing partners ranging from civil society to government to international organizations, this review generally approached learning and evaluation through the context of collective impact, which is best suited for addressing large-scale social problems such as VAW. Collective impact (CI) occurs when a group of actors from different sectors commit to a common agenda for solving a complex social or environmental problem. The CI approach is particularly suited to this review, as it is based on the rationale that traditional approaches to evaluation, in which an individual organization is held accountable for effectively implementing a specific program or intervention, cannot offer CI partners the robust support they need to track their progress, improve their effectiveness, and adapt their strategy over time. At the midterm stage, CI is generally focused on intermediate outcomes reflected in behavioral and systems changes that contribute to the achievement of the projects goals and intended outcomes.1 (See Annex C: Collective Impact Framework) MethodsThe review was conducted utilizing a mixed-methods approach, with primary data collection conducted through qualitative methods, combined with a review of secondary quantitative data provided by the implementing partners and triangulation of findings with additional secondary sources. The review began with a desk review of program documents conducted remotely, followed by a ten-day in-country visit in January 2016. The approach for this evaluation was designed with a focus on promoting learning for DFAT, the EVAW program partners, and government stakeholders. A key element of the evaluation was a Strategic Learning Debrief. The Strategic Learning Debrief is a facilitated meeting that brings data collection and analysis together with intuitive learning in the context of a Theory of Change. Specifically, the Strategic Learning Debrief is an opportunity to: explore what strategies were completed during a pre-defined time period; review what has been learned about the outcomes and preconditions the program intends to influence; and discuss the relationship between strategies, outcomes, and preconditions. The Strategic Learning Debrief was conducted at the beginning of the in-country visit with representation from DFAT and all DFAT EVAW program implementing partners, and set the foundations for the data collection to inform this review. To collect information to inform the review based on the evaluation matrix, the evaluation team utilized different data collection tools, including:
(See Annex D: List of Interviews Conducted) In order to protect the rights of the participants, ensure voluntary participation, and uphold the principles of do no harm, a mandatory consent form was developed for use in all interviews. The consent form explained the context and purpose of the review, established informed consent, and ensured anonymity of responses and information provided. Given the sensitive nature of the evaluation topic and in line with the informed consent process of the review, all data was anonymized regarding the names and positions of the participants. Analysis of the data was undertaken on an ongoing, in-process basis during the in-field activities. Detailed notes were taken during each interview, and where consent was provided, interviews were recorded to allow the team members to revisit specific dialogues and conversations in the analysis phase. Upon conclusion of the in-country visit, all notes and materials were coded using Dedoose computer-assisted qualitative data analysis software to ensure that themes were identified and addressed according to the evaluation questions, and well as to verify and expand upon the key findings and clarified in the aide memoire.
Directory: about-us -> publications -> Documents Documents -> Table of Contents 1 Introduction and Background 7 Documents -> Annual Review for 2014 Summary Report Documents -> East Asia regional development cooperation report 2009 October 2010 Documents -> East Asia Regional Organisations and Programs Annual Program Performance Report 2011 Documents -> Development Cooperation Report 2010: Afghanistan May 2012 Documents -> Independent progress report Documents -> Annual program performance report: South Asia 2008–09 September 2009 Documents -> Kuala Lumpur, 22 November 2015 Documents -> Aid Program Performance Report 2015-16 Download 392.87 Kb. Share with your friends:
|