End-of-term evaluation



Download 0.92 Mb.
Page3/18
Date09.06.2018
Size0.92 Mb.
#53406
1   2   3   4   5   6   7   8   9   ...   18

Contents





Acronyms 5

Acknowledgements 7

Executive Summary 8

Introduction 11

Background 13

Methodology 15

Utilization-Focused Evaluation 15

Results-Based Monitoring and Evaluation 15

Appropriateness of Approach 16

Learning by Doing Approach 16

Data Collection Methods 17

Limitations 19

Evaluation Findings 20

Programme Area 1: Prevention and Control of HIV Transmission 23

Programme Area 2: Diagnosis, Treatment and care of PLHIV 33

Programme Area 3: Impact Mitigation and Support of PLHIV 44

Programme Area 4: Programme Management and Institutional Performance 51

Programme Area 5: Surveillance, Monitoring, Evaluation and Research 63

Conclusion 71

Appendices 73

Appendix 1 – Evaluation Protocol and Matrix 0

ACRONYMS 3

INTRODUCTION 4

EVALUATION PURPOSE 5

EVALUATION OBJECTIVES 5

EVALUATION QUESTION 6

EVALUATION DESIGN 6

Theoretical Framework 6

Learn by Doing Approach 7

Local Evaluation Team 7

External Evaluation Team 8

Evaluation Matrix 8

Evaluation Protocol 9

METHODOLOGY 10

Data Collection & Analysis 10

Proposed Timetable 11

Final Report 12

Dissemination of Findings 12

Barbados HIV/AIDS NSP EVALUATION MATRIX 13

Appendix 2 – External Evaluation Team Biographies 1

1

Appendix 3 – Focus Group Discussion Study 1



CARPHA EVALUATION OF BARBADOS NATIONAL HIV STRATEGIC PLAN 1

2008-2013 1

FINDINGS FROM FOCUS GROUPS DISCUSSIONS 1

Acknowledgments 2

List of Acronyms 4

Executive Summary 4

Overview 6

Methods 6

Limitations 7

FINDINGS FROM FOCUS GROUPS DISCUSSIONS AND INTERVIEWS 8

People Living With HIV 8

People with Disabilities 11

Sex Workers 14

Men who Have Sex with Men 15

Transgender People 17

Adolescents 19

Discussion 20

Programme Design 21

IEC versus BCC 21

The Role of Civil Society 22

Enabling Environment and Stigma and Discrimination 22

On the Outside Looking In 23

Conclusion and Recommendations 23

Recommendations 24

1. Background to Barbados National Strategic Plan 2008-2013 Qualitative Evaluation- Focus Group Discussion Protocol 28

2. Aims and Objectives 28

3. Consent and Ethics 29

4. Methodology and Approach 30

5. Data Analysis Plan 34

6. Activity Timetable 35

APPENDIX I-CONSENT FORMS 36

APPENDIX II-DRAFT FGD GUIDES 41

Appendix 4 – List of Documents Reviewed 0

Appendix 5 – List of Persons Interviewed 1





Acronyms


AIDS Acquired Immunodeficiency Syndrome

ART Antiretroviral Therapy

ARV Antiretroviral (drugs)

BDF Barbados Defence Force

BFPA Barbados Family Planning Association

BGLAD Barbados Gays, Lesbians and All-Sexuals against Discrimination

CARPHA Caribbean Public Health Agency

CEED Community Education Empowerment and Development

CHAA Caribbean HIV AIDS Alliance

CSO Civil Society Organisation

CSW Commercial Sex Workers

EET External Evaluation Team

EQUALS Empowerment Quality Unity Acceptance Love Strength

GIPA Greater Involvement of Persons Living with HIV/AIDS

HIV Human Immunodeficiency Virus

HOPEN Helping Our Peers Effectively Now

IEC Information Education Communication

KABP Knowledge, Attitudes, Beliefs, and Practices

KAP Key Affect Populations

LET Local Evaluation Team

LRU Lady Meade Reference Unit

M&E Monitoring and Evaluation

MOH Ministry of Health

MOVADAC Movement against Discrimination Action Coalition

MSM Men who have Sex with Men

NCSA National Council for Substance Abuse

NHAC National HIV/AIDS Commission

NSP National Strategic Plan

OVC Orphans and Vulnerable Children

PAHO Pan-American Health Organisation

PANCAP Pan-Caribbean Partnership against HIV and AIDS

PLHIV Person Living with HIV

RBM&E Results-Based Monitoring and Evaluation

RePDU Research, Training and Policy Development Unit

SOP Standard Operating Procedure

STI Sexually Transmitted Infection

TB Tuberculosis

UGLAAB United Gays and Lesbians against AIDS, Barbados

UNDP United Nations Development Programme

VCT Voluntary Counselling and Testing


Acknowledgements


This evaluation was possible with the support of several agencies and individuals. The Caribbean Public Health Agency (CARPHA) and the External Evaluation Team (EET) would like to extend its appreciation to all involved.

Firstly, we would like to thank the Pan Caribbean Partnership against HIV and AIDS (PANCAP) and the Global Fund to Fight AIDS, Tuberculosis and Malaria (GFATM) for their generous support for this evaluation. This support is allocated to CARPHA as a sub-recipient of the Round 9 Agreement ‘Fighting HIV in the Caribbean: a Strategic Regional Approach’ between PANCAP and GFATM, numbered MAC-910-G02-H.

We extend our thanks the Barbados National HIV/AIDS Commission (NHAC) and the Barbados Ministry of Health (MOH) who were critical partners in facilitating and guiding the evaluation. Recognition must be extended to all the national stakeholders, including HIV/AIDS Coordinators, HIV/AIDS Focal Points and Civil Society Representatives who acted as members of the Local Evaluation Team (LET) and thus played an essential role in the design and execution of the evaluation. Special thanks are extended to Ms. Nicole Drakes and Ms. Rhonda Greenidge for playing a leading role in coordinating the evaluation.

Thanks are proffered to the Ministries of Health in Trinidad and Tobago and Jamaica, who released their technical staff to participate as members of the External Evaluation Team (EET). These staff were Dr. Ayanna Sebro and Mrs. Sannia Sutherland.

We would like to thank Ms. Audrey Brown, Focus Group Consultant, who successfully organised and facilitated focus group discussions with key populations for the evaluation.

We extend our warm thanks and gratitude to all the individuals and organisation that generously provided information or who participated in interviews and focus groups as a part of this evaluation. A complete list of persons interviewed is presented in Appendix 5.


Executive Summary


This end-of-term evaluation sought to assess the outcomes of the ‘Government of Barbados NSP for the Prevention and Control of HIV 2008-2013’ in terms of relevance, efficiency, effectiveness, coordination, and implementation. In doing so, the evaluation closely followed the Strategic Objectives stated in the NSP.

There were four evaluation objectives:



  1. Determine the relevance of the programmatic response to the NSP;

  2. Assess the extent to which the Strategic Objectives of the NSP were achieved;

  3. Determine whether the programme objectives of the national response were achieved; and,

  4. Assess the extent to which programme resources were utilised to achieve programme objectives.

The findings and recommendations for the evaluation were developed and grounded in the Utilization-Focused Evaluation approach and a Results-Based Monitoring and Evaluation (RBM&E) framework. An EET of regional experts worked in partnership with a LET to review the outcomes of the NSP, with a view to creating practical recommendations to strengthen the national response.

The evaluation found that, in general, the national response moved closer to achieving key targets over the NSP period. Several of the strategies employed during implementation of the NSP appear to be yielding positive results. Notable outcomes include a downward trend in transmission rates; an increased age for sexual initiation; and, increased condom use.

Additionally the evaluation team found that the Lady Meade Reference Unit (LRU) may be a best practice for the region. Thus, the LRU could be used to develop a model for replication or adaption within the country and regionally. The Food Bank was a sustainable model for supporting Persons Living with HIV (PLHIV), especially those of a lower socio-economic status. The team approach to securing housing support for PLHIV was functioning well and a commendable approach to addressing the needs of a highly vulnerable population. There was considerable goodwill among the HIV/AIDS Focal Points and Coordinators from the partner Ministries that could be leveraged for further programming. That empirical data was being used in some areas to improve programming, most notably the use of evaluation to improve the treatment response.

There are also several challenges facing the national response that require attention. The challenge of addressing stigma and discrimination, the challenge of addressing the sexual and health behaviour among males, and the limited availability of data remain major hurdles. This limitation made it difficult for the evaluation team to draw detailed conclusions about the effectiveness of some strategies employed during the period under review. It is a missed opportunity for the national response, undermining its ability to identify successes and challenges clearly. In addition to this, the evaluation team noted that there was the need to strengthen the relationship between the NHAC and MOH. With expected changes in the level of external funding support available for the programme, stronger country level coordination between the ‘health’ and ‘multi-sectoral’ aspects of the response is critical going forward.

Further challenges include the economic climate in Barbados and the closure of the Caribbean HIV AIDS Alliance (CHAA). The national response will need to adapt to the evolving economic situation facing the country and in doing so will need to ensure the internal governance structure and working arrangements are consolidated and streamline. In addition, it will need to ensure that partnerships are more targeted and effective to address the needs of those populations most vulnerable to HIV and AIDS. Meanwhile, CHAA’s closure has created an immediate gap in the national response in terms of support for civil society organisations and outreach to key populations. To deal with this, the national response will need to support the development and sustainability of the nascent CSOs whose capacity for project development and execution were being strengthened by CHAA to ensure greater community level implementation and ownership.

Figure 1, below, provides a ‘Traffic Light’ overview of the evaluation team’s findings aligned to the Goal and Strategic Objectives of the NSP.



Figure 1: Summary of Achievements against NSP Goal and Strategic Objectives

Rating NSP Priority Area

Goal: Mitigation of the social and economic impact of HIV & AIDS on the population thereby reducing new cases (incidence) and ensuring the sustainable development of our nation


Strategic Objective 1: To increase awareness and knowledge on the transmission and prevention of Sexual Transmitted Infections (STIs)/HIV


Strategic Objective 2: To effect positive behaviour change to prevent and reduce the spread of HIV/STIs


Strategic Objective 3: To strengthen treatment, care and support services for PLHIV, Orphans and Vulnerable Children (OVC) and vulnerable and high-risk groups


Strategic Objective 4: To boost the educational and economic opportunities of PLHIV and of the most at-risk


Strategic Objective 5: To build capacity, strengthen institutional and management structures across private sector, civil society and government to deliver effective and sustainable programmes


Strategic Objective 6: To strengthen institutional structures that will enable successful scale up and execution of monitoring and evaluation of programmes to allow for evidence-based decision-making

Key: Largely Achieved Partially Achieved Requires Strengthening



Download 0.92 Mb.

Share with your friends:
1   2   3   4   5   6   7   8   9   ...   18




The database is protected by copyright ©ininet.org 2024
send message

    Main page