Final Project Evaluation: Disability- Inclusive Humanitarian Action in Health and Protection Sectors for IDPs and Host Communities

Background of Project

CBM (Christian Blind Mission) is an international christian development organization committed to improving the lives of persons living with disabilities in prevention and management. In Cameroon, CBM has been implementing project through its local partners since 1976 amongst which are: the Presbyterian Church in Cameroon (since 1976) and Cameroon Baptist Convention Health Services (since 1982) on cross cutting projects on Inclusive Eye Health and Community Base Inclusive Development actions in the North West and South West Regions.

Within the context of the ongoing North West and South West crisis in Cameroon, the Disability Inclusive Humanitarian Action (DIHA) Project, began in May 2020 in the South West Region (Meme and Fako Divisions) with a two-year duration. The project aims to improve access to inclusive humanitarian services and protection for Internally Displaced Persons (IDPs) and Host communities, with special attention to the rights and needs of persons with disabilities. Given the experience gained in the project (implemented by local partner PCC in the South West) from May 2020, and the continuous volatile situation of the crises in NWSW, the project was extended in June 2021 to all seven divisions of the North West Region (implemented by local partner Cameroon Baptist Convention Health Services) with same goal and perspective for results/output until April 30th 2023.

The expected outputs of this project are:

• The capacity development of local and international humanitarian actors through disability-mainstreaming measures (Output 1),
• Capacity building of self-representative organizations of people with disabilities and
• Provision of basic health, rehabilitation and Mental Health and Psycho-Social Support (MHPSS) services through mobile health teams and the set-up of a referral system.

To attend the mentioned outputs, many activities are implemented among which were:

• A disability audit/review of the programmes of humanitarian organisations in the North West and South West Region to assess their level of inclusion as well as to identify key barriers to inclusion of persons with disabilities in the humanitarian response in line with the humanitarian inclusion standards for older people and people with disabilities.
• Introductory and In-depth trainings conducted for local and international humanitarian organisations in the North West and South West Regions to improve their knowledge and skills on inclusive humanitarian assistance.
• Training on functioning of the humanitarian system and disability inclusive humanitarian assistance for OPDs in the North West and South West Regions.
• In-depth trainings for selected OPDs on the functioning of the humanitarian system, inclusive humanitarian aid, effective advocacy and meaningful participation in the cluster coordination system.
• Organizations of Persons with Disabilities (OPD’s) in the NWSW Regions have been supported bi-monthly with logistics to participate in cluster meetings.
• Over 22 OPDs have been supported to develop self-organisational advocacy plans and technical coaching and follow-up.
• Project volunteers and project field staff have been trained on disability data collection using the WGSSQ to identify persons with disabilities as beneficiaries. A major component of the project has been to provide a minimum of 33,000 direct beneficiaries (Internally displaced people (IDP’s) and members of host communities with focus on people with disabilities and other at-risk groups) with immediate support for health interventions (basic health services, rehabilitation) and through mobile health teams while networking with other organisations through a referral system.
• In the North West Region, an unconditional disability inclusive cash transfer was carried out to support the emergency needs of 3,900 persons.

Evaluation Objective, Scope and Intended Use

This final evaluation is intended to:

• Carry out an assessment of the project’s overall relevance and appropriateness, efficiency and effectiveness, impact, sustainability and coverage (more details below).
• Evaluate the results of project activities implemented, outlining unexpected or negative results.
• To assess the project challenges, and document best practice for future projects.

Scope of the evaluation: The evaluation shall focus all activities implemented within the project results 1, 2, 3, and budget spent over the entire project phase in the South West Region from 1st May, 2020 to 31st July 2022 and in the North West Region from 1st June, 2021 to 30th April 2023.

Target Audience of Evaluation:

Primary audience: Project beneficiaries, community stakeholders, OPDs, CBM CO, CBM IO, Project partners, GFFO.

Secondary audience: Local and international humanitarian organisations, MINAT, MINASS.

Together with the project implementing partners, the evaluation report will also be disseminated in the most appropriate format through a workshop to NGOs, INGO’s, UN Agencies, community leaders, local administration, OPD leaders, and key project beneficiaries.

Evaluation Questions

Relevance / Appropriateness and Quality

Evaluate the extent to which the project has been suited to the priorities of the target group, partner organization, to Cameroon Humanitarian Response plan, and to CBM priority areas.

• Was the project designed in a way that has been relevant in reaching its goals?
• Have the activities and outputs of the project been consistent with the intended project impact and effects?
• Was the project aligned to HRP?
• Has the planning taken persons with disabilities and their needs into sufficient consideration?

Effectiveness

Evaluate the project achievements compared to what was planned.

• To which extent did the project activities meet the project output indicators as outlined in the logical framework?
• What challenges were faced in realizing project activities and their results and how was this overcome?
• How informed are persons with disabilities on available opportunities in community as a result of project activities?
• To what extent has this project generated positive (or negative) changes in the participation of men, women, boys and girls with and without disability in humanitarian response planning?
• What impact has the different engaged media houses created on visibility of the project?

Efficiency or cost-effectiveness (of planning and of implementation)

Evaluates the outputs in relation to the inputs (costs, human resource) and whether funds were used in a cost efficient way in order to achieve the desired results.

• Are expenditures appropriate in relation to outputs realised?
• Was monitoring data being collected as planned, stored and used to guide project implementation?
• Is there adequate justification of the activities which have been or have not been implemented?
• Have planned resources and activities been delivered according to schedule? What are the reasons for deviations?
• Was the budget consumption rate aligned with the time consumption rate?

Impact – Contribution to change

Evaluates the higher-level changes (political/ economical/ social) including positive and negative consequences of the project activities, direct and indirect, intended and unintended

• What has been improved or changed as a result of the project implementation in the Region?
• To what extend has the project added value in the lives of persons affected by the crises especially persons with disabilities?
• Have there been any negative or unintended effects of the project activities implemented?
• How has the do-no-harm approach been applied?

Sustainability

Evaluate the project intervention on areas of continued benefits for

an extended period after final completion

• How far can it be expected that results achieved are lasting?
• What indications are there that the outcomes will be sustained, e.g., through the creation or enhancement of capacities (systems, institutions, staff, etc.) and networks?
• What is the impact of the project on the level of government and community participation in disability initiatives at local level?

Disability Inclusion

Evaluates the overall level of participation and direct benefit for persons with disability

• How has the project strategy influence the participation of persons with disabilities in the project?
• Were all the vulnerable groups able to access the full range of services offered? What difficulties did each group have?
• What measures were put in place to encourage active participation of persons with disabilities in community?
• Did men, women, boys and girls have equal chances in decision making within the associations of persons with disabilities in relation to the project?

Gender

Evaluates the involvement of men and women in the implementation of the project from disaggregated data

• In how far has gender been a relevant factor in the management, planning and implementation of the project?
• Have provisions been made so that all persons had a chance to benefit on an equal basis as others, incl. persons of different ages, gender and abilities.
• To which extent did the project succeed in including a gender perspective?

Safeguarding of children and vulnerable adults

Assess level of child safeguarding measures within the project

• What measures were put in place to safeguard children and vulnerable adults? How were the measures being used and adhered to?
• How were the feedback and complaint mechanisms put in place and used?

Methodology

Approach: A detail methodology to be proposed by consultant indicating study methods and limitations.

Geographical Coverage: The evaluation shall be carried out in the North West (All seven divisions) and South West (Fako and Meme Divisions) Regions of Cameroon.

Evaluation Team: The evaluation team shall hold briefing and debriefing meetings with CBM humanitarian team and implementing partner for clear understanding of the purpose of the evaluation.

Principles: the following principles must be adhered to during the entire process:

• Core Humanitarian principles
• Human Rights based and gender sensitive
• Participatory and disability inclusive
• Safeguarding of children and adults at risk
• Data security and privacy
• Data Disaggregation (disability/gender/age)
• Do-no-harm

Expected Deliverables

The following results are expected of the evaluation exercises:

• Final evaluation report in English that includes a 2-3 page summary that could be used as a stand-alone document to be shared with stakeholders. Detailed interview guides and related data shall be annexed to the report and reporting needs to ensure privacy and anonymity of respondents.
• The organization of two workshops (one for the scoping meeting and the other for the feedback of the evaluation results) to be held in decided project location not later than 3th March, 2023.
• Factsheet and Power point presentation of the report

Required Qualifications of Consultant

The consultant must have the following qualifications:

• Advanced degree in social sciences, international development, humanitarian assistance, disability inclusion or similar subject related to the assignment
• At least 10 years of experience in development/ humanitarian action with sound understanding of inclusive development or inclusive humanitarian action
• Track-record in conducting at least 5 similar project/programme evaluations within the past 5 years
• Practical experience in rights-based approach and participatory/inclusive evaluations
• Ability to analyse and translate finding into practical guidance and present in adequate format for future adaption of intervention modality
• Ability to work independently, proactively seek out information and manage feedback and input through in person and remote working methods (IT-based surveys, phone interviews etc).
• Good knowledge of the project intervention zone
• Good written and verbal communication skills in English

Each team member, incl. interpreters, enumerators etc need to fully comply with and sign CBM’s or the partner organisation’s Code of Conduct and Child Safeguarding Policy as well as commitment to data security and privacy.

Costs and payments

The payment of the consultancy fees will be made in three (3) instalments as follows:

• A first instalment of 40% after the signature of the contract;
• A second instalment payment of 30% upon receipt of the draft report and based on invoices from the consultant;
• A third final instalment payment of 30% balance upon final approval of evaluation report and based on invoices from the consultant

Cost covered within the evaluation will be:

• Consultant costs: professional fee, accommodation, local transportation within project region (ensure that VAT is added to total cost