Terms of Reference Final evaluation for Integrated Humanitarian Assistance to Vulnerable Populations in Shebelle IDP Camp in Dharkenley
Terms of Reference
Final evaluation for Integrated Humanitarian Assistance to Vulnerable Populations in Shebelle IDP Camp in Dharkenley District of Mogadishu, Somalia.
Application procedure: Through email on: CSS.LOGISTICS@savethechildren.org
Application Deadline: 23rd February-2019
Project location: Mogadishu
|Project Name||SOM Humanitarian Support and Re-Integration of IDP and Returnees in Mogadishu (Phase 2)|
|Target Location||Dharkenley District|
|Project goal||Saving lives, alleviating suffering and maintaining human dignity in communities experiencing humanitarian crisis or that are food insecure|
|Specific Objective:||To reduce vulnerability of crisis-affected people, especially women and children in Shebelle IDP Camps Mogadishu|
|Key Partners||§ IDPs and host community
§ Community Relief Committee (CRC)
§ Local Authority
§ Private sector – IGA consultancy
|Project lifespan||1 year(s), 5 month(s)|
|Support office||German Federal Foreign Office|
|Purpose||The objective of the baseline survey is described to assess the ability of
Parents and communities to educate and better protect their children.
|§ Quantitative survey from XXX targeted men and women, boys and girls
§ Qualitative interviews with key partners
§ Document review including relevant secondary data
|From 24thFebruary – 23rd March, 2019|
Report Release Date
|TPM report will be released 24thMarch, 2019|
Save the Children has been working in Somalia/Somaliland for over 40 years. Save the Children Somalia/Somaliland country office is implementing an integrated humanitarian assistance to vulnerable populations in Shebelle IDP camp in Mogadishu through provision of lifesaving health, nutrition, WASH and FSL interventions to the continued humanitarian needs of a population that has been through one of the world’s worst humanitarian crises. The needs of IDPs are multi-dimensional and inter-related. An integrated approach aims to ensure the complex and inter-related needs are met with the most efficient use of resources, whilst addressing the underlying causes of vulnerability, in order to achieve the greatest impact.
The purpose of this project is that Internally Displaced People in Somalia have access to life-saving assistance and to basic social infrastructure in communities affected by protracted crisisSomalia/Somaliland through community-based and integrated nutrition, Health FSL and WASH interventions. The action aims to achieve four key result areas:
- Increased access to interventions aimed at preventing, identifying and treating severe and moderate acute malnutrition among children and PLW.
- Increased access to essential package of health services, maternal health services, and improved quality of care for targeted IDPs;
- Reduced prevalence of Water and Sanitation Related Diseases (WSRD) in IDPs
- Targeted Vulnerable, IDP households have increased income and Improved capacity to meet their essential food and non-food needs.
Table 1: Project objective, specific Objective, Results with indicators
To reduce vulnerability of crisis-affected people, especially women and children in Shabelle IDP Camps Mogadishu
|· % of crisis affected beneficiaries reporting improved living conditions.|
|· % increase in crisis affected beneficiaries reporting increased access to portable water.|
|· % HHs able to meet at least 75% of food and non-food needs|
|Result 1: Nutrition
Increased access to nutrition interventions for prevention and treatment of severe and moderate acute malnutrition among children and PLW
|· Proportion of infants 0–5 months of age who were fed exclusively breast milk during the previous day|
|· Death rate|
|· Cure Rate|
|· Defaulter Rate|
|Result 2: Health
Increased access to maternal health care services and improved quality of care for targeted IDPs
|· # of new OPD consultation per month|
|· # of deliveries at the clinic with support from a trained, equipped and skilled birth attendant|
|· # of pregnant women attending at least 1 ANC|
|· % staff in supported clinics reporting improved knowledge and skills|
|· # of children under 5 treated for common illnesses|
|Result 3: WASH
Reduced prevalence of Water and Sanitation Related Diseases (WSRD) in IDPs
|· # households with access to safe and sustained water at Sphere standards (15L/p/d)|
|· % people that can demonstrate satisfactory health and hygiene knowledge and practices|
|· # of people per latrine as per Sphere Standard|
|· # Number of people directly benefitting from the sanitation infrastructure|
|Result 4: FSL
Targeted Vulnerable, IDP households have increased income and Improved capacity to meet their essential food and non-food needs.
|· % of targeted households have sufficient access to food during the cash transfers period|
|· Children in targeted household maintain at least 3 meals per day during cash transfer period|
|· % increase in target HHs who report increased of HDDS|
|· % of targeted households invest in existing and alternative livelihood options|
The project financed by The project financed by European Commission – Federal Foreign Office Strategy for Humanitarian Assistance, Federal Foreign Office Funding Policy
Result 4 (FSL): Targeted IDP households have increased income and access to emergency shelter and non-food items Improved capacity of vulnerable households to meet their essential food and non-food needs.
The FSL component is mainly focus on business skills training & income generation and credit and saving schemes. The overall aim is to implement activities that span from short term humanitarian support to long term resilience building using the durable solutions approach to IDPs crisis in Mogadishu. 120 household of income generating activities will benefit from saving and credit schemes in two IDPs namely Baharsaaf and Kulan IDPs in Shebelle area. SC selected poor households who are interested in engaging in business based on an agreed selection criterion. The aim was to ensure transition from IDP status to self-reliant urban dwellers. Promotion of saving and credit culture within this target group ensures peer support to their businesses and joint activities for sustainability and monitoring purposes.
|S/N||District||Sub-villages||# of target per camp|
Purpose and Objective of the Evaluation:
The overall objective of third party monitoring is to assess and provide detailed analysis of achievements against the anticipated objectives (baseline) and measures the up to date performance of the project. The third party monitoring evaluation is to facilitate a process which will document project outputs and impact and to measure progress achieved, status of all indicators compared to project baseline figures. The project covers sectors in health and nutrition, water supply, hygiene and sanitation, and food security and to recommend/suggest actions deemed fit for enhancing efficiency and effectiveness of the projects’ activities.
Therefore, to improve the accountability of the program, quality of project delivery, an independent consultant will be contracted to monitor the project progress and also to ensure whether the project implementation is in line with SCI accountability strategy.
- Specific Objectives
- To assess the project’s performance and achievements vis-à-vis the project’s overall objectives, the project indicators in the logical framework and the baseline data for the indicators gathered at the start of the project.
- To assess the relevance, effectiveness, efficiency, impact, sustainability, coordination, scalability/replicability and gender effects of the project.
- Collect qualitative data on the impact of the program including benefits of IGA and VSLA support activities and other integration sectors including health, nutrition and WASH interventions, collect case studies that demonstrate change in the lives of children.
- To document unintended impact of the project (negative and positive impacts).
- Key Questions
Following evaluation questions should be at least included in the evaluation criteria. The evaluation will be based on OECD DAC criterion.
- The extent to which the objectives of the project interventions are consistent with the needs and interest of the beneficiaries.
- Are the activities and outputs of the programme consistent with the overall goal and the attainment of its objectives?
- Was the design of the project being most appropriate and relevant to program approach and strategy;
- To what extent did the project attain its objectives and results described in the project proposal?
- What good practices, success stories, lessons learnt and replicable experiences have been identified in the project implementation?
- What were the major underlying factors (internal and external) influencing the achievement or non-achievement of the results within the project implementation?
- Did the project use the financial and human resources as per the project document to deliver the intended results?
- Did the project offer better value for money considering its impact on the lives of the vulnerable children?
- To what extent did the project have an impact on the targeted beneficiaries?
- What are the key short term and long term changes produced by the project, positive or negative and what are the key factors behind these changes?
- Which mechanisms already existed and which have been put in place by the project to ensure results and impact, policy coordination mechanisms, partnerships, networks?
- To what extent has the capacity of beneficiaries (institutional and/or individual) been strengthened such that they are resilient to external shocks and/or do not need support in the long term?
- To what extent will the project be replicated or scaled up at local or national levels?
- What were the major factors which influenced the achievement or non-achievement of sustainability of the project?
- How have the project activities been coordinated within different stakeholders including the Government Line Ministries, project committees and other organizations (LNGOS, INGOS, UN) in the target area to achieve overall objective?
- Is there any likely ability of the project or its components to be scaled or replicated in other programme areas?
- Who are the main actors in the scale-up/replication and how has the project engaged with them to date?
- Gender equality
- To what extent has the project been gender sensitive or transformative in design and implementation as per SCI Gender Equality Guidance?
- What concrete measures were taken in the project to increase gender equality and reduce inequalities?
SCI Somalia/Somaliland will select a local research consultant/institution to conduct the final third party evaluation. The selected research consultant will be required to prepare detailed research methodology in partnership with SCI Somalia/Somaliland.
TPM will be proposed to apply both quantitative and qualitative data collection methods. A total of two umbrellas with nine IDPs camps in Dharkenley district will be target areas for this mid-term evaluation.
Based on the project log frame (objective, results), Project team is intended to have baseline data at objective, outcome and if applicable, output levels. Possible key respondents or data sources are initially determinedbyprojectteam;however,thedetaileddatasourceandmethods,andfullquestionnaires are required from consultant team. Project direct benefitted families are selected by project team beforedatacollectionanddatacollectionwillbecoveredthroughthoseselected120 mostvulnerable families.HHsurveyquestionnairesarebasedonindicatorsofobjectiveandoutcomeswhichareshownin table 1. Consultant team should be submitted the draft questionnaires when they provide the technical proposal to SCI for tender selection process.
Primarydataanddataanalysisprocesswillbedisaggregatedbythesex.Draftfindingswillbepresented with project team and key partners to validate.
The evaluation will follow the key phases:
Phase I – Desk study: Review of documentation and elaboration of field Study [7 days]
The lead consultant/evaluation team will review relevant documentation from section 6below (Reference material). Based on this review, they will produce an inception report which will include an elaborate plan, methodology and sampling strategy of the data collection for evaluation study. The evaluation will only proceed to the next stage upon approval of this inception report. An appropriate inception report format will be provided to the team later on.
Phase II: Field Data Collection [10 days]
This phase of the evaluation will seek to collect primary data on the key evaluation questions explained under evaluation criteria. The team will use the agreed plan, methodology and sampling strategy from phase-1 to conduct the field work.
Phase III – Data analysis and production of evaluation report [9days]
The team will draw out key issues in relation to evaluation questions and produce a comprehensive report.
As a minimum, the evaluation process will include the following key steps:
- Review of relevant literature related to project (list of reference materials provided below) and drafting an inception report before the evaluation exercise at the field.
- Application of appropriate data collection tools (e.g. questionnaire, checklist etc.) for interviews and focus group discussion;
- Data analysis and Evaluation Report writing; and
- Presentation of key evaluation findings;
- REFERENCE MATERIALS
- Project narrative proposal
- Baseline Report
- Project monitoring and evaluation plan
- Monthly Reports
- Project MEAL reports
- Evaluation Team
- Experience in social protectionprograming specially cash programand related fields. Experience in Somalia context is desirable.
- Prior experience in conducting cash based programing, integrated projects such health, nutrition, and wash assessments. Having conducted similar assignment in Somalia will be an advantage.
- Solid analytical, result based planning, report writing, communication and diplomacy skills with ability to correlate different data sets to actionable conclusions.
- English language skills (report should be written in English). Ability to make clear presentations and disseminate findings to both technical and non-technical audience
The consultant is expected to submit the following documents, which will form part of the pre-selection recruitment process:
- Cover letter and CV
- Technical proposal, outlining the methodologies and tools be used and Budget Summary.
- Proven samples of the previous similar work with INGOs and UN agencies preferably Baidoa.
- Reference – At least two credible referees
Time frame for the activities will be:
- 11-23rdFeb 2019 – for adversitment period
- 24th February to 23rdMarch 2019 – Evaluation activity timeline period
- Timeframe and Activities
The evaluation should be completed over a period of approximately 28 days from 24thFebruary – 23rd March 2019. Detailed time table for the evaluation is illustrated below.
Desk Review – Inception Report
|Review of background documents and consultation with relevant SC staff||(3 days)||4th – 27th February 2019|
|Presentation of Inception Report||1 day||28th February 2019|
|Design of assessment methodology and tools for data collection||2 days||1st – 2thMarch 2019|
|Review and feedback on inception report and data collection tools||1 day||3rd March 2019|
Field data Collection
|Primary data collection from project beneficiaries||(10 days)||4th – 14thMarch 2019|
Data Analysis and Report writing
|Data analysis and Draft preliminary report with recommendations
|(5 days)||15th –20th March 2019|
|Save the Children Staff review and feedback on the report||(2 days)||21st – 22ndMarch 2019|
|Finalize report (following review/vetting) and presentation)||(1 days)||23rdMarch 2019|
5.1. Duration of Activities
The duration of the evaluation exercise in the field shall be 10 days from a mutually agreed date no later than14th March 2019
6.0 OUTPUT AND DELIVERABLES
The following specific outputs are expected –
- An Inception report, produced by not later than 28thFebruary, 2019
- A draft evaluation report produced by not later than 20thMarch 2019
- A Final evaluation report including two to three case studies that demonstrate change in the lives of children and recommendations for Country Programme for future use of the project design and/or alternative solutions to achieve the same objectives produced by 20th March 2019
- A set of pictures with GPS coordinates taken during the monitoring exercise shall be appended separately. Pictures must show supported facilities, beneficiaries receiving services, SC branding and all other information that depicts the quality of services being offered23rd March 2019
- Data sets (SPSS, Excel, Stata – for all collected data (quantitative and qualitative). Qualitative data should be transcribed for future use by Save the Children Country Programmes. The data sets should be in an appropriate format (SPSS, Excel, and Word) and will be submitted together with the final evaluation report 23rd March 2019
- PowerPoint presentation, summarizing the key findings from the evaluation submitted together with the final evaluation report on 23rd March 2019
7.0. Ethics and child safeguarding
The consultant is obliged to conduct the research in an ethical manner making sure children are safe at all times. The consultant should seek the views of various stakeholders, including children. Efforts should be made to make the research process child-centred and sensitive to gender and inclusion. The consultant must respect the rights and dignity of participants as well as comply with relevant ethical standards and SC’s Child Safeguarding Policy and Code of Conduct. The research must ensure a voluntary, safe and non-discriminatory participation and a process of free and un-coerced consent. Informed consent of each person (including children) participating in data collection should be documented.
The consultant before commencement of the action will sign a contract. The contract will detail terms and conditions of service, aspects on inputs and deliverables.
- Application Submission address:indicating “Integrated Humanitarian Assistance to Vulnerable Populations in Shebelle IDP Camp in Dharkenley District of Mogadishu, Somalia” as the subject. Deadline for submission is Saturday, 23rdFebruary, 2019.
- All proposals should be sent by toLOGISTICS@savethechildren.orgwith full support documents ( CVs, profiles, experience, registration certificates etc)