Final Evaluation Terms of Reference SOM Family Strengthening through Cash Transfer and Child Protection in Baidoa, Somalia,
- Job category: Tender/Bid/RFQ/RFP
- Post date:14 Nov 2019
- Job expires in: Endless
- Share job:
Final Evaluation Terms of Reference
SOM Family Strengthening through Cash Transfer and Child Protection in Baidoa, Somalia,
Application Deadline: 28 November-19 at 10:00AM.
Send documents To:CSS.LOGISTICS@savethechildren.org
Save the Children International Somalia/Somaliland (SCI) is implementing a project named “Family Strengthening through Cash Transfer and Child Protection in Baidoa” funded by the Ministry for Foreign Affairs of Finland (MFA) to support the most vulnerable families in 11 drought and conflict affected internally displaced people’s (IDP) camps and host communities in Baidoa Somalia by addressing their urgent basic needs to prevent further food insecurity, malnutrition, poor health and gender-based violence (GBV).
The similar kind of humanitarian projects have been implemented in same locations now for four years, since 2016 up to now. Duration of these 4 projects have varied from 6 to 9 months. In 2016 and 2017, SCF reached a total of 10,705 beneficiaries (7,352 children, 3,353 adults) from IDP camps and the host community in Baidoa through cash transfers (CT), community sensitization and awareness campaigns as we as targeted child projection (CP) interventions like psychological support (PSS) and support to GBV survivors. In 2018, SCI supported 1,735 households from 14 IDP settlements and host community with monthly CT of 10,224 individuals (5,028 women and 5,196 men).
In 2019,SCIhas provided support to 1,725 vulnerable households (HH)within 11 camps and host communities in Baidoa. Continued support to these IDP campswas essential as the camps had grown substantially and received additional displaced HHs, thus requiring SCI to consolidate services in line with UNHCR Camp Coordination and Camp Management recommendations. Vulnerable host community households were targeted, representing up to 20% of beneficiaries. All beneficiary HHs with under 5 children have attend IYCF (infant and young child feeding) lessons. In the 5 IDP camps where the project continued supporting child friendly spaces (CFSs), SCI organised structured parenting group sessions and children’s groups sessions with girls and boys aged 10-14 years. SCI conducted community dialogues on equitable, gender sensitive and violent free parenting with religious and traditional leaders and other influential groups/persons in community. Children with special needs, including children with disabilities, were to be identified and their needs assessed. SCI hasstrengthened the capacity of staff, communities, civil society, authorities and service providers to prevent and address the specific protection needs of women, men, girls, and boys. Case management support has provided direct legal, medical, counselling and reintegration support for children. Vulnerable children were given dignity kits, messages on CP prevention and response and referral mechanisms were developed and disseminated in schools.
The project implementation is from 1 April to 31 December 2019 with total funding of EUR 1 million.
- Purpose and objectives of the evaluation
- The main purpose of this final project evaluation is to assessthe overall quality and effectiveness of the project implementation.
- The final evaluation will also document lessons learnt,best practicesandareas for improvementand inform next phase of the project design.
- % of vulnerable children and families accessing counselling and support services, who have demonstrated an improvement in their wellbeing (target: 70%)
- % of male and female parents/caregivers supported with CT and positive parenting and who report not using physical and humiliating punishment with a child/children in the past month (target: 75%)
To achieve this objective, the project has two results described below.
Improved access to income for nutrition through provision of monthly unconditional cash transfers (UCT).
· % of targeted households who have improved access to food during the CT period (target: 90%)
· % reduction in coping strategy index (CSI) among targeted vulnerable households (target: 30%)
· % of boys and girls in targeted households who maintain at least 2 meals per day during CT period (target: 90%)
· % of cash transferred and other household income spent on child nutrition (target: 50%)
Enhanced protection for drought & conflict affected girls and boys from violence, abuse, neglect and exploitation
· # of suspected cases of separation, violence, abuse, exploitation or neglect referred to the project and service providers by community structures (CWCs, community education committees and IDP committees) for support (target: 550)
· # of children and parents/caregivers (including total # of persons with disabilities) who have used CP services provided or supported by the project or participated in related psychosocial activities
· # of boys and girls with protection concerns provided with direct support through case management (target: 150)
· % of girls and boys who report improved relationship with their male and female parents/caregivers (target: 65%)
· % of surveyed members of community-based structures who have better knowledge to prevent and respond to CP concerns (target: 80%)
For the 2019 project:
- To assess the project’s performance and achievements vis-à-vis the project’s overall objectives, the project indicators in the logical framework and the baseline data for the indicators gathered at the start of the project.
- To assess the relevance, effectiveness, efficiency, sustainability and gender effects of the project. Collect qualitative success storieson the”impact” of the project including benefits of combining the cash support with cash plus activities and integrating food security and livelihoods (FSL)support with child protection interventions (case management, support to child welfare committees and child-friendly spaces, community awareness and community dialogues and parenting without violence).
- Find areas of improvement.
For the 4 projects implemented in 2016-2019:
- To identifyand document advantages and disadvantages of combining cash support with cash plus activities and integrating child protection and cash support and give recommendations for improving similar programming in the future.
2.2. KEY QUESTIONS
Following evaluation questions should be at least included in the evaluation criteria.
2.2.1 Key questions for the 2019 project
The evaluation will be based on OECD DAC criterion.
The extent to which the objectives of the projectinterventions are consistent with the needs and interest of the beneficiaries.
- a) To what extent were the project’s activities adapted to meet the needs of particularly vulnerable children in the target project area?
- How relevant were the project objectives and outcomes in benefiting vulnerable target children in Baidoa and is there any differences in relevance for boys and girls?
- To what extent werethe project’s deliverables aligned with local administration and South West Regional Government Ministry of Gender and Family Affairs’ priorities?
- b) Effectiveness
Extent to which the objectives of project intervention have been achieved.
- a) To what extent did the project attain its objectives and results described in the project proposal?
- b) What good practices, success stories, lessons learnt and replicable experiences have been identified in the project implementation?
- c) What was the contribution of theproject’s stakeholders including the South West Regional Government Ministry of Gender and Family Affairs and project committees to the achievement of the projectobjectives and results?
- c) Efficiency
- a) Did the project use the financial and human resources as per the project document to deliver the intended results?
- b) How cost effective was the project implementation?
- c) What better ways, if any, would there have been to achieve the objectives of the project more economically?
- d) Sustainability
Probability of the benefits of the intervention continuing in the long term.
- a) Which mechanisms already existed and which have been put in place by the project to ensure results and impact, policy coordination mechanisms, partnerships, networks?
- b) To what extent has the capacity of beneficiaries (institutional and/or individual) been strengthened such that they are resilient to external shocks and/or do not need support in the long term?
- e) Gender equality
- a) To what extent has the project been gender sensitive or transformative in design and implementation as per SCI Gender Equality Guidance?
- b) What concrete measures were taken in the project to increase gender equality and reduce inequalities?
2.2.2. Key questions for the 4 projects
- What have been the key benefits and drawbacks incombining cash support with cash plus activities and combining cash transfers and child protection programming?
- What has worked and what has not worked inkey components of integrated cash transfer and child protection programming,such as in beneficiary targeting? Why have these approaches worked or not worked and how could they be improved to achieve better child protection outcomes for beneficiaries?
SCI Somalia/Somaliland will selectinternational research consultant/institution to conduct the finalevaluation. The selected research consultant will be required to prepare detailed research methodology in partnership with SCI Somalia/Somaliland.
The final evaluation survey will be proposed to apply both quantitative and qualitative data collection methods. A total of 11 IDPcamps and host communities in Baidoa district will be target areas for this finalevaluation.
Based on the project log frame (objective, results),project team is intended to have baseline data as secondary data source to compare to end line key findings. The detailed data source and methods, and full questionnaires (SCI will provide baseline tool) are required from consultancy team. HH survey questionnaires are based on indicators of objective and outcomes, which are shown in above table. Consultant team should submit technical proposal to SCI for tender selection process.The tools will be developed/revised only after a proper inception phase including desk review and meetings with the project manager and other SC staff.
Theevaluation team will use all project documents; secondary data sources will be used for further data analysis.
Primary data and data analysis process will be disaggregated by the sex and target area. Draft findings will be presented with project team and key partners to validate.
As a minimum, the evaluation process will include the following key steps:
- Review of relevant literature related to the project(list of reference materials provided below) and drafting an inception report before the evaluation exercise at the field;
- Application of appropriate data collection tools (e.g. questionnaire, checklist etc.) for interviews and focus group discussion;
- Training of the enumerators and pre-test the tools;
- Data analysis and Evaluation Report writing; and
- Presentation of key evaluation findings.
3.1. REFERENCE MATERIALS (All project materials from 2016-2019)
- Baidoa MFA CT/child protection project narrative proposal
- Baidoa MFA CT/child protection Baseline Report
- Baidoa MFA CT/child protection Interimand Final Reports
- Project monitoring and evaluation plan
- Monthly Reports
- Project MEAL reports
- Third party monitoring
- Pre- and post-test reports for positive parenting groups and children’s groups
- Experience in social protection programing specially cash program and child protection, DRR and related fields. Experience in Somalia context is desirable.
- Prior experience in conducting cash-based programing, child protection evaluations. Having conducted similar assignment in Somalia will be an advantage.
- Solid analytical, result based planning, report writing, communication and diplomacy skills with ability to correlate different data sets to actionable conclusions.
- English language skills (report should be written in English). Ability to make clear presentations and disseminate findings to both technical and non-technical audience.
The consultant is expected to submit the following documents, which will form part of the pre-selection recruitment process: through SCI recruitment email which will be advertised in the somalijobs.net
- Cover letter and CV;
- Technical proposal, outlining the methodologies and tools be used and Budget Summary;
- Proven samples of the previous similar work with INGOs and UN agencies preferably in Baidoa –signed and stamped copies
- Reference – At least two credible referees.
Share your documents with email; CSS.LOGISTICS@savethechildren.orgwith the subject line of the email body “Final Evaluation Terms of ReferenceSOM Family Strengthening through Cash Transfer and Child Protection in Baidoa, Somalia”. Deadline for submission is 28thNovember 2019
Timeframe for the activities shall be 25 days from the contract period.
5.1. TIMEFRAME AND ACTIVITIES
The evaluation should be completed over a period of approximately 25 days from the agreed timeline. Detailed tentative timetable for the evaluation is illustrated below.
Desk Review – Inception Report
|Review of background documents and consultation with relevant SC staff||(2 days)||TBD|
|Presentation of Inception Report||1 day||TBD|
|Design of assessment methodology and tools for data collection||2 day||TBD|
|Review and feedback on inception report and data collection tools||1||TBD|
|Review and feedback on inception report and data collection tools||1||TBD|
|Training of enumerators and Pilot test||2||TBD|
Field data Collectio
|Primary data collection from project beneficiaries||8 days||TBD|
Data Analysis and Report writing
|Data analysis and Draft preliminary report with recommendations||8||TBD|
|Save the Children Staff review and feedback on the report||1||TBD|
|SCF review the report||4||TBD|
|Finalize report (following review/) and presentation)||(1 days)||21st Dec 2019|
5.2. DURATION OF ACTIVITIES
The duration of the evaluation exercise in the field shall be 25daysfrom a mutually agreed date .
The evaluation will follow the key phases:
Phase I – Desk study: Review of documentation and elaboration of field
Study [12 days]
The lead consultant/evaluation team will review relevant documentation from section 5 above (Reference material). Based on this review, they will produce an inception report.
The inception report will be delivered to SCI after the initial meeting and desk review have taken place. The report should include the purpose and objectives of the evaluation, clarification, interpretation and elaboration of the evaluation questions, a detailed plan of how the evaluation will be carried out describing research methodology, sampling strategy, qualitative and quantitative survey, proposed guiding questions for semi-structured interviews, focus group discussion or other approaches, and proposing the draft data collection tools together with a matrix lining the suggested methods and tools with the project indicators and evaluation questions they are supposed to answer. Methodology to address data quality issues should be explained in the report. The inception report should also provide a clear matrix of roles and responsibilities indicating the persons involved in the evaluation and their roles, the key internal and external stakeholders to be involved, a detailed work plan with expected outputs/deliverables and timeline and a detailed financial breakdown including the number of days and persons involved. A detailed plan on enumerator training, including persons to be trained, contents and duration of training and translation provided should be included. It should also summarize the preliminary findings and any preliminary hypotheses resulting from the desk review and explain the process for obtaining the participants’ consent and any necessary government permissions. Requirements for reporting and dissemination of findings as well as planned dissemination and any restrictions to confidentiality should be included. A detailed work plan should be annexed to the report. The main text of the inception report should not exceed 10 pages. The inception report as well as all the suggested tools should be delivered in English.The evaluation will only proceed to the next stage upon approval of this inception report. An appropriate inception report format will be provided to the team later on.
Phase II: Field Data Collection [8 days]
This phase of the evaluation will seek to collect primary data on the key evaluation questions explained under evaluation criteria. The team will use the agreed plan, methodology and sampling strategy from phase I to conduct the field work. The enumerators will be trained and test the tools before the actual data collection will begin.
Phase III – Data analysis and production of evaluation report [25days]
The team will draw out key issues in relation to evaluation questions and produce a comprehensive report.
A full report with main text of maximum 30 pages excluding cover page table of contents, abbreviations, executive summary and annexes. The draft report should be delivered in a soft copy in English. References should be fully cited after all important facts and figures. The analytical reports of the findings should be presented in a qualitative format supported by quantitative charts and tables. The report should as a minimum include the following elements:
- Front page with the title of the evaluation, SCI name, date and authors of the report
- Table of contents
- List of abbreviations used
- Executive summary (3-4 pages) that presents the key points of the different sections
- Background and description
- Objectives and the intended use of the evaluation
- Methodology and limitations of the evaluation
- Findings, including a table presenting the progress of the project outcomes and indicators against the baseline data
- Relevant annexes
- Project logframe
- Evaluation schedule
- Tools used
- List of people interviewed or consulted
- Bibliography of the documents reviewed
- OUTPUTS AND DELIVERABLES
The following specific outputs are expected:
(i) An Inception report date TBD
(ii) A draft evaluation report date TBD
(iii) Data sets (SPSS, Excel, Stata – for all collected data (quantitative and qualitative). Qualitative data should be transcribed for future use by Save the Children Country Programmes. The data sets should be in an appropriate format (SPSS, Excel, and Word) and will be submitted together with the final evaluation report TBD
(iv)AFinal evaluation report including country case studies and recommendations for Country Programme for future use of the project design and/or alternative solutions to achieve the same objectives date TBD
(v) PowerPoint presentation, summarizing the key findings from the evaluation submitted together with the final evaluation report as per the agreed timeline in the contract.
- ETHICS AND CHILD SAFEGUARDING
The consultant is obliged to conduct the research in an ethical manner making sure children are safe at all times. The consultant should seek the views of various stakeholders, including children. Efforts should be made to make the research process child-centred and sensitive to gender and inclusion. The consultant must respect the rights and dignity of participants as well as comply with relevant ethical standards and SCI’s Child Safeguarding Policy and Code of Conduct. The research must ensure a voluntary, safe and non-discriminatory participation and a process of free and un-coerced consent. Informed consent of each person (including children) participating in data collection should be documented.
Apply for this Job
- No Tags
1543 total views, 7 today