Yearly Third-Party Evaluation of Country Programme, WaterAid Pakistan

Job details

TERMS OF REFERENCE - Yearly Third-Party Evaluation of Country Programme, WaterAid Pakistan • Background WaterAid is an international not-for-profit organization working in 28 countries including Pakistan.The organisation’s vision is of a world where everyone has access to safe water and sanitation. To attain its vision WaterAid is systematically transforming the lives of the poorest and most marginalised people by improving their access to safe Water, Sanitation and Hygiene (WASH). The organization works with partners and government departments/ institutions in strengthening their capacity to deliver WASH programmes. Furthermore, WaterAid’s policy and advocacy efforts are concentrated on decision-makers to maximise impact of its interventions. WaterAid has supported the implementation of WASH programmes in Pakistan since 1996 through its implementing partners and opened its country office in Pakistan in 2006. In its 16 years presence in the country, the organisation, in collaboration with sector stakeholders, has delivered numerous projects on water, sanitation and hygiene and has effectively engaged the government and policy makers on: • Developing WASH models across Pakistan for promotion, adoption and scale-up • Enhancing political ownership of WASH and recognition of human rights to WASH • Supporting Improved sector governance to plan and implement safely managed services in Punjab and Sindh • Prioritization of WASH by the Health Sector & Communities/Households for Improved Public Health • Adaption of WASH systems to mitigate the effects of climate change and continue to deliver benefits for marginalized climate-vulnerable communities • Programme Areas Focused by WaterAid Pakistan WaterAid Pakistan’s programmatic work is divided around two priority thematic areas/programmes, which are: • WASH & Health Programme • WASH & Climate Programme Over the past year, WaterAid Pakistan received approval for 11 projects, which are currently at various stages of implementation across Punjab, KPK, Baluchistan and Sindh. Thematic Area Projects 1.WASH & Health Programme • Behaviour Change and Capacity Development Programme-Project • IGNIT 3 • Improved access to inclusive and sustainable WASH services in schools (Tetra Laval) • Emergency Flood response in Lodhran and Sawat • SWISH Project These projects are/were being implemented by WAP and in collaboration with different partners whereas relevant departments from Govt were key stakeholders in implementing these projects. 2.WASH & Climate Programme • Sustainable Inclusive Climate Resilient WASH Model for Rural Poor • Pakistan Youth Leadership Initiative (PYLI Project) • Envisioning and catalysing PATS Plus for SDGs in Pakistan • National Influencing Project 2025-26 • Improving Access to Clean Drinking Water for urban poor in Karachi, Quetta and Peshawar. • Strengthen Institutional capacities to understand and address and amplify gender considerations for climate resilient inclusive WASH These projects are/were being implemented by WAP and in collaboration with different partners whereas relevant departments from Govt were key stakeholders in implementing these projects. • The Purpose of Evaluation The evaluation aims to assess the impact of WaterAid interventions at local, provincial, and national levels. It will involve a thorough analysis of the effectiveness and outcomes of these interventions, providing insights into their contributions to advancing water, sanitation, and hygiene initiatives and promoting sustainable development goals in targeted areas. The country programme evaluation (CPE) also aims to assess the results generated through each of the projects and programmes in 2025-26, the way these contributed to achieving Country Programme Strategy (CPS) objectives and how these contributed in governments’ efforts in fulfilling their WASH mandates at various levels. The findings of the evaluation will help the country team to reflect on the continued relevance of the programmes against the backdrop of a changing external environment and assess whether the approaches applied in each programme were appropriate and effective. The CP evaluation will generate recommendations and lessons learned that will be used to inform the ongoing programmes for their improvement and maintain focus on achieving the organizational goal as delineated in the CPS. • Objectives of the Study • To evaluate the efficiency, effectiveness, relevance and, sustainability of the programme delivery with a focus on projects initiated and completed last year (April 2025 – March 2026). • To gauge level of impact WaterAid’s programmes has achieved at the local, provincial and national levels • To analyse and document issues and challenges in the programme implementation with recommendations for future course correction. • To assess effectiveness of the support functions i.e. M&E, Finance, HR and Admin/ Security in supplementing the work with partners, government and stakeholders • To document lessons learnt by WaterAid Pakistan in the implementation of its programmes • To make recommendations for the next year of the programme • Methodology It is envisaged that this assignment will be performed using qualitative tools and a desk review of documents to assess the WAP programme. Considering it qualitative in nature the evaluation, the indicative methodology includes: • Review of programme plans and progress reports such as Country Programme Strategy, programme /project plans, periodic progress reports of the projects including financial reports, field visit reports, M&E reports, organisational frameworks on Equity & Inclusion (E&I), and Sustainability framework, Water quality testing protocols/policy and reports. Furthermore, the consultant will also review the anecdotal evidence already collected by WaterAid. • Interviews of key staff and stakeholders which may include Heads of different departments of WaterAid, Provincial Managers and Sector Specialist. If required, WaterAid may arrange virtual meetings of the consultants with the staff of implementing partners and other key stakeholders including officials of relevant line departments of the target districts. However, this is the indicative evaluation methodology, and the consultant is expected to propose detailed methodology in the proposal which may include the steps and any other process as deemed necessary. Based on the information from relevant documents and insights gained through interviews and discussions, the consultant/consulting firm will finalize a comprehensive report based on the format agreed with WaterAid. This report will include objectives and methodology of the evaluation, challenges and limitation, detailed findings and recommendations. • Deliverables Following are the expected deliverables of this assignment: Deliverable Timeline Inception report elaborating the evaluation/data collection plan with clear timelines, roles and responsibilities etc. After 1 week of signing of the contract. Draft Evaluation Report for review and feedback of WaterAid After 4th week of signing of the contract Final report after incorporating feedback of WaterAid Before 20th September • Study Report Format Following is the proposed broader outline of the evaluation report: • Executive Summary • Introduction (context, country programme brief) • Objectives and Methodology • Key Challenges and Limitations • Findings and Analysis • Lessons Learnt • Recommendations • References • Annexes • Payment process: • 1st instalment of 20% payment at the acceptance of inception report • 2nd instalment of 40% payment on the submission of draft report • 3rd instalment of 40% payment on the acceptance of final report. • Qualifications or specialised knowledge/experience required The protentional consultant/firm conducting the evaluation should have • Minimum 10 years of experience in leading third-party evaluations and research. • Demonstrable knowledge of evaluation techniques, especially qualitative analysis techniques such as CAT. • Proven analytical and articulation skills • Understanding of the water, sanitation and hygiene (WASH) sector in general and WASH programming in school and communities in low-income context in particular. • Demonstrable experience and evidence of producing high quality reports for international development organisations. • Intellectual Property Rights All documentation related to the assignment shall remain the sole and exclusive property of WaterAid Pakistan. • Timeframe This assignment is expected to begin by August 17 ,2026 and shall be accomplished no later than 20th September ,2026. • Evaluation criteria Candidate (firms/individual) shall submit technical and financial proposals in two separate sealed envelopes. Technical offers will first be evaluated according to the “Evaluation criteria” below and the technical qualification threshold point is “70”. Financial offers of ONLY successful candidates will be opened Technical Evaluation Criteria for Shortli