Project to be reviewed:
Project Title: Renewable Energy and Energy Efficiency: Integrating Development and Reduction of Energy-Poverty in Bosnia and Herzegovina (REI DP)
Envisaged consultancy duration: 21.01.2019 – 28.02.2019
Envisaged amount of days: 10 days
Country: Bosnia and Herzegovina (Zenica-Doboj Canton)
Caritas Switzerland (CaCH) has a long tradition of engagement in Bosnia and Herzegovina (BiH). In its country strategy 2017-2020, CaCH selected Climate Change and Disaster Risk Reduction (DRR)as a new field of activity in BiH. Following a multi-stakeholder approach, with this project CaCH aimed to turn prevailing energy problems into opportunities: The idea was to consider alternative energy not as a standalone sector. It was envisaged to develop potential backward and forward linkages with the rural economy, local authorities and local communities through an integrated approach to renewable energy deployment that embarks awareness, provides know-how and introduces innovative technology at the same time. This also included piloted innovative interventions that were realized through an energy ser-vice company (ESCO) approach, which is still rather innovative to BiH but which could offer an oppor-tune model for the country.
- Purpose and Goals of the End-Evaluation
1.1. Overall Objective of the End-Evaluation
Purpose of the end-evaluation is to analyse the project against the defined outcomes and outputs. The end-evaluation shall assess the project set-up, activities and outcomes with regard to their relevance, effective-ness, impact, efficiency, and sustainability. The end-evaluation will serve as a learning experience for CaCH and inform the final report towards donors. It should reflect on the relevance of the chosen ap-proaches and methods, assess the capacities and performance of the involved partner organisations, and determine the challenges of the project. It shall provide recommendations for a possible next phase and expansion of the project and define necessary adjustments in the activity planning and management struc-ture, taking into account the strategic framework of Caritas.
1.2. Time Period and Components Covered
The consultant covers the whole implementation period and all three components of the project: energy poverty, public awareness and renewable energy innovations, improved availability of skilled workers for energy efficiency.
1.3. Strategic goal of the projects
The project’s envisaged impactis the reduction of carbon emissions and poverty through improved ener-gy efficiency and renewable energy in Zenica-Doboj Canton.
1.4. Scope, Focus, Key Questions of the Consultant Key Questions:
- Has the project achieved its main goals?
- Are the outcomes of the project in line with its defined objective?
- What were the main challenges regarding the promotion of energy efficiency and renewable ener-gy at levels of individual households, communities and public institutions?
- What are lessons learnt and what can be done to sustain project results?
- Were the chosen indicators SMART and what could be improved concerning M&E set-up in a fu-ture project phase?
Evaluation Questions (scope and focus):
The evaluation shall cover all components of the completed phase. It shall be performed home-based and with on-sight mission to Bosnia and Herzegovina. It shall include interviews and interaction with all rele-vant actors, stakeholders, authorities, academia/research as well as CaCH staff. In particular, the evalua-tion shall provide clear and concise positions to the following guiding questions:
The extent to which the objectives are consistent with beneficiaries’ requirements, country needs, partner as well as donors’ policies.
The extent to which the objectives were achieved, or are expected to be achieved, taking into account their relative importance.
Are resources/inputs (funds, expertise, time, etc.) converted to results in an economically sound way?
- Outcome and Impact:
Positive and negative, primary and secondary long-term effects produced by the intervention, directly or indirectly, intended or unintended.
The continuation of benefits from a development intervention after major development assistance has been completed. The probability of continued long-term benefits. The resilience to risk of the net benefit flows over time.
1.5. Methodology and approach
In terms of the methodology, the consultant will be using a standard project evaluation methodology com-prising from the following phases:
- Background study of all relevant documentation (project proposal, quarterly reports from partnerorganizations, interim reports) in order to develop a short inception report detailing the approach, agenda, methodology, sampling, time-frame for the field work and the required logistical arrange-ments. At the same time an evaluation matrix will be elaborated, summarising the key evaluation questions (2 working days).
- Field phase to collect data from the most important stakeholders –CaCH, the partner organiza-tion, and involved ministries and education institutions through semi-structured interviewsof 50-60 minutes with key informants andquantitative questionnaireswith 30-40 beneficiary households in selected projects sites (4 working days).
- The consultant will prepare and moderate an End-Evaluation Workshoptentatively structured as follows:
- A SWOT analysis of the project
- A compliance check between achievements and goals/outcomes/outputs
- Identification of examples for good practice and lessons learned
- Recommendations for a possible future project
- Formulation of conclusions
Participants of the end-evaluation workshop will be the key stakeholders (representatives of the cooperat-ing and co-financing ministries, the cooperating education institutions and project staff) (1 working day).
- The data analysis, coding and interpretation of the evidence collected will be made to present the draft end-evaluation report within 10 days after the workshop(2 working days). Caritas will begiven two weeks to circulate the draft end-evaluation report and provide its consolidated comments to the consultant.
- Finalization of the end-evaluation report (1 working day).
- Evaluation matrix with key evaluation questions
- An inception briefing session with CaCH staff in Sarajevo before start of the mission
- Formulation of conclusions by consultant
- Submission of a draft report after completion of the mission. Caritas will get the opportunity to review and comment the draft report before it is finalized.
- A final, properly edited end-evaluation report in English, presenting the results as defined in the ToR, not exceeding 15 pages. Including an executive summary not exceeding 2 pages, a presenta-tion of findings, conclusions, lessons learned and recommendations, structured in a logical line of arguments (recommendation deriving from conclusions, conclusions sourced in the fact and find-ings).
The consultant will receive all relevant documentation including project proposal, logical framework and reports.
1.8. Place, Time, Duration of Assignment and Resources
The end-evaluation for the project shall take place between 21.01.2019 – 28.02.2019. The overall assign-ment should be accomplished within 10 working days including all field visits:
|Activities||Duration in days||FROM||TO|
|End-Evaluation workshop (including preparation and documentation for follow up)||
|Data analysis, coding and interpretation of the evidence collected, submission of draft of End-Evaluation||
|Finalization of End-Evaluation||
Caritas Office will prepare all necessary field trips for the consultant, facilitate the evaluation visits, pro-vide transport and arrange stakeholder meetings. The Project Manager will assist the consultant during the whole period of the end-evaluation. The end-evaluation will be carried out under the supervision of Daniel Bronkal, Caritas Country Director in BiH. In the offer the consultant is requested to specify the input and expenses required for undertaking the review as well as his/her professional fee per day.
1.9. Qualifications of the Consultant
- Consultant with relevant professional and academic background and proven experience in evaluation and monitoring;
- Specific professional background/knowledge in energy efficiency/renewable energy or related field;
- Excellent oral and written Bosnian and English.
The evaluation is carried out in compliance with the OECD/DAC Quality Standards for Development Evaluation: https://www.oecd.org/development/evaluation/qualitystandards.pdf
1.11. How to apply:
In the selection process, the submitted documents will be compared with the outlined requirements and the technical and financial proposal. Interested and qualified consultants are invited to submit offers that in-clude:
- a cover letter which clearly summarizes relevant experience;
- a technical proposal, including a critical analysis of the ToRs, as well as a proposed concept in-cluding envisaged training methods and a work schedule
- a financial proposal, including a daily fee plus an estimation of travel costs including allowances and translations, if needed
- a CVand a brief outline of relevant experiences and three professional references;
For questions regarding the offer, the project, or the consultancy please contact firstname.lastname@example.org. Deadline for submission of a proposal is 18 December 2018. Please send your offer to email@example.com in the subject: END EVAL EE BIH
Based on these ToRs, a contract will be set up between the consultant and CaCH. The consultant will use her/his own office/resources/materials and computer in the execution of this assignment. The consultant is responsible for his/her own insurance and security, abiding however by the security rules and regulations of CaCH in B&H.
Sarajevo, 4 December 2018