Brot für die Welt Germany
Evaluation of five Regional Offices located in San José/Costa Rica (for Central America), Addis Ababa/Ethiopia (for Horn of Africa), Port Moresby/Papua-New Guinea (for the Pacific), Lima/Peru (for Peru and Bolivia) and Hanoi/Vietnam (for Vietnam and Laos). The purpose of the evaluation was to generate lessons learnt and to devise recommendations for the future work and organisational set-up.
The guiding question of the evaluation was:
What needs to change with regard to the Regional Offices in order to strengthen the operations and performance of Brot für die Welt in the next years?
I carried out the evaluation together with Andrea Berg and Michael Förch, both experienced independent consultants. We carried out staff and partner surveys, KIIs, analysis of key documents, prepared an inception report, a desk report and a final evaluation report, a 2-pager with specific recommendations for each Regional Office, had several workshops (which included also creation and discussion of a Theory of Change). We carried out field visits to the offices in Vietnam, Ethiopia (my task) and Costa Rica. A peer learning workshop where Regional Office staff could discuss the suggested recommendations completed this very intensive and interesting evaluation and organisational/strategic development consultancy.
Evaluation of the Implementation of the ICRC Eurasia Regional Strategy on Migration 2020-2025
The focus of the evaluation was on Strategic objective 1: Keeping Families Together of the International Commitee of the Red Cross (ICRC) Eurasia Regional Strategy on Migration. My main role in this evaluation was to provide quality assurance of the inception and final report. Collaboration with Owl RE.
Tropical Forest Alliance / World Economic Forum
Final evaluation to look back at the last three years of implementation. The evidence collected fed into the development of a new 3-year strategy. Together with my colleagues from Owl RE I supported both components, the evaluation and the strategy development process. On the strategy development I had the lead.
More on the Tropical Forest Alliance (TFA) here.
Assignment carried out in collaboration with Owl RE, Geneva.
IOM Development Fund Synthesis Evaluation
The report (pdf) summarizes findings of 22 IOM project evaluations from 2016-2021 carried out by the same team. Assessment along the OECD-DAC criteria and of recommendations to provide the Fund with overall learnings to feed into the next funding cycle. Collaboration with Owl RE.
Friends of the Ocean Action Phase III / World Economic Forum
Monitoring, Evaluation and Learning Support: Consulting the project teams on the development of indicators, logframes, Theory of Change, providing monitoring and reporting support.
More on the Ocean Action Agenda here.
Assignment carried out in collaboration with Owl RE, Geneva.
Ex-post evaluation of the IOM project on “Health and Humanitarian Border Management: Capacity Building for Public Health Emergency Preparedness and Response in Burundi and the DRC”
In addition to document analysis I did a field visit to Bujumbura and the Gatumba Kavimvira border (Burundi side) where I carried out interviews with project stakeholders (IOM staff, nurses, provincial district doctors, police officers, etc.).
SDG Initiative 2022 “WIR LEBEN SDGs”
Together with my colleague Andrea Berg I provided monitoring, evaluation and learning support (setting up a monitoring system, collecting, analysing and compiling monitoring data and presenting them to the steering commitee, carrying out a mid-term and a final evaluation) to this Austrian-wide initiative that embraces 8 Austrian NGOs. We used mixed methods (survey, KIIs, interactive reflextion&learning workshops, document review, etc.).
The involved NGOs aimed at raising awareness on the Agenda 2030 and boosting activities for the implementation of SDG interventions. The initative wanted to bring the spotlight on the SDGS als a powerful instrument to promote social justice, sustainable economies and climate protection. The main target was youth, but extended also to the private and public sector.
The main focus of the activities was on child labour and suppy chains, child and youth participation, SDG hikes, SDG Dialogue Forum, SDGs and cultural events, sports and a SDG smartphone ralley.
Project website: https://www.suedwind.at/slider-artikel/rebels-of-change/
The project was funded by the Austrian Development Agency (ADA).
IOM Development Fund Synthesis Evaluation
The report (pdf) summarizes findings of 19 IOM project evaluations from 2015-2018 carried out by the same team. Assessment along the OECD-DAC criteria and of recommendations to provide the Fund with overall learnings to feed into the next funding cycle. Collaboration with Owl RE.
Ex-post evaluation of the IOM project on “Enhancing Migration Governance in Brazil”
Ex-post evaluation of the IOM project on “Strengthening the Capacity of Local Stakeholders to address Migration in Coordination with Federal Authorities in Brazil”
IOM Africa Regional Migration Programme (ARMP)
The aim of the programme is to build long-term capacity of target governments to enable them to manage migration in a sustainable and humane manner.
The evaluation objective is to assess the performance of the inital 45 months of the ARMP and generate lessons to improve the upcoming phase of the programme. It shall help to identify emerging good practices that may be replicated. Case study responsibility for Sierra Leone (onsite), Djibouti, Angola, Mozambique, Togo.
| Geographical Coverage: | Algeria; Angola; Djibouti; Egypt; Ethiopia; Gambia; Lesotho; Libya; Malawi; Mauritania; Morocco; Mozambique; Senegal; Sierra Leone; Somalia; Sudan; Togo; Tunisia; Tanzania; Zambia; Zimbabwe |
Assignment carried out in collaboration with Owl RE, Geneva.
Evaluation of the WIPO project on Increasing the Role of Women in Innovation and Entrepreneurship, Encouraging Women in Developing Countries to Use the Intellectual Property System
The purpose of the project was to strengthen the innovative capacity of Mexico, Uganda, Oman and Pakistan, focusing on increasing the participation of women inventors and innovators in the national innovation system by supporting them in using the IP system more effectively. Activities carried out included awareness raising, production of knowledge products, mentoring 30 women.
This entirely remote evaluation focused on effectiveness and sustainability of the project and collected data through 24 semi-structured interviews with internal and external stakeholders and a document review.
Evaluation Report (pdf)
Friends of the Ocean Phase II
Monitoring, Evaluation and Learn Support: Consulting the project teams on the development of indicators, logframes, Theory of Change, providing monitoring and reporting support.
Assignment carried out in collaboration with Owl RE, Geneva.
Ex-post evaluation of IOM’s support to the National Observatory for Migration (Tunisia)
Mixed methods approach: Key informant interviews during onsite visit with key stakeholders from government, non-governmental and international organizations, document review. The focus of the project was on building the capacity of the relatively young institution ONM (Observatoire nationale de la migration), journalists, press attachés of key Ministries, and to support the institution with visibility activities, for example through the creation of a website (http://www.migration.nat.tn/fr/) dedicated to support decision-makers with relevant migration related data and resources.
Assignment carried out in collaboration with Owl RE, Geneva.
IOM’s strategic and operational response to the Covid-19 pandemic
The aim of the entirely remote evaluation is to evaluate IOM’s strategic, institutional, and operational approach and response to the Covid-19 pandemic and to provide recommendations and lessons learned on how to strengthen IOM’s work to better address the needs and preparedness for future global pandemic crises. Case study responsibility for Greece.
Assignment carried out in collaboration with Owl RE, Geneva.
Ex-post evaluation of IOM’s support to Uganda’s Immigration Training Academy (ITA)
Main project activities: development of a management and marketing strategy of the Academy, development of a training curriculum, trainings.
Evaluation methods used: key informant interviews, document review, onsite visit.
Assignment carried out in collaboration with Owl RE, Geneva.
Evidence Assessment on Migrant (Re-)integration
The IOM Regional Office Argentina commissioned a Rapid Evidence Assessment (REA) to analyse existing literature and evaluation reports. The aim was to find out effective approaches for migrant’s socio-economic, psycho-social and cultural (re-)integration and provide recommendations for policy makers and practicioners.
REA is a process that is faster and less rigorous than a full systematic review but more rigorous than ad hoc searching, it uses a combination of key informant interviews and targeted literature searches to produce a report in a few days or a few weeks. For this REA with colleagues we reviewed over 110 studies in English, French, Spanish, Portuguese with a final selection of 59 studies (documents that fulfilled the preestablished inclusion criteria).
Assignment carried out in collaboration with Owl RE, Geneva.
complete report, pdf, Spanish
executive summary, pdf, English
Ex-post evaluation of the IOM project “Promoting a regional corridor approach to coordinated/integrated border management in Eastern and Southern Africa”
The overall aim of the IDF-funded project was to increase the capacity of the Governments of Malawi, Zambia and Zimbabwe for coordinated/integrated border management within a regional corridor approach. The innovative aspect was to create evidence on the linkage between trade and migration in contrast to the traditional focus on border management which is on security issues. The three mentioned countries supported by COMESA (the Common Market for East and Southern Africa) asked IOM for support to provide evidence and recommendations on the link between human mobility, cross-border migration, and trade, to support the infrastructure development and the facilitation of country and cross-country collaboration and cooperation of concerned government ministries and of border officials.
The evaluation used a mixed methods approach and answers questions related to each of the DAC criteria as well as coordination and the cross-cutting themes gender mainstreaming and human rights. Data were collected both in the field and remotely.
Assignment carried out in collaboration with Owl RE, Geneva.
Ex-post Evaluation of the IOM project “Strengthening the Management of Remittances for the sustainable development of Cameroon”
The overall aim of the IDF-funded project was to strengthen the positive impact of remittances generated by the Cameroonian diaspora. During a field mission I met with stakeholders in IOM, different Ministries, government related institutions (e.g. National Employment Fund), Training institute African BIB, and young entrepreneurs that received training courses to develop and implement their business idea.
The evaluation used a mixed methods approach and answered questions related to each of the DAC criteria as well as coordination and the cross-cutting themes gender mainstreaming and human rights.
Assignment carried out in collaboration with Owl RE, Geneva.
Ex-post Evaluation of the IOM project “Human Mobility to the Artisanal Mining Sector: Comparative Case Studies in Angola, Mozambique, and the Democratic Republic of Congo”
The overall objective of this IDF-funded project was to provide a comparative perspective of the trends and potential of migration flows and how lessons learnt can contribute to responsible mining in the informal artisanal mining sectors in Angola, Mozambique, and DRC.
The evaluation used a mixed methods approach and answered questions related to each of the DAC criteria as well as coordination and the cross-cutting themes gender mainstreaming and human rights.
Assignment carried out in collaboration with Owl RE, Geneva.
M&E consultancy for Friends of the Ocean/World Economic Forum
With a team of three to support the development of the impact measurement and management framework for the following projects:
Blue Food Partnership
Reducing Seafood Loss and Waste
Blue Recovery Hubs,
Supply Chain Risk Tool
Tasks:
Development/fine tuning of indicators, preparation of guidelines and instruments for data collection, analysis/collation of data for progress reporting, development of mini-case studies, reflexion and learning workshops.
Assignment carried out in collaboration with Owl RE, Geneva.
Ex-post Evaluation of the IOM project “Supporting Labour Mobility in the East African Community: Operationalizing the Common Market Protocol Provisions on the Free Movement of Persons and Labour”
This IDF-funded project aimed to contribute to the operationalization of the East African Community Common Market Protocol (EAC CMP), particularly provisions concerning the free movement of people and labour. The actions proposed by this project focused on the enhancement and greater harmonization of national and regional policy, legislative, and institutional frameworks on the one hand and a cross-border capacity building initiative on the other hand.
The evaluation used a mixed methods approach and answered questions related to each of the DAC criteria as well as coordination and the cross-cutting themes gender mainstreaming and human rights.
Assignment carried out in collaboration with Owl RE, Geneva.
Evaluation of the promotion of gender equality within the partner organisations and projects of Bread for the World
The focus of this evaluation was on the Investigation of the embeddedness of gender equality and gender mainstreaming in the partner organisations and their projects (n=131). The evaluation provided an assessment of the status of gender work, within the partner organisations and their projects and the identification of good practice examples. The evaluation applied a mixed methods approach (survey, focus group discussions, document review, case studies).
In December 2020 with my team we finished the deskphase which included a survey to partner organisations and Bread for the World staff members (in 5 languages), in-depth analysis of project documentation for 30 projects in Africa, Asia&Pacific, Latin America&Carribean, Europe/Middle Eeast, focus group discussions. We developed specific actionable recommendations for the client which were then refined during the field phase in 2021. During the field phase I collected data remotely in Lesotho and Tanzania together with a local consultant. We carried out a participatory evaluation workskhop, prepared a debriefing report for the partner organisations and enriched the desk report with the data from the field phase.
Download summary of the full evaluation report (german)
Ex-post Evaluation of the IOM project “Strengthening the knowledge base to better protect and assist migrants in a situation of vulnerability in Mali”
The overall objective of the IDF-funded project was to strengthen the capacity of the government and civil society actors to protect migrants and potential migrants on their migration routes. The evaluation used a mixed methods approach and answered questions related to each of the DAC criteria as well as coordination and the cross-cutting themes gender mainstreaming and human rights.
Assignment carried out in collaboration with Owl RE, Geneva.
Final evaluation of the IOM Migration Governance Indicator (MGI) project
In 2015 IOM developed a Migration Governance Framework (MiGOF) to help define what “well-managed migration policy” might look like at the national level. 90 Migration Governance Indicators were developed to assess national frameworks and help to operationalize the MiGOF. The MGI aim to help countries in their assessment of the comprehensiveness of their migration policies as well as to identify gaps and areas that could be strengthened. I was responsible for the case studies in Portugal, Brazil, Timor-Leste, Cabo Verde, and Sri Lanka. This formative and summative evaluation tried to answer questions related to all DAC criteria as well as coordination and cross-cutting themes. Team member of Owl RE, Geneva.
M&E Consultancy for Caritas Austria, 3-year multicountry advocacy project for Migration&Development MIND
Support of the project manager and 11 European partner organisations in setting up a project M&E system, support learning and capacity building, preparing quarterly monitoring reports, annual effectiveness reports, evaluating the effectiveness of the actions and measuring impact.
Final evaluation of the project: Intellectual Property (IP) Management and Transfer of Technology. Promoting the Effective Use of IP in Developing Countries, Least Developed Countries, and Countries with Economies in Transition (WIPO, World Intellectual Property Organisation)
The evaluation assessed the extent to which the project has been successful in a) establishing a framework for more effectively targeting capacity building activities in the field of technology transfer, and b) creating capacity in IP management and transfer of technologies among the key role players (funders, developers, managers and users of IP). The evaluation answered questions related to project design and management, effectiveness, sustainability, and the implementation of Development Agenda Recommendations.
Evaluation report (pdf)
Participatory final evaluation of the multi-country WWF awareness raising project “Responsible seafood consumption for the benefit of people, oceans and climate ”
Due to the COVID-19 restriction I developed workshop tools to be carried out by each partner country (12 in Europe) remotely. Exercises included: River of Life, Carousel, Brainstorming, etc. In addition, I carried out semi-structured interviews, group discussions with project partners in 5 developing or transition countries (Philippines, India, South Africa, Tunisia, Turkey), and analyse relevant project documentation. The evaluation focused on the DAC-criteria Effectiveness, Impact and Sustainability.
M&E Consultancy for EC-DG NEAR/EU TF (2016-2020)
In a first phase (re-)construction of the intervention logic, creation of a strategic M&E framework with a set of sector-specific indicators (focus: migration&development, institutional capacity building), drafting M&E guidelines, in a second phase advisory service to match existing project proposals/logframes (including agencies such as Agence Francaise de Développement, GIZ, Italian Ministry of Foreign Affairs, ENABEL, PLAN International, AECID, FIIAPP etc.) with the newly created strategic Monitoring and Learning framework, ongoing M&E support to improve logframes and develop SMART indicators, quality assurance, trainings/workshops in the area of the EUTF NOA strategic framework, monitoring, evaluation and learning.
As part of this assignment I have been the lead reviewer and focal point for 22 projects from more than 15 international organisations in Egypt, Libya, Tunisia, Algeria, Morocco. (cooperation with ICMPD)
Monitoring Report 1
Monitoring Report 2
Evaluation of the effects of the international volunteer deployment programme of Caritas Austria on host organisations and host communities
This evaluation assessed the effects of young volunteers on host communities and host organisations. In this programme young people remain on average between 3 and 12 months in a country of the Global South. Used methods: Case studies in Mozambique, Mexico, Thailand; online survey in 3 languages: Spanish, Portuguese, English, extensive literature review.
Participatory mid-term evaluation of the multi-country WWF awareness raising project “Responsible seafood consumption for the benefit of people, oceans and climate ”
The focus of the evaluation was on relevance and effectiveness of the project (implemented in 17 countries in Europe and overseas) and its internal management. For the evaluation I applied a range of qualitative and quantitative research methods (online survey, interviews, group discussions, document analysis).
Presentation of MEAL STRATEGIES AND LEARNING FROM PROJECTS at the Knowledge Management for Development Group Vienna
I presented and discussed Monitoring Evaluaton Accountability and Learning strategies with a focus on learning from projects with representatives from CARE Austria, HORIZONT3000, Diakonie, Caritas, and a colleague from the Vienna Evaluation Network. I share the presentation with you and I am happy to receive any feedback.
Evaluation of the Effectiveness and Relevance of UNHCR advocacy
approaches with the EU and in EU countries
Together with Glenn O’Neil (Owl RE) I participated in data collection and analysis in Austria and Germany applying a contribution analysis approach.
Evaluation of the small grants instrument of Brot für die Welt
Evaluation (I led a team of 3) of the small grants instrument “Churches help Churches” of Brot für die Welt, Germany (field studies for interviews in Argentina, Uruguay, Ukraine, Romania) as team leader. Cooperation with Mainlevel.
Summary of the evaluation report
Evaluation of Caritas Austria Foreign Department’s Strategic Plan
Participatory mid-term evaluation of the implementation of Caritas Austria’s strategic plan (two online surveys, focus group discussions, key informant interviews, etc.)
Synthesis Evaluation of a Multi-country Food Security Programme, Caritas Austria
Final evaluation of an ADA-funded food security programme in four Sub-Saharan countries (Burkina Faso, Senegal, Ethiopia, Congo) with a strong focus on capacity development and knowledge management. One part analysis synthesis of country evaluation report, one part primary data collection through interviews. Report (pdf)
Grant writing for Volkshilfe Solidarität, Austria
Proposal for a humanitarian aid project in Westsahara for submission to European charity foundations
Programme management and strategic advisory for BRAVEAURORA, Ghana and Austria
1-day Training on impact-oriented project planning for staff of Catholic Diocese of Linz
Research on employment effects of financial sector interventions in the MENA region for GIZ, Germany
I was part of the research team of Reinhard Paulesich from the Vienna University of Economics. Comparison with best practice examples from different countries in the world. Research carried out in English, Portuguese, Spanish, French.
Project management, strategic advisory for Aktion Regen, Austria
Grant writing for a project in India on behalf of Hinzen Privatkontor, Germany
Proposal writing for submission to German Foundations, context: India, St. Augustine’s Social Service Society, education and training for disabled children/youth
Grant writing for a school project in Israel
Proposal writing for submission to German Foundations, context: Israel, Salesian Sisters, education. Commissioner: Don Bosco Sisters Germany.
Grant writing – projects in various sectors
Proposal writing for submission to a Swiss Foundation, context: Philippines, Ethiopia, Benin, Mali (education, psycho-social counselling, rural development). Commissioner: Jugend Eine Welt, Austria.
Assessment of the impact of Fair Trade to improve Turkana women’s livelihoods – in cooperation with EZA Fairer Handel, Austria
Research report based on literature review and field study in the seminomad Turkana Region of Kenya (pdf). For the assessment I applied a quasi-experimental approach.