Selected Resources Developed for Organizations

• Evaluation Guidance Notes (Adaptation Fund, 2023). This comprehensive suite of guidance notes covers various aspects of evaluation throughout the project cycle at the Adaptation Fund. Published in 2023, I worked this assignment as the lead consultant developing the guidance notes, coordinating a team of four other consultants, and with oversight from the Technical Evaluation Reference Group of the Adaptation Fund (AF-TERG). Although developed to operationalize the Adaptation Fund’s new evaluation policy, the guidance notes are applicable to other operational and organizational contexts:

1. Evaluation Principles

2. Evaluation Criteria

3. Evaluation Budgeting

4. Commissioning and Managing an Evaluation

5. Evaluation Terms of Reference

6. Evaluation Inception Report

7. Evaluation Reporting

8. Mid-Term Review

9. Final Evaluation

10. Real-Time Evaluation

11. Ex Post Evaluation

• Theory of Change (TOC) Primer (Adrienne Arsht-Rockefeller Center, 2022). Developed to support my work with the Adrienne Arsht-Rockefeller Center, this SlideDoc provides a concise, user-friendly introduction to theories of change (TOCs).

• IFRC Real Time Evaluation (RTE) Guide and Procedures (IFRC, 2017). This guide provides an overview of RTE theory, and describes how RTE is used by IFRC, providing procedures and tools for managing RTEs. Guidance encompasses a range of topics, including commissioning and planning RTEs, t evaluation team composition, inception reporting, field visits, reporting and dissemination, management response and RTE follow-up.

• Technical Note – Counting People Reached (IFRC, 2017). This 24-page technical notes provides detailed guidance for measuring people reached by services provided humanitarian and development contexts. It addressing challenges of distinguishing between direct and indirect service recipients (AKA “beneficiaries”), as well as quality assurance to avoid double counting when operating in multiple program areas over different time periods, in overlapping locations and among shared populations.

• Baseline Basics (IFRC, 2013). This user-friendly guide provides a concise overview of what are baselines, when and how to conduct them, and reconstructing baseline data, with recommended resources.

• PMER (Planning, Monitoring, Evaluation, Reporting) Pocket Guide (IFRC, 2012). This guide provides a concise, user-friendly summary of key PMER concepts and practices for effective results-based management of IFRC projects, programs. It covers the project cycle, initial assessment, project design, baselines, M&E, and reporting.

• IFRC Framework for Evaluation (IFRC, 2011, 2017). Revised in 2017, this framework guides how IFRC's evaluations are planned, managed, conducted, and utilized to promote reliable, useful, and ethical evaluations that contribute to organizational learning, decision-making and accountability.

• Project/Programme Monitoring and Evaluation (M&E) Guide (IFRC, 2011). This guide provides comprehensive, user-friendly M&E guidance to support results-based management (RBM). Published in 2011, it was one of my first deliverables as a Senior M&E Advisor with the International Federation of Red Cross and Red Crescent Societies (IFRC), and it has been independently identified as one of the best M&E guides available. The guide includes an assortment of practical tools, checklist, a glossary, and links to other resources. In addition to English, (and related guides) from the IFRC is available in Spanish, French, and Russian.

Other Resources - learning briefs, checklists, and reference sheets

• Top Ten Principles for Evaluation Capacity Development (ECD). Drawing upon our book,(Monitoring and Evaluation Training. A Systematic Approach, and an Expert Lecture I gave at the American Evaluation Association (AEA) 2017 conference in Washington, D.C., this post identifies ten key considerations for evaluation capacity development (ECD) as well as M&E capacity development in organizations. 

• Adult Learning Principles for Evaluation Capacity Development (ECD). While the literature on adult learning for ECD is limited, there is a wealth of scholarship and research on adult learning in general. The 14 principles identified here draw upon this body of information. The underlying rationale is not original, but they are assembled and express key practices for successful adult learning for ECD. 

• Context Analysis Checklist for Evaluation Capacity Development (ECD). This checklist identifies key considerations to inform context analysis for ECD as well as M&E capacity development. A context analysis for ECD examines the system-wide components of an organization and its operational context to determine the recommended approach to capacity development. It is important to determine not only the organizational need, but also its readiness for ECD. Ultimately, who and what is analyzed for ECD will depend on the specific organization, stakeholders and needs; therefore, this checklist is not exhaustive, but illustrative and to be adapted accordingly. 

• Illustrative Questions for an Organizational Capacity Assessment (OCA). 1- page summary of key considerations to scope an organization in preparation for an OCA.

• Monitoring and Evaluation (M&E) Stakeholder Groups. List of example stakeholder groups and relevant skills (learning) they may require, appropriate for both evaluation and M&E capacity development. 

• M&E Curricula for M&E Capacity Development. Drawing upon several monitoring and evaluation (M&E) learning curricula, this listing of M&E topics can be used to inform task analysis and curriculum design for M&E learning.

• Logical Bridge Game. In our book on monitoring and evaluation (M&E) training, we present a variety of active learning activities to engage people in monitoring and evaluation (M&E) training. The “Logical Bridge” activity is one of the earliest that I have used for participatory project design and M&E workshops, as well as a team-building energizer to frame strategy development. Making learning fun is based on the adult learning principle that a dynamic, pleasing learning experience teaches more than a routine or boring one. 

• Example Recruitment Checklist – M&E Capacity Development. This tool provides a consistent, transparent, and accountable set of criteria to support recruitment of consultants or employees for monitoring and evaluation (M&E) capacity development. It is a generic example designed to be adaptable to different contexts, terms of reference or job descriptions, whether recruiting for organizational capacity assessment or training.   

• Training Preparation Checklist. There is a lot to manage for any given training event, whether it is only a half-day workshop or a multiday, integrated, residential workshop. It can be stressful, especially for new trainers, and it is easy for even experienced trainers to remember all that needs to be done. This checklist helps by providing a generic list of key reminders, including communication with trainees, selecting and preparing the training facility, preparation of instructional materials and media, and related logistics.

• Recommended Resources for Real-Time Evaluations (RTEs). Twelve hyperlinked resources providing both conceptual and practical guidance for RTE that provides timely, actionable learning to affect projects, programs and other interventions as they occur.