--- title: "ITC ILO - Evaluation of Training Activities on Social Protection 2025" description: "ITCILO, the International Training Centre of the ILO, commissioned an external evaluation (via The Alternatives Factory) of its 2024 Social Protection…" url: https://reliefapplications.org/projects/itc-ilo-evaluation-of-training-activities-on-social-protection-2025/ lang: en updated: 2026-11-11 --- # ITC ILO - Evaluation of Training Activities on Social Protection 2025 ITCILO, the International Training Centre of the ILO, commissioned an external evaluation (via The Alternatives Factory) of its 2024 Social Protection training activities, assessing the design, delivery and outcomes of selected online, blended and face-to-face courses against standard evaluation criteria and ITCILO’s quality-management standards. - **Client**: ITCILO - **When**: Jun–Aug 2025 - **Team**: 3 people - **Services**: [Info management & MEAL](https://reliefapplications.org/services/info-management/) - **Technologies**: Python 3.11 (JupyterLab), Pandas, NumPy, SciPy, Pingouin, Statsmodels, Scikit-learn, Gemini, NotebookLM - **Industry**: Labour Rights - **SDGs**: 1. No poverty, 8. Decent work and economic growth, 10. Reduced inequalities, 16. Peace, justice and strong institutions - **Client website**: [itcilo.org](https://www.itcilo.org/) Relief Applications and The Alternatives Factory conducted an external evaluation of ITCILO’s 2024 Social Protection training portfolio for the SPGT Programme. This external evaluation assessed the design, delivery, and outcomes of selected online, blended, and face‑to‑face Social Protection trainings delivered by ITCILO in 2024. The scope covered standard evaluation criteria (relevance, coherence, effectiveness, efficiency, impact, sustainability) and alignment with ISO 29993:2017 learning‑services standards and ITCILO’s Plan, Do, Check, Act (PDCA) quality‑management cycle. The work included desk research, data extraction from MAP/eCampus and course materials, participant survey, key‑informant interviews with ITCILO staff and institutional clients, focus group discussions with learners, and the development of five case studies showcasing good practices and outcomes. Methodology The evaluation applied a mixed-methods approach combining quantitative and qualitative techniques to assess the relevance, quality, and impact of ITCILO’s 2024 Social Protection training activities. The methodology was structured around the OECD-DAC evaluation criteria and the Community of Inquiry (CoI) framework to evaluate teaching, social, and cognitive presence in online and blended learning. Key methods included: Desk Review: Analysis of training documents, course materials, and post-training evaluations to establish context and inform data collection tools. Online Survey: Sent to over 1,800 participants across modalities, collecting data on demographics, training design, learner support, delivery preferences, and outcomes. Key Informant Interviews (KIIs): Conducted with ITCILO staff, programme managers, and institutional clients to gain strategic and operational insights. Focus Group Discussions (FGDs): Held with diverse training participants to explore learning experiences, application, and impact. Case Studies: Five in-depth cases were selected to illustrate concrete examples of training uptake and organizational impact. Data from these sources were triangulated using statistical analysis (e.g. ANOVA, regression models) and thematic coding to generate evidence-based findings and recommendations. Technology Used Quantitative analytics: Python 3.11 (JupyterLab); pandas, numpy, scipy, pingouin (reliability; KMO/Bartlett/Cronbach), statsmodels (OLS/logit/ordinal), scikit‑learn (validation & diagnostics); matplotlib & seaborn (figures). Version logging ensured full reproducibility. Qualitative support: Gemini (interview transcription); NotebookLM (document querying). Final coding/interpretation done manually with evaluator cross‑checks. Reproducibility & QA: Version‑pinned environment, documented notebooks (.ipynb), seeded analyses, codebook, and full pipeline/log archives. In partnership with The Alternatives Factory, Relief Applications brings stakeholder-centred evaluation leadership together with a reproducible, ISO-aligned analytics stack, turning training data into auditable evidence and actionable improvements across programmes. Report brief: https://www.itcilo.org/external-evaluation-2025-report-brief ## The challenge - Measure training quality and learning transfer across modalities. - Assess alignment with ITCILO QA standards and identify improvements. - Generate practical knowledge through case studies for scale‑up. ## What we did - Mixed‑methods design anchored in OECD‑DAC criteria and the Community of Inquiry (CoI) framework (teaching, social, cognitive presence). Evidence collection combined a large‑scale participant survey, KIIs with programme managers and institutional clients, and FGDs with learners. Statistical modelling and thematic analysis triangulated findings into clear results and visuals. - Map practices to ISO 29993 and PDCA, perform evidence‑mapping and triangulation, document constraints and mitigation, and produce targeted, actionable recommendations for design, delivery, and data systems. - Identify and develop five case studies spanning online, blended, and in‑person modalities, selected for demonstrated post‑training application, geographic/institutional diversity, and potential for replication. Each case documents problem/need, actions taken, evidence of change, sustainability factors, and replicability. > I would like to take this opportunity to thank you all for the professionalism, dedication, and collaborative spirit demonstrated throughout the evaluation. Your constructive approach and engagement with colleagues at all levels greatly contributed to the smooth conduct of the process and to the production of a well-balanced and insightful report. > > Eiman Elmasry, Quality Assurance, Data and Analytics officer - International Training Centre of the ILO ![Evaluation of Training Activities on Social Protection 2025, ITCILO: screen 1](https://reliefapplications.org/images/projects/slides/p020/01.webp) ![Evaluation of Training Activities on Social Protection 2025, ITCILO: screen 2](https://reliefapplications.org/images/projects/slides/p020/02.webp) ![Evaluation of Training Activities on Social Protection 2025, ITCILO: screen 3](https://reliefapplications.org/images/projects/slides/p020/03.webp) ![Evaluation of Training Activities on Social Protection 2025, ITCILO: screen 4](https://reliefapplications.org/images/projects/slides/p020/04.webp) ![Evaluation of Training Activities on Social Protection 2025, ITCILO: screen 5](https://reliefapplications.org/images/projects/slides/p020/05.webp) ![Evaluation of Training Activities on Social Protection 2025, ITCILO: screen 6](https://reliefapplications.org/images/projects/slides/p020/06.webp) ## More projects - [MSF UK - REMIT: Research Management & Impact Tool Review](https://reliefapplications.org/projects/msf-uk-remit-research-management-impact-tool-review/): MSF UK - [Equality Fund - Impact Library: Data, Stories & Insights](https://reliefapplications.org/projects/equality-fund-impact-library/): Equality Fund - [FIDH - Automated Timesheet Management System](https://reliefapplications.org/projects/fidh-automated-timesheet-management-system/): FIDH - [French Red Cross - Plateforme Alimentaire de Guyane](https://reliefapplications.org/projects/crf-plateforme-alimentaire-de-guyane-stock-and-distribution-management-application/): French Red Cross - [PUI - Rapid Response and Anticipatory Action in Far North Cameroon](https://reliefapplications.org/projects/pui-strengthening-complementarity-between-rapid-response-mechanisms-and-anticipatory-action-in-far-north-cameroon/): Première Urgence Internationale - [Expertise France - MEAL Data System for the EFOR Project](https://reliefapplications.org/projects/expertise-france-structuring-automating-and-visualising-the-meal-data-system-for-the-efor-project/): Expertise France - [All projects](https://reliefapplications.org/projects/)