{"id":3225,"date":"2023-07-18T20:41:38","date_gmt":"2023-07-18T20:41:38","guid":{"rendered":"https:\/\/generation-global-overhaul.local\/?page_id=3225"},"modified":"2025-04-29T04:58:52","modified_gmt":"2025-04-29T08:58:52","slug":"external-evaluation","status":"publish","type":"page","link":"https:\/\/www.generation.org\/external-evaluation\/","title":{"rendered":"External Evaluation"},"content":{"rendered":"\n\n<div id=\"hero-block_a94ea5073ac16feecc1027393e4e7125\" class=\"hero\">\n\t<div class=\"container\">\n        <div class=\"hero__text\">\n            <div class=\"hero__text-inner lead lead--md\">\n                <h1 class=\"heading\">External Evaluation<\/h1>\n                \n                <p class=\"hero__dek\">As we grow, independent third party evaluations help assess our program impact for learners, graduates, and employers, so that we can continue to improve and expand our programs.<\/p>                \n                                \n                \n            <\/div>\n        <\/div>\n    <\/div><!-- container -->\n            \n    \n<\/div>\n\n\n\n\n<div id=\"\" class=\"band background-\">\n    \n    <div class=\"container container--default background- padding-default  \">\n\t\t\n\t\n\n\n<div id=\"grid-block_362c7c4b38eb20560e4e210d4dbba958\" class=\"grid grid--columns-2 grid--layout-default grid--width-50-50\">\n\t\t\n\t\t\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\t<img decoding=\"async\" src=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2023\/08\/Romain_Pichon_Sintes_C9715.jpg\" srcset=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2023\/08\/Romain_Pichon_Sintes_C9715.jpg 500w, https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_1000,h_1000,c_fit,q_auto:good\/global\/2023\/08\/Romain_Pichon_Sintes_C9715.jpg 1000w\" alt=\"\" class=\"image image--aspect-square image--rounded-lg\" loading=\"lazy\" id=\"image-block_123d08377dafe848d27a9e940f3a8d5a\"\/>\n\n\n\t\n<\/div>\n\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\n    <span class=\"heading__eyebrow eyebrow\">Summary<\/span>\t<h2 class=\"heading heading--md block-heading\">How does Generation validate impact?<\/h2>\n\n\n\n<p>We have begun conducting evaluations in several of our countries with the support of experienced research agencies and academics.<\/p>\n\n\n\n<p>In Generation India, Kenya and France, the evaluations focused on assessing the impact of our program on our learners\u2019 employment trajectory and our employers\u2019 hiring &amp; retention processes.<\/p>\n\n\n\n<p>Specifically in India, the evaluation also compares outcomes for our learners with other skill training programs. In all cases, we have seen strong employment outcomes with a faster time to placement and higher earnings. We have also received great feedback from our employer partners on the ease &amp; quality of hiring from Generation.<\/p>\n\n\n\n<p>The evaluations have also provided great insight into where we can continue to strengthen our programs.<\/p>\n\n\n\n<p>An evaluation of longer term outcomes is currently ongoing in India &amp; Kenya. As we continue to scale up in each of our countries, we are seeking to conduct more independent evaluations that can help to demonstrate our program impact across various programs and geographies.<\/p>\n\n\n\t\n<\/div>\n\n\n<\/div>\n\n        \n    <\/div><\/div>\n\n\n\n<div id=\"\" class=\"band background-generation-blue-subtle\">\n    \n    <div class=\"container container--xl background- padding-default  \">\n\t\t\n\t\n\n\n<div id=\"grid-block_362c7c4b38eb20560e4e210d4dbba958\" class=\"grid grid--columns-2 grid--layout-default grid--width-50-50\">\n\t\t\n\t\t\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\t<img decoding=\"async\" src=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2023\/08\/Mathematica.png\" srcset=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2023\/08\/Mathematica.png 500w, https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_1000,h_1000,c_fit,q_auto:good\/global\/2023\/08\/Mathematica.png 1000w\" alt=\"\" class=\"image image--aspect-default image--rounded-lg\" loading=\"lazy\" id=\"image-block_1c7fc8221af0fec87ee64aa18dc0d2a0\"\/>\n\n\n\t\n<\/div>\n\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\n    \t<h2 class=\"heading heading--sm block-heading\">Mathematica Impact Assessment of Generation Programs in India and Kenya<\/h2>\n\n\n\n<p>With support from IKEA Foundation, Mathematica conducted a multi-year impact evaluation of Generation programs in India and Kenya in 2022 and 2023. This evaluation assessed short-term outcomes (3-6 months post-graduation) in Phase 1 and longer-term outcomes (12-18 months post-graduation) in Phase 2 using qualitative and quantitative methods. The study assessed Generation\u2019s impact outcomes for graduates, employers, and delivery partners using a quasi-experimental design in India by comparing outcomes for Generation graduates to those in public training programs for the same or similar professions. In Kenya, Mathematica used a non-experimental design, comparing Generation graduate outcomes to those of applicants of similar profiles who were not selected for our programs.<\/p>\n\n\n\n\n    \t<h3 class=\"heading heading--xs block-heading\">Key Findings<\/h3>\n\n\n\n<p><strong>Generation India<\/strong>:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>66% <\/strong>of our graduates <strong>found employment<\/strong> <strong>within 90 days<\/strong> of graduation vs 21% in the comparison group, a 3X multiple<\/li>\n\n\n\n<li><strong>85% <\/strong>of Generation graduates <strong>&nbsp;were employed in jobs directly related to their Generation training<\/strong>, while 51% in the comparison group were able to do so.<\/li>\n\n\n\n<li><strong>14-38% higher wages <\/strong>earned by Generation graduates than the comparison group at three to six months post program, varying by profession.<\/li>\n\n\n\n<li><strong>44% <\/strong>of Generation graduates<strong> continued to be employed at ~15 months<\/strong> after graduation versus 25% among the comparison group.<strong> Mathematica was able to conclude with reasonable confidence that the positive difference in employment of 19 percentage points between the two groups is attributable to Generation\u2019s methodology<\/strong>.<\/li>\n\n\n\n<li>Generation programs are <strong>more cost-effective<\/strong> than those of the comparison group &#8211; the cost per percentage point of long-term employment achieved and the cost per dollar of average learner earnings are both 30% lower for Generation programs than for government-funded programs.<\/li>\n<\/ul>\n\n\n\n<p><strong>Generation Kenya:<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>60%<\/strong> of graduates <strong>found paid employment within 90 days<\/strong> of graduation, of whom 83% retained employment for at least three months after starting their first job.<\/li>\n\n\n\n<li><strong>75% <\/strong>of graduates <strong>found employment directly related to their Generation training.<\/strong><\/li>\n\n\n\n<li>While over 80% of learners were unemployed and had no income upon entering Generation Kenya\u2019s programs, they went on to earn <strong>monthly wages of ~12,000-26,000 KSh in their first job (Phase I) after graduating<\/strong>.<\/li>\n\n\n\n<li><strong>55%<\/strong> of Generation graduates<strong> continued to be employed at ~15 months<\/strong> post-graduation compared to 34% of non-selected applicants.<\/li>\n\n\n\n<li><strong>Long-term job retention is also substantially higher for Generation graduates <\/strong>than for non-selected applicants<strong>,<\/strong> with <strong>almost 66% of initially employed Generation graduates still employed at ~15 months<\/strong> post-graduationcompared to 50% of non-selected applicants.<\/li>\n<\/ul>\n\n\n\n\n    \t<h3 class=\"heading heading--xs block-heading\">Links to Reports<\/h3>\n\n\n\n<p>Phase I: <a href=\"https:\/\/www.generation.org\/wp-content\/uploads\/2025\/04\/Mathematica-IN-KE-Generation-Evaluation-Phase-1-report-Executive-Summary.pdf\" data-type=\"link\" data-id=\"https:\/\/beta.generation.org\/wp-content\/uploads\/2023\/11\/Mathematica-IN-KE-Generation-Evaluation-Phase-1-report-Executive-Summary.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Executive Summary<\/a><br>Phase I: <a href=\"https:\/\/www.generation.org\/wp-content\/uploads\/2025\/04\/Mathematica-IN-KE-Generation-Evaluation-Phase-1-report-Final.pdf\" data-type=\"link\" data-id=\"https:\/\/beta.generation.org\/wp-content\/uploads\/2023\/11\/Mathematica-IN-KE-Generation-Evaluation-Phase-1-report-Final.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Full Report<\/a><\/p>\n\n\n\n<p>Phase II: <a href=\"https:\/\/www.generation.org\/wp-content\/uploads\/2024\/01\/Generation-Evaluation-Phase-II-Executive-Summary.pdf\">Executive Summary<\/a><br>Phase II: <a href=\"https:\/\/www.generation.org\/wp-content\/uploads\/2024\/01\/Generation-Evaluation-Phase-II-report_Final_Nov-29_2023.pdf\">Full Report<\/a><\/p>\n\n\n\t\n<\/div>\n\n\n<\/div>\n\n        \n    <\/div><\/div>\n\n\n\n<div id=\"\" class=\"band background-\">\n    \n    <div class=\"container container--default background- padding-default  \">\n\t\t\n\t\n\n\n<div id=\"grid-block_f9c4cd44557e55fc5fc95efe10f603e6\" class=\"grid grid--valign-center grid--columns-2 grid--layout-default grid--width-50-50\">\n\t\t\n\t\t\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\n    \t<h2 class=\"heading heading--sm block-heading\">Koreis: Impact Study of Generation France<\/h2>\n\n\n\n<p>Generation partnered with Koreis to look at impact data from Generation France related to alumni employment status, financial health and professional satisfaction.<\/p>\n\n\n\n\n    \t<h3 class=\"heading heading--xs block-heading\">Key Findings<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Generation France graduates are over <strong>2x&nbsp;more likely to be employed within 6 months of graduation <\/strong>compared to other job seekers in training (68% vs 30% employment rate).<\/li>\n\n\n\n<li><strong>43% of learners are in long term unemployment before entering the Generation France program<\/strong>, compared to 18% in other training programs.<\/li>\n\n\n\n<li><strong>72% were earning above 1,200 Euro per month after the program <\/strong>\u2013 the minimum wage in France \u2013 compared to only 36% who earned this amount prior to joining the program.&nbsp;<\/li>\n<\/ul>\n\n\n\n<p><a href=\"https:\/\/www.generation.org\/wp-content\/uploads\/2025\/04\/Koreis-Generation-France-Impact-Report-English-Summary-Final.pdf\" data-type=\"link\" data-id=\"https:\/\/beta.generation.org\/wp-content\/uploads\/2023\/11\/Koreis-Generation-France-Impact-Report-English-Summary-Final.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Executive Summary (English)<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.generation.org\/wp-content\/uploads\/2025\/04\/Koreis-Generation-France-Impact-Report-French-Final-1.pdf\" data-type=\"link\" data-id=\"https:\/\/beta.generation.org\/wp-content\/uploads\/2023\/11\/Koreis-Generation-France-Impact-Report-French-Final.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">Full Report (French)<\/a><\/p>\n\n\n\t\n<\/div>\n\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\t<img decoding=\"async\" src=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2023\/08\/Koreis.png\" srcset=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2023\/08\/Koreis.png 500w, https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_1000,h_1000,c_fit,q_auto:good\/global\/2023\/08\/Koreis.png 1000w\" alt=\"\" class=\"image image--aspect-default image--rounded-lg\" loading=\"lazy\" id=\"image-block_e52b4e6cb6f4f6b09bf8b33c3ac2b734\"\/>\n\n\n\t\n<\/div>\n\n\n<\/div>\n\n        \n    <\/div><\/div>\n\n\n\n<div id=\"\" class=\"band background-\">\n    \n    <div class=\"container container--default background- padding-default  \">\n\t\t\n\t\n\n\n<div id=\"grid-block_f9c4cd44557e55fc5fc95efe10f603e6\" class=\"grid grid--valign-center grid--columns-2 grid--layout-default grid--width-50-50\">\n\t\t\n\t\t\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\t<img decoding=\"async\" src=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2025\/02\/DPW-Site-wide.jpg\" srcset=\"https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_500,h_500,c_fit,q_auto:good\/global\/2025\/02\/DPW-Site-wide.jpg 500w, https:\/\/res.cloudinary.com\/generation\/image\/upload\/w_1000,h_1000,c_fit,q_auto:good\/global\/2025\/02\/DPW-Site-wide.jpg 1000w\" alt=\"\" class=\"image image--aspect-default image--rounded-lg\" loading=\"lazy\" id=\"image-block_39a7f09814f5c46245a5c17392466c44\"\/>\n\n\n\t\n<\/div>\n\n\n<div class=\"c-grid-column c-grid-column--padding-default \">\n\t\n\t\n\n\n    \t<h2 class=\"heading heading--sm block-heading\">Employment Data Lab: Generation UK<\/h2>\n\n\n\n<p>We collaborated with the UK Department of Work &amp; Pensions&#8217; <strong>Employment Data Lab<\/strong> for an assessment of our learner outcomes in UK, comparing outcomes against matching administrative data.<\/p>\n\n\n\n<p>The evaluation found that 83% of Generation learners found employment within a year. Further, one year after program start, 70% continue to remain employed. Of 5 similar organizations that went through a similar evaluation, Generation has been shown to have the best outcomes to date.<\/p>\n\n\n\n\n    \t<h3 class=\"heading heading--xs block-heading\">Key Findings<\/h3>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Generation program is serving learners with higher barriers to employment &#8211;&nbsp;<\/strong>28% qualified for free school meals, 19% for the Special Educational Needs provision, 79% were of black\/Asian\/other ethnicities, and 61% were enrolled in \u2018looking for work\u2019 benefit prior to the program<\/li>\n\n\n\n<li><strong>83% of learners found a job within a year of the program, with 73-80% remaining in&nbsp; employment even 2 years after enrolment, compared to 26% before enrolment.&nbsp;<\/strong>Those claiming \u2018looking for work\u2019 benefits dropped to 25% 1 year after the program start.<\/li>\n\n\n\n<li><strong>Learners also had a 3.6x increase in wages from the year before they enrolled in the program to one year after enrolment.&nbsp;<\/strong>Wages increased further by 14% at 18 months after enrolment, indicating sustained employment growth.<\/li>\n\n\n\n<li><strong>Generation learners were 1.4x more likely to be in employment one year after the program compared to the counterfactual group(70% vs 50%).<\/strong>&nbsp;While a causal impact could not be established due to insufficient data, t<em>he largest net positive gap over the counterfactual compared to all organizations evaluated, the rigorous matching process for the current counterfactual(across 154 variables) and the comprehensive nature of our intervention<\/em>&nbsp;are strong indicators of causality.<\/li>\n<\/ul>\n\n\n\n<p><a href=\"https:\/\/www.gov.uk\/government\/statistics\/employment-data-lab-analysis-generation-you-employed-uk\/employment-data-lab-analysis-generation-you-employed-uk\" data-type=\"link\" data-id=\"https:\/\/www.gov.uk\/government\/statistics\/employment-data-lab-analysis-generation-you-employed-uk\/employment-data-lab-analysis-generation-you-employed-uk\" target=\"_blank\" rel=\"noreferrer noopener\">Full Report (gov.uk site)<\/a><\/p>\n\n\n\t\n<\/div>\n\n\n<\/div>\n\n        \n    <\/div><\/div>","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"_acf_changed":false,"footnotes":""},"class_list":["post-3225","page","type-page","status-publish","hentry","wpautop"],"acf":[],"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Generation","distributor_original_site_url":"https:\/\/www.generation.org","push-errors":false,"_links":{"self":[{"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/pages\/3225","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/comments?post=3225"}],"version-history":[{"count":15,"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/pages\/3225\/revisions"}],"predecessor-version":[{"id":8836,"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/pages\/3225\/revisions\/8836"}],"wp:attachment":[{"href":"https:\/\/www.generation.org\/wp-json\/wp\/v2\/media?parent=3225"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}