Impact assessment of CISCO supported CSR Projects in Education and Health

Client Name: CISCO

Location: Gujarat, Karnataka, Uttar Pradesh and Chattisgarh

Background Context: Under the India Cash Grant Program, conceptualized to drive problem-solving through innovation and the use of technology, CISCO undertook six diverse CSR projects, catering to different sets of beneficiaries.

Development Solutions (DS) was commissioned to undertake an impact assessment of three out of six projects, implemented by Pratham Books, Sikshana, and Indus Action. An assessment framework incorporating the Organization for Economic Co-operation and Development (OECD) – DAC criteria was framed to assess the impact of the intervention across programs. The evaluation assessed the relevance, coherence, effectiveness, efficiency, impact, and sustainability of the interventions. 

PRATHAM BOOKS- STEM STORY BOOKS PROGRAM

Project: Development of Story Books for Children for Augmenting their Reading and Learning

CISCO developed a strategic partnership with Pratham Books to address lack of STEM education and low foundational skills among students in government schools and low-income private schools. Interventions undertaken under the program are:

  • Development of a series of children’s books in multiple languages based on STEM topics.  
  • Setting up classroom libraries with Science, Technology, Engineering, and Math (STEM) books in multiple languages in schools and community-based organizations.
Assessment Objectives:
DS undertook an impact assessment program with the following objectives:
  • To assess impact of the program on students who engaged with STEM story books in government- run schools.  
  • To assess how teachers used STEM storybooks to aid student learning outcomes in science and maths.  
  • To assess the implementation of the program, along with its successes and challenges.  
  • To understand and document the process undertaken in creating the content of STEM books.  
  • Assess the perspective of the stakeholders (Organization heads/staff with STEM libraries) in augmenting STEM learning among children.
Approach and Methodology:
  • Method/ Design: Mixed-methods: Quantitative surveys and key informant interviews. OECD – DAC criteria was used to assess the impact of the intervention.  
  • Key Respondents/ Informants: Students, teachers, and content writers.
  • Key Areas of Inquiry: Relevance of STEM and STEM Storybooks; alignment of stem storybooks and NCERT curriculum; availability and use of STEM storybooks; learning outcomes
  • Sample: 273(Quantitative), 6(Qualitative)

SIKSHANA FOUNDATION-PRERNA 2.0 PROGRAM

Project: Foundation Arithmetic Skills for Students with Developmental Needs through CLAP and strengthen 21st Century Skills through Project Based Learning (PBL)

CISCO developed a strategic partnership with Sikshana Foundation to address the lack of foundational literacy & arithmetic skills in remedial students and build and strengthen their 21st-century skills. Under Prerna 2.0 program, two modules were developed and introduced to teachers for their capacity building and facilitated student learning. The two modules were:

  • CLAP (Customised Learning Achievement Path) module - Designed with an aim to improve/develop arithmetic foundational skills of students.  
  • PBL (Project Based Learning) module – Designed with an aim to improve/develop 21st-century skills among students.
Assessment Objectives:
DS undertook an impact assessment of the program with the following objectives:  
  • To assess the impact of the program on students in enabling better foundational math, in enabled self-learning skills in math, and enabling 21st-century skills.  
  • To assess and document any effect the program had on the teachers of the government schools who were trained as a part of the program.
  • To understand and assess successes, and challenges in program implementation.
Approach and Methodology:
  • Method/ Design: Mixed-methods: Quantitative surveys and key informant interviews. An assessment framework incorporating (OECD) – DAC criteria was framed to assess the impact of the intervention.  
  • Key Respondents/ Informants: Students and teachers
  • Key Areas of Inquiry: Awareness and access to CLAP and PBL modules, impact of the modules on learning, integration of intervention in schools
  • Sample: 286(Quantitative), 5(Qualitative)

INDUS ACTION: EKLAVYA PROGRAM

Project: Facilitate Implementation of Right to Education (RTE) through Technology Support

CISCO developed a strategic partnership with Indus Action to address the gaps in the implementation of Right to Education and Right to Food, by introducing and strengthening technology solutions for improved government facing and community facing products. The interventions include:

  • Right to Education (RTE): The project focused on enabling the disadvantaged communities to secure seats in private unaided schools, by tapping the EWS scheme.
  • Right to Food (RTF): The project worked to facilitate cash benefits for pregnant women and new mothers, to compensate for their wage loss during pregnancy and encourage health seeking behaviours.
Assessment Objectives:
DS undertook an impact assessment of the initiative with the following objectives: 
  • Right to Education (RTE):  
    • To understand the holistic development and deployment of Education-MIS (EdMIS). 
    • To understand how the EdMIS aided in generating policy insights for government officials.
    • To understand how the EdMIS helped government officials in identifying gaps in RTE implementation.
    • To understand the role of MIS in increasing state capacity functions and making the admission process easier for parents
  • Right to Food (RTF):  
    • To understand the role of the helpline in ensuring Direct Benefit Transfers to pregnant and lactating mothers under the Pradhan Mantri Matru Vandana Yojana (PMMVY) scheme in Uttar Pradesh.
    • To understand the use of the prototype dashboard in streamlining and easing the PMMVY data monitoring in the state concerned.
Approach and Methodology:
  • Method/ Design: Desk review and qualitative interactions. An assessment framework incorporating the (OECD) – DAC criteria was framed to assess the impact of the interventions.  
  • Key Respondents/ Informants: Government officials and Indus Action project staff
  • Key Areas of Inquiry: 
    • Right to Education (RTE): Process of admission under Section 12(1)(c) of RTE; identified challenges for implementing Section 12(1)(c) of the RTE ; acceptance and uptake of MIS systems by government officials; alignment of the EdMIS with the processes across different functional units; sustainability of EdMIS.
    • Right to Food (RTF): Effectiveness and sustainability of dashboard and helpline to strengthen PMMVY implementation.
  • Sample: 6(RTE), 6(RTF)

Impact

The valuable insights and recommendations from the assessment will play a crucial role in shaping informed decision-making for CISCO's significant education-focused programs, alongside its implementation partners. Moreover, the report and presentation prepared by DS will provide valuable input for CISCO's monitoring strategies, in collaboration with their dedicated monitoring and evaluation partner.

Connect with us
Linkedin-square Twitter-square Facebook-square Instagram

Explore

Contact

011-42801081
office@devsolutions.org
17/109, Lower Ground Floor, Vikram Vihar, Lajpat Nagar IV, New Delhi – 110024

© Copyright 2022 by devsolutions.org