Evaluation

Kieran McKeown has undertaken a number of large-scale evaluations which are at the forefront of best international practice. Evaluations are set in the context of evidence-based policy-making and aim at robust measurement of impact based on prior specification of the logic model underpinning the programme or intervention. Data analysis typically involves advanced statistical techniques, notably structural equation modelling, to accurately identify net impacts and the pathways by which they are mediated and moderated. Here are some of the main evaluations undertaken.

Evaluation of Early Years Programmes (2011-2014)

This involves evaluating the impact of two quality-improvement programmes in the early year sector, NEYAI (National Early Years Access Initiative) and Síolta (The National Quality Framework for Early Childhood Education). The evaluation has a before-and-after design and involves collecting data from approximately 700 childcare staff, 500 children in the Free Pre-School Year (approximately 3-4 year olds), and the 500 parents of these children. The evaluation is taking place in around 100 early years centres throughout Ireland. Regular updates on the evaluation are posted on a dedicated website www.neyai-evaluation.ie

Springboard Family Support Programme (1999-2004)

The Springboard initiative, established in 1998, represents the first major family support initiative of its kind in Ireland. It combines support for children at risk with more generalised support for all children and families in disadvantaged areas. The pilot phase involved a full evaluation of services and outcomes based on a pre-post design. This was carried out in 14 sites during the main phase of the evaluation (1999-2001) and two further sites were subsequently evaluated (2002-2004).

Pilot Childcare Initiative (1994-1995)

This was the precursor of the Equal Opportunities Childcare Programme (2000-2006), since superseded by the National Childcare Strategy (2006-2010). This was a multi-site evaluation of 73 childcare projects.

Mental Health Initiative for Children in a Dublin Primary School (2005-2006)

This initiative, informed by the Marte Meo approach to improving mental health, involved a pre-test / post-test evaluation of 20 children (8-13 year olds) with a comparison group of 20 matched children.

Couple-Counselling Services (2000-2002)

ACCORD and MRCS (now renamed Relationships Ireland) are the two largest providers of marriage and relationship counselling services in Ireland. A national evaluation of these services was undertaken using a pre-post design with a sample of some 3,500 ACCORD clients and some 600 clients of Relationships Ireland.

Inter-Agency Programmes (1991-2013)

Evaluation studies have been carried out on almost every major initiative to address local development and social inclusion in Ireland since 1990, including the original PESP Partnerships (1991-1993), the Global Grant (1991-1994), the Operational Programme for Local Urban and Rural Development (1994-1999), the Integrated Services Process (1998-2001), the RAPID Programme (2001 and ongoing), and the mid-term evaluation of the Operational Programmes for the Border Midland & Western Region, and the South & East Region (2000-2006). A local study of inter-agency working in the Ballymun area of Dublin has also been carried out in the context of improving services for children and families.