aes18 International Evaluation Conference

Maria Collazos (Save the Children)
‘Wicked problems’ demand a new way of thinking and working; one which moves beyond independent programs with isolated impact, to a collaborative approach with a common goal. By rethinking the system and how it operates, we can discover new solutions with population level impact.  Being able to measure this impact is key. This practice-focused presentation explores systems change evaluation, using the place-based collective impact initiative, the Youth Partnership Project (YPP), as a case study.
Despite significant investment in the community, there has been persistent issues of youth crime and anti-social behaviour in the south-east corridor of Perth. The YPP was formed as a strategic project to develop a cross-sector early intervention system for the region, and is a demonstration site for Western Australian reform. The project brings together a broad cross-sector of partners to systematically identify the most vulnerable young people in the community and collaboratively address complex needs which are the responsibility of multiple agencies.
This presentation will delve into the challenge of evaluating systems change in initiatives with multiple levels of impact, from individual to systemic. We consider how impact at these different levels affect one another and draw on the YPP’s approach of using developmental evaluation to provide a framework for continuous learning, emergent strategies and monitoring effectiveness and efficiency. Finally, we discuss cost-benefit analysis as an advocacy tool to articulate the need for prevention-focused collaboration and system reform.