Welcome cocktail reception, Tuesday 18 September 6:00–8:00pm, open to all delegates! Venue: Penny Royal
Back To Schedule
Thursday, September 20 • 2:30pm - 3:00pm
In their own words: How we (the boring adults) worked with young people (the cool kids) in Papua New Guinea to develop a bilingual post-program survey, why we did it, and why it was a good idea

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
Lauren Siegmann (Clear Horizon), Dr Ceridwen Spark (RMIT University), Junior Muke (Equal Playing Field)

We were doing an evaluation of a program on preventing violence against women in Papua New Guinea that worked with young people. This program had been diligently collecting pre and post survey data. When the evaluation started there was a dataset with approximately 2000 pre and post surveys. It was expected that we would use this survey data in the evaluation. The surveys were validated instruments that had been used in evaluations of similar programs, for this reason the data was seen as being of high quality. On closer examination it was clear to us that the data had limited value. We saw no meaningful trends in the survey responses. We concluded that it was likely that the young people completing these surveys did not understand the questions. The language in the survey was formal, and some students found it easier to talk about concepts like gender in Tok Pisin, a local language, rather than English. It was likely that the constructs the survey was measuring did not align to the changes the students told us they were experiencing. The pre and post questions misunderstood the way in which attitudinal changes happened for young people.

We worked with young people who had been in the program to redesign the survey so that it 1) captured the types of changes that students told us happened for them as a result of the program; 2) used their own words and language to describe these changes; and 3) was bilingual, so that students could choose to complete the survey in their preferred language.
In this presentation, we discuss the participatory methods we used to develop the survey, we discuss the ways in which we validated the survey, and we discuss the politics surrounding the redevelopment the survey. 

avatar for Christina Thornley

Christina Thornley

Lead Advisor Innovation and Collaboration, Education Council of Aotearo New Zealand
Christina Thornley leads the Council’s Strengthening Appraisal professional learning project across English and Māori medium schooling and early childhood education settings. She has a strong interest in promoting teaching as a self-managing profession. The appraisal project focuses... Read More →

avatar for Junior Muke

Junior Muke

Program Monitoring and Evaluation Officer, Equal Playing Field Inc. Papua New Guinea
I am from Papua New Guinea. I prefer as an emerging indigenous evaluator and was part of a recent evaluation research on respectful relationship education program with primary school students aged 13-15 in the Nations Capital of Papua New Guinea.
avatar for Lauren Siegmann

Lauren Siegmann

Senior Consultant, Clear Horizon
Lauren is a funny, compassionate, and dedicated evaluation specialist. Her work focuses on collaborative evaluations which involve program staff and program participants in the design and conduct of evaluation, and in the sense-making of evaluation data. She has a particular interest... Read More →

Thursday September 20, 2018 2:30pm - 3:00pm AEST
Chancellor 3