aes18 International Evaluation Conference

Amy Gullickson (University of Melbourne), Kelly Hannum (Aligned Impact, LLC)

Values, criteria, standards, and synthesis together form the lens that defines the worth of the object being evaluated and the quality of its performance. To answer the question about how good a particular something is, we must combine values with information about how the evaluand is performing. Values determine what good looks like, but to be useful, they must be translated into criteria, indicators  and performance standards to make them explicit. Those choices of criteria and standards then influence what information is needed to make an evaluative judgment. Once the data is collected, the operationalized values are combined with that information using a synthesis method to arrive at evaluative judgements about performance.
The values that drive the evaluation, and the integrity of the synthesis method are key to promoting fairness, equity, accessibility and sustainability - they are the core power in the task of evaluation. Yet, despite their importance they have been largely missing in evaluation research, training, and practice.
In this session we review these primary elements (values, criteria, standards, and synthesis) and present steps for applying them in practice to enhance the equity and integrity of evaluations. The session will conclude with a facilitated discussion on research needs, further ideas for application, and potential ways to stay connected on this topic.