AES 2015 International Evaluation Conference

Sally Faisandier (Accident Compensation Corporation), Gaylia Powell (Accident Compensation Corporation)

This presentation highlights issues that arise when evaluators work alongside the business owners of an evaluation, to provide regular feedback loops to assist the early development of a programme. It is based on an evaluation by an in-house evaluation team within a government agency.

The evaluation findings were undoubtedly appreciated and changes were made based on the insights reported. However, it was difficult for the business owners to hear that the logic of the programme appeared to be based on a false premise; that key stakeholders were unwilling or unable to apply the protocols that had been developed; some clients selected for the programme were inappropriate; and the benefits were costly.  

Relationship management is always emphasised as a key skill for an evaluator. In this project, the evaluators had to find a way to convey unpalatable findings in a way that was supportive to the programme developers and business owners of the programme.  The evaluators will present a number of different ways that this was achieved - although not always successfully!Perhaps the most critical element for any good evaluation is that there is a shared understanding by all parties about what will be required. However, that is not always possible in the real world - so other paradigms must also be invoked.

Relationship management; maintaining professional standards; presenting findings in a way that was objective rather than negative and critical was significantly challenged through this project - right through from the development of the evaluation plan to the presentation of findings.It is asserted that this is a common scenario for in-house evaluators, and others may learn from the insights presented here.