AES 2015 International Evaluation Conference has ended

Create Your Own Event

AES 2015 International Evaluation Conference

This online program is updated daily. Delegates can also check the Program Change board beside the Registration Desk at MCEC for notices of program changes.

17:30 AEST

Conference opening ceremony: "Challenging the narrative of evaluation" John Hattie Melbourne School of DesignMaxine McKew • Lyn Alderman • John Hattie

09:00 AEST

Plenary 1: Keynote address "Why am I paying you to tell me what I already know?" Ian Anderson and Liz McKinley Plenary 1 (auditorium)Timoci O’Connor • Anona Armstrong AM • Ian Anderson • Elizabeth McKinley

11:00 AEST

Qualitative event evaluation: the AES Darwin 2014 Conference Room 110Laurie Porima • sigrid patterson • Charlie Tulloch Drawing out the values: Social Return on Investment and Public Value discourse lenses Room 111Ghislain Arbour • Linda Kurti • Julian Thomas Plan-deliver-learn: Driving an evaluative mindset Room 108Kylie Brosnan • Sarita Narayan Not another ECB story: Applying Cousins' Framework for organisational evaluation capacity to support the Australian Human Rights Commission preparations for the Enhanced Commonwealth Performance Framework Room 112April Bennett • Jennifer Davis • John Stoney Presidents' Session 1: "Reaching Across Boundaries with Exemplary Evaluation in 2025: Will the World be Better Off?" Stewart Donaldson Room 109Lyn Alderman • Stewart Donaldson Formative Assessment for Evaluation: Collaborative, community-based design of evaluation tools and systems Room 107Sally Faisandier • Hadeel Al-Nawab • Amy Gullickson Evaluation: enabling stronger and better communities Plenary 1 (auditorium)Timoci O’Connor • Ian Anderson • Elizabeth McKinley

11:30 AEST

Evaluator personality preferences - Implications for influencing evaluation design and utilisation Room 110Laurie Porima • Eve Barboza From promise to practicalities: Applying complex systems concepts and methods in evaluation research with peer and community based programs Room 108Kylie Brosnan • Graham Brown • Daniel Reeders CANCELLED Application of evaluative monitoring for adaptive planning, monitoring and evaluation within a bi-lateral aid partnership model programme Room 112April Bennett • Kate Averill • Turisia Pranawisanti Use of Evaluation to Consolidate the Adoption of Innovatory Programs Room 111Ghislain Arbour • Jacqui Borg • Rick Cummings • John Owen

12:00 AEST

Competencies across boundaries: applying a Canadian tool to Australasian competences Room 110Laurie Porima • Emma Williams A flexible, multi-purpose monitoring, evaluation, and learning system to support Australian agriculture international aid and development programs: theories, practices, and lessons learned Room 112April Bennett • Samantha Stone-Jovicich Applying complexity theory to evaluation: Reflecting on research to inform practice Room 108Kylie Brosnan • Mat Walton Evaluative reasoning: How are we doing? Can we do better? Room 107Sally Faisandier • Heather Nunns

13:30 AEST

An old idea still good? A discourse on Owen's Forms and Approaches model Room 111Janice Brown • Brad Astbury • John Owen • John Stoney Getting ethics clearance and consent on projects undertaken with community based Aboriginal research practitioners - The ARPNet experience on the Bushfires CRC project in the Top End Plenary 1 (auditorium)Alison Reedy • Hmalan Hunter-Xenie • Bev Sithole Using multi-methods to evaluate clinical services: A case study. Room 112Gail Kelly • Kerryn Butler • Rebecca Reeve A whole-of-agency perspective on evidence-based policy making Room 109Gabby Fennessy • Ben Barnes • Rebecca Wilkinson Performance measurement: Exploring the gap between promise and practice, using Client Satisfaction as a case study Room 107Sally Faisandier • Julie McGeary So now you've got the data, what next? Collaborative sensemaking to navigate diversity Room 108Gill Westhorp • Irene Guijt • Kate McKegg • Judy Oakden Using digital technology across the range of tasks in evaluation Room 110Eve Barboza • Larraine Larri • Delyth Lloyd • Patricia Rogers

14:00 AEST

Evaluating a national workforce reform initiative: Lessons from the Australian experience with expanded scopes of practice in - primary care physiotherapy, emergency nursing, nurse endoscopy and extended care p... Room 111Janice Brown • Cristina Thompson Your Shed and Dementia: From local stories to a National intervention Room 112Gail Kelly • Samantha Abbato Finding Courageous Clients: an emerging evaluator's reflections on the balance between innovation and caution Room 109Gabby Fennessy • Joanna Farmer Using two lenses in understanding partnerships within a state-wide community-based childhood obesity prevention program Room 107Adeola Capel • Margaret Cargo • Agustina Gancia • Michelle Jones Improving the evidence for communities and policy makers to assist in addressing Indigenous disadvantage in the criminal justice system Plenary 1 (auditorium)Alison Reedy • Ruth McCausland • Cleonie Quayle • Anne Redman

14:15 AEST

Getting to the real 'value in value for money': Using economics evaluatively Room 108Gill Westhorp • Julian King

14:30 AEST

Practical facilitation tips and tools to engage people in your evaluation Room 110Eve Barboza • Vanessa Hood • Natalie Moxham Project of terminological dictionary of evaluation: A much needed attempt at clarity Room 111Janice Brown • Ghislain Arbour Animal Evaluation: How should the evaluator talk with animals? Room 112Gail Kelly • David Brous Evaluating the impact of cancer research funding: All together now Room 107Adeola Capel • Nicci Bartley Insights into the needs of teen parents: Conducting a needs assessment using Photovoice Room 109Gabby Fennessy • Pauline Dickinson

15:30 AEST

Improving children's early numeracy: An evaluation of the Let's Count program Room 112Gail Kelly • Anne Hampshire Politics at play: New imperatives in evaluating foreign aid interventions Room 107Duncan Rintoul • Sue Cant My life as an evaluator: Stories from the field to induce laughter and learning Room 110Kirsten Sterling • Amy Gullickson • Kelly Hannum • Julian King • Krystin Martens • Ian Patrick An evaluator reflects on forty years of developing a transdisciplinary meta-evaluation conceptual framework from practice-based evidence in Australia Room 111Saville Kushner • Yoland Wadsworth Evaluating as an Outsider or an Insider: A Two-way Approach guided by the Knowers of Culture Plenary 1 (auditorium)Alison Reedy • Elaine Lawurrpa Maypilama • Bronwyn Rossingh • Yalmay Yunupingu Evaluation and Technology: Making it work. Room 108Keren Winterford • Sandra Stopher Keep Them Safe: lessons from a large scale evaluation of child welfare reform Room 109Sue Leahy • Rebecca Cassells • Christine Eastman • Ilan Katz • Peter Ryan

16:00 AEST

Building a Bridge: Participatory evaluation with vulnerable communities on a small budget: Evaluating an innovative community engagement project with people of refugee background in Brisbane. Room 112Martin Pritchard • Sarah Renals Impacts of the 2009 Government of Canada Policy on Evaluation on the federal government evaluation system Room 107Duncan Rintoul • Benoit Gauthier

16:30 AEST

An innovative online tool for expanding the utility of program logic maps Room 108Keren Winterford • Donna Cohen Challenges of Evaluation within a Complex Setting with Diverse Populations Room 112Martin Pritchard • Phoebe Cleland The AES Evaluators' Professional Learning Competency Framework: What's next? Room 110Kirsten Sterling • Amy Gullickson • Delyth Lloyd • Dorothy Lucks • Margaret Macdonald • Emma Williams Evaluations that make a difference: stories from around the world Room 111Saville Kushner • Scott Bayley • Vanessa Hood Reaching across cultural boundaries to strengthen evaluation practice: The development of principles for working in, with and for Indigenous communities Plenary 1 (auditorium)Alison Reedy • Amohia Boulton • Margaret Cargo • Lisa Warner Defensible evaluative criteria for public sector evaluations: What do Australasian evaluators think this looks like? Room 107Duncan Rintoul • Mathea (Ma-tay-a) Roorda Improving tertiary education through strengthened evaluative self-assessment Room 109Sue Leahy • Kate Averill • Kara Scally-Irvine

17:00 AEST

Tweeting for help - the utility of social media and digital technology in modern evaluation practice Room 108Keren Winterford • Rosemary McKenzie Using a monitoring and evaluation framework to overcome the barriers to delivering services to families impacted by drought. Room 112Martin Pritchard • Gayle Burling • Sue Rice

17:30 AEST

AES 2015 Annual General Meeting Room 109Lyn Alderman

08:30 AEST

Plenary 2: Keynote address "Boundary Interactions; the good, the bad and the ugly!" Marlène Läubli Loud Plenary 1 (auditorium)Sue Leahy • Marlene Laubli Loud

09:30 AEST

The relevance of cross-cultural understanding for evaluations in development practice Room 110David Turner • Deborah Rhodes How familiar are you with approaches to evaluation? Room 111Squirrel Main • Matt Healey • Kate Roberts Building a framework for organisation-level monitoring, evaluation and learning: Measuring Oxfam Australia's 'Right to be Heard' active citizenship outcomes Room 107Robyn Grigg • Natalie Moxham • Jayne Pilkinton • Jacqueline Storey Mirror mirror on the wall: Reflections on utilisation-focussed evaluation vs. implementation science. Plenary 1 (auditorium)Mathea (Ma-tay-a) Roorda • Duncan Babbage • Sally Faisandier Opening our eyes: The importance of language, concepts and ways of knowing in reaching across boundaries to develop evaluation capacity with senior Aboriginal women in remote Australia Room 112Bridget Roberts • Margaret Smith • Samantha Togni Developing Cascading Monitoring and Evaluation Frameworks: A Case Study of a Pacific Multi-Country program Room 108Irene Guijt • Anne Markiewicz How can Evaluation contribute to policy reform? Lessons from the Evaluation of the Australian Professional Standards for Teachers. Room 109David Roberts • Ghislain Arbour • Ruth Aston • Janet Clinton • Anna Dabrowski • Amy Gullickson • Daniel Pinchas

10:00 AEST

Evaluation of multilingual community programs: Using appreciative inquiry for research into participant evaluation Room 110David Turner • Al Hines

11:00 AEST

Architectural lessons from complex cross-government evaluations Plenary 1 (auditorium)Mathea (Ma-tay-a) Roorda • Les Trudzik Bridging the boundaries and enriching evaluation: Conversations and experiences of a global online Community of Evaluation Practice Room 107Keren Winterford • Rituu B Nanda • Rajib Nandi Take a ride in my Com-B with MEL and ToC: Measuring Social Capital and Collective Impact of Indigenous Organisations Room 112Bridget Roberts • Pascal Bourgeat • Kylie Brosnan • Paul Paulson Why does monitoring not deliver? Room 108Irene Guijt • Jill Campbell • Zazie Tolmer Evaluating across organisational boundaries: Utilising roundtable evaluation Room 110David Turner • Annie Weir Presidents session 2: "Canada 2025: what ought to be and what will be, and how to close the gap" Benoît Gauthier Room 109Lyn Alderman • Benoit Gauthier Getting serious about evaluation capacity building: lessons from a large government agency that did it strategically then evaluated it. Room 111Jenny de Vries • Gregory Bowen • Marita Merlene • Chris Milne

11:30 AEST

Photovoice: A participatory approach to disability service evaluation Room 107Keren Winterford • Natalie Seed The right framework for the job: developing client outcomes models within the housing and homelessness sector Plenary 1 (auditorium)Mathea (Ma-tay-a) Roorda • George Hatvani • Mark Planigale Empowering organisations - Building evaluation capacity in a cross-cultural context Room 112Bridget Roberts • Madeleine Bower • Alison Rogers Breaking down the boundaries of perception: Introducing monitoring and evaluation frameworks within a science organisation Room 108Irene Guijt • Helen Percy • Bruce Small • Toni White Promoting social inclusion through monitoring and evaluation: A learning focused cross country reflection on the inclusion of people with disabilities Room 110David Turner • Tamara Jolly • Maud Mukova-Moses

12:00 AEST

Moller's Maze: Understanding positionality Plenary 1 (auditorium)Mathea (Ma-tay-a) Roorda • Lara Rapson The untapped potential of social science theory in evaluation and knowledge development - a case study of recent Indigenous evaluation studies Room 107Keren Winterford • Kim Grey Why is there a need to raise the profile of cultural protocols amongst non-Indigenous evaluators in Australia and how do cultural protocols improve cross cultural evaluations? Room 112Bridget Roberts • Madeleine Bower Become a Front-End Champion: Five principles for effective evaluation analysis and design. Room 108Irene Guijt • Anthea Rutter • Zita Unger The ties that bind: establishing common measures for outcome evaluation across government and not-for-profit services Room 111Jenny de Vries • Kieran Longridge • Vanessa Rose

13:30 AEST

Plenary 3: Emerging Evaluators – A Vision for Evaluation 2025 Plenary 1 (auditorium)Ken Coghill • Ruth Aston • Allan Mua Illingworth • Sarah Mason • Melitta Rigamoto

15:30 AEST

Twenty-five years in review: An analysis of the Evaluation Journal of Australasia, 1989-2014 Room 109Emma Williams • Brad Astbury • Eleanor Kennett-Smith What auditors are saying about evaluation Room 108John Donnelly • Tim Kirby Seeing beyond attendance rates: evaluating youth engagement. Room 111Connie Donato-Hunt • Gina Mancuso EvalYear 2015: A watershed for the evaluation sector Room 112David Roberts • Dorothy Lucks Developmental Evaluation Exemplars: Learning from 'down under' and around the globe. Plenary 1 (auditorium)Linda Kurti • Kate McKegg • Samantha Togni The Validity of Evaluation Information: The Achilles Heel of Evaluation? A Forum with the AES Fellows Room 110Ralph Straton • Zita Unger Student session: Publicising and Marketing your Work Room 107Hadeel Al-Nawab • Albie Colvin • Stewart Donaldson • John Hattie

16:00 AEST

The role of evaluation in reducing the over-representation of Indigenous Australian women in prison Room 112David Roberts • Ruth McCausland Crossing virtual boundaries - The potential of information communication technology in evaluation Room 108John Donnelly • Timoci O’Connor Social return on investment: Reaching across the 'language of value' boundary Room 111Connie Donato-Hunt • Anne Crawford Evaluation Journals and Their Editors Crossing Across Boundaries Room 109Emma Williams • Lyn Alderman • Liz Gould • Carol Quadrelli

16:30 AEST

Breaking Bad(Boundaries ) It’s all about the Meth(odology) Room 111Connie Donato-Hunt • Lisa Rankin • Alison Wallace Critically reflecting on an evidence-based project evaluation planning framework Plenary 1 (auditorium)Linda Kurti • Elaine Huber The Theory of Change approach in practice: lessons learned in evaluating an international advocacy campaign Room 110Katherine Vaughan-Davies • Keren Winterford Two sides of the coin: Money stories from the Anangu Pitjantjatjara Yankunytjatjara (APY) Lands of central Australia Room 112David Roberts • Carolyn Cartwright • Susan Garner 'Visible Evaluation': Using embedded evaluation to bridge the gap between professional teaching quality standards and the classroom Room 108John Donnelly • Kathryn Cairns • Gerard Calnin • Janet Clinton • Anna Dabrowski

08:30 AEST

Plenary 4: Keynote address "Boundary spanning: The future of evaluation" Penny Hawkins Plenary 1 (auditorium)Anthea Rutter • Penny Hawkins

09:30 AEST

Building an evaluation system that is relevant, reliable, accessible and resilient. Case study: The monitoring and reporting system for Tasmania's national parks and reserves. Room 107Lee-Anne Molony • Glenys Jones The Canadian Evaluation Society's Professional Designation Program: Views from Members Room 110Duncan Rintoul • Shelley Borys • Benoit Gauthier • Simon Roy Reaching across boundaries - evaluation of high stakes collaboration Room 111Ghislain Arbour • Kate McKegg • Judy Oakden • Vivien Twyford Evaluating impact when you have no counterfactual and a fuzzy program Plenary 1 (auditorium)Kim Grey • Jess Dart • Irene Guijt • Patricia Rogers Process Flow mapping for Evaluating Systems Room 112David Roberts • Melissa Rogan Realist Meta-evaluation: New kid on the block? Room 108Sarita Narayan • Bill Walker • Gill Westhorp The Victorian Responsible Gambling Foundation's local prevention program Room 109Jenny Neale • alice dunt • Les Eastman • Matt Healey • Gail O'Donnell • Liz O'Loughlin • Manu Peeters

10:00 AEST

Measuring The Effectiveness Of Collaborative Capacity Builders: A Mental Health Case Study Room 107Lee-Anne Molony • Sean Chung • Lesley Van Schoubroeck

11:00 AEST

Experiencing developmental evaluation - the case of co-innovation in New Zealand's primary sector. Room 111Ghislain Arbour • James Turner • Toni White Evaluating inquiry-led policy reform in Australia Room 107Peter Ryan • Annette Michaux Misuse of evaluation tools and techniques Room 110Squirrel Main • Brad Astbury • Caitlin Barry • John Stoney • Charlie Tulloch Participatory monitoring - ensuring that all interested stakeholders have the opportunity to share in the decision making. Room 112Samantha Togni • Courtney Boi • John Donnelly • Doyen Radcliffe Are we being heard? Adventures from the frontline of evaluation capacity building Plenary 1 (auditorium)Kim Grey • Ben Barnes • Jennifer Davis • Ruth Friedman • Brian Keogh • Lyn Roberts How to build a good performance framework Room 108Sarita Narayan • Caroline Henwood • Kari Sann Presidents session 3 "Unpacking the invisible knapsack – power, privilege and professionalization" Kate McKegg Room 109Lyn Alderman • Kate McKegg

11:30 AEST

Evaluation as an integrated management tool: Embedding an evaluator into a program Room 111Ghislain Arbour • Liam Downing • Sue Rogan Measuring the effectiveness of the 'whole of system' response to family violence: A 'proof-of-concept' project Room 107Peter Ryan • Jeff Foote • Gail Kelly

12:00 AEST

Strengthening networking and collaboration at a regional level - using the AES Evaluators Professional Learning Competency Framework Room 110Squirrel Main • Julie Elliott • Susan Garner Showcasing the application of theory-driven evaluation for a stepped-wedge, community-randomised trial to improve delivery of secondary prophylaxis for rheumatic heart disease Room 111Ghislain Arbour • Clancy Read The role of evaluators in supporting the development and continuation of Indigenous programs in an era of funding uncertainty Room 112Samantha Togni • Connie Donato-Hunt • Anne Redman • Yvonne Weldon Describing is good: measuring is better. A new means of measuring the effectiveness of networks and simultaneously strengthening their function. Room 108Sarita Narayan • Claire Grealy • Gail Winkworth The power of case studies in evaluating impact of a large scale quality improvement program Plenary 1 (auditorium)Kim Grey • Isla Hains Sharpening the Focus of Evaluation Practice on Outcomes for Diverse Learners Room 107Peter Ryan • Dr Ro Parsons

13:30 AEST

Evaluation amidst complexity: why complexity is important and what to do about it Room 111Graeme Nicholas • Ann Larson Gender Responsive Evaluation for non-gendered programs: Challenges of including a gendered lens in evaluation processes in India Room 108Adeola Capel • Rajib Nandi Foundations for evaluation: piloting a targeted evaluation capacity development program with a NSW Government agency Room 109Jenny Neale • George Argyrous Braiding across cultural paradigms Room 112Samantha Togni • Bev Hong • Angus Hikairo Macfarlane Avoiding doing too little, too late about impact: Planning and implementing an impact-oriented monitoring and evaluation system Plenary 1 (auditorium)Jess Dart • Irene Guijt • Greet Peersman The illogic of logic modelling Room 110Michelle Jones • Saville Kushner New performance requirements under the PGPA Act Room 107John Stoney • Brad Cook • Julie Elliott

14:00 AEST

What characteristics of evaluation reports make them 'useful' to decision makers? Room 111Graeme Nicholas • Alison Hickman Gender justice: Evaluation across levels and dimensions of power, inequality and change Room 108Adeola Capel • Jayne Pilkinton • Anna Trembath Rural R&D evaluation in Australia Room 109Jenny Neale • Tim Lester • Jan Paul van Moort

14:30 AEST

Reaching across disciplinary boundaries: Seeing evaluation through a positive psychology lens Room 111Graeme Nicholas • Kathryn Cairns • Janet Clinton • Lea Waters Evaluating e-learning: Indigenous learners crossing higher education boundaries Room 112Samantha Togni • Alison Reedy Adaptive evaluation: Reflections on a multi-layered, participatory action methodology to evaluate a partnership strategy for the prevention of men's violence against women in regional Victoria, Australia. Room 110Michelle Jones • Karen Crinall • Lynda McRae Evaluating Collective Impact: Challenges and Opportunities Plenary 1 (auditorium)Jess Dart • Ruth Aston • Kelly Hannum It's time to ditch the 100 pager: Data viz infused evaluation reporting. Room 108Adeola Capel • Andre van der Walt Considerations for presenting critical findings for the in-house evaluator: some lessons learned Room 109Jenny Neale • Sally Faisandier

15:30 AEST

Plenary 5: Keynote address "Stepping stones for crossing boundaries" Patricia Rogers Plenary 1 (auditorium)Maxine McKew • Patricia Rogers

16:30 AEST

Conference close and handover, including passing of EvalYear torch Plenary 1 (auditorium)Maxine McKew • Lyn Alderman • Janet Clinton