Description
Design every aspect of an evaluation with its specific intended users, around the decisions they will make, so that the findings are actually used.
Patton found that evaluations were often unused, so utilisation-focused evaluation starts by identifying the primary intended users, the people who will act on the findings, and works with them to focus the questions. Methods follow from those questions rather than from the evaluator's preferred paradigm, and use is planned before data are collected. A core move is to ask users what they would do if they had the answer to each question, which prunes a long list to essential questions. The evaluator offers method options and agrees a design users find credible, so they understand and own the study, while challenging their methodological biases where needed. Findings are reported in forms users can act on, and use is followed up. It is a disciplined version of the UX instinct to 'start with the decision'.
Attributes
- Discipline
- Research Design & Rigor
- Loss type
- Unmigrated
- Stage
- Strategy, Evaluation
- Data
- Mixed
- Effort
- Weeks
Steps
- Identify the primary intended users and the decisions they face.
- Generate candidate evaluation questions with them, then prioritise to a few essential ones.
- For each question, ask what they would do differently with each possible answer; drop questions whose answers would change nothing.
- Present method options with their trade-offs and agree a design the users find credible.
- Collect and analyse data around the agreed questions.
- Report in formats users can act on, facilitate interpretation with them, and follow up on actual use.
Sources
- Qualitative Research & Evaluation Methods (Patton, 2002)
- The SAGE Handbook of Qualitative Research (Denzin & Lincoln, 2017)
Also known as
- Utilization-focused evaluation
- UFE
Categories
- Research Operations
- Research Design & Rigor