Description
Evaluate a digital service on three linked dimensions, perceived quality, acceptance, and user need and satisfaction, combining fieldwork with a survey and cross-dimension correlations.
The ISE model frames evaluation of an information service around three dimensions. D1 perceived service quality covers ease of use, usefulness and trust. D2 acceptance covers adoption versus continued use, impact on behaviour and diffusion through recommendation. D3 covers user needs and satisfaction. Research questions are framed for each dimension and for relations between them. In the published application to a city parking-payment app, the team combined a case study, rapid ethnographic fieldwork and interviews with city authorities with a seven-point Likert online survey, reporting awareness and use rates, reasons for non-use, medians, Cronbach's alpha for each dimension and Spearman correlations between indicators. The result showed whether quality, acceptance and need actually align, for example that usefulness rather than ease of use related to use.
Attributes
- Discipline
- Usability & Evaluation
- Loss type
- Siloed
- Stage
- Post-launch
- Data
- Mixed
- Effort
- Weeks
Steps
- Frame research questions for each ISE dimension and for relations between them.
- Run case-study fieldwork and interviews with service owners and operators.
- Build an online Likert survey covering the three dimensions plus awareness and reasons for non-use.
- Report awareness, adoption and frequency of use.
- Check internal consistency of each dimension (Cronbach's alpha).
- Correlate indicators across dimensions with rank correlations, interpreting with care when the user subsample is small.
Sources
- DUXU 2017: Designing Pleasurable Experiences (Marcus & Wang, 2017)
Also known as
- Information Service Evaluation Model
- ISE model
- Smart service evaluation framework
Categories
- User Research
- Usability & Evaluation