Description
Converting qualitative themes into defined constructs and survey items in participants' language, then pretesting and validating them with factor analysis.
This bridge turns qualitative insight into something measurable at scale. For each major theme, the researcher defines the underlying construct and its observable indicators, drafts candidate items using participants' own language (which improves face validity), and pretests the items with cognitive interviews. The items are then fielded to a sample large enough for exploratory factor analysis (typically 200 or more), checked for expected structure and reliability, and confirmed on a fresh sample with confirmatory factor analysis. The result is a validated scale grounded in user experience rather than borrowed from another context. Reporting what the quantitative construct captures and what it misses keeps the link to the qualitative origin honest.
Attributes
- Discipline
- Survey & Psychometrics
- Loss type
- Latent
- Stage
- Definition
- Data
- Mixed
- Effort
- Weeks
Steps
- From each major qualitative theme, derive: what is the underlying construct? What observable behaviours or self-report items would indicate its presence?
- Write candidate items using participants' own language from the qualitative phase — in-vivo language produces more face-valid items.
- Cognitive interview candidate items with 5–8 members of the target population.
- Run Exploratory Factor Analysis to determine whether items group as expected.
- Validate with CFA. Report both what the quantitative construct captures and what it misses.
Sources
- Quantitative User Experience Research (Chapman)
- Oxford Handbook of Multimethod & Mixed Methods Research
- Scale Development: Theory and Applications (DeVellis)
- Designing and Conducting Mixed Methods Research (Creswell & Plano Clark)
Also known as
- Exploratory sequential design
- Instrument development from qualitative data
- Theme operationalisation
Categories
- Analytics & Behaviour
- Survey & Psychometrics