Description
Design a product evaluation by choosing whole or partial product, studio or home use, blind or branded presentation, and single or compared products, each controlling a different bias.
Product tests measure subjectively perceived features to establish customer value, best component design or real-world usability. Four design choices define them. Full or partial: test the whole product or selected features. Studio or home-use: studio tests give control but transfer poorly; home-use tests are realistic but uncontrolled. Blind or identified: blind tests remove brand, shape and colour, while identified tests predict buying better; running both isolates the brand effect. Monadic or comparison: comparisons sharpen discrimination but make people hunt for trivial differences, whereas separate monadic groups compared by polarity profiles level shared biases. Sponsor-blind studies, which conceal that a competitor's product is the subject, are acceptable only if participants would not have refused had they known; recruiters list several possible sponsors at screening and the true sponsor is revealed at the end.
Attributes
- Discipline
- Research Design & Rigor
- Loss type
- Siloed
- Stage
- Evaluation, Post-launch
- Data
- Mixed
- Effort
- Weeks
Steps
- Decide full test (whole product) or partial test (selected features, brand or operation).
- Choose studio testing for control and spontaneous reactions or home-use or beta testing for realism; include lead users in industrial markets.
- Choose blind, identified or partly neutralised presentation; run blind and identified versions in parallel to estimate the brand effect.
- Choose monadic, sequential or side-by-side comparison, or several monadic groups compared on a semantic differential.
- For sponsor-blind studies use a third-party recruiter, list several possible sponsors at screening, exclude candidates who object, and reveal the sponsor at debrief.
- Collect perceptions and judgements, plus performance, error and failure data in field tests.
Sources
- Innovation and Product Management (Gaubinger et al., 2015)
- Understanding Your Users (Baxter et al., 2015)
- MIT Psychology (Stangor, 2012)
Also known as
- Product test designs (full or partial, studio or home-use, blind or identified, monadic or comparison)
- Product tests
- Home-use test
- Blind test
- Monadic test
- Paired comparison product test
- Brand-blind study
- Sponsor-blind study
- Blind competitive study
Categories
- Research Operations
- Research Design & Rigor