Product Test Designs (Blind/Branded, Monadic/Paired, Studio/Home-Use)

Description

Design a product evaluation by choosing whole or partial product, studio or home use, blind or branded presentation, and single or compared products, each controlling a different bias.

Product tests measure subjectively perceived features to establish customer value, best component design or real-world usability. Four design choices define them. Full or partial: test the whole product or selected features. Studio or home-use: studio tests give control but transfer poorly; home-use tests are realistic but uncontrolled. Blind or identified: blind tests remove brand, shape and colour, while identified tests predict buying better; running both isolates the brand effect. Monadic or comparison: comparisons sharpen discrimination but make people hunt for trivial differences, whereas separate monadic groups compared by polarity profiles level shared biases. Sponsor-blind studies, which conceal that a competitor's product is the subject, are acceptable only if participants would not have refused had they known; recruiters list several possible sponsors at screening and the true sponsor is revealed at the end.

Attributes

Loss type
Siloed
Data
Mixed
Effort
Weeks

Steps

  1. Decide full test (whole product) or partial test (selected features, brand or operation).
  2. Choose studio testing for control and spontaneous reactions or home-use or beta testing for realism; include lead users in industrial markets.
  3. Choose blind, identified or partly neutralised presentation; run blind and identified versions in parallel to estimate the brand effect.
  4. Choose monadic, sequential or side-by-side comparison, or several monadic groups compared on a semantic differential.
  5. For sponsor-blind studies use a third-party recruiter, list several possible sponsors at screening, exclude candidates who object, and reveal the sponsor at debrief.
  6. Collect perceptions and judgements, plus performance, error and failure data in field tests.

Sources

  • Innovation and Product Management (Gaubinger et al., 2015)
  • Understanding Your Users (Baxter et al., 2015)
  • MIT Psychology (Stangor, 2012)

Also known as

  • Product test designs (full or partial, studio or home-use, blind or identified, monadic or comparison)
  • Product tests
  • Home-use test
  • Blind test
  • Monadic test
  • Paired comparison product test
  • Brand-blind study
  • Sponsor-blind study
  • Blind competitive study

Categories

  • Research Operations
  • Research Design & Rigor