Description
A five-step mixed-methods pipeline detecting when users stay active but engagement erodes qualitatively, from Honeycomb anchoring through surveys, telemetry, DriftScore modelling and bandit-optimised interventions.
Behavioral drift is defined as users remaining active while their engagement changes qualitatively: repeating shallow actions, ignoring micro-feedback such as toasts and nudges, and reducing variety even when frequency is constant. Drift is not churn; it is the erosion of desirability and trust while activity persists, and is detectable earlier. The pipeline: (1) anchor in Morville's UX Honeycomb with behavioural proxies; (2) a 30-item Honeycomb Likert survey with EFA plus semi-structured interviews and affinity mapping; (3) longitudinal telemetry tracking interaction entropy, category diversity, recommendation CTR and attention decay, with diary and interview signals; (4) Bayesian updating of drift risk and a 0–1 DriftScore; (5) adaptive interventions (re-onboarding, dynamic UI scaling, context-aware nudging) optimised with Thompson Sampling and validated by A/B and longitudinal interviews. Honeycomb is chosen over HTA (bounded tasks) and IFT (drift is the absence of foraging).
Attributes
- Discipline
- Community-Proposed Frameworks
- Loss type
- Community-proposed
- Tested
- Not yet tested
- Stage
- Post-launch
- Data
- Mixed
- Effort
- Months
Steps
- Anchor drift dimensions in Morville's Honeycomb and map each to a behavioural proxy (e.g. Desirable → exploration beyond minimal path; Credible → adopting recommendations without double-checking).
- Field a 30-item Likert survey aligned to the Honeycomb (worked example n = 300) and run EFA; the example yields Trust, Ease and Engagement factors (α = 0.84, 0.81, 0.86).
- Run semi-structured interviews ('Tell me about the last time you discovered something new here') and affinity-map themes such as repetitive content, off-target recommendations and notification fatigue; double-code 30–40% with κ ≥ 0.70.
- Track telemetry longitudinally: Shannon interaction entropy, categories per session, promo/recommendation CTR, scroll depth and dwell, and frequency versus variety.
- Update drift probability with Bayes (prior 20%; after three sessions with entropy < 1.5 and CTR < 25%, posterior ≈ 65%) and compute a weighted 0–1 DriftScore.
- Deploy adaptive interventions (personalised re-onboarding, dynamic UI scaling, context-aware nudging) and allocate them per user with Thompson Sampling.
- Validate with A/B tests on DriftScore reduction and entropy lift plus longitudinal interviews, against a decision bar (e.g. entropy > 2.0 for 70% of active users within 4 weeks).
Sources
- Vivek Gopinath (2025), Detecting Behavioral Drift: A Mixed Methods Playbook and E-commerce Case Study
- Behavioral Drift Playbook (Gopinath)
- Handbook of Longitudinal Research
- Persuasive Technology (Fogg)
- The Inquiry Series, Ch 24 — Behavior Models, Habits & the Anatomy of Non-Adoption
Also known as
- Detecting Behavioral Drift playbook
- Behavioral drift detection
- Engagement drift scoring
- Individual baseline deviation monitoring
- Drift-triggered research
Categories
- Community-Proposed Frameworks