Description
Code whether hand gestures accompanying an explanation convey information absent from the words; frequent mismatches mark someone in transition and ready to learn.
When people explain how they solved a problem, their gestures sometimes match their words and sometimes convey different but compatible information, such as saying the water is 'lower' while showing the glass's width. Goldin-Meadow's work found that children producing many such mismatches benefit most from instruction, and the finding holds across ages and tasks, from conservation and maths to gears and organic chemistry in adults. Mismatches can occur in over half of a learner's explanations at transitional points. The method requires video, separate coding of gesture with sound off and of speech, and classification of each explanation as matching, mismatching or contradictory. It reveals implicit knowledge that people cannot yet put into words.
Attributes
- Discipline
- Cognitive Psychology & Perception
- Loss type
- Unmigrated
- Stage
- Discovery, Evaluation
- Data
- Qualitative
- Effort
- Weeks
Steps
- Ask participants to solve a task and explain their solution, recorded on video.
- Transcribe speech and separately code gestures with the sound off, blind to speech.
- For each explanation, classify gesture as matching speech, mismatching (different but compatible information) or contradicting.
- Count mismatches per participant and classify them as transitional or stable.
- Use the classification to predict who benefits from instruction, or relate it to later performance.
- Check inter-coder reliability on a subset.
Sources
- Handbook of Child Psychology Vol 2 (Lerner et al., 2015)
- Church, R. B., & Goldin-Meadow, S. (1986). The mismatch between gesture and speech as an index of transitional knowledge. Cognition, 23
Also known as
- Gesture-speech mismatch coding as an index of readiness to learn
- Gesture-speech discordance
Categories
- User Research
- Cognitive Psychology & Perception