Systematic social observation and ecometrics

Description

Trained raters code the physical and social features of defined places with a structured checklist, combined with independent surveys and records, and reliability is assessed at the place level.

SSO measures places independently of the people being studied. Trained raters walk defined units such as block faces, or record them on video, coding features such as housing layout, traffic, abandoned buildings, graffiti, loitering and public drinking. Ecometrics treats the place, not the person, as the unit of measurement and applies psychometric standards to it: multiple independent reporters (for example a community survey of 15 to 30 non-participants per neighbourhood), expert surveys and administrative records, with reliability computed at the neighbourhood level. Physical disorder is captured well by observation; sporadic social disorder needs surveys. Street View allows cheaper virtual walks. The key discipline is keeping place measures separate from participants' own perceptions to avoid shared method variance.

Attributes

Loss type
Unmigrated
Effort
Months

Steps

  1. Define the unit of place (block face, block group, tract or GIS buffer) and adapt it for rural areas where block faces do not exist.
  2. Build a structured checklist of physical and social features and train raters to agreement.
  3. Walk or record each unit, or use Street View for virtual observation.
  4. Run an independent community survey of about 15 to 30 non-participant respondents per unit, plus expert surveys and linked administrative records.
  5. Compute place-level reliability across raters and respondents.
  6. Keep place scores separate from study participants' perceptions in analysis, and repeat over time to track stability and change.

Sources

  • Handbook of Child Psychology Vol 4 (Lerner et al., 2015)

Also known as

  • SSO
  • Ecometrics
  • Neighbourhood observation audit
  • Virtual SSO with Street View

Categories

  • User Research
  • Field & Ethnographic