IOA Quick Alignment Sheet

Inter-Observer Agreement Calibration Tool

Quick Alignment Process

  1. Review behavior definitions together before starting
  2. Watch the same 10-minute segment or review video clips
  3. Each observer independently records data for each trial
  4. Compare responses and mark agreements
  5. Calculate IOA percentage - aim for 80% or higher
  6. Discuss any disagreements to clarify definitions

Behavior Definitions (Review Before Starting)

Quick Alignment Trials (10 Trials)
Trial Scenario/Time Obs 1 Obs 2 Match?
1
2
3
4
5
6
7
8
9
10

IOA Calculation

IOA = (Agreements ÷ Total Trials) × 100

90%+ Excellent

Observers are well-aligned

80-89% Acceptable

Brief review of disagreements

<80% Retrain

Revisit definitions and practice

Discussion Notes (Disagreements & Clarifications)