Best For
Teams this article is built to help
Category: Special Education
Evidence
What backs this guide
Curated references are cited at the end of the article.
Materials
What you can leave with
- Condensed key takeaways
- Interactive self-check quiz
As a school-based BCBA, much of your work reaches students through the people you coach: paraprofessionals, behavior interventionists and teachers carrying out behavior plans in classrooms you visit for a few hours a week. That creates a basic problem: how do you make sure data collection is consistent and reliable when you can't be in every room?
The Supervision Scaling Problem
A school BCBA often supports staff in many classrooms across several campuses and sees each of them only briefly each week. Without a shared data system, supervision turns reactive: you respond to the latest crisis instead of building staff skills.
The Challenge: Data Chaos Across Campuses
When staff on several campuses collect behavior data, school BCBAs commonly run into:
Inconsistent Definitions
One para counts partial responses; another counts only independent ones. The numbers can't be compared.
Format Fragmentation
Paper sheets from one campus, a spreadsheet from another, an app at a third. Combining them takes hours.
Delayed Access
You don't see the data until your next visit, too late to catch problems or reinforce careful recording.
Missing Documentation
Coaching visits and fidelity checks aren't logged. When the team reviews a plan, no one can say who was trained on what.
The answer isn't working harder; it's building systems that scale.
Setting Up Consistent Data Collection Protocols
Your data infrastructure starts with standardization. Everyone collecting data on a student should be collecting it the same way.
Protocol Standardization Checklist
Training Staff on Operational Definitions
The most common reliability problem isn't the tool; it's different people understanding a behavior differently. Handing out definitions isn't training.
An 80% Agreement Starting Point
Many behavior analysts treat 80% interobserver agreement (IOA) as a minimum. Before a staff member collects data on their own, check their agreement with you or another trained observer across several observations, and look closely at any behavior where you often disagree.
Four-Step Definition Training
Written Definition Review
The staff member reads the operational definition, explains it in their own words, and names its parts: what the behavior looks like, when an episode starts and ends, and examples and non-examples.
Video Scoring Practice
You and the trainee score the same video independently, using training videos or recordings your district permits. Compare results, talk through the differences, and repeat until agreement reaches 80% or more.
Live Parallel Recording
Record side by side during class. Calculate IOA. If it falls below 80%, find the situations that cause disagreement and clarify the definition.
Maintenance Checks
Run unannounced agreement checks about once a month. Drift happens; retrain as soon as agreement drops below 80%.
Using Technology to Aggregate and Visualize Data
The right tool turns supervision from hunting for data into making decisions with it. Whatever you use, look for:
Technology Selection Criteria
The Weekly View: What You Need to See
A quick weekly scan of your caseload should answer these questions:
- Which students have missing data from the past week?
- Which targets show three consecutive data points below criterion?
- Which staff members have the most missing entries?
- Which behavior plans are due for review?
Running Coaching Meetings with Data
Coaching meetings should start from graphed data, not impressions. Here's one structure:
30-Minute Data-Driven Coaching Meeting
Pull up graphs for the student's active targets. The staff member describes the trends they see, and you check how they read the graph.
Focus on targets with flat or worsening trends. The staff member suggests changes; you guide the decision using the data and the behavior plan.
Model or role-play one procedure from the plan. Give specific, behavioral feedback.
Review fidelity data for the plan's key steps and address any drift. If a procedure needs to change, take it through the team's usual plan review.
Log the meeting. Agree on one or two tasks before the next visit and confirm when it is.
Keeping a Coaching Log
A short entry after every visit gives the team a record of what each staff member was trained on and how implementation is going. Identify students the way your district's records policy allows, such as initials or a student ID. A useful entry covers:
| Entry | What to Record |
|---|---|
| Date and Length | When the visit happened and how long it lasted |
| Type of Contact | Observation, coaching meeting, modeling, or group training |
| Staff and Role | Who you worked with: para, interventionist, or teacher |
| Procedures Covered | Which plan strategies or data procedures you trained or observed |
| Fidelity and Agreement | Fidelity checklist score and IOA result, if you ran either |
| Next Steps | What the staff member will practice and when you'll follow up |
Credentialed Supervision Has Its Own Rules
If someone you supervise holds a BACB credential that requires ongoing supervision, or is accruing fieldwork hours toward one, the BACB sets what you must document. Use its current handbook and forms for that supervision rather than a general coaching log.
Tip: Write It Before You Leave the Building
Fill in the log during or right after the visit. Notes reconstructed weeks later miss details, and the team can't rely on them when it reviews the plan.
Training Paraprofessionals on Data Collection
Your data system is only as good as the people using it. Training up front prevents months of data no one can use.
Four-Week Data Collection Training for New Staff
Week 1: Foundations
- Why we collect data (connect it to the student's goals and behavior plan)
- Overview of measurement systems (frequency, duration, latency, interval)
- Tour of the data collection tool or form
- Practice with sample scenarios (no real students)
Week 2: Operational Definitions
- Walk through each assigned student's target behaviors
- Video review with definition matching
- Non-examples and edge cases
- Written quiz with a 90% criterion
Week 3: Parallel Recording
- Side-by-side data collection with you
- IOA calculation and feedback
- Practice on the situations where you disagreed
- Continue until agreement reaches 80% or more
Week 4 and After: Independent with Spot Checks
- The staff member collects data independently
- You review their data daily for the first month
- Unannounced agreement checks twice a month after that
- Retrain right away if agreement drops
What a Shared System Changes
As your caseload grows, a shared data system changes how your time is spent:
Less Chart Building
Graphs come from entries staff already made, so meeting prep is reading data, not charting it.
Problems Show Up Between Visits
A weekly scan shows missing entries and flat trends before you are back on that campus.
A Record the Team Can Check
Coaching notes and fidelity results sit next to the student data they explain.
School BCBA Data System Checklist
Use this checklist to evaluate your current setup or build a new one:
Data System Essentials
Data Collection
Standardization
Training
Visualization and Review
Coaching Records
Practical Example: A Multi-Campus Week
Here's how a shared data system can support a typical week for a BCBA covering several schools:
Weekly Supervision Workflow
Scan the data for every student on your caseload. Flag any with three or more school days of missing data or a flat or worsening trend, and message the staff involved.
Campus visits with two or three coaching meetings a day. Pull up graphs during each meeting and log the visit before you leave the building.
One direct observation per para on your caseload, with an agreement check and a fidelity checklist. Enter the feedback in the coaching log.
Write a short weekly summary. Export data for any plan reviews or IEP meetings coming up, and check the coaching log for gaps.
For the rest of the role, see the school-based BCBA supervision guide and the school BCBA caseload management guide.
Your Data Infrastructure Is Your Multiplier
Supervising staff across campuses is a systems job as much as a coaching one. With shared protocols, training to criterion and a coaching log, every para and teacher you support records data the same way, and the team has it in hand when it reviews a plan.
Start with one student or one classroom. Get the protocols right. Train to criterion. Then scale.
References
Billingsley, B. S., & Bettini, E. (2019). Special education teacher attrition and retention: A review of the literature. Review of Educational Research, 89(5), 697–744. https://doi.org/10.3102/0034654319862495
Brunsting, N. C., Bettini, E., Rock, M. L., Royer, D. J., Common, E. A., Lane, K. A., Xie, F., Chen, A., & Zeng, F. (2022). Burnout of special educators serving students with emotional-behavioral disorders: A longitudinal study. Remedial and Special Education, 43(3), 160–171. https://doi.org/10.1177/07419325211030562
Kranak, M. P., Andzik, N. R., Jones, C., & Hall, H. (2023). A systematic review of supervision research related to Board Certified Behavior Analysts. Behavior Analysis in Practice, 16(4), 1006–1021. https://doi.org/10.1007/s40617-023-00805-0
Springer, A., Marchese, N. V., & Dixon, M. R. (2024). An analysis of variables contributing to Board Certified Behavior Analyst turnover. Behavior Analysis in Practice. https://pubmed.ncbi.nlm.nih.gov/41523810/
Ruble, L. A., McGrew, J. H., Wong, W. H., & Missall, K. N. (2018). Special education teachers' perceptions and intentions toward data collection. Journal of Early Intervention, 40(2), 177–191. https://doi.org/10.1177/1053815118771391
Kearns, D. M., Feinberg, N. J., & Anderson, L. J. (2021). Implementation of data-based decision-making: Linking research from the special series to practice. Journal of Learning Disabilities, 54(5), 365–372. https://doi.org/10.1177/00222194211032403
U.S. Department of Education, Privacy Technical Assistance Center. (2015). Data governance checklist. https://studentprivacy.ed.gov/resources/data-governance-checklist
U.S. Department of Education. (2021). FERPA general guidance for parents and eligible students. https://studentprivacy.ed.gov/
Briesch, A. M., Chafouleas, S. M., & Riley-Tillman, T. C. (2016). Direct behavior rating: Linking assessment, communication, and intervention. Guilford Press.
Chafouleas, S. M., Kilgus, S. P., Riley-Tillman, T. C., Jaffery, R., Christ, T. J., Briesch, A. M., Chanese, J. A. M., & Kalymon, K. M. (2013). An evaluation of the generalizability of direct behavior rating single-item scales to measure academic engagement across raters and observations. School Psychology Review, 42(4), 407–421.
Volpe, R. J., & Briesch, A. M. (2012). Generalizability and dependability of single-item and multiple-item direct behavior rating scales for engagement and disruptive behavior. School Psychology Review, 41(3), 246–261.
Smith, T. E., Thompson, A. M., & Maynard, B. R. (2022). Self-management interventions for reducing challenging behaviors among school-age students: A systematic review. Campbell Systematic Reviews, 18(1), e1223. https://doi.org/10.1002/cl2.1223
Put This Into Practice
Turn the article into action with ready-to-use materials. Downloads stay open; emailed resources and quiz results are opt-in.
Key Takeaways
- Shared data collection protocols reduce variability between the staff who record data
- Operational definitions must be trained to criterion, not just handed out
- A system that combines every collector's data replaces manual compilation
- Coaching meetings work best when they start from graphed data, not verbal reports
- A coaching log shows what each staff member was trained on; credentialed supervision follows the BACB's own documentation rules
Is Your Supervision Data System Scalable or Chaotic?
Find out if your data infrastructure supports your supervision across campuses or if you're drowning in spreadsheets from different planets.
Tags:
For behavior specialists
Coach Staff From the Same Data
Log the same measures across students, compare independent observer records, and review a day's team entries from one workspace.
See Classroom Pulse for School-Based BCBAsAbout the Author
Practical guides from the Classroom Pulse team for educators and behavior support teams who collect and use behavior data. Classroom Pulse was founded by Bobby Hillman, M.Ed., LBA, BCBA.
About Classroom PulseRelated Articles
The Five-Minute End-of-Day Huddle: How Teams Review Behavior Data
A five-minute end-of-day routine for teachers and paraprofessionals: what happened, gaps in the data, one change for tomorrow, who logs what, and ground rules for privacy.
Do Two Observers Agree? Running an IOA Check on School Behavior Data
Before mid-year decisions, check that a second observer would record the same thing. How to calculate each IOA method, what benchmark to borrow, and what to do when agreement is low.
Writing IEP Progress Reports for Behavior Goals: What the Data Should Say
A six-part narrative for IEP progress reports on behavior goals: baseline, current level, trend, measurement, whether progress is sufficient, and what changes next, with examples.
