Skip to main content
Building a Data Infrastructure for School BCBA Supervision
Special Education

Building a Data Infrastructure for School BCBA Supervision

How school-based BCBAs build data systems for supervising paraprofessionals and behavior staff across classrooms and campuses: shared protocols, training staff to an agreement criterion, graphed data in coaching meetings, and a coaching log.

Specialist12 references
Back to Blog
The Classroom Pulse Team
Behavior Data Specialists
April 3, 2026
10 min read

Best For

Teams this article is built to help

Specialist

Category: Special Education

Evidence

What backs this guide

12

Curated references are cited at the end of the article.

Materials

What you can leave with

2
  • Condensed key takeaways
  • Interactive self-check quiz
Share this article:

As a school-based BCBA, much of your work reaches students through the people you coach: paraprofessionals, behavior interventionists and teachers carrying out behavior plans in classrooms you visit for a few hours a week. That creates a basic problem: how do you make sure data collection is consistent and reliable when you can't be in every room?

The Supervision Scaling Problem

A school BCBA often supports staff in many classrooms across several campuses and sees each of them only briefly each week. Without a shared data system, supervision turns reactive: you respond to the latest crisis instead of building staff skills.

The Challenge: Data Chaos Across Campuses

When staff on several campuses collect behavior data, school BCBAs commonly run into:

Inconsistent Definitions

One para counts partial responses; another counts only independent ones. The numbers can't be compared.

Format Fragmentation

Paper sheets from one campus, a spreadsheet from another, an app at a third. Combining them takes hours.

Delayed Access

You don't see the data until your next visit, too late to catch problems or reinforce careful recording.

Missing Documentation

Coaching visits and fidelity checks aren't logged. When the team reviews a plan, no one can say who was trained on what.

The answer isn't working harder; it's building systems that scale.

Setting Up Consistent Data Collection Protocols

Your data infrastructure starts with standardization. Everyone collecting data on a student should be collecting it the same way.

Protocol Standardization Checklist

Training Staff on Operational Definitions

The most common reliability problem isn't the tool; it's different people understanding a behavior differently. Handing out definitions isn't training.

An 80% Agreement Starting Point

Many behavior analysts treat 80% interobserver agreement (IOA) as a minimum. Before a staff member collects data on their own, check their agreement with you or another trained observer across several observations, and look closely at any behavior where you often disagree.

Four-Step Definition Training

1

Written Definition Review

The staff member reads the operational definition, explains it in their own words, and names its parts: what the behavior looks like, when an episode starts and ends, and examples and non-examples.

2

Video Scoring Practice

You and the trainee score the same video independently, using training videos or recordings your district permits. Compare results, talk through the differences, and repeat until agreement reaches 80% or more.

3

Live Parallel Recording

Record side by side during class. Calculate IOA. If it falls below 80%, find the situations that cause disagreement and clarify the definition.

4

Maintenance Checks

Run unannounced agreement checks about once a month. Drift happens; retrain as soon as agreement drops below 80%.

Using Technology to Aggregate and Visualize Data

The right tool turns supervision from hunting for data into making decisions with it. Whatever you use, look for:

Technology Selection Criteria

Data that syncs across devices
Graphs built from the entries
Several staff recording on the same student
Role-based access controls
Offline data entry
Timestamped notes
FERPA review and a district data agreement
Export for IEP meetings and team reviews

The Weekly View: What You Need to See

A quick weekly scan of your caseload should answer these questions:

  • Which students have missing data from the past week?
  • Which targets show three consecutive data points below criterion?
  • Which staff members have the most missing entries?
  • Which behavior plans are due for review?

Running Coaching Meetings with Data

Coaching meetings should start from graphed data, not impressions. Here's one structure:

30-Minute Data-Driven Coaching Meeting

0-5 min Graph Review

Pull up graphs for the student's active targets. The staff member describes the trends they see, and you check how they read the graph.

5-15 min Problem-Solving

Focus on targets with flat or worsening trends. The staff member suggests changes; you guide the decision using the data and the behavior plan.

15-20 min Skill Building

Model or role-play one procedure from the plan. Give specific, behavioral feedback.

20-25 min Fidelity Check

Review fidelity data for the plan's key steps and address any drift. If a procedure needs to change, take it through the team's usual plan review.

25-30 min Documentation and Planning

Log the meeting. Agree on one or two tasks before the next visit and confirm when it is.

Keeping a Coaching Log

A short entry after every visit gives the team a record of what each staff member was trained on and how implementation is going. Identify students the way your district's records policy allows, such as initials or a student ID. A useful entry covers:

Entry What to Record
Date and Length When the visit happened and how long it lasted
Type of Contact Observation, coaching meeting, modeling, or group training
Staff and Role Who you worked with: para, interventionist, or teacher
Procedures Covered Which plan strategies or data procedures you trained or observed
Fidelity and Agreement Fidelity checklist score and IOA result, if you ran either
Next Steps What the staff member will practice and when you'll follow up

Credentialed Supervision Has Its Own Rules

If someone you supervise holds a BACB credential that requires ongoing supervision, or is accruing fieldwork hours toward one, the BACB sets what you must document. Use its current handbook and forms for that supervision rather than a general coaching log.

Tip: Write It Before You Leave the Building

Fill in the log during or right after the visit. Notes reconstructed weeks later miss details, and the team can't rely on them when it reviews the plan.

Training Paraprofessionals on Data Collection

Your data system is only as good as the people using it. Training up front prevents months of data no one can use.

Four-Week Data Collection Training for New Staff

Week 1: Foundations

  • Why we collect data (connect it to the student's goals and behavior plan)
  • Overview of measurement systems (frequency, duration, latency, interval)
  • Tour of the data collection tool or form
  • Practice with sample scenarios (no real students)

Week 2: Operational Definitions

  • Walk through each assigned student's target behaviors
  • Video review with definition matching
  • Non-examples and edge cases
  • Written quiz with a 90% criterion

Week 3: Parallel Recording

  • Side-by-side data collection with you
  • IOA calculation and feedback
  • Practice on the situations where you disagreed
  • Continue until agreement reaches 80% or more

Week 4 and After: Independent with Spot Checks

  • The staff member collects data independently
  • You review their data daily for the first month
  • Unannounced agreement checks twice a month after that
  • Retrain right away if agreement drops

What a Shared System Changes

As your caseload grows, a shared data system changes how your time is spent:

Less Chart Building

Graphs come from entries staff already made, so meeting prep is reading data, not charting it.

Problems Show Up Between Visits

A weekly scan shows missing entries and flat trends before you are back on that campus.

A Record the Team Can Check

Coaching notes and fidelity results sit next to the student data they explain.

School BCBA Data System Checklist

Use this checklist to evaluate your current setup or build a new one:

Data System Essentials

Data Collection

Standardization

Training

Visualization and Review

Coaching Records

Practical Example: A Multi-Campus Week

Here's how a shared data system can support a typical week for a BCBA covering several schools:

Weekly Supervision Workflow

Monday AM

Scan the data for every student on your caseload. Flag any with three or more school days of missing data or a flat or worsening trend, and message the staff involved.

Tue and Thu

Campus visits with two or three coaching meetings a day. Pull up graphs during each meeting and log the visit before you leave the building.

Wednesday

One direct observation per para on your caseload, with an agreement check and a fidelity checklist. Enter the feedback in the coaching log.

Friday PM

Write a short weekly summary. Export data for any plan reviews or IEP meetings coming up, and check the coaching log for gaps.

For the rest of the role, see the school-based BCBA supervision guide and the school BCBA caseload management guide.

Your Data Infrastructure Is Your Multiplier

Supervising staff across campuses is a systems job as much as a coaching one. With shared protocols, training to criterion and a coaching log, every para and teacher you support records data the same way, and the team has it in hand when it reviews a plan.

Start with one student or one classroom. Get the protocols right. Train to criterion. Then scale.

References

Billingsley, B. S., & Bettini, E. (2019). Special education teacher attrition and retention: A review of the literature. Review of Educational Research, 89(5), 697–744. https://doi.org/10.3102/0034654319862495

Brunsting, N. C., Bettini, E., Rock, M. L., Royer, D. J., Common, E. A., Lane, K. A., Xie, F., Chen, A., & Zeng, F. (2022). Burnout of special educators serving students with emotional-behavioral disorders: A longitudinal study. Remedial and Special Education, 43(3), 160–171. https://doi.org/10.1177/07419325211030562

Kranak, M. P., Andzik, N. R., Jones, C., & Hall, H. (2023). A systematic review of supervision research related to Board Certified Behavior Analysts. Behavior Analysis in Practice, 16(4), 1006–1021. https://doi.org/10.1007/s40617-023-00805-0

Springer, A., Marchese, N. V., & Dixon, M. R. (2024). An analysis of variables contributing to Board Certified Behavior Analyst turnover. Behavior Analysis in Practice. https://pubmed.ncbi.nlm.nih.gov/41523810/

Ruble, L. A., McGrew, J. H., Wong, W. H., & Missall, K. N. (2018). Special education teachers' perceptions and intentions toward data collection. Journal of Early Intervention, 40(2), 177–191. https://doi.org/10.1177/1053815118771391

Kearns, D. M., Feinberg, N. J., & Anderson, L. J. (2021). Implementation of data-based decision-making: Linking research from the special series to practice. Journal of Learning Disabilities, 54(5), 365–372. https://doi.org/10.1177/00222194211032403

U.S. Department of Education, Privacy Technical Assistance Center. (2015). Data governance checklist. https://studentprivacy.ed.gov/resources/data-governance-checklist

U.S. Department of Education. (2021). FERPA general guidance for parents and eligible students. https://studentprivacy.ed.gov/

Briesch, A. M., Chafouleas, S. M., & Riley-Tillman, T. C. (2016). Direct behavior rating: Linking assessment, communication, and intervention. Guilford Press.

Chafouleas, S. M., Kilgus, S. P., Riley-Tillman, T. C., Jaffery, R., Christ, T. J., Briesch, A. M., Chanese, J. A. M., & Kalymon, K. M. (2013). An evaluation of the generalizability of direct behavior rating single-item scales to measure academic engagement across raters and observations. School Psychology Review, 42(4), 407–421.

Volpe, R. J., & Briesch, A. M. (2012). Generalizability and dependability of single-item and multiple-item direct behavior rating scales for engagement and disruptive behavior. School Psychology Review, 41(3), 246–261.

Smith, T. E., Thompson, A. M., & Maynard, B. R. (2022). Self-management interventions for reducing challenging behaviors among school-age students: A systematic review. Campbell Systematic Reviews, 18(1), e1223. https://doi.org/10.1002/cl2.1223

Put This Into Practice

Turn the article into action with ready-to-use materials. Downloads stay open; emailed resources and quiz results are opt-in.

Key Takeaways

  • Shared data collection protocols reduce variability between the staff who record data
  • Operational definitions must be trained to criterion, not just handed out
  • A system that combines every collector's data replaces manual compilation
  • Coaching meetings work best when they start from graphed data, not verbal reports
  • A coaching log shows what each staff member was trained on; credentialed supervision follows the BACB's own documentation rules

Is Your Supervision Data System Scalable or Chaotic?

Find out if your data infrastructure supports your supervision across campuses or if you're drowning in spreadsheets from different planets.

5 questions~3 min

For behavior specialists

Coach Staff From the Same Data

Log the same measures across students, compare independent observer records, and review a day's team entries from one workspace.

See Classroom Pulse for School-Based BCBAs

About the Author

T
The Classroom Pulse Team
Behavior Data Specialists

Practical guides from the Classroom Pulse team for educators and behavior support teams who collect and use behavior data. Classroom Pulse was founded by Bobby Hillman, M.Ed., LBA, BCBA.

About Classroom Pulse

Get More Insights Like This

One email on Fridays with the week's new articles. Unsubscribe anytime.

Stay updated with behavior tracking tips. Unsubscribe anytime. Privacy Policy.