Matrix 5: Evaluation of Effectiveness of AT

Quality Indicator1 Unacceptable2345 Promising Practices
1. Team members share clearly defined responsibilities to ensure that data are collected, evaluated, and interpreted by capable and credible team members. Responsibilities for data collection, evaluation, or interpretation are not defined.Responsibilities for data collection, evaluation, or interpretation of data are assigned to one team member. Responsibilities for collection, evaluation and interpretation of data are shared by some team members.Responsibilities for collection, evaluation and interpretation of data are shared by most team members.Responsibilities for collection, evaluation and interpretation of data are consistently shared by team members.
2. Data are collected on specific student achievement that has been identified by the team and is related to one or more goals.Team neither identifies specific changes in student behaviors expected from AT use nor collects data.Team identifies student behaviors and collects data, but the behaviors are either not specific or not related to IEP goal(s).Team identifies specific student behaviors related to IEP goals, but inconsistently collects data.Team identifies specific student behaviors related to IEP goals, and generally collects data.Team identifies specific student behaviors related to IEP goals, and consistently collects data on changes in those behaviors.
3. Evaluation of effectiveness includes the quantitative and qualitative measurement of changes in the student’s performance and achievement.Effectiveness is not evaluated.Evaluation of effectiveness is not based on student performance, but rather on subjective opinion.Evaluation of effectiveness is not consistent or is based on limited data about student performance.Evaluation of effectiveness is generally based on quantitative and qualitative data about student performance from a few sources.Effectiveness is consistently evaluated using both quantitative and qualitative data about student’s performance obtained from a variety of sources.
4. Effectiveness is evaluated across environments including during naturally occurring opportunities as well as structured activities.Effectiveness is not evaluated in any environment.Effectiveness is evaluated only during structured opportunities in controlled environments(e.g. massed trials data).Effectiveness is evaluated during structured activities across environments and a few naturally occurring opportunities.Effectiveness is generally evaluated during naturally occurring opportunities and structured activities in multiple environments.Effectiveness is consistently evaluated during naturally occurring opportunities and structured activities in multiple environments.
5. Data are collected to provide teams with a means for analyzing student achievement and identifying supports and barriers that influence AT use to determine what changes, if any, are needed.No data are collected or analyzed. Data are collected but are not analyzed.Data are superficially analyzed.Data are sufficiently analyzed most of the time. Data are sufficiently analyzed all of the time.
6. Changes are made in the student’s AT services and educational program when evaluation data indicate that such changes are needed to improve student achievement.Program changes are never made.Program changes are made in the absence of data. Program changes are loosely linked to student performance data.Program changes are generally linked to student performance data.Program changes are consistently linked to student performance data.
7. Evaluation of effectiveness is a dynamic, responsive, ongoing process that is reviewed periodically. No process is used to evaluate effectiveness. Evaluation of effectiveness only takes place annually, but the team does not make program changes based on data.Evaluation of effectiveness only takes place annually and the team uses the data to make annual program changes.Evaluation of effectiveness takes place on an on-going basis and team generally uses the data to make program changes.Evaluation of effectiveness takes place on an on-going basis and the team consistently uses the data to make program changes.