Evaluation of Special Education Teacher Candidates through Direct Observations and Self-Report
Evaluation of the Teacher Rating and Assessment Instrument for Teachers of Students with Significant Disabilities (TRAIT-SD) was used to measure the impact of an educator preparation program for graduate students who were special education teachers of students with significant disabilities who were master’s degree students in a federally funded graduate program participated in this study. Additionally, the correlation of the overall TRAIT-SD scores with the Survey of Practices of Teachers of Students with Significant Disabilities (SPOTS-SD) scores was evaluated. Finally, the interrater agreement between the primary observer and a secondary observer in order to better assure the objectivity of TRAIT-SD observations was evaluated. Results of the ratings on the TRAIT-SD and SPOTS-SD showed significant gains made by the graduate students on teaching skills. Interrater agreement was also examined for 11 of the 44 pre- and post-intervention observations. TRAIT-SD is an instrument that can be used to evaluate the strengths and areas of development for graduate students teaching students with significant disabilities. It can also be used to evaluate the strengths and areas needed for improvement in an educator preparation program for teacher candidates of students with significant disabilities.
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standards for educational and psychological testing. https://www.testingstandards.net/uploads/7/6/6/4/76643089/standards_2014edition.pdf
Browder, D. M., Wood, L., Thompson, J., & Ribuffo, C. (2014). Evidence-based practices for students with severe disabilities (Document No. IC-3). University of Florida, Collaboration for Effective Educator, Development, Accountability, and Reform Center. http://ceedar.education.ufl.edu/tools/innovation-configurations/
Brownell, M. T., Steinbrecher, T., Kimerling, J., Park, Y., Bae, J., & Benedict, A. (2014). Dimensions of teacher quality in general and special education. In P. Sindelar, E. McCray, M. T. Brownell, & B. Lignugaris-Kraft (Eds.), Handbook of research on special education teacher preparation (pp. 423–444). Routledge.
Cohen, J. (1992). Statistical power analysis. Current Directions in Psychological Science, 1(3), 98 – 101. https://doi.org/10.1111/1467-8721.ep10768783
Council for Exceptional Children (CEC). (2013). The Council for Exceptional Children’s position statement on special education teacher evaluation. Teaching Exceptional Children, 45(3), 73 – 76. https://doi.org/10.1177/004005991304500308
Council for the Accreditation of Educator Preparation. (2022). 2022 CAEP Standards. http://caepnet.org/standards/2022-itp/introduction
Danielson, C. (2013). The framework for teaching evaluation instrument. 2013 edition. http://www.loccsd.ca/~div15/wp-content/uploads/2015/09/2013-framework-for-teaching-evaluation-instrument.pdf
DATAtab Team (2024). DATAtab: Online statistics calculator. DATAtab e.U. Graz, Austria. https://datatab.net
Elsevier, B.V. (2022). Wilcoxon signed-ranks test. ScienceDirect. https://www.sciencedirect.com/topics/medicine-and-dentistry/wilcoxon-signed-ranks-test
Grisham-Brown, J., & Collins, B. C. (2002). Training rural educators in Kentucky through distance learning: Impact with follow-up data. Rural Special Education Quarterly, 21(4), 12 – 20. https://doi.org/10/1177/875687050202100403
Johnson, E. S., Crawford, A. R., Zheng, Y., & Moylan, L. A. (2021). Does special educator effectiveness vary depending on the observation instrument used? Educational Measurement: Issues and Practice, 40(1), 36 – 43. https://doi.org/10.1111/emip.12394
National Council on Teacher Quality. (2019). State of the states 2019: Teacher and principal evaluation policy. https://www.nctq.org/dmsView/NCTQ_State_of_the_States_2019_print_ready
North Carolina Department of Public Instruction (n.d.). North Carolina Educator Effectiveness System. https://www.dpi.nc.gov/educators/home-base/nc-educator-effectiveness-system-ncees
Pearson Education (2024). About edTPA. edTPA. https://www.edtpa.com/PageView.aspx?f=GEN_AboutEdTPA.html
Pennington, R. (2018). ALCOT: Autism and Low Incidence Classroom Observation Tool. The Attainment Company.
Pennington, R., & Travers, J. (2024). Telos of Special Education for Students with Severe Disabilities. Exceptionality, 32(2), 131 – 144. https://doi.org/10.1080/09362835.2024.2301824
Pua, D. J., Peyton, D. J., Brownell, M. T., Contesse, V. A., & Jones, N. D. (2020). Preservice observation in special education: A validation study. Journal of Learning Disabilities, 54(1), 6 – 19. https://doi.org/10.1177/0022219420920382
Siegel, S., & Castellan, N. J., Jr. (1988). The case of one sample, two measures of paired replicates. (p 87-94). In S. Siegel & N. J. Castellan, Jr., Nonparametric statistics for the behavioral sciences (2nd ed.). McGraw-Hill.
Stangroom, J. (2024a). The Wilcoxon Signed-Ranks Test Calculator. Social Science Statistics. https://www.socscistatistics.com/tests/signedranks/default.aspx
Stangroom, J. (2024b). Spearman's Rho Calculator. Social Science Statistics. https://www.socscistatistics.com/tests/spearman/default.aspx
Statistics Kingdom (2017). Correlation Confidence Interval Calculator. https://www.statskingdom.com/correlation-confidence-interval-calculator.html
Wei, R. C., & Pecheone, R. L. (2010). Assessment for learning in preservice teacher education: Performance-based assessments. In M. M. Kennedy (Ed.) Teacher assessment and the quest for teacher quality: A handbook. Jossey-Bass. https://scale.stanford.edu/sites/g/files/sbiybj14851/f/weipecheone.pdf
Westling, D. L., Carter, E. W., Da Fonte, A., & Kurth, J. (2021). Teaching students with severe disabilities (6th ed.). Pearson.
Westling, D. & Cooper-Duffy, K. (2013). Survey of practices of teachers of students with severe
disabilities. [Unpublished manuscript]. Special Education, Western Carolina University.
Westling, D., & Cooper-Duffy, K. (2019). Teacher rating and assessment instrument for teachers of students with significant disabilities. [Unpublished manuscript]. Special Education, Western Carolina University.
Westling, D. L., Cooper-Duffy, K., Fisher, L. B., & Kennedy, S. (2022). Evaluating the performance of teachers of students with significant disabilities: Development and use of the TRAIT-SD. Education and Training in Autism and Developmental Disabilities, 57(4), 462 – 481. https://doi.org/10.1177/215416472205700409
Westling, D. L., Cooper-Duffy, K., & Huggins-Manley, A. C. (2024). Assessing the performance of teachers of students with significant disabilities: Establishing content validity for the TRAIT-SD. Teacher Education and Special Education, 47(2), 142 – 160. https://doi.org/10.1177/08884064241234324
Westling, D. L., Salzberg, C., Collins, B. C., Morgan, R., & Knight, V. (2014). Research on the preparation of teachers of students with severe disabilities. In P. T. Sindelar, E. D. McCray, M. T. Brownell, & B. Lignugaris/Kraft (Eds.), Handbook of research on special education teacher preparation (pp. 305 – 319). Routledge.
