From Knowledge to Application: Effects of Performance Feedback and Goal-Setting on Pre-Service Teacher Implementation of Evidence-Based Practice

Authors

  • Caitlin J. Criss, Ph.D. (Author) Georgia Southern University image/svg+xml
    Dr. Caitlin Criss is an Assistant Professor in the Elementary and Special Education department at Georgia Southern University. Her research interests include increasing teachers' use of positive-based classroom management practices, performance feedback with technology, and effective reading interventions for students with disabilities. This research agenda is developed through a strong relationship with K-12 partnerships, administrators, and teachers.
  • Stephanie M. Devine, Ph.D. (Author) Georgia Southern University
    Dr. Stephanie M. Devine is an Associate Professor of Special Education in the Department of Elementary and Special Education at Georgia Southern University. Dr. Devine is also the Executive Director of EAGLE Academy at Georgia Southern, which is an inclusive postsecondary education program for young adults with intellectual and developmental disability. Her research focuses on preservice and in-service teacher preparation; the use of Universal Design for Learning, technology, and peer mentors to support successful postsecondary transition; and competitive integrated employment for individuals with intellectual and developmental disability.
  • Cynthia C. Massey, Ph.D. (Author) Georgia Southern University
    Dr. Cynthia Massey is an Assistant Professor of Special Education at Georgia Southern University. She has 27 years of experience in the field of special education, with 22 of those dedicated to K-12 teaching. Her current research focuses on best practices within educator preparation programs, including evidence-based methods and the efficacy of instructional technology. This blend of hands-on experience and scholarly research contributes to a distinctive approach in special education.
https://doi.org/10.64546/jaasep.547
Teacher implementation of evidence-based practices (EBPs) is critical for student success, yet a gap remains between research to practice. Two EBPs that specifically promote student engagement and positive behavior are specific praise (BSP) and active student responding (OTR). Unfortunately, many classroom teachers, specifically pre-service teachers, struggle with implementing EBPs. While the caseload demands continue to increase for university field supervisors, educator preparation programs are tasked with finding effective and efficient ways to provide feedback to pre-service teachers. The purpose of this study was to evaluate the effectiveness of written performance feedback and goal setting on increasing evidence-based classroom management practices with special education pre-service teachers. Using a single-case multiple probe design, researchers found that all pre-service teachers increased their rate of BSP and OTR after receiving performance feedback with and without goal setting by email. Results from social validity, limitations, and directions for future research are also discussed.

Briere, D. E., Simonsen, B., Sugai, G., Myers, D., (2015). Increasing new teachers’ specific praise using a within-school consultation intervention. Journal of Positive Behavior Interventions, 17(1), 50-60. https://doi.org/10.1177/1098300713497098 DOI: https://doi.org/10.1177/1098300713497098

Common, E. A., Lane, K. L., Cantwell, E. D., Brunsting, N. C., Oakes, W. P., Germer, K. A., & Bross, L. A. (2020). Teacher-delivered strategies to increase students’ opportunities to respond: A systematic methodological review. Behavioral Disorders, 45(2), 67-84. https://doi.org/10.1177/0198742919828310 DOI: https://doi.org/10.1177/0198742919828310

Cook, B. G., Cook, S. C., & Collins, L. W. (2016). Terminology and evidence-based practice for students with emotional and behavioral disorders: Exploring some devilish details. Beyond Behavior, 25(2), 4-13. https://doi.org/10.1177/107429561602500202 DOI: https://doi.org/10.1177/107429561602500202

Cooper, J. O., Heron, T. E., & Heward, W. L. (2020). Applied behavior analysis (3rd ed.). Pearson.

Council for Exceptional Children. (1989). Academy for effective instruction: Working with mildly handicapped students. Teaching Exceptional Children, 22(1), 66. https://doi.org/10.1177/004005998902200117 DOI: https://doi.org/10.1177/004005998902200117

Criss, C. J., Konrad, M., Alber-Morgan, S.R. et al. A Systematic Review of Goal Setting and Performance Feedback to Improve Teacher Practice. J Behav Educ (2022). https://doi.org/10.1007/s10864-022-09494-1 DOI: https://doi.org/10.1007/s10864-022-09494-1

Criss, C. J., Konrad, M., Alber-Morgan, S.R., Brock, M. E., & Harris, A. B. (2023). Using performance feedback with and without goal setting on teachers’ classroom management skills. Behavioral Disorders. Advance online publication. https://doi.org/10.1177/01987429231201096 DOI: https://doi.org/10.1177/01987429231201096

Ennis, R. P., Royer, D. J., Lane, K. L., & Dunlap, K. D. (2019). Behavior-specific praise in PK-12 Setting: Mapping the 50-year knowledge base. Behavioral Disorders, 45(3), 1-17. https://doi.org/10.1177/0198742919843075 DOI: https://doi.org/10.1177/0198742919843075

Ennis, R. P., Royer, D. J., Lane, K. L., & Dunlap, K. D. (2020). The impact of coaching on teacher-delivered behavior-specific praise in pre-K-12 setting: A systematic review. Behavioral Disorder, 45(3), 1-19. https://doi.org/10.1177/0198742919839221 DOI: https://doi.org/10.1177/0198742919839221

Fallon, L. M., Collier-Meek, M. A., Maggin, D. M., Sanetti, L. M., & Johnson, A. H. (2015). Is performance feedback for educators an evidence-based practice? A systematic review and evaluation based on single-case research. Exceptional Children, 81(2), 227–246. https://doi.org/10.1177/0014402914551738 DOI: https://doi.org/10.1177/0014402914551738

Floress, M. T., Jenkins, L. N., Reinke, W. M., & McKown, L. (2018). General education teachers’ natural rates of praise: A preliminary investigation. Behavioral Disorders, 43(4), 411–422. https://doi.org/10.1177/0198742917709472 DOI: https://doi.org/10.1177/0198742917709472

Floress, M. T., Riedesel, E. K., Brito, C. F., & White, J. D. (2022). Middle and high school teachers’ praise and reprimand delivery. School Psychology, 37(1), 15–25. https://doi.org/10.1037/spq0000482 DOI: https://doi.org/10.1037/spq0000482

Freeman, J., Simonsen, B., & Briere, D. E., (2014). Pre-service teacher training in classroom Gage, N. A., & MacSuga-Gage, A. S. (2017). Salient classroom management skills: Finding the most effective skills to increase student engagement and decrease disruptions. Report on Emotional & Behavioral Disorders in Youth, 17, 19–24.

Kennedy, M. J., Hirsch, S. E., Rodgers, W. J., Bruce, A., & Lloyd, J. W. (2017). Supporting high school teachers' implementation of evidence-based classroom management practices. Teaching and Teacher Education, 63, 47–57. https://doi.org/10.1016/j.tate.2016.12.009 DOI: https://doi.org/10.1016/j.tate.2016.12.009

Kirkpatrick, M., Akers, J., & Rivera, G. (2019). Use of behavioral skills training with teachers: A systematic review. Journal of Behavioral Education, 28(3), 344–361. DOI: https://doi.org/10.1007/s10864-019-09322-z

MacSuga-Gage, A. S., & Simonsen, B. (2015). Examining the effects of teacher-directed opportunities to respond on student outcomes: A systematic review of the literature. Education and Treatment of Children, 38(2), 211–240. https://www.jstor.org/stable/44683954 DOI: https://doi.org/10.1353/etc.2015.0009

Martens, B. K., Witt, J. C., Elliott, S. N., & Darveaux, D. X. (1985). Teacher judgments concerning the acceptability of school-based interventions. Professional Psychology: Research and Practice, 16(2), 191–198.https://doi.org/10.1037/0735-7028.16.2.191 DOI: https://doi.org/10.1037//0735-7028.16.2.191

McLeod, R. H., Kim, S., & Resua, K. A. (2019). The effects of coaching with video and email feedback on pre-service teachers’ use of recommended practices. Topics in Early Childhood Special Education, 38(4), 192–203. https://doi.org/10.1177/0271121418763531 DOI: https://doi.org/10.1177/0271121418763531

Parker, R. I., Vannest, K. J., Davis, J. L., & Sauber, S. B. (2011). Combining nonoverlap and trend for single-case research: Tau-U. Behavior Therapy, 42(2), 284-299. DOI: https://doi.org/10.1016/j.beth.2010.08.006

Pas, E. T., Cash, A. H., O’Brennan, L., Debnam, K. J., & Bradshaw, C. P. (2015). Profiles of classroom behavior in high schools: Associations with teacher behavior management strategies and classroom composition. Journal of School Psychology, 53(2), 137–148. https://doi.org/10.1016/j.jsp.2014.12.005 DOI: https://doi.org/10.1016/j.jsp.2014.12.005

Reinke, W. M., Lewis-Palmer, T., & Merrell, K. (2008). The classroom check-up: A classwide teacher consultation model for increasing praise and decreasing disruptive behavior. School Psychology Review, 37(3), 315–332. https://doi.org/10.1080/02796015.2008.12087879 DOI: https://doi.org/10.1080/02796015.2008.12087879

Riley-Tillman, T.C. & Burns, M.K. (2009). Introduction to design and analysis for educational interventions. In Evaluating educational interventions: Single-case design for measuring response to intervention (pp. 1-12). New York: Guilford Press.

Rosenshine, Schles, R. A., & Robertson, R. E. (2017). The role of performance feedback and implementation of evidence-based practices for preservice special education teachers and student outcomes: A review of the literature. Teacher Education and Special Education, 42(1), 36-48. https://doi.org/10.1177/0888406417736571 DOI: https://doi.org/10.1177/0888406417736571

Scott, L. A., Gentry, R., & Phillips, M. (2014). Making preservice teachers better: Examining the impact of a practicum in a teacher preparation program. Educational Research and Reviews, 9(10), 294–301. https://doi.org/10.5897/ERR2014.1748 DOI: https://doi.org/10.5897/ERR2014.1748

Simonsen, B., Fairbanks, S., Briesch, A., Myers, D., & Sugai, G. (2008). Evidence-based practices in classroom management: Considerations for research to practice. Education and Treatment of Children, 31(3), 351–380. https://www.jstor.org/stable/42899983 DOI: https://doi.org/10.1353/etc.0.0007

Simonsen, B., Freeman, J., Dooley, K., Maddock, E., Kern, L., & Myers, D. (2017). Effects of targeted professional development on teachers’ specific praise rates. Journal of Positive Behavior Interventions, 19(1), 37–47. https://doi.org/10.1177/1098300716637192 DOI: https://doi.org/10.1177/1098300716637192

Sleiman, A. A., Aud Elnes, S. S., Gage, N. A., & Gravina, N. E. (2020) A quantitative review of performance feedback in organizational settings (1998-2018), Journal of Organizational Behavior Management, 40(3-4), 303–332. https://doi.org/10.1080/01608061.2020.1823300 DOI: https://doi.org/10.1080/01608061.2020.1823300

Sutherland, K. S., Adler, N., & Gunter, P. L. (2003). The effects of varying rates of opportunities to respond to academic requests on the classroom behavior of students with EBD. Journal of Emotional and Behavioral Disorders, 11(4), 239–248. https://doi.org/10.1177/10634266030110040501 DOI: https://doi.org/10.1177/10634266030110040501

Vannest, K. J., & Ninci, J. (2015). Evaluating intervention effects in single-case research designs. Journal of Counseling & Development, 93(4), 403–412. doi:10.1002/jcad.12038 DOI: https://doi.org/10.1002/jcad.12038

Vannest, K. J., Parker, R. I., Gonen, O., & Adiguzel, T. (2016). Single case research: Web-based calculators for SCR analysis (Version 2.0) [Web-based application]. College Station, TX: Texas A & M University. Available from singlecaseresearch.org.

Zoder-Martell, K. A., Floress, M. T., Bernas, R. S., Dufrene, B. A., & Foulks, S. L. (2019). Training teachers to increase behavior-specific praise: A meta-analysis. Journal of Applied School Psychology, 35(4), 309–338. https://doi.org/10.1080/15377903.2019.1587802 DOI: https://doi.org/10.1080/15377903.2019.1587802

There are 31 references in total.
Criss, C. J., Devine, S. M., & Massey, C. C. (2024). From Knowledge to Application: Effects of Performance Feedback and Goal-Setting on Pre-Service Teacher Implementation of Evidence-Based Practice. Journal of the American Academy of Special Education Professionals, 19(2), 8-25. https://doi.org/10.64546/jaasep.547

Downloads

Article Information

  • Article Type Articles
  • Submitted May 7, 2024
  • Published June 15, 2024
  • Issue Spring/Summer 2024
  • Section Articles
  • File Downloads 0
  • Abstract Views 2
  • Altmetrics
  • Share
Download data is not yet available.