In: Georgia Milestones (standardized test)---Out: CRCT---In: TKES---Out: Standardized Tests for Evaluating Teacher's Effectiveness for Student Achievement

The use of the standardized test that was to judge Georgia teachers' effectiveness on student achievement and therefore contribute significantly to the calculation for the Teacher Keys Effectiveness System, and ultimately the teachers' annual TEM score, is on hold - at least for one year.

Look at the article reporting on the State School Superintendent's thoughts here: AJC

Testing: Saying there is an overemphasis on test scores, Woods added, “We must aggressively lessen this burden.” He also wants a longer moratorium on using scores from the new Georgia Milestones k-12 tests, which roll out this year, to retain children or evaluate effective teaching. 

We were also presented with this update at our school.

(Sorry for the educational alphabet soup, but...)  

As I understand it; start out: Annual TEM score for teachers calculated through the TKES process which is composed of three parts: 1) calculations of student achievement gains determined through teacher-generated SLOs or standardized test results, 2) teachers receiving scores (1-4) on the 10 Standards and 72 Elements outlined in TAPS, and 3) student survey results.

Not even 12 months into the system, currently: 1) student achievement gains from SLOs thrown out [research indicates SLOs can be considered neither valid or reliable], 2) student achievement gains from standardized tests thrown out [my understanding: GA Milestone tests have not even been field tested for validity and reliability].  I would not be surprised if the TEM is thrown out before the end of the school year; that would leave TAPS and the student survey results.  I'd vote for keeping the TAPS only....

This is important, but it won't matter...

If you have read the previous blogs, you should notice that there are practical, real concerns in developing and administering the S.L.O.s (student learning objectives) as part of the new Georgia TKES (Teacher Keys Effectiveness System).  If you haven't read them, please take a moment to do that now....  I'll wait....  Researchers have now compiled evidence that should be taken notice by those in charge (although it is too late for that).  The following statements are from a recent article released by the IES (Institute of Education Sciences); if you haven't signed up for their automatic e-mail notices, you should - it's good stuff - it's the real deal.  I have put a copy of this article in my TKES/TAPS notebook (a picture of my notebook can be seen in a previous blog).

So, from: Gill, B., English, B., Furgeson, J., & McCullough, M. (2014).  Alternative student growth measures for teacher evaluation: Profiles of early-adoption districts.  (REL 2014-016).  Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Mid-Atlantic.  Retrieved from http://ies.ed.gov/ncee/edlabs:

SLOs can be used for teacher evaluation in any grade or subject, but require substantial effort by teachers and principals, and ensuring consistency is challenging [emphasis added].

Use of alternative growth measures that do not depend on state assessments is recent, and little is known about their validity and reliability [emphasis added] or about how they are being used. 

I have subtly raised concerns about the reliability of our SLOs - it is assumed that the teacher will provide a substantial performance task(s) (based on the end of the year expectations) that will show student growth, but because of time limitations, lack of preparation, lack of knowledge, etc., it is conceivable that it may not have happened - it is an unknown variable.  Thus, to me, the reliability of our SLOs is in question....

I have an excellent article, but it is in my TKES/TAPS notebook at school; I'll bring it home and give you the information soon.  The researchers show that SLOs really shouldn't be used in teacher evaluations at all....  It is from the same research institute.

If you have comments or questions, let me know....  gcason123@gmail.com; online portfolio is: https://sites.google.com/site/gcason123/

Measuring Student growth using student learning objectives

Student Learning Objective (SLO)

This quote is from:
Gill, B., Bruch, J., & Booker, K. (2013). Using alternative student growth measures for evaluating teacher performance: what the literature says. (REL 2013-002). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory Mid-Atlantic Retrieved from http://ies.ed.gov/ncee/edlabs.

"Until some of the research gaps are filled, districts that intend to use SLOs may want to roll them out for instructional planning before using them in high-stakes teacher evaluations.  Several students found teacher concerns about fairness in SLO implementation.  This is no surprise, because SLOs are difficult to make valid and reliable.  They are by definition customized to individual teachers and based on the professional judgments of teachers and principals.  Making SLOs an important component of high-stakes evaluation could undermine their validity, because it means that teachers are in essence grading themselves."  (p. ii).

Interesting....