1	Conversations About Accountability: Special Educators’ Views on the Impact of State Testing Programs Lisa M. Abrams, PhD Virginia Commonwealth University March 17, 2005
2	Presentation Overview Purpose of the Study Background on test-based accountability Summary of extant research Data collection & analysis Findings Conclusions
3	Purpose of the Study Explore the impact of state-testing programs on the teaching of students with disabilities. Impact much less-understood for students with disabilities Current state-testing programs designed without students with disabilities in mind
4	Test-Based Accountability Systems (1) Current landscape: Reflects a shift from basic skills to higher academic expectations Includes accountability mechanisms to motivate change Reform Model: Content standards Tests Performance targets Incentives
5	Test-Based Accountability Systems (2) Two-tiered system: state and federal policies Federal policy-No Child Left Behind Act Requires: Achievement testing in reading, math and science for all students in grades 3-8, and 1 year in high school All students reach “proficiency” by 2014 States, districts and schools meet “Adequate Yearly Progress” goals Affects current special education policy; reflect emphasis on access, participation, and outcomes
6	What does Ed Reform mean for Students with Disabilities? Compliance w/IDEA: inclusion and access to the general curriculum States must: Document participation and performance of SPED students on large scale assessments. Provide for participation by allowing for accommodations and alternative assessments. Report on their performance in the same detail and frequency as general education students.
7	Impact of Testing on the Educational Process Positive outcomes: Greater emphasis on professional development and support Standards provide clarity and focus Test results provide useful information Increased emphasis on problem solving, writing across the curriculum Negative outcomes: Focus on tested content can lead to a narrowing of curriculum Increased time spent on test preparation Increased frustration, stress, and anxiety for students Undermine professional efficacy of teachers
8	Research Questions How special education teachers perceive the impact of state-mandated testing programs on… … the educational experiences of students with disabilities? …their own professional experiences? How do these perceptions differ from those held by general education teachers?
9	Data Collection Subset of a larger interview study 32 semi-structured interviews; conducted between 2000-2002 in three states 10-11 interviews with special educators per state Each state had a different type of accountability system
10	Interview Topics Standards Content Instruction Assessment Students Use of test results
11	Data Analysis Inductive & deductive process Codes were generated and applied to transcriptions using HyperResearch software Code frequencies were used to identify key themes
12	Views on State Standards One-half to 3/4 ranged from neutral to positive Greater consistency, more focus Increased attention on critical-thinking skills More interaction between special and general education. Opinions were dependent on the extent of students’ disabilities. For my kids who can fit into an inclusive classroom…those standards are expectations for them and their parents about what real life is all about…For my other children, who are severely disabled…those standards don’t mean anything to them. Nothing. We’re basically worried about their getting through the day. Do they know their address and phone number? Can they take care of themselves? (MI elementary SPED teacher) Before ed reform, the inclusive piece was definitely not there and kids were quickly referred out [of the regular classroom]. And thank god that’s changed. Ed reform has just really encouraged things to mesh together…its great and its also helped the special ed teachers to become more award of what the curriculum is all about. (MA elementary SPED teacher)
13	Views on Accountability Dependent on stakes attached to testing program. More positive in KS than in MA. Positive views-inclusion, shared sense of responsibility Negative views-testing process, developmental appropriateness of the test Before [special ed students were included in the state assessment], we didn’t really have a sense of accountability…now I am aware that we need to get our students ready in those areas…I think it is good because the students, when they know that other kids are being tested…they wonder ‘why can’t we be taking this test also?” Now that they can take it, I think it helps them…in their mindset because they want to be like everyone else. (KS middle school SPED teacher) It [MCAS] doesn’t do anything but make the person or school that didn’t do well feel lousy…if you’re born an apple, you’re going be an apple, if you’re born an orange. You’re going to be an orange. We can’t all be Einsteins and that’s okay. We don’t have to compete to achieve…what makes the hierarchy think that there is going to be a successful generation coming up if they pass the MCAS, and what are they going to do with the kids who don’t pass? (MA elementary school SPED teacher)
14	Views on the Test Main concern is the test is developmentally inappropriate Test scores are not a valid indicator of special ed students’ achievement-they may know the information but can’t take the test. For special education students, the impact of the test is negative; mainly because they are not taught at the grade level that they are tested. The students cannot read the test by themselves...they are frustrated, so they either do nothing or bubble in anything. (MI Middle School SPED teacher)
15	Impact on Classroom Practices Need to make instruction choices about teaching content or basic skills Maintained a balanced/mixed view; recognized the positive and negative effects It is necessary to expose them to a lot more information because they will be tested on it. You tradeoff instruction in the skills that they are lacking with instruction in the things you know they are going to see on the test. They do become exposed to and aware of, not necessarily proficient at, a wider range of information…but you are also taking time away from instruction in [basic] skills that they don’t have…whether they never really understood a vowel sound or they never really understood subtraction or whatever the skills are that they didn’t pick up at the right time…you lose out on time for intensive instruction in skill areas that they need in order to do broader based instruction and test preparation. So, there are positives and negatives. (KS, elementary school SPED teacher)
16	Impact on IEP Process Concern that IEP objectives are not aligned w/state testing requirements Comment on expanding the academic scope of the IEP process to meet demands of tested grade levels. The objectives of the state test do not correlate well at all with special education students’ IEP objectives. If I have a fourth grade student who is at a first grade reading level, making him take the fourth grade reading test is counterproductive to say the least. (MI elementary school SPED teachers) I know when I’m writing an IEP for a 3^rd grader, I’m always thinking about what they are going to be doing at the 4^th grade. We want to be sure to get in the IEP all of the accommodations that can be made because they are going to be hit very hard in the 4^th grade…[where] they need to be within that regular classroom, and you provide support there instead of having a small group because there’s just so much application and they need to hear what the other kids are saying. (KS elementary school SPED teacher)
17	Impact on Students More negative student effects reported in MA than in KS and MI: Labeled as failures Concerns about dropping out MA also reported more parental concerns than other states A lot of these students have a history of failing. I think they just see the MCAS as one more blow…knock them down one more time. (MA high school SPED teacher) I don’t think we do them any favors for the sake of that high school diploma. For most of my students, they are not going to pass the MCAS, and its been a devastating experience for them because they have a feeling of hopelessness. (MA high school SPED teacher) I listen to 9^th graders…these kids are 14 years old and they say I’ll never pass so I might as well quit school…It sends the wrong message to kids. That because you have learning disabilities, you don’t count. You are not valuable in society. (MA high school SPED teacher)
18	Conclusions and Implications Similar influences on classroom practices and professional experiences for special and general educators Unique challenges for SpEd teachers SpEd teachers more likely to perceive negative effects on students Achieving goals of special education policy
19	For additional information: See Clark, M. et al. (2003). Perceived effects of state-mandated testing programs on teaching and learning: Findings from interviews with educators in low-, medium-, and high-stakes states. Chestnut Hill, MA: National Board on Educational Testing and Public Policy, Boston College. Above report can be accessed at http://www.bc.edu/research/nbetpp/