By Michael Deshotels | Originally Published at Lousiana Educator. May 21, 2015
The national news media has been reporting for several years now that the “portfolio” of charter schools created to run the state takeover schools in New Orleans have produced an amazing turnaround of those schools in the ten years since hurricane Katrina demolished the public schools in New Orleans. We see claims that most of the takeover schools are no longer failing and that the graduation rate has improved dramatically, and that the improved performance of the RSD students has greatly exceeded that of more traditional schools across Louisiana and across the nation. The charter school proponents seem to be claiming that poverty can no longer be used as an excuse for poor academic performance. They believe, or would have us believe, that the New Orleans RSD has found the secret to closing the achievement gap between impoverished, at-risk minority students and more advantaged middle class students.
This report is an attempt to simply examine the relevant data that can be used to measure academic success of the New Orleans Recovery District. It will attempt to measure how the RSD compares to traditional public schools. What does the data tell us? Is it Reform Success or Reform Hype?

Is the Comparison Really Complicated?

Some education researchers on this topic have agonized over the fact that the Louisiana school rating system has changed so much in recent years that it is difficult to compare apples to apples. Also, the RSD has closed and renamed so many schools in New Orleans that it is almost impossible to trace the progress of any particular school. The test scores of RSD students on the Louisiana LEAP and iLEAP tests seem to have significantly improved, but so have the scores for the students in traditional schools throughout Louisiana. So, is there a still a method that will really compare the RSD schools to the traditional schools in Louisiana and possibly to other schools across the nation?
Unfortunately for comparison of student performance, the state test results in Louisiana have been manipulated so that they no longer measure the same level of proficiency as they did ten years ago. There appears to have been significant grade inflation of test results over the past ten years that have nothing to do with improvement in student achievement. Some of the grade inflation has come from familiarity of educators and students with the state test, so that students can score higher without significantly improving their math and reading skills. The rest of the grade inflation comes from a general lowering of the raw cut scores documented in this blog for the rating of “Basic” which in Louisiana is considered to be grade level performance. Not only have the state test results been manipulated by lowering many of the raw cut scores, the ratio of difficult to easy questions on the test can be changed from year to year also changing apparent performance.
So how much inflation has occurred in the state testing? The testing inflation can be estimated by comparing the average test results of Louisiana students as measured by the National Assessment of Education Progress (NAEP) with the results of the state designed LEAP and iLEAP tests. In the last ten years, analysis shows that according to state tests, approximately 11 percent more students statewide were deemed to be on grade level (scored basic or above) than ten years ago. But at the same time, the NAEP test shows that only 3 percent more students advanced to basic. That difference and the simultaneous softening in the Louisiana formula for assigning grades to schools (bonus points for subgroups) have resulted in more and more schools appearing to have made dramatic progress in the last ten years. That dramatic “faux progress” includes the New Orleans RSD charter schools.
Graduation rates have improved statewide, and ACT scores are up slightly across the state. So how can we use these statistics to compare the RSD to the rest of the state and to schools nationwide?
There are three simple criteria that may be used to compare student performance between the RSD, state traditional schools, and schools in other states.
The answer to comparison of student performance in Louisiana is really quite simple and does not require complex calculations. First a little history:
The narrative by the charter school proponents is that prior to Hurricane Katrina, the school system in New Orleans was failing miserably. There was graft and corruption by school managers, and most students were empathyeducates - New Orleans RSD Compared to Traditional Schools: