The purpose of this report, prepared by Bill Courtney of Save Our Schools NZ, is to document several matters relating to the various quantitative measures that have been used to report student achievement in the charter secondary schools, across both 2014 and 2015.
The main observation is that, in respect of 2014 achievement, the performance standard originally set out in the charter school Agreement, the Ministry’s interpretation of this, the achievement reported by the schools and the reported achievement in the Ministry’s publicly available database, Education Counts, are all different! (See Reporting Summary table on p. 2 of full report)
One of the most significant implications of these differences in interpretation is that, on the recommendation of the Ministry, the Minister approved the release of the 1% operational funding retention amount, relating to the 2014 year, for both Vanguard and Paraoa. However, Vanguard did not meet its NCEA L2 Target and Paraoa did not meet either its Level 1 or Level 2 Target.
In July 2016, the Ministry finally acknowledged that there were “issues” related to the current NCEA performance standards as being applied to charter schools. This admission raises serious concerns about the mantra underpinning the charter school approach, which is described as: “Rigorous accountability against clearly agreed objectives.”
In a paper to the Minister, it recommended a new set of performance standards be utilised in the Third Round contracts that were signed in August 2016. These will use two new roll-based NCEA pass rate measures along with a clearly stated “School Leaver” measure, calculated in the normal manner.
However, the same paper redacted the sections referring to “Next Steps” that might suggest how the Ministry is going to evaluate the performance of the existing First and Second Round schools on an on-going basis.
At time of writing, the Ministry has published its initial analysis of the schools relating to the 2015 year using what it has described as the “current” interpretation of the performance measures. But it had not yet made any recommendations regarding the 1% retention amounts for 2015.
In order to provide a more comprehensive overview of performance, I have included in the full report data from the Education Counts system-wide data spreadsheets, based on the “School Leavers” metric. These show charter school achievement compared to decile 3 schools and for Maori students.
I have also included an initial analysis of information relating to the “quality” of the NCEA credits being earned by students enrolled at charter schools, based on data provided by NZQA.
Finally, I conclude with some thoughts on the implications of this bizarre outcome in what is supposedly being sold to the country as a “Contracting for Outcomes” arrangement.
You can view the full report here.
~ Save Our Schools NZ