A national study of 2,500 charter schools shows that "maybe 20 percent do better than the community public schools, 40 percent or so do worse and the rest are not having any significant difference."

James Parisi on Sunday, August 21st, 2011 in a TV news show

R.I. union leaders says national study shows 20 percent of charter schools perform better than traditional public schools and 40 percent perform worse

During a recent discussion on Channel 10’s "News Conference" about efforts to expand charter schools in Rhode Island, James Parisi, field representative and lobbyist for the Rhode Island Federation of Teachers and Health Professionals, challenged the notion that charter schools improve student performance.

"I think one of the studies that I pay most attention to," Parisi said, "indicated, on a nationwide basis, looking at two and a half thousand charter schools around the country, maybe 20 percent do better than the community public schools, 40 percent or so do worse and the rest are not having any significant difference."

Rhode Island has 16 charter schools, including a new one opening Sept. 7, and more are expected to open soon. The state has a three-year, $9.4-million federal grant to expand existing charter schools, open additional ones and build partnerships between charter and traditional public schools.

State Education Commissioner Deborah Gist invited Achievement First, a charter school management operator, to come to Rhode Island. And Gist has testified in favor of a proposal by Cranston Mayor Allan W. Fung -- to be voted on Thursday by the state Board of Regents for Elementary and Secondary Education  -- to open a "mayoral academy" charter school.

Fung hopes to eventually create a network of five such charter schools in Cranston and Providence.

Though taxpayer financed, charter schools generally are run by their own boards and and have more control over how they spend their money on. Rhode Island charter schools are required to participate in standardized testing, but they’re free from some of the administrative staffing rules and contractual restrictions that determine policies such as the length of the school year and school dress codes. Most charter schools admit students by lottery.

Supporters of charter schools often hail them as a solution to the failures, real or perceived, of the nation’s public schools. Skeptics, Parisi among them, say they tend to siphon students and resources from traditional public schools.

And he referenced a study that, he said, cast doubt about the educational value of charter schools. So we decided to check that out.

We contacted Parisi, who faxed us page 142 from "Death and Life of the Great American School System: How Testing and Choice Are Undermining Education," a book by prominent education writer and charter school critic Diane Ravitch.

Ravitch referenced a 2009 study by researchers at Stanford University that analyzed data from 2,403 charter schools in 15 states and the District of Columbia, or roughly 65 to 70 percent of the nation’s charter schools at the time.

Ravitch’s summary of the study results was roughly what Parisi had said, but we didn’t want to take the author’s word for it. So we went online and found the study.

Entitled "Multiple Choice: Charter School Performance in 16 States," (or 15 states and the District of Columbia), the so-called CREDO study was released June 2009 by Stanford University’s Center for Research on Education and Outcomes. (Rhode Island was not among the study’s participants.)

The authors summarized their findings this way: "The study reveals that a decent fraction of charter schools, 17 percent, provide superior education opportunities for their students. Nearly half of the charter schools nationwide (46 percent) have results that are no different from the local public school options and over a third, 37 percent, deliver learning results that are significantly worse than their student would have realized had they remained in traditional public schools.’’

The percentages correlated roughly with the ones Parisi described. He said 20 percent do better; the study reported it was 17 percent; he said 40 percent do worse, the study reported 37 percent; and he said the rest (46 percent the study said)  showed no significant difference.

We wondered, though, if this particular study is one we could trust. So we called some experts.

"It’s still among the best,’’ Gary Miron, a professor of education at Western Michigan University’s Department of Educational Leadership, said.

Miron reviewed Stanford University’s CREDO study for The Think Tank Review Project, which was created in 2006 by two academic centers associated with the Education Policy Research Unit at Arizona State University and the University of Colorado at Boulder to provide academically sound reviews of think-tank publications. The project is financed by the Great Lakes Center for Education Research Practice.

"The relative strength and comprehensiveness of the data set used for this study, as well as the solid analytic approaches of the researchers,’’ the reviewers wrote, "makes this report a useful contribution to the charter school research base."

Though a better study, Miron said, financed by the U.S. Department of Education was released last June. But Stanford University’s CREDO study remains the largest-scale study he’s seen measuring charter school performance.

The Department of Education study, conducted by Mathematica Policy Research, also concluded that charter middle schools that choose their students by lotteries are no more or less successful than traditional middle schools in improving student achievement in reading and math.

But the latest Mathematica study found that the impact of charter schools is not necessarily the same for all children across the board. In fact, that study found that charter schools were more effective for lower income and lower achieving students, and less effective for higher income and higher achieving students.

Charter schools in large urban areas, the Mathematica study showed, had positive impacts on students’ achievement in math -- as opposed to negative impacts for children who lived outside these large urban areas.

The results of Stanford University’s CREDO study, which Parisi used in his argument, also were more nuanced than he’d suggested. In the report’s "executive summary," the authors write that "charter schools have different impacts on students based on their family backgrounds."

Students who are black or Hispanic in charter schools performed "significantly worse" educationally than their peers in traditional public schools, the study found. But students from poor families who had limited English skills and attended charter schools showed "better academic growth" than their traditional public school peers. The outcomes for students in special education programs, the study found, were about the same.

In the end, Parisi quoted a national study of charter schools that is widely recognized as reputable. While he omitted some of the studies more nuanced findings -- so important to any debate about charter schools -- he quoted its main conclusions accurately.

We rate his statement True.