Wednesday, September 17th, 2014
Mostly True
Obama
"As many as a quarter of our students aren’t even finishing high school."

Barack Obama on Tuesday, January 25th, 2011 in the State of the Union address

Barack Obama in State of the Union says up to a quarter of U.S. high schoolers drop out

In his State of the Union address on Jan. 25, 2011, President Barack Obama advocated investments in both physical and human capital. But he said the nation’s rates of educational achievement were falling short.

"Over the next 10 years, nearly half of all new jobs will require education that goes beyond a high school degree," Obama said. "And yet, as many as a quarter of our students aren’t even finishing high school."

We looked at this question last year, when Education Secretary Arne Duncan offered a similar statistic on the Aug 29, 2010, edition of ABC's This Week with Christiane Amanpour during a discussion of education policy.

"In this country, we have a 25 percent dropout rate," he said. "That's 1.2 million students leaving our schools for the streets every single year. That is economically unsustainable, and that is morally unacceptable."

We wondered whether it was really true that one of every four American high school students drops out before graduating. We concluded that while Duncan used a commonly cited statistic, education experts we contacted cautioned that it's an imperfect measurement.

First, a bit about the complex world of measuring dropout rates, drawing liberally from a prior article by our colleagues at PolitiFact Texas.

Researchers and governments have many different ways of measuring how many students leave school before graduating. "A dropout rate seems like it should be the most intuitive thing in the world, but it’s not," said David Bills, a professor at the University of Iowa College of Education who specializes in comparative statistics. "There are almost as many ways of calculating state dropout rates as there are states."

One way to calculate it is to track individual students as they progress from freshman year of high school until graduation. This provides the most accurate data, but tracking students this way requires a lot of effort, so many school districts do not do it.

The main alternative is to track the decline in enrollment between freshman year and graduation. This is known as the AFGR, or averaged freshman graduation rate. It's much easier to do -- and it's the most consistent "apples to apples" statistic across the 50 states -- but it is undermined by a greater risk of error.

That's because AFGR does not necessarily distinguish between students who actually dropped out and those who left for other reasons, such as moving to a school in another state, leaving to follow one's parents to a new military assignment, graduating early or graduating late.  "If a kid leaves one school but is never tracked if he enrolls in another school, that can count as a dropout," Bills said. "Also, a lot of kids who leave high school but later get GEDs are often counted as dropouts. And sometimes dropout rates are calculated as the number of people aged 16-24 not in school and without a degree, which can also inflate the number."

Students who leave for other reasons can be excluded, but this is not always done, and not doing it tends to inflate the apparent number of dropouts. Standardization mandated by provisions of the No Child Left Behind Act has reduced these errors over time, but the statistics are not yet perfect, our experts said.

And, needless to say, analyzing different data with different methods will inevitably yield varying results. To add to the confusion, any of the measurements cited above might be termed the "dropout" rate in public discourse.

At the Education Department, we spoke to Tracy Dell'Angela, director of outreach and communications with the Institute of Education Sciences, which oversees the department's National Center for Education Statistics, which among other things calculates AFGR. She said that when Duncan talks about the dropout rate, he tends to subtract the AFGR (nearly 75 percent for the last available year, 2007-2008) from a full student universe of 100 percent to get a 25 percent dropout rate.

In one sense, Duncan was on solid ground -- his calculation is certainly a common way to use the statistics. But the numbers require some important caveats. In addition to the issue of transfer students cited earlier, the statistics do not necessarily treat home schoolers accurately (they may be counted as dropouts if they begin home schooling after 9th grade and eventually graduate from home school). In addition, Education Department data has sometimes left out entire states, including South Carolina in 2007-2008.

Also, the AFGR statistics only refer to public school students. In fact, there is no comprehensive data on graduation and dropout rates from private schools, which account for about 8 to 9 percent of high school students. Since parents paying tuition are likely to be especially motivated to see their children finish school, the true national dropout rate reported probably overstates the actual percentage of American children failing to graduate from high school.

We ended up rating Duncan’s comment Half True, noting that while we understood the need for simplicity in a televised interview, Duncan could have easily said the dropout rate "may be as high as 25 percent."

In fact, Obama in his State of the Union address did essentially that, prefacing the statistic by saying that "as many as a quarter of our students aren’t even finishing high school." We still think the 25 percent statistic is undermined by a variety of problems, but we give Obama credit for offering a range. So we find his claim Mostly True.