Saturday, January 19, 2013

How Safe Are America's Schools?

Rob Bligh, a retired lawyer and school board member with enough energy to argue tirelessly on behalf of public education, recently sent me these facts about the safety of America's public schools.
America's K-12 schools are among the very safest places for a child to be. A child is more likely to die from parental abuse or neglect than to die from all violent causes at school by a ratio of 66-to-1. Parental abuse and neglect kills 1,760 children in a typical year. On average, 26.5 children die each year from all school-associated violent causes. A school-associated violent death is any homicide, suicide, or weapons-related violent death in the United States in which the fatal injury occurred:
  1. on the property of a functioning public, private or parochial elementary or secondary school, Kindergarten through grade 12, (including alternative schools);
  2. on the way to or from regular sessions at such a school;
  3. while person was attending or was on the way to or from an official school-sponsored event;
  4. as an obvious direct result of school incidents, functions or activities, whether on or off school bus or vehicle or school property.
In 2005, for example, a total of 53,501 American children died from all causes. The average 26.5 annual school-associated child deaths amount to slightly less than 5 one hundredths of one percent of that total. If we really want to do something about child safety, we should not be telling school officials how to conduct themselves. Instead, we should ask everyone else in our society who is responsible for children to act more like school officials. The result would be a stunning increase in child safety.
The most authoritative study on this topic reported that between 1994 and 1999, there were a total of 172 homicides at schools. Oh, yeah, that was during the Clinton Administration ban on assault rifles, wasn't it.

Reference: Anderson, M. et al. (2001, December 5) School-Associated Violent Deaths in the United States, 1994-1999. JAMA, Vol. 286, No. 21.

Gene V Glass
University of Colorado Boulder
Arizona State University

Sandy Hook & Cyberschools

Yesterday I received these questions from a newspaper reporter in Pennsylvania.
  • "It occurred to me that one way to protect children as they learn is to teach them at home. Do you expect cyber schools will become more popular because of the massacre in Newtown, Conn.?"
  • "You have charted the growth of cyber schools and mentioned that Florida and perhaps other states turn to them to save money in writings at the NEPC. To what extent do you think concern for safety has fed the growth of cyber schools?"
  • "After the shootings in Columbine, I assume cyber schools nascent entities if they existed at all, but did those shootings lead to an increase in home schooling?"
I assumed immediately that I was not dealing with Walter Lippmann here. But I did wonder who might have put such questions in this poor man’s head. Pennsylvania is home to the Agora cyber-charter-school, one of the largest in the nation and a huge cash cow for K12 Inc. And on several occasions I have been contacted by reporters asking questions after they were visited by a K12 Inc. public relations flack with a parent and cyber-educated student in tow.

There are few places on earth at which a child is safer than at an American public school. More than 90% of public school parents express no concern for their child’s safety while at school, according to repeated Gallup surveys.

My nephew’s son was in the weight room adjacent to the cafeteria on April 20, 1999, when Harris and Kliebold committed that heinous act of mayhem at Columbine. My nephew didn’t start searching for a charter school or bring his son home to educate him.

These tragedies of mass killings – virtually always by males between the ages of 18 and 40 – are completely unpredictable. They happen in Colorado, they happen in Oregon, they happen in Scotland, they happen in Norway. The attempt to twist the narrative of gun control into a debate about mental illness is an obscenity. These acts are almost always the actions of paranoid schizophrenics; and that condition – presenting in the late teens or early 20s – is known to exist in every culture across every decade at a rate of 1 in 100 persons. There are 60,000,000 males in the U.S. between the ages of 18 and 40. One percent of that number is 60,000 males. Approximately that number of young men live, work, and suffer from a tragic biochemical illness in the United States. What does the NRA propose to do with them? Incarcerate them all? Appoint an armed companion to follow them around 24/7?

Back to our reporter in Pennsylvania.

  • “Dr. Glass, do you expect cyber schools will become more popular because of the massacre in Newtown, Conn.?”
No! Nor do I think people will stop going to the movies because of the unspeakable tragedy at the theater in Aurora, Colorado.

And will the next reporter’s question be about buying stock in Netflix?

Gene V Glass
University of Colorado Boulder
Arizona State University

Monday, January 14, 2013

Gates Foundation Wastes More Money Pushing VAM

Any attempt to evaluate teachers that is spoken of repeatedly as being "scientific" is naturally going to provoke rebuttals that verge on technical geek-speak. The MET Project's "Ensuring Fair and Reliable Measures of Effective Teaching" brief does just that. MET was funded by the Bill & Melinda Gates Foundation.

At the center of the brief's claims are a couple of figures (“scatter diagrams” in statistical lingo) that show remarkable agreement in VAM scores for teachers in Language Arts and Math for two consecutive years. The dots form virtual straight lines. A teacher with a high VAM score one year can be relied on to have an equally high VAM score the next, so Figure 2 seems to say.

Not so. The scatter diagrams are not dots of teachers' VAM scores but of averages of groups of VAM scores. For some unexplained reason, the statisticians who analyzed the data for the MET Project report divided the 3,000 teachers into 20 groups of about 150 teachers each and plotted the average VAM scores for each group. Why?

And whatever the reason might be, why would one do such a thing when it has been known for more than 60 years now that correlating averages of groups grossly overstates the strength of the relationship between two variables? W.S. Robinson in 1950 named this the "ecological correlation fallacy." Please look it up in Wikipedia. The fallacy was used decades ago to argue that African-Americans were illiterate because the correlation of %-African-American and %-illiterate was extremely high when measured at the level of the 50 states. In truth, at the level of persons, the correlation is very much lower; we’re talking about differences as great as .90 for aggregates vs .20 for persons.

Just because the average of VAM scores for 150 teachers will agree with next year's VAM score average for the same 150 teachers gives us no confidence that an individual teacher's VAM score is reliable across years. In fact, such scores are not — a fact shown repeatedly in several studies.

So we aren't going to fire groups of 150 teachers arbitrarily lumped together who might have low VAM scores, nor pay big bonuses to the high VAM group. Nor are we going to fire those teachers whose Language Arts VAM score is low, because the odds are substantial that the same teachers' Math VAM score might be average or even above. We would see that such teachers are hardly the exception if the authors of the MET Project brief had simply shown us scatter plots of individual teachers' VAM scores instead of having tripped up on Robinson's ecological correlation fallacy.

Gene V Glass
University of Colorado Boulder
Arizona State University

Wednesday, January 9, 2013

When Methuselah Was Young

John Merrow’s documentary “The Education of Michelle Rhee" aired on many PBS stations on January 8, 2013. There was little in it that educated actual professional educators about the short, eventful, and turbulent career of Michelle Rhee as superintendent of the Washington, D.C. public schools. Diane Ravitch found the show to be disappointing, as would almost any perceptive and concerned fighter to save public education in America. Sometimes journalistic balance is mere pusillanimity.

One might naturally ask what Michelle Rhee learned from her unhappy attempt to bring her brief background as a Teach for America teacher and her managerial acumen to the job of reforming one of the toughest school districts in the nation – one of the very many toughest school districts I must add. Among other things, she undoubtedly learned that public institutions like schools cannot be run like businesses, and had she been a little older and wiser – than age 37 when she took on the job – she should have known that even businesses themselves do not run like the organizations of her fantasies. The number of brutal firings in the business world of employees who fail to make targets on single quantitative measures of “productivity” is far fewer than naive dilettantes like Rhee would imagine.

But what the viewer may have learned from watching “The Education of Michelle Rhee" is more profound. The centerpiece of Rhee’s reform of the D.C. schools was the IMPACT program. Teachers and principals were to negotiate with Rhee on targets for gains on the D.C. CAS test from beginning to end of the year. Based on hitting or missing those goals, teachers and principals were either rewarded generously with cash – as much as $10,000 for principals and $5,000 for teachers – or they were fired. Rhee christened this new program IMPACT – an acronym, perhaps, but I cannot bear to unravel its possible ugliness. Although legions of states and school districts have talked such talk, Rhee walked it. In two years, dozens, perhaps hundreds, of teachers and principals lost their jobs or were put on notice because their CAS test gains were not up to snuff, while others lined their pockets with cash for having topped their targeted gains. Apparently Rhee’s compensation was not tied to the overall district’s performance on CAS. (CAS was built by CTB McGraw-Hill; let’s get everybody’s name out in the open here. CAS is a basic skills achievement test in the one-hundred-year-old mold of "fill in the bubble.")

So far this is little more than the story of the madness of high-stakes testing that has been the stuff of school reform rhetoric for decades, and that story having been swallowed hook-line-and-sinker by a dewy-eyed outsider. But something more significant happened on the screen in John Merrow’s documentary.

In her first year on the job, Rhee met individually with each principal in the district to negotiate the CAS test gain score goal for that principal’s school. This exchange took place on screen – slightly paraphrased:

Rhee: So, what is your goal going to be? How many more kids are you going to raise from BASIC to PROFICIENT.

Principal: Well, I’m going to tell my teachers 10%, but put me down for 5%.

Rhee and the principal exchanged knowing smiles.

IMPACT blew up in two years. Allegations of cheating abounded. It was well-known that teachers and principals in certain places took over the completed answer sheets, erased incorrect answers, and marked the correct answers. One school elevated 40% of its students from BASIC to PROFICIENT in one year and walked off with a ton of cash. A year later when the principal departed under a cloud of suspicion, the scores dropped back to status two years ante. The newspapers got on the story. Two outside firms were hired to examine the situation. They white-washed it.

“The Education of Michelle Rhee” has taught us one thing above all. Actions that begin in duplicity will end in duplicity; and duplicity will eventually be found out. It is a lesson older than high-stakes testing, older than schools themselves, indeed, as old as Methuselah.

Gene V Glass
University of Colorado Boulder
Arizona State University

Wednesday, December 19, 2012

Want to be a Teacher in a Cybercharter School?

Thinking about picking up a little extra cash, using your teaching certificate before it expires, and, in the words of the leading online K-12 corporations, teaching an "award-winning curriculum that engages young minds with a rich combination of online interactive and offline hands-on learning" and enjoying "a new kind of powerful, personalized connection" with students"? Well then, maybe you should take a job teaching in the Colorado Virtual Academy or the Arizona Virtual Academy or Pennsylvania's Agora Cyber Charter School.

Or maybe not. Just listen to the experiences of a few of these teachers who cast their lot with a cybercharter.

In the interview, eight of the ten questions they asked me were about how I would go about finding new students and convincing their parents to enroll them. I stopped the interview and asked them to clarify precisely what position I was being interviewed for.

I worked at Colorado Virtual Academy [COVA] as a teacher; here is what I know for sure. The teachers for K-8 do not teach; they are secretaries, customer support, and marketing reps for COVA. The parents do 98% of the teaching or the kids teach themselves using a "first class" curriculum.

As a former teacher at COVA myself, I can tell you that COVA treats the teachers there like garbage. They get paid pitiful wages and get no respect from the administration or the school board. COVA is nothing more than glorified home school. COVA is merely concerned with the bottom line and with test scores.

COVA's student achievement is affected by class size — enormous (almost criminal) class sizes. I was both a K-8 and a high school teacher. At the K-8 level, I had 75 "homeroom" students and supported 300-350 students in my content (which is impossible, but very, very lucrative for K12). At the high school level, the numbers were higher with 350-450 students to teach in my content. K12 and COVA will say that those numbers reflect beginning-of-the-year enrollment and do not take into consideration attrition. Not true. My numbers didn't change much all year and I basically became a full-time grader when at the high school level (not a teacher!) . I was also told at various times by the principal at the middle school level that I needed to "teach all content areas" and get used to supporting students in every area (math, science, history, etc.) and across many grade levels (K-5th grade or 6th-8th grade in all content areas). This is how K12 makes money. They load up class sizes and hire as few teachers as possible (and the pay averages out to be about $10 an hour).

What I really need to do is get them on the phone, open my computer, open their computer and walk them through it. That would take an hour plus. You can’t do that with 250 students. You can’t.

They treat teachers with the utmost disregard and couldn't care less about their students educational needs. Their only concern is appearances and test scores, which they have tried to manipulate in many different ways over the last seven years.

The teachers at COVA are qualified teachers, but are used as nothing more than customer service representatives in order to market the program and smooth over panicked families who discover that they have made the wrong choice concerning their student's education.

And what if you don't have a teaching certificate or yours lapsed? Find the right state and it could be no problem. When one of the cyber-charter giants applied for a charter in San Francisco and was turned down, a charter was subsequently issued by the California State Board of Education (after, in the words of one reporter, a little money was spread around). Now, California has a law on the books that says any teacher in a charter school in California must be certified to teach in the state. Many certified teachers in California make a decent living. This apparently did not fit well with San Francisco's Flex Academy's business plan. So Flex Academy hired a couple of teachers certified in California and entitled all the rest of the "teaching" staff "teaching assistants." But in the end, it may not matter since so many of these cybercharter teachers are basically recruiters and marketers any way.

Gene V Glass
University of Colorado Boulder
Arizona State University

Friday, December 14, 2012

When Guns are Outlawed Only Outlaws Will Have Knives

At this very moment the news wires are carrying two stories.

Someone – now dead presumably – entered an elementary school in Newtown, CT and murdered nearly 30 persons including 18 children. A semi-automatic gun was used to do the deed, so it is being reported at this moment.

"A man wielding a knife attacked students Friday at a school in central China, leaving 22 children and one adult injured, according to state-run media reports. The attack occurred at the gate of an elementary school in the village of Chengping, in Henan Province. Police arrested the attacker, who they identified as local resident Min Yingjun, 36. Children as young as six were among those hospitalized after the attack, suffering injuries including slashes to the ears and head."

My cousin is the Secretary of the National Rifle Association. I have never shot a gun. Someone is certain to remark in the hours and days after the Connecticut tragedy that a madman will some how find a weapon and wreak havoc, whether with a gun, a knife, or a club.

Gene V Glass
University of Colorado Boulder
Arizona State University

Wednesday, December 12, 2012

Where in the World is Carmen Sandiego?

Back in the dark ages of computer video games, there was great excitement over the geography-teaching game called “Where in the World is Carmen Sandiego?” A series of clues would be revealed, and the game player would have to guess where on earth the virtual Carmen was residing. Try it. “Carmen is sipping a cappuccino at a sidewalk cafĂ© and is about to enjoy a plate of pasta. Just beyond the town square near the banks of the River Arno stands a tower, tilting precariously at about 4 degrees. Where in the world is Carmen? Ans.: Pisa, Italy.

See, it's easy. OK, try this one.

Carmen is sitting at Starbucks enjoying a latte macchiato surrounded by her fellow customers engrossed in their iPads and iPhone 5s and laptops of various persuasions. For miles around her the neighborhoods feature multi-million dollar estates, home to successful entrepreneurs and "early-retirees." Down the street, one finds school buildings designed by world-class architectural firms, and in them the children of the rich study assiduously under the tutelage of experienced, highly educated teachers making $75,000 a year and up. On international tests, 40% of these children score at the advanced level in Math and Science. Where in the World is Carmen Sandiego?

Ans.: Well, if you have been following the results of TIMMS and PISA — not the city in Italy but the paper-pencil test — you have no doubt guessed that Carmen is enjoying her latte in Singapore.

Wrong!

Carmen could be sitting in Highland Park (IL) or Greenwich (CT) or San Jose-Sunnyvale-Santa Clara (CA) or Alexandria (VA) or any of a dozen more cities and metropolitan areas in the United States that can out-test any nation on the globe.

Why then, would anyone think that the secrets to success are to be found in the schools of Singapore (with the highest percentage of millionaires of any nation in the world), or Hong Kong, or Northern Ireland (oh, yes, Northern Ireland scored just below Japan on the TIMSS 2011 math test)? And Finland fell back to near equality with the entire U.S. on 4th and 8th grade Math. What about all those experts we sent to Finland since the last international assessment in search of the Holy Grail?

When will we stop playing these ridiculous games like “Where in the World Are the Greatest Schools?” When will we stop acting as if a few paper-and-pencil tests will reveal the secrets to economic progress and world domination? When will we begin to treat education as the complex relationship among families, children, and educators that it truly is?

Gene V Glass
University of Colorado Boulder
Arizona State University