How Measurement Fails Doctors and Teachers

newyorktimesIn a recent opinion piece in the New York Times, Robert Wachter focuses on the effects of metrics and measurement on the health care and education professions. While arguing that we, of course, need to hold professionals accountable, he cautions against unanticipated consequences. Following is an excerpt from this piece:

Measurement cannot go away, but it needs to be scaled back and allowed to mature. We need more targeted measures, ones that have been vetted to ensure that they really matter. In medicine, for example, measuring the rates of certain hospital-acquired infections has led to a greater emphasis on prevention and has most likely saved lives. On the other hand, measuring whether doctors documented that they provided discharge instructions to heart failure or asthma patients at the end of their hospital stay sounds good, but turns out to be an exercise in futile box-checking, and should be jettisoned.

We also need more research on quality measurement and comparing different patient populations. The only way to understand whether a high mortality rate, or dropout rate, represents poor performance is to adequately appreciate all of the factors that contribute to these outcomes — physical and mental, social and environmental — and adjust for them. It’s like adjusting for the degree of difficulty when judging an Olympic diver. We’re getting better at this, but we’re not good enough.

Most important, we need to fully appreciate the burden that measurement places on professionals, and minimize it. In health care, some of this will come through advances in natural language processing, which may ultimately allow us to assess the quality of care by having computers “read” the doctor’s note, obviating the need for all the box-checking. In both fields, simulation, video review and peer coaching hold promise.

Whatever we do, we have to ask our clinicians and teachers whether measurement is working, and truly listen when they tell us that it isn’t. Today, that is precisely what they’re saying.

Avedis Donabedian, a professor at the University of Michigan’s School of Public Health, was a towering figure in the field of quality measurement. He developed what is known as Donabedian’s triad, which states that quality can be measured by looking at outcomes (how the subjects fared), processes (what was done) and structures (how the work was organized). In 2000, shortly before he died, he was asked about his view of quality. What this hard-nosed scientist answered is shocking at first, then somehow seems obvious.

“The secret of quality is love,” he said.

Our businesslike efforts to measure and improve quality are now blocking the altruism, indeed the love, that motivates people to enter the helping professions. While we’re figuring out how to get better, we need to tread more lightly in assessing the work of the professionals who practice in our most human and sacred fields.

Read the full piece here: