Statistical illiteracy undermines informed shared decision making

Aug 12, 2015 · Berlin Wall to the Great Recession Christoph Laknerand Branko Milanovic We present an improved panel database of national household surveys between 1988 and 2008 In 2008, the global Gini index is around 70 5 , having declined by approxi-mately 2 Gini points China graduated from the bottom ranks, changing a twin-peaked

The International Association for the Properties of Water and

Berlin, Germany September 2008 Release on the IAPWS Formulation 2008 for the Viscosity of Ordinary Water Substance 2008 International Association for the Properties of Water and Steam Publication in whole or in part is allowed in all countries provided that attribution is given to

Relative Distribution Methods in Stata

Berlin, June 27, 2008 Ben Jann (ETH Z¨urich) Relative Distribution Methods in Stata DSUG 2008 1 / 30 Outline Introduction The Relative Distribution Basic concepts

In N Chater & M Oaksford (Eds), The probabilistic mind

Human Development, Berlin, Germany Introduction The complexity of the cognitive system makes powerful metaphors such as the proba- bilistic mind and the Bayesian brain appealing on the one hand, but limited on the other The trick is to not only harness their productivity, but also recognize their limits

selected sPeecHes OBAMAPresident Barack

Election Night Remarks, November 4, 2008 Remarks in Berlin, Germany, July 24, 2008 A New Strategy for a New World July 15, 2008 The America We Love, June 30, 2008 A More Perfect Union, March 18, 2008 Announcement for President February 10, 2007 Keynote Address at the 2004 Democratic National Convention, July 27, 2004 Remarks Against Going to

Statistical illiteracy undermines informed shared decision making

Z Evid Fortbild Qual Gesundh wesen (ZEFQ) 102 (2008) 411–413 Schwerpunkt Statistical illiteracy undermines informed shared decision making Wolfgang Gaissmaier , Gerd Gigerenzer Max Planck Institute for Human Development, Harding Center for Risk Literacy, Berlin Summary Shared decision making relies on the exchange of information between

Germany and Globalization - ETH Z

survey The Transatlantic Economy 2008, which offers the most up-to-date set of facts and figures describ-ing the deep economic integration binding European nations to America’s 50 states In June 2008 we released a companion volume, entitled France and Globalization, which offers interesting similarities and contrast to this study

The Economist Intelligence Unit’s Index of Democracy 2008

Democracy 2008 The results of the Economist Intelligence Unit's Democracy Index 2008 confirm that, following a decades-long global trend in democratisation, the spread of democracy has come to a halt Comparing the results for 2008 with those from the first edition of the index, which covered 2006, shows that the dominant pattern in the past two

[PDF] 2-2011 - De L'Automobile Et Des Véhicules

[PDF] 2-26-01-10-Partir 18 morceaux, 1,2 heures, 117,9 Mo

[PDF] 2-4- Cas d`une solution de solutés non ioniques

[PDF] 2-5 à 2-22 - Troubles

[PDF] 2-56. WILLIAM THOMSON (LORD KELVIN) William Thomson (1824 - France

[PDF] 2-6 ans - Eurostar

[PDF] 2-6 police/taille des caractères

[PDF] 2-7 - Moeller

[PDF] 2-ASSP-2016 - Prêts Étudiants

[PDF] 2-attestation sur l`honneur

[PDF] 2-C5 Paris-Plages Horizons

[PDF] 2-codage-html

[PDF] 2-CONTEXTE (historique, artistique, scientifique, culturel…) 4 - Inondation

[PDF] 2-E-18/2 «* Jacques Bernard, notaire de Beaucaire 22

[PDF] 2-E-31/50 (suite) 12 février 1622 m testament ds

Z. Evid. Fortbild. Qual. Gesundh. wesen (ZEFQ) 102 (2008) 411-413

Schwerpunkt

Statistical illiteracy undermines informedshared decision making

Wolfgang Gaissmaier

, Gerd Gigerenzer Max Planck Institute for Human Development, Harding Center for Risk Literacy, Berlin

Summary

Shared decision making relies on the exchange of information between the physician and the patient and the involvement of both patient and physician in making the decision. Informed shared decision making thus requires that patients and doctors understand the benefits and harms of different treatment options. This, however, is severely undermined by what we call collective statistical illiteracy. Both patients and physicians have difficulties to understand the meaning of numbers so that an

effective risk communication cannot take place. Risk communicationbased on misunderstandings, however, renders the ''informed'' in

informed shared decision making obsolete. We show that the problem of statistical illiteracy can largely be solved by changing the representation of statistical information. Insight can be achieved by communicating risks in absolute, not relative terms; by using a frequentist formulation, which makes the reference class clear instead of communicating single event probabilities; and by communicating natural frequencies instead of conditional probabilities.

Key words:informed shared decision making, statistical illiteracy, risk communication, transparent representation

Mangelndes Statistikversta¨ndnis untergra¨bt die informierte partizipative

Entscheidungsfindung

Zusammenfassung

Partizipative Entscheidungsfindung beruht auf dem Austausch von Informationen zwischen Arzt und Patient und der Beteiligung beider an der Entscheidungsfindung. Eine informierte partizipative Entscheidungs- findung erfordert daher, dass Patienten und A¨rzte sich u¨ber die Vor- und Nachteile der verschiedenen Behandlungsoptionen im Klaren sind. Stark untergraben wird diese allerdings durch kollektiv mangelndes Statistikver- sta ¨ndnis. Sowohl Patienten als auch A¨rzte tun sich schwer damit, die Bedeutung von Zahlen zu verstehen, so dass keine effektive Risikokom- munikation stattfinden kann. Eine auf Missversta ¨ndnissen beruhendeRisikokommunikation jedoch macht das ''informiert'' in dem Begriff informierte, partizipative Entscheidungsfindung'' hinfa¨llig. Wir zeigen, dass sich das Problem mangelnden Statistikversta

¨ndnisses durch eine

gea ¨nderte Darstellung statistischer Informationen weitgehend beheben la ¨sst. Einsicht entsteht indem Risiken absolut statt relativ dargestellt werden, indem eine frequentistische Formulierung benutzt wird, die die Referenzklasse klar macht anstatt Einzelfall-Wahrscheinlichkeiten anzuge- ben, und indem man natu¨rliche Ha¨ufigkeiten anstelle von bedingten

Wahrscheinlichkeiten kommuniziert.

Schlu

¨sselwo¨rter:Informierte partizipative Entscheidungsfindung, mangelndes Statistikversta¨ndnis, Risikokommunikation, transparente Darstellung

www.elsevier.de/zefq

ARTICLE IN PRESS

Corresponding author. Wolfgang Gaissmaier, Harding Center for Risk Literacy, Max Planck Institute for Human Development, Ko¨nigin-Luise Str. 5, 14195 Berlin.

E-Mail:

gaissmaier@mpib-berlin.mpg.de (W. Gaissmaier).Z. Evid. Fortbild. Qual. Gesundh. wesen (ZEFQ)doi:

10.1016/j.zefq.2008.08.013411

Imagine that a woman discusses the

risks of taking the contraceptive pill with her doctor, and the doctor tells her that the third generation of contra- ceptive pills double the risk of poten- tially life-threatening blood clots in the legs or lungs. That is, they increase the risk by 100%. Should this woman decide to take the pill nevertheless?

Many women in the UK decided not to

take this pill anymore when in October

1995 the UK Committee on Safety of

Medicines issued such a warning about

this risk. This 'pill scare' led to an estimated 13,000 additional abortions in the following year, increasing the cost for the National Health Service for abortion provision by about £46 million [1].

But what does the increase by 100%

actually mean? The studies on which the warning was based had shown that of every 7,000 women who took the earlier, second-generation oral contra- ceptive pills, about 1 had a thrombosis; this number increased to 2 among women who took third-generation pills. That is, theabsolute riskincrease was only 1 in 7,000, whereas the relativeincrease was indeed 100%.

Absolute risks are typically small num-

bers while the corresponding relative changes tend to look big - particularly when the base rate is low. Had the committee and the media reported the absolute risks, few women would have panicked and stopped taking the pill.

Collective Statistical

Illiteracy

This example illustrates a larger societal

problem, the problem of statistical illiteracy. People have difficulties to understand the meaning of numbers; they lack a skill callednumeracy, ana- logous to the term literacy that refers to reading and writing. For instance, in a sample of female veterans in New

England, 80% were unable to convert

1 in 1,000 to 0.1%

[2]. And those who had a higher inability in numeracy had more difficulties in interpreting impor- tant health statistics about the benefits of mammography screening. Lipkus,

Samsa, and Rimer

[3]demonstratedthat this problem of low numeracy generalizes to a larger population of rather well-educated citizens. And although physicians do significantly better on the task of converting 1 in

1,000 to 0.1%, even among them,

25% get this basic computation wrong

[4].

This becomes worse when interpreting

more complicated health statistics, such as understanding relative risks (as in the pill scare example above). The problem with relative risks is that they remain silent about the baseline risk, while the absolute risk makes this transparent. A 100% risk increase could mean an increase from 1 to 2 out every 7,000 women, as in the example above. However, it could also mean an increase from 1,000 to 2,000 out of every 7,000 women, which would be much more threatening. In particular for low probability risks, communicating changes in relative terms makes those changes loom lar- ger than they actually are. This does not only hold for risk increases, but also for risk reductions. For instance, the benefits of mammography screening are usually communicated as a 25% reduction of the risk of dying from breast cancer [4]. In fact, this relative risk reduction approximately means that instead of 4 out of every 1,000 women, only 3 out of every 1,000 women die from breast cancer. The absolute risk reduction thus is 1 in

1,000. A review of experimental stu-

dies showed that many patients, but also health professionals and physi- cians, do not understand the difference between relative and absolute risks and evaluate a treatment alternative more favorably if benefits are communicated as relative risk reductions [5].

Similar confusions can be observed

when people have to interpret single event probabilities, such as when your doctor tells you that the risk of having sexual problems as a side effect is 30%.

The problem is that the reference class

of these 30% is unclear. Many patients were frightened by such a statement, because they believed that it meant thateverypatient would have pro- blems in about 30% of their sexual encounters. However, the statementactually meant that out of 100 patients, about 30 will occasionally experience a sexual problem. This fre- quentistic formulation makes the refer- ence clear and made the statement less frightening to patients [6].

Another typical confusion usually hap-

pens when patients want to know what a positive test result actually means for them. Imagine that a patient participates in screening for colorectal cancer with the fecal occult blood test (FOBT) and receives a positive test result. Does that mean that this patient has cancer or not, or with which probability?

Hoffrage and Gigerenzer

[7]tested 48 experienced physicians on this and other problems. One half was given the relevant information in conditional probabilities. That is, they were informed that the probability of posi- tive test result given that a person has cancer (the sensitivity) was 50%, that the false positive rate was 3%, and that the prevalence of the disease was

0.3%. The physicians were then asked

to estimate the probability of colorectal cancer given a positive test result.

Demonstrating that they were largely

confused, their estimates ranged between a 1% and a 99% chance of cancer. The most common mistake was that doctors believed that the statistic in question (the probability of cancer given a positive test result) was the same as the sensitivity (the probability of a positive test result given cancer), which is, of course, not the same. This can be illustrated with a more intuitive example. Up to 2008, every American and German president was male. That is, the probability of being male given that one is president was 100%. The reverse, obviously, does not hold: Given that one is male, chances of being or becoming president are still rather low.

The other half of the physicians in the

study received the information in nat- ural frequencies rather than conditional probabilities, and the confusion largely disappeared. The information was pre- sented as follows: 30 out of every

10,000 people have colorectal cancer.

Of these 30, 15 will have a positive

FOBT result. Of the remaining people

without cancer, 300 will nonetheless

ARTICLE IN PRESS

Z. Evid. Fortbild. Qual. Gesundh. wesen 102 (2008) 411-413 www.elsevier.de/zefq412 test positive. To compute the probabil- ity of cancer given the positive test result, one then simply needs to divide the number of correct positives (15) by the sum of correct and false positives (15+300), which is about 4.8%. With natural frequencies, most doctors got the answer right. Thus, the problem is not so much in physicians' minds but in an inadequate external representation of information, which is commonly used in medicine.

Informed Shared Decision

Making Rendered

Obsolete

InWorld Brain[8], H.G. Wells predicted

that for an educated citizenship in a modern democracy, statistical thinking would be as indispensable as reading and writing. At the beginning of the 21
st century, nearly everyone in indus- trial societies has been taught reading and writing, but not statistical thinking, as these examples illustrate. This poses an existential obstacle to the ideal of informed shared decision making.

Shared decision making relies on the

exchange of information between the physician and the patient and the involvement of both patient and phy- sician in making the decision [9].

Informed shared decision making thus

requires that patients and doctors understand the benefits and harms of different treatment options.

As summarized above, even with good

will, some doctors would not be able to inform their patients adequately with- out two essential skills: understanding health statistics and communicatingthese in a transparent form. If both patients and physicians do not have minimal literacy in health statistics, an effective risk communication cannot take place. A risk communication based on misunderstandings, however, renders the ''informed'' in informed shared decision making obsolete.

It has been debated whether statistical

illiteracy is mainly a consequence of cognitive limitations. However, such an internal attribution of the causes has not led to successful treatment. If ''probability blindness'' were caused by our cognitive limitations, then we just would have to live with it, or, as some have suggested, would have to keep citizens away from important decisions. In contrast to this view, we propose that this problem could largely be solved by changing the representa- tion. The examples above illustrate that insight can be achieved by communi- cating risks in absolute, not relative terms; by using a frequentist formula- tion, which makes the reference class clear instead of communicating single event probabilities; and by communi- cating natural frequencies instead of conditional probabilities.

However, as long as the goal of some

politicians and organizations rather is to persuade citizens to do what those politicians or organizations believe is right instead of informing them, chan- ging the problem of communication top-down may stay a dream, even if it is a dream we continue working on.

Additionally, we probably need pres-

sure bottom-up: From patients who request their right of being informed in an understandable way and from doc-tors who believe it is the right thing to do to inform patients adequately and let them decide according to their values. This would be a crucial step towards the Enlightenment ideal of people's emergence from their self- imposed immaturity.

References

[1] Furedi A. The public health implications of the 1995 'pill scare'. Hum Reprod Update

1999;5(6):621-6.

[2] Schwartz LM, Woloshin S, Black WC, Welch

HG. The role of numeracy in understanding

the benefit of screening mammography.

Ann Intern Med 1997;127(11):966-72.

[3] Lipkus IM, Samsa G, Rimer BK. General performance on a numeracy scale among highly educated samples. Med Decis Making

2001;21(1):37-44.

[4] Gigerenzer G, Gaissmaier W, Kurz-Milcke E,

Schwartz LM, Woloshin S. Helping Doctors

and Patients Make Sense of Health Statis- tics. Psychological Science in the Public

Interest 2008;8(2):53-96.

[5] Covey J. A meta-analysis of the effects of presenting treatment benefits in different formats. Med Decis Making 2007;27(5):

638-54.

[6] Gigerenzer G. Calculated risks: How to know when numbers deceive you. UK edition: Reckoning with risk: Learning to live with uncertainty. Penguin Books, 2002.

New York: Simon & Schuster; 2002.

[7] Hoffrage U, Gigerenzer G. Using natural frequencies to improve diagnostic inferen- ces. Acad Med 1998;73(5):538-40. [8] Wells HG. World brain. London: Cambridge

University Press; 1994. Original work pub-

lished in 1938. [9] Charles C, Gafni A, Whelan T. Shared decision-making in the medical encounter:

[PDF] Statistical illiteracy undermines informed shared decision making

Schwerpunkt

Wolfgang Gaissmaier

Summary

Entscheidungsfindung

Zusammenfassung

¨ndnisses durch eine

Wahrscheinlichkeiten kommuniziert.

ARTICLE IN PRESS

E-Mail:

10.1016/j.zefq.2008.08.013411

Imagine that a woman discusses the

Many women in the UK decided not to

1995 the UK Committee on Safety of

Medicines issued such a warning about

But what does the increase by 100%

Absolute risks are typically small num-

Collective Statistical

Illiteracy

This example illustrates a larger societal

England, 80% were unable to convert

1 in 1,000 to 0.1%

Samsa, and Rimer

1,000 to 0.1%, even among them,

25% get this basic computation wrong

This becomes worse when interpreting

1,000. A review of experimental stu-

Similar confusions can be observed

The problem is that the reference class

Another typical confusion usually hap-

Hoffrage and Gigerenzer

0.3%. The physicians were then asked

Demonstrating that they were largely

The other half of the physicians in the

10,000 people have colorectal cancer.

Of these 30, 15 will have a positive

FOBT result. Of the remaining people

ARTICLE IN PRESS

Informed Shared Decision

Making Rendered

Obsolete

InWorld Brain[8], H.G. Wells predicted

Shared decision making relies on the

Informed shared decision making thus

As summarized above, even with good

It has been debated whether statistical

However, as long as the goal of some

Additionally, we probably need pres-

References

1999;5(6):621-6.

HG. The role of numeracy in understanding

Ann Intern Med 1997;127(11):966-72.

2001;21(1):37-44.

Schwartz LM, Woloshin S. Helping Doctors

Interest 2008;8(2):53-96.

638-54.

New York: Simon & Schuster; 2002.

University Press; 1994. Original work pub-

What does it mean? (or, It takes at least two

1997;44:681-92.

ARTICLE IN PRESS

Das Internetangebotwww.g-i-n.nethat im Juli

2008 erneut die Akkreditierung durch die

Health on the Net Foundation (HON) erhalten.

Das HON-Siegel bescheinigt die gute Qualita

Die HON-Initiative wurde 1995 ins Leben ge-

¨t medizinischer und ge-

¨tsanforderungen be-

Entwickler von Intenetseiten beru¨cksichtigen