In recent years, Glantz has been a key player in the efforts to persuade the public that secondhand smoke is not merely dangerous but is extraordinarily lethal. His written output in this decade has included such papers as 'Even a little secondhand smoke is dangerous' [PDF] - in which it was claimed that just 30 minutes of exposure to smoke could cause a heart attack. He also co-authored the infamous Helena heart attack study, which purported to demonstrate that exposure to smoke caused 40% of heart attacks in one Montanan town. He is also perhaps the only person on earth who believes that passive smoking causes breast cancer despite a mountain of evidence to the contrary and despite the fact that active smoking does not cause the disease (1).
Glantz has been accused of twisting data and disregarding crucial facts to promote his extreme anti-smoking agenda (he is unashamedly prohibitionist). It comes as a surprise, then, to find that one of his earliest published papers was an appeal for greater scientific rigour in epidemiological studies.
Written in 1978, and published in the American Heart Associations' journal Circulation two years later, 'Biostatistics: How to detect, correct and prevent errors in the medical literature' is one of the least known works in Glantz's extensive canon. It does not get a mention on his lengthy online CV.
There is a reason for that.
"Simple mistakes"
"Ironically, these errors rarely involve sophisticated issues that provoke debate among professional statisticians, but are simple mistakes, such as neglecting to include a control group."
He stated that 44% of studies made the error of omitting a control group. It is interesting that Glantz specifically identified the failure to include a control group as a "simple mistake" since many of his own studies have been criticised for that very reason. Between 1994 and 2007, Glantz co-authored six papers which purported to show that smoking bans did not significantly damage the hospitality industry. Half of them did not include a control group. Nor was there any no control group in a study Glantz championed which claimed that the New York smoking ban resulted in 8% fewer heart attacks.
His own study of heart attack admissions (in Helena, Montana) did have the virtue of having a control group but, as I have written previously, he made a very "simple mistake" when he claimed that it was scientifically feasible for 60% of all heart attacks to be caused by secondhand smoke (to say nothing of the error of calculating a 60% drop, which later had to be corrected to 40%).
But the main complaint the Stanton Glantz of 1978 had to make about epidemiological studies involved statistical significance.
The significance of significance
Statistical significance is not a difficult concept to define and the following quote, from Glantz's Circulation article, succinctly explains why a measure of statistical significance is necessary and how it works. First he explains why a standard of significance is necessary:
"In an experiment, an investigator rarely studies all possible members of the population, but only a small, representative sample. The mean value computed from such a sample is an estimate of the true mean that would be computed if it were possible to observe all members of the population. Because the sample used to compute the mean consists of individuals drawn at random from the population being studied, there is nothing special about this sample or its mean. In particular, had the luck of the draw been different, the investigator would have drawn a sample containing different individuals and computed a mean value."
He then explains how this can be done, using the example of drug testing:
"Traditionally, when the chances of observing the computed test statistic when the intervention has no effect are below 5%, one rejects the working assumption that the drug has no effect. There is, of course, about a 5% chance that this assertion is wrong. This 5% is the p value, or "significance level."
In other words, even if the drug being tested has no effect, there will inevitably be a small variation between the two randomly selected groups of people it is tested on. Because of chance, the difference between two random variables is almost never zero. The standard 95% significance test Glantz described is designed to distinguish small and meaningless associations from those that are significant. (In epidemiology, 'significant' does not mean 'substantial' or 'serious' as it does in normal parlance; it simply means that the association is probably not the result of chance*.)
When Glantz explained statistical significance in his Circulation paper, he did not pretend that there was anything groundbreaking or controversial about its usage, and any professional epidemiologist would have been well aware of the importance of testing for significance. Indeed, nothing in the article was in the least bit radical. Testing for significance, like avoiding "simple errors", was the bare minimum a researcher could do to avoid creating bogus results. (The young Glantz made no great claims for his paper saying: "This article presents a few basic ideas and rules of thumb.")
And, it seems, the reminder was needed. Glantz bemoaned the fact that "approximately half the articles published in medical journals that use statistical methods use them incorrectly" and recommended that "journal editors should insist that statistical methods be used correctly." In closing, he insisted that "students and research fellows should receive formal training in applied statistics, if only to increase the skepticism with which they approach the literature."
When this budding academic wrote his assault on faulty epidemiology, he was still a fairly obscure mechanical engineer-turned-junior faculty member at the University of California, San Francisco. Although he was, even then, a prominent anti-smoking activist, Glantz had no particular reason to question standard epidemiological practice. The first epidemiological study on passive smoking was still three years away from being published. Anti-smoking activists like Glantz expected it to be only a matter of time before science 'proved' that secondhand smoke was a cause of cancer and other diseases. The first step towards finding this proof would be showing statistically significant associations in epidemiological studies.
But epidemiology failed to do so. The first two studies encouraged them (Hirayama, 1981 & Trichopoulos, 1981) but Lawrence Garfinkel's large American study put a spanner in the works when he found a relative risk of 1.17 (0.85-1.61) for nonsmoking women married to smokers. The relative risk of 17% was statistically insignificant and neither Garfinkel nor the American Cancer Society (whose data he had used) pretended that the study lent any support to the passive smoking theory.
Over the next ten years a succession of studies showed no statistically significant elevation in risk (Gao (1987), Brownson (1990), Janerich (1990), Garfinkel (1985), Dalager (1986), Kabat (1984), Shimizu (1988), Nyberg (1989), Koo (1987) etc.) and one even showed a statistically significant fall in risk - ie. passive smokers were less likely to contract lung cancer (Wu-Williams (1987)).
It was at this point that the assault on epidemiological standards began. With the great majority of studies failing to show any tangible association between secondhand smoke and lung cancer, the anti-smoking movement began to belittle and disparage the very concept of statistical significance. At the forefront of this new assault was Stanton Glantz.
In 1993, the Environmental Protection Agency was caught playing hard and fast with epidemiological data in its effort to find a link between secondhand smoke and lung cancer. Even after cherry-picking the data, the EPA was only able to show the slimmest of risks by dropping the measure of statistical significance from 95% to 90%. This doubled the EPA's chances of finding a significant result and understandably raised eyebrows but Stanton Glantz was surprisingly relaxed about it. Fifteen years earlier, he had stressed how important the significance test was, but now he described it as "hairsplitting that only professors care about" and said:
"I know that scientifically it's widely used, but there is a strong body of thought that people are too slavishly tied to 95 percent."(2)
Soon afterwards, Philip Morris began to fund The Advancement of Sound Science Coalition. The organisation aimed to set basic standards for epidemiologists and, in the wake of the EPA report, Philip Morris had an obvious motive for supporting such a body. There was nothing in the Advancement of Sound Science Coalition's guidelines that would have been out of place in Austin Bradford Hill's famous criteria of causation or in Stanton Glantz article of 1980, including this remark about significance:
"Two-sided hypothesis tests are encouraged. If a one-sided test is employed, this should be noted and the rationale for using it provided. The presentation of confidence intervals for the estimate of risk gives more information than a single point value with an associated p value. Generally, 95% confidence intervals are preferred."
This was a statement of fact. 95% was indeed the preferred confidence interval in epidemiology. The EPA's use of a lowered 90% interval was almost unheard of and, in his 1980 paper, Stanton Glantz had firmly promoted the 95% confidence interval. But when The Advancement of Sound Science Coalition did the same, Glantz sang to a very different tune. Glantz accused it of "attempting to change the scientific standards of proof" and complained that its recommendations "would make it impossible to conclude that secondhand smoke - and thus other environmental toxins - caused diseases." (3) That may have been true but it was hardly the fault of epidemiology if it was unable to back up Glantz's beliefs.
Faced with a slew of studies that did not meet the test of significance, the anti-smokers preferred to dismiss the significance test itself rather than dismiss the studies. In truth, it was Glantz who was "attempting to change the scientific standards of proof" by abandoning his faith in a crucial criterion; one which could not be met by the null results that continued to appear in studies on secondhand smoke.
Things got worse for the anti-smokers in 2000, when the World Health Organisation's IARC found no statistically significant association between passive smoking and lung cancer. Glantz was incensed and he launched an all-out attack on the 95% confidence interval and, as ever, sought to blame the tobacco industry:
"The [tobacco] industry imposes a one-sided interpretation of confidence intervals, focusing the entire discussion on whether the lower bound of the 95% CI [confidence interval] for a relative risk includes 1. By definition, if the lower bound exceeds 1, then the risk is statistically significantly raised (with p=0.05).
Whether or not there is anything magic about 95%, the true risk is equally likely to be anywhere inside the 95% CI, including values above the point estimate. In environmental and health and safety regulation, it is common to take the health-protective approach of basing public policy on the upper 95% confidence limit...The industry has represented the fact that the increase in risk observed did not reach statistical significance as indicating that the study did not find any increased risk." (4)
This was an extraordinary turn-around. It was the very opposite of what he had written in 1978. Glantz gives an accurate definition of what constitutes a statistically significant risk ("if the lower bound exceeds 1") but then immediately claims that this is a "one-sided interpretation" dreamed up by the tobacco industry. He then suggests that since the true risk falls somewhere within the two confidence intervals, it is reasonable to pick any figure between the two. Furthermore, it is apparently acceptable for anti-smoking advocates to select the highest figure within the confidence interval as being the true risk. What is this if not a "one-sided interpretation" of confidence intervals?!
The troubling implications of such thinking can scarcely be overstated. Glantz is explicitly stating that environmental and health legislation should be based on the top end of the confidence interval ie. the highest level of risk, even when there is no statistical significant association to begin with and, therefore, no risk. Such an assumption makes it possible to 'prove' anything. Even if an epidemiological study finds a nonsignificant reduction in risk (eg. 0.9 (0.7-1.2)), policy makers will only see the 1.2 upper limit and assume a 20% increase in risk. Nothing studied can ever have a neutral effect; everything is harmful; nothing is safe.
Such a practice is not so much bad science as anti-science since it requires no evidence before a theory becomes a 'fact'. It gives the upper hand to pessimists, fanatics and hypochondriacs at the expense of science and reason. The power lies with anybody who can finance and successfully promote the research. Zero-evidence epidemiology can effectively manufacture health hazards at will and the precautionary principle requires politicians to legislate, regulate and abolish as if the risk was real and proven.
Glantz's transition from being a defender of scientific standards to becoming an assailant is an extraordinary one. That it came about due to his need to 'prove' that secondhand smoke kills offers an explanation but is scarce justification. It would a laughable exaggeration to claim that Glantz is some sort of fallen angel. His Circulation article would be unexceptional were it not for its author's subsequent U-turn and Glantz has done as much as anyone to discredit epidemiology as a serious science ever since. Since his training was in mechanical engineering rather than epidemiology, a charitable defence of the man's work might be that he simply does not know any better. I would suggest that his Circulation article, written at the dawn of his career, removes that defence. At one time, Glantz clearly did understand the principles of epidemiology and was prepared to defend them. The fact that he has since become a ringleader of junk science and debased epidemiology is all the more striking in the context of this forgotten article.
(1) 'Alcohol, tobacco and breast cancer', British Journal of Cancer, 2002, 87, pp. 1234-1245; doi: 10.1038/sj.bjc.6600596; see also 'Cigarette smoking and breast cancer', Field et al. International Journal of Epidemiology 1992; 21: 842-848.
(2) Quoted in Michael Fumento, 'Is EPA Blowing Its Own Smoke?' Investor's Business Daily, January 28, 1993. Republished by the American Smokers Alliance at www.smokers.org/research/ articles/08-epa_ blowing _ smoke html.
(3) http:// academicsenate.ucdavis.edu/forums/SoundScienceAJPH.pdf
Incidentally, in his Circulation article, Glantz cites the work of the great epidemiologist Alvas Feinstein. Glantz would later dismiss Feinstein as a "industry consultant" when he cast doubt on the passive smoking theory. http://circ.ahajournals.org/cgi/reprint/116/16/1845.pdf
(4) www.tobaccoscam.ucsf.edu/pdf/5.1.2b-Ong&GlantzIARC.pdf
* In reality, the idea that significant results are correct 95% of the time is a fallacy that can easily be confirmed by reading about the health scares and miracle cures that are reported in every daily newspaper. To quote John Brignell in The Epidemiologists:
"In the comparison of two random variables the correlation coefficient is never zero. The first question to be determined is whether it is far enough from zero to be significant, which in the case of epidemiology means resorting to the one-in-twenty lottery. Even if the correlation is deemed significant, however, that is not sufficient evidence to warrant a claim of causation." (p. 199)
[Originally published at velvetgloveironfist.com]
14 comments:
Excellent article. It's worth recalling that anti-tobacco is not driven by science but by any means that lead to predetermined ends.
How can a sincere man in his right mind accomplish such an intellectual turnaround without stumbling over his own principles of ethics and integrity? Shame on him.
But what can be done to discredit this dangerous charlatan?
Very interesting.
It was the very opposite of what he had written in 1978. Glantz gives an accurate definition of what constitutes a statistically significant risk ("if the lower bound exceeds 1")
Is there a longer passage in which the words "if the lower bound exceeds 1" is embedded?
Whoops! There is. My search somehow missed it.
The 1978 Stanton was doing a very good job explaining the principles of statistics to non specialists. What happened to him? I vaguely remember reading that he or one his parents suffered from respiratory problems.
A useful piece on the critical difference between relative and absolute risk/probability.
http://www.youtube.com/watch?v=_LFbT6_MSSw
Statistical significance only signifies the probability that a relative risk difference is attributable to chance. Although an RR difference may have a low probability of being attributable to chance (e.g., at ≤.05 level), it does not indicate what the difference – other than chance – is attributable to. Causal inference, pertaining to the RR difference, involves a different set of rules altogether.
The critical goal in scientific enquiry is a pinpointing function of discerning unique antecedents for a consequent with a very high degree (e.g., 90-100%) of [absolute] predictive strength. In lifestyle epidemiology, the highest absolute predictive strength is smoking for lung cancer at 10%, i.e., if one used smoking to predict lung cancer, they would be wrong 90% of the time. And 10% is probably overstated given detection bias by a very much antismoking medical establishment. (The RR might be 5, 6, 7, etc., but the absolute risk is 10%).
When we get to secondhand smoke and particular diseases (e.g., lung cancer, heart disease, SIDS), the situation is way, way worse. If we used exposure to SHS to predict any of these diseases, we would be wrong just short of all of the time. And yet one of the strongest terms in the scientific vocabulary – causation – is routinely invoked.
If those in the hard sciences (e.g., physics) had a clue that causation was concluded on the basis of such flimsy statistical associations, they would be pulling their hair out.
Yet, the pseudoscience of lifestyle epidemiology, with its almost exclusive reliance on the relative risk statistic, well serves the eugenics ideology and the profit motive. The flimsy statistics are placed in the hands of agenda-driven groups (for ideology and/or money) who then arrive at “causation by consensus”.
If a correlation coefficient (e.g., Pearson r), which accounts for both positive and negative consequents in the presence of an antecedent, was used instead of RR, an r=±0.3 (absolute predictive strength of 30%) is where one would begin to entertain the probability of causation. But, as should be obvious, this does not serve the eugenics/money-driven medical establishment at all.
Interesting article. Small inconsistencies can be found in any productive writer/scholar's output. The significance of Glantz can be seen in the transformation of the tobacco industry from a legitimate business as late as the 1980s to one that is clearly immoral and deviant, whose business model is built on hooking children on its addictive products. Given that cigarette-related disease causes one in five deaths in the US today, as you point out, this may be one of his most significant legacies.
Yes. [Self-defined] “Heroes” like Glantz are squeaky-clean moral giants. Puhhhhh-leeeeeeez.
Anonymous (16:07), thanks for quoting the standard antismoking drivel. You wouldn’t happen to be Stan’s PR agent? Or maybe you’re Stan himself needing some extra ego inflation? Since you used the word, “deviant” – or rather, productive deviant - well describes the California Cringe. Further, I would think that “scholar Glantz” is an oxymoron. But grateful we are for your immoral contribution nevertheless. Regards to Stan.
Thanks for sharing the link, but argg it seems to be down... Does anybody have a mirror or another source? Please answer to my post if you do!
I would appreciate if someone here at velvetgloveironfist.blogspot.com could post it.
Thanks,
Peter
Peter,
I take it that you are referring to my link. Just checked the link and it is OK.
Anonymous 16/10/10,
Did your mother not teach you that two wrongs don’t make a right?
The real legacy of Glantz and his cronies is an increasingly disillusioned, divided society in which truth, honesty and reason are subjugated by dogmatic ideology, bigotry and political spin.
Do you really think that the 20% of the population you believe die as a consequence of tobacco would live forever if it was somehow abolished? Is Glantz’s crusade saving 20% of Americans from death? That would be quite impressive.
Rewriting the rules of epidemiology in order to further an ideology is not as you put it a “small inconsistency” but a massive hammer blow to the credibility of scientists, medics and politicians who purport to follow an “evidence based” agenda.
I will go further and blame Glantz and his type for the apathy the majority of western populations feel towards the scientific /medical establishment and their disengagement from politics. Glantz has shown the whole world that being honest, fair and right are no longer prerequisites for success in public life.
Sorry for my bad english. Thank you so much for your good post. Your post helped me in my college assignment, If you can provide me more details please email me.
In congressman Thomas Bliley's 70-page memorandum to a Congress comittee hearing in 1993, there is an interesting quote from Stanton Glantz - stated at an anti-smoking conference i Perth, Australia, April 1990:
Glantz made a series of revealing comments. First, he noted that "it's very nice to see that the same ideas that a few of us were advocating in 1983 which were viewed as so strange, radical and hopeless have now really become very mainstream."
He further confessed that "[t]he main thing the science has done on the issue of ETS, in addition to help people like me pay mortgages,
is it has legitimized the concerns that people have that they don't like cigarette smoke. And that is a strong emotional force that needs to be harnessed and used."
Glantz concluded by stating that "we are all on a roll and the bastards are on the run and I urge you to keep chasing them."
The original document is here:
http://legacy.library.ucsf.edu/tid/hrb18a99/pdf
I have made an easy-to-read version with all links at he bottom of the document:
STATEMENT OF THOMAS J. BLILEY
Post a Comment