Objectives To assess the ‘Massachusetts Benchmark Study’ (MBS) that the tobacco companies presented to the Massachusetts Department of Public Health (MDPH) in 1999 in response to ingredient disclosure regulations in the state. This case study can inform future ingredient disclosure regulations, including implementation of Articles 9 and 10 of the WHO Framework Convention on Tobacco Control (FCTC).
Methods We analysed documents available at http://legacy.library.ucsf.edu to identify internal communications regarding the design and execution of the MBS and internal studies on the relationship between tar, nicotine and carbon monoxide and smoke constituents and reviewed publications that further evaluated data published as part of the MBS.
Results The companies conducted extensive studies of cigarette design factors and ingredients that significantly impacted the levels of constituents. While this study asserted that by-brand emissions could be estimated reliably from published tar, nicotine, and carbon monoxide levels, the tobacco companies were well aware that factors beyond tar, nicotine and carbon monoxide influenced levels of constituents included in the study. This severely limited the potential usefulness of the MBS predictor equations.
Conclusions Despite promises to provide data that would allow regulators to predict constituent data for all brands on the market, the final MBS results offered no useful predictive information to inform regulators, the scientific community or consumers. When implementing FCTC Articles 9 and 10, regulatory agencies should demand detailed by-brand information on tobacco product constituents and toxin deliveries to users.
- Public policy
- Surveillance and monitoring
- Tobacco industry documents
Statistics from Altmetric.com
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.
Tobacco companies have long blocked regulatory agencies from disclosing information about the ingredients in their products.1–4 Ingredient and emission disclosure is a continuing issue for tobacco regulators today, including the US Food and Drug Administration and comparable organisations in countries that have ratified the WHO Framework Convention on Tobacco Control (FCTC), which includes Article 9 on the regulation of the contents of tobacco products and Article 10 on the regulation of tobacco product disclosures.5 In 1996 Massachusetts enacted “An Act Providing for Disclosure of Certain Information Relating to Tobacco Products Sold in the Commonwealth” that required the tobacco companies to provide detailed by-brand information on the ingredients and nicotine delivery of their products to the Massachusetts Department of Public Health6 (MDPH) and granted MDPH authority to release this information to the public.6
The companies immediately sued to block the Act7 ,8 and in 1999 developed a new strategy of appearing to be more open to regulations by offering the state the ‘Massachusetts Benchmark Study’ (MBS) with the assertion that it was possible for regression equations based on publicly available tar, nicotine, and carbon monoxide (CO) to accurately predict the 41 constituents in smoke for different brands without providing the actual information on specific brands that Massachusetts was seeking.22 In April 1999, in the midst of the litigation, MDPH agreed to the MBS, which the companies summarised in a presentation to MDPH in February 200010 and delivered in July 2000.9 The MBS allowed the companies to prevent effective disclosure of constituent information on a brand-by-brand basis.
Despite the tobacco companies’ claim that the MBS would allow reliable estimation for all brands from published tar, nicotine and CO levels of a specific cigarette’s constituents, they knew smoke chemistry could be manipulated in a way not predicted by these published measurements. The companies have also promoted benchmarking in Australia, the UK and Canada. Examining the process of the MBS and the validity of the approach informs the studies completed in these nations as well as challenges countries may face as they implement ingredient assessment and disclosure specified in the Partial Guidelines for Articles 9 and 10.11
We searched the University of California San Francisco Legacy Tobacco Documents Library (LTDL: http://legacy.library.ucsf.edu) between February 2013 and August 2014 for documents related to the MBS12 beginning with ‘Massachusetts Benchmark Study,’ ‘Massachusetts and ingredients’ and ‘predictor equation and ingredients.’ Internal company research studies were located by searching for specific constituents measured in the MBS prior to the industry proposing the MBS to MDPH together with the words ‘predictor,’ ‘regression’ and ‘smoke chemistry’. In addition, reports of product changes that manipulated the constituents measured in the MBS were found by searching for constituent with ‘reduction,’ ‘reducing’ and ‘decrease’ and by searching for scientists who worked on the MBS with phrases related to altering constituents (eg, formaldehyde). We searched for documents related to benchmark studies conducted in other countries including Canada, Australia and the UK. We evaluated implementing guidelines for FCTC Articles 9 and 1011 to compare their ingredient disclosure recommendations to those attempted in Massachusetts.
In 1996 Brown and Williamson (BW), Lorillard, Philip Morris (PM) and RJ Reynolds (RJR) sued Massachusetts in federal district court claiming that the Massachusetts Disclosure Act was preempted by the Federal Cigarette Labelling and Advertising Act and Smokeless Tobacco Act.7 The companies followed with a second suit in 1997 alleging that the Disclosure Act violated the Constitution’s Commerce, Fourteenth Amendment Due Process, and Takings clauses.8 The first case was heard in June 1997, and in August 1997 the court ruled against the companies on pre-emption without addressing the other claims.7 In December 1997 the court granted a preliminary injunction blocking enforcement of the Act, which was upheld by the Court of Appeals in November 1998.8 In January 2002, the Court of Appeals found that the Disclosure Act was an unconstitutional taking that deprived companies of property without due process.3
Meanwhile, in August 1998, the Massachusetts governor announced new regulations (independent of the still-being litigated Disclosure Act) that would require companies that had a national market share of larger than 3% to disclose the amount of constituents of mainstream and sidestream smoke by brand to MDPH and authorised MDPH to release the information to the public.13 ,14 The first list of constituents was due in July 2001.
The birth of the Massachusetts Benchmark Study
In December 1998, scientists from the tobacco companies met with MDPH and the US Centers for Disease Control and Prevention (CDC) to discuss the revised regulations and suggested they would be willing to provide ‘benchmark’15 information if MDPH agreed to delay further regulations until information was provided. The ‘benchmarking’ the companies proposed involved the companies providing a set of regression equations that would allow MDPH to reliably estimate 41 constituents in the mainstream and sidestream smoke for different brands of cigarettes using published levels of tar, nicotine and CO that the companies were required to report to the Federal Trade Commission (FTC).16 The four companies, BW, Lorillard, RJ Reynolds and PM met in January 1999 to select 25 brands to measure the levels of tar, nicotine, CO and the constituents MDPH specified in mainstream smoke. In a subset of 12 brands the companies would measure sidestream smoke under two different conditions. The first, was the FTC method, a standardised procedure recognised as unreliable measures of toxin exposure based on actual human smoking patterns,17 and the second condition was designed by the MDPH to better reflect human smoking behaviour.18 Each of the four companies developed their own lists of selected brands.19–21 After the companies developed their individual lists, they selected the brands to include in the MBS at the December 1999 meeting. (The available documents do not indicate why or how the companies made their individual or join brand selections).
The companies then proposed the MBS to MDPH,22 assuring MDPH that the selected brands reflected the range of products on the market across manufacturers, price tier, FTC tar yield, filter characteristics (eg, whether made of cellulose acetate or recessed charcoal), cigarette circumference, cigarette length, paper porosity, menthol, tobacco weight, packaging and market share. The MDPH did not explicitly ask for information on all of these features to be included. MDPH had asked how menthol, tar and nicotine were correlated with the 41 chemicals in the smoke that would be measured, and requested information on cigarette circumference, ventilation and percentage of sheet (reconstituted tobacco) during the December meeting with the companies.15 MDPH also requested information on blends and high level additives; the companies refused this information on the grounds of trade secret protection.23
In March 1999 MDPH agreed to suspend regulations until the MBS was completed 6–8 months later.24 Over the next year the companies worked together in an equal partnership and used the long-time tobacco industry law firm Covington and Burling to communicate study updates to the MDPH.10 ,23 The companies presented a summary of the results of the MBS to MDPH in February 200026 and the full report in July 2000.9
Consistent with the companies’ assertion in their December 1998 meeting with MDPH, the MBS concluded that, “(1) Mainstream smoke particulate phase constituent yields when cigarettes are smoked with the Massachusetts smoking regimen can be most reliably estimated from either a cigarette’s nicotine or ‘tar’ yields” and “(2) Mainstream smoke vapour phase constituent yields can be estimated from a cigarette’s CO yields under either FTC or Massachusetts smoking conditions”9.
Following the December 1998 meeting between MDPH and the companies where the concept of a benchmark study was discussed, a senior RJR scientist wrote a colleague that he was concerned that MDPH was focused on novel technologies, ingredients and processed tobacco that could impact constituent yields not predicted by tar and that the MBS did not address these issues.27
In January 1999, an RJR author of the MBS prepared a draft proposal that stated the brands selected for sidestream analysis were “significantly skewed to lower tobacco weights when compared to the distribution of tobacco weights typically found in the marketplace.”18 This meant the MBS design was biased towards lower levels of SHS estimates than is true in the market as a whole, but this sentence was omitted when the MBS was formally submitted to MDPH on 29 January 1999. Instead, the proposal stated, “The weight of tobacco in a particular cigarette configuration is, as we discussed, a design feature that is expected to affect sidestream smoke yields. The twelve brand styles we recommend using for sidestream smoke analysis represent a wide range of cigarette weights.”22 This change is important because the weight of the product (ie, the amount of material burned) is an important determinant of the amount of secondhand smoke produced.28
On March 22, 1999 MDPH accepted the proposed design and the companies started work.24 In contrast to the assurances the companies made to MDPH during these negotiations and in the final MBS report,22 ,29 they knew that cigarette design parameters, ingredients and blends could impact the constituents of mainstream smoke in ways not predicted by tar, nicotine and CO (table 1).
Tobacco companies internal research on constituents
Table 1 lists 10 illustrative examples of the tobacco companies’ extensive history of measuring and altering the constituent levels of their own products using reconstituted tobacco, filters, filter additives, and other novel technologies without changing the levels of tar, nicotine or CO.30–39 We were also unable to find any examples of the companies using benchmarking or regression equations to estimate constituent levels on their own or their competitors’ products. This section briefly summarises some of the internal research conducted by the tobacco companies (table 1) that produced results that conflicted with the conclusions in the MBS.
Blends and reconstituted tobacco
The companies have long researched the impact of different blends on smoke chemistry in ways not predicted by tar or nicotine. Even though different types of tobacco have different levels of carcinogenic tobacco specific nitrosamines and yield different levels of polycyclic aromatic hydrocarbons (carcinogens that can damage DNA) in smoke,40 the companies refused to provide MDPH information on the amounts or kind of tobacco in their products.10
BW found bright tobacco had significantly higher phenol levels in smoke than burley tobacco in smoke despite having less nicotine.30 PM compared the gas phase components of cigarettes made with 100% burley, bright and Turkish Tobacco.32 Bright and Turkish tobacco had similar levels of acetaldehyde and hydrogen cyanide despite Turkish having significantly less nicotine. These results contradict the MBS conclusion that smoke composition could be accurately predicted by nicotine levels.
In 1983 a PM study approved by Jerry Whidby, a PM author of the MBS, analysed the gas phase components of cigarettes filled with 100% burley and bright tobaccos treated with different fertilisers.35 Nitric oxide (NO) in the smoke was significantly lower for burley treated with a fertiliser traditionally used on bright tobacco compared to normal burley tobacco despite similar nicotine levels in the smoke. The cigarettes were described as a promising approach for NO reduction that maintained good subjective characteristics when tested by a panel of smokers. An additional study completed in 1973 by RJR33 provided evidence of how reconstituted tobacco impacted smoke chemistry in ways not predicted by nicotine.
The companies experimented with additives that affected the level of specific smoke constituents while not impacting tar, nicotine or CO. BW found adding urea could substantially decrease acetaldehyde and increase nitrogen oxides without significant changes in tar and nicotine,31 and Lorillard also reported lower levels of acetaldehyde for cigarettes with added urea without changes in nicotine.38 PM Europe37 found adding glycerol and/or propylene glycol to the filter of a cigarette could increase sidestream deliveries of acrolein and formaldehyde without impacting puff count, CO, nicotine or dry particulate matter. RJR found placing a special sodium salt in a cavity in the filter could reduce aceteldehyde and acrolein without reductions in tar or nicotine.36 These findings show that additives and humectants impact toxic constituents in mainstream and sidestream smoke in ways not predicted by tar, nicotine or CO levels.
There is also evidence of the companies acknowledging design factors and ingredients that influence smoke chemistry. For example, internal 1981 PM correspondence included lists of ingredients that impact acrolein in cigarette smoke, including highlighting a regression equation developed by the US Department of Agriculture that included nicotine, sugar, phosphorous tobacco weight and scopoletin (a coumarin) to predict acrolein in smoke34 (figure 1). PM scientists described this equation as the best approximation for acrolein levels because it gives coefficients for the most significant variables in the reaction that turns glycerol into acrolein. Although the regression equation in this document is not a strong predictor for acrolein (It is similar to the MBS regression equation for acrolein), it shows that PM was aware of factors that impacted acrolein formation beyond nicotine, tar and CO. The fact that the best regression equation that incorporates more complex factors is still not very accurate underscores the fact that regression equations should not be used to predict constituents in cigarettes and that the individual brands need to be measured.
International benchmark studies
In 1999, the Australian Federal Department of Health and Aging proposed annual emissions testing for all brand varieties with a market share greater than 3%, which British American Tobacco, Imperial Tobacco, and PM blocked such testing in court.41 In July 1999, while the MBS was underway, E. Windholz, director of corporate affairs of PM Australia/New Zealand, wrote the director of the Department’s Tobacco and Alcohol Strategies Section describing the MDPH letter agreeing to forego further regulations until the MBS was completed.42 Later, the director of Imperial Tobacco Australia, Nick Cannaar, told the Department that there was considerable evidence in the scientific public literature that the proportions of emissions in smoke per milligram of tar are essentially fixed for cigarettes with the same tobacco type.43 Confidential emails withheld on grounds of attorney-client privilege indicate that Windholz communicated with PM USA officials involved with the MBS regarding an Australian benchmark study.44
In 2001, the companies agreed on a one-time basis45 to provide the Department cigarette actual emissions results for 41 constituents in mainstream and sidestream smoke for 15 Australian brands the companies selected.46
In 2001, the UK Department of Health designed a constituents study protocol to be executed by the Tobacco Manufacturers’ Association, the tobacco companies’ trade association.47 The companies selected 25 brands that represented 58% of the marketplace and included a variety of tar yields, filter ventilation, paper permeability, cigarette circumference, length and blends. The brands were smoked under ISO machine smoking conditions and measured for the yields of different chemicals in the smoke.47 The study design and data delivered were similar to the MBS. Both studies provided the constituent data for the individual brands and used the entire data set to develop regression equations for tar and CO. The UK study did not develop a predictor equation for nicotine. Similar to the MBS, the UK study concluded, “For most analytes there is evidence of a linear relationship between ‘tar’ and carbon monoxide yields and the yield of the analyte being measured.”47
In June 1998, British Columbia (BC) Health Minister Penny Priddy announced new regulations requiring tobacco companies to report cigarette additives and ingredients and 44 toxic emissions.48 ,49 In July 1998, the BC government released a fact sheet based on the Health Canada-commissioned research on levels of 44 constituents in the three most purchased cigarette brands in BC.50 In developing similar regulations, Health Canada accepted proposals from the industry to reduce the number of tests required by using ‘benchmarking’51 in June 2000.52 In June 2000, Michael Borgerding, an RJR author on the MBS, provided a copy of a study called the ‘1999 Canadian Benchmark Study’ to the Bureau of Tobacco Control for Health Canada, and asked if the report would satisfy an exemption to the existing Tobacco Products Information Regulations.53 Health Canada accepted benchmarking as an alternative to annual emissions disclosures of 38 specific constituents.41 A subsequent report prepared by the Canadian Tobacco Control Programme concluded that the Canadian Benchmark study may have provided more accurate predictions than the MBS because the cigarettes in the sample had the same tobacco blends, filter materials, paper and additives.54 However, the Canadian benchmarking has the same fundamental flaws of all benchmarking systems in that the values presented are not actual values of cigarette constituents and smoke products and provide an incentive for the tobacco companies to modify products in ways not reflected in the reported tar, nicotine and CO levels.
Worldwide benchmark study
In 2004, PM scientists, including two who worked on the MBS, published a worldwide benchmark study55 in the pro-industry journal Regulatory Toxicology and Pharmacology that used tar, nicotine and CO to predict 42 other constituents under the ISO machine smoking conditions. They reported results for 48 PM brands the company selected from the USA, Latin America, Asia Pacific, Japan, European Union, Central Europe and the Middle East. PM concluded that more than 90% of the brands included in the study had smoke chemistry yields that were within the 95% prediction intervals using the benchmark regressions, and suggested that benchmarking had the potential to provide reliable predicted smoke constituent yield information.
In response to proposed regulations that would force tobacco companies to disclose information about the ingredients and constituents in their products, the companies provided MDPH with limited information about constituents in a select group of products and successfully delayed further regulatory action while the study was conducted. The limited information ultimately provided by the companies was of no use to MDPH or the general public and subsequent research into internal documents of the tobacco companies reveals that benchmarking is not a scientific method used in any of the tobacco companies' internal research. Our recent4 analysis of 100 industry reverse engineering studies of the amounts of ingredients and constituents in their own and competitors’ products did not contain any examples in which the companies used benchmarking of tar, nicotine or CO to predict the constituents.4 If benchmarking produced reliable estimates of constituent levels, presumably the companies would have used it internally.
Evaluation of the validity of benchmarking
The MDPH asked the CDC Office on Smoking and Health and Massachusetts Institute of Technology (MIT) to evaluate the MBS; subsequent analysis of the Canadian and Australian studies was completed by Australia’s VicHealth Centre for Tobacco Control.41 ,56 ,57
The CDC reported “developing a predictor model using the benchmark approach (ie, the MBS) for particulate and gas phase constituents in the mainstream and sidestream smoke of cigarettes will not provide much useful information to public health researchers and consumers.”56 The CDC observed there was a lack of a highly correlated functional relationship between the predicted values for specific compounds as presented on the best-fit curves presented in the report. For example, for phenol, the data are correlated best with the measured tar levels (R2=0.86), but in the tar range of 5–25 mg/cig the best-fit line of the benchmark model is essentially flat even though the measured phenol increased by 311% from 9 to 28 µg/cig (figure 2). The CDC also observed that the benchmark model gave much poorer fits for tobacco specific nitrosamines with NNN, NAT and NAB all having R2 between 0.64 and 0.70. NNN levels correlated best with nicotine but for an FTC delivery of 1.0 mg of nicotine NNN levels varied from 150 to 300 ng/cig.58 The CDC recommended direct product testing (what MDPH wanted in the first place) as a better approach.56
Harris analysed the relationship between the levels of tobacco specific nitrosamines and FTC tar, nicotine and CO yields for the brands included in the MBS using the data in the MBS.57 In a second analysis he added the manufacturer of the brand as an independent variable and found significantly better predictions for nitrosamines. Including the manufacturer increased the coefficient of determination (R2) from 0.38 to 0.78 for NNN, from 0.46 to 0.88 for NNK, and from 0.49 to 0.81 for NAT. In fact, the cigarette manufacturer was a stronger predictor of nitrosamine levels than nicotine and CO. Harris concluded “manufacturers’ blending and processing of tobacco may significantly influence a cigarette’s yield of carcinogenic nitrosamines” and “the present findings contradict the hypothesis (that is, the MBS) that the FTC tar level of a cigarette brand is, by itself, an adequate indicator of the yields of all other harmful smoke constituents.”57 Consistent with the company studies (table 1), Harris concluded that variables controlled by the manufacturer, including tobacco blends and the methods for processing tobacco, have a stronger impact on nitrosamines yields than tar alone.
Likewise, in 2007 Australia'a VicHealth Centre for Tobacco Control41 examined the efficacy of benchmarking for 13 chemicals with the highest toxicological risk by completing multivariate analysis on data that the tobacco companies submitted to Australia and Canada. Like Harris, they found that tar, nicotine and CO and filtration efficiency were poor predictors for most of the 13 chemicals. Country and manufacturer improved the predictions for all chemicals and strongly improved predictions for some, which they attributed to differences in tobacco sourcing, processing and blending.
All three of these analyses41 ,56 ,57 confirm the fact that the companies’ statement in the MBS that tar, nicotine and CO could be used to predict the levels of toxic constituents in different brands of cigarettes is not accurate.
While this subsequent data did provide some useful information to regulators in learning that manufacturing type has a powerful impact on nitrosamine levels, this fact should be not accepted as an argument to allow tobacco companies to evade full disclosure of product and smoke constituents on the grounds that providing some ingredient or constituent information is better than none. In addition, the tobacco companies have a history of manipulating study designs and misrepresenting information to the scientific community.59–62 The MBS, together with these other examples, underscore the danger of allowing the tobacco companies to control how they make ingredient and smoke constituent data available to regulators and the public. Indeed, the experience with the MBS adds to the case for open access to all brand testing and other scientific data on the grounds that such data would be valuable to regulators and the public even in the absence of other disclosure requirements.
Relevance to implementing the FCTC ingredient disclosure provisions
The lessons learned from the MBS are important to regulatory agencies around the world as they work to implement Partial Guidelines for Implementation of Articles 9 and 10 of the WHO Framework Convention on Tobacco Control.11 The disclosure regulations Massachusetts sought to implement are very similar to these guidelines, with one notable exception (table 2). The Massachusetts regulations did not address trade secrets; the Partial Guidelines for the FCTC states that “Governmental authorities should apply appropriate rules in accordance with their national laws when collecting information claimed to be confidential by tobacco manufacturers and importers in order to prevent unauthorised use and/or dissemination of this information.11 During the MBS the tobacco companies used the trade secret argument to avoid disclosing blend and additive information. Parties to the FCTC should be able to prevent the tobacco companies from using this trade secret argument if they have plans in place to prevent unauthorised use or dissemination of blend and additive information.
In addition, the Partial Guidelines of the FCTC state that Parties should specify the specific methods for the reporting of cigarette design features and that laboratories conducting testing for emission and ingredient disclosure should not be tobacco industry owned or controlled.11 The results of the MBS validate this concern as the tobacco companies selected the brands, provided the cigarettes and conducted all the testing, measurements and statistical analysis. As demonstrated in the Results, the companies selected cigarettes whose weights were skewed towards lighter brands,18 which has an impact on sidestream smoke yields, a point withheld from MDPH.22 RJR scientists also wanted to keep MDPH from focusing on novel technologies,27 which has direct relevance in 2015 as the tobacco companies are introducing a wide range of novel products, including e-cigarettes and heat-not-burn products. The companies’ control of testing and selection of brands also left MDPH at a serious disadvantage because MDPH had no control over how the assays were performed. As new products are introduced into the market countries need to be aware of the limitation of benchmarking.
The development of the WHO Tobacco Free Initiative's TobLabNet,63 a global network of government, academic, and independent laboratories established to strengthen national and regional capacity for testing tobacco products, including cigarette contents and emission products, provides countries the capacity to test tobacco products independent of the tobacco companies. TobLabNet eliminates the arguments the tobacco companies used to justify their control of testing for the MBS. Countries with limited technical or financial resources can tap TobLabNet resources to facilitate testing of ingredient and emission for regulatory decisions and disclosures without having to rely on the tobacco companies to do and interpret the measurements.64 The development of TobLabNet resources will also provide regulators with control over what is measured in cigarettes and why. In addition, implementing these testing facilities will provide accurate measurements of toxicants in commercial cigarettes and may help regulatory agencies analyse emerging technologies that the tobacco companies tried to divert attention from during the MBS process. Unfortunately, as of July 2015 there was no explicit mechanism for sustained funding to support development of ToblabNet facilities to support Parties’ implementation of the Partial Guidelines for Implementations of Articles 9 or 1011 of the FCTC. To ensure independence from tobacco companies for information on ingredients testing, as per the Partial Guidelines, the Conference of the Parties should consider the development of such a funding mechanism for TobLabNet.
The MBS experience, as well as other benchmarking and emissions based studies in Australia, the UK and Canada, provide information on how tobacco companies around the world may respond to the recommended ingredient disclosure regulations to implement FCTC Articles 9 and 10, particularly information about the tobacco blends used in their products. In February 1999 the director of MDPH requested that the MBS include information on the blends of tobacco and percentage of reconstituted tobacco used in the cigarettes in the MBS; the law firm representing the tobacco companies refused.23 At the conclusion of the study, MDPH again asked for blend information in coded form to protect the trade secrets.10 Again the request was denied with the tobacco company responding, “Providing blend specification, even in coded form, would permit anyone with access to the full data set, including the four companies who are active competitors to match those specifications to a specific product, thus destroying the value of the trade secret.10 These responses represent obstacles that regulators may face when attempting to enforce the best practices recommended by the FCTC for ingredient disclosure despite the fact that information claimed to be trade secret protected is routinely measured by rival companies and may not meet the definition of trade secrets.4 In addition, the development of TobLabNet laboratories with increased independent analytical capabilities bypasses this problem because it permits cigarettes to be tested independently to determine blend information. The resulting data from cigarettes and other emerging novel tobacco products around the world can then be used to conduct independent evaluation of the relationships between blend type and toxic carcinogenic emissions.
This paper was limited to the internal documents made available in LTDL up to when the tobacco companies designed and executed the MBS. We screened thousands of documents (the search term ‘Massachusetts Benchmark’ yielded 3658 documents and ‘Massachusetts and Borgerding’ yielded 4671 documents). However, since the ingredient disclosure regulations were heavily litigated, the company lawyers were included on communications related to the MBS and 345 documents remain confidential under claims of attorney client privilege. The available documents do not explain why the companies selected the brands that they did or how they selected the characteristics that they were willing to report in the MBS. The withheld documents may provide additional information about how cigarettes were selected for the study and how or why specific information was or was not presented to MDPH. In 1999, the US Department of Justice sued the major tobacco companies (including those involved in the MBS) for fraudulent and unlawful conduct under the Racketeer Influenced and Corrupt Organisations Act65 which may have led the companies to be more guarded about their communications regarding the MBS. Since it is not known how the cigarettes for the MBS were selected, the fact that they were selected by the tobacco companies raises the question of whether brands were selected with design features and technologies not representative of the majority of products on the market to predict low constituent yields.
The Massachusetts Benchmark Study was a large scale study that served to delay policy actions in the state of Massachusetts and ultimately provided no useful information to the scientific community or consumers of tobacco products. The companies knew there were a large number of variables that independently affected the constituents measured in the MBS, and used the study design to avoid providing by-brand information about the constituents in their product.
The fact that this study design was proposed and published by tobacco companies in response to regulations around the world demonstrates that the tobacco companies have widely used this approach as a way to avoid accurate reporting about the toxicity of their products. It also demonstrates the importance of communication between regulatory bodies when considering policy changes regarding tobacco products, particularly as they implement the product regulation provisions of the WHO Framework Convention on Tobacco Control.5 When considering tobacco policy, regulators should not negotiate with the tobacco companies or allow tobacco companies to conduct research as a means of influencing policy in a way that allows them to provide misleading information. These agencies should demand the same detailed by-brand information on tobacco product constituents and toxin deliveries to users that Massachusetts sought in the beginning.
What this paper adds
The tobacco companies had conducted studies confirming that physical design features, technologies and ingredients impacted the chemical yields of cigarettes in ways not predicted by tar, nicotine and carbon monoxide ‘benchmarking’.
‘Benchmarking’ is not an accurate way to determine deliveries of a wide range of toxins in cigarette smoke and should be rejected by public health authorities.
In implementing Framework Convention on Tobacco Control (FCTC) Articles 9 and 10, parties should reject studies conducted or controlled by the tobacco industry.
Contributors SG had the idea for the study. CV collected the data and prepared the first draft of the paper. SA-B contributed information about the relevance to implementation of FCTC Articles 9 and 10. All authors collaborated to prepare the final manuscript.
Funding This work was supported by National Cancer Institute Grant CA-087472. The funding agency played no role in the selection of the specific research topic, conduct of the research or preparation of the manuscript.
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement All source materials for this paper are publicly available. The tobacco documents are all available at the UCSF Legacy Tobacco Documents Library, http://legacy.library.ucsf.edu.