Article Text

Download PDFPDF

Researching policy impacts
  1. Ruth E Malone
  1. Correspondence to Professor Ruth E Malone, Social and Behavioral Sciences, University of California, San Francisco, San Francisco, CA 94118, USA; ruth.malone{at}

Statistics from

It is widely understood that policy-level interventions have had far greater effects on reducing tobacco use than individual-level measures. Yet, many continue to view the tobacco epidemic as a problem of individual decisions to use harmful products, rather than a problem of governments’ failure to properly protect the public from those unnecessary, addictive and lethal products in the first place. The papers in this e-issue consider the multiple impacts of policy changes and point to the importance of how those impacts are measured, as well as what we decide to measure and why it matters.

The research-policy relationship, as noted by Warner and Tam in 2012,1 is a complicated and sometimes cyclical one in which research influences policy adoption, policy adoption changes the environment and policy impacts may turn out to be different than anticipated, opening up new research areas. Many policies remain unevaluated, and such evaluations, given the complexity of policy contexts, are highly challenging to do well, requiring consideration of multiple factors that may not always be obvious. The paper by Been et al 2 is illustrative. They used an interrupted time series design to assess the effects of Scottish implementation of a national smoke-free policy on children’s hospitalisations and deaths from respiratory infections. Using their prespecified model, they found a puzzling gradual increase in such hospitalisations. Post-hoc exploratory break point analyses demonstrated that the increase actually preceded the implementation of the law by 16 months. After accounting for this, the policy was found to be associated with a modest, gradual decrease in respiratory events.

But health outcomes are not the only relevant measures of policy impact. Policy often changes social environments, even changing how businesses operate, creating new research questions. Does banning smoking in gambling establishments hurt these businesses? Tauras et al 3 studied the impact of a US state law prohibiting smoking on the gambling floors of casinos, showing that there was no significant negative economic impact to the casinos in terms of per capita admissions or revenues.

Modelling of various types is increasingly used to measure or predict policy impacts. Cleghorn et al 4 constructed a model to understand how 10% annual tobacco tax increases would affect the New Zealand adult population over a 10-year period, measuring quality-adjusted life years. They demonstrated that the greatest gains would accrue to the working-age population, with greater benefits for the indigenous Maori population among whom smoking rates are higher. In a study from the UK,5 a two-stage modelling process was used to predict future incidence, prevalence and cost of 17 smoking-related diseases if the tobacco duty escalator was increased from 2% to 5% above inflation. The authors show that such a policy measure would substantially increase cigarette prices, reduce disease burden and lower health and social care costs related to tobacco use. Another policy measure being increasingly implemented worldwide is point-of-sale display bans. He et al 6 constructed generalised linear models using data from 77 countries to consider impacts on smoking prevalence, demonstrating that such bans reduced overall adult daily smoking, male and female smoking. Such research provides important evidence in support of stronger policy measures to stem the epidemic.

Policies increasing the minimum age for purchasing tobacco have recently become popular in many jurisdictions, but do they play into the tobacco industry’s favoured ‘forbidden fruit’ positioning of their products, making them more attractive to adolescents, or do they effectively reduce the number of adolescents who become smokers? Callaghan et al 7 estimated the effects of such a policy on youth smoking, smoking frequency and intensity, and average monthly cigarette consumption. They report that those just above the minimum age limit had ‘significant and abrupt’ increases in the prevalence of current smokers, compared with those below the age limit. While the authors interpret their findings as providing evidence that such laws will reduce youth smoking, critics might argue that their findings could also be evidence of the ‘forbidden fruit’ effect and might have the unanticipated consequences of increasing young adult smoking. This points to the importance of messaging in policy research and policy discourse more generally. How we interpret a result and its relevance for policy may well depend on our frame of reference.

In another way of researching potential policy impact, a discrete choice experiment was conducted by Shang et al 8 to explore the impact of flavour, device type and health warning messages on youth preference for electronic nicotine delivery systems (ENDS). Fruity and sweet flavours significantly increased the probability of adolescents aged 14–17 years saying they would choose ENDS with menthol over tobacco flavour. The authors argue that restriction of flavours in such products could reduce youth uptake.

The cigarette pack as a site for policy intervention is a focus for another two papers. Leas et al 9 conducted a between-subject survey experiment to assess whether standardised packaging could reduce the possibility of erroneous ‘safety’ messages being drawn from the packaging of one popular cigarette brand in the USA, Natural American Spirit. Plain packaging was demonstrated to reduce smokers’ ratings of packs on an implied safety scale, even more when Australian-type packaging was used. Another study of packs illustrates the complexity of understanding potential policy impacts. US smokers were randomly assigned to receive either pictorial or text-only health warnings applied to their cigarette packs across a 4-week period, completing a baseline and follow-up survey which measured intentions to quit smoking and several mediating variables.10 Pictorial warnings were found to increase quit intentions by increasing negative affect. However, this was partly attenuated by message reactance and thus no changes in perceived risk were found.

Comparative studies often seek to estimate policy impacts by comparing trends across different geographical sites with different tobacco control climates. In a study comparing California, a recognised tobacco control leader, with the rest of the USA, Pierce et al 11 demonstrated that every $1 increase in cigarette taxes reduced consumption by 4.8 packs/adult/year and every 5% increase in the proportion of smokers reporting their homes were smoke-free was associated with 8.0 packs/adult/year lower consumption of cigarettes. The authors suggest that California’s leadership in dramatically reducing smoking ahead of the rest of the country overall was attributable to early tax and smoke-free policies, but was attenuated later in the study by lack of additional tax increases, a problem recently remedied at the ballot box after a hard-fought initiative campaign.12

Benefit–cost analyses are used to appraise proposed policies in advance of enactment. For example, in the USA, the Food and Drug Administration is required as part of its rule-making process to conduct an economic benefit–cost analysis. However, a proposed rule requiring graphic warning labels on packs has gone unimplemented partly because a benefit–cost analysis suggested the benefits would be seriously reduced by the ‘lost pleasure’ of smokers who quit as a result. The details of how and what to value in such analyses remain a topic of brisk debate, and Pechacek et al 13 examined 2015 US national survey data to further evaluate the assumptions related to ‘lost pleasure’. More than 80% of current smokers reported high or very high discontent due to their inability to quit smoking, perceived addiction and regret about starting to smoke. The authors concluded that those smokers who might be understood as preferring to continue smoking and would thus lose ‘pleasure’ if the policy was effective in persuading them to quit are far outnumbered by those with high levels of discontent and profound regret.

Policy is never solely determined by research findings, but research plays an important role in establishing the parameters of policy conversations, challenging common assumptions and opening new areas for policy discourse and action, including who benefits and who is burdened by policy change. Understanding policy impacts (or lack thereof) is part of the ongoing process of working towards a world in which health justice drives policy, but this understanding requires thinking about not only what is measured, but how—and what is not measured and why.


View Abstract


  • Funding The author has not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; internally peer reviewed.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.