Article Text

Pictorial cigarette pack warnings: a meta-analysis of experimental studies
  1. Seth M Noar1,2,
  2. Marissa G Hall3,
  3. Diane B Francis1,
  4. Kurt M Ribisl2,3,
  5. Jessica K Pepper2,3,
  6. Noel T Brewer2,3
  1. 1School of Journalism and Mass Communication, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
  2. 2Lineberger Comprehensive Cancer Center, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
  3. 3Department of Health Behavior, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
  1. Correspondence to Dr Seth M Noar, School of Journalism and Mass Communication, 382 Carroll Hall (CB 3365), University of North Carolina at Chapel Hill, Chapel Hill, NC 27599-3365, USA; noar{at}email.unc.edu

Abstract

Objective To inform international research and policy, we conducted a meta-analysis of the experimental literature on pictorial cigarette pack warnings.

Data sources We systematically searched 7 computerised databases in April 2013 using several search terms. We also searched reference lists of relevant articles.

Study selection We included studies that used an experimental protocol to test cigarette pack warnings and reported data on both pictorial and text-only conditions. 37 studies with data on 48 independent samples (N=33 613) met criteria.

Data extraction and synthesis Two independent coders coded all study characteristics. Effect sizes were computed from data extracted from study reports and were combined using random effects meta-analytic procedures.

Results Pictorial warnings were more effective than text-only warnings for 12 of 17 effectiveness outcomes (all p<0.05). Relative to text-only warnings, pictorial warnings (1) attracted and held attention better; (2) garnered stronger cognitive and emotional reactions; (3) elicited more negative pack attitudes and negative smoking attitudes and (4) more effectively increased intentions to not start smoking and to quit smoking. Participants also perceived pictorial warnings as being more effective than text-only warnings across all 8 perceived effectiveness outcomes.

Conclusions The evidence from this international body of literature supports pictorial cigarette pack warnings as more effective than text-only warnings. Gaps in the literature include a lack of assessment of smoking behaviour and a dearth of theory-based research on how warnings exert their effects.

  • Packaging and Labelling
  • Public policy
  • Global health

This is an Open Access article distributed in accordance with the terms of the Creative Commons Attribution (CC BY 4.0) license, which permits others to distribute, remix, adapt and build upon this work, for commercial use, provided the original work is properly cited. See: http://creativecommons.org/licenses/by/4.0/

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Introduction

Tobacco use is the leading cause of preventable death and disease in the world, causing nearly six million deaths each year.1 While tobacco product packaging is a key part of marketing efforts to make tobacco use appealing,2 ,3 regulators can use that same packaging to communicate the health risks of tobacco products to consumers.4 A pack-a-day smoker potentially sees a cigarette pack an estimated 7300 times per year (20 views/day×365 days/year). Messages on these packs would generate exposure far outweighing exposure from other antitobacco communications, such as mass media campaigns.5

The combination of high exposure, nearly universal reach, and very low cost has made pictorial warnings on cigarette packs a core tobacco control strategy globally. The WHO Framework Convention on Tobacco Control (FCTC) calls for the implementation of large warnings on tobacco products.6 The treaty's Article 11 specifies that health warnings may include pictures, and subsequent guidelines for implementation state that pictorial warnings are ‘far more effective’ than text-only messages.6 By 2015, implementation of pictorial warning policies had occurred in 77 countries and jurisdictions that are home to nearly 50% of the world's population.7

As pictorial cigarette pack warnings have proliferated globally, so has research on their impact.8 ,9 Observational studies suggest increased cessation behaviour after the introduction of pictorial warnings,10 ,11 and such studies typically have high external validity. However, isolating the effects of pictorial warnings on smoking behaviour in such studies has proven difficult because governments often introduce the warnings alongside other tobacco control policies.8 ,12 By contrast, experiments can offer strong evidence of the causal impact of pictorial warnings, isolating the effects of warnings on key outcomes. For this reason, experiments are an important tool for studying the effects of pictorial warnings.

Previous research on pictorial cigarette pack warnings

A large and growing empirical literature has documented the effects of pictorial cigarette pack warnings. Some evidence suggests that pictures and imagery may be more effective than text-only messages at communicating health risks.13 ,14 Compared with text-only warnings, pictorial warnings have been associated with stronger beliefs about the harms of smoking and higher motivation to quit smoking.10 ,15–21 However, while some studies find that smokers and non-smokers rate pictorial warnings as more effective than text-only warnings,22–26 other studies have reported conflicting findings.27–29 For instance, studies have found that graphic, pictorial warnings result in poorer recall than less graphic or non-graphic warnings,28 do not increase youth's expectations to be non-smokers a year later,29 have no effect on beliefs about cancer or addiction among non-smoking adolescent boys,26 and are effective in lowering smoking intentions for Canadians but not for Americans.27

Reviews of the literature on pictorial cigarette pack warnings have taken a variety of approaches. A narrative review by Hammond8 suggested that cigarette pack warnings can be effective in promoting smoking cessation, especially when warnings are large, full-colour, and use graphic images. While useful and an important contribution for understanding pictorial warnings, this review did not provide a systematic, quantitative synthesis of pictorial warning effects. A systematic review by Monarrez-Espino et al30 examined 21 mostly observational studies of the impact of pictorial warnings on reduced smoking, quit attempts and smoking cessation. Monarrez-Espino et al found that most of these studies were of poor methodological quality; for this reason, their findings on the impact of pictorial warnings on smoking behaviour were inconclusive. Importantly, this review did not examine many factors that are likely pre-requisites to changes in behaviour, such as attention to warnings, cognitive and emotional reactions to warnings, and changes in beliefs about smoking.

While these recent reviews have summarised portions of the cigarette pack warnings literature,8 ,9 ,30 no meta-analysis has synthesised the experimental literature on pictorial cigarette pack warnings. To inform international research and public policy, we conducted a meta-analysis of experiments examining the impact of pictorial cigarette pack warnings. Our research question was: across the body of experimental studies, what are the effects of pictorial cigarette pack warnings compared with text warnings?

Method

Search strategy

We used a comprehensive search strategy to locate studies relevant to this meta-analysis. The search strategy involved three steps. First, we searched PsycINFO, PubMed, EMBASE, Web of Science, Communication & Mass Media Complete, Business Source Complete, and CINAHL computerised databases in April 2013. We used the following Boolean terms: (cigarette* OR tobacco) AND (warning* OR label* OR pictorial OR graphic OR messag* OR text*). Second, we examined the reference sections of five narrative reviews of cigarette pack warnings.8 ,9 ,31–33 Third, we examined the reference lists of the final set of articles included in our review. We included all reports that came up in our searches—peer-reviewed journal articles, book chapters, and grey literature (eg, dissertations, publicly available reports)—as long as the full text was available.

To be included, a study had to use an experimental protocol that tested warnings intended for cigarette packs. Studies had to report data on both a pictorial warning condition and a text-only condition. The experimental design could be between subjects (individuals were randomised to different warning label manipulation conditions—eg, text vs pictorial) or within subjects (individuals viewed multiple warning label manipulations). We excluded studies of non-cigarette tobacco products, public service announcements or multicomponent interventions, and warnings embedded in cigarette advertising. We excluded observational studies that asked individuals to report on warnings that they had seen on their own prior to the study. Finally, articles reporting the studies had to be available in English.

Figure 1 depicts the search process. The initial database search yielded 14 139 total references, and searching through the other methods yielded 424 references. After removing duplicates, there were 8486 references. Two reviewers independently examined all study titles for relevance, reducing the number to 497, and then reviewed abstracts, further reducing the number to 98. During this process, we excluded articles only if both reviewers independently determined the article as irrelevant. Then, the two reviewers independently examined the full text of the 98 articles and tracked reasons for study exclusion. If the two reviewers made a different determination about the classification of a particular article, they consulted with a third referee to resolve the discrepancy and make a final determination. This process resulted in a total of 35 articles reporting on 37 studies. Since some studies reported results separately for different subgroups, we analysed effect sizes for each independent sample. Thus, the meta-analysis synthesised effects of 48 independent samples.

Figure 1

PRISMA flow diagram showing the study screening process.

Article coding

Coding study characteristics

Two independent coders coded all articles on several features, including participant characteristics such as gender, age, race/ethnicity and country of origin, and study characteristics such as within-subject/between-subject design and use of theory. The coders also coded warning characteristics: warning type (pictorial, text), nature of pictorial labels (image only, image with text), whether pictorial text and control text matched, number of different labels viewed, number of times viewing each label, number of exposure sessions, exposure medium (warning only, warning on two-dimensional pack, warning on three-dimensional pack), exposure channel (digital, printed or paper, cigarette pack), exposure control (researcher-controlled exposure, participant-controlled exposure), and label order (random, non-random).

The coders and the first author met to discuss each article after it was coded to compare the two coders’ work. All discrepancies between coders were resolved through discussion between the two coders and the first author. We calculated intercoder reliability for each characteristic. Most categories had perfect agreement, and the mean per cent agreement was 96%. Cohen's κ34 had a mean of 0.94.

Coding dependent variables

We developed a list of more than 30 dependent variables assessed in the studies based on an initial review of the literature. We then grouped these outcome variables into theory-based construct categories. Table 1 lists the constructs that at least two studies assessed, along with our definition of the construct, an example item from a study in the meta-analysis, and examples of the authors’ original terminology. We grouped all constructs into five categories. The first group (attention and recall) assessed participants’ attention to warnings and ability to recognise or recall the warnings. The second group (warning reactions) assessed participants’ cognitive, emotional and physiological reactions to warnings. The third group (attitudes and beliefs) assessed participants’ smoking or cigarette pack-related attitudes and beliefs. The fourth group (intentions) assessed participants’ intentions or willingness to act. Finally, the fifth group (perceived effectiveness) assessed participants’ perceptions of the effectiveness of warning messages.

Table 1

Outcomes assessed in experimental pictorial warning studies

We organised these five groups of constructs into a message impact framework (figure 2), which is based on communication and psychological theory46–52 and previous tobacco warnings theory and research.29 ,53–55 The framework suggests that the characteristics of a warning affect the extent to which the warning will be noticed and later recalled, and that attention to (and recall of) the warning influences warning reactions. Warning reactions are thought to, in turn, affect attitudes/beliefs, which later influence intentions and ultimately behaviour. Given that cigarette pack warnings are often in public view, they may spark interpersonal communication and social interactions.49 These social interactions, such as talking about the warnings with friends and family members, may affect individuals’ attitudes, beliefs, and reactions to the warnings.

Figure 2

Message impact framework applied to research on cigarette pack warnings.

Perceived effectiveness is also pictured in figure 2, and such ratings are commonly used in formative work to develop and assess messages.56 ,57 However, currently, there is no evidence to suggest that these ratings play a direct role in warning message effects (ie, that participants must perceive a message to be effective in order for it to be so). Thus, perceived effectiveness is not pictured as an integral part of this framework.

Effect-size extraction and calculation

We characterised the effect size of the benefit of pictorial over text warnings by using the standardised mean difference statistic d (ie, the difference in treatment and control means divided by the pooled SD).58 Because d can be upwardly biased when based on small sample sizes,59 we applied the recommended statistical correction for this bias.58 We calculated effect sizes from data reported in the article (eg, means and SDs; frequencies) using standard formulas.58 For within-subject designs, using statistics such as t and F for effect-size computation can bias effect-size estimates.60 However, using raw statistics such as means and SDs does not yield this bias.60 ,61 Thus, we applied conventional formulas58 and computed all within-subject effect sizes from raw (vs inferential) statistics. If the article did not provide data necessary for effect-size computation, we requested the necessary data from authors.

We computed effect sizes for outcomes that were (1) identified as a meaningful construct from the communication or psychological literature and (2) assessed in two or more studies. When studies reported multiple pictorial warning or text-only conditions, we averaged these (text or pictorial) conditions together when computing effects. When studies reported more than one measure of the same variable (eg, two measures of negative smoking attitudes), we averaged them together. In order to keep effect sizes consistent and interpretable, we gave a positive sign (+) to effect sizes in which the pictorial warning condition performed better (ie, yielded a finding conducive to behavioural change) than the text-only condition, and a negative sign (−) to effect sizes in which the pictorial warning condition performed worse than the text-only condition.

Meta-analytic approach

Analyses weighted effect sizes by their inverse variance and combined them using random effects meta-analytic procedures.58 We calculated the Q statistic and I2 to examine whether heterogeneity existed among the effect sizes. Most dependent variables had too few studies to perform moderator analyses. As some form of perceived effectiveness for motivation to not smoke was commonly assessed, we created a composite variable to use in moderator analyses. This composite variable consisted of all relevant perceived effectiveness motivation variables (ie, the first 5 constructs listed in table 4), and assessed the extent to which participants perceived pictorial warnings as motivating smokers or non-smokers to avoid smoking cigarettes. For the seven studies that measured a motivation to avoid cigarette use construct in multiple ways, we averaged together the effect sizes for all relevant outcomes. We performed moderator analyses on this variable using mixed-effects analyses, which allowed for the possibility of differing variances across subgroups.58 We calculated effect sizes for hypothesised categorical moderators along with their 95% CIs, and we statistically compared those effect sizes using the Qb statistic. We also examined correlations between continuous moderator variables and effect size. We conducted all analyses using Comprehensive Meta-Analysis software V.2.2.046 and SPSS V.21.

Results

Study characteristics

The 37 studies were conducted in 16 different countries, with the most conducted in the USA (43%), followed by Canada (11%) and Germany (11%) (see online supplementary file).23–25 ,27–29 ,35–45 ,62–79 While studies were published as early as 2000, most studies (68%) were published between 2009 and 2013. Fifty per cent of study samples included both smokers and non-smokers, 47% were smokers only, and one study was of non-smokers only. Most studies (65%) included both young adults and adults but not adolescents. Eleven studies (29%) included adolescents in their sample, although only four studies (11%) focused solely on adolescents. Study sample sizes ranged from 25 to 4890 (median=197), and the cumulative sample size across all studies was 33 613. Nineteen of 37 studies (51%) mentioned a theory as informing the study.

Studies varied considerably in how many different warnings they showed to participants (mean number of pictorial warnings=6.39, SD=10.86; mean number of text warnings=5.24, SD=10.91). However, in most studies, participants viewed a particular warning only once (86%), and they participated in only one viewing session (97%; table 2). In all but one study, participants were assessed only immediately after viewing the warning labels. The most commonly used exposure medium for warnings (57%) was a two-dimensional pack displayed on a computer with the participant controlling the duration of the exposure to the warning (ie, how long they viewed the warning before advancing further in the survey). Most pictorial warnings (89%) included both images and text, though some (8%) consisted of images only. In many cases (43%), the text in the pictorial warning matched the text presented in the comparison condition, though in several cases the text differed (43%).

Table 2

Characteristics of warning manipulations in studies in the meta-analysis

Studies assessed more than 30 unique constructs (see online supplementary file). Each individual study assessed between one and eight constructs (M=2.75, SD=1.96). We identified 25 constructs that appeared in at least two studies, and these constructs are the focus of the meta-analysis (table 1).

Effectiveness of pictorial warnings

Pictorial warnings exhibited statistically significant effects relative to text warnings for 13 of 17 effectiveness outcomes (most at p<0.001; see table 3), with 12 of 17 effects favouring pictorial warnings. Compared with text-only warnings, pictorial warnings showed an advantage for two of four attention constructs (figure 3), with pictorial warnings scoring higher on both attention attracting (d=0.79) and attention duration (d=1.74). We observed no effects on response time or recall/recognition of warning text.

Table 3

Effectiveness of pictorial warnings: mean weighted effect sizes (d) and heterogeneity statistics

Figure 3

Forest plot displaying effect sizes and 95% CIs for attention outcomes.

For warning reactions, pictorial warnings showed an advantage for five of six constructs (figure 4). Relative to text warnings, pictorial warnings elicited more cognitive elaboration (d=1.70), negative affective reactions (d=0.54), credibility (d=0.15), lower smoking cravings (d=0.08), and aversiveness (d=0.58). However, pictorial warnings also elicited greater psychological reactance (d=−0.50).

Figure 4

Forest plot displaying effect sizes and 95% CIs for warning reactions.

Pictorial warnings showed an advantage on two of four attitude and belief constructs (figure 5), with effects on both negative pack/brand attitudes (d=0.79) and negative smoking attitudes (d=0.55) relative to text warnings. No effects were observed on perceived likelihood of harm (d=0.02) or self-efficacy to quit (d=0.01). Moreover, pictorial warnings showed an advantage on all three intentions constructs (figure 6), with effects on lower willingness to pay (d=0.26), intention to not start smoking (d=1.82), and intention to quit smoking (d=0.54).

Figure 5

Forest plot displaying effect sizes and 95% CIs for attitudes/beliefs.

Figure 6

Forest plot displaying effect sizes and 95% CIs for intentions.

Homogeneity analyses indicated that 9 of 17 effect sizes were heterogeneous, with many outcomes exhibiting extremely high heterogeneity: 6 of these 9 outcomes had an I2 of greater than 90 (table 3).

Perceived effectiveness of pictorial warnings

Pictorial warnings exhibited statistically significant effects relative to text warnings for all eight perceived effectiveness outcomes (see table 4 and figure 7). Pictorial warnings were more likely to be rated as effective in motivating not starting smoking (d=1.03), motivating reducing smoking (d=0.41), motivating themselves (d=0.79) or others (d=1.09) to quit smoking, and motivating (smokers or non-smokers) to not smoke (d=0.24). Participants also perceived pictorial warnings as deterrents to giving cigarettes as a gift (d=1.64), as generally effective (d=1.00), and as effective for themselves and others (d=0.52).

Table 4

Perceived effectiveness of pictorial warnings: mean weighted effect sizes (d) and heterogeneity statistics

Figure 7

Forest plot displaying effect sizes and 95% CIs for perceived effectiveness.

Moderator analyses

The weighted mean effect size for the composite variable motivation to avoid cigarette use was statistically significant (p<0.001) at d=0.95 (CI 0.56 to 1.34, k=15, cumulative n=13 023). This effect was statistically heterogeneous, Q=1310, p<0.001, I2=99. Moderation analyses found that studies using a within-subject design (k=7) differed from those using a between-subject design (k=8; Qb=7.50, p<0.01; table 5). Studies using within-subject designs (d=1.37) had larger effect sizes than those using between-subject designs (d=0.51). Statistical comparisons of samples of smokers (k=9) to non-smokers and mixed samples (k=6) did not reach statistical significance (p=0.07). The trend, however, suggested that non-smokers and mixed samples (d=1.39), rated warnings as being more effective than did smokers (d=0.65). Analyses of exposure medium (two-dimensional vs three-dimensional pack), exposure channel (digital vs paper or pack), and country of sample (USA vs other countries) found no differences. Effect sizes were also not significantly correlated with gender composition, r (14)=−0.02 (p=0.98) or age, r(14)=−0.32 (p=0.49).

Table 5

Moderators of perceived motivation to avoid cigarette use

Discussion

The purpose of this meta-analysis was to expand our understanding of the impact of pictorial cigarette pack warnings on smoking-related outcomes. Across an international body of experimental studies, we found effects favouring pictorial warnings for 12 of 17 effectiveness outcomes. Compared with text warnings, pictorial warnings (1) attracted and held attention better; (2) garnered stronger cognitive and emotional reactions; (3) elicited more negative pack attitudes and negative smoking attitudes; and (4) more effectively increased intentions to not start smoking and to quit smoking. These findings suggest that pictorial warnings are superior to text warnings at multiple stages of our message impact framework (figure 8) and may move people towards quitting smoking. While a recent systematic review did not find evidence that pictorial warnings were effective,30 that review examined only smoking behaviour and included mostly observational studies. The experimental studies we examined here showed promising evidence of effects.

Figure 8

Effects of pictorial warnings on cigarette packs (summary of findings).

In our meta-analysis, it is especially noteworthy that pictorial warnings changed negative smoking attitudes and quit intentions, as these variables are associated with quitting behaviour. For example, a previous meta-analysis of eight longitudinal studies found that negative smoking attitudes and quit intentions predicted subsequent quit attempts.80 Our review also demonstrated that pictorial warnings increased cognitive elaboration more than text-only warnings. Cognitive elaboration may play a particularly important role in the quitting process. A recent longitudinal study found that increased attention to cigarette pack warnings led to greater cognitive elaboration, which ultimately predicted quit attempts (via mediation through worry and quit intentions).81

In our review, pictorial warnings were also superior to text warnings on all eight perceived effectiveness outcomes. Smokers and non-smokers rated pictorial warnings as more effective than text warnings at motivating not starting, reducing and quitting smoking. These findings are noteworthy, as research has suggested that messages with higher perceived effectiveness ratings may be more effective than those with lower ratings.82–84 Taken together, these findings on effectiveness (eg, increased quit intentions) and perceived effectiveness (eg, increased perception that warnings motivate quitting) offer strong evidence to support pictorial cigarette pack warnings as more effective than text-only warnings.

Mediators of pictorial warning effects

Our meta-analysis provides support for the notion that pictorial warnings elicit changes in an array of psychosocial constructs that are plausible mediators of the warning-behaviour link. Future studies should identify constructs that mediate pictorial warnings’ effects on smoking behaviour. The potential mediator most proximal to behaviour is intentions, one of the strongest predictors of behaviour according to both theory85 and empirical research.80

We saw the effects for many beliefs and attitudes that are plausible mediators according to theories of health behaviour.50 ,85 ,86 In our meta-analysis, pictorial warnings elicited greater fear-oriented reactions than text warnings, as intended. This is consistent with previous research and theory on fear appeals, which has found that such appeals increase fear as a mechanism for attitude, intention and behavioural change.87 However, fear appeal theories, such as the extended parallel process model (EPPM),52 also suggest that two key constructs help explain how people respond to fear appeals—perceived threat and efficacy. On these two key constructs, we found no effects of pictorial warnings. It was surprising that only five studies (with 8 effect sizes) in the meta-analysis assessed perceived likelihood of harm, a component of perceived threat, when much theorising situates this as a central construct in fear appeals and risk communication.52 ,88 ,89 While our meta-analysis did not find an effect of pictorial warnings on perceived likelihood of harm, the reason is unclear. It may be due to inadequate perceived likelihood measures or a failure to change risk beliefs because of an inadequate dose of warning exposure. It is also important to note that the lone study that assessed perceived severity of harm, another component of perceived threat, found a large effect.36 More careful studies of the impact of pictorial warnings on perceived likelihood and severity are required before we can make stronger conclusions regarding the role of risk beliefs in warning effectiveness.

Moreover, considering the potential importance of self-efficacy in predicting how people respond to health messages, pictorial warnings may be more effective if they increase self-efficacy to quit smoking. However, only two studies in this meta-analysis measured self-efficacy, and none manipulated it experimentally. Several countries, including Brazil, Australia and New Zealand, require that pictorial warnings provide information about cessation services, which may be a promising strategy for increasing smokers’ self-efficacy to quit.90 ,91 Future pictorial warning studies should examine the role of self-efficacy in predicting changes in intentions and behaviour, and the interaction of efficacy and threat, testing hypotheses from the EPPM.52

Previous fear appeal research and theory also suggest that fear-oriented communications can elicit reactance.87 While we found that pictorial warnings elicited greater reactance than text warnings, the studies in our meta-analysis focused on the emotional aspect of reactance, and largely ignored the cognitive elements. Research characterises reactance as a construct comprised of both emotion (eg, anger, irritation) and cognition (eg, defensive processing, denial).92 Future studies on pictorial warnings should advance a more comprehensive measurement approach and should examine whether reactance leads to adverse outcomes, such as lower quit intentions or greater smoking behaviour.

Finally, our meta-analysis found pictorial warnings increased aversiveness (ie, the warnings being ‘difficult to look at’). How aversiveness plays into effects of such warnings is unclear. For example, actions such as looking away from, covering up, or avoiding the warnings may reduce the warnings’ effects; alternatively, these behaviours may actually be markers of the warnings’ effectiveness. One observational study revealed that Canadian smokers who avoided pictorial warnings were equally likely to think about the warnings or engage in cessation behaviour than those who did not attempt to avoid the warnings.93 Further research is needed to understand how aversiveness affects pictorial warning effectiveness.

Theoretical and measurement issues

Despite the existence of several models to guide warnings research,53–55 our meta-analysis revealed a lack of consensus as to what outcomes experimental studies should assess. Outcomes varied widely, with little consistency across studies. The framework presented in this article (figure 2), along with our empirical findings (figure 8), may help bring theoretical clarity to the literature. In particular, we recommend that researchers pay particular attention to issues of construct validity, taking care to explicitly describe what they measure and how they measure it, and ensuring that the name accurately matches what the measure is assessing. Researchers should also carefully consider what types of constructs and measures are most appropriate for their study given the stage of warnings research in a given country, and the goals of the particular study.

Study design

Our meta-analysis included both experiments that manipulated pictorial warnings between subjects (participants viewed only text or only pictorial warnings) and within subjects (participants viewed both warning types). The between-subject studies had markedly smaller effect sizes for perceived effectiveness for motivation to avoid cigarette use than within-subject studies. Why was this the case? One explanation may be a reference point effect.94 That is, when one evaluates a text warning followed by a pictorial warning, the pictorial warning seems that much more powerful. In that case, the participant may rate the pictorial warning higher than would have been the case otherwise.95 Another possibility is that seeing multiple warnings makes it easier to focus on the presence or absence of graphics, the central attribute that differs. This is similar to Hsee's evaluability hypothesis that explains what happens when an important attribute is hard to evaluate independently.96 In the real world, participants are likely to see only text or pictorial warnings on cigarette packs, and so it may be that between-subject studies provide a more accurate estimate of effect size of that difference. However, comparisons among different pictorial warnings may best be done using within-subject studies, as people will likely see many such warnings on packs.

A final study design issue is that no study in this meta-analysis tested warnings by placing them on smokers’ cigarette packs. Instead, participants had only brief exposure to warnings, often on a computer screen. By contrast, the large body of observational literature examines smokers who have had multiple exposures to warnings on their cigarette packs.8 Such studies are invaluable, as they can potentially demonstrate population-level effects that result from warning policy changes. However, internal validity threats make strong causal conclusions from such studies difficult, especially on outcomes such as smoking behaviour.30 Therefore, we recommend that future experimental studies place warnings on smokers’ cigarette packs, follow participants over time, and assess smoking behaviour as an outcome.97–99

Gaps and future directions

This review identified several areas for future research. First, our meta-analysis identified only a single experimental study that assessed behaviour.69 Future experimental pictorial warning studies should place warnings on smokers’ cigarette packs, measure smoking behaviour over longer periods of time, and include meaningfully intensive exposures.97 Second, given that smoking is a social behaviour,100 a better understanding of how social interactions influence warning effectiveness is needed. While some studies have assessed discussions about warnings,19 ,93 ,101 ,102 studies often use this variable in a composite scale representing depth of processing, making it impossible to tease out the influence of social interactions. Third and finally, an area that remains understudied is the effect of pictorial warnings on reducing smoking initiation. While warnings may be seen as messages designed only for smokers, some warnings could be specifically designed for youth and non-smokers.19 Future research should examine the differential impact of pictorial warnings on smokers and non-smokers, with careful attention to the potential for pictorial warnings to discourage smoking initiation among youth.

Conclusion

Our study was the first to estimate the effects of pictorial cigarette pack warnings through a meta-analysis of experimental studies. This investigation demonstrated that pictorial warnings were more effective than text warnings on the vast majority of outcomes studied, affecting several constructs, including intention to not start smoking and intention to quit smoking. Future research examining the effects of pictorial cigarette warnings should assess impact on smoking behaviour, including initiation and cessation. Studies should also adopt more explicit hypotheses derived from behavioural theory, use validated and standardised measures, include multiple follow-up assessments, and better advance a theoretical understanding of how warnings exert their effects.

What this paper adds

  • Pictorial warnings on cigarette packs are a key international tobacco control policy. The current study presents the first meta-analysis of the experimental literature on pictorial cigarette pack warnings. This review found:

    • Pictorial warnings were more effective than text warnings on 20 of 25 outcomes examined in the meta-analysis;

    • Pictorial warnings were more effective (eg, increased quit intentions) and perceived to be more effective (eg, rated as likely to motivate smokers to quit) as compared with text warnings;

    • Pictorial warnings were more effective than text warnings in changing outcomes relevant to both non-smokers (eg, intentions to not start smoking) and smokers (eg, intentions to quit smoking).

  • Future experimental research should examine the impact of pictorial warnings on smoking behaviour. Future studies should also apply more behavioural theory, and test which theoretical variables mediate the effects of pictorial warnings. Such work would further strengthen the international evidence base for pictorial warnings and advance our ability to better understand the ‘active ingredients’ that underlie such warnings, informing more effective tobacco control policies.

Acknowledgments

The authors wish to thank the following people for providing additional data for this meta-analysis: Sonia A Duffy, Ahmed I Fathelrahman, Geoffrey T Fong, Sabine Glock, David Hammond, Ashish Nimbarte, James Nonnemaker, Ellen Peters, Daniel Romer, James F Thrasher and Ekant Veer.

References (References in the meta-analysis are marked with an asterisk)

  1. 1.
  2. 2.
  3. 3.
  4. 4.
  5. 5.
  6. 6.
  7. 7.
  8. 8.
  9. 9.
  10. 10.
  11. 11.
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
  23. *23.
  24. *24.
  25. *25.
  26. 26.
  27. *27.
  28. *28.
  29. *29.
  30. 30.
  31. 31.
  32. 32.
  33. 33.
  34. 34.
  35. *35.
  36. *36.
  37. *37.
  38. *38.
  39. *39.
  40. *40.
  41. *41.
  42. *42.
  43. *43.
  44. *44.
  45. *45.
  46. 46.
  47. 47.
  48. 48.
  49. 49.
  50. 50.
  51. 51.
  52. 52.
  53. 53.
  54. 54.
  55. 55.
  56. 56.
  57. 57.
  58. 58.
  59. 59.
  60. 60.
  61. 61.
  62. *62.
  63. *63.
  64. *64.
  65. *65.
  66. *66.
  67. *67.
  68. *68.
  69. *69.
  70. *70.
  71. *71.
  72. *72.
  73. *73.
  74. *74.
  75. *75.
  76. *76.
  77. *77.
  78. *78.
  79. *79.
  80. 80.
  81. 81.
  82. 82.
  83. 83.
  84. 84.
  85. 85.
  86. 86.
  87. 87.
  88. 88.
  89. 89.
  90. 90.
  91. 91.
  92. 92.
  93. 93.
  94. 94.
  95. 95.
  96. 96.
  97. 97.
  98. 98.
  99. 99.
  100. 100.
  101. 101.
  102. 102.

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Footnotes

  • Contributors SMN, KMR and NTB originated the study. SMN, MGH and DBF drafted the manuscript. MGH and DBF coded the studies. All authors provided critical feedback on drafts of the manuscript and approved the final manuscript.

  • Funding Research reported in this publication was supported by The National Cancer Institute and FDA Center for Tobacco Products (CTP) under Award Number P3OCAO1 6086-3832; 4CNC: Moving Evidence into Action, a collaborating site in the Cancer Prevention and Control Research Network (Grant U48/DP001944) from the Centers for Disease Control and Prevention and the National Cancer Institute; and a seed grant from the School of Journalism and Mass Communication at UNC Chapel Hill. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or the Food and Drug Administration.

  • Competing interests None declared.

  • Provenance and peer review Not commissioned; externally peer reviewed.