Article Text
Abstract
Background Studies demonstrated that adolescent e-cigarette use is associated with subsequent tobacco smoking, commonly referred to as the gateway effect. However, most studies only investigated gateways from e-cigarettes to tobacco smoking. This study replicates a cornerstone study revealing a positive association between both adolescent e-cigarette use and subsequent tobacco use; and tobacco and subsequent e-cigarette use in the Netherlands and Flanders.
Design The longitudinal design included baseline (n=2839) and 6-month (n=1276) and 12-month (n=1025) follow-up surveys among a school-based cohort (mean age: 13.62). Ten high schools were recruited as a convenience sample. The analyses involved (1) associations of baseline e-cigarette use and subsequent tobacco smoking among never smokers; (2) associations of e-cigarette use frequency at baseline and tobacco smoking frequency at follow-up; and (3) the association of baseline tobacco smoking and subsequent e-cigarette use among non-users of e-cigarettes.
Findings Consistent with prior findings, baseline e-cigarette use was associated with higher odds of tobacco smoking at 6-month (OR=1.89; 95% CI 1.05 to 3.37) and 12-month (OR=5.63; 95% CI 3.04 to 10.42) follow-ups. More frequent use of e-cigarettes at baseline was associated with more frequent smoking at follow-ups. Baseline tobacco smoking was associated with subsequent e-cigarette use (OR=3.10; 95% CI 1.58 to 6.06 at both follow-ups).
Conclusion Our study replicated the positive relation between e-cigarette use and tobacco smoking in both directions for adolescents. This may mean that the gateway works in two directions, that e-cigarette and tobacco use share common risk factors, or that both mechanisms apply.
- electronic nicotine delivery devices
- public policy
- harm reduction
Data availability statement
Data are available upon reasonable request. Anonymised data and protocols are available upon reasonable request from the corresponding author (martinelli@ivo.nl).
This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.
Statistics from Altmetric.com
Introduction
Debates about electronic cigarettes are dividing many of those concerned with tobacco control. Proponents of e-cigarettes point at evidence which suggests that e-cigarettes are an effective smoking cessation aid1 and that e-cigarette use is substantially less harmful than tobacco smoking.2 Therefore, e-cigarettes could dramatically reduce disease and death caused by smoking.3 4 However, opponents are concerned that e-cigarettes attract new generations of youth into nicotine addiction,5 that most e-cigarette users simultaneously use tobacco6 7 and that it acts as a gateway to smoking tobacco.8 9
The gateway or stepping stones theory originates from the 1970s as a mix of academic and popular explanations of the observed sequence from cannabis use to other illicit drug use.10–12 While initially descriptive, the theory was also used to explain causal relationships of substance use.13 However, the theory was and remains controversial as it fails to exclude alternative explanations, particularly the notion that all substance use is associated with shared characteristics of individuals, especially a propensity to use drugs.14 More recently, the gateway theory is applied to e-cigarettes in both policy and research.15 The European Tobacco Products Directive, for example, states that ‘Electronic cigarettes can develop into a gateway to nicotine addiction and ultimately traditional tobacco consumption’.16
Various cohort studies show that in the last decade e-cigarette use among adolescents increased while tobacco use decreased.17–20 Simultaneously, longitudinal studies show that e-cigarette use is associated with initiation of tobacco smoking. The first study that revealed such association among adolescents was published in 2015.21 22 These findings generated ample media attention and led to restrictions for e-cigarettes in the USA, prohibiting the sale to persons under 18 years.23 Since then, cohort studies3 17 20 24–28 have followed finding similar associations, including in the Netherlands.29 Despite the above research into the relation between e-cigarette use and tobacco smoking, only few studies examined the reverse relation between tobacco smoking and initiation of e-cigarette use,21 30 31 which has also been found for tobacco and alcohol use, for example.32
In this paper, we present a replication study with new data using the same protocol as the cornerstone study by Leventhal et al.21 22 Replication is crucial to the scientific method as it enables one to build on demonstrated and confirmed findings.33 We collected data among adolescents in the Netherlands and Flanders, the Dutch-speaking region of Belgium. Both regions have similar legislation in which e-cigarettes (with and without nicotine) are treated as tobacco products, meaning that sales to minors (under 18 years) and advertising are prohibited.34 35 This is different in the original study setting in the USA, where few federal restrictions on e-cigarette marketing existed at the time of the study and some leading e-cigarette brands have been investigated for particularly targeting youth.36–39 In the Netherlands, in 2019, 25% of youth between 12 and 16 years old had ever tried an e-cigarette and 17% had ever tried smoking tobacco19 (see figure 1). Currently, more youth experiment with e-cigarettes than with tobacco. With this paper, we aim to answer the following research questions:
Is e-cigarette use associated with subsequent combustible tobacco use?
Is e-cigarette use frequency associated with subsequent tobacco smoking frequency?
Is combustible tobacco use associated with subsequent e-cigarette use?
Methods
Participants and procedure
Data were collected with online surveys between September 2018 and December 2019 throughout the Netherlands and Flanders. Since high schools are very hard to recruit for research, due to the large number of study requests and ongoing studies, we used multiple recruitment strategies. The research was presented as a study on smoking, alcohol, drugs and other risk behaviours. Different national and regional organisations (including addiction services, school health promotion and youth organisations) were approached to help contact schools. A representative selection of 82 schools were approached by telephone, of which 50 received recruitment packages. At 14 schools we reached the right contacts by phone. Another 10 schools were approached through informal networks of the research group. Lastly, a mass recruitment e-mail with reminder was sent to 580 schools in the Netherlands and 1343 in Flanders (Belgium). In total, 10 schools responded with interest in our study, and of those, all agreed to participate, including eight schools in the Netherlands and two in Flanders. The schools were provided with informed consent forms about the study, which they disseminated among parents and students. Students enrolled through passive consent and were excluded if they or their parents refused participation. Data collection involved three waves that took place 6 months apart. We provided participating schools with links to online surveys at each wave and the schools administered the surveys in the classes. Since recruitment of schools was difficult, some schools enrolled later. This meant that some schools only participated 6 months in the study and did not complete all three surveys. This partly explains the attrition rates across follow-ups (see online supplemental figure 1). Other reasons for attrition were that some students left the school (either to change schools or because they graduated), some schools had shop classes (such as wood or metal shop class, which meant they were at other locations), illness at the day of the survey and, lastly, one school could not be reached to conduct a follow-up despite many reminders.
Supplemental material
Measures
All measures are the same as in the replicated study21 and possess adequate psychometric properties in youth samples.40–44
E-cigarette and combustible tobacco use
Youth Risk Behavior Surveillance (YRBS)40 and Monitoring the Future Surveys (MTF)41 based items measured lifetime (ever) and past 6-month use (yes/no) of e-cigarettes and combustible tobacco products, which included: combustible cigarettes (including ‘even a few puffs’), full-size cigars, little cigars/cigarillos and hookah waterpipes. Lifetime (ever vs never) e-cigarette use at baseline was the primary exposure variable. Outcome variables were any use in the last 6 months (yes/no) of: (1) any combustible tobacco product; (2) combustible cigarettes; (3) cigars (full-size cigars or little cigars); (4) hookah; and (5) the number of different combustible tobacco products (range: 0–3). The terms ‘ever-smokers’ and ‘never-smokers’ refer to participants who either have ever or never used any of the three combustible tobacco products, respectively. The four-level continuous e-cigarette use frequency variable was categorised as never, prior (ever use with no past 30-day use), infrequent (1–2 days during the past 30 days) or frequent (≥3 days during the past 30 days). The cigarette use frequency variable consisted of non-smokers (smoked 0 day in the past 30 days); infrequent smokers (smoked 1–2 days in the past 30 days); and frequent smokers (smoked ≥3 days in the past 30 days).
Covariates
Variables that are potentially associated with risk of combustible tobacco use initiation based on previous literature45–50 were selected a priori as covariates, as they potentially overlap with both e-cigarette use and tobacco use. Covariate categories are described below.
Sociodemographics
Age, gender, ethnicity and highest parental education represented sociodemographics (table 1 contains response categories). In the main analysis, Belgian participants from Belgian (Flanders) schools were coded as Dutch students, as they belonged to the ethnic majority (native) group of their school.
Environmental variables
Environment indicators included family living situation, assessed by asking: ‘Who do you live with most of the time?’ (both biological parents/other).46 Family history of smoking was assessed by asking: ‘Does anyone in your immediate family (brothers, sisters, parents, or grandparents) have a history of smoking cigarettes?’ (yes/no). Peer smoking was measured by asking: ‘In the last 30 days, how many of your five closest friends have smoked cigarettes?’ (range: 0–5).51
Intrapersonal factors
Personality traits, mental health and psychological processes that are linked to risky behaviour, experimentation and smoking were assessed. Depressive symptoms were assessed through the 20-item Center for Epidemiologic Studies Depression Scale43 composite sum of past week frequency ratings (eg, 0=Rarely or none of the time (0–1 day) to 3=Most or all of the time (5–7 days)). Impulsivity was assessed with Temperament and Character Inventory52 Impulsivity subscale sum score (eg, ‘I often do things based on how I feel at the moment’; range: 0–5). Lifetime use of other (non-nicotine or tobacco) substances was assessed with the MTF and YRBS items on ever use (yes/no) of alcohol and 13 other substances. Delinquent behaviour53 was assessed by calculating a mean of frequency ratings for engaging in 11 different behaviours (eg, stealing, lying to parents; 1=Never to 6=Ten or more times) in the past 6 months. Susceptibility to smoking was measured by using a mean of a three-item index44 (eg, ‘Would you try smoking a cigarette if one of your best friends offered it to you?’ (1=Definitely not, 4=Definitely yes)). Smoking outcome expectancies were assessed by a mean of the two responses for ‘I think I might enjoy (…) smoking’ and (reversed) ‘I think I might feel bad (…) from smoking’ (1=Strongly disagree, 4=Strongly agree).54
Data analysis
Following the protocol of Leventhal et al,21 prevalence and associations of lifetime (ever vs never) e-cigarette use and lifetime (ever vs never) combustible tobacco use in the overall baseline sample were first analysed. Subsequently, study attrition and descriptive statistics in the sample of baseline never smokers were reported. For the primary analyses, separate generalised linear mixed models55 for each outcome were used with the follow-up data at two time points (6 and 12 months) as repeated measurements. For research question 1, each binary outcome (eg, any lifetime combustible tobacco product, cigarettes, cigars, hookah) was analysed with logistic mixed regression, whereas the ‘number of combustible products’ outcome was analysed with ordinal mixed regression. All models included baseline e-cigarette ever use, school and time (6-month vs 12-month follow-up) as fixed effects and were fit with and without adjustment for all covariates. To examine whether the association between baseline e-cigarette use and combustible tobacco use differed across follow-ups, the baseline ‘e-cigarette × time’ interaction term was added to each model. If this interaction was significant, the association between e-cigarette use and the outcome was examined separately for the 6 and 12-month follow-ups, including differences in outcome for ever and never use of e-cigarettes at baseline. If not significant, the interaction term was removed from the model, and associations between baseline e-cigarette use and the outcome were averaged across both follow-ups. Participants with missing data on baseline e-cigarette use or baseline measurements of the outcome variable were not included. For research question 2, an ordinal logistic mixed regression model was used to determine the association between baseline frequency of e-cigarette use and follow-up frequency of smoking, fit with and without adjustment for covariates, but always adjusting for time, school and baseline smoking frequency.22 Finally, for research question 3, on the association between baseline combustible tobacco ever use and ever use of e-cigarettes at follow-ups among never users of e-cigarettes at baseline, a similar analysis protocol as research question 1 was used: a binary logistic mixed regression model predicting e-cigarette use from baseline ever tobacco use status (with and without adjustment for covariates).
To account for missing data, multiple imputation was done with an imputation model that was identical to the analysis model including the covariates. The fully conditional specification method was used,56 which has been shown to yield unbiased parameter estimates and SEs.57 58 To obtain unbiased estimates of the relations between the predictor variables and the outcomes, missing data on baseline covariates and on the outcome variables were imputed.59 An analysis done on imputed data sets introduces power loss and also some uncertainty concerning the p value. By taking the number of imputations at least as large as the proportion of incomplete cases, 80 imputations in the present analysis, this is estimated to yield an acceptable power loss59 and a Monte Carlo SE of the p value 0.05 less than 0.01.55 Although analysis with multiply imputed data is valid under the assumption of missingness at random,56 this assumption cannot be tested. Therefore, for research question 1, a sensitivity analysis was performed using imputations according to a scenario violating this assumption. We chose to impute according to a pessimistic scenario, in that it decreased the association between baseline e-cigarette use and an outcome, by imputing the smoking outcome at follow-up in the same way for both baseline ever and never e-cigarette users. At each follow-up, the highest school-specific incidences of each outcome were taken as smoking probabilities for the imputation. Significance was set to 0.05 and all tests were two tailed. All primary analyses were conducted in Mplus V.7.2.
Role of funding source
The funder had no role in the study design, the collection or analysis of the data, the interpretation of data, the writing of the report or the decision to submit the article for publication.
Results
Study sample
All students in the recruited schools were eligible to participate and enrolled (n=2845). Data were collected for 2839 participants at baseline, including 2185 participants who never smoked tobacco at baseline, of which 1276 (58%) and 1025 (47%) participants completed the 6 and 12-month follow-ups, respectively. The analytical sample available for analyses across waves for research question 1 is depicted in online supplemental figure 1.
Descriptive analyses
Table 1 shows that boys were more likely than girls to have ever used e-cigarettes. Furthermore, age, highest parental education and all environmental and intrapersonal factors showed significant associations with e-cigarette use at baseline.
Table 2 shows that in the combined sample of ever and never smokers, baseline e-cigarette use was positively associated with baseline use (ever) of combustible tobacco products. Prevalence of combustible tobacco products was between 5.6% (cigars) and 17.8% (cigarettes). 21.6% (n=603) of participants reported ever use of e-cigarettes; 14.7% (n=412) ever use of e-cigarettes as well as combustible tobacco; 7.1% (n=197) combustible tobacco only; and 71.4% (n=1994) never used e-cigarettes nor combustible tobacco.
Associations between baseline e-cigarette ever use and combustible tobacco ever use at follow-ups in baseline never smokers
Table 3 shows that, among never smokers, baseline ever e-cigarette users were more likely than never users to have used combustible tobacco at 6-month (23.2% vs 5.5%; % difference=17.7; 95% CI 9.8 to 25.6) and 12-month (44.4% vs 10.8%; % difference=33.6; 95% CI 23.1 to 44.1) follow-ups. Table 4 displays the results after imputation. Interaction of e-cigarette use (ever) with time was significant (OR=3.03; 95% CI 1.39 to 6.63) in the unadjusted analysis. Separate analyses at both follow-ups indicated a stronger association for baseline e-cigarette use and combustible tobacco use at the 12-month follow-up (OR=11.39; 95% CI 6.04 to 21.50), compared with the 6-month follow-up (OR=3.76; 95% CI 2.12 to 6.65). Analysis for time (of follow-up) was significant for both e-cigarette ever and never users, indicating an increase in the use of combustible tobacco across time in both groups. In the adjusted model, the interaction between baseline e-cigarette use and time was also significant for any combustible tobacco product use (OR=2.99; 95% CI 1.37 to 6.50). Furthermore, baseline e-cigarette use was associated more with any combustible tobacco use at 12-month follow-up (OR=5.63; 95% CI 3.04 to 10.42), compared with the 6-month follow-up (OR=1.89; 95% CI 1.05 to 3.37).
Table 3 also shows that, among never smokers, e-cigarette use (ever vs never) at baseline was positively associated with higher odds of smoking cigarettes, cigars and hookah. In the unadjusted analyses in table 4, e-cigarette use (ever vs never) at baseline was also positively associated with each of these outcomes at both follow-ups. In the adjusted model, baseline ever e-cigarette use was associated with cigarette use at the 12-month follow-up and with number of tobacco products at both follow-ups. Interaction with time was not significant for hookah use and cigar use, thus associations of baseline ever use of e-cigarettes with these outcomes averaged across time were examined. The relation between e-cigarette use at baseline and hookah use (averaged over 6 and 12-month follow-ups) was significant (OR=3.69; 95% CI 1.75 to 7.77). Of the intrapersonal factors, only smoking susceptibility was positively associated with combustible tobacco use at both follow-ups (see table 4).
Additional sensitivity analyses were performed (see online supplemental table 3). Findings were consistent in the adjusted models for any tobacco use, combustible cigarette use, cigar use and number of tobacco products. For hookah use, there was a significant interaction of e-cigarette use and time. Only the association between e-cigarette use and hookah use at 6-month follow-up remained significant.
Association between baseline e-cigarette use frequency and tobacco use frequency at follow-ups
Online supplemental table 1 shows that, for the unadjusted model, higher scores on the four-level baseline e-cigarette use frequency variable were associated with greater odds of higher smoking frequency averaged across both follow-ups (OR=2.11; 95% CI 1.69 to 2.64). After adjusting for covariates, this association remained significant (OR=1.63; 95% CI 1.29 to 2.06). In the unadjusted analysis, the positive association between baseline e-cigarette use and follow-up smoking frequency differed between the different baseline smoking groups (OR=0.70; 95% CI 0.52 to 0.94, p=0.02), the association being stronger among baseline non-smokers (n=2180; OR=2.53; 95% CI 1.99 to 3.23) than baseline infrequent (smoked 1–2 in the past 30 days; n=41; OR=1.84; 95% CI 1.46 to 2.31) and frequent (smoked ≥3 in the past 30 days; n=127; OR=1.33; 95% CI 0.89 to 1.99) smokers (not shown in online supplemental table 1).
Association between baseline ever smoking and follow-up ever e-cigarette use at follow-ups in baseline never e-cigarette users
Online supplemental table 2 shows that among never users of e-cigarettes, smoking at baseline was positively associated with higher odds of using e-cigarettes averaged across both follow-ups for the unadjusted (OR=5.22; 95% CI 3.06 to 8.92) and adjusted (OR=3.10; 95% CI 1.58 to 6.06) analyses.
Discussion
The current replication study confirms that e-cigarette use by non-smoking adolescents is associated with increased odds of subsequent combustible tobacco smoking initiation; that more frequent e-cigarette use is associated with more frequent subsequent tobacco smoking; and that the ‘reverse’ association applies, namely that tobacco smoking among never users of e-cigarettes is associated with greater odds of later e-cigarette use. These findings are consistent with previous studies,21 22 30 31 employ various adjusted analyses and sensitivity analyses and extend the findings from the US to a European context.
Collectively, this suggests that e-cigarettes may indeed act as a gateway to tobacco smoking for youth, as we see that youth who used e-cigarettes are more likely to try smoking tobacco later. We also found a dose-related relation, namely that the higher the frequency of e-cigarette use was at baseline, the higher the frequency of subsequent tobacco use was at follow-up. This may indicate a causal relation for using both products. Additionally, our analyses suggest a ‘reversed’ gateway of tobacco smoking to e-cigarette use. Yet, these gateways may operate through different mechanisms. E-cigarettes may be a smoother introduction to tobacco smoking60; and reversely, the transition from tobacco smoking to e-cigarette use could point at transitioning to a less harmful behaviour. However, both behaviours may also stem from common risk factors, such as increased propensity to experiment with substances,14 61–63 where final choices on which specific substance is used first may depend on personal preferences, circumstances or cultural norms.32 Dual users of e-cigarettes and cigarettes, for example, share similar characteristics (eg, impulsivity) regardless of which product is used first.64
It remains uncertain whether the found associations are causal, which the gateway hypothesis suggests, or an indication of shared risk factors for e-cigarette and tobacco use. While multiple predictors linked to tobacco smoking were addressed in our study, it remains uncertain whether all common liability risks were controlled for. Studies show that at least some youth with low propensity for tobacco smoking, nevertheless, used e-cigarettes.24 65 66 Another study found that relative to a propensity-matched control group without initial e-cigarette use, non-smoking adolescent e-cigarette users were less likely to become established smokers (30-day use and 100+ lifetime cigarettes).67 This suggests that e-cigarettes do not function as a gateway to tobacco for everyone. Additionally, a study found that the relationship between e-cigarette use and subsequent smoking among adolescents may be weakened through interventions.68 Likely, multiple mechanisms are complementary and the relation between causes and outcomes is complex and multidirectional.69
A critique on quantitative studies on the gateway from e-cigarette to tobacco smoking is that the key question of ‘why’ is not addressed.63 A popular explanation is that the nicotine in e-cigarettes makes individuals dependent and this may cause them to try combustible cigarettes.70 71 The authors of the original gateway theory even describe nicotine as a gateway drug that primes the brain for other substance use, ‘whether the exposure is from smoking tobacco, passive tobacco smoke, or e-cigarettes.’72 A qualitative study of youth who use(d) e-cigarettes found that e-cigarettes can be a ‘smoother’ introduction to the concept of smoking and that they appear to remove boundaries to smoking: ‘There used to be a barrier that said either you’re a smoker or a non-smoker, now I can smoke without smoking’.60 Consequently, e-cigarette users get used to the acts and gestures of smoking which facilitates the transition to tobacco smoking. However, information in this area is still limited and more investigation is needed, including studies among tobacco smokers who started with e-cigarettes to assess reasons for taking up smoking.
Evidence and understanding of associations between e-cigarettes and tobacco and the long-term consequences of e-cigarette use among youth are still limited,28 partly because of the relative novelty of e-cigarettes and still evolving technologies. Until this has been resolved, policymakers should carefully consider whether to act on the dangers (eg, a gateway to tobacco) or rather the benefits (eg, a potentially less harmful alternative to tobacco smoking) of e-cigarettes for smokers. Given the wide availability and marketing of e-cigarettes73 74 and that available evidence provides reasons for caution, prevention of e-cigarette use among non-smoking youth is recommended.
Limitations
The original and current study used binary and categorical outcome measures of smoking. These measures are limited, as smoking intensity (how many cigarettes per day) was not assessed and a fairly low cut-off point for frequent smoking (≥3 days during the past 30 days) was used because of the limited number of participants. Also, the majority (68.3%) of ever users of e-cigarettes had already smoked tobacco at baseline, which may mean that the current study sample is already too old for the main research question focusing on never users of tobacco. Furthermore, substance use was included as a dichotomous variable, meaning, for example, that students who drank alcohol and used cannabis on a weekly basis got the same score as students who had one drink in their lifetime. Additionally, the response of participating (vs invited) schools was low, which may have resulted in selection bias. However, relevant differences between students from participating schools and students at non-participating schools are not expected, as the response rate of students who were present at the time of the survey in participating school classes was 100%. Furthermore, the dropout rate from baseline to follow-up was high and may have affected the relations between e-cigarette use and tobacco use. However, the imputation of missing outcomes for research question 1 according to a pessimistic scenario (see the Data analysis section) yielded the same relations, indicating robustness of the results. Lastly, we coded Flemish (Belgian) students as Dutch in the main analyses because they are part of the (native) ethnic majority of their schools. Thus, differences between Dutch and Belgian students were not assessed, even though (cultural) differences may exist. However, preliminary analyses, in which Flemish students were coded as ‘not Dutch’, yielded similar results in the main analyses.
Conclusion
For this study, we replicated an American cornerstone study21 22 on the association between e-cigarette use and tobacco smoking in the Netherlands and Flanders and found similar results. High school students in the Netherlands and Flanders who used e-cigarettes at baseline were more likely to report initiation of combustible tobacco use over the next year compared with never users of e-cigarettes. These findings add to a growing body of studies that indicate a link between e-cigarette use and tobacco smoking in youth. The gateway hypothesis was further explored by also analysing the ‘reverse’ relation between baseline tobacco smoking and subsequent e-cigarette use. A similar association was found which may indicate that the gateway works in two directions, that e-cigarette use and tobacco smoking share common risk factors, or that both mechanisms apply. Different types of studies are needed to better understand why there are such associations and whether these may be causal relationships.
What this paper adds
What is already known on this subject
E-cigarette use is associated with subsequent tobacco smoking among youth.
A popular explanation of this relation is that e-cigarettes function as a gateway to tobacco smoking for youth.
What important gaps in knowledge exist on this topic
Most studies only investigate the relation between e-cigarette use and tobacco smoking in one direction. Less is known about the opposite relation between tobacco smoking and subsequent e-cigarette use.
It is not yet determined whether the gateway hypothesis or the common liability hypothesis best explains the relation between e-cigarette use and tobacco smoking.
What this paper adds
This study replicated the findings from an American cornerstone study on the relationship between e-cigarette use and tobacco use. Findings indicate both the relationship between e-cigarette use and subsequent tobacco smoking and the opposite relation.
The association between e-cigarette use and tobacco smoking is likely bidirectional for adolescents.
Data availability statement
Data are available upon reasonable request. Anonymised data and protocols are available upon reasonable request from the corresponding author (martinelli@ivo.nl).
Ethics statements
Ethics approval
The Maastricht University Ethical Review Board approved the study (2018-0418).
References
Supplementary materials
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Supplementary Data
This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.
Footnotes
Contributors TM: writing–original draft, validation, formal analysis, data curation. MJJMC: formal analysis, validation, writing–original draft. HdV, RT, CPvS: conceptualisation, methodology, writing–review and editing. VK: investigation, project administration, resources. GEN: conceptualisation, methodology, funding acquisition, writing–review and editing, supervision.
Funding This study was funded by NWO (401.16.012).
Competing interests None declared.
Provenance and peer review Not commissioned; externally peer reviewed.