Objective: To examine the psychometric properties, test-retest reliability, and convergent construct validity of five indicators of nicotine dependence (ND) symptoms in adolescents.
Design: Analysis of baseline data from a prospective study on the natural history of ND in 1264 adolescents aged 12–13 years.
Setting: Ten Montreal high schools.
Subjects: 233 grade 7 students who had smoked cigarettes one or more times in the three months preceding the baseline data collection.
Main outcome measures: Five indicators of ND symptoms including two that are multi-dimensional (a proxy measure of ICD-10 criteria for tobacco dependence; the Hooked on Nicotine Checklist (HONC)) and three new indicators of “symptom clusters” that emerged from principal component analysis (ND/cravings, withdrawal symptoms, self medication).
Results: All five indicators demonstrated acceptable internal and test-retest reliability. The correlation between the HONC and ND/cravings was 0.910. All other correlations between indicators ranged between 0.716–0.824. There was considerable overlap in the independent correlates identified for each indicator.
Conclusions: All five indicators performed well psychometrically. Until the meaning, relative importance, and usefulness of each scale is clarified in longitudinal work, decisions regarding which scale(s) are most informative will depend more on the content of the scales, the need for a multi- or unidimensional indicator, and whether or not the scale is theory based.
Statistics from Altmetric.com
- DSM-IV, Diagnostic and statistical manual of mental disorders, fourth edition
- HONC, Hooked on Nicotine Checklist
- ICD-10, International statistical classification of diseases and related health problems, 10th revision
- ND, nicotine dependence
- OR, odds ratio
Contrary to prevailing theories advocating that nicotine dependence (ND) develops only after lengthy periods of regular or daily exposure to cigarettes,1 recent evidence suggests that ND symptoms occur even with the irregular, sporadic smoking that characterises the early stages of smoking onset.2 Increased understanding of the process by which ND is established is crucial to developing effective prevention and cessation strategies for adolescents, yet few studies to date have examined the natural history of ND. This relates in part to the lack of a widely accepted, theoretically derived, and psychometrically sound tool to measure ND in adolescents.3 This article describes the derivation, and compares the psychometric properties, reliability, and convergent construct validity of five indicators of ND symptoms used in an ongoing prospective study investigating the development of ND symptoms in relation to the onset of smoking. Data for this analysis were drawn from the baseline data collection.
The McGill University study on the Natural History of Nicotine Dependence in Teens (NDIT study) is a prospective study of 1264 students initially aged 12–13 years, recruited from all grade 7 classes in a convenience sample of 10 Montreal secondary schools (seven English speaking and three French speaking schools). The primary objectives are to measure the onset of ND symptoms in relation to tobacco exposure, and to investigate the relative aetiologic importance of environmental and genetic risk factors for ND. Secondary schools were selected in consultation with local schools boards and school principals, to include a mix of French and English speaking schools, urban, suburban, and rural schools, and schools located in high and low socioeconomic neighbourhoods. In addition all schools purportedly had a relatively low turnover of students. All 13 schools approached agreed to participate; three schools were excluded, two because of a low return rate of consent forms, and one because school administrators could not guarantee cooperation over the entire study. All subjects and a parent/guardian provided signed informed consent. Over half (56.2%) of eligible students participated in the baseline data collection; the relatively low response is related in part to the need for blood draws for genetic analysis, and also to a labour dispute in Quebec that resulted in teachers in several schools refusing to collect consent forms.
Baseline data collection in the Fall (autumn) of 1999 comprised questionnaires and standardised anthropometric4 and blood pressure measurements.5,6 French or English questionnaires were administered according to the language used in each study school, either classroom by classroom or in the school cafeteria to groups of classes. In one school with 85 subjects, we repeated the baseline questionnaire administration one week later to examine test-retest reliability of the study variables.
The study population for the analyses described in this paper includes the 233 subjects from among the baseline sample of 1264 students, who had smoked one or more times, even just a puff, in the three months preceding the baseline questionnaire (201 of the 233 subjects (86.6%) had smoked one or more times in the past month (that is, were past-month smokers)).
Description of variables
Sociodemographic data included student’s date of birth, sex, language(s) spoken, main language spoken at home, country of birth of each of the student, biologic father and mother, number of years the students has lived in Canada, family composition, and family origin.
Lifetime smoking history was measured in five items including: (1) Have you ever IN YOUR LIFE smoked a cigarette, even just a puff (drag, hit, haul)?7 (No; Yes, 1 or 2 times; Yes, 3 or 4 times; Yes, 5 to 10 times; Yes, more than 10 times); (2) Check the one box that describes you best7 (I have never smoked a cigarette, even just a puff; I have smoked cigarettes (even just a puff), but not at all in the past 12 months; I smoked cigarettes once or a couple of times in the past 12 months; I smoke cigarettes once or a couple of times each month; I smoke cigarettes once or a couple of times each week; I smoke cigarettes every day); (3) How old were you when you smoked a whole cigarette (down to or close to the filter) for the first time; (4) How old were you when you first took cigarette smoke into your lungs for more than one puff; (5) Have you smoked 100 or more whole cigarettes in your life? (100 cigarettes = 4 packs of 25) (Yes; No).
Six items measured smoking in the past three months beginning with the month preceding questionnaire administration.8 One item for each month measured the number of days on which the subject had smoked during the month, and one item for each month measured the number of cigarettes smoked per day on average (on the days subject had smoked) during that month.
The number of cigarettes smoked during the week preceding questionnaire administration was measured in a seven day recall9 (one item). A measure of cigarette “single time exposure” was obtained by asking subjects how much of the cigarette he/she usually smokes (one or a few puffs; less than half of it; about half of it; most of the cigarette; right down to or near the filter; and I don’t know (I smoke so little/this does not apply to me)). Finally, students reported how often during the past three months they smoked a cigar or cigarillo, or used chewing tobacco or snuff (never, a bit to try, once or a couple of times a month, once or a couple of times a week, usually every day).
For analysis, data on lifetime smoking history and number of cigarettes smoked in the week preceding baseline data collection were used to create four smoking status categories including “triers” (smoked only once or twice in lifetime), “sporadic smokers” (smoked more than twice in lifetime, but not daily and number of cigarettes smoked per week ≤ 1.0), “weekly smokers” (smoked more than twice in lifetime, but not daily, and number of cigarettes smoked per week >1.0), and “daily smokers” (smoked every day).
Quit attempts in the past three months were measured in one item: Did you seriously try to quit smoking completely and forever? (Yes, I quit completely and have remained non-smoking ever since; I never tried to quit; Yes, I tried to quit but failed).
ND symptom items
A total of 46 items that measured numerous diverse ND symptoms in youth were included in the questionnaire, including the 10 items that comprise the Hooked on Nicotine Checklist (HONC).10 The remaining items emerged from consultation with seven North American experts on youth smoking, and from six focus groups interviews with teenage smokers aged 14–17 years.11 The item specific test-retest reliability and convergent construct validity of many of these items were reported in an earlier study.12 In this current study, most items had multi-level response choices.
Tolerance was measured in three items: How true are each of the following statements for you? (not at all true, a bit true, very true): (1) Compared to when I first started smoking, I need to smoke a lot more now to be satisfied; (2) Compared to when I first started smoking, I can smoke much more now before I start to feel nauseated or ill; and (3) I get dizzy or nauseous when I smoke my usual amount of cigarettes.
Depression symptoms were measured in a six item scale that has been previously validated.13–16 Subjects reported how often (never, rarely, sometimes, often) in the past three months they: (1) felt too tired to do things; (2) had trouble going to sleep or staying asleep; (3) felt unhappy, sad or depressed; (4) felt hopeless about the future; (5) felt nervous or tense; (6) worried too much about things. Responses were summed to create a depression symptom score (mean (SD) = 2.4 (0.7); median = 2.3; Cronbach’s α = 0.76 in past three month smokers). For analysis, scores were categorised into few (0–1), some (2–3), or many (≥ 4) depression symptoms.
ND symptom indicators
We studied five ND symptom indicators, including an existing multi-dimensional measure called the HONC,10 an indicator based on the International statistical classification of diseases and related health problems, 10th revision (ICD-10) criteria for tobacco dependence,17 and three new ND “symptom clusters” that emerged from principal component analysis of all the ND items in the questionnaire.
The HONC was derived from a theory based definition of ND, which postulates that a person is hooked when they have experienced a loss of autonomy over their use of nicotine.10 It includes 10 dichotomous (yes, no) items that assess cravings, loss of control, withdrawal symptoms, and psychological addiction. In a longitudinal study of adolescents, the endorsement of a single HONC item (indicating diminished autonomy) was associated with a failed attempt at cessation (odds ratio (OR) = 29), continued smoking until the end of follow up (OR = 44), and daily smoking (OR = 58). HONC scores correlated with the maximum amount smoked (r = 0.65), and the maximum frequency of smoking (r = 0.79). Internal reliability was 0.94 and a one factor solution explained 66% of the total variance.10
For this study, the HONC was modified slightly (table 1). Multiple response choices were provided for each item, allowing that the intensity of symptoms might reflect different degrees of lost autonomy. The question, “Have you ever tried to quit, but couldn’t?” was replaced with, “In the past 3 months, did you seriously try to quit smoking completely and forever?” The question, “Have you ever felt like you were addicted to tobacco?” was replaced by two items, “How physically addicted to smoking cigarettes are you?” and “How mentally addicted to smoking cigarettes are you?”. All of the items in the modified HONC indicate diminished autonomy over the use of tobacco as defined by the autonomy theory.10 Endorsement of any affirmative response category of any HONC item (that is, a positive HONC) was considered to indicate a loss of autonomy. In addition, a continuous HONC score was calculated by summing the scores obtained for each item.
To create an indicator based on the six ICD-10 criteria for tobacco dependence,17 ND related questionnaire items were selected to measure each criterion (table 1). An item was considered positive only if the most extreme response choice was endorsed; a criterion was considered positive if the subject endorsed any of its items (the withdrawal syndrome required that two items be endorsed). The subject was categorised as nicotine dependent if he/she met three or more of the six ICD-10 criteria, as defined by ICD-10. In addition, the number of positive criteria was summed to obtain a continuous score of ICD-10 tobacco dependence.
Finally, we used principal component analysis with orthogonal varimax rotation to identify parsimonious clusters of ND symptoms from among the ND items included in the questionnaire. The number of factors selected was based on the scree test and a minimum eigenvalue of 1.0. A factor loading of at least 0.40 was selected as the criterion for determining which items contributed to a given factor.18 This analysis resulted in the creation of three new scales (table 1): (1) a 16 item general indicator of ND and cravings; (2) a six item indicator of withdrawal symptoms; and (3) a six item indicator of self medication to alleviate negative affect.
All HONC items, and nine of 16 ND/craving items, overlapped with items in the ICD-10. Seven ND/cravings and HONC items overlapped. Five withdrawal items overlapped with ICD-10 items, and four withdrawal items were also among HONC items. Items comprising the self medication score did not overlap with any items in the other four indicators.
Internal and test-retest reliability
The internal consistency of the five ND symptom indicators was measured by Cronbach’s α. Values above 0.85 indicate acceptable internal consistency.19 Test-retest reliability was examined in a subsample of past three month smokers from one school with 85 participating students. While patterns of smoking (and hence exposure to nicotine) are likely to be variable in this age group, a lapse of one week for the retest was judged to be optimal to minimise recall bias due to measures being too close in time, and to reduce the likelihood that patterns of smoking had changed substantially over time. We computed the intraclass correlation coefficient20; a “reliability of 0.75 is a fairly minimal requirement for a useful instrument”.21
Convergent construct validity
Because no gold standard exists against which the criterion related validity of ND measures can be assessed, we examined convergent construct validity in three ways: (1) first, because evidence of convergent construct validity is provided if the indicator examined correlates as expected with other indicators known or thought to be related to the construct under investigation,21 we tested the association between each indicator and smoking status, and then quit attempts (both of which are known to be associated with ND, at least in adults22); (2) next, we studied the correlation between the five ND symptom indicators; and finally (3) we identified the independent correlates of each ND symptom indicator, from among measures of cigarette exposure and sociodemographic characteristics, in multivariate regression analyses. Similarity in the correlates identified could indicate that the indicators measure similar constructs. The independent correlates of the ICD-10 indicator, dichotomised into tobacco dependent (yes, no), were identified in logistic regression analyses. Scores for the other four indicators were divided into tertiles and independent correlates were identified in polychotomous logistic regression.
Compared to 992 subjects in the baseline sample who had not smoked in the past three months, a higher proportion of past three month smokers were female (64.8% v 48.9%; p < 0.0001), they were slightly older (mean (SD) age 12.5 (0.6) years v 12.2 (0.5) years; p < 0.0001), there was a much higher proportion of Francophone subjects among past three month smokers (54.9% v 25.3%; p < 0.0001), and fewer past three month smokers had been born outside Canada (4.7% v 8.4%; p = 0.062). There was little difference in the proportion of subjects living in single parent families (12.5% of past three month smokers v 8.6% of subjects who had not smoked in the past three months, p = 0.093).
Subjects reported a wide range of smoking experiences: 65 of 233 (28.1%) were triers; 29.4% were sporadic smokers; 23.8% were weekly smokers; and 18.6% smoked daily. The median number of cigarettes smoked per week was 1 (range 0–121). Triers, sporadic, weekly, and daily smokers smoked a median of 0, 0, 5, and 30 cigarettes per week, respectively. Subjects had first inhaled at age 11.3 (1.5) years on average, and this coincided closely with the mean age at which they had first smoked a whole cigarette (11.1 (1.3) years). A total of 140 smokers (67.0%) reported recent quit attempts, including 61.2%, 65.1%, 67.3%, and 76.2% of triers, sporadic, weekly, and daily smokers, respectively. Among those who attempted to quit, 35.0% remained non-smoking (up until the current data collection), including 46.9%, 34.9%, 5.5%, and 2.4% of triers, sporadic, weekly, and daily smokers, respectively. According to our proxy ICD-10 measure, 17.3% of past three month smokers were tobacco dependent. Tobacco dependence increased notably with increased exposure to cigarettes, such that 0%, 1.5%, 18.2%, and 67.4% of triers, sporadic, weekly, and daily smokers, respectively, were tobacco dependent. Finally, 85.2% had a positive HONC including 61.5%, 89.7%, 100.0%, and 100.0% of triers, sporadic, weekly, and daily smokers, respectively.
Table 2 describes the distributions of the scores on each ND symptom indicator. All five ND symptom indicators demonstrated acceptable internal reliability and test-retest reliability.
Convergent construct validity
In univariate analyses, scores for each of the five ND indicators all increased with increased exposure to tobacco, and in addition could differentiate subjects who had tried to quit and failed, from those who had tried and remained non-smoking (table 3). The ND/cravings indicator, and the HONC, were highly correlated with each other; the correlations between the other indicators ranged between 0.716–0.824 (table 4). The independent correlates of the five indicators overlapped considerably: number of cigarettes smoked in the past week and the tolerance symptom, “need to smoke more now to be satisfied”, emerged strongly and consistently across all five models; depression symptoms and how much of the cigarette smoked were significant in four of the five models; and sex was significant in three of the five models (table 5). The finding that fewer correlates were identified in the ICD-10 model possibly reflects that the dependent variable was dichotomous.
ND has been defined as the compulsive use of cigarettes to achieve pleasurable and other effects and to avoid withdrawal symptoms.23 According to the Diagnostic and statistical manual of mental disorders, fourth edition (DSM-IV),24 symptoms of ND include tolerance, withdrawal symptoms, use in larger amounts and over longer periods than intended, a persistent desire or unsuccessful attempts to cut down or control usage, a great deal of time spent in use related activities, social disruption caused by use, and continued use despite physical or psychological symptoms. Symptoms of nicotine withdrawal include dysphoria or depressed mood, insomnia, irritability, frustration or anger, difficulty concentrating, restlessness, decreased heart rate, and increased appetite, and cravings.22 However, these definitions remain controversial, even in adults. For example, cravings are not included in the DSM-IV criteria, but are included in the ICD-10 criteria for tobacco dependence,17 and the role of tolerance in ND is debated.25,26
In this analysis, all five indicators of ND symptoms demonstrated convergent construct validity against quit attempts and smoking status; all five were highly intercorrelated (in part because of the shared items); and there was considerable overlap in their independent correlates. Since the individual items comprising each indicator were developed based on expert opinion or qualitative inquiry among adolescents, these indicators also possess content validity. This analysis therefore cannot distinguish between these five indicators on the basis of psychometric performance or convergent construct and content validity. It could be that, in spite of their obvious content differences, all are relatively good indicators of ND symptoms, at least cross sectionally. This would be true if ND is indeed a multidimensional phenomenon that includes symptoms of withdrawal, self medication, cravings, and loss of autonomy. However, until the meaning, relative importance, timing of appearance, and usefulness of each indicator is clarified in longitudinal work, decisions regarding which scale(s) are most useful for a particular research project will depend on the context and objectives of the research, as well as the content of the scales, the need for a multi- or unidimensional indicator, and whether or not the scale is theory based.
What this paper adds
Few studies have examined the natural history of nicotine dependence (ND), in part because there is no widely accepted, theoretically derived, and psychometrically sound tool to measure ND in adolescents. This article compares the psychometric properties of five indicators of ND symptoms, including the multidimensional Hooked on Nicotine Checklist, an indicator based on the ICD-10 criteria for tobacco dependence, and three new ND “symptom clusters” measuring ND/cravings, withdrawal symptoms, and self medication to alleviate negative affect. All five indicators performed well psychometrically. Until the meaning, relative importance, and usefulness of each scale is clarified in longitudinal work, decisions regarding which scale is most useful in a given context will depend on its content, the need for a multi- or unidimensional indicator, and whether or not the scale is theory based.
These data were drawn from a convenience sample of grade 7 students (age 12–13 years), and are therefore not representative of the general population. However, the sample included adolescent smokers with a wide range of cigarette exposures. Range of exposure is arguably more important in a study examining reliability and validity, than the representativeness of the population. In addition, if the biological processes underlying the development of ND do not differ substantially between populations, then representativeness is not crucial in a measurement study.
The sample size of smokers was relatively small, but did not impede multivariate analysis, or result in overly wide confidence intervals or difficulties attaining statistically significant results. Finally, the sample included only smokers in early adolescence. It could be that the constellation of ND symptoms as well as the timing of the appearance of individual symptoms or symptom clusters differ in different age groups.
All five ND indicators showed satisfactory psychometric properties and in addition were related as expected to other variables thought to be associated with ND. As such they each provide an informative measure for use in descriptive, analytic, or evaluative research on nicotine dependence in adolescence. However, until the meaning, relative importance, and usefulness of each scale in predicting failed cessation, continued smoking, or progression to higher levels of smoking is clarified in longitudinal work, decisions regarding which scale(s) to use will depend more on the content of the scales, the need for a multi- or unidimensional indicator, and whether or not the scale is theory based.
This research was funded by the National Cancer Institute of Canada, with funds from the Canadian Cancer Society. Jennifer O’Loughlin was a Research Scholar of the Fonds de la recherche en sante du Quebec when this work was completed and is currently an Investigator of the Canadian Institutes of Health Research. Paul Clarke is a Research Scholar of the Fonds de la recherche en santé du Québec (FRSQ). Rachel Tyndale acknowledges the support of a Canadian Research Chair in Pharmacogenetics. The authors are grateful to the school administrators, teachers, and students who participated.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.