Next Article in Journal
Translation of the Child and Adolescent HARDSHIP (Headache-Attributed Restriction, Disability, Social Handicap and Impaired Participation) Questionnaire into the Lithuanian Language and Validation of Its HRQoL (Headache-Related Quality of Life) Scale
Previous Article in Journal
Aeroallergens in Canada: Distribution, Public Health Impacts, and Opportunities for Prevention
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Placing Health Warnings on E-Cigarettes: A Standardized Protocol

1
Lineberger Comprehensive Cancer Center, University of North Carolina, Chapel Hill, NC 27599, USA
2
Department of Health Behavior, Gillings School of Global Public Health, University of North Carolina, Chapel Hill, NC 27599, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2018, 15(8), 1578; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph15081578
Submission received: 5 July 2018 / Accepted: 20 July 2018 / Published: 25 July 2018
(This article belongs to the Section Health Behavior, Chronic Disease and Health Promotion)

Abstract

:
Health warnings for e-cigarettes are a promising and novel tobacco control intervention for reducing e-cigarette use. We developed a new protocol for evaluating e-cigarette warnings by placing them on users’ own devices to reflect real-world exposure. Study 1 participants were a national convenience sample of 606 U.S. adult e-cigarette users surveyed online in March 2017. Most Study 1 participants were willing to have their e-cigarette devices (87%) and refills (83%) labeled. Study 2 participants were a convenience sample of 22 adult e-cigarette users recruited in California, United States in April 2017. We applied the U.S. Food and Drug Administration’s proposed e-cigarette warning to users’ own devices and refills. Most Study 2 participants (81%) reported using e-cigarette devices with our warning labels at least 90% of the time during the study. Nearly all (95%) said they would participate in the study again, and 100% would recommend the study to a friend. Conversations about e-cigarette harms, conversations about quitting e-cigarettes, and intentions to quit using e-cigarettes increased during the study (all p < 0.05). These studies show that our naturalistic labeling protocol was feasible, acceptable to participants, and had high retention over three weeks. Using the protocol can yield important evidence on the impact of e-cigarette warnings to inform tobacco warning policies.

1. Introduction

Increasing numbers of U.S. youth and adults have tried electronic nicotine delivery systems (or e-cigarettes) [1,2,3]. Many current cigarette smokers regularly use e-cigarettes [4,5] and often believe e-cigarettes can help them quit smoking [2,6]. E-cigarettes may help smokers quit smoking when used with clinical supervision [7,8], but they may hinder cessation or even encourage initiation when used naturalistically [9,10,11]. As a result, sustained dual use of both electronic and combustible cigarettes has increased [12,13]. While the general consensus is that e-cigarettes cause less harm overall than cigarettes [14,15], a growing body of research indicates evidence of health harms from e-cigarette use [16]. For instance, exposure to toxic chemicals via inhalation of e-cigarette aerosol may lead to respiratory impairment [9,17], among other health risks [18,19].
Health warnings for e-cigarettes are a novel and timely tobacco control intervention that hold promise for discouraging inappropriate e-cigarette use. The U.S. Food and Drug Administration (FDA) recently extended its authority to include e-cigarettes and to require a single text-only warning about addiction on packaging and advertisements for e-cigarettes that contain nicotine [20]. A large and growing body of research indicates that cigarette pack warnings help smokers quit [21,22]. However, research is needed to understand the effects of e-cigarette warnings on intended (e.g., discouraging e-cigarette use) and unintended consequences (e.g., increasing cigarette use) [23]. Online experiments have found that brief one-time exposures to warnings about e-cigarette harms increase thoughts about not using e-cigarettes, while reducing positive evaluations of and intentions to purchase e-cigarettes [24,25,26]. Two qualitative studies have highlighted the complexity of developing warnings for e-cigarettes, further pointing toward a need for additional studies with diverse populations [27,28]. However, no studies have assessed the impact of actually placing warnings on users’ e-cigarettes for several weeks, an intervention with the potential for high exposure and reach that pairs the warning with behavior. Tobacco control researchers would benefit from a naturalistic method for evaluating the FDA’s proposed warnings and other e-cigarette warnings that replicate real-world exposure to the warnings [29].
Two large randomized controlled trials have successfully used the University of North Carolina (UNC) tobacco product warning protocol [29] to evaluate the impact of placing new messages on smokers’ own cigarette packs for several weeks (total n = 2868) [21,30]. In the protocol, smokers bring a supply of cigarette packs to weekly appointments; then, study staff label the cigarette packs while smokers take a survey [29]. In the current proof of principle study, we aimed to adapt the UNC protocol for evaluating warnings for e-cigarette devices and refills. In two pilot studies, we separately examined e-cigarette users’ initial receptivity to the proposed protocol and their satisfaction with the actual protocol. To further validate the use of warnings as a viable tobacco control intervention for reducing e-cigarette use, we also aimed to assess short-term changes in both intended and unintended outcomes.

2. Study 1: Acceptability

The aim of Study 1 was to gauge initial reactions from e-cigarette users about the acceptability of participating in an e-cigarette labeling study and to determine how to modify the UNC protocol [29] for e-cigarettes.

2.1. Materials and Methods

2.1.1. Participants and Procedures

In March 2017, we recruited a convenience sample of 1350 U.S. adults (18+) through Amazon Mechanical Turk (MTurk), an online platform commonly used for behavioral and social science research [31,32,33,34,35]. The current study was part of a larger parent study that set a sampling quota for 900 cigarette smokers and 450 non-smokers. For the current study, we report data for 606 participants who were current e-cigarette users (i.e., used e-cigarettes every day or some days). After providing informed consent, participants completed an online questionnaire. Participants received US $1.25 after completing the brief survey. The UNC institutional review board approved this study (study number 17-0133).

2.1.2. Measures and Analysis

The survey assessed standard demographics and combustible cigarette use. We defined being a current smoker as having smoked at least 100 cigarettes in one’s lifetime and now smoking every day or some days, and defined being a former smoker as having smoked at least 100 cigarettes in one’s lifetime but not smoking currently. The survey also measured whether participants attempted to quit using e-cigarettes (defined as having stopped using for one day or longer in the past week because they were trying to quit using e-cigarettes), adapting the standard quit attempt item for combustible cigarettes [36]. The survey then briefly described an e-cigarette warning protocol and study: “Imagine you have been recruited to participate in a new research study. In this study, you would come to the research office every week for four weeks, and a sticker with a health warning would be put on your e-cigarette. During the study, you’d use the labeled e-cigarette as you normally would. You would get up to $300 for being in the study.” Finally, the survey assessed whether participants would be able to bring in an eight-day supply of refills and willing to have their e-cigarette device, package, refills, and refill package labeled. Response options were “yes”, “no”, and “not sure”. Survey measures appear in Supplementary Materials (Tables S1 and S2). We calculated descriptive statistics to summarize demographic information and process measures and used logistic regression to examine demographic predictors of process outcomes, using Stata/SE version 14.1 [37].

2.2. Results

About half of Study 1 participants (45%) were aged 29 or younger (Table 1). Almost all participants (92%) were current smokers. Average e-cigarette use frequency was three days in the past week and average intensity was 41 puffs on the days they used e-cigarettes. Fourteen percent had made an e-cigarette quit attempt of at least 24 h in the past week.
Most participants (85%) owned and regularly used only one or two e-cigarette devices. The most common types of refills used were e-liquid poured in a tank (45%) and pre-filled cartridges (32%); 8% used disposable e-cigarettes that do not have refills. Most (68%) said they would be able to bring in an eight-day supply of refills, and 21% said they were not sure. Most said they would be willing to have their e-cigarette device (87%), device package (88%), refills (83%), and refill package (86%) labeled (Figure 1). E-cigarette users who vaped more frequently had higher odds of being willing to have their e-cigarette package (OR = 1.21), refills (OR = 1.17), and refill package (OR = 1.16) labeled, and higher odds of being able to bring in eight days’ worth of refills (OR = 1.26, all p < 0.05). E-cigarette users who were younger (OR = 0.60) and had tried to quit e-cigarettes in the past week (OR = 0.47) were less likely to report being able to bring in eight days’ worth of refills (both p < 0.05). Otherwise, the protocol was equally acceptable across populations.

2.3. Discussion

Most e-cigarette users in Study 1 were willing to have their e-cigarette devices and refills labeled with a health warning. Most also reported being able to bring in enough refills to participate in a four-week labeling study. E-cigarette users were receptive to the warning protocol as we described it and would be likely to enroll in an e-cigarette labeling study. Importantly, the warning protocol was acceptable across diverse groups, and e-cigarette users who vape more frequently were particularly receptive to the protocol. The results of Study 1 informed two decisions regarding the protocol for Study 2. First, we decided to instruct participants to bring in one or two e-cigarette devices they own and use most frequently for labeling based on the finding that few e-cigarette users used more than two devices. Second, we decided to allow e-cigarette users to bring in disposable e-cigarettes for labeling in Study 2 since a small but meaningful proportion of e-cigarette users in Study 1 reported using disposable e-cigarettes.

3. Study 2: Feasibility

The goal of Study 2 was to test our UNC tobacco product warning protocol [29] modified for e-cigarettes. Specifically, we examined the feasibility of recruiting and retaining e-cigarette users, as well as the feasibility of placing warnings on their devices and refill materials. We also explored whether e-cigarette-related psychosocial outcomes changed during the study. Finally, we aimed to develop best practices for putting warnings on e-cigarette devices and refill materials.

3.1. Materials and Methods

3.1.1. Participants

In April 2017, we recruited 22 adult e-cigarette users in the Bay Area in California, US. Eligibility criteria were being 21 years or older, being a current e-cigarette user (defined as now using every day or some days), using an e-cigarette that contains nicotine, being able to attend three weekly appointments, being able to bring in e-cigarette devices and eight days’ worth of refills to each visit for labeling with warnings, being able to complete a paper and pencil survey without help, and being able to speak English. We excluded pregnant women and participants whose e-cigarette devices could not be labeled (e.g., if the label did not stick on device material). We recruited participants through Craigslist and screened potential participants for eligibility online and by phone.

3.1.2. Procedures

We adapted the UNC protocol [29] for placing warnings on e-cigarettes and refills, as described below. We invited participants to attend three visits, each spaced one week apart, at the study office in San Francisco, California, US. At Visit 1, we confirmed eligibility, obtained written informed consent, and enrolled e-cigarette users. Participants completed a paper survey at all three visits.
We asked participants to bring in up to two e-cigarette devices they own and regularly use to Visits 1–3. We also asked participants to bring in eight days’ worth of e-cigarette refills to those visits; users of disposable e-cigarettes were instructed to bring eight days’ worth of disposable e-cigarettes. In front of the participant, research staff applied a self-adhesive label with the warning message to the participant’s e-cigarette devices and refills at Visit 1. The message was adapted from the FDA warning that will be required on packaging and advertisements of e-cigarettes that contain nicotine: “WARNING: This product contains nicotine. Nicotine is an addictive chemical” [20]. We used the message verbatim except we removed the marker “warning” so the text could be larger and thus more easily read (Figure 2). Warning labels came in three sizes and study staff used the largest label that fit on the device, applying labels to the e-cigarette on the area farthest from the mouth piece. Study staff also labeled e-cigarette refills when possible, but some of the refills were too small to label. Study staff made notes about the labeling process to help inform best practices.
At Visit 2, study staff applied warning labels to new devices and refills as needed. At the end of each visit, on completion of the survey, participants received a cash incentive that totaled up to $200 across the study. At the end of the study, we offered participants information and resources about tobacco cessation. None of the participants withdrew from the study. The UNC institutional review board approved this study (study number 13-2430).

3.1.3. Measures and Analysis

Surveys used validated measures adapted from prior studies to assess constructs from the UNC Tobacco Warning Model [38], including noticing the warning [39], social interactions about the warning [40,41], thinking about the information in the warning [42,43], intention to quit using e-cigarettes (three items) [44], number of times forgoing using an e-cigarette in the past week [45,46], attempting to quit using e-cigarettes for one day or longer in the past three weeks [36], and quitting e-cigarettes (i.e., did not use an e-cigarette in the past seven days as of the end of the study) [47]. Additionally, the surveys measured worry about the harms of using e-cigarettes (four items) [48,49,50,51], positive e-cigarette user prototypes (four items) [52,53,54], negative e-cigarette user prototypes (four items) [52,53,54], the percentage of the time participants used labeled e-cigarette devices, participant satisfaction with study procedures, and participant demographics. The surveys also assessed combustible cigarette use and the number of days in the past week that participants smoked cigarettes to look at potential unintended consequences of the warning (i.e., increased cigarette consumption). We used the same definitions as Study 1 for smoking status. Survey measures appear in Supplementary Materials.
Analyses used Stata/SE version 14.1, R (v. 3.3.2) [37] and BayesFactor (v. 0.19.12-2) [55]. We calculated descriptive statistics to summarize participant demographics, process measures, and social interactions about the warning. To assess changes over time, we present means for baseline and the final follow-up visit and difference scores along with 95% confidence intervals from paired samples t-tests. We confirmed these results using Bayesian parameter estimation [56,57], an approach that is well-suited to small samples [58]. Bayesian analyses used an uninformative prior (concentration = 1) [59] for e-cigarette quit attempts and an informative Cauchy prior (r = 2 / 2 ) [60] for all other outcomes, reflecting our previous cigarette pack labeling trials that produced small and occasionally medium or larger effects [21,30].

3.2. Results and Discussion

About a third of participants (36%) were aged 29 or younger (Table 2). Half of e-cigarette users were white, and 14% were African American. Most (68%) were male and 27% were gay, lesbian, or bisexual. Half of participants were current smokers, and 45% were former smokers. Participants reported using e-cigarettes an average of six days in the past week and taking an average of 38 puffs on the days they used e-cigarettes. Five percent had made an e-cigarette quit attempt of at least 24 h in the past week. Most (90%) owned and regularly used one or two e-cigarette devices.

3.2.1. Process Measures

About one-third (36%) of participants said they thought about the information in the warning often or all of the time; and 90% found the label very or extremely easy to read (Figure 3). About half said they noticed the warning often or all of the time. Study participants reported high rates of adherence to using labeled e-cigarettes; 81% used labeled e-cigarettes at least 90% of the time. Many participants (82%) found participating in the study to be easy or very easy, 86% found bringing in refills easy or very easy, and 91% found bringing in e-cigarette devices to be easy or very easy. Nearly all participants (95%) would participate in the study again and 100% would recommend the study to a friend. Retention was 100% for all three visits.

3.2.2. Social Interactions

Most e-cigarette users (82%) talked about the warning with a variety of people during the study. Among the 18 participants who talked about the warning with others, the most common conversation partners were friends (78%), followed by spouses or significant others (50%), co-workers (44%), other family members (33%), people they did not previously know (22%), and health care providers (6%). At the final visit, 13% said their conversations about the warning were mostly negative, 6% were mostly positive, and 81% were somewhere in between. When asked about the content of conversations, most participants reported talking about negative affect elicited by the warning, chemicals in e-cigarette vapor, the health problems caused by using e-cigarettes, and whether the warning would make other e-cigarette users want to quit using e-cigarettes (Table 3).

3.2.3. Changes over Time

Analyses suggested some changes over the course of the study. Between baseline and follow-up, people appeared to have more conversations about the addictiveness of e-cigarettes (mean difference = 0.82, 95% confidence interval (CI) = 0.06 to 1.58) and the health problems caused by using e-cigarettes (mean difference = 0.77, 95% CI = 0.23 to 1.32) (Table 4). Similarly, e-cigarette quit intentions (mean difference = 0.35, 95% CI = 0.06 to 0.64) also appeared to be higher at the end of the study. While initial analyses suggested that the percentage making an e-cigarette quit attempt increased (absolute difference = 24%, 95% CI = 1% to 47%), Bayesian analyses did not confirm this finding. The number of days when participants smoked combustible cigarettes did not appear to increase (mean difference = −0.14, 95% CI = −0.69 to 0.40). At baseline, people smoked combustible cigarettes an average of 2.10 days in the past week, and at follow-up, they smoked an average of 1.95 days in the past week.

4. General Discussion

Our proof of principle study of placing warnings on actual users’ e-cigarette devices and refills for an extended period of time suggests that our naturalistic labeling protocol is acceptable to e-cigarette users and feasible to implement. The protocol had high retention and adherence, and participants reported high levels of satisfaction with the procedures. Furthermore, social interactions and e-cigarette quit intentions appeared to have increased over the two-week period of participants using labeled e-cigarettes. Thus, our new e-cigarette labeling protocol offers the potential for studying the impact of e-cigarette warnings with more realistic exposure to warnings compared with lab studies, filling an important gap in the tobacco control literature. Randomized controlled trials could feasibly use the protocol to evaluate the impact of e-cigarette warnings on behavioral outcomes such as e-cigarette quit attempts.
Adapting the UNC warning protocol [29], we implemented our new e-cigarette warning protocol successfully, and our findings point to six key protocol elements. We recommend an e-cigarette warning protocol that has the steps shown in Table 5: (1) schedule multiple study appointments, spaced one week apart; (2) determine typical e-cigarette consumption through self-report; (3) ask users to bring in their own e-cigarette devices and refills; (4) during study appointments, apply self-adhesive warning labels to users’ devices and refills; (5) provide participation incentives at the end of the appointments; and (6) give participants information about tobacco product cessation services. Based on study staff notes about the labeling process, we offer additional recommendations for warning label design and placement suitable for e-cigarette and refills, as shown in Figure 4. E-cigarette and refill warning labels should be available in several sizes to accommodate variation in product size (e.g., mods vs. vape pens) and study staff should consider selecting the largest size that fits the devices and refills. To maximize readability, study staff should apply the warning labels to participants’ e-cigarette devices lengthwise on the area farthest from mouth piece; refill liquid bottles should be labeled with the message text direction matching that of the bottle. In Study 2, we decided to label the e-cigarette device and refills, rather than the packaging, in order to maximize exposure to the warning. Researchers could adapt the protocol to also place warnings on packaging (e.g., cartridge package or device package) or provide the warning in other ways to enhance exposure (e.g., on a point-of-sale sign).
To evaluate the use of warnings as a viable tobacco control intervention for reducing e-cigarette use, we examined changes in psychosocial and behavioral outcomes. We observed increases in social interactions and e-cigarette quit intentions from baseline to follow-up in Study 2. According to the Tobacco Warning Model [38], social interactions and quit intentions are two key mechanisms by which warnings change behavior. In addition to examining the intended effects of e-cigarette warnings, we examined one potential unintended consequence, finding that the frequency of combustible cigarette use did not appear to increase from baseline to follow-up. Taken together, these findings suggest that e-cigarette warnings hold promise as a tobacco control policy strategy, although we cannot attribute the observed changes solely to the e-cigarette warning because the study did not have a control group. Future studies should examine these outcomes and other possible mediators (e.g., attention, fear, and other negative affect elicited by the warnings [38]) in larger controlled studies. It is possible that the e-cigarette warning we tested and other future e-cigarette warnings could have unintended consequences [61], so future studies should continue to examine a wide range of potential unintended consequences of e-cigarette warnings, such as inaccurate risk perceptions (e.g., the incorrect belief that e-cigarettes are as harmful as or more harmful than cigarettes), increased intentions to switch from e-cigarettes to combustible tobacco products (e.g., cigarettes, hookah), and compensatory increases in combustible tobacco product use [61,62]. Research could inform the possibility of FDA extending the planned single e-cigarette warning on packaging and advertisements to include multiple new warnings and warnings on actual e-cigarette devices and refills [20]. Additional research on e-cigarette warnings could also inform other countries considering implementing this novel tobacco control policy.
The Study 2 sample was small, and thus the study was underpowered to detect changes from baseline to follow-up. We verified results from traditional statistical tests using methods suited to small samples. As stated previously, the absence of a control group means we cannot attribute observed changes solely to the e-cigarette warning. Finally, a limitation of both studies is the use of convenience samples, so the generalizability of findings remains to be established.

5. Conclusions

Better examining the impact of e-cigarette warnings in order to inform tobacco control strategies is a compelling need for public health. Quitting e-cigarettes can reduce exposure to harmful substances, eliminate the maintenance of addiction afforded by dual use, and prevent renormalization of tobacco product use [9]. Our recommended e-cigarette warning protocol developed through this proof of principle study is acceptable and feasible and holds promise as a rigorous strategy for testing new warnings. This protocol maximizes real-world repeated exposures by pairing the warning message with e-cigarette use for greater impact on behavior, while allowing for experimental control necessary to generate rigorous evidence needed to inform U.S. tobacco control policy.

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/1660-4601/15/8/1578/s1, Table S1: Study 1 measures, Table S2: Study 2 measures.

Author Contributions

N.T.B. led the study concept and design. N.T.B., J.R.M., M.G.H., and M.J. assisted with study development and data collection. J.R.M. led the manuscript preparation. M.G.H. and S.A.B. assisted with data analysis and data interpretation. All authors contributed to interpretation of the results and provided substantive edits to the manuscript. All authors read and approved the final manuscript.

Funding

Research reported in this publication was supported by grant number P50CA180907 from the National Cancer Institute and FDA Center for Tobacco Products (CTP). T32-CA057726 from the National Cancer Institute of the National Institutes of Health supported Marissa Hall’s time writing the paper. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH or the Food and Drug Administration.

Acknowledgments

We thank Andrew Seidenberg for his assistance with data collection for Study 1 and the staff at Ewald & Wasserman Research Consultants LLC for their assistance with Study 2.

Conflicts of Interest

Brewer has served as a paid expert consultant in litigation against tobacco companies. The other authors declare no conflict of interest.

References

  1. McMillen, R.C.; Gottlieb, M.A.; Shaefer, R.M.W.; Winickoff, J.P.; Klein, J.D. Trends in electronic cigarette use among U.S. Adults: Use is increasing in both smokers and nonsmokers. Nicotine Tob. Res. 2015, 17, 1195–1202. [Google Scholar] [CrossRef] [PubMed]
  2. Rass, O.; Pacek, L.R.; Johnson, P.S.; Johnson, M.W. Characterizing use patterns and perceptions of relative harm in dual users of electronic and tobacco cigarettes. Exp. Clin. Psychopharmacol. 2015, 23, 494–503. [Google Scholar] [CrossRef] [PubMed]
  3. Jamal, A.; King, B.A.; Neff, L.J.; Whitmill, J.; Babb, S.D.; Graffunder, C.M. Current cigarette smoking among adults—United States, 2005–2015. Morb. Mortal. Wkly. Rep. 2016, 65, 1205–1211. [Google Scholar] [CrossRef] [PubMed]
  4. Kasza, K.A.; Ambrose, B.K.; Conway, K.P.; Borek, N.; Taylor, K.; Goniewicz, M.L.; Cummings, K.M.; Sharma, E.; Pearson, J.L.; Green, V.R.; et al. Tobacco-product use by adults and youths in the United States in 2013 and 2014. N. Engl. J. Med. 2017, 376, 342–353. [Google Scholar] [CrossRef] [PubMed]
  5. Coleman, B.N.; Rostron, B.; Johnson, S.E.; Ambrose, B.K.; Pearson, J.; Stanton, C.A.; Wang, B.; Delnevo, C.; Bansal-Travers, M.; Kimmel, H.L.; et al. Electronic cigarette use among US adults in the population assessment of tobacco and health (PATH) study, 2013–2014. Tob. Control 2017, 26, e117–e126. [Google Scholar] [CrossRef] [PubMed]
  6. Pepper, J.K.; Brewer, N.T. Electronic nicotine delivery system (electronic cigarette) awareness, use, reactions and beliefs: A systematic review. Tob. Control 2014, 23, 375–384. [Google Scholar] [CrossRef] [PubMed]
  7. McRobbie, H.; Bullen, C.; Hartmann-Boyce, J.; Hajek, P. Electronic cigarettes for smoking cessation and reduction. Cochrane Database Syst. Rev. 2014, 12, CD010216. [Google Scholar]
  8. Rahman, M.A.; Hann, N.; Wilson, A.; Mnatzaganian, G.; Worrall-Carter, L. E-cigarettes and smoking cessation: Evidence from a systematic review and meta-analysis. PLoS ONE 2015, 10, e0122544. [Google Scholar] [CrossRef] [PubMed]
  9. Grana, R.; Benowitz, N.; Glantz, S.A. E-cigarettes: A scientific review. Circulation 2014, 129, 1972–1986. [Google Scholar] [CrossRef] [PubMed]
  10. Caraballo, R.S.; Shafer, P.R.; Patel, D.; Davis, K.C.; McAfee, T.A. Quit methods used by US adult cigarette smokers, 2014–2016. Prev. Chronic Dis. 2017, 14. [Google Scholar] [CrossRef] [PubMed]
  11. Kalkhoran, S.; Glantz, S.A. E-cigarettes and smoking cessation in real-world and clinical settings: A systematic review and meta-analysis. Respir. Med. 2016, 4, 116–128. [Google Scholar] [CrossRef]
  12. Rutten, L.J.; Blake, K.D.; Agunwamba, A.A.; Grana, R.A.; Wilson, P.M.; Ebbert, J.O.; Okamoto, J.; Leischow, S.J. Use of e-cigarettes among current smokers: Associations among reasons for use, quit intentions, and current tobacco use. Nicotine Tob. Res. 2015, 17, 1228–1234. [Google Scholar] [CrossRef] [PubMed]
  13. Popova, L.; Ling, P.M. Alternative tobacco product use and smoking cessation: A national study. Am. J. Public Health 2013, 103, 923–930. [Google Scholar] [CrossRef] [PubMed]
  14. Chen, J.; Bullen, C.; Dirks, K. A comparative health risk assessment of electronic cigarettes and conventional cigarettes. Int. J. Environ. Res. Public Health 2017, 14, 382. [Google Scholar] [CrossRef] [PubMed]
  15. Farsalinos, K.E.; Polosa, R. Safety evaluation and risk assessment of electronic cigarettes as tobacco cigarette substitutes: A systematic review. Ther. Adv. Drug Saf. 2014, 5, 67–86. [Google Scholar] [CrossRef] [PubMed]
  16. National Academies of Sciences, Engineering, and Medicine. Public Health Consequences of E-Cigarettes; The National Academies Press: Washington, DC, USA, 2018. [Google Scholar]
  17. Vardavas, C.I.; Anagnostopoulos, N.; Kougias, M.; Evangelopoulou, V.; Connolly, G.N.; Behrakis, P.K. Short-term pulmonary effects of using an electronic cigarette: Impact on respiratory flow resistance, impedance, and exhaled nitric oxide. Chest 2012, 141, 1400–1406. [Google Scholar] [CrossRef] [PubMed]
  18. Glasser, A.M.; Collins, L.; Pearson, J.L.; Abudayyeh, H.; Niaura, R.S.; Abrams, D.B.; Villanti, A.C. Overview of electronic nicotine delivery systems: A systematic review. Am. J. Prev. Med. 2017, 52, e33–e66. [Google Scholar] [CrossRef] [PubMed]
  19. Maina, G.; Castagnoli, C.; Passini, V.; Crosera, M.; Adami, G.; Mauro, M.; Filon, F.L. Transdermal nicotine absorption handling e-cigarette refill liquids. Regul. Toxicol. Pharmacol. 2016, 74, 31–33. [Google Scholar] [CrossRef] [PubMed]
  20. U.S. Food and Drug Administration; Health and Human Services. Deeming tobacco products to be subject to the federal food, drug, and cosmetic act, as amended by the family smoking prevention and tobacco control act; restrictions on the sale and distribution of tobacco products and required warning statements for tobacco products. Final rule. Fed. Regist. 2016, 81, 28973. [Google Scholar]
  21. Brewer, N.T.; Hall, M.G.; Noar, S.M.; Parada, H.; Stein-Seroussi, A.; Bach, L.E.; Hanley, S.; Ribisl, K.M. Effect of pictorial cigarette pack warnings on changes in smoking behavior: A randomized clinical trial. JAMA Intern. Med. 2016, 176, 905–912. [Google Scholar] [CrossRef] [PubMed]
  22. Noar, S.M.; Hall, M.G.; Brewer, N.T. Pictorial cigarette pack warnings have important effects. Am. J. Public Health 2015, 105, E1–E2. [Google Scholar] [CrossRef] [PubMed]
  23. Wackowski, O.; Hammond, D.; O’Connor, R.; Strasser, A.; Delnevo, C. Considerations and future research directions for e-cigarette warnings—Findings from expert interviews. Int. J. Environ. Res. Public Health 2017, 14, 781. [Google Scholar] [CrossRef] [PubMed]
  24. Mays, D.; Smith, C.; Johnson, A.C.; Tercyak, K.P.; Niaura, R.S. An experimental study of the effects of electronic cigarette warnings on young adult nonsmokers’ perceptions and behavioral intentions. Tob. Induc. Dis. 2016, 14, 17. [Google Scholar] [CrossRef] [PubMed]
  25. Popova, L.; Ling, P.M. Nonsmokers’ responses to new warning labels on smokeless tobacco and electronic cigarettes: An experimental study. BMC Public Health 2014, 14, 997. [Google Scholar] [CrossRef] [PubMed]
  26. Sanders-Jackson, A.; Schleicher, N.C.; Fortmann, S.P.; Henriksen, L. Effect of warning statements in e-cigarette advertisements: An experiment with young adults in the united states. Addiction 2015, 110, 2015–2024. [Google Scholar] [CrossRef] [PubMed]
  27. Wackowski, O.A.; Hammond, D.; O’Connor, R.J.; Strasser, A.A.; Delnevo, C.D. Smokers’ and e-cigarette users’ perceptions about e-cigarette warning statements. Int. J. Environ. Res. Public Health 2016, 13, 655. [Google Scholar] [CrossRef] [PubMed]
  28. Wackowski, O.A.; O’Connor, R.J.; Strasser, A.A.; Hammond, D.; Villanti, A.C.; Delnevo, C.D. Smokers’ and e-cigarette users’ perceptions of modified risk warnings for e-cigarettes. Prev. Med. Rep. 2016, 4, 309–312. [Google Scholar] [CrossRef] [PubMed]
  29. Brewer, N.T.; Hall, M.G.; Lee, J.G.; Peebles, K.; Noar, S.M.; Ribisl, K.M. Testing warning messages on smokers’ cigarette packages: A standardised protocol. Tob. Control 2015, 25, 153–159. [Google Scholar] [CrossRef] [PubMed]
  30. Brewer, N.T.; Jeong, M.; Mendel, J.R.; Hall, M.G.; Zhang, D.; Parada, H., Jr.; Boynton, M.H.; Noar, S.M.; Baig, S.A.; Morgan, J.C.; et al. Cigarette pack messages about toxic chemicals: A randomised clinical trial. Tob. Control 2018. [Google Scholar] [CrossRef] [PubMed]
  31. Berinsky, A.J.; Huber, G.A.; Lenz, G.S. Evaluating online labor markets for experimental research: Amazon.Com’s Mechanical Turk. Political Anal. 2012, 20, 351–368. [Google Scholar] [CrossRef]
  32. Buhrmester, M.; Kwang, T.; Gosling, S.D. Amazon’s Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspect. Psychol. Sci. 2011, 6, 3–5. [Google Scholar] [CrossRef] [PubMed]
  33. Paolacci, G.; Chandler, J.; Ipeirotis, P. Running experiments on amazon Mechanical Turk. Judgm. Decis. Mak. 2010, 5, 411–419. [Google Scholar]
  34. Rand, D.G. The promise of Mechanical Turk: How online labor markets can help theorists run behavioral experiments. J. Theor. Biol. 2012, 299, 172–179. [Google Scholar] [CrossRef] [PubMed]
  35. Jeong, M.; Zhang, D.; Morgan, J.C.; Cornacchione, J.; Osman, A.; Boynton, M.H.; Mendel, J.R.; Brewer, N.T. Similarities and differences in tobacco control research findings from convenience and probability samples. Ann. Behav. Med. 2008, in press. [Google Scholar] [CrossRef]
  36. Centers for Disease Control and Prevention. Adult Tobacco Survey (ATS); Centers for Disease Control and Prevention: Atlanta, GA, USA, 2008.
  37. R Core Team. R Language Definition; R Foundation for Statistical Computing: Vienna, Austria, 2000. [Google Scholar]
  38. Brewer, N.T.; Parada, H.; Hall, M.G.; Boynton, M.H.; Noar, S.M.; Ribisl, K.M. Understanding why pictorial cigarette pack warnings increase quit attempts. Ann. Behav. Med. 2018. [Google Scholar] [CrossRef] [PubMed]
  39. Nonnemaker, J.; Farrelly, M.; Kamyab, K.; Busey, A.; Mann, N. Experimental Study of Graphic Cigarette Warning Labels: Final Results Report; RTI International: Research Triangle Park, NC, USA, 2010. [Google Scholar]
  40. Hall, M.G.; Peebles, K.; Bach, L.E.; Noar, S.M.; Ribisl, K.M.; Brewer, N.T. Social interactions sparked by pictorial warnings on cigarette packs. Int. J. Environ. Res. Public Health 2015, 12, 13195–13208. [Google Scholar] [CrossRef] [PubMed]
  41. Morgan, J.C.; Southwell, B.G.; Noar, S.M.; Ribisl, K.M.; Golden, S.D.; Brewer, N.T. Frequency and content of conversations about pictorial warnings on cigarette packs. Nicotine Tob. Res. 2017, 20, 882–887. [Google Scholar] [CrossRef] [PubMed]
  42. Borland, R.; Yong, H.; Wilson, N.; Fong, G.T.; Hammond, D.; Cummings, K.M.; Hosking, W.; McNeill, A. How reactions to cigarette packet health warnings influence quitting: Findings from the ITC Four-Country survey. Addiction 2009, 104, 669–675. [Google Scholar] [CrossRef] [PubMed]
  43. Hammond, D.; Fong, G.T.; McDonald, P.W.; Cameron, R.; Brown, K.S. Impact of the graphic Canadian warning labels on adult smoking behaviour. Tob. Control 2003, 12, 391–395. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Klein, W.M.; Zajac, L.E.; Monin, M.M. Worry as a moderator of the association between risk perceptions and quitting intentions in young adult and adult smokers. Ann. Behave. Med. 2009, 38, 256–261. [Google Scholar] [CrossRef] [PubMed]
  45. Borland, R.; Hill, D. Initial impact of the new Australian tobacco health warnings on knowledge and beliefs. Tob. Control 1997, 6, 317–325. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Li, L.; Borland, R.; Fong, G.T.; Jiang, Y.; Yang, Y.; Wang, L.; Partos, T.R.; Thrasher, J.F. Smoking-related thoughts and microbehaviours, and their predictive power for quitting: Findings from the International Tobacco Control (ITC) China Survey. Tob. Control 2015, 24, 354–361. [Google Scholar] [CrossRef] [PubMed]
  47. PATH: Population Assessment of Tobacco and Health. 2014. Available online: http://www.pathstudyinfo.nih.gov/UI/HomeMobile.aspx (accessed on 21 January 2016).
  48. Dijkstra, A.; Brosschot, J. Worry about health in smoking behaviour change. Behav. Res. Ther. 2003, 41, 1081–1092. [Google Scholar] [CrossRef]
  49. Ranby, K.W.; Lewis, M.A.; Toll, B.A.; Rohrbaugh, M.J.; Lipkus, I.M. Perceptions of smoking-related risk and worry among dual-smoker couples. Nicotine Tob. Res. 2013, 15, 734–738. [Google Scholar] [CrossRef] [PubMed]
  50. Magnan, R.E.; Koblitz, A.R.; Zielke, D.J.; McCaul, K.D. The effects of warning smokers on perceived risk, worry, and motivation to quit. Ann. Behav. Med. 2009, 37, 46–57. [Google Scholar] [CrossRef] [PubMed]
  51. Magnan, R.E.; Koblitz, A.R.; McCaul, K.D.; Dillard, A.J. Self-monitoring effects of ecological momentary assessment on smokers’ perceived risk and worry. Psychol. Assess. 2013, 25, 416–423. [Google Scholar] [CrossRef] [PubMed]
  52. McCool, J.; Cameron, L.; Petrie, K. Stereotyping the smoker: Adolescents’ appraisals of smokers in film. Tob. Control 2004, 13, 308–314. [Google Scholar] [CrossRef] [PubMed]
  53. McCool, J.; Cameron, L.D.; Robinson, E. Do parents have any influence over how young people appraise tobacco images in the media? J. Adolesc. Health 2011, 48, 170–175. [Google Scholar] [CrossRef] [PubMed]
  54. Pepper, J.K.; Cameron, L.D.; Reiter, P.L.; McRee, A.L.; Brewer, N.T. Non-smoking male adolescents’ reactions to cigarette warnings. PLoS ONE 2013, 8, e65533. [Google Scholar] [CrossRef] [PubMed]
  55. Morey, R.D.; Rouder, J.N.; Jamil, T. Bayesfactor: Computation of Bayes Factors for Common Designs, R Package Version 0.9. 2015; Volume 9.
  56. Kruschke, J.K. Bayesian assessment of null values via parameter estimation and model comparison. Perspect. Psychol. Sci. 2011, 6, 299–312. [Google Scholar] [CrossRef] [PubMed]
  57. Kruschke, J.K. Bayesian estimation supersedes the t test. J. Exp. Psychol. Gen. 2013, 142, 573–603. [Google Scholar] [CrossRef] [PubMed]
  58. McNeish, D. On using bayesian methods to address small sample problems. Struct. Equ. Model. 2016, 23, 750–773. [Google Scholar] [CrossRef]
  59. Jamil, T.; Ly, A.; Morey, R.D.; Love, J.; Marsman, M.; Wagenmakers, E.J. Default “gunel and dickey” bayes factors for contingency tables. Behav. Res. Methods 2017, 49, 638–652. [Google Scholar] [CrossRef] [PubMed]
  60. Morey, R.D.; Rouder, J.N. Bayes factor approaches for testing interval null hypotheses. Psychol. Methods 2011, 16, 406–419. [Google Scholar] [CrossRef] [PubMed]
  61. Hajek, P.; Etter, J.-F.; Benowitz, N.; Eissenberg, T.; McRobbie, H. Electronic cigarettes: Review of use, content, safety, effects on smokers and potential for harm and benefit. Addiction 2014, 109, 1801–1810. [Google Scholar] [CrossRef] [PubMed]
  62. Majeed, B.A.; Weaver, S.R.; Gregory, K.R.; Whitney, C.F.; Slovic, P.; Pechacek, T.F.; Eriksen, M.P. Changing perceptions of harm of e-cigarettes among U.S. Adults, 2012–2015. Am. J. Prev. Med. 2017, 52, 331–338. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Acceptability of e-cigarette warning protocol, Study 1 (n = 606). Missing data ranged from 0% to 1.0%.
Figure 1. Acceptability of e-cigarette warning protocol, Study 1 (n = 606). Missing data ranged from 0% to 1.0%.
Ijerph 15 01578 g001
Figure 2. Warning labels for e-cigarette devices and refills, Study 2.
Figure 2. Warning labels for e-cigarette devices and refills, Study 2.
Ijerph 15 01578 g002
Figure 3. Process evaluation measures for e-cigarette labeling protocol, Study 2 (n = 22). Note. One participant had missing data for noticing the warning and one had missing data for percentage of the time using a labeled e-cigarette; no other missing process data.
Figure 3. Process evaluation measures for e-cigarette labeling protocol, Study 2 (n = 22). Note. One participant had missing data for noticing the warning and one had missing data for percentage of the time using a labeled e-cigarette; no other missing process data.
Ijerph 15 01578 g003
Figure 4. Examples of recommended e-cigarette warning placement.
Figure 4. Examples of recommended e-cigarette warning placement.
Ijerph 15 01578 g004
Table 1. Participant characteristics, Study 1 (n = 606).
Table 1. Participant characteristics, Study 1 (n = 606).
Demographics%
Age (years)
 18–2416
 25–2929
 30–4442
 45–5911
 60+2
Male63
Gay, lesbian, or bisexual10
Race
 Asian7
 Black or African American7
 Other/Multiracial3
 White83
Hispanic ethnicity12
Education
 High school diploma or less14
 Some college31
 College degree49
 Graduate degree7
Tobacco Product Use
Smoking status
 Current smoker92
 Former smoker5
 Never smoker2
E-cigarette use frequency (days used in past week), mean (SD)3 (2)
E-cigarette use intensity (puffs on days when used e-cigarette), mean (SD)41 (93)
Made e-cigarette quit attempt (for 24 h) in past week14
E-cigarette devices owned and used regularly
 None5
 1 device61
 2 devices24
 3 devices7
 4 or more devices3
Type of e-cigarette refills used in past 30 days
 E-liquid poured in tank45
 Pre-filled cartridges32
 Disposable e-cigarettes8
 Combination12
 Other3
SD = standard deviation. Missing data for demographics ranged from 0% to 2.6%.
Table 2. Participant characteristics, Study 2 (n = 22).
Table 2. Participant characteristics, Study 2 (n = 22).
Demographics%
Age (years)
 21–2936
 30–3923
 40–4927
 50+14
 Mean (SD)38 (12)
Male68
Gay, lesbian, or bisexual27
Race
 Asian9
 Black or African American14
 Other/Multiracial27
 White50
Hispanic ethnicity18
Education
 Some college23
 College degree64
 Graduate degree14
Household income, annual US$
 0–24,99914
 25,000–49,99945
 50,000–74,99918
 ≥75,00023
Tobacco Product Use at Baseline
Smoking status
 Current smoker50
 Former smoker45
 Never smoker5
E-cigarette use frequency (days used in past week), mean (SD)6 (1)
E-cigarette use intensity (puffs on days when used e-cigarette), mean (SD)38 (46)
Made e-cigarette quit attempt (for 24 h) in past week5
E-cigarette devices owned and used regularly
 1 device45
 2 devices45
 3 devices9
SD = standard deviation. No missing data for demographic characteristics.
Table 3. Content of conversations during the study, Study 2 (n = 18).
Table 3. Content of conversations during the study, Study 2 (n = 18).
Content of Conversations%
Negative affect toward the warning61
Chemicals in e-cigarette vapor56
Health problems caused by using e-cigarettes50
Warning would make other e-cigarette users want to quit using e-cigarettes50
Warning would stop people from starting to use e-cigarettes44
This research study33
Made fun of the warning28
Warning should be on e-cigarettes22
Warning makes me want to quit using e-cigarettes22
Information in this warning is new to me17
Data from participants who had at least one conversation about the warning; no missing data.
Table 4. Changes between baseline and two-week follow-up, Study 2.
Table 4. Changes between baseline and two-week follow-up, Study 2.
nBaseline Mean (SD)2-week Follow-Up Mean (SD)tDifference (95% CI)
Worry222.15 (0.90)2.35 (0.85)1.300.20 (−0.12 to 0.53)
E-cigarette user prototypes—positive212.06 (0.85)1.74 (0.70)−2.01−0.32 (−0.66 to 0.01)
E-cigarette user prototypes—negative201.63 (0.65)1.73 (0.71)0.640.10 (−0.23 to 0.43)
No. conversations about the addictiveness of e-cigarettes in past week220.82 (1.79)1.63 (2.22)2.250.82 (0.06 to 1.58)
No. conversations about the health problems caused by e-cigarettes in past week220.77 (1.74)1.55 (1.47)2.940.77 (0.23 to 1.32)
No. conversations about quitting e-cigarettes in past week220.91 (1.63)1.32 (1.52)1.160.41 (−0.32 to 1.14)
E-cigarette quit intentions191.56 (0.60)1.91 (0.78)2.540.35 (0.06 to 0.64)
No. of times forgoing an e-cigarette in past week220.77 (0.96)1.64 (2.51)1.730.86 (−0.17 to 1.90)
Made e-cigarette quit attempt (for 24 h) in past week, %215%29%--24% (1% to 47%)
Response scale for worry and e-cigarette user prototypes ranged from 1 to 5, with 5 indicating higher endorsement. Response scale for e-cigarette quit intentions ranged from 1 to 4, with 4 indicating higher intentions. -- = not applicable. SD = standard deviation. CI = confidence interval.
Table 5. Recommended e-cigarette warning protocol.
Table 5. Recommended e-cigarette warning protocol.
Protocol StepRationale
1. Schedule weekly study visit appointments A week between visits reduces participants’ financial burden of having to purchase refills and allows for frequent assessment of outcomes.
2. Determine e-cigarette consumption Knowing how much an e-cigarette user typically consumes allows study staff to instruct the user on how many devices and refills to bring to the first and subsequent study visits.
3. Ask users to bring 1–2 e-cigarette devices and eight days’ worth of refills to study visitsHaving users bring in their e-cigarette devices and refills on their own (rather than providing devices) prevents them from thinking that the study is giving users “free e-cigarettes.” Ask users to bring in their e-cigarette device and an eight-day supply of refills. If participants use more than one e-cigarette, ask them to bring in the two devices they own and use most frequently; if participants use disposable e-cigarettes, ask them to bring an eight-day supply of disposable e-cigarettes. Having users bring extra refills or disposable e-cigarettes allows for a buffer against missed appointments or in case they use more than expected in a given week.
4. Apply labels to users’ e-cigarette device(s) and refill(s)Researchers label the devices and refills. Having researchers label devices and refills is likely to lead to higher protocol compliance. Apply labels to the e-cigarette on the area farthest from the mouth piece to minimize contact with saliva and increase chance of being seen during use. See Figure 4 for examples of recommended warning placement. Alternative approaches, such as users applying the warning labels to their own devices, may serve as an additional intervention component in addition to the warning itself.
5. Provide participation incentives for survey completionCommunicating that study incentives are for survey completion may reduce the possibility that participants will perceive that payments equate to receiving free e-cigarettes or refills.
6. Provide e-cigarette users materials about tobacco cessation services at study completionGiving information about tobacco product cessation services at the end of the study may help users to quit using all tobacco products, if they have not already. It will also help explain that no tobacco product is safe to use, which may prevent unintended consequences such as compensatory cigarette smoking and correct any potentially inaccurate risk perceptions.

Share and Cite

MDPI and ACS Style

Mendel, J.R.; Hall, M.G.; Baig, S.A.; Jeong, M.; Brewer, N.T. Placing Health Warnings on E-Cigarettes: A Standardized Protocol. Int. J. Environ. Res. Public Health 2018, 15, 1578. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph15081578

AMA Style

Mendel JR, Hall MG, Baig SA, Jeong M, Brewer NT. Placing Health Warnings on E-Cigarettes: A Standardized Protocol. International Journal of Environmental Research and Public Health. 2018; 15(8):1578. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph15081578

Chicago/Turabian Style

Mendel, Jennifer R., Marissa G. Hall, Sabeeh A. Baig, Michelle Jeong, and Noel T. Brewer. 2018. "Placing Health Warnings on E-Cigarettes: A Standardized Protocol" International Journal of Environmental Research and Public Health 15, no. 8: 1578. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph15081578

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop