© 2005 American Public Health Association DOI: 10.2105/AJPH.2004.049692
Matthew C. Farrelly and Kevin C. Davis are with RTI International, Research Triangle Park, NC. At the time of the study, M. Lyndon Haviland was with, and Cheryl G. Healton is with, the American Legacy Foundation, Washington, DC. Cheryl G. Healton is also with the Mailman School of Public Health, Columbia University, New York, NY. Peter Messeri is with the Mailman School of Public Health, Columbia University. Correspondence: Requests for reprints should be sent to Matthew C. Farrelly, PhD, RTI International, 3040 Cornwallis Rd, Research Triangle Park, NC 27709 (e-mail: mcf{at}rti.org).
Objectives. In early 2000, the American Legacy Foundation launched the national "truth" campaign, the first national antismoking campaign to discourage tobacco use among youths. We studied the impact of the campaign on national smoking rates among US youths (students in grades 8, 10, and 12). Methods. We used data from the Monitoring the Future survey in a pre/post quasi-experimental design to relate trends in youth smoking prevalence to varied doses of the "truth" campaign in a national sample of approximately 50000 students in grades 8, 10, and 12, surveyed each spring from 1997 through 2002. Results. Findings indicate that the campaign accounted for a significant portion of the recent decline in youth smoking prevalence. We found that smoking prevalence among all students declined from 25.3% to 18.0% between 1999 and 2002 and that the campaign accounted for approximately 22% of this decline. Conclusions. This study showed that the campaign was associated with substantial declines in youth smoking and has accelerated recent declines in youth smoking prevalence.
Mass media campaigns can be an effective public health strategy to prevent youth smoking.13 Antismoking television campaigns have emphasized diverse themes to discourage smoking, including highlighting short-and long-term health consequences, deglamorizing its social appeal through humorous and unflattering portrayals, and countering misperceptions that smoking is widespread among teens. A more recent theme, first used by California in the 1990s, focuses on exposing deceptive tobacco industry marketing practices and denials of tobaccos health and addictive effects. In 1998, the Florida Department of Health launched a tobacco prevention program that featured a mass media campaign known as "truth" that countered industry influences with hard-hitting television advertisements that deglamorized smoking and portrayed youth confronting the tobacco industry. After 2 years, the prevalence of any past 30-day smoking among middle and high school students dropped by 40% and 18%, respectively.4 In a longitudinal study, Sly et al.5 linked exposure to the Florida "truth" campaign to declines in youth smoking prevalence. As a result of the Master Settlement Agreement between tobacco companies and 46 states, the American Legacy Foundation (Legacy) initiated the national "truth" campaign in February 2000. From 2000 to 2002, annual funding for the campaign averaged $100 million per year. A national media purchase was employed by the campaign, as opposed to a randomized exposure design, for 2 primary reasons. First, Legacy could not ethically assign some media markets to low or zero exposure, given the documented successes of the Florida "truth" campaign. Second, a national media purchase was roughly 40% cheaper than a market-to-market purchase, which would have been necessary to randomize exposure. Although the "truth" campaign builds upon the experiences of Florida and other state campaigns, no similar large-scale national antismoking effort has occurred since the period of the Fairness Doctrine from 1967 to 1970, when TV networks were required to maintain a balance between anti-and prosmoking ads. The "truth" campaign ads are designed to avoid overt and directive messages that tell teens not to smoke and instead use graphic images depicting stark facts about death and disease caused by tobacco and exposés of manipulative marketing practices. For example, an early commercial, "Body Bags," showed youths piling 1200 body bags outside a major tobacco companys headquarters to highlight the daily death toll from tobacco use. This is the first study to evaluate the behavioral outcomes of the campaign. Previous studies have shown that the campaign influenced campaign-related attitudes toward tobacco use and the tobacco industry and that negative attitudes about the tobacco industry are correlated with reduced risk of smoking.69 The current study assessed whether there was a doseresponse relationship between the level of exposure to the campaign and youth smoking prevalence during the first 2 years of the campaign.
Study Design Overview This study used a pre/post quasi-experimental design that related changes in youth smoking prevalence to varied exposure to the campaign over time and across media markets in the United States; secular trends in smoking prevalence and other confounding influences were controlled. The years 19971999 represent a precampaign study period, and although the campaign was launched nationally, the dose of campaign messages varied considerably across media markets and over time from 2000 to 2002. The primary source of variation in exposure is the presence or absence of local affiliates for 1 or more of the broadcast networks (e.g., FOX, UPN, WB) on which "truth" campaign commercials aired and variation in cable television market presence (e.g., MTV).
Study Population MTF surveys are conducted in approximately 420 public and private secondary schools per year and use a multistage random sampling design to provide nationally representative samples of students in each grade level. The sampling procedure selects geographic areas in stage 1, 1 or more schools within those geographic areas in stage 2, and classes within each school in the final stage. Schools are selected such that their probability of selection is proportionate to the size of the classes being sampled. Sample weights are applied to all respondents in the survey to adjust for school differences in probabilities of selection and school size. Up to 350 students are surveyed from each selected school. All surveys are self-administered in school classrooms during normal class periods. The average yearly student response rates for 8th-, 10th-, and 12th-grade students in the 19972002 MTF surveys were 89.0%, 86.2%, and 82.8%, respectively. The primary study outcome was a dichotomous indicator for reporting any quantity of smoking in the past 30 days, based on the question "How frequently have you smoked cigarettes during the past 30 days?" Our indicator variable equaled zero for students who responded "none per day" and 1 for students who responded less than 1 cigarette, 1 to 5 cigarettes, about 1/2 pack, about 1 pack, about 1 1/2 packs, and 2 packs or more per day.
Exposure
To illustrate the variation in potential exposure, we grouped the 210 media markets into 1 of 5 levels of exposure, on the basis of the range in total GRPs (647 to 22 389) that accumulated in each market from campaign launch in February 2000 until the second quarter of 2002 (Figure 1
A students exposure was defined as the cumulative number of "truth" campaign GRPs that were delivered in a schools media market from the beginning of the campaign to the time of each spring survey in 2000, 2001, and 2002. Consistent with our pre/post evaluation design, we included students surveyed from 1997 to 1999 to serve as a historical unexposed (GRP = 0) comparison group. To account for the possibility that markets that received relatively high doses of the campaign might experience diminishing returns to additional GRPs, we included a quadratic term for cumulative GRPs in our models.
Potential Confounders Individual Level. Our multivariable models included individual-level data from the MTF such as grade, race/ethnicity, gender, parental education, and weekly income. We created indicator variables for grade, race/ethnicity (African American, Hispanic, Asian, other race, with White as the reference), gender, and parental education for mother and father separately (high school graduate, at least some college, with less than high school diploma as the reference category). To account for missing data on race and parental education, we included indicator variables for those with unspecified race and fathers and mothers education in the MTF survey. We also included a measure of students weekly income, based on 2 MTF survey questions that assess how much money students earn during an average week from a job and from other sources such as allowances. To adjust for inflation, we used the 2002 consumer price index to express our measure of income in 2002 dollars. Media Market Level. In light of the source of variation in the media market dose of the "truth" campaign, there might be factors that determined both the dose of the "truth" campaign and the level of smoking at the media market level. For example, low-exposure markets tended to be more rural, White, and less educated and have lower incomesall factors associated with smokingthan markets with high campaign exposure. Failing to control for these factors could lead to a spurious negative correlation between campaign exposure and smoking prevalence. We implemented 2 approaches to statistically model possible correlations between preexisting media market smoking rates and the subsequent campaign dose. We first treated each of the 210 media markets as fixed effects in a logistic regression model that included indicator variables for 209 of 210 media markets (with 1 market as a reference).12 The fixed-effects approach was equivalent to controlling for average market-level smoking rates, effectively making each market its own control group. Our second approach included direct media marketlevel measures of potential confounders2002 data on the median household income, percentage of the population who were college graduates, and population size. State Level. To account for potential state-level influences, we collected data on inflation-adjusted cigarette prices13 and investments in tobacco control programs corresponding to the 19972002 MTF and the location of a students school. Previous research has shown that cigarette prices and state tobacco control programs influence youth smoking prevalence.4,14,15 Our measure of tobacco control investments is based on state per capita tobacco control program funding derived from Centers for Disease Control and Prevention State Highlight reports1618 and supplemented by data from state programs.
Analytic Approach Multivariable Logistic Regression. To more precisely isolate the association between current youth smoking prevalence and "truth" campaign exposure, we used population average logistic regression models to estimate current youth smoking prevalence as a function of individual-, media market, and state-level influences (noted earlier). We also included a linear time variable, taking values from 0 to 6 for the MTF years from 1997 to 2002, to control for the national downward trend in the prevalence of youth smoking that began in 1997 in order to isolate the effects of the campaign from the national trend. Students from the 19971999 surveys served as an unexposed comparison group. We estimated all regressions by combining the cross-sectional 19972002 MTF surveys to relate the odds that an individual smoked to his or her media market dose of the campaign, measured at the time of the survey. Cumulative campaign GRPs were scaled such that the estimated odds ratios indicated the odds of smoking, given an increase of 10000 GRPs. All models were estimated separately for 8th, 10th, and 12th grades and all grades combined. All analyses were estimated with sampling weights that corrected for nonresponse and sample design. Standard errors were adjusted for clustering at the school level (schools were the primary sampling unit) using Statas (version 8.0; Stata Corp, College Station, Tex) SVYLOGIT command. We estimated 2 sets of logistic regressions: 1 with media market indicator variables and 1 with the specific market-level variablesmedian household income, percentage of the population who were college graduates, and average population size of telephone exchanges within each media market. A final set of regressions examined the differential effects of the campaign in 2000, 2001, and 2002 to test the hypothesis that the campaign effects on smoking rates in spring 2001 and 2002 were substantially greater than campaign effects measured in the spring 2000 MTF surveyonly a few months into the campaign. We employed 2 methods to illustrate the relationship between youth smoking rates and campaign exposure from the logistic regressions. First, to illustrate to what extent there was evidence of diminishing campaign effects at increasing levels of exposure, we plotted the combined odds ratio for the linear (GRP) and quadratic (GRP2) exposure variables over a range of GRPs. Second, the inclusion of a precampaign period (19971999) allowed us to predict the trend in youth smoking prevalence in the absence of the campaign and hence to estimate the proportion of the decline in youth smoking prevalence attributable to the "truth" campaign after 1999. To do this, we estimated the probability of smoking for each year on the basis of the multivariable logistic regressions, setting campaign exposure to zero in each postcampaign year for all youths. The difference between the predicted and the actual smoking rates indicated how much lower smoking rates were as a result of the campaign.
The MTF data showed a large decline in current youth smoking prevalence overall and for each grade between 1997 and 2002 (Table 1
Results of the logistic regression for all grades indicated that there was a statistically significant doseresponse relationship between "truth" campaign exposure and current youth smoking prevalence (odds ratio [OR] = 0.78; 95% confidence interval [CI] = 0.63, 0.97; P<.05) (Table 2
Results calculated from the data presented in Table 2
In addition, as hypothesized, there was no statistically significant relationship between overall youth smoking prevalence and the campaign after only a few months of the campaign in 2000, but the effect was statistically significant in 2001 (OR = 0.66; 95% CI = 0.45, 0.98; P<.05) and 2002 (OR = 0.63; 95% CI = 0.45, 0.88; P<.01) (Table 2
Separate regressions by grade show the largest effects for 8th-grade students (OR = 0.61; P<.05), followed by statistically non-significant effects for 12th- (OR = 0.79; P=.198) and 10th- (OR = 0.98; P=.884) grade students, respectively (Table 2 The doseresponse relationship for the "truth" campaign is robust across the alternative set of models that control for potential confounding of media market characteristics, such as median household income, percentage of the population who were college graduates, average population size of telephone exchanges within each media market, and state-specific indicator variables (results available on request).
The "truth" campaign was associated with significant declines in youth smoking prevalence; thus, its approach to appeal to youths with hard-hitting ads that show at-risk youths rejecting tobacco and that reveal deceptive tobacco industry marketing tactics appears to be effective. Previous research revealed that in its first year, the campaign reached three fourths of American youths and was associated with campaign-related attitudes toward tobacco and the tobacco industry among youths. The current results further validate these early markers of the campaigns success. These findings are consistent with previous research on the effectiveness of antismoking campaigns in general1,2 and recent state tobacco industry manipulation campaigns.5,19 In addition to being consistent with previous findings, this study improves on previous research by reaching generalized conclusions about the effects of antismoking campaigns for youths across the United States and by implementing a pre/post quasi-experimental design that controlled for potential threats to validity, such as secular trends in smoking prevalence, the influence of cigarette prices, state tobacco control programs, and other factors. Descriptive statistics show that smoking rates declined faster after the launch of the campaign. More significant, this result was confirmed in multivariable analyses that controlled for confounding influences and indicated a doseresponse relationship between "truth" campaign exposure and current youth smoking prevalence. To address concerns over the environmental nature of the "truth" campaign exposure measure, we performed sensitivity analyses that showed internally consistent and intuitive resultsno effect in the early months of the campaign, diminishing returns, and no statistically significant association between the campaign and drinking among youths (described later). We found that by 2002, smoking rates overall were 1.5 percentage points lower than they would have been in the absence of the campaign, which translates to roughly 300 000 fewer youth smokers based on 2002 US census population statistics. To put our findings in perspective, research indicated that youth smoking prevalence declined by about 1 percentage point per year between 1967 and 1970 during the period of the Fairness Doctrine.20 It is important to note that these results may also reflect residual impacts from the 1964 Smoking and Health: Report of the Advisory Committee to the Surgeon General of the Public Health Service21 and federal government policies requiring health warnings on all cigarette packages and in all cigarette advertising. Our findings provide some evidence that the campaign may have the largest impact among 8th-grade students, which is consistent with evidence from Florida that indicates the Florida "truth" campaign led to declines in smoking rates and that smoking rates declined by 50% among middle school students (grades 6 through 8) and by 35% among high school students (grades 9 through 12) from 1998 to 2002. Our analyses are not without their limitations. Our measures of youth smoking prevalence are self-reported and may be subject to social desirability bias so that youths are less likely to report smoking in areas with high exposure to the campaign than in areas with lower exposure. This would lead to an overstatement of the campaigns effects. However, previous studies have found that underreporting of smoking by youths is minimal.2224 Our results also rely on repeated cross-sectional surveys, not repeated measures on the same students, which weakens the strength of our causal inference. However, we included youths surveyed before 2000, so students in the 19971999 surveys served as an unexposed control group.
Finally, it is possible that the estimated campaign effects may have been due to other unmeasured youth-focused prevention activities (e.g., in-school substance abuseprevention programs, the national antidrug campaign by the Office of National Drug Control Policy) that were correlated by chance with the "truth" campaign exposure. To assess this possibility, we used data from the 2000 and 2002 National Youth Tobacco Surveys to examine the correlation between the "truth" campaign exposure and exposure to tobacco use prevention education in schools. In addition, if there was a spurious correlation between "truth" campaign exposure and other prevention activities, we would also have expected to find a correlation between the "truth" campaign and other risk behaviors such as underage drinking. We addressed this potential problem by estimating a series of models identical to those presented in Table 2
Although exposure to multistrategy tobacco use prevention education programs in schools has been linked to lower smoking prevalence among middle school students,25,26 we found no statistically significant differences in reported exposure to tobacco use prevention education programs in schools and exposure to the "truth" campaign. We tested this relationship by comparing self-reported recall of tobacco use prevention education programs in schools from the National Youth Tobacco Surveys by grouping students into the same 5 levels of "truth" campaign exposure illustrated in Figure 1 In addition, we did not find any evidence of a relationship between "truth" campaign exposure and any drinking in the past 30 days (OR = 0.981; P=.848) nor any relationship between "truth" campaign exposure and any binge drinking within the past 2 weeks (OR = 0.857; P=.189), suggesting that "truth" campaign exposure is not spuriously correlated with other prevention efforts. Our results further suggest that the measured "truth" campaign effects on smoking prevalence are not the result of other efforts such as in-school tobacco use prevention education programs and prevention activities aimed at other risk behaviors such as underage drinking. Under the Master Settlement Agreement, the tobacco industry was obligated to fund Legacys Public Education Fund for 5 years (through 2003) and is obligated thereafter in any year in which the tobacco companies participating in the Master Settlement Agreement achieve a combined 99.05% market share of US tobacco sales. The continuation of Legacys efforts, including the "truth" campaign, is presently in question because of these terms. Our findings are consistent with those of other studies that demonstrate that effective antismoking campaigns are critical for public health and that their elimination will likely erase gains that have been made to date in reducing youth smoking prevalence.2731
This study was supported by the American Legacy Foundation. We express our appreciation to Lloyd Johnson and Patrick OMalley as the principal investigators of Monitoring the Future (MTF) for their cooperation in providing timely access to the MTF data. We also thank Timothy Perry for his contributions to analysis of the MTF data and Susan Murchie for editorial review.
Human Participant Protection
Peer Reviewed
Contributors Accepted for publication October 23, 2004.
1. Farrelly MC, Niederdeppe J, Yarsevich J. Youth tobacco prevention mass media campaigns: past, present, and future directions. Tob Control. 2003;12(suppl 1): i35i47. 2. Siegel M. Antismoking advertising: figuring out what works. J Health Commun. 2002;7(2):157162.[CrossRef][Web of Science][Medline] 3. Wakefield M, Flay B, Nichter M, Giovino G. Effects of anti-smoking advertising on youth smoking: a review. J Health Commun. 2003;8(3):229247.[CrossRef][Web of Science][Medline]
4. Bauer UE, Johnson TM, Hopkins RS, Brooks RG. Changes in youth cigarette use and intentions following implementation of a tobacco control program: findings from the Florida Youth Tobacco Survey, 19982000. JAMA. 2000;284:723728. 5. Sly DF, Hopkins RS, Trapido E, Ray S. Influence of a counteradvertising media campaign on initiation of smoking: the Florida "truth" campaign. Am J Public Health. 2001;91:233238.[Abstract]
6. Farrelly MC, Healton CG, Davis KC, Messeri P, Hersey JC, Haviland ML. Getting to the "truth": evaluating national tobacco countermarketing campaigns. Am J Public Health. 2002;92:901907.
7. Niederdeppe J, Farrelly MC, Haviland ML. Confirming "truth": more evidence of a successful tobacco countermarketing campaign in Florida. Am J Public Health. 2004:94:255257. 8. Evans WD, Price S, Blahut S, Ray S, Hersey JC, Niederdeppe J. Social imagery, tobacco independence, and the truth® campaign. J Health Commun. 2004;9: 425441.[CrossRef][Web of Science][Medline] 9. Hersey JC, Niederdeppe J, Evans WD, et al. The effects of state counterindustry media campaigns on beliefs, attitudes, and smoking status among teens and young adults. Prev Med. 2003:37(6 pt 1):544552.[CrossRef][Web of Science][Medline] 10. Johnston LD, Bachman JG, OMalley PM, Schulenberg J. Monitoring the Future: A Continuing Study of American Youth (8th, 10th, and 12th Grade Surveys). Ann Arbor, Mich: Inter-University Consortium for Political and Social Research; 2003. 11. Glanz K, Lewis FM, Rimer BK. Health Behavior and Health Education. San Francisco, Calif: Jossey-Bass Publishers; 1997. 12. Heckman JJ, Hotz VJ. Choosing among alternative nonexperimental methods for estimating the impact of social programs: the case of manpower training. J Am Stat Assoc. 1989;84:862880.[CrossRef] 13. Tax Burden on Tobacco. Historical Compilation. Vol 37. Arlington, Va: Orzechowski & Walker; 2002. 14. Reducing Tobacco Use: A Report of the Surgeon General. Atlanta, Ga: National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health; 2000. 15. Farrelly MC, Pechacek TF, Chaloupka FJ. The impact of tobacco control program expenditures on aggregate cigarette sales: 19812000. J Health Econ. 2003; 22:843859.[CrossRef][Web of Science][Medline] 16. State Tobacco Control Highlights 1999. Atlanta, Ga: National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health; 2002. 17. Investment in Tobacco Control: State Highlights 2001. Atlanta, Ga: National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health; 2002. 18. Tobacco Control State Highlights 2002: Impact and Opportunity. Atlanta, Ga: National Center for Chronic Disease Prevention and Health Promotion, Office on Smoking and Health; 2002. 19. Sly DF, Trapido E, Ray S. Evidence of the dose effects of an antitobacco counteradvertising campaign. Prev Med. 2002;35:511518.[CrossRef][Web of Science][Medline] 20. Lewit EM, Coate D, Grossman M. The effects of government regulation on teenage smoking. J Law Econ. 1981;24:545569.[CrossRef] 21. Smoking and Health: Report of the Advisory Committee to the Surgeon General of the Public Health Service. Washington, DC: US Department of Health, Education and Welfare; 1964.
22. Bauman KE, Koch GG. Validity of self-reports and descriptive and analytical conclusions: the case of cigarette smoking by adolescents and their mothers. Am J Epidemiol. 1983;118(1):9098. 23. Bauman KE, Koch GG, Bryan ES. Validity of self-reports of adolescent cigarette smoking. Int J Addict. 1982;17:11311136.[Web of Science][Medline] 24. Messeri P, Haviland ML, Mowery P, Gable J, Farrelly MC. A biochemical validation study to assess effects of the "truth" campaign on truthful reporting of current smoking among high school students. Paper presented at the 130th Annual Meeting of the American Public Health Association; November 2002; Philadelphia, Pa.
25. Peterson AV Jr, Kealy KA, Mann SL, Marek PM, Srason IG. Hutchinson Smoking Prevention Project: long-term randomized trial in school-based tobacco use preventionresults on smoking. J Natl Cancer Inst. 2000;92:19791991. 26. Wenter DL, Blackwell S, Davis KC, Farrelly MC. Legacy First Look Report 8: Using Multiple Strategies in Tobacco Use Prevention Education. Washington, DC: American Legacy Foundation; 2002. 27. Glantz SA. Changes in cigarette consumption, prices, and tobacco industry revenues associated with Californias Proposition 99. Tob Control. 1993;2: 311314.
28. Pierce JP, Gilpin EA, Emery SL, et al. Has the California tobacco control program reduced smoking? JAMA. 1998;280:893899. 29. Centers for Disease Control and Prevention. Effect of ending an antitobacco youth campaign on adolescent susceptibility to cigarette smokingMinnesota, 20022003. MMWR Morb Mortal Wkly Rpt. 2004; 53(14):301304.
30. Fichtenberg CM, Glantz SA. Association of the California tobacco control program with declines in cigarette consumption and mortality from heart disease. N Engl J Med. 2000;343:17721777.
31. Goldman LK, Glantz SA. Evaluation of antismoking advertising campaigns. JAMA. 1998;279:772777. This article has been cited by other articles:
eLetters:Read all eLetters
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||