© 2002 American Public Health Association
Michael Huncharek is with the Division of Radiation Oncology, Department of Clinical Oncology, Marshfield Clinic Cancer Center, Marshfield, Wis; the Meta-Analysis Research Group, Stevens Point, Wis; and St. Michael's Hospital Cancer Center, Stevens Point. Bruce Kupelnick is with the Meta-Analysis Research Group, Stevens Point. Correspondence: Requests for reprints should be sent to Michael Huncharek, MD, MPH, FACA, Director, Meta-Analysis Research Group, 2740 Sunset Blvd, Stevens Point, WI 54481 (e-mail: metaresearch{at}hotmail.com).
Objectives. This study examined the methodology of epidemiological studies that suggest use of topical sunscreen preparations is associated with increased risk of malignant melanoma. Methods. We pooled data from observational studies using a general variancebased meta-analytic method that employed confidence intervals (previously described). The outcome of interest was a summary relative risk (RR) reflecting the risk of melanoma associated with sunscreen use versus nonuse. Sensitivity analyses were performed when necessary to explain any observed statistical heterogeneity. Results. Combining studies that used nonheterogeneous data yielded a summary RR of 1.01, indicating no association between sunscreen use and development of malignant melanoma. Conclusions. The available epidemiological data do not support the existence of a relationship between topical sunscreen use and an increased risk of cutaneous malignant melanoma. (Am J Public Health. 2002;92:11731177)
Malignant melanoma is 1 of the most increasingly common solid tumors over the last three decades.1 Although increased detection may possibly account for some of the increase in incidence, other behavioral and environmental factors are likely to contribute to the current "epidemic" of this disease. Sun exposure in the form of ultraviolet-B (UVB) radiation is considered a major risk factor for the development of melanoma. Unfortunately, uncertainties regarding the impact of various host characteristics, frequency and type of sun exposure, and behavioral factors on melanoma development complicate assessment of the exact relationship between sun exposure and cancer risk.2 Sunscreens are able to delay sunburns and to reduce some UV-induced skin lesions, such as nonmelanoma tumors in rodents, local immunological depression, mutations of the p53 gene in keratinocytes, and the incidence of actinic keratoses in humans. As a consequence, sunscreen use is often recommended as a sun protection method, although its true impact on melanoma prevention remains obscure. Despite uncertainties in the available epidemiological data, experimental evidence using both animal models and humans suggests that sunscreen preparations capable of reducing exposure to UVB radiation from the sun can prevent melanoma.2 Regrettably, this finding has not been universal. In fact, some investigators suggest that sunscreen use could be a risk rather than a protective factor for malignant melanoma.1 Although it is considered unlikely that available sunscreen preparations contain compounds with carcinogenic effects, other factors may account for this observed relationship; they include uncontrolled confounding caused by host factors and behavioral factors, such as increased sun exposure among patients who use sunscreen preparations. This article presents the results of a meta-analysis designed to examine the impact of sunscreen use on melanoma risk. In addition to calculating an overall summary estimate of effect, the analysis also explores characteristics of the included studies that may contribute to heterogeneity of observed outcome. The resulting data may provide a clearer understanding of the role of sunscreen in preventing malignant melanoma.
The methods used in the design and execution of this study have been described previously.3,4 The study protocol initially developed outlined a meta-analysis to examine the risk of developing malignant melanoma associated with topical sunscreen use. Eligibility criteria for study inclusion were determined prospectively, as were the specific data elements to be extracted from each published report. The study protocol also included details of the planned statistical analysis. We used a data extraction form designed for recording relevant information from each selected report. Two researchers performed data extraction, with differences in extraction forms resolved by consensus. Other data collected but not included in the eligibility criteria were number of patients in each study, study odds ratios and 95% confidence intervals (CIs), and type of statistical adjustments made, if any, by individual study authors.
Literature Search
The initial citations (in the form of abstracts) from this literature search were screened by a physicianinvestigator to exclude those that did not meet protocolspecified inclusion criteria. Reasons for rejection included studies of designs other than casecontrol; cohort or randomized controlled trials; animal or in vitro studies; studies including nonmelanoma skin cancer patients not stratified by tumor type; abstracts; and review articles. Copies of full articles for the remaining citations were obtained and screened according to the following additional eligibility criteria: (1) published casecontrol or cohort studies, (2) studies enrolling adult patients only (i.e.,
Statistical Analysis For each included study, we derived odds ratios reflecting the risk of developing malignant melanoma associated with sunscreen use and determined the natural logarithm of the estimated relative risk (RR) for each data set followed by an estimate of the variance. We used the estimate of the 95% confidence interval from each study to calculate the variance of each study's measure of effect. We calculated a weight for each included study as 1/variance followed by a summation of the weights. We then determined the product of the study weight and the natural logarithm of the estimated relative risk and performed a summation of these products. Finally, we calculated a summary RR and 95% confidence interval.5
Before estimation of the summary RR, we performed a statistical test for heterogeneity (Q). This procedure tests the hypothesis that the effect sizes are equal in all studies.3 If Q exceeds the upper-tail critical value of the
We obtained a total of 166 citations from the electronic and manual literature search. Initial screening of these citations yielded 13 that appeared to meet specified protocol criteria.618 On further review of the full published manuscripts, we found that 2 articles did not meet inclusion criteria. Herzfeld et al.17 did not clearly distinguish between the use of suntan lotion and sunscreen preparations. Because of its lack of stratification, this study was not included in the meta-analysis. The study by Autier and Dore18 also did not meet inclusion criteria, because it examined only the influence of sun exposure during childhood and adulthood on melanoma risk using a "sun exposure index" created by the authors. Data on sunscreen use had been collected in a earlier casecontrol study by this group15 that was included in the meta-analysis. The remaining 11 published articles composed the database for the present analysis.
Table 1
All but 3 studies6,7,16 had odds ratios greater than 1.0, demonstrating that the vast majority of casecontrol studies indicate that sunscreen users have a greater risk of melanoma than do nonusers. Combining data from all 11 reports gave a summary RR of 1.11 (95% CI = 0.37, 3.32), a statistically nonsignificant result. Calculation of Q for this meta-analysis resulted in a value of 42.0 (Table 2
We performed several sensitivity analyses to evaluate possible sources of the observed statistical heterogeneity. As indicated in Table 1
Our examination of the data presented in Table 2
Table 3
Next, we combined the 7 reports that used hospital patient databases in a meta-analysis. Five of the 7 studies had odds ratios greater than 1.09,911,14,15 suggesting an association between sunscreen use and melanoma risk. Our analysis for heterogeneity yielded a Q of 36.9. With 6 degrees of freedom, the corresponding P value for a Q of this size was < .001, a highly heterogeneous result. Substantial heterogeneity therefore exists across these 7 studies. We obtained a summary RR of 2.41 (95% CI = 0.32, 18.1). This finding provides evidence that bias associated with hospital-derived data is probably accounting for the observed positive association between sunscreen use and melanoma risk in many of the available casecontrol studies.
The sustained increase in malignant melanoma incidence over the past few decades highlights the fact that this disease represents a major public health management issue worldwide. In the United States alone, more than 42 000 cases are diagnosed and more than 7 000 deaths result each year.19 Sun exposure is recognized as the most important environmental risk factor for malignant melanoma.20 Behaviors that increase sun exposure have been suggested to be major contributors to the rising incidence. This suggestion has led to the development of measures to protect individuals from the potentially harmful effects of solar ultraviolet radiation (both ultraviolet-A [UVA] radiation and UVB), most notably topical sunscreen preparations. If solar radiation is a primary risk factor for malignant melanoma, it is reasonable to conclude that reducing sun exposure via topical sunscreen use would be associated with reduced disease risk. However, the available epidemiological data are contradictory. In fact, the majority of studies suggest that sunscreen use is associated with an increased melanoma risk (see, e.g., studies cited in references 9 and 10). To address this uncertainty, we designed the present study to systematically evaluate the available data using rigorous meta-analytic techniques. By pooling data from 11 casecontrol studies meeting protocol inclusion criteria (yielding a statistically nonsignificant summary odds ratio of 1.11), we demonstrated that sunscreen use is not associated with an increased risk of developing malignant melanoma. Unfortunately, further evaluation showed the data to be highly heterogeneous (i.e., the available studies are not measuring an effect size of the same magnitude), thereby making the validity of the summary odds ratio questionable. We then explored reasons for the observed heterogeneity. Several constitutional factors are accepted as important risk factors for melanoma; these include presence of nevi, having red or fair hair color, freckling, and having blue eye color.14 Failure to control for possible confounders could certainly contribute to the observed statistical heterogeneity. Two of the studies used in the meta-analysis10,11 did not adjust for such factors. Nonetheless, our sensitivity analysis indicated that heterogeneity remained even when the data from Klepp et al. and Graham et al. were dropped from the pooled analysis. Our careful review of study designs and selection criteria for case and control subjects suggested that the source of study subjects might contribute to a biased estimate of effect (i.e., individual study odds ratios). We found that data from the 4 studies that used population registryderived subjects7,8,12,13 were statistically homogeneous compared with data from studies that used hospital-derived databases. This result provided strong evidence that selection bias is an important factor contributing to the spurious finding, seen in much of the literature, of a positive association between sunscreen use and melanoma development. Hospital-derived data are problematic because referral patterns differ widely depending on hospital location, type of facility (e.g., university vs community hospital), and practice patterns, among other factors. In addition, some studies did not provide adequate information on control patient selection. For instance, Rodenas et al.16 reported that "controls were selected from the visitors to the hospital on a random basis" without providing details of the "random" selection process. Autier et al.15 selected case subjects from 5 collaborating hospitals; they noted that "controls were randomly chosen in the same municipality as the cases." Again, no further details are provided on what constituted "random" selection. Referral patterns may influence study results. If referral patterns among hospitals in a given city or region differ, the overreferral of exposed cases to one hospital implies an underreferral of exposed cases to the others. Due to "differential referral," a factor may be associated with increased disease risk in one hospital-based study and may be protective in another. In an individual study, pooling data across hospitals helps to eliminate bias from differential admission of cases. Pooling data from several sources in a meta-analysis, as done in the study reported here, has partially accomplished this. Although many individual hospital-based studies showed a positive association between sunscreen use and melanoma risk, the pooled analysis indicated that this finding was spurious. Other factors that may affect outcome in casecontrol studies include "ascertainment bias" and misclassification of exposure status (in this case, sunscreen use). One factor not considered in the available studies is the possible influence of socioeconomic status (SES). Melanoma tends to affect white-collar, educated, and urban individuals. SES is known to affect recall of some types of information and could play a role in the studies examined in our analysis in which SES was not generally accounted for.20 These factors may all contribute to the wide variation in outcome observed across studies that used hospital registries. In contrast, data from more than 4 800 patients enrolled in population-based casecontrol studies showed no such variation (i.e., the data were not heterogeneous and could reliably be combined in a meta-analysis). The resulting summary RR of 1.01 (95% CI = 0.46, 2.28) provides strong evidence for a lack of any positive association between sunscreen use and increased melanoma risk.
The relationship between sunlight and melanoma is complex. Existing data suggest that the effect of solar radiation on melanoma development is more complex than is the case for other types of skin cancer.6 Many unanswered questions remain regarding factors that may influence melanoma development, including the type of sunlight exposure most associated with melanoma etiology, interaction with host factors possibly important in disease risk, sunburn history, and tanning ability, among others. Because of this complexity, it has been difficult to separate the effects of sun exposure per se from the effects of host factors. Nonetheless, because sunlight remains the most important recognized etiological factor in this disease, methods to reduce exposure (including use of topical sunscreens) appear to be a rational approach to disease prevention and risk reduction. We undertook the present meta-analysis to address the counterintuitive findings of multiple casecontrol studies that suggest sunscreen use as a risk factor for malignant melanoma. The largely positive association seen in the existing literature appears to be due to bias inherent in study designs and uncontrolled confounding. It is our hope that the results of the present analysis will contribute to the design of future studies addressing this issue. Until more conclusive data are available, recommending use of sunscreens as a cancer prevention strategy would appear to be prudent.
Partial funding for this project was provided by the Marshfield Medical Research Foundation and by a grant from Warner-Lambert Company to the Meta-Analysis Research Group. The authors thank Dr Henry Klassen and Lamar Wheeler for assistance with data extraction.
M. Huncharek planned the study, collected and analyzed the data, and wrote the article. B. Kupelnick designed the literature search strategy, conducted electronic and manual literature searches, performed literature retrieval, and participated in writing the article. Accepted for publication September 24, 2000.
1. Donawho C, Wolf P. Sunburn, sunscreen, and melanoma. Curr Opin Oncol.1996;8(2):159166.[Medline] 2. Osterlind A. Epidemiology of malignant melanoma in Europe. Acta Oncol. 1992;31(8):903908.[Medline] 3. Hedges LV, Olkin I. Statistical Methods for Meta-Analysis. New York, NY: Academic Press; 1985. 4. Cooper H, Hedges LV, eds. The Handbook of Research Synthesis. New York, NY: Russell Sage Foundation; 1994.
5.
Greenland S. Quantitative methods in the review of epidemiologic literature. Epidemiol Rev. 1987;9:130. 6. Espinoza Arranz J, Sanchez Hernandez JJ, Bravo Fernandez P, et al. Cutaneous malignant melanoma and sun exposure in Spain. Melanoma Res. 1999;9(2):199205.[Medline]
7.
Holly EA, Aston DA, Cress RD, et al. Cutaneous melanoma in women, I: exposure to sunlight, ability to tan, and other risk factors related to ultraviolet light. Am J Epidemiol. 1995;141(10):923933. 8. Westerdahl J, Olsson H, Masback A, et al. Is the use of sunscreens a risk factor for malignant melanoma? Melanoma Res. 1995;5(1):5965.[Medline] 9. Wolf P, Quehenberger F, Mullegger R, et al. Phenotypic markers, sunlight-related factors and sunscreen use in patients with cutaneous melanoma: an Austrian case-control study. Melanoma Res. 1998;8(4):370378.[Medline] 10. Klepp O, Magnus K. Some environmental and bodily characteristics of melanoma patients. A case-control study. Int J Cancer. 1979;23(4):482486.[Medline]
11.
Graham S, Marshall J, Haughey B, et al. An inquiry into the epidemiology of melanoma. Am J Epidemiol. 1985;122(4):606619. 12. Holman CD, Armstrong BK, Heenan PJ. Relationship of cutaneous malignant melanoma to individual sunlight-exposure habits. J Natl Cancer Inst. 1986;76(3):403414. 13. Osterlind K, Tucker MA, Stone BJ, et al. The Danish case-control study of cutaneous malignant melanoma, II: the importance of UV-light exposure. Int J Cancer. 1988;42(3):319324.[Medline] 14. Beitner H, Norell SE, Ringborg U, et al. Malignant melanoma: aetiological importance of individual pigmentation and sun exposure. Br J Dermatol. 1990;122(1):4351.[Medline] 15. Autier P, Dore JF, Schifflers E, et al. Melanoma and use of sunscreens: an EORTC case-control study in Germany, Belgium and France. The EORTC Melanoma Cooperative Group. Int J Cancer. 1995;61(6):749755.[Medline] 16. Rodenas JM, Delgado-Rodriguez M, Herranz MT, et al. Sun exposure, pigmentary traits, and risk of cutaneous malignant melanoma: a case-control study in a Mediterranean population. Cancer Causes Control. 1996;7(2):275283.[Medline] 17. Herzfeld PM, Fitzgerald EF, Hwang SA, Stark A. A case-control study of malignant melanoma of the trunk among white males in upstate New York. Cancer Detect Prev. 1993;17(6):601608.[Medline] 18. Autier P, Dore JF. Influence of sun exposures during childhood and during adulthood on melanoma risk. EPIMEL and EORTC Melanoma Cooperative Group, European Organisation for Research and Treatment of Cancer. Int J Cancer. 1998;77(4):533537.[Medline] 19. Ries LAG, Kosary CL, Hankey BF, et al. SEER Cancer Statistics Review: 19731994. Bethesda, Md: National Cancer Institute; 1997. NIH publication 97-2789. 20. International Agency for Research on Cancer. Solar and Ultraviolet Radiation. Monographs on the evaluation of the carcinogenic risk of chemicals to humans. Vol. 55. Lyon, France: IARC: 1992. 21. Glass R, Johnson B, Vessey M. Accuracy of recall of histories of oral contraceptive use. Br J Prev Soc Med. 1974;28(4):273275.[Medline] This article has been cited by other articles:
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||