Physician ratings of appropriate indications for six medical and surgical procedures.
R E Park,
A Fink,
R H Brook,
M R Chassin,
K L Kahn,
N J Merrick,
J Kosecoff and
D H Solomon
We convened three panels of physicians to rate the appropriatenessof a large number of indications for performing a total of sixmedical and surgical procedures. The panels followed a modifiedDelphi process. Panelists separately assigned initial ratings,then met in Santa Monica, California where they received reportsshowing their initial ratings and the distribution of the otherpanelists ratings. They discussed the indications and revisedthe indications lists, then individually assigned final ratings.There was generally better agreement on the final ratings thanon the initial ratings. Based on reasonable criteria for agreementand disagreement, and excluding one outlying procedure, thepanelists agreed on ratings for 42 to 56 per cent of the indications,and disagreed on 11 to 29 per cent.
This article has been cited by other articles:
S. N. Weingart, B. Simchowitz, H. Padolsky, T. Isaac, A. C. Seger, M. Massagli, R. B. Davis, and J. S. Weissman An Empirical Model to Estimate the Potential Impact of Medication Safety Alerts on Patient Safety, Health Care Utilization, and Cost in Ambulatory Care
Arch Intern Med,
September 14, 2009;
169(16):
1465 - 1473.
[Abstract][Full Text][PDF]
D. P. Faxon Assessing Appropriateness of Coronary Angiography: Another Step in Improving Quality
Ann Intern Med,
August 19, 2008;
149(4):
276 - 278.
[Full Text][PDF]
J. K. Harris, F. Froehlich, J.-J. Gonvers, V. Wietlisbach, B. Burnand, and J.-P. Vader The appropriateness of colonoscopy: a multi-center, international, observational study
Int. J. Qual. Health Care,
June 1, 2007;
19(3):
150 - 157.
[Abstract][Full Text][PDF]
I. S. Fraser, H.O.D. Critchley, M.G. Munro, and M. Broder Can we achieve international agreement on terminologies and definitions used to describe abnormalities of menstrual bleeding?
Hum. Reprod.,
March 1, 2007;
22(3):
635 - 643.
[Abstract][Full Text][PDF]
M. L. McGory, P. G. Shekelle, and C. Y. Ko Development of Quality Indicators for Patients Undergoing Colorectal Cancer Surgery.
J Natl Cancer Inst,
November 15, 2006;
98(22):
1623 - 1633.
[Abstract][Full Text][PDF]
A. Guttmann, A. Razzaq, P. Lindsay, B. Zagorski, and G. M. Anderson Development of Measures of the Quality of Emergency Department Care for Children Using a Structured Panel Process
Pediatrics,
July 1, 2006;
118(1):
114 - 123.
[Abstract][Full Text][PDF]
M. P. Tully and J. A. Cantrill The validity of explicit indicators of prescribing appropriateness
Int. J. Qual. Health Care,
April 1, 2006;
18(2):
87 - 94.
[Abstract][Full Text][PDF]
M. R. Patel, J. A. Spertus, R. G. Brindis, R. C. Hendel, P. S. Douglas, E. D. Peterson, M. J. Wolk, J. M. Allen, and I. E. Raskin ACCF Proposed Method for Evaluating the Appropriateness of Cardiovascular Imaging
J. Am. Coll. Cardiol.,
October 18, 2005;
46(8):
1606 - 1613.
[Full Text][PDF]
G. J. Poston, R. Adam, S. Alberts, S. Curley, J. Figueras, D. Haller, F. Kunstlinger, G. Mentha, B. Nordlinger, Y. Patt, et al. OncoSurge: A Strategy for Improving Resectability With Curative Intent in Metastatic Colorectal Cancer
J. Clin. Oncol.,
October 1, 2005;
23(28):
7125 - 7134.
[Abstract][Full Text][PDF]
J. M. Quintana, A. Escobar, J. Azkarate, J. I. Goenaga, and A. Bilbao Appropriateness of total hip joint replacement
Int. J. Qual. Health Care,
August 1, 2005;
17(4):
315 - 321.
[Abstract][Full Text][PDF]
G. HUTSCHEMAEKERS, B. TIEMENS, and A. KAASENBROOD Roles of psychiatrists and other professionals in mental healthcare: Results of a formal group judgement method among mental health professionals
The British Journal of Psychiatry,
August 1, 2005;
187(2):
173 - 179.
[Abstract][Full Text][PDF]
R. N. Shiffman, P. Shekelle, J M. Overhage, J. Slutsky, J. Grimshaw, and A. M. Deshpande Standardized Reporting of Clinical Practice Guidelines: A Proposal from the Conference on Guideline Standardization
Ann Intern Med,
September 16, 2003;
139(6):
493 - 498.
[Abstract][Full Text][PDF]
B. A. Spencer, M. Steinberg, J. Malin, J. Adams, and M. S. Litwin Quality-of-Care Indicators for Early-Stage Prostate Cancer
J. Clin. Oncol.,
May 15, 2003;
21(10):
1928 - 1936.
[Abstract][Full Text][PDF]
J. K. Tobacman, B. Zimmerman, P. Lee, L. Hilborne, H. Kolder, and R. H. Brook Visual Acuity following Cataract Surgeries in Relation to Preoperative Appropriateness Ratings
Med Decis Making,
March 1, 2003;
23(2):
122 - 130.
[Abstract][PDF]
A. H. Briggs, R. Goeree, G. Blackhouse, and B. J. O'Brien Probabilistic Analysis of Cost-Effectiveness Models: Choosing between Treatment Strategies for Gastroesophageal Reflux Disease
Med Decis Making,
August 1, 2002;
22(4):
290 - 308.
[Abstract][PDF]
J M Quintana, J Cabriada, I Lopez de Tejada, M Varona, V Oribe, B Barrios, I Arostegui, and A Bilbao Development of explicit criteria for cholecystectomy
Qual. Saf. Health Care,
January 12, 2002;
11(4):
320 - 326.
[Abstract][Full Text][PDF]
J. K. Tobacman, I. U. Scott, S. T. Cyphert, and M. B. Zimmerman Comparison of Appropriateness Ratings for Cataract Surgery between Convened and Mail-only Multidisciplinary Panels
Med Decis Making,
December 1, 2001;
21(6):
490 - 497.
[Abstract][PDF]
P. G. Shekelle, C. H. MacLean, S. C. Morton, and N. S. Wenger Assessing Care of Vulnerable Elders: Methods for Developing Quality Indicators
Ann Intern Med,
October 16, 2001;
135(8_Part_2):
647 - 652.
[Full Text][PDF]
E. C. Schneider, L. L. Leape, J. S. Weissman, R. N. Piana, C. Gatsonis, and A. M. Epstein Racial Differences in Cardiac Revascularization Rates: Does "Overuse" Explain Higher Rates among White Patients?
Ann Intern Med,
September 4, 2001;
135(5):
328 - 337.
[Abstract][Full Text][PDF]
R. W. Dubois, S. M. Swetter, M. Atkins, K. McMasters, R. Halbert, S. J. Miller, R. Shiell, and J. Kirkwood Developing Indications for the Use of Sentinel Lymph Node Biopsy and Adjuvant High-Dose Interferon Alfa-2b in Melanoma
Arch Dermatol,
September 1, 2001;
137(9):
1217 - 1224.
[Abstract][Full Text][PDF]
A. M. Epstein, J. Z. Ayanian, J. H. Keogh, S. J. Noonan, N. Armistead, P. D. Cleary, J. S. Weissman, J. A. David-Kasdan, D. Carlson, J. Fuller, et al. Racial Disparities in Access to Renal Transplantation -- Clinically Appropriate or Due to Underuse or Overuse?
N. Engl. J. Med.,
November 23, 2000;
343(21):
1537 - 1544.
[Abstract][Full Text][PDF]
K. M. Kuntz, J. Tsevat, M. C. Weinstein, and L. Goldman Expert Panel vs Decision-Analysis Recommendations for Postdischarge Coronary Angiography After Myocardial Infarction
JAMA,
December 15, 1999;
282(23):
2246 - 2251.
[Abstract][Full Text][PDF]
J. Bader, A. Ismail, and J. Clarkson Evidence-based Dentistry and the Dental Research Community
Journal of Dental Research,
September 1, 1999;
78(9):
1480 - 1483.
[PDF]
F. J. Molnar, M. Man-Son-Hing, W. B. Dalziel, S. L. Mitchell, B. E. Power, A. M. Byszewski, and P. St. John Assessing the quality of newspaper medical advice columns for elderly readers
Can. Med. Assoc. J.,
August 1, 1999;
161(4):
393 - 395.
[Abstract][Full Text][PDF]
S J Bernstein, B Brorsson, T Åberg, H Emanuelsson, R H Brook, and L Werkö Appropriateness of referral of coronary angiography patients in Sweden
Heart,
May 1, 1999;
81(5):
470 - 477.
[Abstract][Full Text]
L. L. Leape, L. H. Hilborne, R. Bell, C. Kamberg, and R. H. Brook Underuse of Cardiac Procedures: Do Women, Ethnic Minorities, and the Uninsured Fail To Receive Needed Revascularization?
Ann Intern Med,
February 2, 1999;
130(3):
183 - 192.
[Abstract][Full Text][PDF]
J. Z. Ayanian, M. B. Landrum, S.-L. T. Normand, E. Guadagnoli, and B. J. McNeil Rating the Appropriateness of Coronary Angiography -- Do Practicing Physicians Agree with an Expert Panel and with Each Other?
N. Engl. J. Med.,
June 25, 1998;
338(26):
1896 - 1904.
[Abstract][Full Text][PDF]
A. Gadomski, P. Jenkins, and M. Nichols Impact of a Medicaid Primary Care Provider and Preventive Care on Pediatric Hospitalization
Pediatrics,
March 1, 1998;
101
(3):
e1 - e1.
[Abstract][Full Text][PDF]
J. Lipscomb, G. Parmigiani, and V. Hasselblad Combining Expert Judgment by Hierarchical Modeling: An Application to Physician Staffing
Management Science,
February 1, 1998;
44(2):
149 - 161.
[Abstract][PDF]
Attributes of ATS documents that guide clinical practice. Recommendations of the ATS Clinical Practice Committee
Am. J. Respir. Crit. Care Med.,
December 1, 1997;
156(6):
2015 - 2025.
[Full Text]
Practice and Policy Guidelines Panel, National Ins Clinical Practice Guidelines in Complementary and Alternative Medicine: An Analysis of Opportunities and Obstacles
Arch Fam Med,
March 1, 1997;
6(2):
149 - 154.
[Abstract][PDF]
M. R. Chassin Improving the Quality of Care- Part Three of Six
N. Engl. J. Med.,
October 3, 1996;
335(14):
1060 - 1063.
[Full Text][PDF]
D. Verrilli and H. G. Welch The Impact of Diagnostic Testing on Therapeutic Interventions
JAMA,
April 17, 1996;
275(15):
1189 - 1191.
[Abstract][PDF]
B. O'Brien, R. Goeree, A. H. Mohamed, and R. Hunt Cost-effectiveness of Helicobacter pylori Eradication for the Long-term Management of Duodenal Ulcer in Canada
Arch Intern Med,
October 9, 1995;
155(18):
1958 - 1964.
[Abstract][PDF]
R. S. A. Hayward, M. C. Wilson, S. R. Tunis, E. B. Bass, G. Guyatt, and Evidence-Based Medicine Working Group Users' Guides to the Medical Literature: VIII. How to Use Clinical Practice Guidelines A. Are the Recommendations Valid?
JAMA,
August 16, 1995;
274(7):
570 - 574.
[Abstract][PDF]
A. B. Flood The Impact of Organizational and Managerial Factors on the Quality of Care in Health Care Organizations
Med Care Res Rev,
December 1, 1994;
51(4):
381 - 428.
N R Hicks Some observations on attempts to measure appropriateness of care
BMJ,
September 17, 1994;
309(6956):
730 - 733.
[Full Text]
L. C. Kleinman, J. Kosecoff, R. W. Dubois, and R. H. Brook The Medical Appropriateness of Tympanostomy Tubes Proposed for Children Younger Than 16 Years in the United States
JAMA,
April 27, 1994;
271(16):
1250 - 1255.
[Abstract][PDF]
E. A. Mort, J. S. Weissman, and A. M. Epstein Physician Discretion and Racial Variation in the Use of Surgical Procedures
Arch Intern Med,
April 11, 1994;
154(7):
761 - 767.
[Abstract][PDF]
E. Z. Oddone, G. Samsa, and D. B. Matchar Global Judgments versus Decision-model-facilitated Judgments: Are Experts Internally Consistent?
Med Decis Making,
February 1, 1994;
14(1):
19 - 26.
[Abstract][PDF]
C. E. Phelps The Methodologic Foundations of Studies of the Appropriateness of Medical Care
N. Engl. J. Med.,
October 21, 1993;
329(17):
1241 - 1245.
[Full Text]
J. P. Kassirer The Quality of Care and the Quality of Measuring It
N. Engl. J. Med.,
October 21, 1993;
329(17):
1263 - 1265.
[Full Text]
J. Whittle, J. Conigliaro, C.B. Good, and R. P. Lofgren Racial Differences in the Use of Invasive Cardiovascular Procedures in the Department of Veterans Affairs Medical System
N. Engl. J. Med.,
August 26, 1993;
329(9):
621 - 627.
[Abstract][Full Text]
S. J. Bernstein, E. A. McGlynn, A. L. Siu, C. P. Roth, M. J. Sherwood, J. W. Keesey, J. Kosecoff, N. R. Hicks, R. H. Brook, the Health Maintenance Organization Quality of Car, et al. The Appropriateness of Hysterectomy: A Comparison of Care in Seven Health Plans
JAMA,
May 12, 1993;
269(18):
2398 - 2402.
[Abstract][PDF]
C. D. Naylor, W. J. Sibbald, C. L. Sprung, S. P. Pinfold, J. E. Calvin, and F. B. Cerra Pulmonary Artery Catheterization: Can There Be an Integrated Strategy for Guideline Development and Research Promotion?
JAMA,
May 12, 1993;
269(18):
2407 - 2411.
[Abstract][PDF]
L. L. Leape, L. H. Hilborne, R. E. Park, S. J. Bernstein, C. J. Kamberg, M. Sherwood, and R. H. Brook The Appropriateness of Use of Coronary Artery Bypass Graft Surgery in New York State
JAMA,
February 10, 1993;
269(6):
753 - 760.
[Abstract][PDF]
S. J. Bernstein, L. H. Hilborne, L. L. Leape, M. E. Fiske, R. E. Park, C. J. Kamberg, and R. H. Brook The Appropriateness of Use of Coronary Angiography in New York State
JAMA,
February 10, 1993;
269(6):
766 - 769.
[Abstract][PDF]
L. L. Leape Practice Guidelines
Perspectives in Vascular Surgery and Endovascular Therapy,
January 1, 1993;
6(1):
117 - 127.
[PDF]
S. F. Jencks and G. R. Wilensky The Health Care Quality Improvement Initiative: A New Approach to Quality Assurance in Medicare
JAMA,
August 19, 1992;
268(7):
900 - 903.
[Abstract][PDF]
S. H. Woolf Practice Guidelines, a New Reality in Medicine: II. Methods of Developing Guidelines
Arch Intern Med,
May 1, 1992;
152(5):
946 - 952.
[Abstract][PDF]
D. C. Hadorn and R. H. Brook The Health Care Resource Allocation Debate: Defining Our Terms
JAMA,
December 18, 1991;
266(23):
3328 - 3331.
[Abstract][PDF]
M. H. Beers, J. G. Ouslander, I. Rollingher, D. B. Reuben, J. Brooks, and J. C. Beck Explicit Criteria for Determining Inappropriate Medication Use in Nursing Home Residents
Arch Intern Med,
September 1, 1991;
151(9):
1825 - 1832.
[Abstract][PDF]
T. A. Brennan Practice Guidelines and Malpractice Litigation: Collision or Cohesion?
Journal of Health Politics Policy and Law,
March 1, 1991;
16(1):
67 - 85.
[Abstract][PDF]
A.-M. Audet, S. Greenfield, and M. Field Medical Practice Guidelines: Current Activities and Future Directions
Ann Intern Med,
November 1, 1990;
113(9):
709 - 714.
[Abstract][PDF]
L. L. Leape, R. E. Park, D. H. Solomon, M. R. Chassin, J. Kosecoff, and R. H. Brook Variation and Inappropriateness Are Not the Same-Reply
JAMA,
June 20, 1990;
263(23):
3150 - 3150.
[Abstract][PDF]
L. L. Leape, R. E. Park, D. H. Solomon, M. R. Chassin, J. Kosecoff, and R. H. Brook Does Inappropriate Use Explain Small-Area Variations in the Use of Health Care Services?
JAMA,
February 2, 1990;
263(5):
669 - 672.
[Abstract][PDF]
J. T. Kelly Assessing Quality
JAMA,
November 11, 1988;
260(18):
2715 - 2716.
[Abstract][PDF]
K. L. Kahn, J. Kosecoff, M. R. Chassin, D. H. Solomon, and R. H. Brook The Use and Misuse of Upper Gastrointestinal Endoscopy
Ann Intern Med,
October 15, 1988;
109(8):
664 - 670.
[Abstract][PDF]
P. M. Wortman, A. Vinokur, and L. Sechrest Do Consensus Conferences Work? A Process Evaluation of the NIH Consensus Development Program
Journal of Health Politics Policy and Law,
September 1, 1988;
13(3):
469 - 498.
[Abstract][PDF]
A. G. Mulley Jr and K. A. Eagle What Is Inappropriate Care?
JAMA,
July 22, 1988;
260(4):
540 - 541.
[Abstract][PDF]
J. Kosecoff, D. E. Kanouse, W. H. Rogers, L. McCloskey, C. M. Winslow, and R. H. Brook Effects of the National Institutes of Health Consensus Development Program on Physician Practice
JAMA,
November 20, 1987;
258(19):
2708 - 2713.
[Abstract][PDF]
M. R. Chassin, J. Kosecoff, R.E. Park, C. M. Winslow, K. L. Kahn, N. J. Merrick, J. Keesey, A. Fink, D. H. Solomon, and R. H. Brook Does Inappropriate Use Explain Geographic Variations in the Use of Health Care Services? A Study of Three Procedures
JAMA,
November 13, 1987;
258(18):
2533 - 2537.
[Abstract][PDF]
J. Kosecoff, M. R. Chassin, A. Fink, M.-F. Flynn, L. McCloskey, B. J. Genovese, C. Oken, D. H. Solomon, and R. H. Brook Obtaining Clinical Data on the Appropriateness of Medical Care in Community Practice
JAMA,
November 13, 1987;
258(18):
2538 - 2542.
[Abstract][PDF]
M. R. Chassin, J. Kosecoff, D. H. Solomon, and R. H. Brook How Coronary Angiography Is Used: Clinical Determinants of Appropriateness
JAMA,
November 13, 1987;
258(18):
2543 - 2547.
[Abstract][PDF]
A. Fink, A. L. Siu, R. H. Brook, R. E. Park, and D. H. Solomon Assuring the Quality of Health Care for Older Persons: An Expert Panel's Priorities
JAMA,
October 9, 1987;
258(14):
1905 - 1908.
[Abstract][PDF]
N. J. Merrick, R. H. Brook, A. Fink, and D. H. Solomon Use of Carotid Endarterectomy in Five California Veterans Administration Medical Centers
JAMA,
November 14, 1986;
256(18):
2531 - 2535.
[Abstract][PDF]