Great advances in medicine were achieved following application of statistical analysis to research findings in the early 20th century. Armed with a formal mechanism to analyze data, investigators could reject empirical claims that treatments such as blistering and bloodletting were beneficial. Structured clinical trials with results analyzed in objective ways paved the way for improved health care by proving that vaccinations and surgical antisepsis were effective.
Statistical analysis of data has proven highly successful for ensuring that medical research findings are objectively analyzed, minimizing the risk of promoting practices solely on empirical evidence. Courses in statistics are a required part of every medical school curriculum. Unfortunately, most physicians only acquire a superficial understanding of statistics. A limited understanding of these analytic techniques can be harmful. Most clinicians equate a P value of less than .05 with the significance of a finding, assuming that any finding with this level of a P value (or less) means that the finding is important and should be accepted. Blindly accepting this logic has caused a great deal of harm.1 Adverse risks of medications have been overstated and some therapies overvalued because of inappropriate acceptance of statistical analyses. Missing in the interpretation of most studies is an easily understood measure of the overall clinical significance of an observation to complement reported statistical significance measurements.
Effect of diet composition on weight loss over time. Examination of this graph reveals that the Atkins diet results in greater weight loss than the other diet plans. The effect size index of 0.19 for this observation is a moderately large size effect. Reporting P values for statistical significance provides no information about the size of a difference, only that a difference exists. Graphs such as this one, combined with reporting effect size indices, provide readers with compelling information about the importance of differences between groups, with larger differences being more important than small ones. LEARN indicates Lifestyle, Exercise, Attitudes, Relationships, and Nutrition. Reprinted with permission from JAMA.19
Thank you for submitting a comment on this article. It will be reviewed by JAMA Surgery editors. You will be notified when your comment has been published. Comments should not exceed 500 words of text and 10 references.
Do not submit personal medical questions or information that could identify a specific patient, questions about a particular case, or general inquiries to an author. Only content that has not been published, posted, or submitted elsewhere should be submitted. By submitting this Comment, you and any coauthors transfer copyright to the journal if your Comment is posted.
* = Required Field
Disclosure of Any Conflicts of Interest*
Indicate all relevant conflicts of interest of each author below, including all relevant financial interests, activities, and relationships within the past 3 years including, but not limited to, employment, affiliation, grants or funding, consultancies, honoraria or payment, speakers’ bureaus, stock ownership or options, expert testimony, royalties, donation of medical equipment, or patents planned, pending, or issued. If all authors have none, check "No potential conflicts or relevant financial interests" in the box below. Please also indicate any funding received in support of this work. The information will be posted with your response.
Some tools below are only available to our subscribers or users with an online account.
Download citation file:
Web of Science® Times Cited: 24
Customize your page view by dragging & repositioning the boxes below.
More Listings atJAMACareerCenter.com >
The Rational Clinical Examination
The Rational Clinical Examination
The best background information for diagnosing airflow limitation is exposure to cigarette smoke....
All results at
Enter your username and email address. We'll send you a link to reset your password.
Enter your username and email address. We'll send instructions on how to reset your password to the email address we have on record.
Athens and Shibboleth are access management services that provide single sign-on to protected resources. They replace the multiple user names and passwords necessary to access subscription-based content with a single user name and password that can be entered once per session. It operates independently of a user's location or IP address. If your institution uses Athens or Shibboleth authentication, please contact your site administrator to receive your user name and password.