RSM logo
JRSM

Home Current issue Browse archive Alerts About the journal Feedback
 
J R Soc Med 2003;96:156-157
doi:10.1258/jrsm.96.3.156-b
© 2003 Royal Society of Medicine

This Article
Right arrow Full Text (PDF)
Right arrow Send a Quick Comment
Right arrow Alert me when this article is cited
Right arrow Alert me when Quick Comments are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ernst, E.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?
J R Soc Med 2003;96:156-157
© 2003 The Royal Society of Medicine

How objective are systematic reviews?

Edzard Ernst

Complementary Medicine, Peninsula Medical School, Universities of Exeter & Plymouth, 25 Victoria Park Road, Exeter, Devon EX2 4BN, UK

Dr Linde and Dr Willich (January 2003 JRSM1) have done a great service to the medical community by showing us how systematic reviews (SRs) can differ confusingly regarding a range of methodological aspects. As they point out, SRs are designed to avoid biases and make conclusions as objective as possible. Given the diversity of the SRs analysed, I was impressed with the level of agreement many of them reached in their conclusions. Table 1 summarizes five subject areas where our own SRs were cited. The concordance of the conclusions is stunning.


View this table:
[in this window]
[in a new window]
 
Table 1. Conclusions of systematic review

 

There are exceptions, of course. The prime example is acupuncture for back pain, where we have published a ‘positive’2 and others a largely ‘negative’ SR3. The difference is, however, readily explicable: we pooled the data from all trials where this was possible2 while van Tulder et al.2 basically relied on a vote count. If studies tend to be small and produce non-significant positive trends, pooling will generate a positive overall result, while vote-counts will yield a negative one.

And then there is homeopathy, which is perhaps the most controversial subject of all. Linde et al. have published their landmark SR concluding that ‘clinical effects of homeopathy are not completely due to placebo’4. Two years later they cast considerable doubt on this by reanalysing the data and concluding that ‘there was clear evidence that studies with better methodological quality tended to yield less positive results’5. I have recently reviewed all eleven SRs of homeopathy published since Lind's meta-analysis4. This collective evidence led me to conclude that ‘the best clinical evidence for homeopathy available to date does not warrant positive recommendations for its use in clinical practice’6.

REFERENCES

  1. Linde K, Willich SN. How objective are systematic reviews? Differences between reviews in complementary medicine. J R Soc Med 2003;96:17 -22[Abstract/Free Full Text]

  2. Ernst E, White AR. Acupuncture for back pain. A meta-analysis of randomized controlled trials. Arch Intern Med1998; 158:2235 -41[Abstract/Free Full Text]

  3. van Tulder MW, Cherkin DC, Berman B, Lau L, Koes BW. Acupuncture for low back pain. Cochrane Library2000

  4. Linde K, Clausius N, Ramirez G, et al. Are the clinical effects of homoeopathy placebo effects? A meta-analysis of placebo-controlled trials. Lancet1997; 350:834 -43[CrossRef][Medline]

  5. Linde K, Scholz M, Ramirez G, Clausius N, Melchart D, Jonas WB. Impact of study quality on outcome in placebo controlled trials of homoeopathy. J Clin Epidemiol1999; 52:631 -6[CrossRef][Medline]

  6. Ernst E. A systematic review of systematic reviews of homeopathy. Br J Clin Pharmacol2002; 54:577 -82[CrossRef][Medline]


Add to CiteULike CiteULike   Add to Complore Complore   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us   Add to Digg Digg   Add to Reddit Reddit   Add to Technorati Technorati    What's this?



This Article
Right arrow Full Text (PDF)
Right arrow Send a Quick Comment
Right arrow Alert me when this article is cited
Right arrow Alert me when Quick Comments are posted
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Ernst, E.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Social Bookmarking
 Add to CiteULike   Add to Complore   Add to Connotea   Add to Del.icio.us   Add to Digg   Add to Reddit   Add to Technorati  
What's this?

MDU Exam Doctor