Evidence based medicine has become the accepted modus operandi within medicine. And why not? The proposition that all medical decisions should be based on evidence is a no-brainer. The danger is in the definition of "evidence" that is at the heart of evidence based medicine (EBM).
EBM values evidence based upon good randomised control trials (RCTs), and especially systematic reviews of good randomised control trials. There's nothing wrong with this, but there are some caveats. The best known is the bias introduced by the non-reporting of negative results. The international community has made strenuous efforts to reduce this bias, but there are other remaining issues.
1. Systematic reviews produce an averaging effect, which may disguise the impact in sections of the populations, eg ethnic minorities.
2. I will call the second caveat "The feet are the wrong size for their shoes" in deference to the late great Douglas Adams. To establish a robust trial you need to exclude confounding factors and this means excluding those people who might introduce them. This generally means old people (who may have a range of other conditions) children ( whose systems may behave in different ways) and women who might be pregnant (for ethical and clinical reasons). These are the people whose feet are the wrong size for their shoes! Trials therefore often feature a strong representation of men aged 18-50. This group are not nearly so well represented in a typical patient population.
3. The third caveat may be characterised as "Making the feet fit even though they are the wrong size for their shoes". Because of the high regard in which RCTs are held, they are sometimes applied to problems to which they are wholly unsuited. This may be because of problems in defining a clear hypothesis for testing, or problems in defining the control and active groups for a trial. An example may be found at Lattimer V, George S, Thompson F, Thomas E, Mullee M, Turnbull J, et al. Safety and effectiveness of nurse telephone consultation in out of hours primary care: randomised controlled trial. BMJ 1998; 317: 1054-1059. available on-line at http://bmj.com. There are a range of problems for which RCTs are simply not amenable.
4. The final caveat relates to the undermining of other forms of knowledge and evidence. Tacit or implicit knowledge is highly valued in many spheres. It appears to have been undermined in the UK in medicine following a series of scandals in the 1990s which led to a public perception of paternalism and complacency.
So, yes, decision should be evidence-based, but the scope of that evidence may be wider than that deployed within orthodox EBM.
Filed under: Evidence based medicine, randomised control trials


