Evidence-based toxicology

Part of a series on
Evidence-based practices

The discipline of evidence-based toxicology (EBT) strives to transparently, consistently, and objectively assess available scientific evidence in order to answer questions in toxicology,[1] the study of the adverse effects of chemical, physical, or biological agents on living organisms and the environment, including the prevention and amelioration of such effects.[2] EBT has the potential to address concerns in the toxicological community about the limitations of current approaches to assessing the state of the science.[3][4] These include concerns related to transparency in decision making, synthesis of different types of evidence, and the assessment of bias and credibility.[5][6][7] Evidence-based toxicology has its roots in the larger movement towards evidence-based practices.

By analogy to evidence-based medicine (EBM),[8] the umbrella term evidence-based toxicology (EBT) has been coined to group all approaches intended to better implement the above-mentioned evidence-based principles in toxicology in general and in toxicological decision-making in particular. Besides systematic reviews, the core evidence-based tool, such approaches include inter alia the establishment and universal use of a common ontology, justified design and rigorous conduct of studies, consistently structured and detailed reporting of experimental evidence, probabilistic uncertainty and risk assessment, and the development of synthesis methodology to integrate evidence from diverse evidence streams, e.g. from human observational studies, animal studies, in vitro studies and in silico modeling. A main initial impetus for translating evidence-based approaches to toxicology was the need to improve the performance assessment of toxicological test methods.[9] The U.S. National Research Council (NRC) concurs that new means of assessment are needed to keep pace with recent advances in the development of toxicological test methods, capitalizing on enhanced scientific understanding through modern biochemistry and molecular biology.[10]

A key tool in evidence-based medicine that holds promise for EBT is the systematic review. Historically, authors of reviews assessing the results of toxicological studies on a particular topic have searched, selected, and weighed the scientific evidence in a non-systematic and non-transparent way. Due to their narrative nature, these reviews tend to be subjective, potentially biased, and not readily reproducible.[1] Two examples highlighting these deficiencies are the risk assessments of trichloroethylene and bisphenol A (BPA). Twenty-seven different risk assessments of the evidence that trichloroethylene causes cancer have come to substantially different conclusions.[11] Assessments of BPA range from low risk of harm to the public to potential risks (for some populations), leading to different political decisions.[12] Systematic reviews can help reducing such divergent views.[3] In contrast with narrative reviews, they reflect a highly structured approach to reviewing and synthesizing the scientific literature while limiting bias.[3] The steps to carrying out a systematic review include framing the question to be addressed; identifying and retrieving relevant studies; determining if any retrieved studies should be excluded from the analysis; and appraising the included studies in terms of their methodological quality and risk of bias. Ultimately the data should be synthesized across studies, if possible by a meta-analysis. A protocol of how the review will be conducted is prepared ahead of time and ideally should be registered and/or published.

Scientists have made progress in their efforts to apply the systematic review framework to evaluating the evidence for associations between environmental toxicants and human health risks. To date, researchers have shown that important elements of the framework established in evidence-based medicine can be adapted to toxicology with little change, and some studies have been attempted.[13][14][15] Researchers using the systematic review methodology to address toxicological concerns include a group of scientists from government, industry, and academia in North America and the European Union (EU) who have joined together to promote evidence-based approaches to toxicology through the nonprofit Evidence-based Toxicology Collaboration (EBTC). The EBTC brings together the international toxicology community to develop EBT methodology and facilitate the use of EBT to inform regulatory, environmental and public health.[3][16][17]

Background

Evidence-based approaches were first conceived as a means of anchoring policy decisions, not to current practices or the beliefs of experts, but to experimental evidence.[18] Evidence-based medicine (EBM) was launched slightly later. Its rise as a distinct discipline is generally credited to the work and advocacy of Scottish epidemiologist Archie Cochrane.[19] The Cochrane Collaboration named in his honor was launched at Oxford University in 1993 to promote evidence-based reviews of clinical medical literature. More recently, EBM expanded to encompass evidence-based health care (EBHC).

EBM/HC involves the conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients taking patients' preferences into account.[20] Prior to EBM, medical decisions about diagnosis, prevention, treatment or harm were often made without a rigorous evaluation of the alternatives. Research in the 1970s and 1980s showed that different physicians regularly recommended different treatments and tests for patients with ailments that were essentially the same, and that large proportions of procedures being performed by physicians were considered inappropriate by the standards of medical experts.[21][22] EBM/HC supporters stress that while evidence always has been important to the practice of medicine, EBM/HC provides an enhanced approach of identifying, assessing, and summarizing evidence. EBT's supporters make a similar argument.[3]

The idea of translating evidence-based approaches from medicine to toxicology has been percolating for two decades, with proponents in both medicine and toxicology.[23][24] Three research papers published in 2005 and 2006 catalyzed what eventually became known as EBT by suggesting that EBM's established tools and concepts might serve as a prototype of evidence-based decision-making in toxicology.[1][9][25]

Process and progress

The First International Forum Toward Evidence-Based Toxicology was held in 2007.[26] The forum was organized by the European Commission and attended by 170 scientists from more than 25 European, American, and Asian countries. The goal was to explore the available concepts of EBT, and to launch an initiative to formally implement evidence-based assessment methods in toxicology.

The starting point for the discussions were two research papers suggesting that the tools and concepts established in evidence-based medicine could serve as a prototype of evidence-based decision-making for evaluating toxicological data.[1][9] Apparent fundamental differences between medicine and toxicology were carefully considered during these discussions. Forum participants attempted to bridge the two disciplines in order to make use of the accrued wisdom and apply this approach to toxicology. (See [1] Archived 2017-07-29 at the Wayback Machine .)

The proceedings of this forum were published as a special issue in Human & Experimental Toxicology.[27]

EBT's proponents include experts in EBM, public health, and toxicology who believe that EBT can help toxicologists to better serve the goals of health protection and safety assurance.[15][16] They argue that EBT's methodologies for collecting, appraising, and pooling evidence can help ensure that all available information on a given topic is evaluated in a transparent, unbiased, and reproducible manner. They contend that EBT's concept of the systematic review could prove particularly helpful for the standardization and quality assurance of novel methodologies for evaluating toxicity, as well as for their formal validation. In this regard, EBT may prove particularly useful for assessing the performance of newer non-animal "21st century" toxicology tools. EBT can also help scientists integrate new toxicological test methods into test strategies being implemented across the globe.

In 2010, a group of EBT supporters joined together to convene a workshop titled "21st Century Validation for 21st Century Tools".[28] The session on the potential for evidence-based approaches to assess the performance of the new generation of non-animal test methods inspired the formation of the EBTC. The EBTC was officially launched in the U.S. in 2011 at a Society of Toxicology conference[29] and convened its first workshop in 2012.[3] The EBTC's EU branch was officially opened during the 2012 Eurotox conference.[30]

In 2014, the EBTC hosted a workshop on "The Emergence of Systematic Review and Related Evidence-based Approaches in Toxicology" with speakers representing US and European organizations that are implementing and promoting the use of systematic reviews for toxicological questions. The experts noted that the structured approach of systematic reviews increases objectivity and transparency but also made clear that the approach requires a substantial time investment, which is a challenge to its more widespread adoption. Consequently, the participants called for close collaboration of interested organizations, which they determined to be a pre-requisite for the broad and efficient introduction of systematic reviews in toxicology.[29]

Applications of EBT

Regulatory decision-making

Some scientists and policymakers would like EBT to help them combine information from various sources. Toxicological evidence can be assigned to evidence streams, sets of studies representing the same type or level of evidence, such as human (observational) studies, animal studies, in vitro or mechanistic studies. EBT can be applied both within one evidence stream, and it is especially well-suited to be applied across multiple evidence streams. Regulators often designate one study as "the lead study", then use later studies as additional information. Many perceive this as unsatisfying, but objective approaches to combine study results are lacking. The EBM concept of the systematic review has promise for this application, and some structured reviews serve as forerunners for this approach.[31] [32][33]

Evaluating effects of environmental exposures

The U.S. National Toxicology Program's Office of Health Assessment and Translation (OHAT) has started to use systematic review methodology for the program's evaluations.[34] The first systematic review was completed in 2016, reviewing the effects of fluoride on learning and memory in animal studies.[33] OHAT’s approach is tailored to its mandate, but its seems especially appropriate for substances with substantial yet conflicting literature, and hence the need for systematic reviews to sort out somewhat confusing situations.

Causation

One application of EBT focuses on causation.[25] It addresses the challenge of tracing a health effect back to a toxicant, such as lung cancer to smoking. This approach is similar to legal arguments[35] Some experts warn that this approach could increase the evidence burden for proving causation, and thereby increase the difficulty involved in banning toxic substances.[36]

Clinical toxicology

Practitioners of clinical toxicology, which is concerned with the treatment of patients known to be exposed to toxic substances, are also beginning to use an EBM-style approach.[37][38] Guidance documents based on this approach have already been published

21st century toxicology

The National Research Council's (NRC) landmark 2007 publication, "Toxicity Testing in the 21st Century", has also been an impetus for EBT. EBT provides new tools for assessing test method performance. Also, as the focus of 21st-century toxicology shifts from animal biology to human biology, EBT provides a method for comparatively evaluating the results gleaned from new methods of investigating the effects of chemical exposure.[39]

The Evidence-based Toxicology Collaboration has pioneered a number of projects aimed at applying EBT approaches and systematic reviews to test methods comparison.[40][41]

Limitations and challenges

The specific differences between toxicology and medicine/health care cause challenges for implementing EBT.[15] Evidence-based methodology of clinical research has been focused on a single type of study—randomized, controlled clinical trials, which are a direct measure of the effectiveness of the health care intervention under scrutiny. In contrast, toxicology employs a variety of different kinds of studies in three distinct evidence streams: human (observational) studies, animal studies, and non-animal studies. Because human evidence is frequently lacking most evidence is obtained by using animal and non-animal models, which—by definition—is more difficult to generalize and extrapolate to humans. This methodological heterogeneity complicates evidence integration within an evidence stream, such as when inconsistent evidence is obtained from different animal species, but even more so across evidence streams. Adding to the difficulty is the reality that much toxicological evidence, more so than in medicine and health care, is not readily accessible in the literature.[3][15] Moreover, the role of expert judgment, especially in systematic reviews, needs to be clearly defined, as it is a common misperception that evidence-based approaches leave no room for it. Systematic reviews should strive to make expert judgments clear along with the scientific basis for those judgments in developing conclusions for a systematic review. Further issues to be worked out include exposures to multiple substances, the multitude of outcomes observed in some animal studies, and challenges in improving the experimental designs and reporting of studies.

See also

References

  1. ^ a b c d Hoffmann, S.; Hartung, T (2006). "Toward an evidence-based toxicology". Hum Exp Toxicol. 25 (9): 497–513. doi:10.1191/0960327106het648oa. PMID 17017003. S2CID 42202416.
  2. ^ "How do you define toxicology?". Society of Toxicology. Archived from the original on 2013-06-05. Retrieved 2017-06-17.
  3. ^ a b c d e f g Stephens, M.; Andersen, M.; Becker, R.A.; Betts, K.; et al. (2013). "Evidence-based toxicology for the 21st century: Opportunities and challenges". ALTEX. 30 (1): 74–104. doi:10.14573/altex.2013.1.074. PMID 23338808.
  4. ^ Mandrioli, D.; Silbergeld, E. (2016). "Evidence from toxicology: the most essential science for the prevention". Environ Health Perspect. 124 (1): 6–11. doi:10.1289/ehp.1509880. PMC 4710610. PMID 26091173.
  5. ^ Schreider, J.; Barrow, C.; Birchfield, N.; et al. (2010). "Enhancing the credibility of decisions based on scientific conclusions: transparency is imperative". Toxicol Sci. 116 (1): 5–7. doi:10.1093/toxsci/kfq102. PMID 20363830.
  6. ^ Adami, H.O.; Berry, S.C.; Breckenridge, C.B.; Smith, L.L.; et al. (2011). "Toxicology and epidemiology: improving the science with a framework for combining toxicological and epidemiological evidence to establish causal inference". Toxicol Sci. 122 (2): 223–234. doi:10.1093/toxsci/kfr113. PMC 3155086. PMID 21561883.
  7. ^ Conrad, J.W.; Becker, R.A. (2011). "Enhancing credibility of chemical safety studies: an emerging consensus on key assessment criteria". Environ Health Perspect. 119 (6): 757–764. doi:10.1289/ehp.1002737. PMC 3114808. PMID 21163723.
  8. ^ Eddy, D.M. (2005). "Evidence-Based Medicine: A Unified Approach". Health Aff. 24 (1): 9–17. doi:10.1377/hlthaff.24.1.9. PMID 15647211.
  9. ^ a b c Hoffmann, S.; Hartung, T (2005). "Diagnosis: toxic! Trying to apply approaches of clinical diagnostics and prevalence in toxicology considerations". Toxicol Sci. 85 (1): 422–428. CiteSeerX 10.1.1.546.8341. doi:10.1093/toxsci/kfi099. PMID 15689419.
  10. ^ National Research Council (2007). Toxicity Testing in the 21st Century: A Vision and a Strategy. Washington, DC: The National Academies Press.
  11. ^ Rudén, C. (2001). "The use and evaluation of primary data in 29 trichloroethylene carcinogen risk assessments". Regul Toxicol Pharmacol. 34 (1): 3–16. doi:10.1006/rtph.2001.1482. PMID 11502152.
  12. ^ Whaley, P.; Halsall, C.; Ågerstrand, R.A.; Aiassa, E.; et al. (2016). "Implementing systematic review techniques in chemical risk assessment: Challenges, opportunities and recommendations". Environ Int. 92–93: 556–564. doi:10.1016/j.envint.2015.11.002. PMC 4881816. PMID 26687863.
  13. ^ Navas-Acien, A.; Sharrett, A.R.; Silbergeld, E.K.; et al. (2005). "Arsenic exposure and cardiovascular disease: a systematic review of the epidemiologic evidence". Am J Epidemiol. 162 (11): 1037–1049. doi:10.1093/aje/kwi330. PMID 16269585.
  14. ^ Krauth, D.; Woodruff, T.J.; Bero, L.; et al. (2013). "Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review". Environ Health Perspect. 121 (9): 985–992. doi:10.1289/ehp.1206389. PMC 3764080. PMID 23771496.
  15. ^ a b c d Silbergeld, E.; Scherer, R.W. (2013). "Evidence-based toxicology: Strait is the gate, but the road is worth taking". ALTEX. 30 (1): 67–73. doi:10.14573/altex.2013.1.067. PMID 23338807.
  16. ^ a b Stephens, M.; Betts, K.; Beck, N.B.; Cogliano, V.; et al. (2016). "The emergence of systematic review in toxicology". Toxicol Sci. 152 (1): 10–16. doi:10.1093/toxsci/kfw059. PMC 4922539. PMID 27208075.
  17. ^ Samuel, G.O.; Hoffmann, S.; Wright, R.A.; Lalu, M.M.; et al. (2016). "Guidance on assessing the methodological and reporting quality of toxicologically relevant studies". Environ Int. 92–93: 630–46. doi:10.1016/j.envint.2016.03.010. PMID 27039952.
  18. ^ Eddy, D.M. (1990). "Practice Policies: Guidelines for Methods". JAMA. 263 (13): 1839–1841. doi:10.1001/jama.1990.03440130133041.
  19. ^ Mayer, D. (2004). Essential Evidence-Based Medicine. New York: Cambridge University Press.
  20. ^ Sackett, D.L.; Rosenberg, W.M.; Gray, J.A.; Haynes, R.B.; et al. (1996). "Evidence based medicine: what it is and what it isn't". BMJ. 312 (7023): 71–72. doi:10.1136/bmj.312.7023.71. PMC 2349778. PMID 8555924.
  21. ^ Wennberg, J.E.; Gittelsohn, A. (1973). "Small Area Variations in Health Care Delivery". Science. 182 (4117): 1102–1108. Bibcode:1973Sci...182.1102W. doi:10.1126/science.182.4117.1102. PMID 4750608. S2CID 43819003.
  22. ^ Chassin, M.R.; Kosecoff J.; Solomon D.H.; Brook R.H. (1987). "How Coronary Angiography Is Used: Clinical Determinants of Appropriateness". JAMA. 258 (18): 2543–2547. doi:10.1001/jama.258.18.2543. PMID 3312657.
  23. ^ Buckley, N.A.; Smith, A.J. (1996). "Evidence-based medicine in toxicology: where is the evidence?". Lancet. 347 (9009): 1167–1169. doi:10.1016/s0140-6736(96)90615-7. PMID 8609755. S2CID 28749027.
  24. ^ Dodes, J.E. (2001). "The amalgam controversy – an evidence-based analysis". J Am Dent Assoc. 132 (3): 348–356. doi:10.14219/jada.archive.2001.0178. PMID 11258092.
  25. ^ a b Guzelian, P.S.; Victoroff, M.S.; Halmes, N.C.; et al. (2005). "Evidence-based toxicology: a comprehensive framework for causation". Hum Exp Toxicol. 24 (4): 161–201. doi:10.1191/0960327105ht517oa. PMID 15957536. S2CID 5359374.
  26. ^ Hoffman, S.; Griesinger, C.; Coecke, S.; Kinser, A.; et al. (2007). "1st International Forum Towards Evidence-Based Toxicology". ALTEX. 24: 354–355.
  27. ^ Guzelian, P.S.; Victoroff, M.S.; Halmes, C.; James, R.C. (2009). "Proceedings of the 1st International Forum Towards Evidence-Based Toxicology". Hum Exp Toxicol. 28 (2–3): 71–163. doi:10.1177/0960327109102802. PMID 19713364.
  28. ^ Rudacille, D. (2010). "Summary of the July 2010 Workshop, "21st Century Validation Strategies for 21st Century Tools"". ALTEX. 27 (2): 279–284. doi:10.14573/altex.2010.4.279.
  29. ^ a b "Conference Report: Evidence-based Toxicology Collaboration Kick-off Meeting". Altex. 28 (2): 52. 2011.
  30. ^ Hoffmann, S. "Kick-off of the Evidence-Based Toxicology Collaboration Europe". ALTEX. 29: 456.
  31. ^ Navas-Ancien, A.; Guallar, E.; Silbergeld, E.K.; Rothenberg, S.J. (2007). "Lead exposure and cardiovascular disease – a systematic review". Environ Health Perspect. 115 (3): 472–482. doi:10.1289/ehp.9785. PMC 1849948. PMID 17431501.
  32. ^ "Scientific Opinion on the risk assessment peri- and post-menopausal women taking food supplements containing isoflavones". EFSA Journal. 13 (10): 4246–4588. 2015. doi:10.2903/j.efsa.2015.4246.
  33. ^ a b "Systematic literature review on the effects of fluoride on learning and memory in animal studies" (PDF). National Toxicology Program. Retrieved July 29, 2017.
  34. ^ "Handbook for Conducting a Literature-Based Health Assessment Using Office of Health Assessment and Translation (OHAT) Approach for Systematic Review and Evidence Integration" (PDF). National Toxicology Program. 2015. Retrieved 2017-07-30.
  35. ^ Rodricks, J.V. (2006). "Evaluating disease causation in humans exposed to toxic substances". J Law Policy. 41: 62.
  36. ^ Rudén, C.; Hansson, S. O. (2008). "Evidence-based toxicology: "sound science" in new disguise". Int J Occup Environ Health. 14 (4): 299–306. doi:10.1179/oeh.2008.14.4.299. PMID 19043917. S2CID 24010570.
  37. ^ Dargan, P.I.; Wallace, C.I.; Jones, A.L. (2002). "An evidence based flowchart to guide the management of acute salicylate (aspirin) overdose". Emerg Med J. 19 (3): 206–209. doi:10.1136/emj.19.3.206. PMC 1725844. PMID 11971828.
  38. ^ Wallace, C..I.; Dargan, P.I.; Jones, A.L. (2002). "Paracetamol overdose: an evidence based flowchart to guide management". Emerg Med J. 19 (3): 202–205. doi:10.1136/emj.19.3.202. PMC 1725876. PMID 11971827.
  39. ^ Hartung, T. (2009). "Food for thought ... on evidence-based toxicology". ALTEX. 26 (2): 75–82. doi:10.14573/altex.2009.2.75. PMID 19565165.
  40. ^ Stephens, Martin L.; Akgün-Ölmez, Sevcan Gül; Hoffmann, Sebastian; de Vries, Rob; Flick, Burkhard; Hartung, Thomas; Lalu, Manoj; Maertens, Alexandra; Witters, Hilda; Wright, Robert; Tsaioun, Katya (2018-06-13). "Adaptation of the Systematic Review Framework to the Assessment of Toxicological Test Methods: Challenges and Lessons Learned with the Zebrafish Embryotoxicity Test". Toxicological Sciences. 171: 56–68. doi:10.1093/toxsci/kfz128. ISSN 1096-0929. PMC 6736188. PMID 31192353.
  41. ^ Dirven, Hubert; Vist, Gunn E.; Bandhakavi, Sricharan; Mehta, Jyotsna; Fitch, Seneca E.; Pound, Pandora; Ram, Rebecca; Kincaid, Breanne; Leenaars, Cathalijn H.C.; Chen, Minjun; Wright, Robert A. (2021-03-18). "Performance of preclinical models in predicting drug-induced liver injury in humans: a systematic review". Scientific Reports. 11 (1): 6403. doi:10.1038/s41598-021-85708-2. ISSN 2045-2322. PMC 7973584. PMID 33737635.