A reference set of clinically relevant adverse drug-drug interactions

Kontsioti, Elpida; Maskell, Simon; Dutta, Bhaskar; Pirmohamed, Munir

doi:10.1038/s41597-022-01159-y

A reference set of clinically relevant adverse drug-drug interactions

Data Descriptor
Open access
Published: 04 March 2022

Volume 9, article number 72, (2022)
Cite this article

Download PDF

You have full access to this open access article

Scientific Data

A reference set of clinically relevant adverse drug-drug interactions

Download PDF

5512 Accesses
13 Citations
6 Altmetric
Explore all metrics

This article has been updated

Abstract

The accurate and timely detection of adverse drug-drug interactions (DDIs) during the postmarketing phase is an important yet complex task with potentially major clinical implications. The development of data mining methodologies that scan healthcare databases for drug safety signals requires appropriate reference sets for performance evaluation. Methodologies for establishing DDI reference sets are limited in the literature, while there is no publicly available resource simultaneously focusing on clinical relevance of DDIs and individual behaviour of interacting drugs. By automatically extracting and aggregating information from multiple clinical resources, we provide a scalable approach for generating a reference set for DDIs that could support research in postmarketing safety surveillance. CRESCENDDI contains 10,286 positive and 4,544 negative controls, covering 454 drugs and 179 adverse events mapped to RxNorm and MedDRA concepts, respectively. It also includes single drug information for the included drugs (i.e., adverse drug reactions, indications, and negative drug-event associations). We demonstrate usability of the resource by scanning a spontaneous reporting system database for signals of DDIs using traditional signal detection algorithms.

Measurement(s)	Adverse Event
Technology Type(s)	digital curation
Sample Characteristic - Organism	Homo sapiens

Machine-accessible metadata file describing the reported data: https://doi.org/10.6084/m9.figshare.16681933

Pediatric Drug Safety Signal Detection: A New Drug–Event Reference Set for Performance Testing of Data-Mining Methods and Systems

Article Open access 08 February 2015

A time-indexed reference standard of adverse drug reactions

Article Open access 11 November 2014

A Method to Combine Signals from Spontaneous Reporting Systems and Observational Healthcare Data to Detect Adverse Drug Reactions

Article Open access 08 July 2015

Background & Summary

Polypharmacy (i.e., the concomitant use of multiple medications in an individual) has become a common phenomenon in the Western world. In the United States, between 2015 and 2018, it has been estimated that two out of three people over 65 take at least three prescription medications during the course of a month (up from one third in the early 1990s), with four out of ten taking five or more medications¹. As life expectancy is increasing around the world, leading to more people living with multiple chronic diseases, together with new medicines being launched onto the market each year, giving rise to a growing volume of possible drug combinations, the implications of drug-drug interactions (DDIs) in clinical practice have become a matter of concern. A DDI can lead to the potentiation or antagonism of one drug by another, or cause another effect that is not related to the individual drug profiles. From a mechanistic perspective, DDIs are classified into two main categories: pharmacodynamic and pharmacokinetic². Predicted DDIs based on pharmacological knowledge (i.e., possible drug effect alterations caused when multiple drugs are simultaneously administered) far outnumber those with clinically significant consequences, i.e., those ranging from lack of efficacy to serious and life-threatening adverse reactions³. The necessarily limited time and extent of pre-clinical studies and pre-marketing clinical trials may burden the identification of adverse drug reactions (ADRs) caused by single drugs or drug combinations (i.e., adverse DDIs).

Postmarketing safety surveillance (pharmacovigilance) is a vital stage in the lifecycle management of a medicine: The number of people exposed to medicines after marketing is substantially larger than the number of volunteers involved in pre-market clinical trials. Spontaneous reporting system (SRS) databases, such as the US Food and Drug Administration (FDA) Adverse Event Reporting System (FAERS), are a particularly useful source of information, with more recent efforts focusing on the integration of multiple data sources^{4,Full size image}

Methods

The processing pipeline for the construction of CRESCENDDI included the following steps: (1) web data extraction of information related to DDIs and single-drug ADRs from 4 different online resources for DDIs, single-drug ADRs, and drug indications; (2) map** (normalization) of drug names appearing in the extracted data; (3) extraction of the intersection of the DDI online resources; (4) manual annotation and map** of English language text descriptions for DDIs, single-drug ADRs, and drug indications to MedDRA concepts; (5) generation of positive controls for DDIs using the normalized intersection of the DDI online resources; (6) generation of negative controls using drugs and AEs from the positive control set combined with PubMed search; and (7) aggregation of information on single-drug ADRs and drug indications for the drugs appearing in the DDI reference set (i.e., positive and negative control sets) and generation of negative controls for single drugs with a process similar to the one followed in the previous step for DDI negative controls.

Web data extraction

DDI data were derived from the following online resources: the British National Formulary (BNF) website²⁵, the French National Drug Safety Institute (ANSM) Portable Document Format (PDF) file (Thesaurus)²⁶ and the Micromedex platform²⁷. For BNF and Micromedex, web data extraction tools in Python 3.6²⁸ enabled the extraction of the relevant fields into a Comma Separated Values (CSV) file (June-August 2018). For Thesaurus, the R package IMThesaurusANSM²⁹ was used and the resulting R dataframe from the 2019 update was converted to a CSV file.

The tables contained the following fields:

interacting drug name 1 (D1) (e.g., Metoprolol Tartrate);
interacting drug name 2 (D2) (e.g., Lidocaine);
text description for the DDI (e.g., Lidocaine is predicted to increase the risk of cardiovascular adverse effects when given with metoprolol. Manufacturer advises use with caution or avoid);
severity label (e.g., Severe);
evidence label (if available) (e.g., Study).

For single-drug ADRs, the following sources were considered: the BNF website²⁵ and SIDER dataset³⁰. For drug indications, SIDER was used. BNF ADR data were extracted in a similar way as previously with DDI data (automated web data extraction) into a CSV file, while SIDER data for ADRs and drug indications were already available in CSV files.

A table containing the following fields was constructed:

drug name (e.g., Metoprolol Tartrate);
event text description (e.g., Bradycardia);
event type (e.g., ADR);
source (e.g., SIDER).

Drug name map**

To facilitate usability and ensure compatibility, a standardization process was followed such that we could provide a resource with normalized concepts to standard terminologies for drugs and medical events. Specifically, the Observational Health Data Sciences and Informatics (OHDSI) Vocabulary version 5 was selected for map** the drug names occurring in each of the DDI online resources into RxNorm and RxNorm Extension standard codes (at the Ingredient level) using OHDSI Usagi³¹.

We removed combination drugs (as DDIs of their constituent drug ingredients were separately mentioned), vaccines, vitamins, herbal medicines, food, beverages, supplements, tobacco, and lab tests. Also, generic drug classes (e.g., combined hormonal contraceptives, hormonal replacement therapy) appearing in the BNF were not mapped to their individual drug ingredients, as there was no table on the BNF website specifying the drugs belonging in each drug class. We mapped the remaining unique drug names occurring in the DDI resources to OHDSI standard vocabulary concept identifiers. For example, Metoprolol Tartrate was mapped to the RxNorm Ingredient concept metoprolol. For Thesaurus, a native French speaker (pharmacist) confirmed the drug map**s of French drug names to English language OHDSI concepts.

A similar process was followed for drugs that appear in the single-drug data (ADRs and indications).

Intersection of DDI online resources

By matching drug names to their mapped drug ingredients in the extracted DDI data tables, we obtained the set of common drug pairs across the tables and generated a new table that contains only the DDIs and associated information which could be found in each of the DDI online resources under consideration. Cases where the interacting drug map** of D1 and D2 were swapped in the original data tables (i.e., (D1,D2) and (D2,D1)) were considered equivalent.

The final table contained the following fields:

drug_1 concept name (e.g., metoprolol);
drug_2 concept name (e.g., lidocaine);
bnf description (e.g., Lidocaine is predicted to increase the risk of cardiovascular adverse effects when given with metoprolol. Manufacturer advises use with caution or avoid);
micromedex description (e.g., lidocaine toxicity (anxiety, myocardial depression, cardiac arrest));
bnf severity (e.g., Severe);
ansm severity (e.g., Précautions d’emploi (Precautions for use));
micromedex severity (e.g., major);
bnf evidence (e.g., Study);
micromedex evidence (e.g., probable).

Adverse event and indication map**s

For DDI-related text descriptions in English from BNF and Micromedex that could be found in the DDI intersection table, a drug name blinding process was performed by replacing the interacting drug names with a common token in all cases (i.e., ‘X’). In this way, the number of unique descriptions was reduced, thus facilitating the map** process that followed. For example, the descriptions:

Both dexibuprofen and ibuprofen can increase the risk of nephrotoxicity.and

Both polymyxins and streptomycin can increase the risk of nephrotoxicity.

were both mapped to the following blinded description:

Both X and X can increase the risk of nephrotoxicity.

The set of blinded text descriptions for BNF and Micromedex was extracted from the table and a semi-automated map** process using OHDSI Usagi mapped them to MedDRA PT concepts. We explicitly focused on text descriptions that included clinical manifestations of DDIs, e.g., X may increase the risk of hypoglycaemia when taken with X. Text descriptions containing a potential mechanism of the interaction were left unmapped. In some cases, a single text description was linked to multiple concepts. For example:

Interaction Effect: An increased risk of cardiotoxicity (QT prolongation, torsades de pointes, cardiac arrest).

includes 3 different MedDRA PTs.

Also, serotonin syndrome was not mapped to its corresponding MedDRA PT and was not further considered as an AE for inclusion in the reference set.

Text descriptions from the BNF regarding single-drug ADRs were mapped to MedDRA PTs (where possible), but only for the drug ingredients that could be found in the DDI pair intersection table. SIDER ADR and indication data for the same list of drugs were also mapped to OHDSI concepts; however, for this resource, MedDRA PT codes were already available.

Positive controls

The set of positive controls was derived from the DDI intersection table, using map**s of text descriptions to AEs that were generated in the previous step. It contained 10,286 drug-drug-event (DDE) triplets, 454 unique individual drug ingredients, and 179 unique AEs (as OHDSI concepts) in total.

Negative controls

The set of negative controls was generated by randomly pairing two drug ingredients from the 454 unique drug ingredients that can be found in the positive controls and, in case the random drug pair did not appear in any of the DDI online resources, then it was randomly paired with an AE from the 179 unique AEs present in the positive control set. The choice of generating negative controls with common drug ingredients and AEs as the ones appearing in positive controls aimed to ensure the generation of a balanced reference set that does not contain added biases by design. For each of the created DDE triplets, a customized query (“(DRUG_1_CONCEPT_NAME) AND (DRUG_2_CONCEPT_NAME) AND ((EVENT_CONCEPT_NAME) OR (interaction))”, e.g., “(Oxazepam) AND (Naproxen) AND ((Hyperkalaemia) OR (interaction))”) was submitted to PubMed in an automated fashion and, if the search returned no results, the triplet was added to the negative control set. This process aimed to provide more confidence, to the best of our ability, about the absence of literature evidence of a potential DDI for the triplet under consideration, rather than definitive evidence to support the lack of a potential association.

The process was repeated until the number of negative controls with non-zero counts in the US Food and Drug Administration (FDA) Adverse Event Reporting System (FAERS) database (see Usage Notes) was similar in size (N = 4,544) compared to the equivalent subset of positive controls. The negative control set included 161 unique AEs and 435 unique drug ingredients.

Single-drug ADRs, indications, and negative controls

By replacing text descriptions from BNF (N = 1,538) and MedDRA PT codes to their corresponding mapped OHDSI concepts, a table with ADR and indication information related to the drug ingredients of the DDI reference set was generated. The table included: 438 unique drug ingredients, which could be found in at least one of the resources under consideration (i.e., BNF and SIDER), 3,492 AEs and 1,557 indication terms (as OHDSI concepts).

BNF and SIDER jointly contained 69,721 single-drug ADRs, with 12,318 common instances; this set could be utilized as a source for single-drug positive controls. This set covered 381 unique drugs and 835 unique AE concepts. Random pairing of those drugs and AE concepts followed by submission of a customized query (“(DRUG_CONCEPT_NAME) AND (EVENT_CONCEPT_NAME) AND ((adverse event) OR (adverse drug reaction))’”, e.g., “(oxazepam) AND (myoclonus) AND ((adverse event) OR (adverse drug reaction))”) to PubMed (to ensure absence of literature evidence of a potential ADR for the various drug-event associations) enabled the generation of a negative control set for single drugs (N = 12,141).

Data Records

CRESCENDDI is publicly available online through Figshare³² in 5 Excel spreadsheets. The fields contained in each of the spreadsheets are outlined below.

Data Record 1: Positive controls

DRUG_1_CONCEPT_NAME: Name of the first drug (active ingredient) that comprises a test case (DDE triplet).

DRUG_2_CONCEPT_NAME: Name of the second drug (active ingredient) that comprises a test case (DDE triplet).

EVENT_CONCEPT_NAME: Name of the normalized event (as a MedDRA PT) that comprises a test case (DDE triplet).

MDR_CODE: MedDRA code associated with the PT specified in the EVENT_CONCEPT_NAME field.

EVENT_SOURCE: Label indicating the resource where the event is mentioned (i.e., ‘BNF’, ‘Micromedex’, ‘BNF + Micromedex’).

BNF_SEV_LEVEL: Label with the values of ‘Severe’, ‘Moderate’ or ‘Mild’ that indicates the severity level associated with the DDI as shown in BNF (if available).

ANSM_SEV_LEVEL: Label with the values of ‘Contraindicated’, ‘Not recommended’, ‘Precautions for use’ or ‘Take into consideration’ that indicates the severity level associated with the DDI as shown in Thesaurus.

MICROMEDEX_SEV_LEVEL: Label with the values of ‘Contraindicated’, ‘Major’, ‘Moderate’ or ‘Minor’ that indicates the severity level associated with the DDI as shown in Micromedex.

BNF_EVID_LEVEL: Label with the values of ‘Study’, ‘Anecdotal’ or ‘Theoretical’ that indicates the evidence level associated with the DDI as shown in BNF (if available).

MICROMEDEX_EVID_LEVEL: Label with the values of ‘Established, ‘Theoretical’ or ‘Probable’ that indicates the evidence level associated with the DDI as shown in Micromedex.

Data Record 2: Negative controls

DRUG_1_CONCEPT_NAME: Name of the first drug (active ingredient) that comprises a test case (DDE triplet).

DRUG_2_CONCEPT_NAME: Name of the second drug (active ingredient) that comprises a test case (DDE triplet).

EVENT_CONCEPT_NAME: Name of the normalized event (as a MedDRA PT) that comprises a test case (DDE triplet).

MDR_CODE: MedDRA code associated with the PT specified in the EVENT_CONCEPT_NAME field.

Data Record 3: Single-drug ADRs, indications and negative controls

Tab 1 – Positive drug-event associations.

Table 1 Statistics related to the performance evaluation of three SDAs for DDIs using FAERS data.

Full size table

DRUG_CONCEPT_NAME: Name of the drug (active ingredient) that comprises a single drug information case (drug-event pair).

EVENT_CONCEPT_NAME: Name of the normalized event (as a MedDRA PT) that comprises a single drug information case (drug-event pair).

EVENT_TYPE: Type of association between the drug and event of the single drug information case (i.e., ‘Adverse event’ or’Indication’).

SOURCE: Label indicating the resource of the single drug information case (i.e., ‘BNF’ or ‘SIDER’).

Tab 2 – Negative drug-event associations.

Table 2 Statistics related to the performance evaluation of three SDAs for single drugs using FAERS data.

Full size table

DRUG_CONCEPT_NAME: Name of the drug (active ingredient) that comprises a single drug negative case (drug-event pair).

EVENT_CONCEPT_NAME: Name of the normalized event (as a MedDRA PT) that comprises a single drug negative case (drug-event pair).

Data Record 4: Drug map**s

DRUG_INITIAL_NAME: Unmapped name of the drug as extracted from the resource.

DRUG_CONCEPT_NAME: Normalized name of the drug (as an RxNorm Ingredient) extracted from the resource.

RXNORM_CODE/RXNORM_EXTENSION_CODE (OHDSI): RxNorm/RxNorm Extension code associated with the normalized drug name specified in the DRUG_CONCEPT_NAME field.

SOURCE: Label indicating the resource where the drug is found (i.e., ‘BNF_DDI’, ‘Thesaurus_DDI’, ‘Micromedex_DDI’, ‘BNF_Single’).

Data Record 5: Event map**s

EVENT_INITIAL_TEXT: Text description (after drug name blinding) containing an AE as extracted from the resource.

EVENT_CONCEPT_NAME: Mapped name of the event (as a MedDRA term) extracted from the resource.

SOURCE: Label indicating the resource where the text description is found (i.e., ‘BNF_DDI’, ‘Micromedex_DDI’, ‘BNF_Single’).

Technical Validation

Given the inability to generate ‘gold standards’ in pharmacovigilance, the validation of the reference set included steps that supported the technical quality of the procedures followed to generate the dataset, rather than attempting to further ensure the validity of each control. The process of validating the reference set was two-way.

First, we verified the original online data as well as the unmapped extracted DDI data versus the curated reference set in order to validate the accuracy of the automated extraction and concept map** processes. A random sample of 40 positive and 40 negative controls was manually checked in each of the DDI online resources (i.e., BNF, Thesaurus, and Micromedex), to ensure the presence or absence, respectively, of the DDE triplet in the information provided. Due to the time lag between data retrieval (June-August 2018) and validation (September 2021), there were issues most probably related to differing versions of the resources. More specifically, there were 6 positive controls missing from one of the resources (5 from the BNF and 1 from Micromedex), 2 of which due to the complete removal of the drug monograph. Also, one of the negative control samples had been added to the BNF. No issues were identified during the validation of the random sample of controls from the curated reference set against the unmapped extracted DDI data.

Second, the validation of text description map** for AEs included independent annotation of a random sample of 100 text descriptions for AEs to ensure agreement on event map**. No issues were identified.

Expert manual review of a number of cases from the reference set could be potentially performed as an additional layer of the technical validation procedure to confirm that the included DDIs are worthy of note. We have attempted to replace this need for expert manual review by combining information from multiple resources of clinical interest.

The next section outlines the application of the reference set for drug safety surveillance in an SRS database using SDAs that have been described in previous studies, in an effort to showcase its validity through practical implementation as well as prove its potential use in the real world.

Usage Notes

This publicly available resource aims to provide a common ground for evaluation of SDAs related to DDI signals, with a focus on assembling information from disparate sources that could provide support toward the clinical relevance of controls. The size of the reference set alongside the relatively large number of drugs and AEs considered enables a quantitative approach in algorithm performance evaluation in terms of SDAs developed for DDI signals.

Also, the supplementary single-drug positive and negative control sets could be used separately for signal detection in the context of adverse drug-event associations.

This reference set could be applied to a variety of data sources (e.g., electronic health record data, social media, literature). Here, we illustrate applicability in one such context.

FAERS screening for DDI signals

In pharmacovigilance, signal detection is largely based on methodologies that use disproportionality analysis, meaning that the observed counts are compared to the expected ones, assuming that the drug(s) and the events occur independently. For DDIs, similar measures of disproportionality have been described in the literature. For our analysis, the following statistical measures were considered:

(i)
An observed-to-expected shrunk interaction measure (Omega)⁸
(ii)
The ‘interaction coefficient’ in a linear regression model with additive baseline (delta_add)⁹
(iii)
A measure based on an adapted version of Multi-Gamma Poisson Shrinker (MGPS) model, called Interaction Signal Score (IntSS)¹⁰

A curated and standardized version of FAERS was used as the test data source. In FAERS, each spontaneous report contains information on administered drugs, AEs experienced, indications, and demographic information (i.e., sex, age, etc). Using a slight modification of the Adverse Event Open Learning through Universal Standardization (AEOLUS) process that was described in published work³³, FAERS data files corresponding to the period 2004Q1–2018Q4 were standardized to the RxNorm Ingredient level terms and MedDRA PTs, so that compatibility of the reference set with the test data could be established. The total number of reports containing at least one drug and one AE was 9,203,239.

ROC analysis was performed using MATLAB function perfcurve. 95% confidence interval (CI) estimates for the AUC were calculated using leave-one-out cross validation.

Table 1 shows statistics related to the performance of the SDAs in FAERS using our advocated reference standard. For each algorithm, the table provides the AUC scores with 95% CI estimates. As opposed to expectations, only two out of three SDAs for DDIs (i.e., Omega and IntSS) performed better than random guessing. Median signal scores for the set of positive controls were larger compared to those of negative controls in those two cases, which provides support for the validity of CRESCENDDI. Limited performance analyses in the studies describing the SDAs for DDIs as well as absence of other efforts in the literature for quantitative performance assessment across multiple thresholds did not manage to provide an appropriate benchmark for this study.

FAERS screening for single-drug ADRs

For the single-drug reference set, empirical support was provided by applying three well-established SDAs to FAERS data. Positive controls (at the MedDRA PT level) were sourced from either the intersection (N = 12,318) or the union (N = 52,637) of the resources under consideration (i.e., BNF and SIDER) and ROC analysis for performance evaluation similarly to the previous section (Table 2).

Table 2 shows that EBGM outperformed PRR, which is in line with the results of other studies¹⁴. Also, improved performance was noticed in the case of resource intersection for all SDAs, which advocates the use of information that appears in multiple resources rather than relying on a single data source for deriving positive controls.

Flexibility of the resource

This reference set has been mapped to standard vocabularies using the OHDSI framework, thus enabling linking to other ontologies and/or vocabularies, based on research needs, test data resources format, etc.

Considering the changing nature of available evidence for both positive and negative controls, reproduction of the resource in the future would be recommended to ensure that it is up to date. Although specific products (e.g., vaccines) were excluded given our focus on generating a reference set relevant to DDIs, slight modifications on the drug map** process can allow the inclusion of controls pertinent to any additional products of interest.

The incorporation of additional information (e.g., shared indication, single-drug AE under the same HLT/HLGT MedDRA level, evidence levels) enables filtering and stratification of controls. The effect of stratification using those design criteria is outside the scope of this paper, but we aim to explore this aspect in future research.

Code availability

The code used to generate this dataset is publicly available on a GitHub repository (https://github.com/elpidakon/CRESCENDDI). This code was developed and tested using: OHDSI standard vocabulary version v5.0 18-JAN-19 (https://athena.ohdsi.org/), which includes: RxNorm version 20181203, RxNorm Extension version 2019-01-17, and MedDRA version19.1. Database storage and operations were enabled using PostgreSQL 9.3. Drug and event map** steps were performed using OHDSI Usagi version 1.2.7 (https://github.com/OHDSI/usagi). Web data extraction was performed using Python 3.6. Scores for the SDAs were calculated using Python 3.6 (Omega), SAS (delta_add) and R version 4.0.0 (IntSS, PRR, EBGM and BCPNN); AUC scores and CI estimates were calculated using MATLAB R2020b (perfcurve function).

Change history

10 March 2022
In this article the hyperlink provided for https://doi.org/10.6084/m9.figshare.c.5481408 in reference 32 was incorrect. The original article has been corrected.

References

National Center for Health Statistics. Health, United States, 2019. (2021).
Tannenbaum, C. & Sheehan, N. L. Understanding and preventing drug-drug and drug-gene interactions. Expert Review of Clinical Pharmacology 7, 533–544 (2014).
Article CAS Google Scholar
Magro, L., Moretti, U. & Leone, R. Epidemiology and characteristics of adverse drug reactions caused by drug–drug interactions. Expert Opin. Drug Saf. 11, 83–94 (2012).
Article CAS Google Scholar
Li, Y., Ryan, P. B., Wei, Y. & Friedman, C. A Method to Combine Signals from Spontaneous Reporting Systems and Observational Healthcare Data to Detect Adverse Drug Reactions. Drug Saf. 38, 895–908 (2015).
Article Google Scholar
Li, Y., Jimeno Yepes, A. & **ao, C. Combining Social Media and FDA Adverse Event Reporting System to Detect Adverse Drug Reactions. Drug Saf. 43, 893–903 (2020).
Article Google Scholar
Harpaz, R. et al. Toward multimodal signal detection of adverse drug reactions. J. Biomed. Inform. 76, 41–49 (2017).
Article Google Scholar
Bate, A., Pariente, A., Hauben, M. & Bégaud, B. Quantitative Signal Detection and Analysis in Pharmacovigilance. in Mann’s Pharmacovigilance: Third Edition 331–354 (John Wiley & Sons, Ltd, 2014).
Norén, G. N., Sundberg, R., Bate, A. & Edwards, I. R. A statistical methodology for drug–drug interaction surveillance. Stat. Med. 27, 3057–3070 (2008).
Article MathSciNet Google Scholar
Thakrar, B. T., Grundschober, S. B. & Doessegger, L. Detecting signals of drug-drug interactions in a spontaneous reports database. Br. J. Clin. Pharmacol. 64, 489–95 (2007).
Article CAS Google Scholar
Almenoff, J. S., DuMouchel, W., Kindman, L. A., Yang, X. & Fram, D. Disproportionality analysis using empirical Bayes data mining: a tool for the evaluation of drug interactions in the post-marketing setting. Pharmacoepidemiol. Drug Saf. 12, 517–521 (2003).
Article Google Scholar
Norén, G. N., Caster, O., Juhlin, K. & Lindquist, M. Zoo or Savannah? Choice of Training Ground for Evidence-Based Pharmacovigilance. Drug Safety 37, 655–659 (2014).
Article Google Scholar
Harpaz, R., DuMouchel, W. & Shah, N. H. Comment on: “Zoo or Savannah? Choice of Training Ground for Evidence-Based Pharmacovigilance”. Drug Safety 38, 113–114 (2015).
Article Google Scholar
Niklas Norén, G., Caster, O., Juhlin, K. & Lindquist, M. Authors’ Reply to Harpaz et al. Comment on: ‘“Zoo or Savannah? Choice of Training Ground for Evidence-Based Pharmacovigilance”’. (2014).
Ryan, P. B. et al. Defining a reference set to support methodological research in drug safety. Drug Saf. 36 (2013).
Harpaz, R. et al. Performance of Pharmacovigilance Signal Detection Algorithms for the FDA Adverse Event Reporting System. Clin. Pharmacol. Ther. 93, 539–46 (2013).
Article CAS Google Scholar
Harpaz, R. et al. A time-indexed reference standard of adverse drug reactions. Sci. Data 1, 140043 (2014).
Article Google Scholar
Coloma, P. M. et al. A reference standard for evaluation of methods for drug safety signal detection using electronic healthcare record databases. Drug Saf. 36, 13–23 (2013).
Article CAS Google Scholar
Voss, E. A. et al. Accuracy of an automated knowledge base for identifying drug adverse reactions. J. Biomed. Inform. 66, 72–81 (2017).
Article CAS Google Scholar
Juhlin, K., Soeria-Atmadja, D., Thakrar, B. & Norén, G. N. Evaluation of statistical measures for adverse drug interaction surveillance. Pharmacoepidemiol. Drug Saf. Drug Saf 23, 294–5 (2014).
Google Scholar
Fulda, T. R., Valuck, R. J., Zanden, J. V., Parker, S. & Byrns, P. J. Disagreement among drug compendia on inclusion and ratings of drug-drug interactions. Curr. Ther. Res. - Clin. Exp. 61, 540–548 (2000).
Article Google Scholar
Vitry, A. I. Comparative assessment of four drug interaction compendia. Br. J. Clin. Pharmacol. 63, 709–714 (2007).
Article CAS Google Scholar
Vonbach, P., Dubied, A., Krähenbühl, S. & Beer, J. H. Evaluation of frequently used drug interaction screening programs. Pharm. World Sci. 30, 367–374 (2008).
Article Google Scholar
Kheshti, R., Aalipour, M. & Namazi, S. A comparison of five common drug–drug interaction software programs regarding accuracy and comprehensiveness. J. Res. Pharm. Pract. 5, 257 (2016).
Article CAS Google Scholar
Wang, L. M., Wong, M., Lightwood, J. M. & Cheng, C. M. Black box warning contraindicated comedications: Concordance among three major drug interaction screening programs. Ann. Pharmacother. 44, 28–34 (2010).
Article CAS Google Scholar
National Institute for Health and Care Excellence. BNF: British National Formulary. https://bnf.nice.org.uk/ (2018).
Agence nationale de sécurité du médicament et des produits de santé. Thésaurus des interactions médicamenteuses. https://ansm.sante.fr/documents/reference/thesaurus-des-interactions-medicamenteuses-1 (2019).
IBM Watson Health. Micromedex® (electronic version). https://www.micromedexsolutions.com/ (2018).
Python Software Foundation. Python Language Reference. https://www.python.org/ (2009).
Cossin, S. IMthesaurusANSM: Thesaurus des Interactions Medicamenteuses de l’ANSM. https://rdrr.io/github/scossin/IMthesaurusANSM/ (2016).
Kuhn, M., Letunic, I., Jensen, L. J. & Bork, P. The SIDER database of drugs and side effects. Nucleic Acids Res. 44, D1075–D1079 (2016).
Article CAS Google Scholar
OHDSI Team. Usagi: an application to help create map**s between coding systems and the Vocabulary standard concepts. http://ohdsi.github.io/Usagi/ (2020).
Kontsioti, E., Maskell, S., Dutta, B. & Pirmohamed, M. A reference set of clinically relevant adverse drug-drug interactions. figshare https://doi.org/10.6084/m9.figshare.c.5481408 (2021).
Banda, J. M. et al. Data Descriptor: A curated and standardized adverse drug event resource to accelerate drug safety research. Sci. Data 3 (2016).
Evans, S. J. W., Waller, P. C. & Davis, S. Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reports. Pharmacoepidemiol. Drug Saf. 10, 483–486 (2001).
Article CAS Google Scholar
DuMouchel, W. Bayesian Data Mining in Large Frequency Tables, with an Application to the FDA Spontaneous Reporting System. Am. Stat. 53, 177–190 (1999).
Google Scholar
Bate, A. et al. A Bayesian neural network method for adverse drug reaction signal generation. Eur. J. Clin. Pharmacol. 54, 315–21 (1998).
Article CAS Google Scholar

Download references

Acknowledgements

EK is funded for her PhD through joint funding from EPSRC and AstraZeneca. The authors would like to acknowledge Antoni Wisniewski and Isobel Anderson for valuable feedback on this research. We also thank Victor Dupuy for validating map**s of French drug names to English language and Ingrid Vilimelis for performing an independent text annotation during the technical validation process.

Author information

Authors and Affiliations

Department of Electrical Engineering and Electronics, University of Liverpool, Liverpool, UK
Elpida Kontsioti & Simon Maskell
Patient Safety Center of Excellence, Chief Medical Office Organization, AstraZeneca Pharmaceuticals, Gaithersburg, MD, USA
Bhaskar Dutta
The Wolfson Centre for Personalized Medicine, MRC Centre for Drug Safety Science, Department of Pharmacology and Therapeutics, Institute of Systems, Molecular and Integrative Biology, University of Liverpool, Liverpool, United Kingdom
Munir Pirmohamed

Authors

Elpida Kontsioti
View author publications
You can also search for this author in PubMed Google Scholar
Simon Maskell
View author publications
You can also search for this author in PubMed Google Scholar
Bhaskar Dutta
View author publications
You can also search for this author in PubMed Google Scholar
Munir Pirmohamed
View author publications
You can also search for this author in PubMed Google Scholar

Contributions

E.K., S.M. and M.P. conceived the work and designed the analysis. E.K. conducted the data extraction, developed the analysis code, and wrote the manuscript. All authors reviewed and approved the manuscript.

Corresponding author

Correspondence to Elpida Kontsioti.

Ethics declarations

Competing interests

EK receives PhD studentship that is jointly funded by AstraZeneca and the EPSRC. MP receives research funding from various organizations including the MRC and NIHR. He has also received partnership funding for the MRC Clinical Pharmacology Training Scheme (co-funded by MRC and Roche, UCB, Eli Lilly and Novartis) and grant funding from Vistagen Therapeutics. He has also unrestricted educational grant support for the UK Pharmacogenetics and Stratified Medicine Network from Bristol-Myers Squibb and UCB. He has developed an HLA genoty** panel with MC Diagnostics, but does not benefit financially from this. He is part of the IMI Consortium ARDAT (www.ardat.org). These funding sources were not utilized for this work. BD was AstraZeneca’s employee and shareholder when this article was submitted but has since ended his relationship with both.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.

The Creative Commons Public Domain Dedication waiver http://creativecommons.org/publicdomain/zero/1.0/ applies to the metadata files associated with this article.

Reprints and permissions

About this article

Cite this article

Kontsioti, E., Maskell, S., Dutta, B. et al. A reference set of clinically relevant adverse drug-drug interactions. Sci Data 9, 72 (2022). https://doi.org/10.1038/s41597-022-01159-y

Download citation

Received: 27 July 2021
Accepted: 13 January 2022
Published: 04 March 2022
DOI: https://doi.org/10.1038/s41597-022-01159-y
Springer Nature Limited

This article is cited by

Detection Algorithms for Simple Two-Group Comparisons Using Spontaneous Reporting Systems
- Yoshihiro Noguchi
- Tomoaki Yoshimura
Drug Safety (2024)
Timing Matters: A Machine Learning Method for the Prioritization of Drug–Drug Interactions Through Signal Detection in the FDA Adverse Event Reporting System and Their Relationship with Time of Co-exposure
- Vera Battini
- Marianna Cocco
- Maurizio Sessa
Drug Safety (2024)

A reference set of clinically relevant adverse drug-drug interactions

Abstract

Similar content being viewed by others

Pediatric Drug Safety Signal Detection: A New Drug–Event Reference Set for Performance Testing of Data-Mining Methods and Systems

A time-indexed reference standard of adverse drug reactions

A Method to Combine Signals from Spontaneous Reporting Systems and Observational Healthcare Data to Detect Adverse Drug Reactions

Background & Summary

Methods

Web data extraction

Drug name map**

Intersection of DDI online resources

Adverse event and indication map**s

Positive controls

Negative controls

Single-drug ADRs, indications, and negative controls

Data Records

Data Record 1: Positive controls

Data Record 2: Negative controls

Data Record 3: Single-drug ADRs, indications and negative controls

Data Record 4: Drug map**s

Data Record 5: Event map**s

Technical Validation

Usage Notes

FAERS screening for DDI signals

FAERS screening for single-drug ADRs

Flexibility of the resource

Code availability

Change history

10 March 2022

References

Acknowledgements

Author information

Authors and Affiliations

Contributions

Corresponding author

Ethics declarations

Competing interests

Additional information

Rights and permissions

About this article

Cite this article

Share this article

This article is cited by

Detection Algorithms for Simple Two-Group Comparisons Using Spontaneous Reporting Systems

Timing Matters: A Machine Learning Method for the Prioritization of Drug–Drug Interactions Through Signal Detection in the FDA Adverse Event Reporting System and Their Relationship with Time of Co-exposure

Search

Navigation