{"id":32433,"date":"2021-10-25T23:05:39","date_gmt":"2021-10-25T22:05:39","guid":{"rendered":"https:\/\/www.inovex.de\/?p=32433"},"modified":"2023-06-13T07:56:41","modified_gmt":"2023-06-13T05:56:41","slug":"adverse-drug-events-discovery-nlp","status":"publish","type":"post","link":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/","title":{"rendered":"Adverse Drug Events Discovery Using Natural Language Processing"},"content":{"rendered":"<p>This article shows the ADE Discovery Browser can\u00a0contribute to the visibility of adverse drug events (ADEs) \u2013 and thereby drug safety \u2013 by an\u00a0end-to-end qualitative text mining of ADEs\u00a0associated with a medication like the COVID-19 vaccines.<!--more--><\/p>\n<p>The outbreak of a global pandemic revealed the need for quick but also safe development of COVID-19 vaccines. Next to the practical complexity of developing and manufacturing such vaccines, the amount of research accompanying the drug development constituted a challenge by itself. Biomedical literature hosts research findings and case reports of crucial and potential hidden information such as adverse drug events (ADEs) associated with a certain medication consumption. Recently developed COVID-19 vaccines were observed to cause mild ADEs such as fever, redness at the injection site, headache, diarrhoea, muscle pain and also several severe ADEs such as anaphylaxis allergic reactions, thrombocytopenia, bell\u2019s palsy etc. in certain groups of people or individuals. Since the COVID-19 vaccines are being produced and administered, the amount of available literature related to ADEs associated with COVID-19 vaccines have been increasing just like the amount of available biomedical literature in any other topic.<\/p>\n<p>In order to contribute to the visibility of ADEs and thereby drug safety, our goal was to perform end-to-end qualitative text mining of ADEs associated with a medication from the life sciences literature database, <a href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/\">PubMed<\/a>, and to make it possible to interactively discover the ADEs, DRUGs and their causal and semantic relationships. The eventual goal of the ADE Discovery Browser is to provide a system to pharmacovigilance experts where they can easily make use of and evaluate the retrieved information about ADEs from the scientific literature. To achieve that, we performed 2 tasks: named entity recognition (NER) and relation extraction (RE). For each task, we fine-tuned transformers based pre-trained language models (PLM): a generic domain model <a href=\"https:\/\/arxiv.org\/pdf\/1910.01108.pdf\">DistilBERT<\/a> and an in-domain model <a href=\"https:\/\/arxiv.org\/pdf\/2007.15779.pdf\">PubMedBERT<\/a>.<\/p>\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_82_2 counter-hierarchy ez-toc-counter ez-toc-custom ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\"><p class=\"ez-toc-title\" style=\"cursor:inherit\"><\/p>\n<\/div><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#What-is-ADE\" >What is ADE?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Natural-Language-Processing-for-ADE-Extraction\" >Natural Language Processing for ADE Extraction<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Our-Approach-Data-and-Results\" >Our Approach, Data and Results<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Named-Entity-Recognition\" >Named-Entity Recognition<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Relation-Extraction\" >Relation Extraction<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Information-Retrieval\" >Information Retrieval<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Application-Development\" >Application Development<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Examples-of-Retrieved-Information\" >Examples of Retrieved Information<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#Conclusion\" >Conclusion<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#References\" >References<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"What-is-ADE\"><\/span><b>What is ADE?<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">First, let\u2019s leave out the word \u201cdrug\u201c and focus on \u201cadverse events\u201c only. <\/span><b>Adverse events<\/b><span style=\"font-weight: 400;\"> are any unwanted and unfavourable <\/span><b>occurrence<\/b><span style=\"font-weight: 400;\"> that is temporarily <\/span><b>associated with<\/b><span style=\"font-weight: 400;\"> the use of a <\/span><b>medical product<\/b><span style=\"font-weight: 400;\">. In this sense, \u201coccurrence\u201c can be a sign or a symptom, \u201cmedical product\u201c can be a drug, medical device or a vaccination and \u201cassociated with\u201c does not necessarily imply causation. There exists a subset in this set of undesired occurrences which are caused by treatment, and some of these undesired occurrences that are caused by treatment happen due to medication errors. Medication errors occur either during prescribing such as failure to adjust with different drugs, or administration, such as overdosing or having allergic reactions etc..<\/span><\/p>\n<p><figure id=\"attachment_32434\" aria-describedby=\"caption-attachment-32434\" style=\"width: 440px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32434\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/ae-1024x566.png\" alt=\"Adverse Events in a Venn Diagram\" width=\"440\" height=\"243\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/ae-1024x566.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/ae-300x166.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/ae-768x424.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/ae-1536x848.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/ae-400x221.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/ae-528x290.png 528w, https:\/\/www.inovex.de\/wp-content\/uploads\/ae-360x199.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/ae.png 1586w\" sizes=\"auto, (max-width: 440px) 100vw, 440px\" \/><figcaption id=\"caption-attachment-32434\" class=\"wp-caption-text\">Figure 1: Adverse events in a venn diagram [1]<\/figcaption><\/figure><b>Adverse drug reaction<\/b><span style=\"font-weight: 400;\"> (ADR) is defined as the <\/span><b>undesired reaction<\/b><span style=\"font-weight: 400;\"> that <\/span><b>results<\/b> <b>from<\/b><span style=\"font-weight: 400;\"> a <\/span><b>medical product<\/b><span style=\"font-weight: 400;\"> consumption under the condition that it was <\/span><b>consumed at normal doses<\/b><span style=\"font-weight: 400;\"> and they are the normal expected side effects that we all know. On the other hand, <\/span><b>adverse drug event <\/b><span style=\"font-weight: 400;\">(ADE) is as well defined as the <\/span><b>unpleasant reaction<\/b><span style=\"font-weight: 400;\"> after taking a medication, whereas the <\/span><b>cause<\/b><span style=\"font-weight: 400;\"> of the reaction is <\/span><b>not necessarily the medication consumption<\/b><span style=\"font-weight: 400;\">, but it might also be caused due to above mentioned medication errors [2]. Although the terms ADR and ADE are quite exchangeably used, ADRs are a subset of ADEs and the distinction between the terms can be understood better in Figure 2 and 3.<\/span><\/p>\n<p><figure id=\"attachment_32438\" aria-describedby=\"caption-attachment-32438\" style=\"width: 440px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32438\" title=\"Figure 2: ADRs in a Venn Diagram [1]\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/adr-1024x585.png\" alt=\"ADRs in a Venn Diagram\" width=\"440\" height=\"251\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/adr-1024x585.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/adr-300x171.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/adr-768x439.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/adr-1536x877.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/adr-400x228.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/adr-360x206.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/adr.png 1558w\" sizes=\"auto, (max-width: 440px) 100vw, 440px\" \/><figcaption id=\"caption-attachment-32438\" class=\"wp-caption-text\">Figure 2: ADRs in a venn diagram [1]<\/figcaption><\/figure><figure id=\"attachment_32436\" aria-describedby=\"caption-attachment-32436\" style=\"width: 440px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32436\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/ade-1024x581.png\" alt=\"ADEs in a venn diagram\" width=\"440\" height=\"250\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/ade-1024x581.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/ade-300x170.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/ade-768x436.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/ade-1536x871.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/ade-400x227.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/ade-360x204.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/ade.png 1562w\" sizes=\"auto, (max-width: 440px) 100vw, 440px\" \/><figcaption id=\"caption-attachment-32436\" class=\"wp-caption-text\">Figure 3: ADEs in a venn diagram [1]<\/figcaption><\/figure><span style=\"font-weight: 400;\">According to the studies conducted over the time, around <\/span><b>5% of the hospital admissions<\/b><span style=\"font-weight: 400;\"> were reported to be <\/span><b>due to ADEs<\/b><span style=\"font-weight: 400;\"> some of which can be prevented from happening if they were known. T<\/span><span style=\"font-weight: 400;\">his number <\/span><b>can increase<\/b><span style=\"font-weight: 400;\"> up <\/span><b>to<\/b> <b>10%<\/b> <b>considering<\/b><span style=\"font-weight: 400;\"> only <\/span><b>elderly patients<\/b><span style=\"font-weight: 400;\">, who take more medications and are weaker to certain adverse events than the young patients. [3,4] Considering the increasing number of medications being produced day by day, various potential usages and different groups of people; u<\/span><span style=\"font-weight: 400;\">nder-reporting of ADEs seems to be a crucial problem and the ideal goal is to make as much information as possible available to the healthcare professionals in order to reduce the human errors. Drug safety is eventually critical as the misuse might cause mortem.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Natural-Language-Processing-for-ADE-Extraction\"><\/span><b>Natural Language Processing for ADE Extraction<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In the biomedical domain, there are several text based resources like electronic health records, biomedical literature, medical blog websites, patient surveys, laboratory reports etc.. Having such data resources more and more electronically available, brings the idea if natural language processing (NLP) techniques can be helpful to extract ADEs automatically from such text-based resources because they potentially include hidden ADE cases, and the more ADEs known, the more they can be prevented. In order to perform such information retrieval,<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">automatic recognition of DRUG and ADE named entities in a given text<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">automatic extraction of DRUG-ADE relations between the two target entities<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">needs to be handled using NLP techniques.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Let\u2019s say the following sentence is from one of the text-based resources. The first step is to identify the ADE and DRUG mention spans in the sentence in order to relate the observation of an ADE to a drug as in the following example.<\/span><\/p>\n<figure id=\"attachment_32440\" aria-describedby=\"caption-attachment-32440\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32440 size-large\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence-1024x408.png\" alt=\"Example sentence with highlighted ADE and DRUG entity spans\" width=\"640\" height=\"255\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence-1024x408.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence-300x120.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence-768x306.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence-1536x612.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence-400x159.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence-360x143.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence.png 1852w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-32440\" class=\"wp-caption-text\">Figure 4: Example sentence with highlighted ADE and DRUG entity spans<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">Once we have all the ADE and DRUG entity spans identified, we have a set of ADEs and a set of DRUGs and we do not know yet which of those are actually in a causal relationship with which of those. Thereafter, the second step is to identify the semantic relationships between the entities in order to assign a causal relationship. Eventually, <\/span><b>amoxicillin<\/b><span style=\"font-weight: 400;\"> is in a causal relation with <\/span><b>anaphylactic reaction<\/b><span style=\"font-weight: 400;\">, <\/span><b>pruritis<\/b><span style=\"font-weight: 400;\"> and <\/span><b>facial erythema edema<\/b><span style=\"font-weight: 400;\">, and <\/span><b>bactrim<\/b><span style=\"font-weight: 400;\"> is in a causal relation with <\/span><b>pruritis<\/b><span style=\"font-weight: 400;\">, <\/span><b>facial erythema edema<\/b><span style=\"font-weight: 400;\"> and <\/span><b>anaphylactic exposure<\/b><span style=\"font-weight: 400;\">.<\/span><\/p>\n<figure id=\"attachment_32442\" aria-describedby=\"caption-attachment-32442\" style=\"width: 440px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32442\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_relations-1024x382.png\" alt=\"elationships between the target entities in Figure 4\" width=\"440\" height=\"164\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_relations-1024x382.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_relations-300x112.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_relations-768x287.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_relations-400x149.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_relations-360x134.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_relations.png 1174w\" sizes=\"auto, (max-width: 440px) 100vw, 440px\" \/><figcaption id=\"caption-attachment-32442\" class=\"wp-caption-text\">Figure 5: Relationships between the target entities in Figure 4<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">As can be seen from the example above, some of the challenges of the task are to have multiple entities of same or different types in a sentence, entities with multiple words and that not all the entity pairs mentioned in a sentence are in a relation. These challenges can be approached using NLP techniques and following the tasks such as named entity recognition and relation extraction.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"Our-Approach-Data-and-Results\"><\/span><b>Our Approach, Data and Results<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Our approach was to develop an end-to-end solution for interactive discovery of ADEs from the scientific literature in order to provide pharmacovigilance experts or researchers a system with easy information gathering of ADEs from the published research papers. <\/span><a href=\"https:\/\/pubmed.ncbi.nlm.nih.gov\/\"><span style=\"font-weight: 400;\">PubMed<\/span><\/a><span style=\"font-weight: 400;\"> is a database of around 30M life sciences literature. The amount of available biomedical literature in PubMed is increasing exponentially year by year, as shown in Figure 6, which makes it impossible for any researcher to stay up-to-date by reading and getting insights from the literature. Moreover, the literature potentially hosts information about common and rare ADEs that are observed and published as research findings or case reports of adverse events associated with a certain drug consumption.\u00a0<\/span><\/p>\n<figure id=\"attachment_32447\" aria-describedby=\"caption-attachment-32447\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32447 size-large\" style=\"color: #404040;\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats-1024x274.png\" alt=\"graph diagram showing the amount of citations by year in PubMed when searching for \u201cAdverse Events\u201c \u2013 increasing exponantially\" width=\"640\" height=\"171\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats-1024x274.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats-300x80.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats-768x206.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats-1536x411.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats-400x107.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats-360x96.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/pubmed_stats.png 1688w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-32447\" class=\"wp-caption-text\">Figure 6: The amount of citations by year in PubMed when searching for <span style=\"font-weight: 400;\">\u201c<\/span>Adverse Events\u201c<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">Such common and rare ADEs can be retrieved from the literature by applying the below mentioned information retrieval techniques and our approach is illustrated in Figure 7.\u00a0<\/span><\/p>\n<figure id=\"attachment_32449\" aria-describedby=\"caption-attachment-32449\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32449 size-large\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/approach_diagram-1024x609.png\" alt=\"end-to-end approach diagram of Deep Learning models for analysing medical articles\" width=\"640\" height=\"381\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/approach_diagram-1024x609.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/approach_diagram-300x178.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/approach_diagram-768x457.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/approach_diagram-400x238.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/approach_diagram-360x214.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/approach_diagram.png 1440w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-32449\" class=\"wp-caption-text\">Figure 7: The end-to-end approach diagram<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">We<\/span><span style=\"font-weight: 400;\"> trained <\/span><b>two deep learning (DL) models<\/b><span style=\"font-weight: 400;\"> making use of transformers-based pre-trained language models from the <\/span><span style=\"font-weight: 400;\">Hugging Face<\/span><span style=\"font-weight: 400;\"> library: one performing the named entity recognition (NER) of DRUGs and ADEs and one performing the relation extraction (RE) whether a DRUG-ADE pair is related to each other in a sentence or not. We fine-tuned the models using <\/span><b>the annotated data<\/b><span style=\"font-weight: 400;\">, and then <\/span><b>pipelined<\/b><span style=\"font-weight: 400;\"> them in a way that the output of NER can be fed into RE as input so that we can process sequential evaluation. <\/span><span style=\"font-weight: 400;\">Then, we have <\/span><b>a set of literature<\/b><span style=\"font-weight: 400;\"> filtered and downloaded from PubMed and we <\/span><b>apply this literature to the pipeline model<\/b><span style=\"font-weight: 400;\"> and <\/span><b>visualise<\/b> <b>the retrieved information in the ADE Discovery Browser.<\/b><span style=\"font-weight: 400;\"> We worked with 2 annotated datasets for fine-tuning:\u00a0<\/span><\/p>\n<ol>\n<li><span style=\"font-weight: 400;\">2018 n2c2 ADE and Medication Extraction Challenge dataset [5]<\/span><\/li>\n<li><span style=\"font-weight: 400;\">ADE corpus [6]<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">To the best of our knowledge, the n2c2 dataset is one of the latest available annotated datasets which includes 1038 sentences with at least one ADE entity annotation out of 505 electronic health records. The ADE corpus was the first published labeled data for this task in 2012 by filtering 3000 case reports from PubMed and annotating the relevant sentences which includes 4272 sentences with at least one ADE annotation. The language domain of the ADE corpus is more in the medical context than the n2c2 dataset. The data resource being the biomedical literature instead of spontaneously written clinical records, ADE corpus has more specific domain words and includes more thought language. The big difference between the n2c2 dataset and the ADE corpus was that the n2c2 dataset also involves generic terms annotated as named entity. Such generic terms can be simply mentions of<\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">painkiller, antibiotics<\/span><\/i><\/p>\n<p><span style=\"font-weight: 400;\">for drugs instead of specifically mentioning which kind of painkiller or antibiotics it was, or mentions of<\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">overdose, drug reaction, allergic reaction\u00a0<\/span><\/i><\/p>\n<p><span style=\"font-weight: 400;\">instead of specifying which kind of adverse event was observed. The problem is that the named entity is expected to be a more specific definition of DRUG or ADE. The n2c2 dataset also has an inconsistency problem. An observed sample was different ways of annotating rash observation as an ADE:<\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">rash, developed a drug rash, developed papular rash over posterior thighs and perirectal area, red rash on arms and face, severe rash<\/span><\/i><\/p>\n<p><span style=\"font-weight: 400;\">ADE Corpus was able to successfully differentiate such named entities and includes more specific words for DRUG or ADE mentions. Therefore, we used ADE Corpus to evaluate the quality of the n2c2 dataset to introduce better quality labeled data and to introduce more data samples. For those reasons, we used the ADE Corpus together with the n2c2 dataset for advancing the named entity recognition while using only the n2c2 dataset for both named-entity recognition and relation extraction.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Named-Entity-Recognition\"><\/span><b>Named-Entity Recognition<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Biomedical NER has been quite important in identifying specific biomedical entity types from unstructured text, and acts as a basis for many biomedical text analysis tasks. We approached NER as a sequential token classification problem and performed Beginning-Inside-Outside (BIO) tagging of the annotated corpora in order to fine-tune the PLMs. By using PLMs and the ADE corpus, we incorporated outside knowledge and a good language representation to the n2c2 dataset. The biggest motivation for using PLMs was to make use of state-of-the-art contextual representations and observe how much they can help the sequential token classification task for ADE extraction. <\/span><\/p>\n<p><span style=\"font-weight: 400;\">We performed entity level evaluation and considered F1 score as the main comparison metric. We observed the best F1 score for ADE entity span recognition, <\/span><b>fine-tuning the PubMedBERT model and using the combined datasets<\/b><span style=\"font-weight: 400;\">. This setting indeed performed better than a previously published machine learning model using CRF and is comparable to a deep learning model of Bi-LSTM and CRF layers [7]. Therefore, we used the fine-tuned PubMedBERT model using the combined datasets for the pipeline processing later on.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Relation-Extraction\"><\/span><b>Relation Extraction<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Biomedical RE also has been an attention catching research topic in identifying semantic relations from biomedical text documents. RE relies on the two extracted entities and the sentence those entities were used. We approached RE as a sentence classification problem and performed entity masking of the target entities in the input sentence when fine-tuning the PLMs.\u00a0\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For entity masking, we replaced the actual tokens of the target entities with special tokens such as <\/span><b>[ADE]<\/b><span style=\"font-weight: 400;\"> and<\/span><b> [DRUG] <\/b><span style=\"font-weight: 400;\">[8]. This prevents the model from learning the specific lexical items, and is useful for us because we want to keep discovering new relations depending on the context of the sentence and not on the tokens that make up the entity.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Usage of contextual representation is useful for RE tasks, because the identification of such relations heavily relies on the context the entities were used in. We can easily observe in the datasets that DRUG-ADE semantic relations in the sentence exist with phrases like:<\/span><\/p>\n<p><i><span style=\"font-weight: 400;\">occur .. after, induced, associated with, developed, suffered from, caused in, concluded to etc.<\/span><\/i><\/p>\n<p><span style=\"font-weight: 400;\">On the other side, we did not consider extracting relations across sentences because we decided the input sequence to be a single sentence at a time. Therefore, our model was only able to classify relations within the same sentence, and not across sentences.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">We fine-tuned two different PLMs for RE, i.e. DistilBERT and PubMedBERT. While <\/span><b>fine-tuning the DistilBERT model<\/b><span style=\"font-weight: 400;\">, we obtained comparable results for DRUG-ADE relation classification to a previously published classical model based on Support Vector Machines (SVM) [7]. However, fine-tuning the PubMedBERT model for sentence classification was not successful. Therefore, we used the fine-tuned DistilBERT model for the pipeline processing later on.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"Information-Retrieval\"><\/span><b>Information Retrieval<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Once we had the NER and RE models performing just as good as the best team\u2019s models and the pipeline processing in place, we could perform the information retrieval on biomedical literature to uncover the hidden and rare ADEs associated with COVID-19 vaccines as illustrated in Figure 8. With the search query mentioned in the below figure, we downloaded 1321 abstracts from PubMed which potentially talk about the ADEs after receiving COVID-19 vaccines. After processing the abstracts through the pipeline model, we stored the sentences, extracted named entities and the classified relations in the MongoDB. From these abstracts, we retrieved 972 DRUG entity mentions, 1407 ADE entity mentions, and 1837 sentences with DRUG-ADE relations which contain both target entities as summarised in Table 1.<\/span><\/p>\n<figure id=\"attachment_32451\" aria-describedby=\"caption-attachment-32451\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32451 size-large\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval-1024x417.png\" alt=\"chart of the process of information retrieval \" width=\"640\" height=\"261\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval-1024x417.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval-300x122.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval-768x313.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval-1536x625.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval-400x163.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval-360x147.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/information_retrieval.png 1690w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-32451\" class=\"wp-caption-text\">Figure 8: How information retrieval is performed<\/figcaption><\/figure>\n<figure id=\"attachment_32453\" aria-describedby=\"caption-attachment-32453\" style=\"width: 500px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32453\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/result_stats-1024x287.png\" alt=\"table of extracted information per class type\" width=\"500\" height=\"140\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/result_stats-1024x287.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/result_stats-300x84.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/result_stats-768x215.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/result_stats-400x112.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/result_stats-360x101.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/result_stats.png 1422w\" sizes=\"auto, (max-width: 500px) 100vw, 500px\" \/><figcaption id=\"caption-attachment-32453\" class=\"wp-caption-text\">Table 1: The statistics of extracted information per class type<\/figcaption><\/figure>\n<h3><span class=\"ez-toc-section\" id=\"Application-Development\"><\/span><b>Application Development<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Finally, we implemented an application with user interaction in two different scenarios for the interactive discovery of ADEs:<\/span><\/p>\n<ol>\n<li><span style=\"font-weight: 400;\">a user input paragraph can be processed through the pipeline and the user can visualise the entities highlighted in the paragraph together with a table of the relations,<\/span><\/li>\n<li><span style=\"font-weight: 400;\">a user can visualis<\/span><span style=\"font-weight: 400;\">e the database of already extracted information as a co-occurrence table together with its context.\u00a0<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">Figure 9 illustrates the application technology stack used to implement the ADE Discovery Browser.<\/span><\/p>\n<figure id=\"attachment_32455\" aria-describedby=\"caption-attachment-32455\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32455 size-large\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/app_stack-1024x237.png\" alt=\"graph of the technology stack for application development\" width=\"640\" height=\"148\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/app_stack-1024x237.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/app_stack-300x70.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/app_stack-768x178.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/app_stack-400x93.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/app_stack-360x83.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/app_stack.png 1518w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-32455\" class=\"wp-caption-text\">Figure 9: The technology stack for application development<\/figcaption><\/figure>\n<h3><span class=\"ez-toc-section\" id=\"Examples-of-Retrieved-Information\"><\/span><b>Examples of Retrieved Information<\/b><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">Figure 10 illustrates the first user scenario where the user can input a paragraph and visualise the predictions below having the identified entities highlighted and the relations listed on the table.<\/span><\/p>\n<figure id=\"attachment_32459\" aria-describedby=\"caption-attachment-32459\" style=\"width: 540px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32459\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/paragraph_prediction-1024x931.png\" alt=\"screenshot of website showing the ADE Discover Browser\" width=\"540\" height=\"491\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/paragraph_prediction-1024x931.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/paragraph_prediction-300x273.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/paragraph_prediction-768x698.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/paragraph_prediction-400x364.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/paragraph_prediction-360x327.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/paragraph_prediction.png 1458w\" sizes=\"auto, (max-width: 540px) 100vw, 540px\" \/><figcaption id=\"caption-attachment-32459\" class=\"wp-caption-text\">Figure 10: Paragraph prediction<\/figcaption><\/figure>\n<p><span style=\"font-weight: 400;\">Figure 11 illustrates the second user scenario and lists the extracted DRUG-ADE tuples from PubMed aggregated as a co-occurrence table. Drug and ADE column refers to the recognised drug and ADE mentions respectively. Next to that, we can see the number of literature and the number of sentences the specific tuple was used. Because the table includes over a thousand tuples, it becomes difficult to find specific information. Therefore, we added drug and ADE filters on the left side. When the \u201cSee the Sentences\u201c button is clicked for a tuple, a pop-up window will be shown to visualise the context the tuple was used as illustrated in Figure 12.\u00a0<\/span><\/p>\n<figure id=\"attachment_32461\" aria-describedby=\"caption-attachment-32461\" style=\"width: 540px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32461\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/table_vis-1024x1003.png\" alt=\"Co-occurrence table visualisation of extracted DRUG-ADE relations\" width=\"540\" height=\"529\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/table_vis-1024x1003.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/table_vis-300x294.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/table_vis-768x752.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/table_vis-400x392.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/table_vis-360x353.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/table_vis.png 1460w\" sizes=\"auto, (max-width: 540px) 100vw, 540px\" \/><figcaption id=\"caption-attachment-32461\" class=\"wp-caption-text\">Figure 11: Co-occurrence table visualisation of extracted DRUG-ADE relations<\/figcaption><\/figure>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32475 size-large alignleft\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7-1024x225.png\" alt=\"\" width=\"640\" height=\"141\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7-1024x225.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7-300x66.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7-768x168.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7-1536x337.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7-400x88.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7-360x79.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_7.png 1596w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32477 size-large alignleft\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1-1024x219.png\" alt=\"\" width=\"640\" height=\"137\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1-1024x219.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1-300x64.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1-768x165.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1-1536x329.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1-400x86.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1-360x77.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_1-1.png 1596w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-32465 alignleft\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2-1024x219.png\" alt=\"\" width=\"640\" height=\"137\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2-1024x219.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2-300x64.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2-768x165.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2-1536x329.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2-400x86.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2-360x77.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_2.png 1596w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-32479 alignleft\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1-1024x223.png\" alt=\"\" width=\"640\" height=\"139\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1-1024x223.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1-300x65.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1-768x167.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1-1536x335.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1-400x87.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1-360x78.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_3-1.png 1596w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-32469 alignleft\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4-1024x222.png\" alt=\"\" width=\"640\" height=\"139\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4-1024x222.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4-300x65.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4-768x166.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4-1536x333.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4-400x87.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4-360x78.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_4.png 1596w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"size-large wp-image-32471 alignleft\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5-1024x191.png\" alt=\"\" width=\"640\" height=\"119\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5-1024x191.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5-300x56.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5-768x143.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5-1536x287.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5-400x75.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5-360x67.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_5.png 1596w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><\/p>\n<figure id=\"attachment_32473\" aria-describedby=\"caption-attachment-32473\" style=\"width: 640px\" class=\"wp-caption aligncenter\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-32473 size-large\" src=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6-1024x219.png\" alt=\"\" width=\"640\" height=\"137\" srcset=\"https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6-1024x219.png 1024w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6-300x64.png 300w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6-768x165.png 768w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6-1536x329.png 1536w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6-400x86.png 400w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6-360x77.png 360w, https:\/\/www.inovex.de\/wp-content\/uploads\/sentence_6.png 1596w\" sizes=\"auto, (max-width: 640px) 100vw, 640px\" \/><figcaption id=\"caption-attachment-32473\" class=\"wp-caption-text\">Figure 12: Some examples for context visualisation of extracted ADEs associated with EU approved COVID-19 vaccines<\/figcaption><\/figure>\n<h2><span class=\"ez-toc-section\" id=\"Conclusion\"><\/span><b>Conclusion<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">ADE extraction using NLP techniques still did not reach its perfectly performing level due to the language variety in different domains and a lack of quality of the annotated data. Additionally, when applying machine learning in life sciences, human intervention is important to have the predictions reviewed by experts for correctness. Therefore, combining such AI based ADE extraction with a system where user interaction is possible is a good use case for this task. The <\/span><span style=\"font-weight: 400;\">idea behind the ADE Discovery Browser is therefore, to provide a user-friendly platform to the pharmacovigilance experts to scroll through the potential DRUG, ADE entities and the potential relations between them which are extracted from the PubMed. Eventually, the experts can approve or disapprove the extracted information seeing the sentence in which context the two target entities are potentially related to each other.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Considering the extracted information about the ADEs related with COVID-19 vaccines, we conclude that PLMs can be fine-tuned for ADE extraction incorporating outside and contextual knowledge to perform token and sentence classification for NER and RE respectively, and adequately be used for information retrieval from other similar domain text resources having just as good performing models as the best team, and few labeled data.\u00a0<\/span><\/p>\n<p><b>NOTE:<\/b>\u00a0This study was within the scope of M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu&#8217;s master&#8217;s thesis study at TUM under the close supervision of Dr. Robert Pesch and Sebastian Blank, and has not been used for any other purpose.<\/p>\n<h2><span class=\"ez-toc-section\" id=\"References\"><\/span><b>References<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">[1] <\/span><a href=\"https:\/\/www.nlpsummit.org\/adverse-drug-event-detection-using-spark-nlp\/\"><span style=\"font-weight: 400;\">https:\/\/www.nlpsummit.org\/adverse-drug-event-detection-using-spark-nlp\/<\/span><\/a><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">[2] Edwards, I. Ralph, and Jeffrey K. Aronson. &#8222;Adverse drug reactions: definitions, diagnosis, and management.&#8220; The lancet 356.9237 (2000): 1255-1259.<br \/>\n<\/span><span style=\"font-weight: 400;\">[3] Leape, Lucian L., et al. &#8222;The nature of adverse events in hospitalized patients: results of the Harvard Medical Practice Study II.&#8220; New England journal of medicine 324.6 (1991): 377-384.<br \/>\n<\/span><span style=\"font-weight: 400;\">[4] Bates, David W., et al. &#8222;Incidence of adverse drug events and potential adverse drug events: implications for prevention.&#8220; Jama 274.1 (1995): 29-34.<br \/>\n<\/span><span style=\"font-weight: 400;\">[5] Henry, Sam, et al. &#8222;2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records.&#8220; Journal of the American Medical Informatics Association 27.1 (2020): 3-12.<br \/>\n<\/span><span style=\"font-weight: 400;\">[6] Gurulingappa, Harsha, et al. &#8222;Development of a benchmark corpus to support the automatic extraction of drug-related adverse effects from medical case reports.&#8220; Journal of biomedical informatics 45.5 (2012): 885-892.<br \/>\n<\/span><span style=\"font-weight: 400;\">[7] Wei, Qiang, et al. &#8222;A study of deep learning approaches for medication and adverse drug event extraction from clinical text.&#8220; Journal of the American Medical Informatics Association 27.1 (2020): 13-21.<br \/>\n<\/span><span style=\"font-weight: 400;\">[8] Zhang, Yuhao, et al. &#8222;Position-aware attention and supervised data improve slot filling.&#8220; Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing. 2017.<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>This article shows the ADE Discovery Browser can\u00a0contribute to the visibility of adverse drug events (ADEs) \u2013 and thereby drug safety \u2013 by an\u00a0end-to-end qualitative text mining of ADEs\u00a0associated with a medication like the COVID-19 vaccines.<\/p>\n","protected":false},"author":263,"featured_media":33138,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"inline_featured_image":false,"ep_exclude_from_search":false,"footnotes":""},"tags":[511,575,179,206,151,407,141],"service":[76,431],"coauthors":[{"id":263,"display_name":"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu","user_nicename":"mhasanbasoglu"}],"class_list":["post-32433","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","tag-artificial-intelligence-2","tag-bert","tag-data-products","tag-data-science","tag-deep-learning","tag-e-health","tag-nlp","service-artificial-intelligence","service-data-science"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Adverse Drug Events Discovery Using Natural Language Processing - inovex GmbH<\/title>\n<meta name=\"description\" content=\"How to use end-to-end qualitative text mining for Adverse Drug Events Discovery (ADEs) associated with medication.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/\" \/>\n<meta property=\"og:locale\" content=\"de_DE\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Adverse Drug Events Discovery Using Natural Language Processing - inovex GmbH\" \/>\n<meta property=\"og:description\" content=\"How to use end-to-end qualitative text mining for Adverse Drug Events Discovery (ADEs) associated with medication.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/\" \/>\n<meta property=\"og:site_name\" content=\"inovex GmbH\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/inovexde\" \/>\n<meta property=\"article:published_time\" content=\"2021-10-25T22:05:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-06-13T05:56:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1920\" \/>\n\t<meta property=\"og:image:height\" content=\"1080\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:image\" content=\"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery-1024x576.png\" \/>\n<meta name=\"twitter:creator\" content=\"@inovexgmbh\" \/>\n<meta name=\"twitter:site\" content=\"@inovexgmbh\" \/>\n<meta name=\"twitter:label1\" content=\"Verfasst von\" \/>\n\t<meta name=\"twitter:data1\" content=\"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu\" \/>\n\t<meta name=\"twitter:label2\" content=\"Gesch\u00e4tzte Lesezeit\" \/>\n\t<meta name=\"twitter:data2\" content=\"17\u00a0Minuten\" \/>\n\t<meta name=\"twitter:label3\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data3\" content=\"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/\"},\"author\":{\"name\":\"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#\\\/schema\\\/person\\\/c22acce25e36f733cbc624cdf8c29745\"},\"headline\":\"Adverse Drug Events Discovery Using Natural Language Processing\",\"datePublished\":\"2021-10-25T22:05:39+00:00\",\"dateModified\":\"2023-06-13T05:56:41+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/\"},\"wordCount\":2998,\"commentCount\":0,\"publisher\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.inovex.de\\\/wp-content\\\/uploads\\\/adverse-drug-events-discovery.png\",\"keywords\":[\"Artificial Intelligence\",\"BERT\",\"Data Products\",\"Data Science\",\"Deep Learning\",\"e-health\",\"nlp\"],\"articleSection\":[\"Analytics\",\"English Content\",\"General\"],\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/\",\"url\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/\",\"name\":\"Adverse Drug Events Discovery Using Natural Language Processing - inovex GmbH\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.inovex.de\\\/wp-content\\\/uploads\\\/adverse-drug-events-discovery.png\",\"datePublished\":\"2021-10-25T22:05:39+00:00\",\"dateModified\":\"2023-06-13T05:56:41+00:00\",\"description\":\"How to use end-to-end qualitative text mining for Adverse Drug Events Discovery (ADEs) associated with medication.\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#breadcrumb\"},\"inLanguage\":\"de\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.inovex.de\\\/wp-content\\\/uploads\\\/adverse-drug-events-discovery.png\",\"contentUrl\":\"https:\\\/\\\/www.inovex.de\\\/wp-content\\\/uploads\\\/adverse-drug-events-discovery.png\",\"width\":1920,\"height\":1080,\"caption\":\"Red Pills on a medical journal symboliizing adverse drug effects\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/adverse-drug-events-discovery-nlp\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Adverse Drug Events Discovery Using Natural Language Processing\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#website\",\"url\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/\",\"name\":\"inovex GmbH\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"de\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#organization\",\"name\":\"inovex GmbH\",\"url\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/www.inovex.de\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/inovex-logo-16-9-1.png\",\"contentUrl\":\"https:\\\/\\\/www.inovex.de\\\/wp-content\\\/uploads\\\/2021\\\/03\\\/inovex-logo-16-9-1.png\",\"width\":1921,\"height\":1081,\"caption\":\"inovex GmbH\"},\"image\":{\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/inovexde\",\"https:\\\/\\\/x.com\\\/inovexgmbh\",\"https:\\\/\\\/www.instagram.com\\\/inovexlife\\\/\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/inovex\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UC7r66GT14hROB_RQsQBAQUQ\"]},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/#\\\/schema\\\/person\\\/c22acce25e36f733cbc624cdf8c29745\",\"name\":\"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"de\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3c116bb07dcf2da7587cf483f6a18a9c896e0f907cf21faf677d1df2819cafa2?s=96&d=retro&r=g4ab8527a0a097cfca2cac0a9738d3d36\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3c116bb07dcf2da7587cf483f6a18a9c896e0f907cf21faf677d1df2819cafa2?s=96&d=retro&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/3c116bb07dcf2da7587cf483f6a18a9c896e0f907cf21faf677d1df2819cafa2?s=96&d=retro&r=g\",\"caption\":\"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu\"},\"url\":\"https:\\\/\\\/www.inovex.de\\\/de\\\/blog\\\/author\\\/mhasanbasoglu\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Adverse Drug Events Discovery Using Natural Language Processing - inovex GmbH","description":"How to use end-to-end qualitative text mining for Adverse Drug Events Discovery (ADEs) associated with medication.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/","og_locale":"de_DE","og_type":"article","og_title":"Adverse Drug Events Discovery Using Natural Language Processing - inovex GmbH","og_description":"How to use end-to-end qualitative text mining for Adverse Drug Events Discovery (ADEs) associated with medication.","og_url":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/","og_site_name":"inovex GmbH","article_publisher":"https:\/\/www.facebook.com\/inovexde","article_published_time":"2021-10-25T22:05:39+00:00","article_modified_time":"2023-06-13T05:56:41+00:00","og_image":[{"width":1920,"height":1080,"url":"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery.png","type":"image\/png"}],"author":"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu","twitter_card":"summary_large_image","twitter_image":"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery-1024x576.png","twitter_creator":"@inovexgmbh","twitter_site":"@inovexgmbh","twitter_misc":{"Verfasst von":"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu","Gesch\u00e4tzte Lesezeit":"17\u00a0Minuten","Written by":"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#article","isPartOf":{"@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/"},"author":{"name":"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu","@id":"https:\/\/www.inovex.de\/de\/#\/schema\/person\/c22acce25e36f733cbc624cdf8c29745"},"headline":"Adverse Drug Events Discovery Using Natural Language Processing","datePublished":"2021-10-25T22:05:39+00:00","dateModified":"2023-06-13T05:56:41+00:00","mainEntityOfPage":{"@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/"},"wordCount":2998,"commentCount":0,"publisher":{"@id":"https:\/\/www.inovex.de\/de\/#organization"},"image":{"@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#primaryimage"},"thumbnailUrl":"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery.png","keywords":["Artificial Intelligence","BERT","Data Products","Data Science","Deep Learning","e-health","nlp"],"articleSection":["Analytics","English Content","General"],"inLanguage":"de","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/","url":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/","name":"Adverse Drug Events Discovery Using Natural Language Processing - inovex GmbH","isPartOf":{"@id":"https:\/\/www.inovex.de\/de\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#primaryimage"},"image":{"@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#primaryimage"},"thumbnailUrl":"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery.png","datePublished":"2021-10-25T22:05:39+00:00","dateModified":"2023-06-13T05:56:41+00:00","description":"How to use end-to-end qualitative text mining for Adverse Drug Events Discovery (ADEs) associated with medication.","breadcrumb":{"@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#breadcrumb"},"inLanguage":"de","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/"]}]},{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#primaryimage","url":"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery.png","contentUrl":"https:\/\/www.inovex.de\/wp-content\/uploads\/adverse-drug-events-discovery.png","width":1920,"height":1080,"caption":"Red Pills on a medical journal symboliizing adverse drug effects"},{"@type":"BreadcrumbList","@id":"https:\/\/www.inovex.de\/de\/blog\/adverse-drug-events-discovery-nlp\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.inovex.de\/de\/"},{"@type":"ListItem","position":2,"name":"Adverse Drug Events Discovery Using Natural Language Processing"}]},{"@type":"WebSite","@id":"https:\/\/www.inovex.de\/de\/#website","url":"https:\/\/www.inovex.de\/de\/","name":"inovex GmbH","description":"","publisher":{"@id":"https:\/\/www.inovex.de\/de\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.inovex.de\/de\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"de"},{"@type":"Organization","@id":"https:\/\/www.inovex.de\/de\/#organization","name":"inovex GmbH","url":"https:\/\/www.inovex.de\/de\/","logo":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/www.inovex.de\/de\/#\/schema\/logo\/image\/","url":"https:\/\/www.inovex.de\/wp-content\/uploads\/2021\/03\/inovex-logo-16-9-1.png","contentUrl":"https:\/\/www.inovex.de\/wp-content\/uploads\/2021\/03\/inovex-logo-16-9-1.png","width":1921,"height":1081,"caption":"inovex GmbH"},"image":{"@id":"https:\/\/www.inovex.de\/de\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/inovexde","https:\/\/x.com\/inovexgmbh","https:\/\/www.instagram.com\/inovexlife\/","https:\/\/www.linkedin.com\/company\/inovex","https:\/\/www.youtube.com\/channel\/UC7r66GT14hROB_RQsQBAQUQ"]},{"@type":"Person","@id":"https:\/\/www.inovex.de\/de\/#\/schema\/person\/c22acce25e36f733cbc624cdf8c29745","name":"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu","image":{"@type":"ImageObject","inLanguage":"de","@id":"https:\/\/secure.gravatar.com\/avatar\/3c116bb07dcf2da7587cf483f6a18a9c896e0f907cf21faf677d1df2819cafa2?s=96&d=retro&r=g4ab8527a0a097cfca2cac0a9738d3d36","url":"https:\/\/secure.gravatar.com\/avatar\/3c116bb07dcf2da7587cf483f6a18a9c896e0f907cf21faf677d1df2819cafa2?s=96&d=retro&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/3c116bb07dcf2da7587cf483f6a18a9c896e0f907cf21faf677d1df2819cafa2?s=96&d=retro&r=g","caption":"M\u00fcr\u00fcvvet Hasanba\u015fo\u011flu"},"url":"https:\/\/www.inovex.de\/de\/blog\/author\/mhasanbasoglu\/"}]}},"_links":{"self":[{"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/posts\/32433","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/users\/263"}],"replies":[{"embeddable":true,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/comments?post=32433"}],"version-history":[{"count":5,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/posts\/32433\/revisions"}],"predecessor-version":[{"id":46124,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/posts\/32433\/revisions\/46124"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/media\/33138"}],"wp:attachment":[{"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/media?parent=32433"}],"wp:term":[{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/tags?post=32433"},{"taxonomy":"service","embeddable":true,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/service?post=32433"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/www.inovex.de\/de\/wp-json\/wp\/v2\/coauthors?post=32433"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}