A novel hybrid approach to automated negation detection in clinical radiology reports.

Full Abstract

OBJECTIVE:
Negation is common in clinical documents and is an important source of poor precision in automated indexing systems. Previous research has shown that negated terms may be difficult to identify if the words implying negations (negation signals) are more than a few words away from them. We describe a novel hybrid approach, combining regular expression matching with grammatical parsing, to address the above limitation in automatically detecting negations in clinical radiology reports.

DESIGN:
Negations are classified based upon the syntactical categories of negation signals, and negation patterns, using regular expression matching. Negated terms are then located in parse trees using corresponding negation grammar.

MEASUREMENTS:
A classification of negations and their corresponding syntactical and lexical patterns were developed through manual inspection of 30 radiology reports and validated on a set of 470 radiology reports. Another 120 radiology reports were randomly selected as the test set on which a modified Delphi design was used by four physicians to construct the gold standard.

RESULTS:
In the test set of 120 reports, there were a total of 2,976 noun phrases, of which 287 were correctly identified as negated (true positives), along with 23 undetected true negations (false negatives) and 4 mistaken negations (false positives). The hybrid approach identified negated phrases with sensitivity of 92.6% (95% CI 90.9-93.4%), positive predictive value of 98.6% (95% CI 96.9-99.4%), and specificity of 99.87% (95% CI 99.7-99.9%).

CONCLUSION:
This novel hybrid approach can accurately locate negated concepts in clinical radiology reports not only when in close proximity to, but also at a distance from, negation signals.

Learn Faster Today Improve your study skills

Author information

Author/s: Huang, Yang (Y); Lowe, Henry J (HJ);

Affiliation: Stanford Medical Informatics, Stanford, CA 94305-5479, USA. huangy(-atsign-)stanford.edu

Journal and publication information

Publication Type: Journal Article

Journal: Journal of the American Medical Informatics Association : JAMIA (J Am Med Inform Assoc), published in United States. (Language: eng)

Reference: -2007 May-Jun; vol 14 (issue 3) : pp 304-11

Dates: Created 2007/05/04; Completed 2007/06/12; Revised 2008/11/20;

PMID: 17329723, status: MEDLINE (last retrieval date: 12/26/2008)

Sourced from the National Library of Medicine. Abstract text and other information may be subject to copyright.

External Links for this article (including full text providers, if available):

Click Electronic Full-text Provider Links to see options for finding the electronic full text links to this article. Note there may be a subscription or fee required for access to the full text. See our FAQ for information on finding FREE full text articles.

This article may also be located in paper journal collections available in many libraries. Use the Journal and Publication Information above to find the full article.

MeSH headings (categories)

This article was linked to the MESH Headings shown below.

Abstracting and Indexing as Topic - methods
Automatic Data Processing
Delphi Technique
Humans

These are the highest related articles currently in the database:

Paying for transcription: not very professional. 28 Feb 2008
Reliable personal health records. 30 Dec 2007
Collection of cancer stage data by classifying free-text medical reports. 19 Aug 2007
Cooperative learning as applied to resident instruction in radiology reporting. 29 Nov 2007
Organisational factors affecting the quality of hospital clinical coding. 30 Dec 2007
A practical approach for inexpensive searches of radiology report databases. 30 May 2007
Why poor quality of ethnicity data should not preclude its use for identifying disparities in health and healthcare. 30 May 2007
The reliability of the frequency-volume chart in assessing lower urinary tract symptoms. 29 Jun 2007
ICD-9 CM code 333.1 as an identifier of patients with essential tremor: a study of the positive predictive value of this code. 17 Jun 2007
KMR: a clinical audit. 29 Jun 2007

See 100+ related articles.