• AI
  • Molecular Imaging
  • CT
  • X-Ray
  • Ultrasound
  • MRI
  • Facility Management
  • Mammography

De-identification challenge spurs automatic schemes


Medical records are an important source for clinical researchers, but text records used outside the hospital must first be de-identified.

Medical records are an important source for clinical researchers, but text records used outside the hospital must first be de-identified.

Several automatic schemes to achieve de-identification recently surfaced as the result of a challenge issued by the American Medical Informatics Association (J Am Med Inform Assoc 2007;14[5]:550-580).

In one effort, researchers at the University of Szeged in Hungary developed a de-identification model that successfully removes personal health information from hospital records in conformance with the Health Insurance Portability and Accountability Act.

A machine learning-based iterative system, the solution uses a named entity recognition approach on semistructured documents. Named entity recognition (NER) is a subtask of information extraction that locates and classifies elements in text into predefined categories.

"Our named entity approach is based on a complex feature set and boosted decision trees, and it uses a different feature representation from other state-of-the-art NER systems," said Gyorgy Szarvas, Ph.D., of the university's informatics department.

Szarvas's method identifies personal health information in several steps (J Am Med Inform Assoc 2007;14[5]:574-580). First, it labels all entities whose tags can be inferred from the structure of the text, and it then uses this information to find further personal health information phrases in the flow text parts of the document. Customizing the system took only a few weeks.

"Such systems can be built quite rapidly for any institute for de-identification or other NER-like tasks," he said.

Elsewhere, researchers at Mitre (Bedford, MA), along with Harvard, Brandeis, and Stanford universities, took a different approach, focusing instead on rapid adaptation of existing toolkits for named entity recognition. They used two existing tools: Carafe and LingPipe.

The researchers report that the out-of-the-box Carafe system achieved a good score (a phrase F-measure of 0.9664) with only four hours of work to adapt it to the de-identification task. With further tuning, they were able to reduce the token-level error term by over 36% through task-specific feature engineering and the introduction of a lexicon, achieving a phrase F-measure of 0.9736.

Challenge organizer Ozlem Uzuner, Ph.D., of the University at Albany, State University of New York, said the efforts show that most private health information can be recognized with more than 98% accuracy. Whether 98% accuracy is good enough is an open question best left to policymakers, he said.

"The results are nevertheless encouraging, from a technical perspective, and show that much can be accomplished to de-identify data with the best techniques," Uzuner said.

AMIA was so encouraged, it is now in the process of organizing similar challenges on other open research questions in medical language processing.

Related Videos
Improving the Quality of Breast MRI Acquisition and Processing
Can Fiber Optic RealShape (FORS) Technology Provide a Viable Alternative to X-Rays for Aortic Procedures?
Does Initial CCTA Provide the Best Assessment of Stable Chest Pain?
Making the Case for Intravascular Ultrasound Use in Peripheral Vascular Interventions
Can Diffusion Microstructural Imaging Provide Insights into Long Covid Beyond Conventional MRI?
Assessing the Impact of Radiology Workforce Shortages in Rural Communities
Emerging MRI and PET Research Reveals Link Between Visceral Abdominal Fat and Early Signs of Alzheimer’s Disease
Reimbursement Challenges in Radiology: An Interview with Richard Heller, MD
Nina Kottler, MD, MS
The Executive Order on AI: Promising Development for Radiology or ‘HIPAA for AI’?
Related Content
© 2024 MJH Life Sciences

All rights reserved.