Advancing Literature Mining through Image Processing and Analysis

Yale University, New Haven CT

Investigators

Linked publications & trials

Abstract

DESCRIPTION (provided by applicant): We propose to advance biomedical literature mining by providing new technologies for searching and retrieving biomedical images. The content of these images is a good representation of the research results discussed in scientific articles, and often contains additional facts not explicitly mentioned in the article or image caption. While the inherent structure in biomedical images facilitates automated image content extraction, the extraction process can be made more accurate by concurrent processing of text and images. Text-enhanced image analysis results in richly annotated images, which open up new possibilities for locating images of interest. The specific aims are to 1) develop methods for extracting structured image content through image processing and analysis, to 2) design methods to boost accuracy of image understanding through concurrent processing of text and images, to 3) devise methods for searching across structured image content, and 4) to develop an image search tool that demonstrates the power of using structured Image content for accessing the biomedical literature.