Visual Search and Detection in Natural Scenes

University Of Texas At Austin, Austin TX

Investigators

Linked publications & trials

Abstract

? DESCRIPTION (provided by applicant): An ultimate goal of vision science is to understand and predict performance under natural conditions, and there is arguably no task more ubiquitous and fundamental than visually searching the environment for objects of interest. However, little is known about search in natural scenes. Our aim is to measure, characterize, and model search performance in natural scenes in both humans and non-human primates. We will study both covert search, where the search scene is presented for a limited time and the eyes remain on a fixation target, and overt search, which involves eye movements. Our approach combines mathematical/computational analysis, psychophysical and eye-movement measurements in humans and monkeys, and voltage sensitive dye imaging (VSDI) in V1 of behaving monkeys. We argue that a rigorous understanding of visual search must begin with a characterization of the sensory factors that control the detectability of the target across the visual field in absence of any uncertainty about the location of the target. In preliminary psychophysical, neurophysiological, and computational studies we developed a model of target detectability that predicts simple detection performance in natural images. In further computational studies (based on the detection results), we discovered a biologically-plausible computation that would allow the brain to perform optimal overt search in natural scenes. Specifically, we prove that during a visual search, the optimal next fixation location is obtained from the current belief map (posterior probability map) of where the target might be located, by (i) dividing (normalizing) the map by the local image contrast, (ii) blurring this contrast-normalized map appropriately, and then (iii) selecting the peak of the blurred map as the next fixation location. The proposed studies will measure human and monkey detection and visual search performance in natural images, and will measure VSDI responses in monkeys during fixation and detection tasks. The studies will let us test and further develop our models of simple detection and covert search in natural images, and determine which components of optimal fixation search humans use when searching in natural images. They may also lead to methods for training humans to use more optimal search strategies.