Representation of Visual Features in Mental Images of Complex Scenes.

Medical University Of South Carolina, Charleston SC

Investigators

Linked publications & trials

Abstract

DESCRIPTION (provided by applicant): Mental imagery is a salient part of mental awareness but very little is understood about how visual percepts are generated without retinal input, or how visual features that are known to be an important part of visual representation drive neural activity during mental imagery. Our long-term goal is to provide clinicians with the ability to objectively interpret mental images by accessing underlying neural activity. The objective of the current work is to develop a basic understanding of the similarities and differences between the representation of visual features in veridical and mental images. Our central hypothesis is that the mechanisms for representing visual features during perception are fundamentally conserved during mental imagery and that receptive fields that link activity to veridical images should predict activity evoked by mental imagery. Nonetheless, mental images are clearly distinguishable from veridical images and we consider three potential sources of difference: (1) The potential for exaggerated effects of attention on mental imagery; (2) The predominate influence of feedback connections from high-level visual areas with large receptive fields (relative to the retina) during mental imagery; (3) Differences between the neural processes of generating mental images and the physical processes that generate retinal images. Two Specific Aims are proposed that will be pursued using an innovative new approach for analyzing functional MRI signals that is based upon voxel-wise modeling of receptive fields. Under this approach, a separate predictive model is constructed for each and every voxel in the acquired volumes. The model links activity measured in a voxel directly to specific visual features, including spatial frequency, orientation, object category, and object location. The models can then be used to decode perceived or recalled scenes from measured brain activity. We expect that our contribution will be an advance in our understanding of the specific factors that determine the degree of consistency between activity during imagery and perception, as well as a significant advance in our ability to quantitatively model the high-level visual areas where activity is most consistent. This contribution will be significant because it will take us several necessary steps toward the development of imagery receptive fields-predictive receptive field models that explain how the visual features in a scene drive activity when the scene is recalled in the form of a mental image. A receptive field model for mental imagery would place within reach a decoding algorithm for objectively interpreting and even pictorially reconstructing mental images.