Quantification of facial expressions for neuropsychiatry

University Of Pennsylvania, Philadelphia PA

Investigators

Linked publications & trials

Abstract

[unreadable] DESCRIPTION (provided by applicant): The main goal of this project is to develop methods for quantification of facial expressions. Facial expression analysis is being increasingly used in clinical investigations of neuropsychiatric disorders including affective disorders and schizophrenia, which cause deficits in the perception and expression of emotion. However, clinicians still rely on methods of expression rating that are manual, largely qualitative and typically of low reproducibility. This project seeks to develop objective and automated tools, which will significantly augment current capabilities for reliable clinical diagnosis and follow-up. The proposed tools perform a morphometric analysis of fine-grained structural deformations of the face during an expression change. Faces will be represented using deformable models, as a complex combination of elastic regions that deform (expand and contract) as the expression changes. The deformation between two faces with different expressions will be estimated through a high-dimensional shape transformation that will be used to define the quantification measure, using the neutral expression or a standardized template as reference units, depending on the study design. In video sequences, the shape transformation between subsequent frames will be temporally propagated, thereby combining the spatial and temporal information. These methods will be validated against clinically accepted scales of expression rating, in terms of their ability to replicate clinically established results, with emphasis on quantifying difference in expressions between patients with affective disorders and healthy controls. It is expected that upon completion of the project, an integrated collection of expression quantification tools will be provided to clinicians, which will improve diagnostic accuracy in affect-related disorders and provide quantification measures beyond the scope of currently existing clinical techniques. These tools are expected to provide neuropsychiatrists the ability to quantify the degree of impairment in affect expression, quantitatively assess response to medication, obtain behavioral predictors of violence and aggression and find endophenotypic markers in children, adolescents, and family members of patients, which could potentially predict the future onset of the disorder. The long-term goal of the project is to provide methods for expression quantification that are reliable, objective, reproducible and easily usable by clinicians and that will significantly influence the procedures used for accurately diagnosing clinical conditions that cause deficits in emotional expressiveness, such as schizophrenia, affective disorders, Parkinson's disease and senile dementias. [unreadable] [unreadable]