CAREER: Extraction and Integration of Voice Source Features into the Acoustical Analysis of Spoken Affect

Georgia Tech Research Corporation, Atlanta GA

Investigators

Abstract

This CAREER project is focused on voice source extraction directly from recorded speech signals for the enhancement of acoustical models in speaker affect analysis. The project has four primary research goals. The first goal is the creation of new techniques in voice source estimation from the acoustic speech signal without the use of auxiliary devices (e.g., EGG's). This is accomplished through the development of metrics for assessing glottal quality and choosing estimates that reflect the best approximation of the voice source given the available speech data. A second goal is the automated parameterization of the voice source in both the time and frequency domain allowing the shape and characteristics of the voice source to be quantified for analysis. The third goal is to integrate the parameterized voice source into an acoustical framework for describing the characteristics of a speaker's affective/emotional state. Current databases consisting of representations of speaker emotion, deception, and stress are under analysis for the incorporation of voice source features not previously available. The final goal of the project is the creation and dissemination of a robust set of extraction and analysis tools of the voice source to the scientific community to encourage and enable the analysis of voice source parameters in all forms of speech research. The project contributes greatly to speech analysis applications by enhancing the theoretical knowledge of assessing the quality of voice source estimates and providing the tools to enhance the acoustical models of the voice. Additionally, the project allows for the design of educational demonstrations for outreach activities focused on improving community exposure to science and engineering research and increasing the participation of underrepresented groups.