Speech is a complex process emitting a wide range of biosignals, including, but not limited to, acoustics. These biosignals – stemming from the articulators, the articulator muscle activities, the neural pathways, or the brain itself – can be used to circumvent limitations of conventional speech processing in particular, and to gain insights into the process of speech production in general.
In my talk I will present ongoing research at the Cognitive Systems Lab (CSL), where we explore Biosignals like muscle and brain activity to facilitate human-machine as well as machine-mediated human communication. Several applications will be described such as Silent Speech Interfaces that rely on articulatory muscle movement captured by electromyography to recognize and synthesize silently produced speech, Brain-to-text interfaces that use brain activity captured by electrocorticography to recognize speech and brain computer interfaces based on near infrared spectroscopy. We hope that our research will lead to a better understanding of the neural basics of speech production and will result in alternative interfaces that offer ways to communicate silently without disturbing bystanders or compromising privacy, and may be used for rehabilitation of speech-disabled people in the future.
Tanja Schultz received her doctoral and diploma degree in Informatics from University of Karlsruhe, Germany in 2000 and 1995 respectively and successfully passed the German state examination for teachers of Mathematics, Sports, and Educational Science from Heidelberg University, in 1990.
She joined Carnegie Mellon University in Pittsburgh, Pennsylvania in 2000 and up to now holds a position as Research Professor at the Language Technologies Institute. From 2007 to 2015 she was a Full Professor at the Department of Informatics of the Karlsruhe Institute of Technology (KIT) in Germany before she accepted an offer from the University of Bremen in April 2015. Since 2007, Tanja Schultz directs the Cognitive Systems Lab, where her research activities focus on human-machine communication with a particular emphasis on multilingual speech processing and human-machine interfaces. Together with her team, she investigates the processing, recognition and interpretation of biosignals, i.e. human signals resulting from physical and mental activities, to enable human interaction with machines in a natural way.
Tanja Schultz received several awards for her work, such as the FZI award for an outstanding Ph.D. thesis (2001), the Allen Newell Medal for Research Excellence from Carnegie Mellon (2002), the ISCA best journal award for her publication on language independent acoustic modeling (2002) and on Silent Speech Interfaces (2015), the Plux Wireless award (2011) for the development of Airwriting, the Alcatel-Lucent Research Award for Technical Communication (2012), the Google Research Award and the Otto-Haxel Award (2013), as well as several best paper awards. She is the author of more than 350 articles published in books, journals, and proceedings, and is regularly invited as panelist and keynote speaker. Tanja Schultz serves as a member for numerous conference committees, as Associate Editor of IEEE Transactions (2002-2004), as an Associate Editor for ACM TALLIP (since 2013), as editorial board member of Speech Communication (since 2001), and served as board member and elected president of the International Speech Communication Association ISCA for ten years.