Missions

The recruited candidate will carry out research and development activities aimed at improving the performance of the multimodal conversational AI developed within the Theradia project (https://www.theradia.fr). Their role will be to evaluate (and, if necessary, adapt) this AI to the context of pathological speech, in order to better address the target population of the Theradia project. The expected work will be structured around the activities described in the following paragraph.

Activités

• Evaluation of the robustness of the vocal conversational AI developed within the Theradia project to pathological speech, using openly accessible datasets.
• Implementation of a mechanism enabling the speech synthesis system to adapt to potential cognitive impairments of the user (e.g., reduced speech rate, hyperarticulation, reinforcement of prosodic cues).
• Implementation of a pathological speech enhancement system in order to improve the performance of the conversational AI's speech recognition module.
The developed source code shall be archived in a GIT repository, and the results of the simulations shall be documented in a technical report.

Compétences

• Proficiency in Python, PyTorch, and torchaudio/librosa libraries, as well as in a Linux/GIT environment.
• Good knowledge of deep learning and self-supervised audio encoders (e.g., HuBERT, Wav2Vec, etc.).
• Basic knowledge in linguistics is a plus (but not mandatory).
• Proficiency in English (minimum B2 level).
• Ability to work effectively as part of a team.

Contexte de travail

.The Gipsa-lab is a joint research laboratory of the CNRS, Grenoble-INP -UGA and the University of Grenoble Alpes. It is under agreement with Inria and the Observatory of Sciences of the Universe of Grenoble. He conducts theoretical and applied research on AUTOMATICS, SIGNAL, IMAGES, SPEECH, COGNITION, ROBOTICS and LEARNING.
Multidisciplinary and at the interface between the human, the physical and digital worlds, our research is confronted with measurements, data, observations from physical, physiological and cognitive systems. They focus on the design of methodologies and algorithms for processing and extracting information, decisions, actions and communications that are viable, efficient and compatible with physical and human reality. Our work is based on mathematical and computer theories for the development of models and algorithms, validated by hardware and software implementations.
By relying on its platforms and partnerships, Gipsa-lab maintains a constant link with applications in a wide variety of fields: health, environment, energy, geophysics, embedded systems, mechatronics, processes and industrial systems, telecommunications, networks, transport and vehicles, operational safety and security, human-computer interaction, linguistic engineering, physiology and biomechanics, etc.
Due to the nature of its research, Gipsa-lab is in direct and constant contact with the economic environment and society.
Its potential as teacher-researchers and researchers is invested in training at the level of universities and engineering schools on the Grenoble site (Grenoble Alpes University).
Gipsa-lab develops its research through 16 teams or themes organized into 4 divisions:
• Automatic and Diagnosis (PAD)
• Data Science (PSD)
• Speech and Cognition (PPC)
• Geometries, Learning, Information and Algorithms (GAIA).
The staff supporting research (38 engineers and technicians) is distributed in the common services distributed within 2 divisions:
• The Administrative and Financial Pole
• The Technical Pole
Gipsa-lab has around 150 permanent staff, including 70 teacher-researchers and 41 researchers. It also welcomes guest researchers and post-docs.
Gipsa-lab supervises nearly 150 theses, including around 50 new ones each year. All the theses carried out in the laboratory are financed and supervised by teacher-researchers and researchers, including 50 holders of an HDR.
Finally, around sixty Master's trainees come each spring to swell the ranks of the laboratory.

Le poste se situe dans un secteur relevant de la protection du potentiel scientifique et technique (PPST), et nécessite donc, conformément à la réglementation, que votre arrivée soit autorisée par l'autorité compétente du MESR.

Contraintes et risques

NR