Job Description
Contexte et atouts du poste
The PhD will take place at Inria Paris in the ALMANaCH project-team and will be co-supervised by Benoît Sagot and Rachel Bawden.
The PhD contract is a 3-year contract.
Mission confiée
Context
Large Language Models (LLMs) undeniably belie past objections to the viability of artificial intelligence (AI) and deep learning as research programs (Bar-Hillel, 1960; Pierce et al., 1966; Minsky and Papert, 1969; Lighthill, 1973). This is the outcome, against all odds, of decades of persistent progress: the modelling of language based on neural nets (Bengio et al., 2000), the learning of contextual representations of textual data (Peters et al., 2018; Devlin et al., 2019), the development of neural architectures optimized for text generation (Sutskever et al., 2014; Bahdanau et al., 2015; Vaswani et al., 2017), and the training of ever-larger models on vast and heterogeneous multilin...