ECUE Advanced NLP

ECUE's code : SMENLP

This course belong to UE AIA (Artificial Intelligence and Applications) (6 ECTS) which contains 3 ECUE

Structure

EUR DS4H

Disciplinary domain

Informatique

Campus

Campus SophiaTech Les Lucioles

Course's level

Master 2

Semester

Semestre impair

Language

Anglais , Français

PRESENTATION

Automatic Natural Language Processing (NLP) is a branch of Artificial Intelligence (AI) that enables computers to understand and generate human language. NLP enables us to talk to our phones, use the web to answer questions, organize discussions in books and social media, and even translate between human languages. Because language is rich, ambiguous and very difficult for computers to understand, these systems can sometimes seem magical, but they are engineering problems that we can solve with data, mathematics and linguistic knowledge.

This course will deal generally with deep learning methods for natural language processing, with a particular focus on Large Language Models (LLMs). We will cover modeling architectures and downstream tasks such as text classification, question answering, machine translation and text generation.

Course's manager(s)

Sofiane Elguendouze

In class

12h of lectures
16h of directed studies

PREREQUISITES

Before the start of the course, I must ...

Basics in machine learning and natural language processing.

OBJECTIVES

By the end of this course, I should be able to...

1) Understand modern neural network algorithms for linguistic information processing.
2) Move from simple word representation and syntactic processing to more robust representation, as well as the implementation of complex deep learning models for a variety of NLP tasks (such as question answering, machine translation and text generation).

CONTENT

Introduction & background

No description
Neural networks & Back-propagation

No description
Recurrent Neural Networks & Encoder-Decoder

No description
Attention & Transformers

No description
Pre-training, Finetuning & LLMs

No description
Interpretability in NLP

No description

Access to complete Syllabus (Authentification required)

Important

This syllabus has no contractual value. Its content is subject to change throughout this year: be aware to the last updates