Cours "Traitement automatique du langage naturel"

Content

1. Neural Networks
   • Neuron
     • Structure
     • Activation functions
   • Feed Forward
     • Architecture
     • Input layer
     • Hidden layers
     • Output layer
   • Training
     • Cost functions
     • Optimization functions
     • Back-propagation
2. Auto-encoders
   • Definition
   • Denoising auto-encoder
   • Sparse auto-encoder
   • Variational auto-encoder
3. Convolutional neural networks
   • Traditional image processing
   • Convolitional layers
   • Pooling layers
4. Recurrent neural networks
   • Architecture
   • Long Short-Term Memory (LSTM)
   • Gated Recurrent Unit (GRU)
5. Attention
   • Sequence to sequence
   • Attention mechanism
   • Transformers
6. Generative Adversarial Networks
   • Architecture
   • GAN variants
   • GAN applications

Licence

Copyright (C) 2021 Abdelkrime Aries

Attribution 4.0 International (CC BY 4.0)

https://creativecommons.org/licenses/by/4.0/