- Word Embeddings
- Sentence Embeddings
- Transfer Learning
- Classification
- Clustering
- Dialog Management
- Dimensionality Reduction
- Generative Models
- Grammatical Error Correction
- Information Retrieval
- Intent Detection
- Keyword Extraction
- NLP Conversations
- Question Answering
- Summarization
- Speech Recognition
- Methods to compress large pre-trained models: https://blog.rasa.com/compressing-bert-for-faster-prediction-2/
- Compressing BERT with knowledge distillation: https://medium.com/huggingface/distilbert-8cf3380435b5