Word Embeddings & Neural NLP
A 14-module path through word embeddings & neural nlp, in study order from foundations to the frontier.
Modules
- Distributional Semantics
- Word Embeddings and Dense Vectors
- Word2Vec Skip-gram
- Continuous Bag-of-Words (CBOW)
- Negative Sampling and Training Word2Vec
- GloVe
- Embedding Geometry and Analogies
- Recurrent Models for NLP
- Sequence-to-Sequence Models
- The Encoder-Decoder Architecture
- Attention Mechanism in NLP
- Neural Machine Translation
- Subword Tokenization and Byte-Pair Encoding
- Contextual Embeddings and ELMo