Skip to content
mlmentorship

Book VIII · Chapter 3

Language representations and sequence models

Follow text representation from embeddings and recurrence to bidirectional encoders and structured prediction.

Priority
Specialist
Difficulty
Intermediate
Useful for
NLP, Speech, AS, RS
Interview rounds
ML breadth, Research

Read first: Representations and architectures

Chapter contents

4 entries · read in order
  1. 01
    Word embeddings: Word2Vec, GloVe, and the geometry of meaning
    Concept
  2. 02
    LSTM and GRU: gating as Hadamard products
    Concept
  3. 03
    BERT and masked language modeling
    Concept
  4. 04
    Conditional random fields (CRFs)
    Concept