Topic · Tasks

Language models

Everything on this site about language models, in the order to read it: a page is listed after the pages it builds on. The figures below are the ones those pages use to explain it; each is live: move a slider and it recomputes.

In reading order

1. 1Text2SQL — Part 1: Introduction
   Read
2. 2Text2SQL — Part 3: Baseline Models
   Read · read first: Text2SQL — Part 2: Datasets
3. 3Text2SQL — Part 4: State-Of-The-Art Models
   Read
4. 4Text2SQL — Part 5: Final Insights
   Read
5. 5Facebook AI TransCoder
   Paper · read first: Attention Is All You Need — The Transformer, Block by Block
6. 6Is ALBERT short for BERT?
   Paper · read first: Attention Is All You Need — The Transformer, Block by Block
7. 7OpenAI’s GPT — Part 1: Unveiling the GPT Model
   Paper · read first: Attention Is All You Need — The Transformer, Block by Block

Tags that go with it

Natural language 7Transformers 4Developer tools 1