Chapter 2: Working with Text Data

 

Main Chapter Code

• 01_main-chapter-code contains the main chapter code and exercise solutions

 

Bonus Materials

• 02_bonus_bytepair-encoder contains optional code to benchmark different byte pair encoder implementations

• 03_bonus_embedding-vs-matmul contains optional (bonus) code to explain that embedding layers and fully connected layers applied to one-hot encoded vectors are equivalent.

• 04_bonus_dataloader-intuition contains optional (bonus) code to explain the data loader more intuitively with simple numbers rather than text.