Playlist - https://youtube.com/playlist?list=PLMULAM6iDn0-bSMckVXRV7uZ4gKNBN9ad&si=LdBW01l6hN9vpAMF

Source Code used in the course:

https://github.com/misrapk/LLM-FROM-SCRATCH---YT

<aside> 💡

Prerequisite

  1. NLP - https://www.youtube.com/playlist?list=PLMULAM6iDn08tb_IYCagR7OxQ5QaIdV_x
  2. PyTorch - https://www.youtube.com/playlist?list=PLMULAM6iDn0_966DLPOxmRIiGWGuJey47
  3. Python-
    1. https://www.youtube.com/playlist?list=PLMULAM6iDn09M0VLFOg62MWewnqtHlCbO
    2. https://youtu.be/kAQloJ_7KLI?si=F3t5F8lgDLwd6_b6
  4. Machine Learning -
    1. https://youtu.be/ctz7VwQ82og?si=KG-bt8OvbZIOSmcQ
    2. https://youtu.be/GC1cZx-_eiA?si=fFQ7zYiFSbflgn-L </aside>

Day 1 and Day 2

Day 3 - Text into tokens and TokenIDs

DAY 4 - BPE Byte Pair ENcoding

Day 5 - Sliding Window for DataSet and DataLoad