Skip to content

Commit ffc8706

Browse files
committed
feat: update readme
1 parent eb030e3 commit ffc8706

1 file changed

Lines changed: 2 additions & 1 deletion

File tree

README.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -43,14 +43,15 @@ Each module is a standalone notebook packed with explanations, exercises, and im
4343
| 11 | Appendix: Position Embeddings | [11-appendix-position-embeddings.ipynb](https://shreshthtuli.github.io/llms-from-scratch/11-appendix-position-embeddings.html) |
4444
| 12 | Appendix: Quantisation Strategies | [12-appendix-quantisation.ipynb](https://shreshthtuli.github.io/llms-from-scratch/12-appendix-quantisation.html) |
4545
| 13 | Appendix: Parameter-Efficient Tuning | [13-appendix-peft.ipynb](https://shreshthtuli.github.io/llms-from-scratch/13-appendix-peft.html) |
46-
46+
| 14 | Bonus: Energy Based and Diffusion LLMs | [14-bonus-diffusion-llms.ipynb](https://shreshthtuli.github.io/llms-from-scratch/14-bonus-diffusion-llms.html) |
4747

4848
## 🧠 What You'll Learn
4949
- The end-to-end data flow of an LLM—from tokenization and batching to inference-time decoding.
5050
- How to implement core transformer components, attention variations, and optimization tricks.
5151
- Strategies for scaling datasets, managing checkpoints, and monitoring training stability.
5252
- Practical alignment techniques: SFT, preference modeling, RLHF, and reward modeling.
5353
- Deployment-ready compression: pruning, distillation, quantization, and PEFT recipes.
54+
- Bonus section on Energy based models (EBMs) and Diffusion LLMs.
5455

5556

5657
## ⚙️ Quick Start

0 commit comments

Comments
 (0)