Skip to content

Commit 7daaf19

Browse files
committed
Refactor lecture 20 into discussion-focused 'Language, thought, and other brains'
Replace applications-heavy lecture with deeply engaging discussion day centered on: - Language as lossy compression of neural states (Stephens, Zadbood, Regev) - LLMs speaking the brain's language (Goldstein, Zada) - Understanding as prediction/compression (Schrimpf, Clark, Delétang, Queloz) - What LLMs have inside vs. the grounding problem (Anthropic, LeCun) - Role-play vs. understanding (Shanahan, Farrell/Graziano) - Two competing frameworks + 6 deep discussion questions All 14 references verified via web search; 2 broken DOIs fixed. Overflow-checked via Playwright screenshots on all 19 slides. README updated with new lecture description and readings.
1 parent a92ab78 commit 7daaf19

4 files changed

Lines changed: 326 additions & 576 deletions

File tree

slides/README.md

Lines changed: 16 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -216,19 +216,23 @@ Explore concepts hands-on with our interactive web demos! Each demo runs directl
216216
- 📓 [Companion Notebook](https://colab.research.google.com/github/ContextLab/llm-course/blob/main/slides/week6/bert_variants_demo.ipynb)
217217
- 📊 [Slides PDF](https://contextlab.github.io/llm-course/slides/week6/lecture19.pdf) | 🌐 [Slides HTML](https://contextlab.github.io/llm-course/slides/week6/lecture19.html)
218218

219-
**Friday (Lecture 20):** Encoders in the Real World
220-
- Novel applications: clinical NLP, legal tech, financial NER, scientific literature
221-
- Sentence-BERT and modern retrieval: from SBERT to E5 to NV-Embed (MTEB)
222-
- BERT in Google Search, industry adoption ($7.73B NLP market)
223-
- Brain-LLM alignment: neural encoding with language model representations
224-
- Language as brain-to-brain transmission: neural coupling and lossy compression
225-
- Societal consequences: fluency, classification-as-labor, measuring harm at scale
226-
- Discussion: is language a statistical phenomenon? The next decade of encoders
227-
- Reading: [Caucheteux & King (2022)](https://doi.org/10.1038/s42003-022-03036-1) - Brain-LLM alignment
228-
- Reading: [Aw et al. (2026)](https://openreview.net/forum?id=PgIlCCNxdB) - The Mind's Transformer (ICLR 2026)
219+
**Friday (Lecture 20):** Language, Thought, and Other Brains
220+
- Encoder applications recap: industry scale, cost advantages over decoders
221+
- Brain-LLM alignment: layer-specific prediction of brain activity, Mind's Transformer
222+
- Language as wireless brain activity transmission: neural coupling (Stephens et al., 2010)
223+
- Memory transfer through narrative (Zadbood et al., 2017), LLMs bridging brains (Zada et al., 2024)
224+
- Understanding is prediction: next-word prediction mirrors the brain (Schrimpf et al., 2021)
225+
- Language modeling is compression (Delétang et al., 2024), languages optimize for compression (Gibson et al., 2019)
226+
- Does prediction equal understanding? Queloz & Beckmann (2025) vs. Fedorenko et al. (2024)
227+
- What LLMs have inside: monosemantic features (Anthropic, 2024) vs. grounding problem (LeCun, 2022)
228+
- Deep discussion: lossy channels, alignment puzzles, the prediction test, experience and simulation
229229
- Reading: [Stephens, Silbert & Hasson (2010)](https://doi.org/10.1073/pnas.1008662107) - Speaker-listener neural coupling
230-
- Reading: [Reimers & Gurevych (2019)](https://arxiv.org/abs/1908.10084) - Sentence-BERT
231-
- Reading: [Jiang et al. (2025)](https://aclanthology.org/2025.coling-main.202.pdf) - SAGED bias evaluation
230+
- Reading: [Goldstein et al. (2022)](https://doi.org/10.1038/s41593-022-01026-4) - GPT-2 predicts brain activity
231+
- Reading: [Schrimpf et al. (2021)](https://doi.org/10.1073/pnas.2105646118) - Neural architecture of language
232+
- Reading: [Delétang et al. (2024)](https://arxiv.org/abs/2309.10668) - Language modeling is compression
233+
- Reading: [Queloz & Beckmann (2025)](https://philarchive.org/rec/QUEWWC-2) - Understanding as predictive compression
234+
- Reading: [Fedorenko et al. (2024)](https://doi.org/10.1038/s41586-024-07522-w) - Language vs. thought
235+
- Reading: [Shanahan (2024)](https://doi.org/10.1145/3624724) - LLMs as role-play engines
232236
- 📓 [Companion Notebook](https://colab.research.google.com/github/ContextLab/llm-course/blob/main/slides/week6/encoder_applications_demo.ipynb)
233237
- 📊 [Slides PDF](https://contextlab.github.io/llm-course/slides/week6/lecture20.pdf) | 🌐 [Slides HTML](https://contextlab.github.io/llm-course/slides/week6/lecture20.html)
234238
---

0 commit comments

Comments
 (0)