Episode #93
Richard Sutton – Father of RL thinks LLMs are a dead end
Watch now (66 mins) | LLMs aren’t Bitter-Lesson-pilled
September 26, 20251h 6m7 chapters
People
What this episode covers
Watch now (66 mins) | LLMs aren’t Bitter-Lesson-pilled
Where to start
Current architectures generalize poorly out of distribution
Current architectures generalize poorly out of distribution
Start at 33:39
Will The Bitter Lesson still apply post AGI?
Will The Bitter Lesson still apply post AGI?
Start at 46:41
Do humans do imitation learning?
Do humans do imitation learning?
Start at 13:04
People and topics
People
Key takeaways
- Are LLMs a dead end?
- Do humans do imitation learning?
- The Era of Experience
- Current architectures generalize poorly out of distribution
- Surprises in the AI field