Episode #64
John Schulman (OpenAI Cofounder) — Reasoning, RLHF, & plan for 2027 AGI
Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come...
May 15, 20241h 35m7 chapters
What this episode covers
Chatted with John Schulman (cofounded OpenAI and led ChatGPT creation) on how posttraining tames the shoggoth, and the nature of the progress to come...
Where to start
People and topics
Key takeaways
- Pre-training, post-training, and future capabilities
- Plan for AGI 2025
- Teaching models to reason
- The Road to ChatGPT
- What makes for a good RL researcher?