Ilya co-founded OpenAI and was one of the key minds behind GPT. In 2024, he left OpenAI to start Safe Superintelligence Inc — a company focused on building safe superintelligence with safety at its core
Here are the main points he talked about:
1. Models today can crush benchmarks, ace IQ tests, and solve olympiad-level problems. But they struggle with real-world tasks. The current training approach has hit a ceiling.
2. The "throw more compute at it" formula is exhausted.
What matters now isn't adding more power — it's discovering new training methods. We have enough compute, but it's not delivering the exponential gains we used to see. The focus is shifting to new algorithms and research with existing models.
3. The difference between a model and a human? Humans learn fast from tiny amounts of data. We literally build our worldview from fragments of information and self-correct along the way. AI needs to consume entire knowledge bases and still struggles with context. Bottom line: humans are way more efficient learners right now.
4. Interesting take on AGI: it's not a model that knows everything. It's a model that knows how to learn. When that happens, progress will accelerate dramatically. Why? Millions of AI workers learning like humans, but faster. That's going to shake up the job market hard.
5. AI can't verify its own actions yet. Humans have emotions, intuition, that gut feeling when something's off — it's a feedback system. AI just executes functions. Without this mechanism, it's unreliable.
6. Big models will be rolled out gradually so society can adapt. Just like GPT existed and functioned for 3 years before being shown to the public.
The overall picture? We're not racing toward one massive Skynet. Instead, we're heading toward specialized AIs, each mastering its own domain. Once we crack that, we'll clone millions of copies — and that's when the real shift begins. Some roles will vanish, others will survive.
So what should we do? Learn to work with these tools, not against them. And double down on the skills that can't be automated
watch interview
