Using synthetic data for AI training is 'a big mistake,' says AI pioneer Rich Sutton
Rich Sutton criticized tech's reliance on synthetic data, urging real-world experiential learning.Tech giants like Google and OpenAI are going out of their way for real-world data.Sutton's Oak Lab focuses on teaching AI agents from experiences, not made-up datasets.Rich Sutton helped pioneer the technology behind today's AI boom. Now he thinks Big Tech's push to keep AI going is all wrong.On an episode of Sequoia's podcast released Tuesday, the Canadian computer scientist and Turing Award winner said that the AI industry is headed in the wrong direction because of its reliance on synthetic training data."That's just a big mistake," he said when asked about using synthetic data as a way to keep scaling large language models.
Reported by 1 outlet — Business Insider. See all sources ↓
Rich Sutton criticized tech's reliance on synthetic data, urging real-world experiential learning.Tech giants like Google and OpenAI are going out of their way for real-world data.Sutton's Oak Lab focuses on teaching AI agents from experiences, not made-up datasets.Rich Sutton helped pioneer the technology behind today's AI boom. Now he thinks Big Tech's push to keep AI going is all wrong.On an episode of Sequoia's podcast released Tuesday, the Canadian computer scientist and Turing Award winner said that the AI industry is headed in the wrong direction because of its reliance on synthetic training data."That's just a big mistake," he said when asked about using synthetic data as a way to keep scaling large language models. "Maybe it's the next big lesson."Synthetic data is information artificially produced by algorithms or AI models rather than collected from original, real-world sources. It has become increasingly attractive as AI companies scour the internet and hunt for new sources of training data.
Read the full report at Business Insider ↗
Why it matters
A world story we're tracking; its significance and source trust firm up as more outlets confirm it.
- What's the story?
- Rich Sutton criticized tech's reliance on synthetic data, urging real-world experiential learning.Tech giants like Google and OpenAI are going out of their way for real-world data.Sutton's Oak Lab focuses on teaching AI agents from experiences, not made-up datasets.Rich Sutton helped pioneer the technology behind today's AI boom. Now he thinks Big Tech's push to keep AI going is all wrong.On an episode of Sequoia's podcast released Tuesday, the Canadian computer scientist and Turing Award winner said that the AI industry is headed in the wrong direction because of its reliance on synthetic training data."That's just a big mistake," he said when asked about using synthetic data as a way to keep scaling large language models.
- How widely is it covered?
- 1 outlet, average source rating 6.0/10.
- When was it last updated?
- just now ago.
How outlets are framing the same story
Here's how each outlet is covering the story — compare their headlines and timing at a glance.
- Coverage card1 outlet1CoverageScouting report
Using synthetic data for AI training is 'a big mistake,' says AI pioneer Rich Sutton
Sources1TypeCoverageBusiness Insider