Submission + - Cannibal AIs Could Risk Digital 'Mad Cow Disease' Without Fresh Data (sciencealert.com) 1
schwit1 writes: A new study by researchers from Rice University and Stanford University in the US offers evidence that when AI engines are trained on synthetic, machine-made input rather than text and images made by actual people, the quality of their output starts to suffer.
The researchers are calling this effect Model Autophagy Disorder (MAD). The AI effectively consumes itself, which means there are parallels for mad cow disease – a neurological disorder in cows that are fed the infected remains of other cattle.
Without fresh, real-world data, content produced by AI declines in its level of quality, in its level of diversity, or both, the study shows. It’s a warning about a future of AI slop from these models.
“Our theoretical and empirical analyses have enabled us to extrapolate what might happen as generative models become ubiquitous and train future models in self-consuming loops,” says computer engineer Richard Baraniuk, from Rice University.
“Some ramifications are clear: without enough fresh real data, future generative models are doomed to MADness.”
The researchers are calling this effect Model Autophagy Disorder (MAD). The AI effectively consumes itself, which means there are parallels for mad cow disease – a neurological disorder in cows that are fed the infected remains of other cattle.
Without fresh, real-world data, content produced by AI declines in its level of quality, in its level of diversity, or both, the study shows. It’s a warning about a future of AI slop from these models.
“Our theoretical and empirical analyses have enabled us to extrapolate what might happen as generative models become ubiquitous and train future models in self-consuming loops,” says computer engineer Richard Baraniuk, from Rice University.
“Some ramifications are clear: without enough fresh real data, future generative models are doomed to MADness.”
