AI produces gibberish when trained on too much AI-generated data

As generative artificial intelligence (AI) models — from Open AI’s ChatGPT to Meta’s Llama and beyond — become more available, the amount of AI-generated content on the Internet is swelling. AI-generated blogs, images and other content1 are now commonplace. And although the effects of an AI-generated Internet on humans remain to be seen, a paper published this week in Nature reports that the proliferation of AI-generated content online could be devastating to the models themselves. Read the full cover story in this week’s Nature here.