---
title: "Model collapse and the data that is left (research idea)"
description: "Synthetic data generation appears on 77 recent papers and synthetic data on 18, almost all in AI journals, while model collapse, the degradation of models trained on their predecessors' output, appears on 3. The web is filling with generated text and images that will train the next models. How fast does quality decay, and what does that do to the value of human data?"
url: https://scholar4ai.com/ideas/model-collapse-and-synthetic-data
markdown_url: https://scholar4ai.com/ideas/model-collapse-and-synthetic-data.md
license: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/)
share_text: "Synthetic data generation appears on 77 recent papers and synthetic data on 18, almost all in AI journals, while model collapse, the degradation of models trained on their predecessors' output, appears on 3."
date: "2026-10-23"
updated: "2026-10-23"
status: "seed"
tags: ["ai", "data", "methods"]
keywords: ["model collapse", "synthetic data", "data quality"]
---

# Model collapse and the data that is left

Synthetic data generation appears on 77 recent papers and synthetic data on 18, almost all in AI journals, while model collapse, the degradation of models trained on their predecessors' output, appears on 3. The web is filling with generated text and images that will train the next models. How fast does quality decay, and what does that do to the value of human data?

## What prompted this

Since October 2025, 117 papers carry a synthetic-data, model-collapse, self-consuming or recursive-training keyword (111 in AI journals): "synthetic data generation" on 77, "synthetic data" on 18, "synthetic data augmentation" on 10, "model collapse" on 3. Eleven of the 117 also carry a collapse, degradation, recursive, distribution-shift or contamination keyword, and "data quality" appears on 30 papers in the archive.

## Questions

- When models are trained on mixtures of human and generated data at the shares now seen on the web, how fast do rare patterns and tails disappear, and does filtering by quality stop it?
- Does the decay differ for text, images and tabular data used in finance and economics?
- If human-written data becomes scarce, what is it worth, and who owns the archives that have it?

## Data that could help

Web crawl samples by year with AI-text detection, controlled training runs on mixed data, and licensing deals for data archives.

## Next step

Train a small model on successive generations of mixed human and generated data at web-realistic shares and measure the loss of tail vocabulary and rare facts per generation.

## Related research activity

*The keywords this note follows, in the tracked finance, accounting, economics, management, operations research and AI journals as of 2026-10-26*

| Keyword | Papers, last 30 days | Rank | Papers per month, Oct 23 – Oct 26* | Papers, last 36 months |
|---|---:|---:|---|---:|
| model collapse | 0 | – | 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 1, 2, 0, 0, 0, 0, 1, 0, 1, 0, 0, 1, 0, 1, 0, 0, 0, 1, 1, 0, 0, 0, 0, 0, 1, 0, 0 | 11 |
| synthetic data | 1 | #2881 | 1, 3, 2, 2, 1, 1, 1, 3, 0, 1, 3, 0, 0, 2, 2, 0, 2, 2, 2, 1, 3, 3, 1, 4, 0, 0, 3, 2, 2, 3, 3, 5, 2, 3, 1, 1, 1 | 65 |
| data quality | 0 | – | 3, 2, 1, 3, 3, 0, 3, 3, 3, 2, 4, 4, 2, 1, 2, 5, 2, 4, 3, 4, 5, 3, 3, 2, 3, 1, 2, 8, 3, 9, 3, 5, 2, 6, 0, 5, 0 | 114 |

## Cite this page

Scholar4AI. (2026). Model collapse and the data that is left. Journal Research Rankings. Retrieved October 23, 2026, from https://scholar4ai.com/ideas/model-collapse-and-synthetic-data

```bibtex
@misc{scholar4ai-ideas-model-collapse-and-synthetic-data,
  author = {{Scholar4AI}},
  title = {Model collapse and the data that is left},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/ideas/model-collapse-and-synthetic-data}},
  urldate = {2026-10-23},
  note = {Journal Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}
```

License: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).