---
title: "How fragile is the difference-in-differences boom?"
description: "Difference-in-differences is the most-mentioned method on the equation ranking, and treatment effect heterogeneity is one of the fastest-rising keywords in economics. A first check finds that about three in ten recent DiD papers with searchable full text name a heterogeneity-robust estimator. How many staggered-adoption findings would survive one?"
url: https://scholar4ai.com/ideas/how-fragile-is-the-did-boom
markdown_url: https://scholar4ai.com/ideas/how-fragile-is-the-did-boom.md
license: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/)
share_text: "How fragile is the difference-in-differences boom?: Difference-in-differences is the most-mentioned method on the equation ranking, and treatment effect heterogeneity is one of the fastest-rising keywords in economics."
date: "2026-10-23"
updated: "2026-10-23"
status: "exploring"
tags: ["economics", "finance", "methods"]
keywords: ["treatment effect heterogeneity", "staggered difference-in-differences", "difference-in-differences"]
---

# How fragile is the difference-in-differences boom?

Difference-in-differences is the most-mentioned method on the equation ranking, and treatment effect heterogeneity is one of the fastest-rising keywords in economics. A first check finds that about three in ten recent DiD papers with searchable full text name a heterogeneity-robust estimator. How many staggered-adoption findings would survive one?

## What prompted this

On the [equation ranking](/rankings/equations), [difference-in-differences](/equations/difference-in-differences) is the most-mentioned method: 148 papers in the 30 days to 2026-10-23 (72 in economics journals, 53 in finance, 14 in management, 6 in accounting). Instrumental variables (112 papers), two-way fixed effects (69) and propensity score matching (60) follow. In economics, "treatment effect heterogeneity" had 14 papers in July–September 2026 against about 4 expected from its earlier share.

Two-way fixed-effects DiD can be badly biased when a policy starts at different times for different units and its effect varies. Newer estimators fix this: Callaway and Sant'Anna, Sun and Abraham, de Chaisemartin and D'Haultfœuille, and Borusyak, Jaravel and Spiess, with the Goodman-Bacon decomposition as a diagnostic.

## First check

OpenAlex has searchable full text for 55 of the 148 DiD papers. 17 of those 55 (31%) name at least one of these estimators or the decomposition: 11 of 20 in finance, 3 of 21 in economics, 2 of 9 in management and 1 of 4 in accounting. The samples are small and most papers have no searchable full text, so this is a first signal, not a finding.

## Questions

- Re-estimated with robust estimators, how often do recent staggered-adoption results change sign, size or significance?
- Which designs are most at risk: many adoption cohorts, long panels, or effects that build up over time?
- Do studies of Chinese pilot policies, a common setting in these journals, behave differently?

## Data that could help

Replication packages where journals require them; for city pilot studies, the public city panels most of them use, such as the China City Statistical Yearbook.

## Next step

Pick 20 recent staggered DiD papers with replication data and re-estimate each one with two robust estimators.

## Related research activity

*The keywords this note follows, in the tracked finance, accounting, economics, management, operations research and AI journals as of 2026-10-26*

| Keyword | Papers, last 30 days | Rank | Papers per month, Oct 23 – Oct 26* | Papers, last 36 months |
|---|---:|---:|---|---:|
| treatment effect heterogeneity | 0 | – | 2, 4, 1, 2, 1, 3, 4, 7, 7, 4, 1, 6, 8, 3, 4, 3, 1, 4, 1, 4, 1, 6, 1, 3, 1, 2, 3, 1, 1, 5, 4, 1, 4, 6, 6, 5, 0 | 120 |
| staggered difference-in-differences | 1 | #2881 | 0, 0, 0, 0, 2, 0, 1, 1, 0, 0, 1, 2, 1, 1, 1, 0, 0, 1, 0, 1, 2, 0, 2, 1, 0, 1, 0, 0, 1, 0, 2, 2, 1, 2, 2, 0, 1 | 28 |
| difference-in-differences | 0 | – | 0, 1, 0, 0, 0, 0, 1, 0, 3, 0, 2, 1, 1, 0, 1, 0, 0, 1, 0, 1, 0, 0, 1, 1, 1, 2, 1, 0, 1, 0, 1, 1, 0, 4, 0, 1, 0 | 26 |

## Cite this page

Scholar4AI. (2026). How fragile is the difference-in-differences boom?. Journal Research Rankings. Retrieved October 23, 2026, from https://scholar4ai.com/ideas/how-fragile-is-the-did-boom

```bibtex
@misc{scholar4ai-ideas-how-fragile-is-the-did-boom,
  author = {{Scholar4AI}},
  title = {How fragile is the difference-in-differences boom?},
  year = {2026},
  howpublished = {\url{https://scholar4ai.com/ideas/how-fragile-is-the-did-boom}},
  urldate = {2026-10-23},
  note = {Journal Research Rankings; data from OpenAlex (CC0); licensed CC BY-NC 4.0}
}
```

License: CC BY-NC 4.0 (https://creativecommons.org/licenses/by-nc/4.0/).
