What managers' voices reveal in earnings calls
Earnings calls are a staple of finance and accounting research, read almost always as transcripts. In the AI journals, multimodal fusion is one of the biggest topics. Do voice and video carry information about firms that the words miss?
What prompted this#
Since October 2025, 50 papers in the archive carry an earnings-call keyword (20 in finance journals, 17 in accounting). None of them carries a multimodal, audio, voice, video or facial keyword. Meanwhile "multimodal fusion" appears on 502 papers, 495 of them in AI journals, and is the 11th most frequent keyword of the last 30 days. Earnings call transcripts are also among the most-mentioned data sources in finance on the dataset ranking.
Questions#
- Do executives' vocal cues (pitch, pauses, speech rate) predict earnings surprises, restatements or crash risk beyond what they say?
- Does the market price these cues during the call, or only later?
- Do managers learn to control them once analysts and machines listen?
Data that could help#
- Call recordings, which many firms post on their investor-relations sites, with timestamped transcripts.
- Speech-emotion models pretrained on public corpora such as IEMOCAP or RAVDESS, and intraday prices.
- A text-only baseline such as the Loughran-McDonald tone measure.
Voice analysis touches on privacy, so the study should use public recordings and report firm-level results only.
Next step#
Collect audio for one quarter of S&P 500 calls and test whether a pretrained speech-emotion score adds anything to a text-only tone measure.