Skip to main navigation Skip to search Skip to main content

StressTest: Can YOUR Speech LM Handle the Stress?

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

1 Scopus citations

Abstract

Sentence stress refers to emphasis on words within a spoken utterance to highlight or contrast an idea. It is often used to imply an underlying intention not explicitly stated. Recent speech-aware language models (SLMs) have enabled direct audio processing, allowing models to access the full richness of speech to perform audio reasoning tasks such as spoken question answering. Despite the crucial role of sentence stress in shaping meaning and intent, it remains largely overlooked in evaluation and development of SLMs. We address this gap by introducing StressTest, a benchmark designed to evaluate models’ ability to distinguish between meanings of speech based on the stress pattern. We evaluate leading SLMs, and find that despite their overall capabilities, they perform poorly on such tasks. Hence, we propose a novel data generation pipeline, and create Stress-17k, a training set that simulates change of meaning implied by stress variation. Results suggest, that our finetuned model, StresSLM, generalizes well to real recordings and notably outperforms existing SLMs on sentence stress reasoning and detection. Models, code, data, samples - https://pages.cs.huji.ac.il/adiyosslab/stresstest.

Original languageEnglish
Title of host publication64th Annual Meeting of the Association for Computational Linguistics, Findings of the Association for Computational Linguistics
Subtitle of host publicationACL 2026
EditorsMaria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
PublisherAssociation for Computational Linguistics (ACL)
Pages1264-1285
Number of pages22
ISBN (Electronic)9798891763951
StatePublished - 2026
Event64th Annual Meeting of the Association for Computational Linguistics, ACL 2026 - San Diego, United States
Duration: 2 Jul 2026 → 7 Jul 2026

Publication series

NameProceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)0736-587X

Conference

Conference64th Annual Meeting of the Association for Computational Linguistics, ACL 2026
Country/TerritoryUnited States
CitySan Diego
Period2/07/26 → 7/07/26

Bibliographical note

Publisher Copyright:
© 2026 Association for Computational Linguistics.

Fingerprint

Dive into the research topics of 'StressTest: Can YOUR Speech LM Handle the Stress?'. Together they form a unique fingerprint.

Cite this