ValuesML: A new multilingual dataset for values detection in news and political manifestos

Mario Scharfbillig; Theresa Reitis-Münstermann; Nicolas Stefanovitch; Johannes Kiesel; Paula Schulze Brock; Joanne Sneddon; Emmanuel Cartier; Murat Ardag; Sharon Arieli; Ella Daniel; Henrik Dobewall; Johannes Karl; Anna Krasteva; Thomas Peter Oeschger; Georgios Petasis; Luana Russo; Antonella Seddone; Aurelia Tamo-Larrieux; Hester van Herk; Nazan Avcı; Giuliano Bobba; Pierre Chiron; Ahmet Çoymak; Maria Dagioglou; Dora Katsamori; Ingmar Leijen; Berna Öney; Ricarda Scholz-Kuhn; Emilia Zankina; Sandrine Astor; Petra Auer; Livia Aulino; Anat Bardi; Fiorella Battaglia; Constanze Beierlein; Maya Benish-Weisman; Christina Christodoulou; Patricia R. Collins; Irene Coppola; Mafalda Dâmaso; Meike Morren; Einat Elizarov; Naama Erlich; Peculiar Ezeigwe-Ephraim; Ronald Fischer; Maria Cristina Gaeta; Lucilla Gatt; Noam Gerera; Sjoukje Goldman; Frederic Gonthier; Stefanie Habermann; Mina Hristova; Demet Islambay Yapali; Luigi Izzo; Panos Kapetanakis; Reşit Kışlıoğlu; Chaya Koleva; Roberta Koleva; Joshua Lake; Mael Mesplou; Vanina Ninova; Elif Sandal Önal; Shani Oppenheim-Weller; Duygu Ozturk; Ioannis Elissaios Paparrigopoulos; Vladimir Ponizovskiy; Tim Reeskens; Maria Francesca Romano; Torven Schalk; Alina Starovolsky-Shitrit; Oscar Smallenbroek; Ömer Topuz; Christin Melanie Vauclair; Giuseppe Di Vetta; Sheng Ye

doi:10.3758/s13428-026-03092-z

ValuesML: A new multilingual dataset for values detection in news and political manifestos

Mario Scharfbillig^*
, Theresa Reitis-Münstermann
, Nicolas Stefanovitch
, Johannes Kiesel
, Paula Schulze Brock
, Joanne Sneddon
, Emmanuel Cartier
, Murat Ardag
, Sharon Arieli
, Ella Daniel
, Henrik Dobewall
, Johannes Karl
, Anna Krasteva
, Thomas Peter Oeschger
, Georgios Petasis
, Luana Russo
, Antonella Seddone
, Aurelia Tamo-Larrieux
, Hester van Herk
, Nazan Avcı

Giuliano Bobba, Pierre Chiron, Ahmet Çoymak, Maria Dagioglou, Dora Katsamori, Ingmar Leijen, Berna Öney, Ricarda Scholz-Kuhn, Emilia Zankina, Sandrine Astor, Petra Auer, Livia Aulino, Anat Bardi, Fiorella Battaglia, Constanze Beierlein, Maya Benish-Weisman, Christina Christodoulou, Patricia R. Collins, Irene Coppola, Mafalda Dâmaso, Meike Morren, Einat Elizarov, Naama Erlich, Peculiar Ezeigwe-Ephraim, Ronald Fischer, Maria Cristina Gaeta, Lucilla Gatt, Noam Gerera, Sjoukje Goldman, Frederic Gonthier, Stefanie Habermann, Mina Hristova, Demet Islambay Yapali, Luigi Izzo, Panos Kapetanakis, Reşit Kışlıoğlu, Chaya Koleva, Roberta Koleva, Joshua Lake, Mael Mesplou, Vanina Ninova, Elif Sandal Önal, Shani Oppenheim-Weller, Duygu Ozturk, Ioannis Elissaios Paparrigopoulos, Vladimir Ponizovskiy, Tim Reeskens, Maria Francesca Romano, Torven Schalk, Alina Starovolsky-Shitrit, Oscar Smallenbroek, Ömer Topuz, Christin Melanie Vauclair, Giuseppe Di Vetta, Sheng Ye

^*Corresponding author for this work

Research output: Contribution to journal › Article › peer-review

Abstract

Values are important building blocks of political ideologies and are frequently invoked in political debates. Yet, because values are abstract, understanding how they are expressed in real-world discourse, and how this varies across contexts, remains a challenge. In this paper, we introduce a large-scale, expert-annotated dataset of value expression in political text, comprising news articles and political manifestos across nine languages. The dataset is grounded in the refined theory of human values (Schwartz et al., 2012) and was developed through an iterative process of annotation guideline development, annotator training, and expert curation. Value annotations capture both the type of value expressed and its evaluative framing, distinguishing whether values are expressed as attained or constrained. The final dataset comprises 2648 texts and 74,231 sentences across nine languages. This resource enables systematic, cross-linguistic analysis of value expression in political communication and provides a benchmark for developing and evaluating computational models of value detection.

Original language	English
Article number	276
Journal	Behavior Research Methods
Volume	58
Issue number	10
DOIs	https://doi.org/10.3758/s13428-026-03092-z
State	Published - Oct 2026

Bibliographical note

Publisher Copyright:
© The European Union and the Authors 2026 2026.

Keywords

Annotation
Cross-cultural
Human values
Political discourse
Value expression

Access to Document

10.3758/s13428-026-03092-z

Cite this

Scharfbillig, M., Reitis-Münstermann, T., Stefanovitch, N., Kiesel, J., Brock, P. S., Sneddon, J., Cartier, E., Ardag, M., Arieli, S., Daniel, E., Dobewall, H., Karl, J., Krasteva, A., Oeschger, T. P., Petasis, G., Russo, L., Seddone, A., Tamo-Larrieux, A., van Herk, H., ... Ye, S. (2026). ValuesML: A new multilingual dataset for values detection in news and political manifestos. Behavior Research Methods, 58(10), Article 276. https://doi.org/10.3758/s13428-026-03092-z

@article{68717f7cc38b43eaa779d30e6e0709c8,

title = "ValuesML: A new multilingual dataset for values detection in news and political manifestos",

abstract = "Values are important building blocks of political ideologies and are frequently invoked in political debates. Yet, because values are abstract, understanding how they are expressed in real-world discourse, and how this varies across contexts, remains a challenge. In this paper, we introduce a large-scale, expert-annotated dataset of value expression in political text, comprising news articles and political manifestos across nine languages. The dataset is grounded in the refined theory of human values (Schwartz et al., 2012) and was developed through an iterative process of annotation guideline development, annotator training, and expert curation. Value annotations capture both the type of value expressed and its evaluative framing, distinguishing whether values are expressed as attained or constrained. The final dataset comprises 2648 texts and 74,231 sentences across nine languages. This resource enables systematic, cross-linguistic analysis of value expression in political communication and provides a benchmark for developing and evaluating computational models of value detection.",

keywords = "Annotation, Cross-cultural, Human values, Political discourse, Value expression",

author = "Mario Scharfbillig and Theresa Reitis-M{\"u}nstermann and Nicolas Stefanovitch and Johannes Kiesel and Brock, \{Paula Schulze\} and Joanne Sneddon and Emmanuel Cartier and Murat Ardag and Sharon Arieli and Ella Daniel and Henrik Dobewall and Johannes Karl and Anna Krasteva and Oeschger, \{Thomas Peter\} and Georgios Petasis and Luana Russo and Antonella Seddone and Aurelia Tamo-Larrieux and \{van Herk\}, Hester and Nazan Avcı and Giuliano Bobba and Pierre Chiron and Ahmet {\c C}oymak and Maria Dagioglou and Dora Katsamori and Ingmar Leijen and Berna {\"O}ney and Ricarda Scholz-Kuhn and Emilia Zankina and Sandrine Astor and Petra Auer and Livia Aulino and Anat Bardi and Fiorella Battaglia and Constanze Beierlein and Maya Benish-Weisman and Christina Christodoulou and Collins, \{Patricia R.\} and Irene Coppola and Mafalda D{\^a}maso and Meike Morren and Einat Elizarov and Naama Erlich and Peculiar Ezeigwe-Ephraim and Ronald Fischer and Gaeta, \{Maria Cristina\} and Lucilla Gatt and Noam Gerera and Sjoukje Goldman and Frederic Gonthier and Stefanie Habermann and Mina Hristova and Yapali, \{Demet Islambay\} and Luigi Izzo and Panos Kapetanakis and Re{\c s}it Kı{\c s}lıoğlu and Chaya Koleva and Roberta Koleva and Joshua Lake and Mael Mesplou and Vanina Ninova and {\"O}nal, \{Elif Sandal\} and Shani Oppenheim-Weller and Duygu Ozturk and Paparrigopoulos, \{Ioannis Elissaios\} and Vladimir Ponizovskiy and Tim Reeskens and Romano, \{Maria Francesca\} and Torven Schalk and Alina Starovolsky-Shitrit and Oscar Smallenbroek and {\"O}mer Topuz and Vauclair, \{Christin Melanie\} and \{Di Vetta\}, Giuseppe and Sheng Ye",

note = "Publisher Copyright: {\textcopyright} The European Union and the Authors 2026 2026.",

year = "2026",

month = oct,

doi = "10.3758/s13428-026-03092-z",

language = "אנגלית",

volume = "58",

journal = "Behavior Research Methods",

issn = "1554-351X",

publisher = "Springer Nature",

number = "10",

}

Scharfbillig, M, Reitis-Münstermann, T, Stefanovitch, N, Kiesel, J, Brock, PS, Sneddon, J, Cartier, E, Ardag, M, Arieli, S, Daniel, E, Dobewall, H, Karl, J, Krasteva, A, Oeschger, TP, Petasis, G, Russo, L, Seddone, A, Tamo-Larrieux, A, van Herk, H, Avcı, N, Bobba, G, Chiron, P, Çoymak, A, Dagioglou, M, Katsamori, D, Leijen, I, Öney, B, Scholz-Kuhn, R, Zankina, E, Astor, S, Auer, P, Aulino, L, Bardi, A, Battaglia, F, Beierlein, C, Benish-Weisman, M, Christodoulou, C, Collins, PR, Coppola, I, Dâmaso, M, Morren, M, Elizarov, E, Erlich, N, Ezeigwe-Ephraim, P, Fischer, R, Gaeta, MC, Gatt, L, Gerera, N, Goldman, S, Gonthier, F, Habermann, S, Hristova, M, Yapali, DI, Izzo, L, Kapetanakis, P, Kışlıoğlu, R, Koleva, C, Koleva, R, Lake, J, Mesplou, M, Ninova, V, Önal, ES, Oppenheim-Weller, S, Ozturk, D, Paparrigopoulos, IE, Ponizovskiy, V, Reeskens, T, Romano, MF, Schalk, T, Starovolsky-Shitrit, A, Smallenbroek, O, Topuz, Ö, Vauclair, CM, Di Vetta, G & Ye, S 2026, 'ValuesML: A new multilingual dataset for values detection in news and political manifestos', Behavior Research Methods, vol. 58, no. 10, 276. https://doi.org/10.3758/s13428-026-03092-z

TY - JOUR

T1 - ValuesML

T2 - A new multilingual dataset for values detection in news and political manifestos

AU - Scharfbillig, Mario

AU - Reitis-Münstermann, Theresa

AU - Stefanovitch, Nicolas

AU - Kiesel, Johannes

AU - Brock, Paula Schulze

AU - Sneddon, Joanne

AU - Cartier, Emmanuel

AU - Ardag, Murat

AU - Arieli, Sharon

AU - Daniel, Ella

AU - Dobewall, Henrik

AU - Karl, Johannes

AU - Krasteva, Anna

AU - Oeschger, Thomas Peter

AU - Petasis, Georgios

AU - Russo, Luana

AU - Seddone, Antonella

AU - Tamo-Larrieux, Aurelia

AU - van Herk, Hester

AU - Avcı, Nazan

AU - Bobba, Giuliano

AU - Chiron, Pierre

AU - Çoymak, Ahmet

AU - Dagioglou, Maria

AU - Katsamori, Dora

AU - Leijen, Ingmar

AU - Öney, Berna

AU - Scholz-Kuhn, Ricarda

AU - Zankina, Emilia

AU - Astor, Sandrine

AU - Auer, Petra

AU - Aulino, Livia

AU - Bardi, Anat

AU - Battaglia, Fiorella

AU - Beierlein, Constanze

AU - Benish-Weisman, Maya

AU - Christodoulou, Christina

AU - Collins, Patricia R.

AU - Coppola, Irene

AU - Dâmaso, Mafalda

AU - Morren, Meike

AU - Elizarov, Einat

AU - Erlich, Naama

AU - Ezeigwe-Ephraim, Peculiar

AU - Fischer, Ronald

AU - Gaeta, Maria Cristina

AU - Gatt, Lucilla

AU - Gerera, Noam

AU - Goldman, Sjoukje

AU - Gonthier, Frederic

AU - Habermann, Stefanie

AU - Hristova, Mina

AU - Yapali, Demet Islambay

AU - Izzo, Luigi

AU - Kapetanakis, Panos

AU - Kışlıoğlu, Reşit

AU - Koleva, Chaya

AU - Koleva, Roberta

AU - Lake, Joshua

AU - Mesplou, Mael

AU - Ninova, Vanina

AU - Önal, Elif Sandal

AU - Oppenheim-Weller, Shani

AU - Ozturk, Duygu

AU - Paparrigopoulos, Ioannis Elissaios

AU - Ponizovskiy, Vladimir

AU - Reeskens, Tim

AU - Romano, Maria Francesca

AU - Schalk, Torven

AU - Starovolsky-Shitrit, Alina

AU - Smallenbroek, Oscar

AU - Topuz, Ömer

AU - Vauclair, Christin Melanie

AU - Di Vetta, Giuseppe

AU - Ye, Sheng

PY - 2026/10

Y1 - 2026/10

N2 - Values are important building blocks of political ideologies and are frequently invoked in political debates. Yet, because values are abstract, understanding how they are expressed in real-world discourse, and how this varies across contexts, remains a challenge. In this paper, we introduce a large-scale, expert-annotated dataset of value expression in political text, comprising news articles and political manifestos across nine languages. The dataset is grounded in the refined theory of human values (Schwartz et al., 2012) and was developed through an iterative process of annotation guideline development, annotator training, and expert curation. Value annotations capture both the type of value expressed and its evaluative framing, distinguishing whether values are expressed as attained or constrained. The final dataset comprises 2648 texts and 74,231 sentences across nine languages. This resource enables systematic, cross-linguistic analysis of value expression in political communication and provides a benchmark for developing and evaluating computational models of value detection.

AB - Values are important building blocks of political ideologies and are frequently invoked in political debates. Yet, because values are abstract, understanding how they are expressed in real-world discourse, and how this varies across contexts, remains a challenge. In this paper, we introduce a large-scale, expert-annotated dataset of value expression in political text, comprising news articles and political manifestos across nine languages. The dataset is grounded in the refined theory of human values (Schwartz et al., 2012) and was developed through an iterative process of annotation guideline development, annotator training, and expert curation. Value annotations capture both the type of value expressed and its evaluative framing, distinguishing whether values are expressed as attained or constrained. The final dataset comprises 2648 texts and 74,231 sentences across nine languages. This resource enables systematic, cross-linguistic analysis of value expression in political communication and provides a benchmark for developing and evaluating computational models of value detection.

KW - Annotation

KW - Cross-cultural

KW - Human values

KW - Political discourse

KW - Value expression

UR - https://www.scopus.com/pages/publications/105047962398

U2 - 10.3758/s13428-026-03092-z

DO - 10.3758/s13428-026-03092-z

M3 - ???researchoutput.researchoutputtypes.contributiontojournal.article???

C2 - 42625026

AN - SCOPUS:105047962398

SN - 1554-351X

VL - 58

JO - Behavior Research Methods

JF - Behavior Research Methods

IS - 10

M1 - 276

ER -

ValuesML: A new multilingual dataset for values detection in news and political manifestos

Abstract

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this