-
Improving low-resource ASR using bilingual fine-tuning with language identification: A cross-linguistic evaluation
Amooie, R., Hao, Y., de Vries, W., Dijkstra, J., Coler, M. & Wieling, M. · SPEAKABLE Workshop @ LREC 2026, 132–138
2026Conference paperLow-resource speech
-
What makes synthetic speech sound sarcastic? A prosody-controlled perception study
Li, Z., Nayak, S. & Coler, M. · Interspeech 2026, Sydney
2026Conference paperMultimodal AI
-
Modeling sarcastic speech: Semantic and prosodic cues in a speech synthesis framework
Li, Z., Zhang, Y., Gao, X., Nayak, S. & Coler, M. · Proceedings of the Annual Meeting of the Cognitive Science Society, 48 (CogSci 2026, Rio de Janeiro)
2026Conference paperMultimodal AI
-
AMuSeD: An attentive deep neural network for multimodal sarcasm detection incorporating bimodal data augmentation
Gao, X., Bansal, S., Gowda, K., Li, Z., Nayak, S., Kumar, N. & Coler, M. · IEEE Transactions on Affective Computing, 17(1), 900–912
2026Journal articleMultimodal AI
-
SarcasmMiner: A dual-track post-training framework for robust audio-visual sarcasm reasoning
Li, Z., Chen, Y., Lai, H., Gao, X., Nayak, S. & Coler, M. · arXiv:2603.05275
2026PreprintMultimodal AI
-
A neural model for CDST: Resonance, attunement, and prosodic transfer in L2 development
Harding, E. & Coler, M. · Dutch Journal of Applied Linguistics, 15
2026Journal articleProsody
-
Investigating musical pitch as a cue for resolving prosodic stress ambiguity in artificial speech: Evidence from Dutch and Chinese listeners
Kargakis, A., Harding, E., Coler, M. & Lowie, W. · PsyArXiv preprint
2026PreprintProsody
-
Precision-weighting across domains: A predictive coding framework for language-music integration under uncertainty
Kargakis, A., Harding, E., Coler, M. & Lowie, W. · PsyArXiv preprint
2026PreprintProsody
-
MCSD 1.0: Multimodal Chinese Sarcasm Dataset
Gao, X., Wang, B.X., Zhang, M., Huang, S., Li, Z., Nayak, S. & Coler, M. · DataverseNL, version 1.0 (CC BY-NC 4.0). Introduced in Gao et al., Interspeech 2025
2025DatasetMultimodal AI
-
Evaluating multimodal large language models on spoken sarcasm understanding
Li, Z., Gao, X., Zhang, Y., Nayak, S. & Coler, M. · arXiv:2509.15476
2025PreprintMultimodal AI
-
The Blizzard Challenge 2025
Do, P., Coler, M., Dijkstra, J., Marchenko, I., Verkhodanova, V. & Le Maguer, S. · Proceedings of the Blizzard Challenge 2025
2025Conference paperLow-resource speech
-
Enhancing standard and dialectal Frisian ASR: Multilingual fine-tuning and language identification for improved low-resource performance
Amooie, R., de Vries, W., Hao, Y., Dijkstra, J., Coler, M. & Wieling, M. · ICASSP 2025
2025Conference paperLow-resource speech
-
A multimodal Chinese dataset for cross-lingual sarcasm detection
Gao, X., Wang, B.X., Zhang, M., Huang, S., Li, Z., Nayak, S. & Coler, M. · Interspeech 2025, 3968–3972
2025Conference paperMultimodal AI
-
Intra-modal relation and emotional incongruity learning using graph attention networks for multimodal sarcasm detection
Raghuvanshi, D., Gao, X., Li, Z., Bansal, S., Coler, M., Kumar, N. & Nayak, S. · ICASSP 2025
2025Conference paperMultimodal AI
-
Integrating feedback loss from bi-modal sarcasm detector for sarcastic speech synthesis
Li, Z., Zhang, Y., Gao, X., Raghuvanshi, D., Kumar, N., Nayak, S. & Coler, M. · 13th ISCA Speech Synthesis Workshop (SSW 2025)
2025Conference paperMultimodal AI
-
Spoken in jest, detected in earnest: A systematic review of sarcasm recognition—multimodal fusion, challenges, and future prospects
Gao, X., Nayak, S. & Coler, M. · IEEE Transactions on Affective Computing
2025Journal articleMultimodal AI
-
Leveraging large language models for sarcastic speech annotation in sarcasm detection
Li, Z., Zhang, Y., Gao, X., Nayak, S. & Coler, M. · Interspeech 2025
2025Conference paperMultimodal AI
-
Overcoming data scarcity in multi-dialectal Arabic ASR via Whisper fine-tuning
Özyilmaz, Ö.T., Coler, M. & Valdenegro-Toro, M. · Interspeech 2025
2025Conference paperLow-resource speech
-
Meta learning text-to-speech synthesis in over 7000 languages
Lux, F., Meyer, S., Behringer, L., Zalkow, F., Do, P., Coler, M., Habets, E.A.P. & Vu, N.T. · Interspeech 2024
2024Conference paperLow-resource speech
-
A functional trade-off between prosodic and semantic cues in conveying sarcasm
Li, Z., Gao, X., Zhang, Y., Nayak, S. & Coler, M. · Interspeech 2024
2024Conference paperMultimodal AI
-
Lexical stress identification in cochlear implant-simulated speech by non-native listeners
Everhardt, M.K., Sarampalis, A., Coler, M., Başkent, D. & Lowie, W. · Language and Speech, 67(4), 1075–1092
2024Journal articleProsody
-
Fine-tuning strategies for Dutch dysarthric speech recognition: Evaluating the impact of healthy, disease-specific, and speaker-specific data
Leivaditi, S., Matsushima, T., Coler, M., Nayak, S. & Verkhodanova, V. · Interspeech 2024, 1295–1299
2024Conference paperProsody
-
Aymara
Coler, M. · In M. Urban (ed.), The Oxford Guide to the Languages of the Central Andes, 219–244. Oxford University Press
2024Book chapterAndean languages
-
Improving sarcasm detection from speech and text through attention-based fusion exploiting the interplay of emotions and sentiments
Gao, X., Nayak, S. & Coler, M. · Proceedings of Meetings on Acoustics
2024Conference paperMultimodal AI
-
Enhancing sarcasm detection through multimodal data integration: A proposal for augmenting audio with text and emoticon
Gao, X., Nayak, S. & Coler, M. · Journal of the Acoustical Society of America
2024Journal articleMultimodal AI
-
Jaqaru
Coler, M. · In M. Urban (ed.), The Oxford Guide to the Languages of the Central Andes. Oxford University Press
2024Book chapterAndean languages
-
Improving Luxembourgish speech recognition with cross-lingual speech representations
Nguyen, L., Nayak, S. & Coler, M. · 2022 IEEE Spoken Language Technology Workshop (SLT), 792–797
2023Conference paperLow-resource speech
-
SarcasticSpeech: Speech synthesis for sarcasm in low-resource scenarios
Li, Z., Gao, X., Nayak, S. & Coler, M. · ISCA Speech Synthesis Workshop (SSW)
2023Conference paperMultimodal AI
-
Prosodic focus interpretation in spectrotemporally degraded speech by non-native listeners
Everhardt, M.K., Sarampalis, A., Coler, M., Başkent, D. & Lowie, W. · Journal of Speech, Language, and Hearing Research, 66, 3649–3664
2023Journal articleProsody
-
Reimagining language: Towards a better understanding of language by including our interactions with non-humans
Rasenberg, M., Amha, A., Coler, M., van Koppen, M., van Miltenburg, E., de Rijk, L., Stommel, W. & Dingemanse, M. · Linguistics in the Netherlands
2023Journal articleLanguage diversity
-
The effects of input type and pronunciation dictionary usage in transfer learning for low-resource text-to-speech
Do, P., Coler, M., Dijkstra, J. & Klabbers, E. · Interspeech 2023
2023Conference paperLow-resource speech
-
Resource-efficient fine-tuning strategies for automatic MOS prediction in text-to-speech for low-resource languages
Do, P., Coler, M., Dijkstra, J. & Klabbers, E. · Interspeech 2023
2023Conference paperLow-resource speech
-
Strategies in transfer learning for low-resource speech synthesis: Phone mapping, features input, and source language selection
Do, P., Coler, M., Dijkstra, J. & Klabbers, E. · 12th ISCA Speech Synthesis Workshop (SSW 2023)
2023Conference paperLow-resource speech
-
A contrastive study on the representation of “Made in China” in Chinese and U.S. newspapers
Wang, Y., Coler, M. & Redeker, G. · Frontiers in Communication
2023Journal articleLanguage diversity
-
luxembourgish-asr-rtl-lu: A speech corpus for Luxembourgish
Nguyen, L.M., Nayak, S. & Coler, M. · Hugging Face Datasets (CC BY-NC-ND 4.0). Released with Nguyen et al., IEEE SLT 2022
2022DatasetLow-resource speech
-
Contemporary Research in Minoritized and Diaspora Languages of Europe
Coler, M. & Nevins, A. (eds.) · Language Science Press, Contact and Multilingualism series (open access)
2022BookLanguage diversity
-
A cross-linguistic perspective to classification of healthiness of speech in Parkinson’s disease
Verkhodanova, V., Coler, M., Jonkers, R., Timmermans, S., Maurits, N., de Jong, B. & Lowie, W. · Journal of Neurolinguistics, 63, 101068
2022Journal articleProsody
-
How expertise and language familiarity influence perception of speech of people with Parkinson’s disease
Verkhodanova, V., Coler, M., Jonkers, R. & Lowie, W. · Clinical Linguistics & Phonetics, 36(2–3), 165–182
2022Journal articleProsody
-
Interpretation of prosodically marked focus in cochlear implant-simulated speech by non-native listeners
Everhardt, M.K., Sarampalis, A., Coler, M., Başkent, D. & Lowie, W. · Speech Prosody 2022, 72–76
2022Conference paperProsody
-
Speech prosody: The musical, magical quality of speech
Everhardt, M.K., Sarampalis, A., Coler, M., Başkent, D. & Lowie, W. · Frontiers for Young Minds, 698575. Science article for young readers, reviewed by children
2022Journal articleProsody
-
The use of nayra ‘eye’ in Muylaq’ Aymara: Body, time, and space
Coler, M., Kaal, B. & Banegas-Flores, E. · In R. Zariquiey & P.M. Valenzuela (eds.), The Grammar of Body-Part Expressions: A View from the Americas, 79–90. Oxford University Press
2022Book chapterAndean languages
-
Trilingual modality: Towards an analysis of mood and modality in Aymara, Quechua and Castellano Andino as a joint systematic concept
Dankel, P., Soto Rodríguez, M., Coler, M. & Banegas-Flores, E. · In M. Coler & A. Nevins (eds.), Contemporary Research in Minoritized and Diaspora Languages of Europe. Language Science Press
2022Book chapterAndean languages
-
Deep CNN-based inductive transfer learning for sarcasm detection in speech
Gao, X., Nayak, S. & Coler, M. · Interspeech 2022
2022Conference paperMultimodal AI
-
Text-to-speech for under-resourced languages: Phoneme mapping and source language selection in transfer learning
Do, P., Coler, M., Dijkstra, J. & Klabbers, E. · Proceedings of the 1st Annual Meeting of the ELRA/ISCA SIG on Under-Resourced Languages (SIGUL 2022), 16–22
2022Conference paperLow-resource speech
-
UniMorph 4.0: Universal Morphology
Batsuren, K., Goldman, O., Khalifa, S., Habash, N., Kieraś, W., Bella, G., … Coler, M., … Vylomova, E. · Proceedings of LREC 2022, 840–855
2022Conference paperLanguage diversity
-
Salience is in the brain of the beholder: ERPs reflect acoustically salient variables
Boswijk, V., Hilton, N.H., Coler, M. & Loerts, H. · Ampersand
2022Journal articleProsody
-
Sensory Experiences: Exploring Meaning and the Senses
Dubois, D., Cance, C., Coler, M., Paté, A. & Guastavino, C. (eds.) · John Benjamins
2021BookSensory experiences
-
Exploring speech experiences: Linguists, speakers, sounds and meanings
Coler, M. · In Dubois et al. (eds.), Sensory Experiences, 169–212. John Benjamins
2021Book chapterSensory experiences
-
The five senses and the cognitivist approach to perception
Dubois, D., Cance, C., Coler, M. & Paté, A. · In Dubois et al. (eds.), Sensory Experiences, 23–66. John Benjamins
2021Book chapterSensory experiences
-
From perception to sensory experiences: A paradigm shift
Dubois, D., Cance, C., Coler, M., Paté, A. & Guastavino, C. · In Dubois et al. (eds.), Sensory Experiences, 333–370. John Benjamins
2021Book chapterSensory experiences
-
Questioning sensory experience
Dubois, D., Cance, C., Coler, M., Paté, A. & Guastavino, C. · In Dubois et al. (eds.), Sensory Experiences, 371–402. John Benjamins
2021Book chapterSensory experiences
-
Subjects or participants?
Dubois, D., Cance, C. & Coler, M. · In Dubois et al. (eds.), Sensory Experiences, 403–438. John Benjamins
2021Book chapterSensory experiences
-
From stimulations to stimuli construction and selection
Cance, C., Dubois, D., Paté, A. & Coler, M. · In Dubois et al. (eds.), Sensory Experiences, 439–474. John Benjamins
2021Book chapterSensory experiences
-
Making sense of the outcomes
Cance, C., Dubois, D. & Coler, M. · In Dubois et al. (eds.), Sensory Experiences, 505–536. John Benjamins
2021Book chapterSensory experiences
-
The Dawn of the Human-Machine Era: A forecast on new and emerging language technologies
Sayers, D., et al. · LITHME COST Action CA19102, University of Jyväskylä. 4,000+ downloads
2021ReportLanguage diversity
-
Evolving plasticity for autonomous learning under changing environmental conditions
Yaman, A., Iacca, G., Mocanu, D.C., Coler, M., Fletcher, G. & Pechenizkiy, M. · Evolutionary Computation
2021Journal articleMachine learning
-
A systematic review and analysis of multilingual data strategies in text-to-speech for low-resource languages
Do, P., Coler, M., Dijkstra, J. & Klabbers, E. · Interspeech 2021
2021Conference paperLow-resource speech
-
Meta-analysis on the identification of linguistic and emotional prosody in cochlear implant users and vocoder simulations
Everhardt, M.K., Sarampalis, A., Coler, M., Başkent, D. & Lowie, W. · Ear and Hearing, 41(5), 1092–1102
2020Journal articleProsody
-
More than words: Cross-linguistic exploration of Parkinson’s disease identification from speech
Verkhodanova, V., Trčková, D., Coler, M. & Lowie, W. · SPECOM 2020, LNCS 12335, 613–623
2020Conference paperProsody
-
Vowel deletion in two Aymara varieties
Coler, M., Emlen, N.Q. & Banegas-Flores, E. · Italian Journal of Linguistics, 32(1), 151–174
2020Journal articleAndean languages
-
Verbal art as heuristic for semantic analyses: How non-prosodic poetic structure in the verbal art of Muylaq’ Aymara (Muylaque, Peru) reveals semantic categories
Coler, M., Guyot, P. & Banegas-Flores, E. · LIAMES: Línguas Indígenas Americanas
2020Journal articleAndean languages
-
The multilingual workplace realities of Polish truckers: A case study in the Netherlands
Dijkstra, B.E., Coler, M. & Redeker, G. · Multilingua
2020Journal articleLanguage diversity
-
What is salience?
Boswijk, V. & Coler, M. · Open Linguistics
2020Journal articleProsody
-
Processing of prosodically marked focus in a cochlear implant simulation by non-native listeners: Preliminary results
Everhardt, M.K., Sarampalis, A., Coler, M., Başkent, D. & Lowie, W. · Journal of the Acoustical Society of America
2020Journal articleProsody
-
How dysarthric prosody impacts naïve listeners’ recognition
Verkhodanova, V., Timmermans, S., Coler, M., Jonkers, R., de Jong, B. & Lowie, W. · SPECOM 2019, LNCS 11658, 510–519
2019Conference paperProsody
-
Prosodic changes in the speech of a single speaker with Parkinson’s disease
Verkhodanova, V., Coler, M., Jonkers, R., de Bot, K. & Lowie, W. · Proceedings of ICPhS 2019, 3046–3050
2019Conference paperProsody
-
Perception of L2 lexical stress in words degraded by a cochlear implant simulation
Everhardt, M.K., Sarampalis, A., Coler, M., Başkent, D. & Lowie, W. · Proceedings of ICPhS 2019, 102–106
2019Conference paperProsody
-
An exploratory study on the influence of activities on public space users’ descriptions of their auditory environments on site: The case of Amsterdam
Bild, E., Pfeffer, K., Coler, M. & Bertolini, L. · Acta Acustica united with Acustica, 105(3), 449–463
2019Journal articleSensory experiences
-
Prosodic and segmental correlates of spontaneous Dutch speech in patients with Parkinson’s disease: A pilot study
Verkhodanova, V. & Coler, M. · Speech Prosody 2018
2018Conference paperProsody
-
Aymara
Banegas-Flores, E. & Coler, M. · International Journal of American Linguistics, 84(S1), 165–185. Narrative text, Texts in the Indigenous Languages of the Americas
2018Journal articleAndean languages
-
Public space users’ soundscape evaluations in relation to their activities: An Amsterdam-based study
Bild, E., Pfeffer, K., Coler, M., Rubin, O. & Bertolini, L. · Frontiers in Psychology, 9, 1593
2018Journal articleSensory experiences
-
Multi-strategy differential evolution
Yaman, A., Iacca, G., Coler, M., Fletcher, G. & Pechenizkiy, M. · EvoApplications 2018
2018Conference paperMachine learning
-
Introduction: Texts in the Indigenous Languages of the Americas: Narratives in Indigenous Peruvian languages
Coler, M., Valenzuela, P. & Zariquiey, R. · International Journal of American Linguistics, 84(S1), S1–S4
2018Journal articleAndean languages
-
Acoustic and perceptual correlates of vowel articulation in Parkinson’s disease with and without mild cognitive impairment: A pilot study
Strinzel, M., Verkhodanova, V., Jalvingh, F., Jonkers, R. & Coler, M. · SPECOM 2017
2017Conference paperProsody
-
Presenting the ECO: Evolutionary Computation Ontology
Yaman, A., Hallawa, A., Coler, M. & Iacca, G. · EvoApplications 2017
2017Conference paperMachine learning
-
Aymara inflection
Coler, M. · In M. Baerman (ed.), The Oxford Handbook of Inflection. Oxford University Press
2016Book chapterAndean languages
-
The Phonetics and Phonology of Laryngeal Features in Native American Languages
Avelino, H., Coler, M. & Wetzels, W.L.M. (eds.) · Brill (Brill’s Studies in the Indigenous Languages of the Americas)
2016BookAndean languages
-
Considering sound in planning and designing public spaces: A review of theory and applications and a proposed framework for integrating research and practice
Bild, E., Coler, M., Pfeffer, K. & Bertolini, L. · Journal of Planning Literature, 31, 419–434
2016Journal articleSensory experiences
-
Sharing music in public spaces: Social insights from the Musikiosk project (Montreal, CA)
Bild, E., Steele, D., Tarlao, C., Guastavino, C. & Coler, M. · INTER-NOISE and NOISE-CON Congress and Conference Proceedings, 253(5)
2016Conference paperSensory experiences
-
Word and phrasal stress disentangled: Pitch peak alignment in Frisian and Dutch declarative structures
Nota, A., Hilton, N.H. & Coler, M. · Speech Prosody 2016
2016Conference paperProsody
-
Introduction to laryngeal features in languages of the Americas
Avelino, H., Coler, M. & Wetzels, W.L.M. · In Avelino, Coler & Wetzels (eds.), The Phonetics and Phonology of Laryngeal Features in Native American Languages. Brill
2016Book chapterAndean languages
-
An ethnomusical and linguistic description of the Añasita song as sung by the Aymara of Muylaq’i
Coler, M., Guyot, P. & Banegas-Flores, E. · Proceedings of REELA
2015Conference paperAndean languages
-
A pilot experiment on effects of motor and cognitive activities on memories of soundscapes
Bild, E., Coler, M., Dubois, D. & Pfeffer, K. · Proceedings of Euronoise 2015, Maastricht, 1529–1533
2015Conference paperSensory experiences
-
Hybrid sound classification
Gaillard, P., Coler, M., Tardieu, J. & Magnen, C. · Proceedings of Euronoise 2015, Maastricht, 1523ff.
2015Conference paperSensory experiences
-
Method and system for predicting human activity
Coler, M. & Wörtche, H.J. · US Patent Application 2015/0156597 A1 (Stichting INCAS3)
2015PatentMachine learning
-
A Grammar of Muylaq’ Aymara: Aymara as Spoken in Southern Peru
Coler, M. · Brill
2014BookAndean languages
-
The grammatical expression of dialogicity in Muylaq’ Aymara narratives
Coler, M. · International Journal of American Linguistics, 80(2), 241–265
2014Journal articleAndean languages
-
Rule-based machine translation for Aymara
Coler, M. & Homola, P. · In M. Jones (ed.), Endangered Languages and New Technologies. Cambridge University Press
2014Book chapterAndean languages
-
Knowledge, sensory experience, and sensor technology
Dubois, D., Coler, M. & Wörtche, H. · In The World in Prismatic Views. World Scientific
2014Book chapterSensory experiences
-
A descriptive analysis of Castellano loanwords into Muylaq’ Aymara
Coler, M. & Banegas-Flores, E. · LIAMES: Línguas Indígenas Americanas, 13
2013Journal articleAndean languages
-
Pragmatic structures in Aymara
Homola, P. & Coler, M. · Proceedings of the Second International Conference on Dependency Linguistics (DepLing 2013), 98–107
2013Conference paperAndean languages
-
Multimodal analysis of “well” as a discourse marker in conversation: A pilot study
Esfandiari Baiat, G., Coler, M., Pullen, M., Tienkouw, S. & Hunyadi, L. · IEEE 4th International Conference on Cognitive Infocommunications (CogInfoCom 2013), 283–288
2013Conference paperMultimodal AI