Journal Article

AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation
AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation

A novel approach to multimodal sarcasm detection that combines text and audio data augmentation with attention mechanisms.

Dec 13, 2024

Lexical Stress Identification in Cochlear Implant-Simulated Speech by Non-Native Listeners

We examine how Dutch listeners identify lexical stress in English speech when the speech is degraded to simulate cochlear implant processing, finding they adapt their cue-weighting strategies.

Dec 1, 2024

Improving Sarcasm Detection from Speech and Text through Attention-based Fusion Exploiting the Interplay of Emotions and Sentiments

We enhance sarcasm detection by combining speech and text data with emotion recognition and sentiment analysis, using attention-based fusion to capture the characteristic mismatch between emotional tone and semantic content.

May 13, 2024

Reimagining Language: Towards a Better Understanding of Language by Including Our Interactions with Non-humans

This essay explores the nature of language by examining human interactions with non-humans (animals and computers), revealing new perspectives on language's essence and boundaries.

Nov 3, 2023

Prosodic Focus Interpretation in Spectrotemporally Degraded Speech by Non-Native Listeners

We examine how cochlear implant speech processing affects non-native listeners' ability to interpret prosodic focus, finding that speech degradation and non-native listening interact to create disproportionate challenges.

Sep 13, 2023

A Cross-Linguistic Perspective to Classification of Healthiness of Speech in Parkinson's Disease

A study on how listeners from different language backgrounds perceive speech healthiness in people with Parkinson's disease.

Aug 1, 2022

UniMorph 4.0: Universal Morphology

Expansion of the Universal Morphology project with 67 new languages and improved schema for morphological annotation.

May 7, 2022

Speech prosody: The musical, magical quality of speech

An accessible explanation of speech prosody for young readers, exploring how we use pitch, loudness, and duration to add meaning to our speech.

Jan 17, 2022

Salience is in the brain of the beholder: ERPs reflect acoustically salient variables

This study uses Event Related Potentials (ERPs) to investigate linguistic salience, finding distinct neural responses to salient linguistic features.

Jan 1, 2022

A Cross-Linguistic Perspective to Classification of Healthiness of Speech in Parkinson's Disease
A Cross-Linguistic Perspective to Classification of Healthiness of Speech in Parkinson's Disease

Cross-linguistic analysis of speech patterns in Parkinson's disease patients.

Jan 1, 2022