Aurosweta Mahapatra

Aurosweta
Mahapatra

PhD Student, SMILE Lab @ CLSP
Advisor: Dr. Berrak Sisman
Speech Security · Anti-Spoofing · Deepfake Detection · Speech Synthesis · Speech for Healthcare

Latest News

August 2026 2 Papers accepted at EMNLP 2026. Looking forward to the conference in Budapest 🇭🇺
Jun 2026 2 Papers accepted at Interspeech 2026. Looking forward to the conference in Sydney 🇦🇺
Apr 2026 Invited talk on Speech Security at a graduate course at Johns Hopkins University.
Jan 2026 Invited to present research on speech security at the Amazon Trusted AI Symposium 2026.
Aug 2025 Presented "Can Emotion Fool Anti-Spoofing?" at Interspeech 2025 in the Netherlands 🇳🇱
Aug 2025 Presented research trajectory before an expert speech panel at the Doctoral Consortium at Interspeech 2025.

About Me

I am a Ph.D. student at Johns Hopkins University, working with Dr. Berrak Sisman on speech security. My interest in AI began during my undergraduate years, when an internship and a published paper on COVID-19 detection from radiological images showed me how impactful AI could be in real-world applications. This curiosity led me to UCLA, where I earned my M.S. and began working in speech research at the SPAPL Lab with Dr. Abeer Alwan, focusing on automatic speech recognition for child speech. Now at Johns Hopkins, my research addresses a critical gap in speech deepfake detection: existing models often struggle with emotional and expressive synthetic speech generated by advanced text-to-speech and voice conversion systems. I build emotion- and prosody-aware speech deepfake detection models that generalize across paralinguistic variation, with the broader goal of supporting the secure and ethical use of synthetic speech. I am also broadly interested in speech technologies for healthcare, speech generation, and speech translation, and I am always happy to connect with others sharing similar interests.


Academic Journey

Jan 2025 – Present
PhD in Electrical and Computer Engineering
Johns Hopkins University · SMILE Lab @ CLSP
Advisor: Dr. Berrak Sisman · Secure speech technologies, speech synthesis, speech for healthcare
Sep 2022 – Jun 2024
MS in Electrical & Computer Engineering
University of California, Los Angeles (UCLA) · GPA 3.71/4
Specialization in Signals and Systems · ASR for child speech, generative TTS-based data augmentation
Jul 2018 – May 2022
BS in Electronics & Telecommunication
KIIT, Bhubaneswar, India · GPA 3.88/4
School of Electronics Topper · Science Academies' Summer Research Fellowship

Projects & Resources

AffectDF
"AffectDF: The Most Comprehensive Benchmark for Speech Deepfake Detection against Emotionally Expressive Attacks" · Accepted, EMNLP 2026
The most comprehensive benchmark for evaluating speech deepfake detection against emotionally expressive attacks, enabling rigorous evaluation under realistic and affective conditions.
↗ Dataset Page
ProSDD
"ProSDD: Learning Prosodic Representations for Speech Deepfake Detection" · Accepted, Interspeech 2026
A speaker-conditioned, prosody-aware speech deepfake detection framework based on supervised masked prediction. Improves cross-domain generalization and robustness to expressive and emotional attacks while maintaining strong performance on standard benchmarks across diverse training scenarios.
↗ Project Page
HuLA
"HuLA: Prosody-Aware Anti-Spoofing with Multi-Task Learning" · Under Review, IEEE TAC
A human-perception-inspired, prosody-aware deepfake detection model using multi-task learning. Improves robustness to expressive and emotional synthetic speech while maintaining strong performance on standard benchmarks. Learns prosodic patterns that generalize to cross-lingual attacks, including Spanish and Mandarin, even when trained only on English.
↗ Project Page
EmoSpoof-TTS
"Can Emotion Fool Anti-Spoofing?" · Interspeech 2025
The first TTS-based emotional synthetic speech dataset. Reveals critical vulnerabilities of speech deepfake detectors to expressive and emotion-driven attacks and enables evaluation under realistic conditions. Exposes performance disparities across emotional states, which we define as vulnerability to emotion-targeted attacks.
↗ Dataset Page
NaturalVoices
"NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset" · Under Review, IEEE TAC
A large-scale dataset with over 5,000 hours of spontaneous and emotional podcast speech, designed to support research in voice conversion and expressive speech modeling.
↗ GitHub
JIBO Kids Corpus
"The JIBO Kids Corpus: A speech dataset of child-robot interactions" · JASA Express Letters 2024
A 21-hour dataset of child–robot interactions in classroom environments, covering 110 children aged 4–7 with longitudinal recordings and word-level annotations.
↗ GitHub

Publications (Selected)

2026
EMNLP
AffectDF: The Most Comprehensive Benchmark for Speech Deepfake Detection against Emotionally Expressive Attacks
Mahapatra, A., Ulgen, I. R., Lee, K. A., Andrews, N., & Sisman, B.
Accepted · EMNLP 2026
2026
EMNLP
Disentangling the Interpretive and Predictive Roles of LIWC: Controlled Substitution in Depression-Related Classification
Yeh, H. C., Sun, L., Mahapatra, A., Chandra, S. S., Provost, E. M., & Sisman, B.
Accepted · EMNLP 2026
2026
IS2026
ProSDD: Learning Prosodic Representations for Speech Deepfake Detection against Expressive and Emotional Attacks
Mahapatra, A., Ulgen, I. R., Lee, K. A., Andrews, N., & Sisman, B.
Accepted · Interspeech 2026
2026
IS2026
Who is Speaking or Who is Depressed? A Controlled Study of Speaker Leakage in Speech-Based Depression Detection
Yeh, H. C., Sun, L., Mahapatra, A., Chandra, S. S., Provost, E. M., & Sisman, B.
Accepted · Interspeech 2026
2025
IEEE TAC
HuLA: Prosody-Aware Anti-Spoofing with Multi-Task Learning for Expressive and Emotional Synthetic Speech
Mahapatra A., Ulgen I.R., Sisman B.
Under Review · IEEE TAC
2025
IS2025
Can Emotion Fool Anti-spoofing?
Mahapatra A., Ulgen, I.R., Reddy Naini, A., Busso, C., Sisman, B.
Published · Interspeech 2025
2025
IEEE TAC
NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset for Voice Conversion
Du Z., Chandra S.S., Ulgen I.R., Mahapatra A., Salman A.N., Busso C., Sisman B.
Under Review · IEEE TAC
2024
JASA EL
The JIBO Kids Corpus: A speech dataset of child-robot interactions in a classroom environment
Shankar, N. B., Afshan, A., Johnson, A., Mahapatra, A., et al.
Published · JASA Express Letters 2024

Talks & Presentations

2026 · Poster
Amazon Trusted AI Symposium 2026 — "Toward Trustworthy Speech Security: Failure Modes and Defenses for Emotional, Expressive Deepfakes"
Accepted for poster presentation
2025 · Poster
Interspeech 2025 — "Can Emotion Fool Anti-Spoofing?" Introducing EmoSpoof-TTS and the GEM model
Poster presentation
2025 · DC
11th Doctoral Consortium at Interspeech 2025 — Presented PhD research trajectory, key findings, and future directions
Expert-led session for doctoral researchers

Milestones

Amazon Trusted AI Symposium 2026
2026
Accepted for a poster at the Amazon Trusted AI Symposium 2026 on emotional speech deepfake vulnerabilities and defenses.
Interspeech 2025
2025
Presented "Can Emotion Fool Anti-Spoofing?" at Interspeech 2025, introducing EmoSpoof-TTS and the GEM model.
Doctoral Consortium
2025
Selected for the 11th Doctoral Consortium at Interspeech 2025 to present PhD research trajectory.
SMILE Lab
Jan 2025
SMILE Lab @ CLSP, JHU
Joining JHU
Jan 2025
Joined Johns Hopkins University as a PhD student at SMILE Lab, CLSP under Dr. Berrak Sisman.
UT Dallas
2024
Joined as Research Assistant at UT Dallas.
UCLA Graduation
Jun 2024
Graduated with an MS in Electrical & Computer Engineering from UCLA, with specialization in signals and systems.

Beyond the Researcher

Odissi Dance
Odissi Dance
I love classical Indian dance — Odissi is one of the oldest dance forms, and it has been a meaningful part of my life.
Beaches
Beaches
Love beaches! El Matador, Malibu — there is something about the ocean that is endlessly calming and energizing at the same time.
Kayaking at Lake Tahoe
Kayaking
Kayaking at Lake Tahoe— one of my favourite adventures on the water.
Olympic National Park
National Parks
Love exploring National Parks. Here at Olympic National Park — nature at its most breathtaking.