Aurosweta Mahapatra

Aurosweta
Mahapatra

PhD Student, SMILE Lab @ CLSP
Advisor: Dr. Berrak Sisman
Speech Security · Anti-Spoofing · Deepfake Detection · Speech Synthesis · Speech for Healthcare

Latest News

Jun 2026 2 Papers accepted at Interspeech 2026. Looking forward to the conference in Australia 🇦🇺
Apr 2026 Invited talk on Speech Security at a graduate course at Johns Hopkins University.
Jan 2026 Invited to present research on speech security at the Amazon Trusted AI Symposium 2026.
Aug 2025 Presented "Can Emotion Fool Anti-Spoofing?" at Interspeech 2025 in the Netherlands 🇳🇱
Aug 2025 Presented research trajectory before an expert speech panel at the Doctoral Consortium at Interspeech 2025.

About Me

I am a Ph.D. student at Johns Hopkins University, working with Dr. Berrak Sisman on speech security. My interest in AI began during my undergraduate years, when an internship and a published paper on COVID-19 detection from radiological images showed me how impactful AI could be in real-world applications. This curiosity led me to UCLA, where I earned my M.S. and began working in speech research at the SPAPL Lab with Dr. Abeer Alwan, focusing on automatic speech recognition for child speech. Now at Johns Hopkins, my research addresses a critical gap in speech deepfake detection: existing models often struggle with emotional and expressive synthetic speech generated by advanced text-to-speech and voice conversion systems. I build emotion- and prosody-aware speech deepfake detection models that generalize across paralinguistic variation, with the broader goal of supporting the secure and ethical use of synthetic speech. I am also broadly interested in speech technologies for healthcare, speech generation, and speech translation, and I am always happy to connect with others sharing similar interests.


Academic Journey

Jan 2025 – Present
PhD in Electrical and Computer Engineering
Johns Hopkins University · SMILE Lab @ CLSP
Advisor: Dr. Berrak Sisman · Secure speech technologies, speech synthesis, speech for healthcare
Sep 2022 – Jun 2024
MS in Electrical & Computer Engineering
University of California, Los Angeles (UCLA) · GPA 3.71/4
Specialization in Signals and Systems · ASR for child speech, generative TTS-based data augmentation
Jul 2018 – May 2022
BS in Electronics & Telecommunication
KIIT, Bhubaneswar, India · GPA 3.88/4
School of Electronics Topper · Science Academies' Summer Research Fellowship

Projects & Resources

ProSDD
"ProSDD: Learning Prosodic Representations for Speech Deepfake Detection" · Submitted, Interspeech 2026
A speaker-conditioned, prosody-aware speech deepfake detection framework based on supervised masked prediction. Improves cross-domain generalization and robustness to expressive and emotional attacks while maintaining strong performance on standard benchmarks across diverse training scenarios.
↗ Project Page
HuLA
"HuLA: Prosody-Aware Anti-Spoofing with Multi-Task Learning" · Under Review, IEEE TAC
A human-perception-inspired, prosody-aware deepfake detection model using multi-task learning. Improves robustness to expressive and emotional synthetic speech while maintaining strong performance on standard benchmarks. Learns prosodic patterns that generalize to cross-lingual attacks, including Spanish and Mandarin, even when trained only on English.
↗ Project Page
EmoSpoof-TTS
"Can Emotion Fool Anti-Spoofing?" · Interspeech 2025
The first TTS-based emotional synthetic speech dataset. Reveals critical vulnerabilities of speech deepfake detectors to expressive and emotion-driven attacks and enables evaluation under realistic conditions. Exposes performance disparities across emotional states, which we define as vulnerability to emotion-targeted attacks.
↗ Dataset Page
NaturalVoices
"NaturalVoices: A Large-Scale, Spontaneous and Emotional Podcast Dataset" · Under Review, IEEE TAC
A large-scale dataset with over 5,000 hours of spontaneous and emotional podcast speech, designed to support research in voice conversion and expressive speech modeling.
↗ GitHub
JIBO Kids Corpus
"The JIBO Kids Corpus: A speech dataset of child-robot interactions" · JASA Express Letters 2024
A 21-hour dataset of child–robot interactions in classroom environments, covering 110 children aged 4–7 with longitudinal recordings and word-level annotations.
↗ GitHub

Publications (Relevant Work)


Talks & Presentations

2026 · Poster
Amazon Trusted AI Symposium 2026 — "Toward Trustworthy Speech Security: Failure Modes and Defenses for Emotional, Expressive Deepfakes"
Accepted for poster presentation
2025 · Poster
Interspeech 2025 — "Can Emotion Fool Anti-Spoofing?" Introducing EmoSpoof-TTS and the GEM model
Poster presentation
2025 · DC
11th Doctoral Consortium at Interspeech 2025 — Presented PhD research trajectory, key findings, and future directions
Expert-led session for doctoral researchers

Milestones

Amazon Trusted AI Symposium 2026
2026
Accepted for a poster at the Amazon Trusted AI Symposium 2026 on emotional speech deepfake vulnerabilities and defenses.
Interspeech 2025
2025
Presented "Can Emotion Fool Anti-Spoofing?" at Interspeech 2025, introducing EmoSpoof-TTS and the GEM model.
Doctoral Consortium
2025
Selected for the 11th Doctoral Consortium at Interspeech 2025 to present PhD research trajectory.
SMILE Lab
Jan 2025
SMILE Lab @ CLSP, JHU
Joining JHU
Jan 2025
Joined Johns Hopkins University as a PhD student at SMILE Lab, CLSP under Dr. Berrak Sisman.
UT Dallas
2024
Joined as Research Assistant at UT Dallas.
UCLA Graduation
Jun 2024
Graduated with an MS in Electrical & Computer Engineering from UCLA, with specialization in signals and systems.

Beyond the Researcher

Odissi Dance
Odissi Dance
I love classical Indian dance — Odissi is one of the oldest dance forms, and it has been a meaningful part of my life.
Beaches
Beaches
Love beaches! El Matador, Malibu — there is something about the ocean that is endlessly calming and energizing at the same time.
Kayaking at La Jolla
Kayaking
Beach kayaking in San Diego at La Jolla — one of my favourite adventures on the water.
Mount Rainier
National Parks
Love exploring National Parks. Here at Mount Rainier — nature at its most breathtaking.