Skip to main content
  • Home
  • About
  • Faculty Experts
  • For The Media
  • ’Cuse Conversations Podcast
  • Topics
    • Alumni
    • Events
    • Faculty
    • Students
    • All Topics
  • Contact
  • Submit
STEM
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • University Statements
  • Syracuse University Impact
  • |
  • The Peel
  • Athletics
Sections
  • All News
  • Arts & Culture
  • Business & Economy
  • Campus & Community
  • Health & Society
  • Media, Law & Policy
  • STEM
  • Veterans
  • University Statements
  • Syracuse University Impact
  • |
  • The Peel
  • Athletics
  • Home
  • About
  • Faculty Experts
  • For The Media
  • ’Cuse Conversations Podcast
  • Topics
    • Alumni
    • Events
    • Faculty
    • Students
    • All Topics
  • Contact
  • Submit
STEM

Smart Speakers, Smarter Protection

Thursday, November 2, 2023, By Kwami Maranga
Share
College of Engineering and Computer Scienceresearchtechnology
Two individuals standing next to each other in front of a building that is covered in fall colored leaves.

Asif Salekin (left) and Brian Testa (Photo by Alex Dunbar)

Whether you’re looking to try a new recipe, dimming the lights in your living room, or curious about the species of bacteria living inside your mouth, Amazon Alexa has got you covered. With a simple voice command, Alexa’s ability to perform various tasks or answer questions has made it widely popular, with over 40 million users in the United States alone. Despite the convenience smart speakers like Alexa offer, these devices have also raised some privacy concerns.

Amazon has been known to collect data on users, which includes their shopping habits, preferences and even their location for personalized marketing. But that’s not all. When using waking words such as “Hey Alexa” to activate smart speakers, the audio of your voice command is also recorded and stored, becoming Amazon’s property. This means that Amazon owns your voice audio and can do whatever they want with it. “Big tech companies are using our personal information. We’re less like customers and more like their product,” says graduate student Brian Testa ’24. “I’ve always been sensitive to that. I don’t use a lot of technology at home for that reason.”

Using voice data, companies like Amazon and Google have now developed technology that poses even more threats to privacy: AI and machine learning that can determine people’s emotional state or mood from their voice. This patented technology can even pick up on feelings from emotionally neutral phrases like “What’s the weather?” Since there are no laws in place to prevent this, there’s no protection against it. “In the U.S. for the last five to 10 years, lots of researchers have been working on how they can use voice to infer emotions, mood or even mental health,” says assistant professor in electrical engineering and computer science, Asif Salekin. “In my own lab, we have previous works on tech that can infer mental disorders like depression, social anxiety, manic disorder and even suicidal tendencies from one’s voice.”

While this technology can be useful in certain circumstances, most users, if not all, have not consented to having their emotions detected by smart speakers. These privacy concerns led Testa, Professor Salekin, graduate students Harshit Sharma ’26 and Yi Xiao ’26, and undergraduate student Avery Gump ’24 to begin researching ways to protect users’ privacy from smart speakers. “Consent is key,” Salekin says. “We’d still like to use smart speakers since they’re quite useful–I have them in my own home. This project was about finding a way to use these devices without giving companies the power to exploit us.”

Led by Testa, the group conducted extensive research and developed a device that can be attached to a smart speaker or downloaded as software onto a laptop. This device emits a mild noise that only the smart speaker can hear and masks the emotional tone in your voice, providing a new level of privacy protection for concerned users. “Through the use of a speech emotion recognition (SER) classifier, a smart speaker can analyze how people are feeling based on how they sound. We created a microphone device that listens for the wake word ‘Hey Alexa,’” Testa says. “When the smart speaker activates, our device activates too and begins to emit a noise that disrupts the smart speaker from detecting your emotions. However, only the smart speaker hears this noise.”

Currently, their device masks your emotional state by presenting it as a completely different emotion. When you speak, the smart speaker may detect from your voice that you’re sad, angry or frustrated when you’re not feeling any of these emotions. This unpredictability makes it difficult for smart speakers to accurately determine your true emotions or mood and also prevents machine learning from picking up on any patterns and mood correlations. The group hopes to improve the device’s functionality by making it mask your emotions as neutral rather than presenting them as a different emotion. “To create the mild noise our device emits, we utilized genetic programming to identify a combination of specific frequencies that disrupt the smart speaker from determining a person’s mood,” Salekin says. “Only the speaker hears this noise, but it can hear your speech commands clearly, so the utility of the smart speaker remains intact.”

Though the sound is only detected by the smart speaker, the group wanted to see how loud it would be when the device is used. Testa played the sound in the lab when Professor Salekin was having a meeting and Salekin didn’t even realize it was playing, which showed that the noise wasn’t disruptive. Additionally, they also conducted a survey with others to see if the noise was loud enough to be disruptive.

Testa, Salekin, Sharma, Xiao and Gump are currently working on patent submissions, form factors and speaking with companies about commercializing their device. What sets their patent apart from similar concepts is that while past technology focused on determining people’s moods or emotions, their technology is all about protecting them. This unique approach makes their device the first of its kind. “It was a fun project,” Testa says. “This paper was published by me and as the first listed author, I’m excited about it. I’ve been working towards my Ph.D., and this is another step towards that goal.”

“Working with the students in real-world applications and research with real results was exciting,” Salekin says. “This research has many components and the collaboration between us was great. We’re excited to see what the future for this tech holds.”

  • Author

Kwami Maranga

  • Recent
  • Timur Hammond’s ‘Placing Islam’ Receives Journal’s Honorable Mention
    Tuesday, May 27, 2025, By News Staff
  • Syracuse University 2025-26 Budget to Include Significant Expansion of Student Financial Aid
    Wednesday, May 21, 2025, By News Staff
  • University’s Dynamic Sustainability Lab and Ireland’s BiOrbic Sign MOU to Advance Markets for the Biobased Economy
    Wednesday, May 21, 2025, By News Staff
  • Engaged Humanities Network Community Showcase Spotlights Collaborative Work
    Wednesday, May 21, 2025, By Dan Bernardi
  • Students Engaged in Research and Assessment
    Tuesday, May 20, 2025, By News Staff

More In STEM

University’s Dynamic Sustainability Lab and Ireland’s BiOrbic Sign MOU to Advance Markets for the Biobased Economy

This month at the All Island Bioeconomy Summit held in Co. Meath, Ireland, it was announced that BiOrbic, Research Ireland Centre for Bioeconomy, comprising 12 leading Irish research universities in Ireland, signed a joint memorandum of understanding (MOU) with the Dynamic Sustainability…

Professor Bing Dong Named as the Traugott Professor of Mechanical and Aerospace Engineering

The College of Engineering and Computer Science has named Bing Dong as the Traugott Professor of Mechanical and Aerospace Engineering. This endowed professorship is made possible by a 1998 gift from the late Fritz Traugott H’98 and his wife, Frances….

Physics Professor Honored for Efforts to Improve Learning, Retention

The Department of Physics in the College of Arts and Sciences (A&S) has made some big changes lately. The department just added an astronomy major approved by New York State and recently overhauled the undergraduate curriculum to replace traditional labs with innovative…

ECS Team Takes First Place in American Society of Civil Engineers Competition

Civil and environmental engineering student teams participated in the American Society of Civil Engineers (ASCE) Sustainable Solutions and Steel Bridge competitions during the 2025 Upstate New York-Canada Student Symposium, winning first place in the Sustainable Solutions competition. The symposium was…

Chloe Britton Naime Committed to Advocating for Improved Outcomes for Neurodivergent Individuals

Chloe Britton Naime ’25 is about to complete a challenging and rare dual major program in both mechanical engineering from the College of Engineering and Computer Science and neuroscience from the College of Arts and Sciences. Even more impressive? Britton…

Subscribe to SU Today

If you need help with your subscription, contact sunews@syr.edu.

Connect With Us

  • X
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
Social Media Directory

For the Media

Find an Expert Follow @SyracuseUNews
  • Facebook
  • Instagram
  • Youtube
  • LinkedIn
  • @SyracuseU
  • @SyracuseUNews
  • Social Media Directory
  • Accessibility
  • Privacy
  • Campus Status
  • Syracuse.edu
© 2025 Syracuse University News. All Rights Reserved.