AI and Machine Learning Help Researchers Get Audio from Still Images and Silent Videos
ECE/Khoury Professor Kevin Fu has developed a machine learning tool called Side Eye that can extract audio from pictures and even muted videos.
This article originally appeared on Northeastern Global News. It was published by Cody Mello-Klein. Main photo: When you take a photo on your phone, the vibrations of your voice can create tiny bends in the light that are enough to extract audio, according to Kevin Fu, a professor of engineering and computer science at Northeastern University. Photo by Matthew Modoono/Northeastern University.
Kevin Fu, a professor of electrical and computer engineering and computer science at Northeastern University, has figured out a way to get audio from pictures and even muted videos. Using Side Eye, a machine learning assisted tool that Fu and his research team created, Fu can determine the gender of someone speaking in the room where a photo was taken –– and even the exact words they spoke.
