{"id":1383,"date":"2023-10-27T09:46:04","date_gmt":"2023-10-27T13:46:04","guid":{"rendered":"https:\/\/faculty.northeastern.edu\/advance\/?p=1383"},"modified":"2023-10-27T09:46:04","modified_gmt":"2023-10-27T13:46:04","slug":"ai-and-machine-learning-help-researchers-get-audio-from-still-images-and-silent-videos","status":"publish","type":"post","link":"https:\/\/faculty.northeastern.edu\/advance\/ai-and-machine-learning-help-researchers-get-audio-from-still-images-and-silent-videos\/","title":{"rendered":"AI and Machine Learning Help Researchers Get Audio from Still Images and Silent Videos"},"content":{"rendered":"<p>ECE\/Khoury Professor Kevin Fu has developed a machine learning tool called Side Eye that can extract audio from pictures and even muted videos.<\/p>\n<p>This article originally appeared on\u00a0<em>Northeastern Global News<\/em>. It was published by Cody Mello-Klein. Main photo: When you take a photo on your phone, the vibrations of your voice can create tiny bends in the light that are enough to extract audio, according to Kevin Fu, a professor of engineering and computer science at Northeastern University. Photo by Matthew Modoono\/Northeastern University.<\/p>\n<p><a href=\"https:\/\/coe.northeastern.edu\/people\/fu-kevin\/\" target=\"_blank\" rel=\"noreferrer noopener\">Kevin Fu<\/a>, a professor of electrical and computer engineering and computer science at Northeastern University, has figured out a way to get audio from pictures and even muted videos. Using Side Eye, a machine learning assisted tool that Fu and his research team created, Fu can determine the gender of someone speaking in the room where a photo was taken \u2013\u2013 and even the exact words they spoke.<\/p>\n<figure id=\"attachment_1384\" aria-describedby=\"caption-attachment-1384\" style=\"width: 300px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" class=\"size-medium wp-image-1384\" src=\"https:\/\/faculty.northeastern.edu\/wp-content\/uploads\/sites\/5\/2023\/10\/fu0923-300x200.jpg\" alt=\"\" width=\"300\" height=\"200\" srcset=\"https:\/\/faculty.northeastern.edu\/advance\/wp-content\/uploads\/sites\/5\/2023\/10\/fu0923-300x200.jpg 300w, https:\/\/faculty.northeastern.edu\/advance\/wp-content\/uploads\/sites\/5\/2023\/10\/fu0923.jpg 600w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><figcaption id=\"caption-attachment-1384\" class=\"wp-caption-text\">Photo by Matthew Modoono\/Northeastern University<\/figcaption><\/figure>\n<p><strong><a class=\"btn bg--red --lg\" href=\"https:\/\/coe.northeastern.edu\/news\/your-photos-can-hear-you-ai-and-machine-learning-help-researchers-get-audio-from-still-images-and-silent-videos\/\">Read More<\/a><\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>ECE\/Khoury Professor Kevin Fu has developed a machine learning tool called Side Eye that can extract audio from pictures and even muted videos. This article originally appeared on\u00a0Northeastern Global News. It was published by Cody Mello-Klein. Main photo: When you take a photo on your phone, the vibrations of your voice can create tiny bends &hellip; <a href=\"https:\/\/faculty.northeastern.edu\/advance\/ai-and-machine-learning-help-researchers-get-audio-from-still-images-and-silent-videos\/\">Continued<\/a><\/p>\n","protected":false},"author":12,"featured_media":1384,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16,24,10],"tags":[],"class_list":["post-1383","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","category-success","category-faculty"],"_links":{"self":[{"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/posts\/1383","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/users\/12"}],"replies":[{"embeddable":true,"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/comments?post=1383"}],"version-history":[{"count":0,"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/posts\/1383\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/media\/1384"}],"wp:attachment":[{"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/media?parent=1383"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/categories?post=1383"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/faculty.northeastern.edu\/advance\/wp-json\/wp\/v2\/tags?post=1383"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}