{"id":8483,"date":"2015-09-30T19:16:31","date_gmt":"2015-09-30T19:16:31","guid":{"rendered":"https:\/\/voxelvid.com\/?p=8483"},"modified":"2025-11-19T18:41:16","modified_gmt":"2025-11-19T18:41:16","slug":"reconstructing-sound-from-vibrations-two-minute-papers-12","status":"publish","type":"post","link":"https:\/\/voxelvid.com\/?p=8483","title":{"rendered":"Reconstructing Sound From Vibrations | Two Minute Papers #12"},"content":{"rendered":"<p>When exposed to sound waves, the surface of objects in a room start vibrating. One could wonder that if we had sufficiently advanced technology, maybe the sound itself could be reconstructed from looking only at the vibration of these objects. A great technique they call &#8220;visual microphone&#8221; has been recently proposed that executes this idea with breathtaking results.<\/p>\n<p>_____________________<\/p>\n<p>The paper &#8220;The Visual Microphone: Passive Recovery of Sound from Video&#8221; is available here: http:\/\/people.csail.mit.edu\/mrub\/VisualMic\/<br \/>\nDisclaimer: I was not part of this research project, I am merely providing commentary on this work.<\/p>\n<p>The mentioned TED talk from Abe Davis:<\/p>\n<div class=\"video-ratio-16-9 whatever-embed-responsive\"><iframe title=\"Abe Davis: New video technology that reveals an object&#039;s hidden properties\" width=\"640\" height=\"360\" src=\"https:\/\/www.youtube.com\/embed\/npNYP2vzaPo?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe><\/div>\n<p>Reddit AMA with the main author, Abe Davis:<\/p>\n<blockquote class=\"reddit-embed-bq\" style=\"height:316px\" ><p><a href=\"https:\/\/www.reddit.com\/r\/IAmA\/comments\/357b4o\/im_an_mit_computer_scientist_and_recent_ted\/\">I&#39;m an MIT computer scientist and recent TED speaker who can hear your conversations by watching a potato-chip bag. AMA!<\/a><br \/> by<a href=\"https:\/\/www.reddit.com\/user\/abedavis\/\">u\/abedavis<\/a> in<a href=\"https:\/\/www.reddit.com\/r\/IAmA\/\">IAmA<\/a><\/p><\/blockquote>\n<p><script async src=\"https:\/\/embed.reddit.com\/widgets.js\" charset=\"UTF-8\"><\/script><\/p>\n<p>Material properties from vibrations:<br \/>\nhttp:\/\/www.visualvibrometry.com\/<\/p>\n<p>The background image for the thumbnail was created by Corey Leopold: https:\/\/flic.kr\/p\/54UZdL<br \/>\nSplash screen\/thumbnail design: Fel\u00edcia Feh\u00e9r &#8211; http:\/\/felicia.hu<\/p>\n<p>Subscribe if you would like to see more of these! &#8211; http:\/\/www.youtube.com\/subscription_center?add_user=keeroyz<\/p>\n<p>K\u00e1roly Zsolnai-Feh\u00e9r&#8217;s links:<br \/>\nPatreon \u2192 https:\/\/www.patreon.com\/TwoMinutePapers<br \/>\nFacebook \u2192 https:\/\/www.facebook.com\/TwoMinutePapers\/<br \/>\nWeb \u2192 https:\/\/cg.tuwien.ac.at\/~zsolnai\/<br \/>\nTwitter \u2192 https:\/\/twitter.com\/karoly_zsolnai<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When exposed to sound waves, the surface of objects in a room start vibrating. One could wonder that if we had sufficiently advanced technology, maybe the sound itself could be reconstructed from looking only at the vibration of these objects. A great technique they call &#8220;visual microphone&#8221; has been recently proposed that executes this idea [&hellip;]<\/p>\n","protected":false},"author":0,"featured_media":8484,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"video","meta":{"yasr_overall_rating":0,"yasr_post_is_review":"","yasr_auto_insert_disabled":"","yasr_review_type":"","footnotes":""},"categories":[23],"tags":[2917,2912,2927,2913,2925,1464,2861,2869,2919,2923,2921,2922,2924,2928,2916,2793,2920,2911,2918,2926,2914,2915],"class_list":["post-8483","post","type-post","status-publish","format-video","has-post-thumbnail","hentry","category-ai_tech","tag-abe-davis","tag-microphone","tag-passive-recovery-of-sound-from-video","tag-reconstruction","tag-recovering-sound-from-video","tag-research","tag-siggraph","tag-sound","tag-sound-from-vibrations","tag-sound-from-video","tag-sound-reconstruction","tag-sound-recovery","tag-sound-recovery-from-video","tag-the-visual-microphone-ieee","tag-the-visual-microphone-passive-recovery-of-sound-from-video","tag-two-minute-papers","tag-vibrating-objects","tag-vibration","tag-vibrations","tag-video-to-sound","tag-visual-microphone","tag-visual-microphones","post_format-post-format-video"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Reconstructing Sound From Vibrations | Two Minute Papers #12 - voxelvid<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/voxelvid.com\/?p=8483\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Reconstructing Sound From Vibrations | Two Minute Papers #12 - voxelvid\" \/>\n<meta property=\"og:description\" content=\"When exposed to sound waves, the surface of objects in a room start vibrating. One could wonder that if we had sufficiently advanced technology, maybe the sound itself could be reconstructed from looking only at the vibration of these objects. A great technique they call &#8220;visual microphone&#8221; has been recently proposed that executes this idea [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/voxelvid.com\/?p=8483\" \/>\n<meta property=\"og:site_name\" content=\"voxelvid\" \/>\n<meta property=\"article:published_time\" content=\"2015-09-30T19:16:31+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-11-19T18:41:16+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1280\" \/>\n\t<meta property=\"og:image:height\" content=\"720\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/voxelvid.com\/?p=8483\",\"url\":\"https:\/\/voxelvid.com\/?p=8483\",\"name\":\"Reconstructing Sound From Vibrations | Two Minute Papers #12 - voxelvid\",\"isPartOf\":{\"@id\":\"https:\/\/voxelvid.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/voxelvid.com\/?p=8483#primaryimage\"},\"image\":{\"@id\":\"https:\/\/voxelvid.com\/?p=8483#primaryimage\"},\"thumbnailUrl\":\"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg\",\"datePublished\":\"2015-09-30T19:16:31+00:00\",\"dateModified\":\"2025-11-19T18:41:16+00:00\",\"author\":{\"@id\":\"\"},\"breadcrumb\":{\"@id\":\"https:\/\/voxelvid.com\/?p=8483#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/voxelvid.com\/?p=8483\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/voxelvid.com\/?p=8483#primaryimage\",\"url\":\"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg\",\"contentUrl\":\"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg\",\"width\":1280,\"height\":720},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/voxelvid.com\/?p=8483#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/voxelvid.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Reconstructing Sound From Vibrations | Two Minute Papers #12\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/voxelvid.com\/#website\",\"url\":\"https:\/\/voxelvid.com\/\",\"name\":\"voxelvid\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/voxelvid.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},false]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reconstructing Sound From Vibrations | Two Minute Papers #12 - voxelvid","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/voxelvid.com\/?p=8483","og_locale":"en_US","og_type":"article","og_title":"Reconstructing Sound From Vibrations | Two Minute Papers #12 - voxelvid","og_description":"When exposed to sound waves, the surface of objects in a room start vibrating. One could wonder that if we had sufficiently advanced technology, maybe the sound itself could be reconstructed from looking only at the vibration of these objects. A great technique they call &#8220;visual microphone&#8221; has been recently proposed that executes this idea [&hellip;]","og_url":"https:\/\/voxelvid.com\/?p=8483","og_site_name":"voxelvid","article_published_time":"2015-09-30T19:16:31+00:00","article_modified_time":"2025-11-19T18:41:16+00:00","og_image":[{"width":1280,"height":720,"url":"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/voxelvid.com\/?p=8483","url":"https:\/\/voxelvid.com\/?p=8483","name":"Reconstructing Sound From Vibrations | Two Minute Papers #12 - voxelvid","isPartOf":{"@id":"https:\/\/voxelvid.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/voxelvid.com\/?p=8483#primaryimage"},"image":{"@id":"https:\/\/voxelvid.com\/?p=8483#primaryimage"},"thumbnailUrl":"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg","datePublished":"2015-09-30T19:16:31+00:00","dateModified":"2025-11-19T18:41:16+00:00","author":{"@id":""},"breadcrumb":{"@id":"https:\/\/voxelvid.com\/?p=8483#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/voxelvid.com\/?p=8483"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/voxelvid.com\/?p=8483#primaryimage","url":"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg","contentUrl":"https:\/\/voxelvid.com\/wp-content\/uploads\/2025\/11\/private-id-2i1hrywdwpo-youtube-a.jpg","width":1280,"height":720},{"@type":"BreadcrumbList","@id":"https:\/\/voxelvid.com\/?p=8483#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/voxelvid.com\/"},{"@type":"ListItem","position":2,"name":"Reconstructing Sound From Vibrations | Two Minute Papers #12"}]},{"@type":"WebSite","@id":"https:\/\/voxelvid.com\/#website","url":"https:\/\/voxelvid.com\/","name":"voxelvid","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/voxelvid.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},false]}},"yasr_visitor_votes":{"stars_attributes":{"read_only":true,"span_bottom":"<div class='yasr-small-block-bold'><span class='yasr-visitor-votes-must-sign-in'>You must sign in to vote<\/span><\/div>"},"number_of_votes":0,"sum_votes":0},"cmb2":{"poster_feature_image":{"vid_m_player_background":"","vid_m_poster_image":"","vid_m_poster_image_id":""},"gif_feature_image":{"vid_m_gif_image":"","vid_m_gif_image_id":""},"video_movie_settings":{"vid_m_director":"","vid_m_actor":"","vid_m_imdb_ratings":"","vid_m_amazon_associates":"","vid_m_vid_tmdb_movie":"","vid_m_vid_tmdb_tv_shows":"","vid_m_vid_tmdb_thumb":""},"vid_ads_m_videoads_settings_post":{"vid_ads_m_video_ads":"","vid_ads_m_video_ads_type":"","vid_ads_m_group_google_ima":"","vid_ads_m_group_image":"","vid_ads_m_group_html5_video":"","vid_ads_m_group_html":"","vid_ads_m_vpaid_mode":"","vid_ads_m_vast_preroll":"","vid_ads_m_vast_postroll":"","vid_ads_m_vast_pauseroll":"","vid_ads_m_vast_midroll":"","vid_ads_m_group_dynamic":"","vid_ads_m_time_to_show_ads":"","vid_ads_m_time_skip_ads":"","vid_ads_m_time_to_hide_ads":""},"feature_image_settings":{"feature_image_position":""},"video_player_settings":{"single_video_style":"","video_player_position":"","vm_video_url_btn_choose":"","vm_video_url_btn_choose_id":"","vm_video_url":"https:\/\/www.youtube.com\/watch?v=2i1hrywDwPo","vm_video_ratio":"","vm_video_ratio_mobile":"","video_player_library":"","plyr_player":"","video_streaming":"","vm_video_shortcode":"","vm_video_timelapse":"","vm_media_subtitles":"","vm_media_sources":"","vid_vtt_preview":"","vid_vtt_preview_vtt_file":"","vid_vtt_preview_vtt_file_id":"","vid_vtt_preview_sprite_image":"","vid_vtt_preview_sprite_image_id":"","vid_auto_play":"","vid_preview_mode":"","vm_video_trailer_manl_url":"","vm_screenshot_preview":"","vid_tags":"","vid_p_sync_playlist":"","vid_c_sync_channel":"","get_post_format":"","multiple_links_structure":"","multi_links_title":"","original_video_title":"","multi_links_series":"","vm_video_multi_links":"","vm_duration":"03:39","vid_social_locker":"","vid_locker_mode":"","vid_social_locker_id":"","vid_social_email_locker_id":"","vid_social_signin_locker_id":"","sv_login_to_watch":"","vid_membership_action":"","vm_video_trailer_url":"","vid_download_type":"","vid_download_target":"","vid_woo_product":"","vid_download_mode":"","vid_download_mode_trailer":"","vm_media_download":"","user_rating":"","user_rating_position":"","user_rating_mode":"","user_rating_multi_sets":"","ads_above_single_player":""},"video_auto_fetch_settings":{"vm_video_fetch":""},"video_fake_views_likes":{"vm_fake_views":"","vm_fake_likes":"","vm_fake_dislikes":""},"gallery_settings":{"gallery_position":""},"quote_settings":{"quote_position":""},"post_options":{"main_layout":"","main_logo":"","main_logo_id":"","main_logo_retina":"","main_logo_retina_id":"","main_logo_mobile":"","main_logo_mobile_id":"","main_logo_mobile_retina":"","main_logo_mobile_retina_id":"","sticky_logo":"","sticky_logo_id":"","sticky_logo_retina":"","sticky_logo_retina_id":"","main_nav_layout":"","header_background":"","theme_sidebar":"","single_post_comment_type":"","theme_background":""}},"_links":{"self":[{"href":"https:\/\/voxelvid.com\/index.php?rest_route=\/wp\/v2\/posts\/8483","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/voxelvid.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/voxelvid.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/voxelvid.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=8483"}],"version-history":[{"count":1,"href":"https:\/\/voxelvid.com\/index.php?rest_route=\/wp\/v2\/posts\/8483\/revisions"}],"predecessor-version":[{"id":8485,"href":"https:\/\/voxelvid.com\/index.php?rest_route=\/wp\/v2\/posts\/8483\/revisions\/8485"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/voxelvid.com\/index.php?rest_route=\/wp\/v2\/media\/8484"}],"wp:attachment":[{"href":"https:\/\/voxelvid.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=8483"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/voxelvid.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=8483"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/voxelvid.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=8483"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}