Multimodal Learning for Audio and Visual Processing

Justin Wilson

(Draft dissertation sent to committee - Friday, June 26, 2020)

(Dissertation feedback, please select 1-2 chapters Google doc - by Friday, July 17, 2020)

(Final dissertation feedback - by Friday, July 24, 2020)

(Defense datetime 11 am to 1 pm ET on July 29, 2020 via Zoom)

Full Dissertation
(Overleaf)
(PDF 9/29/2020)
(PDF 10/6/2020)
(PDF 10/8/2020)
(PDF 11/14/2020)
(PDF 11/18/2020)
Abstract
(PDF 6/26/2020)
(PDF 10/6/2020)
Ch. 1: Introduction
(PDF 6/26/2020)
(PDF 7/14/2020)
(PDF 7/23/2020)
(PDF 9/28/2020)
(PDF 10/6/2020)
Ch. 2: Background
(PDF 6/26/2020)
(PDF 9/28/2020)
DELETED - Merged into Chapter 1 Introduction
Ch. 3: Sound Synthesis for Fluid-Structure Coupling
(PDF 6/26/2020)
(PDF 7/23/2020)
Ch. 4: Analyzing Liquid Pouring Sequences via Audio-Visual
(PDF 6/26/2020)
(PDF 7/23/2020)
Ch. 5: Audio-Visual Object Tracking for Multiple Objects
(PDF 6/26/2020)
(PDF 7/23/2020)
Ch. 6: Audio-Augmented Scene Reconstruction on Mobile Devices
(PDF 6/26/2020)
(PDF 7/23/2020)
(PDF 10/8/2020)
Ch. 7: Audio-Visual Object Reconstruction from Video
(PDF 6/26/2020)
(PDF 7/23/2020)
(PDF 10/8/2020)
Ch. 8: Conclusion
(PDF 6/26/2020)
(PDF 9/29/2020)
Draft Defense Slides
(PowerPoint)
(PDF 7/28/2020)

Supporting Publications

Audio-Augmented Reconstruction

Justin Wilson, Nicholas Rewkowski, Ming C. Lin, and Henry Fuchs

Under Review

AVOT: Audio-Visual Object Tracking of Multiple Objects for Robotics

Justin Wilson and Ming C. Lin

International Conference on Robotics and Automation (ICRA) 2020

[project page] [preprint PDF] [video]

Analyzing Liquid Pouring Sequences via Audio-Visual Neural Networks

Justin Wilson, Auston Sterling, and Ming C. Lin

International Conference on Intelligent Robots and Systems (IROS) 2019

[project page] [preprint PDF] [video]

Glass half full: sound synthesis for fluid-structure coupling using added mass operator

Justin Wilson, Auston Sterling, Nicholas Rewkowski, and Ming C. Lin

Computer Graphics International (CGI) 2017, The Visual Computer

[project page] [preprint PDF] [video]

Changelog

11/18/20

All: Fixed misspelling of virtual, added missing contributions in section 1.5, and updated from in this paper to chapter.

11/14/20

All: Updated Chapter 6 based on latest submission.

10/06/20

All: Merged Chapter 2 on Background into Chapter 1 Introduction.

9/28/20

All: Updated introduction and conclusion based on comments following my defense.

7/23/20

All: Updated references to display author and year.

7/20/20

All: Updates to defense slides.

7/14/20

All: Draft defense slides and updated thesis statement in Chapter 1.

6/26/20

All: Chapter 8 and updates to table/figure captions for table of contents.

6/22/20

All: Chapters 2 and 7.

6/21/20

All: Chapters 5 and 6.

6/20/20

All: Chapters 3 and 4.

6/17/20

All: Abstract and Chapter 1 Introduction.

6/15/20

All: Dissertation outline (Google Doc link here).

6/1/20

All: Started dissertation webpage.