Research projects, internships, class projects, and other software development work.
Working in Prof. Henry Fuchs' group on enhancing human capabilities through virtual personal embodied assistants. We envision a telepresence system available anywhere, anytime, enabling users to reconstruct their body and environment in 3D using eyeglasses-mounted cameras and body-worn inertial sensors (IMUs).
Set up an instrumented indoor environment with 8 Pan-Tilt-Zoom (PTZ) cameras and ran live experiments with USMC cadets, demonstrating that our real-time camera control method scales successfully up in the number of targets and cameras.
Thesis research for the BASE-IT project. Developed a stochastic model and optimization methods for online, real-time control of PTZ cameras, maximizing 3D reconstruction and target coverage quality under bandwidth constraints.
Built upon Shader Lamps projection techniques. We used cameras and projectors to capture the dynamic motion and appearance of a person, mapping their appearance in real-time onto a physical animatronic humanoid model.
Extended the functionality of the ObjectVideo Virtual Video Tool to allow movements of virtual targets under active program control. Programmed a client-server paradigm to schedule global scheduling optimizations and local movements.
Collaborative project with Sarnoff Corporation and the Naval Postgraduate School. Researched optimal scheduling algorithms for active camera sensors for automated behavior analysis and virtual training scenarios.
Designed a two-station, four-person immersive telepresence system. Used multi-camera acquisition and autostereo lenticular displays that turn real-time captured video streams into high-quality 3D visual fields.
Designed the software architecture and networking for a medical telepresence system. Programmed a multi-threaded camera server and client-side applications for real-time 3D reconstruction and remote consulting.
Created a flexible calibration system utilizing OpenCV geometric corners detection and custom camera libraries. Implemented multi-camera photometric calibration models described in ICCV 2005.
Researched hardware-based register manipulation and image processing algorithms to correct color disparities across multi-camera configurations prior to 3D image-based reconstruction.
Processed 3D reconstructions of dynamic surgical tasks (e.g., tying medical knots) to embed interactive 3D playback models in web documents for educational training resources.
Collaborated with Brown University and the UNC School of Medicine. Worked on multi-camera 3D volume reconstruction, tracking, and rendering algorithms inside a dedicated multi-camera capture cube.
Developed rendering support and conducted user evaluation studies on combining immersive head-mounted displays with wide-field projector-based displays. Published in VR 2003.
Ported the renderer engine from SGI Reality Monster platforms onto PC Clusters. Researched active projection occlusion culling, shadow boundaries removal, and projector auto-calibration.
Integrated the open-source Geographic Information System (GRASS), PostgreSQL database systems, and the R statistical package to build an automated data analysis pipeline for EPA environmental simulations.
Research internship at Mitsubishi Electric Research Labs with Ramesh Raskar. Developed algorithms to merge high-dynamic lighting data from different timeframes, dramatically enhancing dark security camera feeds.
Implemented non-photorealistic cartoon-style rendering shaders for the Quake engine as part of the COMP 238 Advanced Image Generation course, adding silhouette lines and cel shading.
Developed a program that harvests image files, indexes their color signatures, and reconstructs a high-level input image using libraries of matching micro-images as mosaic tiles.
Software Consultant for KindHeart, Inc. Created optical camera processing algorithms to image transparent anatomic structures, delivering a realistic surgical training experience without exposing trainees to radiation.
Software Designer for a live stage project featuring an actor and a RoboThespian robot. Created custom control software that converts real actor recordings into on-demand performance routines for the robot.
Developed a program in Turbo C++ to generate, size, and print custom checkerboard patterns of precise metric proportions for optical scale camera calibration.
Served as Online Chair. Overhauled the open-source MyReview paper review platform to add custom AJAX upload bars, which were integrated into version 1.9.3 of the official repository.
Designed an MS Access repository database and C++ front-end tool in Borland Turbo C++ to manage, review, and export formatted document disposition schedules for manuscripts archivists.
Designed a client tracking database and Delphi 3 graphical client interface for the Inter-Faith Council for Social Service in Chapel Hill, supporting service history management.
