Preface: This comp239 project proposal would be easier to explain in person, however, here is attempt at a written version. 

The kind of virtual reality we are exploring in Comp 239 is to immerse the visitor into a virtual world. In effect, the person should feel that the virtual world is real. The world the person explores can teach him/her new concepts or help him/her complete a task that would be difficult to accomplish without the virtual reality system. 

I suggest a virtual reality system to immerse a blind person and help him/her travel outdoors. Without sight the blind person faces the challenges when traveling between destinations in the outdoors environments like a city of university campus. It would be helpful if they had a way to sense their approximate position. The person can know their position based on the surrounding buildings and other landmarks. My IP will explain in more detail why such a system should work. More info on my IP.

The reality system would present information about the surrounding area with an audio interface. With the interface, the blind person would hear sounds coming from the location of the landmarks. 

With the comp 239 prototype a blind person would be able to explore the UNC campus. In the lab, the person would wear headphones and “fly though” campus using the wand control. Along the way they would hear where the campus buildings are. I would also implement a visual display for sighted people to see where on campus they are.

Presence
This application gives the blind person an awareness of their location. If it successful, then the person will be able to travel between destinations. 

Example of how the navigation system helps blind person 
Say on the typical path to a destination blind persons takes a left turn and say the supermarket in on the left. If the left turn is mistakenly taken early, then the supermarket will be on their right. If the path does do not have distinguishing auditory, smell, or haptic features then the blind person will not be able to know they took a wrong turn. A computer system can inform the blind person about the surrounding environment and convey that the supermarket is on the right side. Recognizing the wrong turn, the blind person can correct for it and get on their pay.

Navigation in the virtual world
A prototype of the system will be developed in a virtual reality system. The virtual reality allows the person to explore campus space without having to go outdoors. Being in the virtual reality eliminates complication of tracking outdoors and having a mobile computer. The work on the virtual reality system can later be used in the outdoor implementation.  
 

Virtual world navigation

• Restrict the movement to defined paths. Have to select branch when choice is available.
• Should provide map to help person navigate. Sighted person will be able to see buildings through HMD. 

UNC Map 

• Includes foot prints of all buildings.
• Should still obtain the paths.
• XML representation that can be loaded into Open GL.
• Need algorithm to determine which buildings should the hearable. Maybe by line of sight. 

Spatial Audio 

• Open AL works with VR Juggler

Corrdinate spaces (worlds)

• Lab
• Application 
• UNC map
• Audio 

Next semester:

• Take the navigation system outside with outside tracker from comp 261