WPC :3&Oy`3Q4b *aL +[8Gs2ѩ? .xGRHI$hPP pctb d 77 mf>v&Q?r,'zوI6?Gx_;6"(nP+X6uj5kqͦ^WR<.ﰲY_(wZH~w xɱ|cvy4F$+-@T$E;a4W eOc&ܱFa+s\;ne!ڙ{l9d8ኵ *d$ c/)>$U @ }[ )=)'dFj#0N9(ap_vguv`-&lIs1-q*κtd.Ϯs!2ko5EO=Xoz;d+.^wEr<$<H % 0`XY: 0: f 0=U[J 0| UN a 0| 0e ' UN :j 0| R rUN 0kIU:>w@x B 0;9AUN4d Rx RUN+ hyyyyyy 0><T 0h 0|N R BUN9 RUNb/E3 5 RFF 0|j  )` *X, XX*  . %.%t!t!t!(#Page  1  .%(8h$` *X, XX*c:\office\wpwin\template\report\report1.wpt 0  *` *X, XX*  % !  m%.%# %%.mc# %!Sby% ,  %.%JasonJerald# %%.# %, D`>$Level 1 Heading %p%%.% H' % %p   %p%%.% H' % %p(K>:$ %p%%.% g% %p  q %p%%.% g% %p'@FA2Humanst521 Cn BT Bold(T3 $ h!` *X, XX*  (ON  Z 6Times New Roman RegularTABLE A(T3 $ h!` *X, XX*  F>>G,TitleReport TitleXXXX\XXXXXX\XX   '` *X, XX*  . %.%  %  TheDevelopmentofanImmersiveMedicalEnvironment%  (hH  Z 6Times New Roman Regular 0  *` *X, XX*  % ! .m%.%#.%%.mc# %!Sby% , .%.%JasonJerald#.%%.# %,(T3 $ h!` *X, XX*  1[ReportTitle]%/    )` *X, XX*   %.%t!t!t!(#Page  1  (ON  Z 6Times New Roman RegularDK>$Level 3 Heading %p%%.% X X% %p  q %p%%.% X X% %p   '` *X, XX*  " %.%  %  TheDevelopmentofanImmersiveMedicalEnvironment%  ,{AZ"Arial Regular  ggEEgg6g d(Vm$0   (hH  Z 6Times New Roman Regular7dZ!ٛ2 n )*+3|x3 Ti )*+(ON  Z 6Times New Roman Regular(,!$0  0` (#(#  (@$0  0` (#(#0 ` (#` (# ` (T$0  0` (#(#0 ` (#` (#0 (# (# 4 )*+P Pd(ON  Z 6Times New Roman Regular5d (#pP (hH  Z 6Times New Roman Regular )*2H$VdTEMP1 ' u 9 &` *X, XX*  Thispageintentionallyleftblank7(T3 $ h!` *X, XX*  Report - Traditional /, '  0 .    h!` *X, XX*  ݛn*q ddd Xdd Xdd X` (#` (#q,@+  - T  G%%%.%%%  G]  %  TheDevelopmentofan h ImmersiveMedicalEnvironment%G]݌& (  - &Ќ..%%.  % / .%.%May13August16,1996#.%%.#%/     %  n  8`    `   .%.% G .TableofContents#.  G##.%%.#  4  Vm  Vm0     Abstract#""J(#.(#(##1Vm݌  Ќ  Vm  Vmq0     1  Introduction#""J(#.\ \ (#(##1Vmq݌ @  Ќ  )!  )!:0  0(#(#    1.1  VirtualEnvironments#""J(#.3 3 #(#(##1)!:U݌  e Ќ  )!  )! 0  0(#(#    1.2  TheImmersiveVirtualEnvironmentsLaboratory#""J(#.<(#(##2)! ;݌  : Ќ  )!  )!0  0(#(#    1.3  MedicalApplications#""J(#., , #(#(##3)!:݌   Ќ  Vm  Vm 0     2  TheInternship#""J(#. (#(##4Vm ! ݌ i   Ќ  )!  )! 0  0(#(#    2.1  ObtainingtheInternship#""J(#. '(#(##4)! ݌ >  Ќ  Vm  Vm 0     3  TheProblem#""J(#. (#(##4Vm ݌ 8  Ќ  )!  )! 0  0(#(#    3.1  WorkResponsibilities#""J(#.a a $(#(##4)! ݌   Ќ  )!  )!i 0  0(#(#    3.2  GeneralProblemsofImmersiveEnvironments#""J(#.QQ9(#(##5)!i ݌   Ќ  )!  )!e 0  0(#(#    3.3  RequirementsoftheImmersiveMedicalEnvironment#""J(#.jj@(#(##7)!e ݌ g  Ќ  Vm  Vmh0     4  TheTeam#""J(#.(#(##7Vmh݌ a Ќ  Vm  Vm-0     5  DataSources#""J(#. (#(##8Vm-I݌   Ќ  )!  )!0  0(#(#    5.1  TraditionalMethods#""J(#. "(#(##8)!݌  Ќ  )!  )!0  0(#(#    5.2  TheVisibleHumanProject#""J(#.((#(##9)!݌ e Ќ  )!  )!0  0(#(#    5.3  DataUsageinanImmersiveEnvironment#""J(#.5(#(##9)!݌ : Ќ  Vm  Vm0     6  HardwareandSoftware#n"n"I(#. !(#(##10Vm݌ 4 Ќ  )!  )!0  0(#(#    6.1  Hardware#n"n"I(#. (#(##10)!݌   Ќ  )!  )!l0  0(#(#    6.2  Software#n"n"I(#. (#(##11)!l݌  Ќ  Vm  VmG0     7  Background&NecessarySkills#n"n"I(#.)(#(##12VmGc݌ 8 Ќ  Vm  Vm"0     8  TheSolution#n"n"I(#. (#(##13Vm">݌ 2 Ќ  )!  )!0  0(#(#    8.1  UserInterface#n"n"I(#.  (#(##13)!݌   Ќ  )!  )!0  0(#(#    8.2  Functions#n"n"I(#. (#(##14)!݌  ! Ќ  )!  )!0  0(#(#    8.3  FutureDevelopment#n"n"I(#. !(#(##17)!݌ a!" Ќ  Vm  Vm0     9  RelatedworkatPNNL#n"n"I(#.k k (#(##19Vm݌  #[$ Ќ  )!  )!`0  0(#(#    9.1  ProjectswithinIVE#n"n"I(#. "(#(##19)!`{݌ #0% Ќ  )!  )!F0  0(#(#    9.2  MedicalProjectswithinPNNL#n"n"I(#.+(#(##19)!Fa݌ $ & Ќ  Vm  Vm50     10  Siggraph96#n"n"I(#.# # (#(##20Vm5Q݌ _&!( Ќ  )!  )!0  0(#(#    10.1GeneralRealityCompany#n"n"I(#.((#(##20)!݌ 4'") Ќ  Vm  Vm0     11  TheFinalPresentation#n"n"I(#.D D "(#(##22Vm݌ (.$+ Ќ  Vm  Vm0     12  TheFutureoftheIVELab#n"n"I(#.w w %(#(##22Vm݌ *%- Ќ  Vm  Vm0     13  FinancialCompensation#n"n"I(#. #(#(##23Vm݌ 2,'/ Ќ  Vm  Vma 0     14  FutureEmploymentOpportunities#n"n"I(#.+(#(##23Vma } ݌ -,)1 Ќ  Vm  VmC!0     15  Conclusion#n"n"I(#.  (#(##24VmC!_!݌  Ќ  )!  )! "0  0(#(#    15.1PNNL#n"n"I(#.0 0 (#(##24)! "'"݌ Z Ќ  )!  )!"0  0(#(#    15.2TheProject#n"n"I(#. (#(##24)!""݌ / Ќ  Vm  Vm#0     AppendixA:Glossary#n"n"I(#.  (#(##25Vm##݌ ) Ќ  Vm  Vmr$0     AppendixB:Bibliography#n"n"I(#.~ ~ #(#(##27Vmr$$݌   Ќ  Vm  Vm<%0     AppendixC:Resumeoftheintern#n"n"I(#.+(#(##28Vm<%X%݌ - }  Ќ    Vm  Vm0     Abstract#""J(#.(#(##1Vm݌  Ќ  Vm  Vmk0     1  Introduction#""J(#.\ \ (#(##1Vmk݌ @  Ќ  )!  )!40  0(#(#    1.1  VirtualEnvironments#""J(#.3 3 #(#(##1)!4O݌  e Ќ  )!  )!0  0(#(#    1.2  TheImmersiveVirtualEnvironmentsLaboratory#""J(#.<(#(##3)!5݌  : Ќ  )!  )!0  0(#(#    1.3  MedicalApplications#""J(#., , #(#(##3)!4݌   Ќ  Vm  Vm0     2  TheInternship#""J(#. (#(##4Vm ݌ i   Ќ  )!  )! 0  0(#(#    2.1  ObtainingtheInternship#""J(#. '(#(##4)! ݌ >  Ќ  Vm  Vm 0     3  TheProblem#""J(#. (#(##4Vm ݌ 8  Ќ  )!  )!| 0  0(#(#    3.1  WorkResponsibilities#""J(#.a a $(#(##4)!| ݌   Ќ  )!  )!c 0  0(#(#    3.2  GeneralProblemsofImmersiveEnvironments#""J(#.QQ9(#(##5)!c ~ ݌   Ќ  )!  )!_ 0  0(#(#    3.3  RequirementsoftheImmersiveMedicalEnvironment#""J(#.jj@(#(##7)!_ z ݌ g  Ќ  Vm  Vmb0     4  TheTeam#""J(#.(#(##7Vmb~݌ a Ќ  Vm  Vm'0     5  DataSources#""J(#. (#(##8Vm'C݌   Ќ  )!  )!0  0(#(#    5.1  TraditionalMethods#""J(#. "(#(##8)! ݌  Ќ  )!  )!0  0(#(#    5.2  TheVisibleHumanProject#""J(#.((#(##9)!݌ e Ќ  )!  )!0  0(#(#    5.3  DataUsageinanImmersiveEnvironment#""J(#.5(#(##9)!݌ : Ќ  Vm  Vm0     6  HardwareandSoftware#n"n"I(#. !(#(##10Vm݌ 4 Ќ  )!  )!0  0(#(#    6.1  Hardware#n"n"I(#. (#(##10)!݌   Ќ  )!  )!f0  0(#(#    6.2  Software#n"n"I(#. (#(##11)!f݌  Ќ  Vm  VmA0     7  Background&NecessarySkills#n"n"I(#.)(#(##12VmA]݌ 8 Ќ  Vm  Vm0     8  TheSolution#n"n"I(#. (#(##13Vm8݌ 2 Ќ  )!  )!0  0(#(#    8.1  UserInterface#n"n"I(#.  (#(##13)!݌   Ќ  )!  )!0  0(#(#    8.2  Functions#n"n"I(#. (#(##14)!݌  ! Ќ  )!  )!0  0(#(#    8.3  FutureDevelopment#n"n"I(#. !(#(##17)!݌ a!" Ќ  Vm  Vm0     9  RelatedworkatPNNL#n"n"I(#.k k (#(##19Vm݌  #[$ Ќ  )!  )!Z0  0(#(#    9.1  ProjectswithinIVE#n"n"I(#. "(#(##19)!Zu݌ #0% Ќ  )!  )!@0  0(#(#    9.2  MedicalProjectswithinPNNL#n"n"I(#.+(#(##19)!@[݌ $ & Ќ  Vm  Vm/0     10  Siggraph96#n"n"I(#.# # (#(##20Vm/K݌ _&!( Ќ  )!  )!0  0(#(#    10.1 4 GeneralRealityCompany#n"n"I(#.((#(##20)!݌ 4'") Ќ  Vm  Vm0     11  TheFinalPresentation#n"n"I(#.D D "(#(##22Vm݌ (.$+ Ќ  Vm  Vm0     12  TheFutureoftheIVELab#n"n"I(#.w w %(#(##22Vm݌ *%- Ќ  Vm  Vm0     13  FinancialCompensation#n"n"I(#. #(#(##23Vm݌ 2,'/ Ќ  Vm  Vmf 0     14  FutureEmploymentOpportunities#n"n"I(#.+(#(##23Vmf ݌ -,)1 Ќ  Vm  VmH!0     15  Conclusion#n"n"I(#.  (#(##24VmH!d!݌  Ќ  )!  )!"0  0(#(#    15.1 4 PNNL#n"n"I(#.  (#(##24)!","݌ Z Ќ  )!  )!"0  0(#(#    15.2 4 TheProject#n"n"I(#.  (#(##24)!"#݌ / Ќ  Vm  Vm#0     AppendixA:Glossary#n"n"I(#.  (#(##25Vm##݌ ) Ќ  Vm  Vm$0     AppendixB:Bibliography#n"n"I(#.~ ~ #(#(##27Vm$$݌   Ќ  Vm  VmW%0     AppendixC:Resumeoftheintern#n"n"I(#.+(#(##28VmW%s%݌ - }  Ќ     R  ` ` 00 % %%.% E  % %    WH  AbstractWHI HԌ  Ќ.  E.%%.  .XX%.%% 5   ThispaperdescribestheinternshipofJasonJeraldatBattellePNNL(Pacific   NorthwestNationalLaboratories)forthesummerof1996.  TheImmersiveMedicalEnvironmentprojectcreatesanartificial,nonphysicalspaceintowhichonecanenterandinteractwithmedicaldataThisistobeusedbyprofessionalmedicaldoctorstoanalyzepatientdata.Justlikeanytechnology,carefulresearchanddevelopmentwillcontinuetobeneededifwewantthebenefitstooutweightheproblems.00 XXX.X E X X    L  1  IntroductionLL hLԌ  Ќ.  E.XX.   : XXX.X G X X     :?M  1.1  VirtualEnvironments :?MM MԌ  Ќ.  G.XX.    Theconceptofimmersingoneselfinanonphysicalcreatedspacehasbeenaround !b formanyyears.EvanSutherlandproposedthatsimulationscouldbemoreexperientiallyimmersivebyplacingavideodisplayontheusershead.Theheadsorientationwouldbesensedandanimagecouldbeproducedinrealtimefromthepointofviewoftheuser.Sutherlandthenimplementedthisideaandthuscreatedthefirstheadmounteddisplay.Sincethistime,manyapplicationsforthistechnologyhavebeendeveloped.Recentlycrudeattemptsatsimulatingenvironmentshavebeenmade 6,~$$ possiblebyadvancingtechnologieswithcomputers.Althoughthesemanmadeworldsarestillintheirinfancy,theyarebeingdeveloped.  Thedifferencebetweenvirtualenvironmentsanddesktopvisualizationisthatinvirtualenvironmentsinputandoutputperipheralsaredesignedtobeintuitive.Thiswillallowtheusertointeractwiththecomputerinnaturalhumanwaysratherthancomputercentricways.Theultimatesystemwouldallowapersontousehis/herhisorherentirebodyandallofthesenses.  Perhapsthemostimportantpartofasimulatedenvironmentisthevisualrepresentation.Computergraphicsthusplaysaveryimportantroleinthisfieldofstudy.Oneofthemostpopularwaystodesignanenvironmentisbybuildinganapproximatemodelfrompolygons.Thesepolygonsareusuallytriangles,butsometimescontainmorevertices.Thesepolygonsarethengivenpropertiessuchascolor,transparency,andhierarchallinks.Lightsarethenaddedtoilluminatethescene.Themodelisthensentthroughagraphicalpipelinetotransformthedataintoanimagetobedisplayed. : XXX.X G X X     :pU  1.2 TheImmersiveVirtualEnvironmentsLaboratory :pUU UԌ X%  Ќ.  G.XX.    TheIVE(ImmersiveVirtualEnvironments)labatPNNLhassomeofthelatest ' " technologiesavailableforuse.Pastresearchhasmostlyincludedthebuildingandunderstandingofimmersiveenvironments.Arecentlyconcludedprojectlinkedimage +#& datatogetherinavirtualspace.Someofthesetechniquesarelatertobeusedinthemedicalprojectdescribedhere. : XXX.X G X X     :zX  1.3 MedicalApplications :zXX XԌ F  Ќ.  G.XX.    Technologyhasimprovedthewayinwhichweliveinmanyways.Inparticular  Healthhasbeenimprovedon.However,muchistobelearnedandimprovedonwithinthisfield.Usingcomputers,PNNLisresearchinganddevelopingmanyusefulapplicationsforuseinthemedicalprofession.  Duetothecomplicationsofhumanbiology,medicalimmersionshavebeenlimitedinthepast.Evenrealtimedesktopvisualizationofmedicaldatahasbeenlimitedtosmalldatasets.HoweverHowever,withadvancesincomputerhardwareandsoftware,thesetechniquesarenowbecomingfeasibleforrealisticsizeddatasets.  Atechniquecalledvolumevisualizationworksverywellformanymedicalapplications.Volumevisualizationisdifferentthandifferentfromtraditionalpolygonrendering.Themaindifferenceisthatwhilepolygonalmodelingmostcommonlyonlymodelstheshellofanobject,volumevisualizationmodelstheentiresolid.Thousandsofvoxels,whicharebasicallythreedimensionalpixels,areplacedinspace.EachoneEachofthesevoxelscanhaveuserdefinedpropertiessuchasmass,transparency,color,etc.Inthepastvolumevisualizationhasnotbeenpossibleduetothelimitsofcomputingspeed.Withincreasingpowerofcomputersthisisnowbecomingpossibletorenderthesevolumes +#& inrealtime.00 XXX.X E X X    h_  2  TheInternshiph__ _Ԍ F  Ќ.  E.XX.   : XXX.X G X X     :`  2.1 ObtainingtheInternship :` a `Ԍ f Ќ.  G.XX.    TheinternshipopportunitywasfirstdiscoveredviatheWorldWideWeb.The &  AWU(AssociatedWesternUniversities)sitewaslocated.AlonglistofinternshipϜopportunitiessopportunitiesthroughoutthecountrywaslistedalongwithcontacts.EmailEmailwasexchangedwithPNNLpersonnelregardingtheirpossibleneedforanewstudentfortheduringstudentduringthesummerof1996atPNNL.AreferencewithinPNNLwasalsoalreadyestablishedthroughascholarshipprogram.AnAWUform,anSERS(Science&EngineeringResearchSemesterform),andaresumewereweremailed.Soonareplycameinthemailalongwithaphonecallofferingtheinternshipwithoutanyquestionsasked,muchlessaninterview.00 XXX.X E X X    ze  3  TheProblemzee eԌ b% Ќ.  E.XX.   : XXX.X G X X     :f  3.1 WorkResponsibilities :fg gԌ (  Ќ.  G.XX.    Workwithinthelabwasoftenperformedunsupervised.Theinternwasexpectedto *B#" workoutofmotivationotherthanbydirectsupervision.Althoughnoexactschedulewaskept,theinternwasexpectedtowork40hoursaweek,whichoftenwaswasoftenexceeded.  TheinternsbasicresponsibilitiesweretoimproveontheimplementationwrittenbythepreviousinternScottDecker.Thisinitialcodeprovidedtheframeworkoftheproject.HoweverthecodehadtobealmostentirelyrewrittenbecauseoftheconversionfromAmbertoWTK(Seechapter6.2Software).Thiscodethencouldbeimprovedon.  WTKRelease3wasbeingimplementedwhenbetatestingofrelease6started.Thisreleasehadmanydifferencesfromrelease3andthecodeneededtobeconvertedonceagain.  Improvementofthesystemwasalsoexpectedduringandafterthetranslationofcode. : XXX.X G X X     :k  3.2 GeneralProblemsofImmersiveEnvironments :kl kԌ  Ќ.  G.XX.    ThedevelopmentofImmersiveEnvironmentsisstillinitsinfancy.Manyproblems B" needtobesolvedfortheseenvironmentstoreacharealisticsimulationofreality.   Lag Foranynumberoftrackers(devicesusedtoestablishphysicallocationsand %>  orientations),eachtrackermustperformitssensing,dataprocessing,andoutputinafractionofthetimethecomputerrequirestorenderoneframe.OtherwiseOtherwise,theperceivedimagewilllagbehindthemovementofthetracker.Thisappearstotheuser +#& as swimming..񛀀Thiscancauseproblemsrangingfromclumsinesstonausea.   Framerate Thehumanvisualsystemperceivessmoothmotionataround30   framespersecond.Thismeansanewimagemustbesenttothedisplaydeviceatleast30timespersecond.Ifthedisplayisstereo,then60framespersecondarerequired(30framespereye).   Toleranceoftrackers Currenttrackersaresubjecttojitter.Theexactlocationof H  anobjectmaynotbeabletocannotbedeterminedexactly,thusexactly.Thus,sequentialsamplesmayplacethemodelindifferingpositions.Interferencefrommetallicitemsmayalsocausethecomputertomisplaceobjects.     Thehapticsensorysystem Thehumanbodyisquiteadeptatsensingaccelerations n generatedbyvariousactionssuchasfalling,turning,andcollidingwithobjects.Currentmotionsimulatorsattempttofoolthebodybysmallaccelerations.    (p   Othersensorysystems Smell,taste,andheathavenotbeenresearchedmuchin J immersiveenvironments.Thesetechnologiesaremuchfartherinthefuturethananyoftheothersensoryinputs.Somemayconcludethatthesesensesarenotnearlyasimportant,butwhataboutfirefightingsimulations?Whatabouttelesurgery(smellisveryimportantinsurgery)?Orhowaboutavirtualcookbook?Virtualenvironmentswillnotbecompleteuntiltheseinputshavebeensimulated.  J'"   Simulatorsickness Someusersexperiencenauseaduetoproblemsofinconsistent $)l!$ sensoryinput.Differentusersareaffecteddifferently.Experimentshaveshownthe +L#& moreexperiencedauseris,thelesslikelyheorshewillbecomesick. : XXX.X G X X     :w  3.3 RequirementsoftheImmersiveMedicalEnvironment :w}w ewԌ l  Ќ.  G.XX.    Theprojectmustexpandontraditionalmedicalvisualization(e.g.,xraysandultra  , sound).Thereasonforportingthistoanimmersiveenvironmentisnotonlytoincreaseinterpretationofthedata,butallowadoctoreasyaccesstoapatientsdata.Thus,thesystemmustbestraightforwardandeasytouse.00 XXX.X E X X    y  4  TheTeamy'"      Steps2)and3)convertfromtheBOOMcoordinatesystemtothe̛  WTKcoordinatesystem *@#&   2 )Convertthe3x3matrixintoaquaternion           reverseYandZaxises  3 )Gettheheadmatrixpositiondatainavector r       reverseYandZpositions  4 )Relativizetherecord(Changetheabsolutetransformationtoarelative H!  ,t   transformation)  5 )Setthelastrecord   Л .    step6)seemstobecausingtheproblem  6 )񛀜SetScale񛀜relativetranslationformationbythesensitivityfactoroftherelativerecordamountof zoom. z Л   @  l   step(6)seemstobecausingtheproblem    7 )SettherecordinWTK    Step6)determinestheamountofrotationoftheviewpoint.Iftheuseriszoomedinclosetothedatathantherotationshouldbeslowerthaniffartheraway.Thiswouldfirstappeartobeasimplescalingoftheamountofrotationaboutanarbitraryaxis.However,thisisnotthecase.Approximatelytwoweeksandeightdifferentmathematicaltechniqueswereattempted,beforeMr.Maysuggestedtheinternmoveontosomethingelse.ThedefaultBOOMdriverdoesnotbehaveasneededfortheproject.Alongtheworldaxesthedriverperformswell,butasanyotheraxesarerotatedstrangethingshappen.Thisalsoisaffectedbytheamountofzoom.Therotationalspeedoftheviewpointiscurrentlybypassedandthussettothedefaultspeed.  +R#&    Orthogonalslices Thesethreedynamicsliceswerefirsttestedbydisplayingin  timedsequenceallslicesalongthevolumeworldx,y,andzaxeswhenin3Dcursormode.Later,asthecursorchangedlocation,thesliceswouldbeupdated.   r     Slicemanipulation Thisfunctionfirstcheckstoseeifthechosenimageisan L  orthogonalsliceoranotherimage.Ifso,itmakesacopy.Thetexturedpolygonisthenattachedasachildtothespherecursor.Ifthepickbuttonispushedthenthepolygondetachesitselffromthespherecursorandisplacedinthatlocationfacingtheorigin.   Multiresolution ThedataneedstobererenderedwithinVolPackatalower   Мresolutionattimestoincreaseperformance.Thedynamictexturemapsizeofthisrenderedimagealsochangessize.   Transparency VolPackhandlestransparentcy񛀛voxelswell.256levelsoftransparencyare N availableforeachvoxel.Thetransparenciesofvoxelsbehindothervoxelsaddtogethertoformatotaltransparency.WTKhoweverhasuserdefinablecutoffpointatwhichthepixelisturnedonoroff.   Interpolationofdata Asimplelinearinterpolationutilitywaswrittentoexpand ! datasets.VolPackdoesaverypoorjobofexpandingdata. : XXX.X G X X     :  8.3 FutureDevelopment : Ԍ P'" Ќ.  G.XX.    Manyfeaturesstillneedtobeimplementedinthesoftware.Plansforthenear )"$ futureinclude: +#&    Stereoimaging ThisiseasilydonewithWTKandVolPackbysimplyrendering  twoviewsfromslightlydifferentpositions.Unfortunately,thisrequirestwicetherenderingtime.   Dynamicdata Thiswastestedearlyindevelopmentwitheighttimevaryingdata L  setsofabeatingheart.Thetestsworkedexceptionallywell,exceptforthefactthattheframeupdaterateslowedtoaroundfourframespersecond.Also,thelagwasseveralseconds.   Truecolorofvolume ThiscaneasilybeimplementedasWTKisalreadyrendering   intruecolor.VolPackiscurrentlyrenderedineightbitmonochrome,butcanbealteredtorenderintruecolor,withonlyasmalllossofspeed.However,obtainingdataintruecolorisaproblem.   Spacializedsound ThisareahasnotbeenexploredindetailwithintheIVElab. (p WTKhoweverdoessupportspacializedsound.   OpacityRamp ThishasbeenhighlysuccessfulindesktopvisualizationatPNNL. * Thetransparencyofeachvoxelcanbedeterminedbythisramp.Ifonewantstoseetheboneswithinadataset,thenoneonlyneedstosettheopaquenessofthedensitywithinthatbonerangetoahighvalue.Alltheothervalueswouldbesettoalowopaquevalue.Similaradjustmentscanbemadetoviewvaryinglevelsofdetailoforganssuchastheheart.Notethatmaterialcanbemadesemitransparentsoonecanseethroughthinlayersofsuchmaterial.Theusercanadjustthisrampinrealtimeandseethe +L#& resultswithinseconds.Thisrampshouldbefairlyeasytoimplementwithintheenvironment.̜00 XXX.X E X X    Y  9  RelatedworkatPNNLY Ԍ  h Ќ.  E.XX.   : XXX.X G X X     :  9.1 ProjectswithinIVE : Ԍ @  Ќ.  G.XX.    AnotherprojectbeingdevelopedintheIVElabisamolecularvisualizationthat   willeventuallyallowvisualizationofthousandsofmoleculesandtheinteractionsofthesemolecules.Also,ageographicalvisualizationproject,whichallowsviewingfromaverylargescaletoasmallscale,isbeingdevelopedbyanotherintern. : XXX.X G X X     :4  9.2 MedicalProjectswithinPNNL :4 Ԍ B Ќ.  G.XX.    Muchofthecodeimplementedintheprojectfirsthadbeenimplementedinother r  software.Theopacityramphasbeendevelopedinadesktopapplication.The3Dcursoralsowasimplementedinadesktopapplicationfirst.  AveryusefulmedicalapplicationwascompletedinJuneof1996.AnSGIIndycomputeralongwithanUultraSsoundreceivingdevicewasbuiltintoabackpack.Theusercanenterahostileenvironmentwhereitmaynotbesafeformedicalstafftoenter.Theuserthenscansapatientandsendsthedataviasatellitetoaremotelocation.A +#$ doctorcanthenviewthepatientonamonitorusinga6DOFlocatingdevice.Thisdevicedeterminestheviewpointforthemonitortodisplay.Thisprojectallowsacertifieddoctortoexamineapatientwhomaybeinanotherpartoftheworldwherenodoctorsareavailable.Orifthepatientisonhisorherwaytoadoctor,thatdoctorcanstudythatpatientandpossiblyevendeterminetheproblembeforethepatienthasarrived.00 XXX.X E X X      10  Siggraph96? 'Ԍ  Ќ.  E.XX.    Siggraphisacomputergraphicsconferenceheldonceayear.Thousandsof  computergraphicsexpertsattendtheconferencetopresent,andbepresentedto,thenewesttechnologies.AlthoughPNNLhadnodirectassociationwithstudentsattendingSiggraph96,AWUdidprovidefundingfortheweekoftheconvention,soisconsideredpartoftheinternship. : XXX.X G X X     :  ݜ10.1  GeneralRealityCompany : Ԍ $  Ќ.  G.XX.    TheinternwaschosenasavolunteerforGeneralRealityCompany.Thiscompany <'  provideslowcostimmersionhardwareandsoftware.Severalapplicationswerepresented.Studentvolunteersdemonstratedallofthehardware&andsoftwarebeing *8#$ presented,helpedsetuphardwareandsoftware,andansweredtechnicalquestions.  HardwareconsistedofanSGIIndy,4PCs,several5thGloves,severalCyberEyeheadmounteddisplays,andPolhemustrackers.  SoftwareconsistedofWindowsNT,AliasWavefront,SoftImage,WTK,Amber,SuperScape,andpersonalizedsoftware.  GesturerecognitionsoftwarebeingdevelopedattheUniversityofWashingtonbyMarkBillinghurstwasshown.Thedemoshowedtwohandedgesturerecognition,whichallowedtheusertoperformsolidmodelingwithonlythesehandgestures.  AvirtualMarsenvironmentwasshown.ThisdatabaseistheactualdataobtainedfromtheVikingmission.ThesoftwareusedbythisapplicationisWTK.  Popularentertainmentsoftwarewasshowninusewithaheadmounteddisplay.Thisconsistedofasimpledrivertoconvertthetrackerdatafromtheheadmounteddisplaytoaformatthatthegamingsoftwareexpected.  AtrainingapplicationwasshownwithsoftwareusedbyMotorolaUniversity.Thissimulatedroboticmanufacturinglinehasbeenshowntobemoreeffectivethantrainingintraditionalways.ThesoftwareusedbythisapplicationisSuperscape.  HandmotioncaptureforAliasWavefrontandSoftimagewasalsodemonstrated.Thecomputertrackshandgesturesthatallowanimatorsawiderangeoftoolsfromgivingcharactersfacialexpressionstomakinganimalsmoverealistically.̜ *.#&  *.#& Л00 XXX.X E X X    #  11  TheFinalPresentation# Ԍ  Ќ.  E.XX.    OnAugust16,ProfessionalmedicaldoctorsarrivedatPNNLforapresentationof   medicalworkbeingresearched.EarlythatmorningthesimpletaskofchangingtheoutputdisplayfromthemonitortotheBOOMdevicewasperformed.However,anewoperatingsystemalongwithupgradedhardwarewasrecentlyinstalled.Thisnewmaterialwascausingsmallproblems,butnothingdrasticuntilthechangeofdisplayswasperformed.Thesystemcrashedandcouldnotberebooted.Withinanhourbeforethepresentation,halfthesupportstaffofPNNLalongwithphonesupportacrossthecountrywastryingtodeterminetheproblem.Inplaceoftheenvironment,avideotapecreatedduringtheinitialstagesoftheprojectwasshown.Approximatelyonehourafterthepresentationwascomplete,theproblemwassolvedandthesystemwasupandrunningagain.00 XXX.X E X X      12  TheFutureoftheIVELab\ DԌ "2 Ќ.  E.XX.    ThecurrentIVElabisalargeofficeroomconvertedlab.HoweveranewIVElabis  &R currentlybeingbuiltunderthedirectionofRichardMayinthenewEMSL(EnvironmentalMolecularSciencesLaboratory)building.ThislabisbeingbuiltspecificallyforImmersiveEnvironmentsandhasmanyadvantagesoverthecurrentlab. +#$ Onesuchadvantageismetalsthatmayaffectmagnetictrackersarecarefullybeingplacedastohaveaminimumaffect.00 XXX.X E X X      13  FinancialCompensation ~Ԍ  h Ќ.  E.XX.    AWUpaidtheintern$250aday.PNNLgrantedtheuseofthefacilitiesalongwith @  $50aweekforhousing.  GeneralRealityCompanyprovidedhousingfortheweekofSiggraph96.Travelandfoodwastheresponsibilityofthestudent.00 XXX.X E X X    {  14  FutureEmploymentOpportunities{ Ԍ \ Ќ.  E.XX.    Theinternshipprovidedverygoodexperiencebackgroundforonewantingtoenter |  suchafield.Muchwaslearned.FutureworkbeinglookedintoincludecontinuingresearchatPNNL,workingwiththeCAVEatArgonneNationalLaboratories(ofwhichalreadyofferedaninternship)andresearchatNASAJetPropulsionLaboratories. +#$ 00 XXX.X E X X    I  15  ConclusionI Ԍ  Ќ.  E.XX.   : XXX.X G X X     :  15.1 PNNL : Ԍ   Ќ.  G.XX.    Muchwaslearnedduringtheinternshipperiod.BothPNNLandstudentinterns P  benefitfromsuchwork.Thestudentgainsvaluableexperienceneededintodaysworkforce,whilePNNLgainsvirtuallyafreeworkforce.Ofcourse,sacrificesmustbemadeofbothinterns(lowpay)andPNNL(suchastrainingandtrustingthestudents),butbothbenefitfromtheoveralleffectintheend.̀ : XXX.X G X X     :N  15.2 TheProject :N Ԍ l Ќ.  G.XX.    Althoughtheprojecthasalongwaytogo,itseemstobeofftoaverygoodstart. , Withcontinuedresearch&developmenttheworldwillbecomeabetterplacetolive.Eventually,ImmersiveMedicalEnvironmentswillsavemanylives. +#$ 00 XXX.X E X X    G  AppendixA:GlossaryG Ԍ  Ќ.  E.XX.    6DOF Sixdegreesoffreedom.Thisconsistsoftranslationalongthreeorthogonal   axesalongwithrotationaboutthesethreeaxes(roll,pitch,andyaw).      desktopvisualization Throughtheuseofacomputer,dataisanalyzedand  renderedintoanimagethatisdisplayedonamonitor.   forcefeedback Strongforcesareappliedtoausertolethimorherknowthereisa L  solidobjectobstructingmovement.   headmounteddisplay Avideodeviceandtrackerthatisplacedonausershead. N Thetrackerkeepstrackoftheuserslocationandorientation.Thisinformationissenttoacomputerwhichdeterminestheviewpointoftheeyes,rendersanimage(s)andreturnstheimagetothevideodisplayontheheadmounteddisplay     realtime Theresponseofthecomputerisfastenoughthatahumanperceivesthe t reactiontohappenimmediatelywithnodelay.   spacializedsound Justasauserperceivesthelocationofanobjectvisually,one .!v canalsoperceivethelocationofanobjectaudibly.Thisisdonebyslightchangesinwhateachearhears.  $0   stereoimaging 򛀜Theproductionoftwoimagestakenfromaslightlydifferent &   viewpoint.Theseimagesareeachseenbyoneeye.Theuserthenperceivesdepthperceptionandcanjudgedistancesmuchmoreaccurately.   tactilefeedback 󀜀Tinyforcesareappliedoverasmallarea.Thesedevicesallow V,$& theusertodeterminethe feeloftheanobject.   texturemap Animageismappedontoanobject.Thisaddsvisualrealismwithout   addingmuchcomplexitytoamodel.   trackers Thesedevicesareusedtoestablishphysicallocations.Theycanbe L  attachedtoahumanbodytotrackthehead,hands,legs,etc.   truecolor 󀜀Eightbitseachofred,green,andbluerepresentthiscolorspace.Thisis N  atotalofapproximately16.7millioncolors.  .    virtualenvironment Anartificiallycreatednonphysicalspaceintowhichonecan   enterandinteractwithdata.   volumevisualization Thevisualizationofsolidgeometrycommonlyintheformof z voxels.   voxel Thethreedimensionalequivalentofapixel.Thesevoxelscanhave 4| propertiessuchasmass,color,andtransparency.  +R#& 00 XXX.X E X X      AppendixB:Bibliography Ԍ  Ќ.  E.XX.  AssociatedWesternUniversities,Inc.StudentFellowshipProgram.4190South  X   HighlandDrive,Suite211SaltLakeCity,UT841242600XXX.XJ.D.Foley,A.V.Dam,S.K.Feiner,J.F.Hughes.#.XXXX#ԀComputerGraphics:Principles 9   andPractice,SecondEdition.AddisonWesleySystemsProgrammingSeries,July     1990.ACMTransactionsonGraphics13(3)July1994,pp.256-276. G  XXX.XJ.C.Hart,G.K.Francis,L.H.Kauffman#.XXXX#.Visualizingquaternionrotation.ACM     TransactionsonGraphics13(3)July1994,pp.256-276. (p  XXX.XP.Lacroute,MLevoy#.XXXX#.FastVolumeRenderingUsingaShearWarpFactorizationof 6   theViewingTransformation.ComputerGraphics(Proc.Siggraph94)28,(1994), Q   451458XXX.XR.May#.XXXXO#.InternAdvisor.PacificNorthwestNationalLaboratories,Richland,WA z   MayAug1996XXX.XM.Papka,R.Hudson,M.Szymanski#.XXXX#.PersonalInterview.ArgonneNational !$   Laboratories,Chicago,IL.Sept1996 #N& XXX.X#.XXXX# :+#2 00 XXX.X E X X    d  AppendixC:Resumeoftheinternd Ԍ ` Ќ.  E.XX.  XXXX.X.X A3) (#dE (#AJasonJerald 4  ` #.XX.#. X.X 󀀀345SGrandAveAptFPullmanWA99163(509)3320115jjerald@eecs.wsu.edu   #.XX. #.&&X.XOBJECTIVE:   ЀToacquireaninternshipforthesummerof1997inthefieldofcomputergraphicswhichallowsforaninteresting̀fastpacedlearningenvironment.RELATEDEXPERIENCE:    򀀀 #.XX&.&M #.X.XSiggraph96GeneralRealityCompanyVolunteer#.XX. #.&&X.X D  p     Aug1996 .  ЀDutiesincludedsettinguphardware,demoingofhardware/software,andansweringtechnicalquestions.̀HardwarerangedfromPCSandSGIstoheadmounteddisplaysandDataGloves. ̀ #.XX&.& #.X.XBattellePacificNorthwestNationalLaboratories#.XX.Y #.&&X.X D  p     May1996Aug1996 * ЀWorkedwithasmallteamonthedesignandimprovementofaVirtualMedicalEnvironmentintheIVÈ(ImmersiveVirtualEnvironments)lab.Theworkincludedtheintertwiningofvolumetricdataalongwithtraditional̀polygonalbasedmodeling.Responsibilitiesincludedthemajorityofprogrammingforthevirtualenvironment. 򀀀 "  󀀀#.XX&.& #.X.XSiggraph95StudentVolunteer#.XX.#.X.X <  h          D #.XX.@#.&&X.XAug1995 %$ ЀWorkedwithvariouscompaniesdemoinghardwareandsoftware.Answeredtechnicalquestions.̀Attendedlecturesandexhibitsinmysparetime. #.XX&.&#.X.X 򀀀#.XX.#.X.XICFKaiserHanford#.XX."#.&&X.X     <  h         May1994Aug1994 #!, ЀModeler/Animatorposition.Useofvarioussoftwareforengineeringapplications.3Dmechanicaldesign.̀Evaluationofnewsoftwarereleasessuchas3dStudioandAutoCAD. 򀀀 #.XX&.&v#.X.XWestinghouseHanfordCompany#.XX.#.&&X.X h          D  p June1992Aug1993 (}#4 ЀQuicklymovedintodesigner/modeler/animatorpositionafterstartingasDesignServicesAssistant..̀Becamefamiliarwithvarioussoftware. 9.(< SKILLS: ` Ѐexperiencedinprogramminglanguages:Basic,C,C++,ML,Assemblỳsoftwareproficiency:OpenGL,WorldToolKit,VolPack,AutoCAD,3dStudio,Wavefront,PhotoShop̀knowledgeablewithoperatingsystems:DOS,Windows,Unix̀EDUCATION:  ;  ЀWashingtonStateUniversitỳSeniorinComputerSciencewithcomputergraphicsspecialization.̀Minors:Mathematics,ElectricalEngineering,Music,PsychologỳCumulativeGPA:3.3ACHIEVEMENTS/AWARDS:   Ѐ1996#.XX&.&q#.X.XԀAssociatedWesternUniversitiesGrant#.XX.#.&&X.X.ThisprogramprovidedfundingfortheBattelleintern. T Ѐ1995#.XX&.&}#.X.XSiggraphPioneerGrant#.XX.#.&&X.X.Sixoftheseinternationalawardsweregivenfortheyear1995. o Ѐ1993#.XX&.&u#.X.XWashingtonSoftwareAssociationScholarship#.XX.#.&&X.XThisfouryearscholarshipwasbasedonananimationI J   created.̀REFERENCES: C" ЀRichardMayScientist,summer96internadvisor,BattellePNNL         4  `       <  h          D  p   (509)3756766 x ra_may@pnl.gov a& ̀JohnHart  AssistantProfessorofWSU,SiggraphDirectorofCommunications ? *          4  `       <  h          D  p   (509)3352343 x hart@eecs.wsu.edu ~!, ̀ArthurZwernPresident,GeneralRealityCompany   #0          4  `       <  h          p   (408)2898340 x arthur@genreality.com ;%2 Ѐ#.XX&.&#