A mixed Reality Approach for Interactively Blending Dynamic Models with Corresponding Physical Phenomena
Download 11.36 Mb.
|
|
To visualize the superimposed gas flowmeters, users look through a tracked 6DOF magic lens (figure 5.3). The lens allows users to move freely around the machine and view the simulation from a first person perspective, thereby augmenting their visual perception of the real machine with the overlaid VAM model graphics. The relationship between the user’s head and the lens is analogous to the OpenGL camera metaphor. The camera is positioned at the user’s eye, and the projection plane is the lens; the lens renders the VAM simulation directly over the machine from the perspective of the user. Through the lens, users can view a first-person perspective of the VAM model in context with a photorealistic 3D model of the real machine. The 3D machine model appears on the lens in the same position and orientation as the real machine, as if the lens were a transparent window (or a magnifying glass) and the user was looking through it. 5.1.2 Interaction In this Real-Machine context, users interact with the simulation through their interactions with the real machine, i.e., the anesthesia machine acts as tangible user interface. To facilitate this interaction style, the interface and the simulation must be synchronized. For example, the gas flowmeters model (specifically the graphical representation of the gas particles’ flow rate and the flowmeter bobbin icon position) must be synchronized with the real machine. That is, changes in the rate of the simulated gas flow must correspond with changes in the physical gas flow in the real anesthesia machine. To facilitate this coupling, this system uses motion detection via computer vision techniques to track the setting of the physical flowmeters. This setting corresponds to the real gas flow rate of the machine. Then, the gas flow rates (as set by the user on the real flowmeters) are transmitted to the simulation in order to set the flow rate of the corresponding gas in the transparent reality simulation. In effect, if a user turns the N2O knob on the real machine to increase the real N2O flow rate (figure 5.4), the simulated N2O flow rate will increase as well. Then the user can visualize the rate change on the magic lens interactively, as the blue particles (icons representing the N2O gas “molecules”) will visually increase in speed until the user stops turning the knob. Thus, the real machine is an interface to control the simulation of the machine. The transparent reality model visualization (e.g., visible gas flow and machine state) is synchronized with the real machine. With this synchronization, users can observe how their interactions with the real machine affect the model in context with the real machine. The overlaid diagram-based dynamic model enables users to visualize how the real components of the machine are functionally and spatially related, thereby demonstrating how the real machine works internally. This coupling or mirroring of the overlaid VAM visualization and real machine interaction may help users to more effectively visualize the mappings between the VAM model and the real machine. Using the real machine controls as the user interface to the model minimizes the need to interact with a pointing device that can be a challenge for some, for example when using a click and drag rotation with the mouse to turn the flowmeters. Additionally, users get to experience the real location, tactile feel and resistance of the machine controls. For example, the O2 flowmeter knob is fluted while the N2O flowmeter knob is knurled to provide tactile differentiation. 
Figure 5.4: A user turns the N2O knob on the real machine and visualizes how this interaction affects the overlaid VAM model. 5.1.3 HUD Visualization 
Figure 5.5: The menu at the bottom of the HUD points the user in the direction of each spatially reorganized VAM component in 3D. The tubes have been removed to make the icons more visible. Directory: research research -> Charter School Enrollment Data Annual Report research -> Lyra Viol Composers research -> Geographies of Race and Food research -> Author (s) title research -> The Media and Intercollegiate Sports research -> Project Title: Research and Development for goes-r risk Reduction Principal Investigator research -> Why Everyday Life Matters: Class, Community and Making Life Livable Les Back research -> Ecocritique and the Materialities of Animation Download 11.36 Mb. Share with your friends:
|