Sixth Sense [1]
Sixth Sense: 'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.
We've evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses to
perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges this gap, bringing intangible, digital information
out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘SixthSense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer.
Augmented Reality [2]
Augmented Reality: Video games have been entertaining us for nearly 30 years, ever since Pong was introduced to arcades in the early 1970s. Computer graphics have become much more sophisticated since then, and game graphics are pushing the barriers of photorealism. Now, researchers and engineers are pulling graphics out of your television screen or computer display and integrating them into real-world environments. This new technology, called augmented reality, blurs the line between what's real and what's computer-generated by enhancing what we see, hear, feel and smell.
Everyone from tourists, to soldiers, to someone looking for the closest subway stop can now benefit from the ability to place computer-generated graphics in their field of vision. audio will coincide with whatever you see. These enhancements will be refreshed continually to reflect the movements of your head. Similar devices and applications already exist, particularly on Smartphone like the iPhone.
Augmented Reality Technology [3]
The objects of the real world observed by the user (world reference frame) are sent to the computer, which generates the virtual objects (in virtual reference frame). The real and the virtual objects (scenes) are mixed and rendered in such a way to give the user the perception of observing one integrated scene. Depending on what kind of equipment is used, different approaches can be followed, which result in diverse type of systems architectures. However, four very general components (and corresponding technologies) are always present in an AR system, i.e. displays, tracking systems, devices for interaction and graphics systems (computer).
How it Works?
The scene is viewed by an imaging device, which in this case is depicted as a video camera.
The camera performs a perspective projection of the 3D world onto a 2D image plane.
The generation of the virtual image is done with a standard computer graphics system.
The virtual objects are modeled in an object reference frame.
The graphics system requires information about the imaging of the real scene so that it can correctly render these objects.
This image is then merged with the image of the real scene to form the augmented reality image.
Figure 1: Technology of Augmented Reality
Technology of Sixth Sense [4]
Figure 2: How it works
The sixth sense technology uses different technologies like gesture recognition, image processing, etc. At present the commercial product isn’t launched but the prototype is prepared. The sixth sense prototype is made using very common and easily available equipments like pocket projector, a mirror, mobile components, color markers and a camera.
The projector projects visual images on a surface. This surface can be wall, table, book or even your hand. Thus, the entire world is available on your screen now. When user moves their hands to form different movements with colored markers on the finger tips, the camera captures these movements. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. Recognition is made using computer vision technique. These markers act as visual tracking fiducials. The software program processes this video stream data and interprets the movements into gestures. The gestures are different from one another and are assigned some commands. These gestures can act as input to application which is projected by the projector. Since, the projector is aligned downwards for compactness; therefore images would be formed at the user’s feet if mirror wasn’t used. The mirror reflects the image formed by the projector to front. The entire hardware is fabricated in the form of a pendent.
Augmented Reality
Applications as of 2011 [5]
Advertising: Usage of AR to promote products via interactive AR applications is becoming common now. For example Nissan (2008 LA Auto Show), Best Buy (2009), Volvo (2011, S60 Campaign) and others used webcam based AR to connect 3D models with printed materials. There are numerous examples of connecting mobile AR to outdoor advertising
.
Task support: Complex tasks such as assembly,
maintenance, and surgery can be simplified by inserting additional information into the field of view. For example, labels can be displayed on parts of a system to clarify operating instructions for a mechanic who is performing maintenance on the system. AR can include images of hidden objects, which can be particularly effective for medical diagnosis or surgery.
Examples include a virtual X-ray view based on prior tomography or on real time images from ultrasound and confocal microscopy probes or open NMR devices. AR can enhance viewing a fetus inside a mother's womb.
Navigation: AR can augment the effectiveness of navigation devices. For example, building navigation can be enhanced to aid in maintaining industrial plants. Outdoor navigation can be augmented for military operations or disaster management. Head-up displays or personal display glasses in automobiles can provide navigation and traffic information. Head-up displays are currently used in fighter jets. These systems include full interactivity, including gaze tracking. They are also currently used by car manufacturers as BMW, Corvette
and GM in car windshields, mostly to display meter information, traffic information.
Industrial: AR can be used to compare digital mock-ups with physical mock-ups for efficiently finding discrepancies between them. It can safeguard digital data together with existing real prototypes, and thus reduce the number of real prototypes and improve the quality of the final product.
Military and emergency services: Wearable AR can provide information such as instructions, maps, enemy locations, and fire cells.
Art: AR can help create art in real time integrating reality such as painting, drawing and modelling. AR art technology has helped disabled individuals to continue pursuing their passion.
Architecture: AR can simulate planned construction projects.
Sightseeing: Guides can include labels or text related to the objects/places visited. With AR, users can rebuild ruins,
buildings, or even landscapes as they formerly existed.
Time: Historical events such as battle re-enactments can be augmented onto current landscapes.
Collaboration: AR can help facilitate collaboration among distributed team members via conferences with real and virtual participants.
Entertainment and education: AR can create virtual objects in museums and exhibitions, theme park attractions, games and books. AR can also be used to make games that can be played outdoors.
Commerce: AR can be used to display certain products at another way. For example, the lego-boxes in the lego-store at Schaumburg are fitted with a QR code which show the product when it's assembled. AR can also be used as an aid in picking clothing.
Performance: AR can enhance concert and theatre performances. For example, artists can allow listeners to augment their listening experience by adding their performance to that of other bands/groups of users.
Translation: AR systems can provide dynamic subtitles in the user's language. [8, 9, 10, 11, 12]
Share with your friends: