Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are



Download 374.92 Kb.
Page2/3
Date26.04.2018
Size374.92 Kb.
#46902
1   2   3
Augmented reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated sensory input such as sound, video, graphics or GPS data. It is related to a more general concept called mediated reality, in which a view of reality is modified (possibly even diminished rather than augmented) by a computer. As a result, the technology functions by enhancing one’s current perception of reality. Sixth Sense is based on the concept of anywhere computing. It essentially allows you to access information from the Internet and project that information on any surface, including your hand. It reads human gestures and turns any surface into an interactive screen. It senses objects around you, reads your hand gestures and immediately displays relevant information. This paper is a primary research on the understanding of the technology, finding its current applications in all possible domains and then suggesting future of these technologies. The Paper will conclude by focusing on the human and ethical aspect for the selected topic, before giving a future scope of work that can be carried out using this primary research work.

Introduction to Sixth Sense and Augmented Reality

Sixth Sense [1]

Sixth Sense: 'SixthSense' is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information.
We've evolved over millions of years to sense the world around us. When we encounter something, someone or some place, we use our five natural senses to perceive information about it; that information helps us make decisions and chose the right actions to take. But arguably the most useful information that can help us make the right decision is not naturally perceivable with our five senses, namely the data, information and knowledge that mankind has accumulated about everything and which is increasingly all available online. Although the miniaturization of computing devices allows us to carry computers in our pockets, keeping us continually connected to the digital world, there is no link between our digital devices and our interactions with the physical world. Information is confined traditionally on paper or digitally on a screen. SixthSense bridges this gap, bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand gestures. ‘SixthSense’ frees information from its confines by seamlessly integrating it with reality, and thus making the entire world your computer. 
Augmented Reality [2]

Augmented Reality: Video games have been entertaining us for nearly 30 years, ever since Pong was introduced to arcades in the early 1970s. Computer graphics have become much more sophisticated since then, and game graphics are pushing the barriers of photorealism. Now, researchers and engineers are pulling graphics out of your television screen or computer display and integrating them into real-world environments. This new technology, called augmented reality, blurs the line between what's real and what's computer-generated by enhancing what we see, hear, feel and smell.

Everyone from tourists, to soldiers, to someone looking for the closest subway stop can now benefit from the ability to place computer-generated graphics in their field of vision. audio will coincide with whatever you see. These enhancements will be refreshed continually to reflect the movements of your head. Similar devices and applications already exist, particularly on Smartphone like the iPhone.



Augmented Reality Technology [3]

The objects of the real world observed by the user (world reference frame) are sent to the computer, which generates the virtual objects (in virtual reference frame). The real and the virtual objects (scenes) are mixed and rendered in such a way to give the user the perception of observing one integrated scene. Depending on what kind of equipment is used, different approaches can be followed, which result in diverse type of systems architectures. However, four very general components (and corresponding technologies) are always present in an AR system, i.e. displays, tracking systems, devices for interaction and graphics systems (computer).



How it Works?

  1. The scene is viewed by an imaging device, which in this case is depicted as a video camera.

  2. The camera performs a perspective projection of the 3D world onto a 2D image plane.

  3.  The generation of the virtual image is done with a standard computer graphics system.

  4. The virtual objects are modeled in an object reference frame.

  5. The graphics system requires information about the imaging of the real scene so that it can correctly render these objects.

  6. This image is then merged with the image of the real scene to form the augmented reality image.

Figure 1: Technology of Augmented Reality

Technology of Sixth Sense [4]

Figure 2: How it works

The sixth sense technology uses different technologies like gesture recognition, image processing, etc. At present the commercial product isn’t launched but the prototype is prepared. The sixth sense prototype is made using very common and easily available equipments like pocket projector, a mirror, mobile components, color markers and a camera.

The projector projects visual images on a surface. This surface can be wall, table, book or even your hand. Thus, the entire world is available on your screen now. When user moves their hands to form different movements with colored markers on the finger tips, the camera captures these movements. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. Recognition is made using computer vision technique. These markers act as visual tracking fiducials. The software program processes this video stream data and interprets the movements into gestures. The gestures are different from one another and are assigned some commands. These gestures can act as input to application which is projected by the projector. Since, the projector is aligned downwards for compactness; therefore images would be formed at the user’s feet if mirror wasn’t used. The mirror reflects the image formed by the projector to front. The entire hardware is fabricated in the form of a pendent.



Augmented Reality

Applications as of 2011 [5]

Advertising: Usage of AR to promote products via interactive AR applications is becoming common now. For example Nissan (2008 LA Auto Show), Best Buy (2009), Volvo (2011, S60 Campaign) and others used webcam based AR to connect 3D models with printed materials. There are numerous examples of connecting mobile AR to outdoor advertising.

Task support: Complex tasks such as assembly, maintenance, and surgery can be simplified by inserting additional information into the field of view. For example, labels can be displayed on parts of a system to clarify operating instructions for a mechanic who is performing maintenance on the system. AR can include images of hidden objects, which can be particularly effective for medical diagnosis or surgery.

Examples include a virtual X-ray view based on prior tomography or on real time images from ultrasound and confocal microscopy probes or open NMR devices. AR can enhance viewing a fetus inside a mother's womb.



Navigation: AR can augment the effectiveness of navigation devices. For example, building navigation can be enhanced to aid in maintaining industrial plants. Outdoor navigation can be augmented for military operations or disaster management. Head-up displays or personal display glasses in automobiles can provide navigation and traffic information. Head-up displays are currently used in fighter jets. These systems include full interactivity, including gaze tracking. They are also currently used by car manufacturers as BMW, Corvette and GM in car windshields, mostly to display meter information, traffic information.

Industrial: AR can be used to compare digital mock-ups with physical mock-ups for efficiently finding discrepancies between them. It can safeguard digital data together with existing real prototypes, and thus reduce the number of real prototypes and improve the quality of the final product.

Military and emergency services: Wearable AR can provide information such as instructions, maps, enemy locations, and fire cells.

Art: AR can help create art in real time integrating reality such as painting, drawing and modelling. AR art technology has helped disabled individuals to continue pursuing their passion.

Architecture: AR can simulate planned construction projects.

Sightseeing: Guides can include labels or text related to the objects/places visited. With AR, users can rebuild ruins, buildings, or even landscapes as they formerly existed.

Time: Historical events such as battle re-enactments can be augmented onto current landscapes.

Collaboration: AR can help facilitate collaboration among distributed team members via conferences with real and virtual participants.

Entertainment and education: AR can create virtual objects in museums and exhibitions, theme park attractions, games and books. AR can also be used to make games that can be played outdoors. 

Commerce: AR can be used to display certain products at another way. For example, the lego-boxes in the lego-store at Schaumburg are fitted with a QR code which show the product when it's assembled. AR can also be used as an aid in picking clothing.

Performance: AR can enhance concert and theatre performances. For example, artists can allow listeners to augment their listening experience by adding their performance to that of other bands/groups of users.

Translation: AR systems can provide dynamic subtitles in the user's language. [8, 9, 10, 11, 12]


Download 374.92 Kb.

Share with your friends:
1   2   3




The database is protected by copyright ©ininet.org 2024
send message

    Main page