PROJECTION AUGMENTED MODEL

A projection augmented model (PA model): 

an element sometimes employed in virtual reality systems. It consists of a physical three-dimensional model onto which a computer image is projected to create a realistic looking object. Importantly, the physical model is the same geometric shape as the object that the PA model depicts.

Spatially augmented reality (SAR) renders virtual objects directly within or on the user's physical space. A key benefit of SAR is that the user does not need to wear a head-mounted display. Instead, with the use of spatial displays, wide field of view and possibly high-resolution images of virtual objects can be integrated directly into the environment. For example, the virtual objects can be realized by using digital light projectors to paint 2D/3D imagery onto real surfaces, or by using built-in flat panel displays.

Real objects can be physically handled and naturally manipulated to be viewed from any direction, which is essential for ergonomic evaluation and provides a strong sense of palpability. Although simulated hap tic feedback devices enable some aspects of computer-generated objects to be touched, they cannot match this level of functionality. It is, therefore, unsurprising that physical objects are still used for many applications, such as product design. However, computer-generated objects have a key advantage; they provide a level of flexibility that cannot be matched by physical objects. Therefore, a display is needed that somehow joins the real physical world and computer-generated objects together, thus enabling them to be experienced simultaneously.
Tangible user interfaces (TUI) and augmented reality both aim to address this issue. TUI systems use real physical objects to both represent and also interact with computer-generated information. However, while TUIs create a physical link between real and computer-generated objects, they do not create the illusion that the computer-generated objects are actually in a user’s real environment. That is the aim of augmented reality.

Unlike virtual reality (VR), which immerses a user in a computer-generated environment, augmented reality (AR) joins together physical and virtual spaces by creating the illusion that computer-generated objects are actually real objects in a user’s environment. Furthermore, head-mounted-display based AR and VR systems can directly incorporate physical objects. Thus, as a user reaches out to a computer-generated object that they can see, they touch an equivalent physical model that is placed at the same spatial location. Such systems enable the computer-generated visual appearance of the object to be dynamically altered, while the physical model provides hap tic feedback for the object’s underlying form. However, head-mounted-display based systems require users to wear equipment, which limits the number of people who can simultaneously use the display.
A variant of the AR paradigm that does not suffer from these limitations is spatially augmented reality. Spatially augmented reality displays project computer-generated information directly into the user’s environment. Although there are several possible display configurations, the most natural type is the projection augmented model.
A projection augmented model (PA model) consists of a physical three-dimensional model, onto which a computer image is projected to create a realistic looking object. Importantly, the physical model is the same geometric shape as the object that the PA model depicts. For example, the image projected onto the objects provides color and visual texture, which makes them appear to be made from different materials.

PA models use a unique combination of physical objects and computer-generated information, and hence they inherit advantages from both. “The human interface to a physical model is the essence of ‘intuitive’. There are no widgets to manipulate, no sliders to move, and no displays to look through (or wear). Instead, we walk around objects, moving in and out to zoom, gazing and focusing on interesting components, all at very high visual, spatial, and temporal fidelity”. PA models combine the high level of intuitiveness of physical models with the flexibility and functionality of computer graphics, such as the ability to be quickly altered, animated, saved and updated (Jacucci, Oulasvirta, Psik, Salovaara & Wagner, 2005). Thus, a PA model essentially gives a physical form to a computer-generated object, which a user can touch and grasp with their bare hands. It is therefore unsurprising that user studies, which compared PA models to other Virtual and Augmented Reality displays, found PA models to be a natural and intuitive type of display (Nam & Lee, 2003; Stevens et al., 2002).
However, the PA model concept is not new. In fact, one of the first PA model type displays was created over twenty years ago when Naimark built the ‘Displacements’ art installation (Naimark, 1984) and more recently in the “Haunted Mansion” attraction in Disney World (Liljegren & Foster, 1990). At the time technology did not exist for a PA model to be much more than an artistic statement. However, given the technology available today and a little “unfettered imagination”, exploring novel projection displays is now “potentially boundless”.

The growth in PA model technology has been marked by the recent recreation of Naimark’s ‘Displacements’ installation at SIGGRAPH (Displacements, 2005). Specifically, new technology has been developed that semi-automates the process of both creating and aligning the physical model and projected image. This supports multiple projectors, which enables a PA model to be illuminated from every direction. Furthermore, powerful projectors (2000-3000 lumens) can be used to allow a PA model to be located in a well-lit room (Nam, 2005; Memory, Keller & Staplers, 2003). However, whilst this technology enables a PA model to be a viable and useful type of display, it does not address its main aim.
A PA model aims to create the illusion of actually being the object that it depicts. For example, when used for a product design application, it is important that a PA model provides a convincing perceptual impression of actually being the final product (Nam, 2006; Sakes, 2006; Verlinden, Horvath & Edelenbos, 2006; Keller & Sappers, 2001). Similarly, when used for a museum display application to create a replica of an artifact, a PA model aims to create the illusion of being the real artifact (Hirooka & Satio, 2006; Senckenberg Museum, 2006; Bimber, Gatesy, Witmer, Raskar & Encarnacao, 2002; Museum of London, 1999).