Augmented reality adds or removes sensory data from our perception of the world in order to modify our experience of reality. For example, the mobile game Pokemon Go is augmented reality. Pokemon Go adds a fictional world on top of the real world, and it does this by adding digital creatures, digital locations, and more, on top of the real world of its players.
However, AR is more than a feature, collection of technologies, or product.
AR markers, also called fiducial markers, aid computer vision algorithms in grounding (registering) virtual objects within the physical world.
Markers exists as one sign with multiple meanings. The sign always exists to the AR app to register virtual content. Additionally the sign can signal to the viewer that AR exists here, as well as any other sign the creator imagines.
The first experiment consists of an AR sign drawn in charcoal, as well as a QR code drawn in charcoal. When a viewer scans the QR code with their phones, they are taken to a website. If the viewer then points their camera, with the website up, at the AR sign, a framed drawing of a chair is registered on the paper.
The second experiment consists of a charcoal drawing of the shadow cast by a chair. This shadow was used by an AR application to register the digital chair that casts the shadow.
Contextually appropriate markers conceptually integrate AR techniques into the work.
Documentation of prototype 3. When a viewer points their phone at the charcoal drawing of a marker, a video is registered on the paper that loops video of the drawing of the marker.
Meaningful registration grounds an augmented space in reality. As explored in the article ‘Augmented reality is a medium’
Meaningful registration then allows us to establish a shared relationship between the real and virtual realms that is the grounding [foundation] with which we construct our augmented world.
Instead of generic markers, a custom ink drawing is used, and the augmentation is based on the image.
How can we augment experiences in surprising and unexpected ways?
There will be no shortage of AR applications promising more efficiency, more productivity, and more connectedness. But a future without whimsy, wonder, and play, leaves us optimized to be miserable. After all, we potentially face a daunting level of unemployment in this century as a result of automation. Even if we are to institute healthy social programs like universal basic income, how will we augment our lives in enriching ways that point us towards fulfillment instead of anxiety?
buskAR is a music performance app prototype for a street performer, with a networked augmented reality visualization for viewers.
buskAR is open source: buskAR on github
This is an ongoing project, with more information forthcoming. Thanks for stopping by.