Still Still Lifes places photo-captures of a scene within the scene itself.
Unlike the previous map, the photos do not compound. Rather, taking a new capture brings the background, obscured by a previous capture, to the fore. Instead of an aggregation, each captures seems to replace the previous.
The captures duplicate the context, but also change the environment in which they are situated. With each capture, its plane is distinguished from the context by a slightly misaligned edge. The unsteady movement of the photographer is registered against the static captures and steady progression of the train.
Technicals
As with yesterday, the map is built using Swift and the ARKit framework. On tap, a new plane is added to the scene, slightly in front of the camera’s position. Rather than using snapshot(), a pixel buffer from the camera device is extracted using capturedImage(). This is then converted into an image using VTCreateCGImageFromCVPixelBuffer() and applied as a material to the plane.
Both experiments (068 and 069) also demonstrate ARKits’s overall reliance on distinct features or static contexts for the photos to be situated relatively. As shown in the video below, when the maps were explored outside at an intersection, the scene had difficultly maintaining the photos in a fixed location.
Next Steps
- Compare how the app responds differently to a changing environment versus a static one.