Digital Tangible Interactive Immersive
LEDs @electronics @programming
Concept originally developed for realtime-compositing of a live performance livestream by a rock band during lockdown. Each member of the band would record themself playing through the album to a click track. For the live event, the streamer would be able to composit and switch between cameras live, while doing commentary.
This ended up more being an experiment in how much visual information could be maintained by overlaying chaotic and stylized masks of multiple videos.
The system was an absolute-orientation I built, which controlled a 3D cluster of audio-reactive cubes. Each side of the cubes in the cluster acted as a compositing mask for a different camera view.