Stepping into a living breathing artwork
We’ve harnessed the power of cutting-edge technology to create an unparalleled immersive experience. Our space utilizes advanced projection mapping to turn every surface into a dynamic canvas for stunning video and laser displays. Combined with Envelop SF’s groundbreaking 3D spatial audio, we’ve engineered an environment where art transcends its traditional boundaries, engaging your senses in completely new ways.
Ambisonics and Envelop
The Ableton plugin developed by Envelop SF is based on Ambisonics, a spatial audio technology originating in the UK in the 1970s through research supported by the British National Research Development Corporation.
Ambisonics can be understood as a three-dimensional extension of M/S (mid/side) stereo, adding additional difference channels for height and depth. The resulting signal set is called B-format. Its component channels are labelled W for the sound pressure (the M in M/S), X for the front-minus-back sound pressure gradient, Y for left-minus-right (the S in M/S) and Z for up-minus-down.
It is also worth noting that the 4-channel format described above is only a simple, first-order form of B-format, which is what most Ambisonics microphones and playback platforms support today. While even first-order B-format provides higher-resolution spatial immersion than traditional surround technologies, higher-order B-format audio can provide even higher spatial resolutions, with more channels providing more different polar patterns. Thus, second-order Ambisonics uses 9 channels, third-order Ambisonics jumps up to 16 channels, all the way up to sixth-order Ambisonics with 49 channels.
Our space will be either a third-order (16 channel) or fourth-order (25 channel) installation, where a channel is a speaker.
Speaker Configuration
The Octagon is a flexible choice for up to third-order playback. When oriented one-in-front, it can be used for reasonably accurate native 5.1 playback (L and R at +/- 45° vs. 30°, and surrounds within the standardized sector at +/- 112.5°). For first order, phasing artefacts might become obvious under non-reverberant listening conditions due to the use of significantly more speakers than required, and Solvang’s results (2008) suggest slightly increased timbral defects outside the sweet spot.
Our speaker installation, like the installation at Envelop SF, will be composed of eight columns which will surround the audience. In each of these monolithic columns there will be three different speakers with four subwoofers in each corner for a really clear body vibrating bass.
E4L: Empowering Artists
E4L (Envelop for Live) is a free, open-source suite of immersive audio production tools compatible with Ableton Live Suite. This platform provides artists and producers with an accessible way to create immersive music for our listening spaces, DIY multichannel audio environments, and even headphone-based VR/AR applications.
EnvelopLX: Integrated Audio and Visual Control
EnvelopLX runs within the Processing environment using the LX Studio framework. This system allows for direct control or remote OSC control from Envelop for Live devices, which can be programmed and sequenced within Ableton Live 10. Additionally, real-time spatial audio metering and position data can be used to control animations.
Projection Mapping
Projection mapping is a technique that uses video projectors to project images onto irregular surfaces, effectively turning objects like buildings, sculptures, or even small items into dynamic display surfaces by precisely aligning visuals to their contours, creating an optical illusion of movement and depth on a non-flat surface; essentially, it allows you to “map” video content onto complex 3D objects using specialized software to warp and fit the image perfectly.
While projection mapping is a mature and readily available technology, there are a few key software solutions on the market including Resolume and HeavyM.