Engineering:Audiocubes
AudioCubes are a collection of wireless intelligent light emitting objects, capable of detecting each other's location, orientation, and user gestures. Created by Bert Schiettecatte, as an electronic musical instrument used by musicians for live performance, sound design, music composition, and creating interactive applications in max/msp, pd and C++.
The concept of AudioCubes was first presented by Schiettecatte in April 2004 at the CHI2004 conference in Vienna.[1] A first prototype of AudioCubes was shown at the Museum for Contemporary Art, MUHKA in Antwerp in December 2004. AudioCubes were used in an art installation created in collaboration with Peter Swinnen during the Champ D’Action Time Canvas festival.[2]
In January 2007, AudioCubes were launched on the market[3] and offered online on the Percussa website, the company which Schiettecatte founded in October 2004 to further develop and commercialize AudioCubes.
Hardware architecture
Each AudioCube is identical, and has a small built-in computer which is able to measure distances as well as detect the position and location of the other cubes in a network. AudioCubes also work without drivers and communicate using high speed HID.
An AudioCube has four onboard infrared sensors (one on each face) to communicate and measure distances to objects nearby, digital signal processors (DSP), a USB-rechargeable battery, and a translucent housing.
MIDI and OSC compatible
AudioCubes work wirelessly with MIDI-compatible software and hardware (e.g. FL Studio, Logic Pro, Reason, drum machines and Monome). A connection must be established using middleware such as MIDIBridge.
AudioCubes also come with an Open Sound Control (OSC) server to send and receive OSC data.[4]
Software Applications
Several applications have been created for the AudioCubes, each focusing on a different use: sound design, music composition, live performance, as well as creating applications in max/msp, pd and C++.
- MIDIBridge: sends/receives MIDI from/to other MIDI compatible software/hardware
- DeckaBridge: specifically created to let AudioCubes work with the DJ software Deckadance
- PluginWrapper: application to use VST-plugins together with the AudioCubes.
- Loopshaper: to make sounds and loops with one AudioCube
- Modular: detects and communicates to a network of AudioCubes wirelessly, and reassembles data from a MIDI device
- Improvisor: a generative MIDI step sequencer to create generative music using AudioCubes
- Evolvor: generate complex LFO waveforms using AudioCubes (sound design)
- Flext external for Max/Msp: to create your own max patches for the AudioCubes
- OSC server: sends information about the location, orientation, and sensor data of the AudioCubes to other OSC applications
- SDK C++ library: to create your own applications for the AudioCubes
- FM synthesizer for AudioCubes: creating sounds with AudioCubes without needing any additional hardware/software
In addition, a number of Max/MSP patches were created to work with AudioCubes.
Software Uses
AudioCubes for Live Performance
The AudioCubes can be used to send MIDI notes to MIDI compatible software/hardware using MIDIBridge. When two AudioCubes are put next to each other, they detect each other, and triggers are sent as MIDI notes. These triggers can then be used to control on/off type of signals, such as start and stop audio clips in a Digital Audio Workstation (DAW), such as Ableton Live. At each face of the cube, a different audio clip can be assigned in a DAW.
The AudioCubes can also measure distances to nearby objects or your hands when configured as a sensor cube in MIDIBridge.[5] In the same way, this sensor data is sent to the computer as a continuous controller (CC) which can be used to control parameters in the DAW. Since each cube has 4 sensors, up to 4 parameters can be controlled per AudioCube.
In addition, you can also control the RGB colors of the AudioCubes and use this information as feedback during a live performance.[6]
AudioCubes for Sound Design
The sensors of the AudioCubes can also be used to shape sounds. By moving hands and fingers closer or further away from the 4 sensors, it generates 4 different MIDI CCs which can be sent to MIDI compatible instruments. When using an AudioCube in this way, it can be compared to a 4D optical theremin.
The AudioCubes can also be linked to LFOs by using the software application Evolvor. The LFO waveforms are designed in the graphical editors of Evolvor. Each AudioCube is then automatically linked to an LFO, because of the topology detection. LFO signals can be added and removed, by adding and removing AudioCubes. The signals can also be mixed and matched, by mixing and matching AudioCubes.
AudioCubes for Music Composition
When using the Improvisor application, velocity as well as semitone patterns are automatically linked to every AudioCube. Every AudioCube plays the melody created by both patterns. When cubes are placed next to each other they can follow the same melody. In this way, music can be composed by mixing and rearranging AudioCubes.
AudioCubes for Creating Interactive applications
Several tools have been created to make applications for the AudioCubes in max/msp, pure data, and C++.
Artists
AudioCubes have been used by some performers such as Mark Mosher,[7] Pearls for Swines, Richard Devine, Steve Baltes, Bostich from Nortec, Ilan Kriger, Arecio Smith, Julien Pauty, the European Bridges Ensemble.[8]
Example of Tangible User Interface
AudioCubes are an example of a Tangible User Interface. In the past few years[when?] a lot of research has been done in the field of Tangible User Interfaces. The Reactable is another example of such an interface. It is an installation on which people can move around objects which are followed by a camera and projector on a surface.
Awards
For the creation of the AudioCubes, Bert Schiettecatte received in 2009 the prestigious Qwartz Electronic Music Awards in Paris. He was also invited to give a talk at TEDx Mediterranean in Cannes, September 2010.[9]
References
- ↑ Schiettecatte, Bert (24 April 2004). "Interaction Design for Electronic Musical Interfaces". written at Vienna, Austria (in en). CHI 2004 Conference on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery. p. 1549. doi:10.1145/985921.986125. ISBN 978-1-58113-703-3. http://portal.acm.org/citation.cfm?id=986125. Retrieved 15 May 2011.
- ↑ "AudioCubes at MUHKA, Antwerp" (in en). 4 December 2004. http://www.percussa.com/2004/12/04/audiocubes-used-in-an-art-installation-at-muhka-antwerp/.
- ↑ "AudioCubes at Namm 2007" (in en). 30 January 2007. http://www.percussa.com/2007/01/30/audiocubes-at-namm-2007/.
- ↑ "Guide to Audiocubes | Sound Genetics" (in en-US). 2020-10-05. https://soundgenetics.com/guide-to-audiocubes/.
- ↑ . doi:10.17658/issn.2058-5462/issue-11/composing/p9.
- ↑ . doi:10.17658/issn.2058-5462/issue-11/composing/p9.
- ↑ "Mark Mosher website" (in en). https://markmoshermusic.com/tag/percussa-audiocubes/.
- ↑ "AudioCubes artists" (in en). http://www.percussa.com/artists/.
- ↑ "AudioCubes designer @ TEDx Mediterranean". 2 November 2010. https://www.percussa.com/2010/11/02/audiocubes-designer-tedx-mediterranean.
External links
 |  |
