The user is surrounded by speakers allowing for an immersive 3D sound experience.
A tablet is used to control the sound. 8 individual sound sources can be manipulated and placed around the used. For every sound source the user can choose an Instrument, an effect to apply to the instrument and a note sequence.
A global volume and effect mixer allows for live fine adjustment to the different sounds.
Technical Implementation:
The implementation is split in two main parts:
User Interface: The user faced is implemented using Python. It handles the visual seen on the tablet and the input of the user. It transforms informations such as sound source position, sound and effect choices and volume adjustment and sends them to the second part of implementation.
Sound handling: The sound is handled using Max MSP. It receives the transformed information from Python and adjust the sounds accordingly. The sounds and effects are all saved in MAX MSP. An Ambisonics plugin is used to send the sounds to the correct speakers and creating a 3D audio experience.
Bothe programs run on a PC communicating with each other. The PC steams the interface to the tablet allowing for a more intuitive interaction for the user.
