As a collaboration between the SAT and Mobile Muse, we have created a component that allows visual artists to collect media content from their audiences during live events. The project is called RawMaterials, and is targetted at VJs using Modul8 for mixing, yet any software capable of receiving OSC messages can be used. Audience members can use their cell phones or other mobile devices to send SMS, MMS, microblob feeds such as Twitter, and even live video using Livecast software. The public can also upload content to social media sites such as Flickr, YouTube, Picasa, etc., and the system can be configured to aggregate content from those sources as well. This can even happen far before the event starts, so that the public can choose the raw materials that will be used during the performance.

I went to a meeting on Friday to discuss the development of a standard for describing spatial audio, called SpatDIF. There is now an official website and mailing list, so go check it out at www.spatdif.org.

The idea is quite nice, because it allows one to separate the contents of the 3D scene from the audio renderer. All that is required is to format messages for sound source positions and directivity in this OSC-style format:

/spatdif/source/1/position 1.23 7.98 5.4
/spatdif/source/*/directivity 1 0.7 0 0.7

Then, any SpatDIF-compatible renderer will be able to spatialize the sounds on the particular audio display that it is written for (eg, binaural, 5.1 surround, VBAP, Ambisonics, etc).