I’ve started to work on a project called New Terrain of Apparition (NTA) with Luc Courchesne. The goal is to connect several hemispheric projection environments (called Panoscopes), so that users can meet and interact in a networked virtual environment. Several cameras are used to capture each user from various angles, allowing an accurate image to be displayed for each relative viewing angle in the virtual world. This means that even in an immersive 360 degree display, users can look each other in eyes and have a real time video chat. Audio and video transmission is handled by Scenic, and management of the virtual environment is handled by the SPIN Framework.
Below is a video of the first prototype, which will be exhibited as part of CODE Live 1 at the Vancouver Olympics:
We recently created an installation to demonstrate our component of the PropulseART project at the Society for Arts and Technology. The goal of the project at large is to connect remote concert venues with high quality video and multi-channel audio. Several open source software components have been released, under the name of Telesceno, which manage real time transmission of audiovisual data. Our Clickable Space authoring suite allows for the 3D modelling of performance spaces so that users from multiple locations can share and interact with each others stages.
Below is a proof-of-concept video about how Clickable Space operates:
This Monday, May 11th, I will be presenting a course on “Art, GPS and mobility” as part of the SAT[Transform] educational series. Although the topics may vary according to audience feedback, below is a overview of the topics that may be presented:
> Inspiration for interactive mobile applications:
intro to mixed & augmented reality
examples of locative media projects (past & present)
> Geospatial data:
Existing viewers, rendering engines, and geotagged data
Location-based content delivery and interaction
intro to OpenStreetMap, Google Earth, etc.
> Mapping & GIS:
projections and representations (lat/long - UTM)
geocaching: waypoints/tracks/routes and exchange formats
open source software solutions
> User tracking:
about GPS receivers, technologies, and conversion between formats
robustness with other inputs: accelerometers, compasses, cameras, fiduciary markers, etc
On March 6th 2009, we held a networked event where DJs and VJs in Montreal and Vancouver performed simultaneously. Moreover, audience members in each location were able to contribute material in real time with their cell phones using Raw Materials, a software developed by Mike Wozniewski and Alexandre Quessy at the SAT. Below is a documentary video created by Mo Simpson that describes the event:
Here is a beautiful video made by ItoWorld that shows the progress of the OpenStreetMap (OSM) project during 2008. Those who don’t know OSM, should take notice of the exponential growth of this data source. Contrary to NAVTEQ (which provides geospatial data to almost all online services, including Google Maps, Yahoo, MapQuest, and Microsoft Virtual Earth), the content of OSM is free, open source, and largely user-generated.
I think that in the near future, bottom-up projects like this will replace the top-down commercial data sets, similarly to the way that Wikipedia has replaced online reference material. The paradigm has the advantage of numbers, making it more possible to keep up-to-date with the changing global landscape.
The official call for works is available for the Pure Data Convention 2009. You may recall that the previous Pd Convention took place in Montreal in the summer of 2007, and that I gave a talk, workshop, and performed a piece.
As you might know, my main colleague and research collaborator who works with me in the design of 3D musical interfaces is Zack Settel. In summer of 2008, he produced Blairatta Policeme, a volumetric concert piece for jazz trio, mobile chamner quartet, and audio-enhanced performance space. See his documentation for more about what this means. On that site, you’ll find a live recording by the CBC, as well as an excellent video that explains the main concepts.
Also most recently, Zack appears in a video interview (seulement en français) on the on the Télé-Québec site. In fact, you can also see me in some of the shots, apparently doing “research”.
The call for NIME (New Interfaces for Musical Expression) has been posted for next year’s conference, which will be held at Carnegie Mellon in Pittsburgh. More details at www.nime2009.org. The submission deadline for most items is January 24th, 2009.
As a collaboration between the SAT and Mobile Muse, we have created a component that allows visual artists to collect media content from their audiences during live events. The project is called RawMaterials, and is targetted at VJs using Modul8 for mixing, yet any software capable of receiving OSC messages can be used. Audience members can use their cell phones or other mobile devices to send SMS, MMS, microblob feeds such as Twitter, and even live video using Livecast software. The public can also upload content to social media sites such as Flickr, YouTube, Picasa, etc., and the system can be configured to aggregate content from those sources as well. This can even happen far before the event starts, so that the public can choose the raw materials that will be used during the performance.
I went to a meeting on Friday to discuss the development of a standard for describing spatial audio, called SpatDIF. There is now an official website and mailing list, so go check it out at www.spatdif.org.
The idea is quite nice, because it allows one to separate the contents of the 3D scene from the audio renderer. All that is required is to format messages for sound source positions and directivity in this OSC-style format:
Then, any SpatDIF-compatible renderer will be able to spatialize the sounds on the particular audio display that it is written for (eg, binaural, 5.1 surround, VBAP, Ambisonics, etc).
