The d-touch sequencer and the d-touch drum machine are fully and freely available for download (Registration needed)! Please try them out and spread the word!
25 August 2011: new version of audio d-touch! Lots of new features, still fully and freely available for download (Registration needed). Note that we had to reset the old accounts, so if you had one you will need to register again.
Audio d-touch is a collection of applications for real-time musical composition and performance, with very special user interfaces. The collection includes a drum machine and a sampling sequencer, both are controlled by spatially arranging physical objects on an interactive table surface. Each object represents a sound, and its position with respect to the surface is mapped to certain playback parameters. For example, the horizontal position of an object represents the timing of the sound. The system is extremely low cost and now it can be freely and fully downloaded from http://www.d-touch.org/audio. All is needed to get audio d-touch to work is a standard computer (PC or Mac) with a webcam and a printer.
The following video shows the d-touch sequencer and the drum machine in action:
More videos of the sequencer are available in the concerts section.
The sequencer and the drum machine are much more fun to use than to watch!
Download (registration needed) and build your own d-touch instruments! Have fun and at the same time help us with our research!
The audio d-touch interactive surface consists of a simple printed piece of paper. The movable physical objects are marked using labels, also printed on normal paper. The computer observes the blocks and the paper through a low cost web-cam, and thanks to the d-touch marker recognition algorithm it can localize them precisely. The information about the position and orientation of each block is used to control a digital audio synthesis process. The system was designed to be extremely low cost, robust and easy to set up, which makes it possible to fully and freely release it for download.
Taking Tangible Interfaces out of the Lab
In the research field of computer interfaces the audio d-touch interface is known as a tangible user interface: physical objects are used for the control and representation of digital information. While tangible interfaces have been well known in academic research circles for some 15 years, audio d-touch is the first attempt to make them accessible to a larger audience, requiring only products that are available in any local computer store. Audio d-touch allows people to set up and to use tangible interfaces in their own home, office, recording studio, or wherever else they like.
The release of audio d-touch is itself part of a research project about novel computer interfaces. Our aim is to advance the field by gaining insight on how tangible interfaces may be used in the real world. Please help us by trying out the applications, letting us know what you think and spreading the word about audio d-touch! To inform our research we remotely record usage data from the system, in the respect of our users' privacy: we do not record images, but only the positions of the objects in the interface and the sounds recorded on them (all details are available on the license).
The design of audio d-touch was inspired and motivated by a passion for electronic music (electronica) and minimalism shared by Enrico Costanza and Simon Shelley: the collaboration resulted in the incredibly fast production of a number of prototypes in 2003, thanks also to the great encouragement that they received from the Media Engineering Group at the University of York. In the following years Enrico continued to develop audio d-touch as a side activity, while his day job as researcher at Media Lab Europe and MIT Media Lab focused on mobile devices. Part of the original d-touch recognition system was adopted by the colleagues and friends developing Reactable at UPF in Barcelona. In 2006 the Italian composer and cellist Giovanni Sollima became interested in the sequencer and has used it in a number of public performances right up until the present day.
In early 2009 Matteo Giaccone and Olivier Küng joined Enrico, who in the meantime had moved to the Media and Design lab at EPFL, and their enthusiasm and technical contribution were key in making audio d-touch truly multi-platform and available for download.
The audio d-touch applications were publicly launched in summer 2009 and received a great response: 200+ hours total usage, 400+ users trying the applications, 1200+ registrations, in just few months. The public deployment allowed us to observe how people from all over the World interacted with the system, and to learn how to improve it (more information about the first release and what we learned from it is available on on this paper).
In February 2010 Enrico moved to the School of Electronics and Computer Science at the University of Southampton, where he continues his research.
In summer 2011 Elliot Salisbury joined the d-touch team, through the ECS summer internship programme in Southampton, bringing new enthusiasm and expertise. The audio d-touch development gained momentum again, resulting a new public release of the project.
In 2012, Rob Streeting pushed the limits of audio d-touch by adding real-time visual feedback, through common off-the-shelf LCD screens. Rob's work took place as part of his third year Computer Science project and summer internship programme in ECS in Southampton.
High resolution images are available on the press material page.