1. Inkjet-printed Conductive Patterns for Physical Manipulation of Audio Signals
A major part of my research at the MIT Media Lab was about utilizing conductive inkjet printing to create interactive sensing surfaces. Since inkjet printing enables a new way of fast sensing prototyping in a graphic way, it enables us to design sensors that not only serve as a part of the circuit, but a fully integrated part in an object. In this collaborative work with Dr. Amit Zoran, we present the realization of a completely aesthetically driven conductive image as a multi-modal music controller. Combining two emerging technologies – rapid prototyping with an off-the-shelf inkjet printer using conductive ink and parametric graphic design, we are able to create an interactive surface that is thin, flat, and flexible. This sensate surface can be conformally wrapped around a simple curved surface, and unlike touch screens, can accommodate complex structures and shapes such as holes on a surface. We present the design and manufacturing flow and discuss the technology behind this multi-modal sensing design. Our work seeks to offer a new dimension of designing sonic interaction with graphic tools, playing and learning music from a visual perspective and performing with expressive physical manipulation.The paper is published and demoed in UIST 2013.
2. A Customizable Sensate Surface for Music Control
We developed a novel music control sensate surface, which enables integration between any musical instruments with a versatile, customizable, and essentially cost-effective user interface. This sensate surface is based on conductive inkjet printing technology which allows capacitive sensor electrodes and connections between electronics components to be printed onto a large roll of flexible substrate that is unrestricted in length. The high dynamic range capacitive sensing electrodes can not only infer touch, but near-range, non-contact gestural nuance in a music performance. With this sensate surface, users can “cut” out their desired shapes, “paste” the number of inputs, and customize their controller interface, which can then send signals wirelessly to effects or software synthesizers. Our preliminary design and concept was published at NIME 2012 and was featured in CNET and the Financial Times. | publication | video |