The XY interactive textile is a large tactile interface for playing electronic music. The performer plays it simply by the movement of his/her hand on it's surface. This textile interface allows users to compose and interpret electronic music by choreographic movements. By its size, its texture, its flexibility and its transparency, this textile interface involves the whole body in the musical interpretation. Like a music score, the sound elements are graphically represented on the fabric, giving to the composer the ability to locate and play (with) them. Thus, for each piece of music, a graphic partition is carried out. The idea behind this project is also to develop an opposite approach to a classical process (from graphic towards the sound). Created in collaboration with graphic designers and composers, these hybrid textiles offer spaces to be explored by look, touch and gesture. Today, this multi- functional project inspires new usages in numerous domains. For example, we're currently working with a choreographer to integrate dance with the musical fabric. We have already created an installation in which allowed two people to communicate by drawings on the fabric over an internet connection. We also plan to use this programmable surface for gesture recognition. The idea is to associate symbolic gestures with a particular function: for example, to make an ambient light glow, you need to draw a circle on the sensitive fabric placed on a room wall.

The XY interactve textile is currently used by Marco Marini a French Electro-Acoustic composer. Within the research project "ENIGMES" on the topic of navigable score, Marco Marini was taken part in creation of a dedicated XY textile score. Currently finished, through performances Marco Marini uses all the gestual and acoustic actions patterns required to interprete this interactive score: musical notations, sound lines, trajectory... The movement of his hands on the textile surface triggers musical lietmotives. Inspired by echography (graphic sounds patterns), each graphic pattern uses simultaneously technical and symbolic codes. These patterns allow the musician to localise the sounds, their shape and their duration. The role of the performer is transformed, he is musican and dancer which makes for a unique mis-en-scene of the musical score. Facing the public the performer (both musician and dancer) shows how the movement of his hands bring to life the music as he traces the patterns on the surface of the translucent fabric. His fingers in contact with the fabric playlike the record head on a record : distorting the duration of the sound or simply triggering sound events. For the time being the sound environment that we are exploring are highly experimental but new, more "pop" partitions are in perspective.

 

Stakes

  • Leave the traditional interaction screen, keyboard, mouse, too generic and getting old.
  • Give a physical dimension to the numerical interface.
  • Rehabilitate the gestures into the interaction.
  • Make evolve range of the interactive devices.
  • Bring a sensible dimension to the numerical world.
  • Propose an interaction who give a direct contact to the hand (haptic nteraction).
  • Create new tactile objects.
  • Produce accessible objects.

Material originality

  • Simplicity
  • Flexibility
  • Transparency
  • Lightness
  • Texture touch
  • Large surface interaction
  • Low cost per m2
  • High input resolution
  • Modeling around the subject


-----

Technology.

On this smart fabrics, the hand's contact position is transmitted to a computer via a 10 bytes resolution Lilypad card. This allows an input resolution of 1024 by 1024. Two conductive fabrics are attached to a frame, each one weaved with conductive threads in different directions. When the performer presses any point of this textile instrument, the two fabrics are connected and the current electrical value is sent to the computer. The technology of the textile is based simply on a voltage divider resistive principle! I developed this project at the National School of Industrial Creation (ENSCI) Paris, France, as a part of my senior thesis project in December 2005. Since then I have become specialized in the creation of innovative electronic textiles and elaborate the design of this tactile fabric.



XY firmware.



To obtain the XY contact value we do a two time sensing. Eatch sensing give us a resistor value who is proportional to X or Y finger position. This principle can be illustrated by two potentiometers which middles points pins are connected together and the others pins connected to the LilyPad board. Below, the two-time program to obtain significant values of XY finger position.

Schéma de connections des toiles à la carte Lilypad

Arduino sketch with optimized communication

Software R&D

Here we propose a set of programs usable with the XY interface. Those pieces of software are to be considered as a modular base to be adapted to a particular application. The code used for this library is mainly Pure Data, a multi-platform open-source visual programming. This library is inspired by the ENIGMES-Lib originally designed for Max Msp by Roland Cahen for the ENIGMES project. "ENIGMES-Lib" is a set of programs made for playing sound through interactive graphical metaphors.

  • Data acquisition (Pure Data) : Read XY textile datas.
  • Data acquisition (Processing) Read XY textile datas.
  • Curves following : realize the mapping between a graphic curve and sound datas. Your finger is acting as a tape reader. Vincent Rioux
  • Zone detection : describe zones, with complex shapes and possibly overlapping, and associates them with sound datas.
  • Angular detection : determine distance and angular value of one vector made by the finger and a reference point.
  • Munger player : a real-time multichannel granulator, a.k.a. the swiss-army-knife of real-time granular synthesis. By Dan Trueman.
  • Gesture recognition : learn curves and then try to match with current input. This program uses Python and NumPy (Numerical Python) within Pure Data. Coded by Vincent Rioux.
Powered by pmwiki-2.2.10