The duration of the workshop is two weeks. In this period we will go through the three stages of the project: the prototype development, the test in the street, and the final exhibition. I provide a list of tasks that will give the technical basis from where to start to build the project. All the ideas and artistic decisions will be taken in a collaborative way, and the overall experience and result will be subject to the creativity and interaction of the team involved.
Prototype development (10 days)
In essence this project is an interactive exercise to make our body to talk with our awareness, using the music and the rhythm as the voice and language to make this to happen. We will be testing and playing with accelerometers, gyroscopes, and compasses, attached to our limbs while we walk, run, dance or jump. The data from this sensors will be send via bluetooth to a computer and inserted in a Processing sketch, where we will process this data to convert into a new data that will be used in a Pure Data patch, which will convert the data into sounds and music.
Having some prototypes working with Pure Data (PD) and Processing, we will move from the computer to a portable device. We will design an Android App to run the code in a Tablet or Mobile phone, so we will have an autonomous and portable system to test with our body.
We will develop one sensor system for each limb, which will be attached to shins and wrists. As a result we will have a right shin, left shin, right wrist and left wrist sensor each of them containing:
Right Shin: (1) Arduino Nano, (1) bluetooth, (1) Accelerometer+compass, (1) 9v battery
Left Shin: (1) Arduino Nano, (1) bluetooth, (1) Accelerometer+compass, (1) 9v battery
Right wrist: (1) Arduino Nano, (1) bluetooth, (1) Accelerometer, (1)gyroscope, (1) 9v battery
Left wrist: (1) Arduino Nano, (1) bluetooth, (1) Accelerometer, (1)gyroscope, (1) 9v battery
The brain of the system will be an Android device, which will receive the data sent by the Arduinos (limb sensors). The data will be transformed into sounds and music, allowing us to have an auditory feedback of our movements.
The principal tasks for this stage are:
- Build Arduino sensor system (16 - 18 June). Connect an accelerometer, gyroscope and/or compass (according to the position of the system in the body) with the Arduino Board. Besides we will include a 9v battery to supply energy. Part of this task is to develop a comfortable carrier system (for example with wristbands).
- Setting bluetooth connection and Programming Arduino (17 - 19 June). Get the arduino connected via bluetooth. We will program the arduino to send the sensors data to a computer or Android device.
- Set Processing and Pure Data templates to directly test with Arduino. (17 June). To test the music and visual artistic proposal we will have a template made in Pure Data and Processing, that will connect the arduino sensors with a computer via bluetooth. This way, the prototype will be more easily developed. The final code wrote in PD, will be exported to be used with libPD in an Android device, and the Processing code will be adapted and moved to the Android project inside the Eclipse IDE.
- Set an EclipseTemplate for Android App (17 - 19 June). The Android app will be developed in Eclipse IDE with Android SDK, and it will incorporate LibPD to embed PureData patches inside the program and the process made in Processing, we will be using all the Android architecture to develop the application, getting the data from the Arduinos and passing it to the Processing (Java) code and PD Patchs.
- Research time and final App. Most of the time in this stage will be used to explore ways to convert the data into musical responses for the user. In the second week, we will start to implement the solutions in the final Android App.
Test in the street
Once the prototype is ready, we will look for volunteers who want to experience this ‘invisible musical suit’, and make their own music creation. All this process will be documented with video recording and photographs. The musical feedback will be saved into the Android devices in audio format.
The main idea is to exhibit part of the visual documents (photos and videos) in addition to the audio tracks recorded in the tests. We will make a processing program, to show the information collected in an interactive way.