Flow Analysis Of Sensor Data

With the implementation of the three sensors and data analysis, we fixed the intervals of values ​​for each axis.

The microprocessor provides us with a steady flow of data as a string. This string is treated to separate the values. For indeed, they are simply delimited by commas. We must therefore recognize which are the gyroscope, accelerometer or magnetometer.

These values ​​studied can be used to start the encoding on Processing, and therefor adapt these values ​​to the requirements for control applications.

All axes are redefining the specific actions in applications. This allows to see that we have a series of combinations of movement, making programming easier for the clarity of the requirements of the final result.

Then for example, to move from one application to another, we can cause an acceleration in the direction of the z-axis. So the subdivision of the different axes allows us to clearly identify the movements, generating actions.

Throughout the programming step of the application on Processing, step by step we will set the axes, allowing the correct application of the program.

Interface Engineering

We have think about the informatic interface and after a couple of hours (we have test Open Interface), we have decide to do all the interface and OSC message with Processing because we need an Innovative User Interface, Open Interface offers good User Interface like iTunes but it’s not new !

Test Session

Today, in the morning we allocated some tasks about what we planned yesterday and we did some tests with Resolume Avenue. Additionally, we connected the sensor to Open Interface to test its functionality. In the afternoon, we made our first tests with the hardware and started the coding for the application. Also, we started the work for our conceptual poster for the final presentation.

We also connected Resolume Avenue with Open Interface and our sensor to test the effect of rotation of the videos around the X-axis. In the tests of the hardware, we tested the received data from the Razor IMU and wrote some processing code for it.

We start the coding for our application and made the preparations for the choice panel of the tags.

Finally we started designing the poster which comprises the relevant aspects of our design concept.

Informatic Part

Today, we decided how to proceed with the informatics part of our project. Therefor, we need an XML database should contain all of the videos, positions of all videos in Resolume Avenue for associate a touch of the globe with max 4 videos. We created the following checklist:

  • Send OSC message to resolume
  • How to import xml file to processing
  • How to convert video file to mov
  • We have to take videos in Brussels
  • How to interpret the glove positions to switch to an other word theme
  • What we will do with the video in Resolume
  • Can you imagine some sounds for each themes?

First Brainstorming

To introduce and explain our goal of this project, we made a main brainstorming session with all our principle ideas. With the help of our coaches, Tom HEENE and Kenneth LABIAU, we talked about the possibilities and functionality of the final result.

So we had to find a common understanding of the project tools, the project goal and also the final prototype. After all these reflections, we agreed on the same concept: using the interactive glove to mix videos and add music of specific themes, Brussels.

The sources for the videos are personal travel experiences (e.g. monuments, cultural stuff, nightclubs, … ) and videos from the internet (youtube, vimeo, google, … ).

The prototype for our group for the following week will include videos from our own experiences as well as videos from the web. Those videos will be loaded into a video composer software called Resolume Avenue. The user chooses some tags of Brussels and gets directed to a video composition related to the chosen tags. With the ability of the glove, especially the finger/gravity sensors, the user can manipulate the videos (while Resolume runs in the background).

So for conclusion, we want to create a installation wich allows users to create their own Brussels experiences, mixed by themselves.

After all of this, we had to find a name to our project. With several propositions by all the members of the group, we agreed with this name: VGMove. We thought that name was the most significant, including keywords like “visual”, “glove” and “move”; which means that we can move and mix videos by including visual effects, with all the possibilities given by the interactive glove.