GesturAR

Read the article on ResearchGate

This study explores a new way to notate extended techniques on tam-tam (expandable to other instruments in the future). The application allows the representation of performance gestures through holograms projected on the instrument’s surface. The trajectories can be created by the composer with their bodily motion thanks to the use of a hand skeletal tracking device. The sequence of previously recorded trajectories in space can also be organized on a timeline and played back, realizing a new type of score that notates events through time instead of on paper.

This experiment has been realized with the intention to explore a new uncharted territory in musical notation: 4D notation in space and time, as opposed to 2D notation on paper.

The project has, so far, encountered bottlenecks in the quality of the equipment used and in the precision of the available Augmented Reality solutions on the market. In fact, a musical application requires a very high precision for what concerns tracking and visualization of virtual objects respect to real ones. However, such a level of precision could not be achieved under most of the circumstances with the equipment I had access to.

ResearchGate.png