FEATUR.UX: An approach to leveraging multitrack information for artistic music visualization

Abstract

FEATUR.UX (Feature - ous) is an audio visualisation tool, currently in the process of development, which proposes to introduce a new approach to sound visualisation using pre-mixed, independent multitracks and audio feature ex- traction. Sound visualisation is usually performed using a mixed mono or stereo track of audio. Audio feature ex- traction is commonly used in the field of music information retrieval to create search and recommendation systems for large music databases rather than generating live visual- isations. Visualizing multitrack audio circumvents prob- lems related to the source separation of mixed audio sig- nals and presents an opportunity to examine interdepen- dent relationships within and between separate streams of music. This novel approach to sound visualisation aims to provide an enhanced listening experience in a use case that employs non-tonal, non-notated forms of electronic music. Findings from prior research studies focused on live per- formance and preliminary quantitative results from a user survey have provided the basis from which to develop a prototype for an iterative design study that examines the impact of using multitrack audio and audio feature extrac- tion within sound visualisation practice.