Software
The featured musical software applications are designed to expand and extend human creativity, expression and well being. They cover a wide range of use cases, from interaction with generative AI through assistive technology for stroke patients, to gestural music making and sonifcation.
Mixboard is a web and mobile app that allows music lovers to create, personalize, and share musical mashups. In a co-creative manner, users can visually build mashup songs while AI contributes musical analysis and generative ideas.
Piano Therapy is an iPad app designed to provide engaging and accessible finger rehabilitation for stroke survivors. The application, which can be integrated with a MIDI keyboard, has been shown to improve at-home practice time for stroke patients through gamified piano playing pedagogy.
ZOOZbeat is a gesture-based Music re-creation app, designed to provide users with expressive access to gestural music making. The app was licensed to the startup ZOOZ Mobile and to the Coca Cola company, which featured it in their London Olympics campaign.
The goal of the Accessible Aquarium project is to use sonification to make dynamic exhibits such as those at museums, science centers, zoos and aquaria more engaging and accessible for visitors with vision impairments. The system provides real-time interpretation of the surroundings using innovative approaches for object tracking, music generation, narrations, and adaptive sonification.
The sonification projects BrainWaves and Fish and Chips (F&C) were designed to provide auditory and scientific representation of complex data in real time through hands-on interaction.
