Software
The featured musical software applications are designed to expand and extend human creativity, expression and well being. They cover a wide range of use cases, from interaction with generative AI through assistive technology for stroke patients, to gestural music making and sonifcation.
Mixboard is a web and mobile app that allows music lovers to create, personalize, and share musical mashups. In a co-creative manner, users can visually build mashup songs while AI contributes musical analysis and generative ideas.
Piano Therapy is an iPad app designed to support engaging and accessible finger rehabilitation for stroke survivors. The application, which can be integrated with a MIDI keyboard, has been shown to improve at home practice time for stroke patients through gamified piano pedagogy.
ZOOZbeat is a gesture-based Music re-creation app, designed to provide users with expressive access to gestural music making. The app was licensed to the startup ZOOZ Mobile and to the Coca Cola company, which featured it in their London Olympics campaign.
The goals of the Accessible Aquarium project is to make dynamic exhibits such as those at museums, science centers, zoos and aquaria more engaging and accessible for visitors with vision impairments by providing real-time interpretations of the surrounding using innovative approaches for object tracking, music, narrations, and adaptive sonification.
The sonification projects BrainWaves and Fish and Chips (F&C) were designed to provide auditory and scientific representation of complex data in real time through hands-on interaction.
