Installations
A number of public installations have been created to bring research in music technology to the public. The installations span from sonifying neural activity, through providing auditory displays for the blind and visually impaired, to robotic installations that feature research in human robot interaction.
medusai is an AI driven robotic sculpture that responds to and interacts with humans through sound, touch, movement, and light. Inspired by the Greek myth of Medusa, the sculpture features seven robotic arms acting as snake hairs. The arms follow human activity around the sculpture, pluck strings and respond to human movement through music and dance.
FOREST is the performative outcome of an NSF funded project aimed at enhancing trust between humans and robots through sound and gestures. As part of the award winning project, a deep learning architecture was trained to generate music-driven , motion-carrying audio to accompany robotic gestures.
The goal of the Accessible Aquarium project is to use sonification to make dynamic exhibits such as those at museums, science centers, zoos and aquaria more engaging and accessible for visitors with vision impairments. The system provides real-time interpretation of the surroundings using innovative approaches for object tracking, music generation, narrations, and adaptive sonification.
The sonification projects BrainWaves and Fish and Chips (F&C) were designed to provide auditory and scientific representation of complex data in real time through hands-on interaction.
