This questioning led him to create spatial audio interfaces, such as a table that allows you to feel different vibration points. The success of these tools among people with hearing problems inspired him to continue innovating and searching for New ways to integrate accessibility into the musical experience.
Music through the DualSense controller
The real breakthrough in Jesse’s project came by chance, when he discovered an article about using the PlayStation 5’s DualSense controller as a tool to generate vibrations across different frequencies. This helped him experiment with playing music from Spotify, using the DualSense as a new way to experience music.
Jesse Austin-Stewart found that the DualSense’s ability to translate music into vibrations opened up a new avenue for making music accessible to those with hearing problems, and anyone interested in experiencing music in a whole new way.
The future of accessible music
Inspired by artists such as Christine Sun Kim, a deaf sound artist who uses vibration and American Sign Language in his work, Jesse sees his project as part of a broader movement toward accessibility in music.
Jesse Austin-Stewart’s “Music for PlayStation” is a testament to how technology can transform art and make it accessible to everyone. Using the haptic vibration technology of the PlayStation 5 DualSense controller, Jesse has found a way to make music a tactile experience, giving people with hearing impairments a new way to connect with sounds.
