Pitch-aware granular synthesis algorithm on the Bela platform

This work shows a real-time audio synthesis algorithm based on granular synthesis. Instead of creating grains from the raw input signal, we dynamically mask the audio data in the frequency domain in order to create sub-signals, from which grains are created. This process enables any audio signal with sufficient content to be used as a basis for synthesis and results in a large variety of possible timbral characteristics. We integrate the algorithm into a digital musical instrument on the Bela platform to demonstrate its capabilities. We evaluate the system on three different types of source data and discuss the results.

A video explaining and demonstrating the system is available via YouTube.
For an audio demo, skip to 6:19.


Report (PDF)Code