I'm rewriting BlockCam (while letting Flatland rest for a little bit) in SwiftUI and decided to add a new feature that doesn't seem to fit well with graphics programs - sound. I eventually plan to use sound from the microphone to change how images look. The first step was to get the spectrum of the sound from the microphone. It took me about a day of dead-ends until I found some sample code from Apple that made things go very quickly.
In the video you can see the live view of part of my desk and floor (not terribly exciting) overlayed with the spectrum from the sound from the microphone. I smooth the spectrum out both spatially and chronologically but when I actually use the sound for the intended purpose, I may not smooth it out.
Loading contexts...