Looks like a fun project. I can highly recommend Teensy Audio Library for audio projects: https://www.pjrc.com/teensy/td_libs_Audio.html

Mozzi (for Arduino) is also great!

https://sensorium.github.io/Mozzi/