We are all affected by sound waves, whether we hear them or not. Therefore, the potential is vast, what open resources can offer us to become masters of our own sound experience. People who are deaf could build apps to alarm them if cars honk, and from which direction; people with intact hearing could build a filter that lets them hear only birds sing, if they tire of human voices. Smart filters can potentially reduce hearing loss as well as stress for those living or working in noisy environments.
The problem potential developers and users of smart filtering techniques face is the large number of barriers standing in front of them. Often access to the relevant resources, such as hardware, software, and data (e.g. for training neural networks), either require a hefty fee, a good health insurance, an amazing employer, or a position at a successful academic or research institution. Furthermore, the mathematics behind that of sound, specifically digital signal processing, as well as deep learning algorithms can be quite intimidating and difficult to penetrate for outsiders.
In this talk, we share what we’ve learned building a low-computational smart noise filter for the purpose of speech enhancement via mobile device (e.g. smart phone). We will offer an overview of how we used Python to create not only a functional smart noise filter, but a potential learning tool to help others understand and interact with the math behind it. Important topics will include the gray area of ‘high performance’ in deep learning as well as acoustic filtering. We will also talk about the pros and cons of using open audio databases and how people can contribute to them to increase their already great value.
artist and computer scientist
Affiliation: Peggy Sylopp und Aislyn Rose GbR
Aislyn is the developer as well as a researcher for \\NoIze//, a Prototype Fund project centering on open source smart sound filter development. Python came into Aislyn's life while studying acoustics in Finland: those long winter nights were just the right thing. She currently pulls from her academic background in clinical linguistic research and her life-long dance training to build smart applications processing sound and movement. She lives in Berlin and loves bike tours with her husband and daughter.