AI In Audio Panel

Anna Huang (Google Magenta), David Trevelyan (TikTok), Ale Koretzky (Splice), Zach Evans (Harmonai)

Neural Audio Plugin Competition (Livestream #5)

CMajor Updates and Talking Product Design! || The Audio Programmer Meetup Mar 2024

Developing and porting plugins to the Multiverse platform, from UI creation to C++ coding. In this talk, we cover the unique challenges of creating and deploying audio plugins on embedded hardware. We'll introduce the Multiverse platform and show how it addresses these challenges and enables developers to access the stompbox market.

large_Steve Lascos Portrait_Square.jpg

medium_Steve Lascos Portrait_Square.jpg

small_Steve Lascos Portrait_Square.jpg

thumbnail_Steve Lascos Portrait_Square.jpg

Steve Lascos Portrait_Square.jpg

Steve Lascos (Blackaddr Audio and Aviate Audio)

Developing and porting plugins to the Multiverse platform

large_Shane Nolan Portrait 1 Square.jpg

medium_Shane Nolan Portrait 1 Square.jpg

small_Shane Nolan Portrait 1 Square.jpg

thumbnail_Shane Nolan Portrait 1 Square.jpg

Shane Nolan Portrait 1 Square.jpg

Shane Nolan (Aviate Audio)

large_Ryan Portrait.jpg

medium_Ryan Portrait.jpg

small_Ryan Portrait.jpg

thumbnail_Ryan Portrait.jpg

Ryan Portrait.jpg

Ryan Jaquin (Aviate Audio)

Quick tour of the AUv3Template repo and what it offers for developing a new AUv3 plugin.
Some focus on the render thread, parameter controls, and MIDI interfacing in Swift and
C++.

thumbnail_unnamed.jpg

unnamed.jpg

Brad Howes (Squarepoint Capital)

AUv3 Filters for iOS and macOS using AUv3Template

Book presentation:
Audio programming is an exciting intersection between software development, digital signal processing (DSP), and creativity. It's enjoyable and rewarding once you've learned the basics, but how do you get started?

In this book, we introduce you to this exciting world with a step-by-step guide to building a synthesizer plug-in. We provide straight-forward explanations to the concepts and keep the math simple.

Why build a synthesizer? Building a synth plug-in is a fantastic way to learn and walk through some of the fundamental concepts of audio programming.

Matthijs Hollemans (Indie)

Creating Synth Plug-Ins with JUCE

 The Audio Programmer Virtual Meetup (Dec 12, 2023 at 18:30 UK)

We will go through the elements necessary to build a high-performance globally distributed software development team. Looking at topics like hiring, processes, rituals, tools and values.

thumbnail_Jens XMT square.jpg

Jens XMT square.jpg

Jens Brosbøl-Ravnborg (XMT Audio)

Building a Global Audio Programming Team

Adam Fligsten and Nolan Vernon of Silen Audio explain the design struggles for creating Infinite Flow, a modern synthesizer, with an analog soul.
They will discuss the pitfalls they avoided, as well as the unexpected issues that arose as a new audio team. 

thumbnail_Adam.png

Adam.png

Adam Fligsten (Silen Audio)

The Unseen Challenges of Crafting a Synthesizer from Scratch

medium_Nolan Vernon.jpg

small_Nolan Vernon.jpg

thumbnail_Nolan Vernon.jpg

Nolan Vernon.jpg

Nolan Vernon (Silen Audio)

In this talk, I'm going to talk about how we built FM Bison - an open source FM synthesizer using the JUCE framework.  I'll talk about some of the challenges along the way and what helps make this synth unique!

medium_Niels Johannes de Wit.jpg

small_Niels Johannes de Wit.jpg

thumbnail_Niels Johannes de Wit.jpg

Niels Johannes de Wit.jpg

Neils Johannes de Wit (Indie Audio Programmer)

Building FM Bison with JUCE

 The Audio Programmer Virtual Meetup (Nov 7, 2023 at 18:30 UK)

In this presentation, the speaker will discuss and demonstrate the encapsulation of ValueTrees within 'domain-specific' classes, facilitating the transfer of a single ValueTree root object to client code.

large_Chris.png

medium_Chris.png

small_Chris.png

thumbnail_Chris.png

Chris.png

Chris Roberts (Independent Software Engineer)

ValueTree Wrappers: Data model without dealing with ValueTree's in your client code

In this talk, Kyle will discuss the results of an analysis of interviews with 13 professional video game composers about their considerations and concerns about AI driven music technology and how this informs the ways we should be building AI tools if we want to see them adopted in the mainstream. Kyle will then discuss how this informed the development of his expressive rendering deep learning algorithm (Cue-Free Express), which allows non-expressive midi to be performed as if played by a human, with the goal of being a new 'Humanise' tool for composers.

large_Kyle.jpeg

medium_Kyle.jpeg

small_Kyle.jpeg

thumbnail_Kyle.jpeg

Kyle.jpeg

Kyle Worrall (Music Computing and Psychology Lab, University of York)

Understanding how to design AI driven music technology for increased acceptance by musicians

 The Audio Programmer Virtual Meetup (Oct 10, 2023 at 18:30 UK)

In this talk, we'll explore NeuralNote, an open-source audio-to-MIDI plugin built over Spotify’s BasicPitch model. We’ll dive into the technical aspects of the plugin and gain general insights into the use of machine learning in audio plugins.

large_Damien_Ronssin.jpeg

medium_Damien_Ronssin.jpeg

small_Damien_Ronssin.jpeg

thumbnail_Damien_Ronssin.jpeg

Damien_Ronssin.jpeg

Damien Ronnsin (Minimal Audio)

NeuralNote - An audio-to-MIDI plugin using Machine Learning

Audio buffers are a fundamental container used in audio software development for storing and processing audio signals. This talk will give a brief overview of container design in C++, and will walk through an implementation of a new audio buffer class from scratch. Supplementary classes including a buffer "view" class will be presented as well as C++ "iterator" types to simply the process of iterating through an audio buffer.

large_Jatin Chowdhury headshot.jpg

medium_Jatin Chowdhury headshot.jpg

small_Jatin Chowdhury headshot.jpg

thumbnail_Jatin Chowdhury headshot.jpg

Jatin Chowdhury headshot.jpg

Jatin Chowdhury (Chowdhury DSP)

Audio Buffers, Buffer Views, and Buffer Iterators

Monthly Meetup (September 12th, 2023)

The Korg Prologue is a hybrid analogue polyphonic synthesiser released in 2018. In this talk, a digital model of its VCF based on its circuit diagram is put forward, comparisons are drawn, and the process is discussed.

small_image.jpeg

thumbnail_image.jpeg

image.jpeg

Modeling the Korg Prologue VCF

Victor Lazzarini (Maynooth University Music Department)

A headfirst dive into the benefits of rephrasing well known algorithmic reverb structures as FDNs (but with "The Matrix" references).

large_image.jpeg

medium_image.jpeg

Freaky Diffuse Noises: Getting Creative with FDNs

Syl Morrison (Kalide Systems, SLM Audio)

This talk is a summary of the experience of and lessons learned from designing an audio programming language in its early stages. I aim to examine the importance of accessible audio languages, and my considerations and ambitions based on real-world usage of pre-existing languages.

The How, What, and Why of Designing an Audio Language

Ryan Jeffares (Kalide Systems, Sound Training College)

Geraint/Signalsmith chats about his journey learning programming, maths and DSP, and when waving away details can be useful.

small_Geraint.png

thumbnail_Geraint.png

Geraint.png

The Advantages of Hand-Waving

Geraint Luff (Signalsmith Audio)

This talk will discuss some of the features of the p5.Csound library for p5.js, and showcase how it can be used to quickly develop web based audio applications. 

p5.Csound - A Lightweight Csound Library for p5js

Rory Walsh (Dundalk Institute of Technology, Ireland)

Ireland Meetup (July 11th, 2023)

I am a junior software engineer based in London. I have worked with the sound stacks team for just under a year, working on the Cmajor platform. My previous studies were in music and audio programming. Alongside work, I co organise dynamic cast, a peer to peer C++ learning group based in Berlin and London.

large_Screenshot_20220628-191847.jpg

medium_Screenshot_20220628-191847.jpg

small_Screenshot_20220628-191847.jpg

thumbnail_Screenshot_20220628-191847.jpg

Screenshot_20220628-191847.jpg

Programmer Q&A (Interviewee)

Harriet Drury (Sound Stacks)

Valeriia is a recent computer science graduate from Arizona State University with a background in law. She has been learning about audio in her free time for the past year and is interested in building a career in this field.

medium_4246426B-06C7-4C9F-81BF-49614C583078.jpeg

small_4246426B-06C7-4C9F-81BF-49614C583078.jpeg

thumbnail_4246426B-06C7-4C9F-81BF-49614C583078.jpeg

4246426B-06C7-4C9F-81BF-49614C583078.jpeg

Programmer Q&A (Interviewer)

Valeriia Starosek (Independent)

This talk will be an exploration of LLMs (large language models) to increase developer velocity for audio programming use cases.

large_20181122_IMG_2224_lo - Marcus Hobbs.jpg

medium_20181122_IMG_2224_lo - Marcus Hobbs.jpg

small_20181122_IMG_2224_lo - Marcus Hobbs.jpg

thumbnail_20181122_IMG_2224_lo - Marcus Hobbs.jpg

20181122_IMG_2224_lo - Marcus Hobbs.jpg

JUCE GPT!?!

Marcus Hobbs (Perfect Buzz Music)

Monthly Meetup (June 13th, 2023)

Warmer Wave Shapers

Geraint Luff (Signalsmith)

small_slice2@3x.png

thumbnail_slice2@3x.png

slice2@3x.png

Building Plugin Installers with CMake & CPack

Ben Vining (Independent)

Monthly Meetup (May 9, 2023)

Judges

Ale Koretzky (Splice), David Trevelyan (TikTok), Joshua Reiss (QMUL), Dan Stein (aka DJ Fresh)

thumbnail_Screenshot 2023-03-29 at 3.38.50 PM.png

Screenshot 2023-03-29 at 3.38.50 PM.png

On Another Note: Symbolic Music Generation

Julian Lenz (Pompeu Fabra University)

Neural Audio Plugin Competition (Livestream #6)

thumbnail_image (3).png

image (3).png

Toward Prototyping with Neural Networks on Embedded Hardware

Teresa Pelinkski (Queen Mary University of London)

small_image (2).png

thumbnail_image (2).png

image (2).png

Unchain Hidden Power - Latent Space Processing for Music Remixing and Upmixing

Haici Yang (Indiana University)

large_image (4).png

medium_image (4).png

small_image (4).png

thumbnail_image (4).png

image (4).png

AI Death Metal - Eliminating Humans from Music

CJ Carr (Dadabots, Harmonai)

medium_image (1).png

small_image (1).png

thumbnail_image (1).png

image (1).png

Beyond the Noise: Exploring the Potential of Audio Effect Removal for Music Production

Johannes Imort (AudioShake)

medium_image.png

small_image.png

thumbnail_image.png

image.png

How Deep Learning Can Improve Sample Retrieval for Electronic Music Creation

António Ramires (Beatoven.ai)

Neural Audio Plugin Competition (Livestream #4)

small_philippeeslingheadshot_720.jpg

thumbnail_philippeeslingheadshot_720.jpg

philippeeslingheadshot_720.jpg

AI in 64Kb: Can We Do More With Less?

Philippe Esling (IRCAM)

RTNeural is a neural inferencing library written in C++. RTNeural is designed to be used in systems with hard real-time constraints, with additional emphasis on speed, flexibility, size, and convenience. This talk will discuss the motivation and design of the library, and give examples of how the library can be used for creating real-time neural audio plugins.

large_headshot - Jatin Chowdhury.jpg

medium_headshot - Jatin Chowdhury.jpg

small_headshot - Jatin Chowdhury.jpg

thumbnail_headshot - Jatin Chowdhury.jpg

headshot - Jatin Chowdhury.jpg

Building Neural Audio Plugins with RTNeural

Neural Audio Plugin Competition (Livestream #3)

The Qosmo team will provide an overview of the Neutone platform, taking you step by step through the process of building, wrapping and exporting Neural Audio models for the Neutone plugin.

Neutone Workshop: Real-Time Audio Plugin and SDK

Andrew Fl, Christopher M., Naotake M.

Are you considering entering the Neural Audio Plugin Competition? MATLAB is free to use for all participants and this session provides an overview of the most useful features to work on the challenge. Join us and learn about the basics of: 
 * Using MATLAB code to create and host VST and AU plugins, from DSP to UI controls 
 * Hosting, running, and testing VST and AU plugins in MATLAB 
 * Accessing pre-trained deep learning networks in MATLAB and training your own 
 * Importing PyTorch, TensorFlow and ONNX models into MATLAB 
 * Turning deep learning models into efficient C++ implementations for audio plugins 

Neural Audio Plugin Competition (Livestream #5)

Previous Meetups