In this episode of the Immersive Audio Podcast, Oliver Kadel, Monica Bolles and Bjørn Jacobsen are joined by a Principal Dev Leader at the Mixed Reality division at Microsft Noel Cross and Senior Principal Researcher at Microsoft Research Nikunj Raghuvanshi from Redmond, US.

Nikunj likes to invent techniques that create immersive sight and sound from computation. He is endlessly fascinated with simulating the laws of physics in real-time and finds it thrilling to search for simple algorithms that unfold into complex physical behaviour. He has over a decade of research and development experience at the intersection of computational audio, graphics, and physics, with over fifty papers and patents. His inventions have been successfully deployed in the industry, particularly Project Acoustics, which is bringing immersive sound propagation to many major AAA game franchises today. Nikunj is currently a Senior Principal Researcher at Microsoft Research. Previously, he initiated interactive sound simulation research at UNC-Chapel Hill during his PhD studies, whose codebase was acquired by Microsoft.

Noel grew up playing games on my Commodore 64 and Amiga computers. His love for multimedia computing helped him to start working at Microsoft as an intern in 1991 in the multimedia team. This was the age of the SoundBlaster 16 ISA cards and CD-ROMs were just being introduced into PCs. Out of the multimedia team, the DirectX team was born to accelerate the development of high-quality games for the PC. Noel worked on DirectSound and audio drivers for Windows getting a taste of the game development community attending several GDCs in the 90s. This was the first time he was introduced to 3D audio algorithms and at the time the technology didn’t impress much. Through the 2000s, he worked on every release of Windows with the focus on improving the audio subsystem. This led to the complete overhaul of the audio infrastructure on the Windows Vista platform which has remained largely intact since introduced in 2006. The most current stop on his Microsoft journey is working on Mixed Reality devices. He worked on the speech and audio functionality exposed from HoloLens and Windows Mixed Reality devices with a concentration on spatial audio. After having lackluster impact in the 90s with spatial audio, he’s been reinvigorated working on this technology with the introduction of high-quality HRTFs and head-tracking services to complete the experience. Spatial audio processing has also led Noel to better understand the impact of acoustics on virtual 3d worlds. His team is currently working on Project Acoustics which allows developers of 3d titles to take advantage of wave-based simulations to handle how audio propagates in the real world.

In this episode, Nikunj and Noel dive deep into the topic of physics-based virtual acoustics along with Project Triton and Project Acoustics covering fundamental theory, research, technology and case studies.

This episode was produced by Oliver Kadel and Emma Rees and included music by Rhythm Scott.

For extended show notes and more information on this episode go to https://immersiveaudiopodcast.com/episode-62-nikunj-raghuvanshi-noel-cross-microsoft-physics-based-virtual-acoustics/

If you enjoy the podcast and would like to show your support please consider becoming a Patreon. Not only are you supporting us, but you will also get special access to bonus content and much more.

Find out more on our official Patreon page - www.patreon.com/immersiveaudiopodcast

We thank you kindly in advance!

We want to hear from you! We value our community and would appreciate it if you would take our very quick survey and help us make the Immersive Audio Podcast even better: surveymonkey.co.uk/r/3Y9B2MJ Thank you!

You can follow the podcast on Twitter @IAudioPodcast for regular updates and content or get in touch via [email protected]

immersiveaudiopodcast.com