Fine grain access to AEC and noise cancellation internals.

[sgorilla]

We are using discord voice in a custom audio processing pipeline (3D proximity chat inside our game via the social SDK). We would love to be able to highlight discord as the solution that enables echo cancellation with proximity chat, something I don't see in other games. Well we would love to have echo cancellation support. Right now this is not possible because when we get the audio stream and disable standard discord audio out, it disables echo cancellation. Is it possible to get access to the AEC pipeline through the API in such a way as to allow us to turn that on?

[markmandel]

(I need to document this), but for echo cancellation/noise suppression etc - the Social SDK uses standard webrtc echo cancellation.

You are right though, when we hand you the audio via Client::StartCallWithAudioCallbacks, you are kinda on your own, since it's just raw audio.

I haven't dug in too deeply to see if you could lift the webrtc AEC3 implementation directly out of libWebRTC, but I'd probably recommend giving that a shot (looks like it should be possible), and then looking at what other libraries exist on there.

There's an interesting question of whether applying this before or after you do your proximity chat will work better 🤔 honestly not sure -- but this is also why we give you the control to do with it as you need to.

[sgorilla]

Okay, we will give this a try! 🤞