Real Time Audio Processing

⚓ rust    📅 2025-05-21    👤 surdeus    👁️ 4      

surdeus

Warning

This post was published 39 days ago. The information described in this article may have changed.

Info

This post is auto-generated from RSS feed The Rust Programming Language Forum - Latest topics. Source: Real Time Audio Processing

Hi,

I'm building a real time audio chat app. I have delay problem and I don't know what to do with it.

Here is steps:

Speaker A and Speaker B speaks in client side.
Server collects data immediately while they are speaking.
Server waits 50 milliseconds to buffering a little.
Server mixes collected buffers.

image

In part 1 there is no problem because buffers can align with no problem. Problem starts with part 2 because Speaker B's buffer couldn't arrive on time, so it can not align with Speaker A's buffer. As a result Listener gets a buffer that is bigger then what is suppose to be. Because of this big buffer Listener can not listen the buffer of part 3 on time. This happens many time in a second so situation automatically turns out a mess.

How should I solve this ?

1 post - 1 participant

Read full topic

🏷️ rust_feed