Try sending SR report. The NTP timestamp in the SR report will help in audio and video synchronization.
Check rtpbin examples which have SR and RR reort



Sent from Yahoo Mail. Get the app


On Monday, 22 April, 2024 at 03:20:51 pm GMT-5, cfd new via gstreamer-devel <gstreamer-devel@lists.freedesktop.org> wrote:


I guess you send out audio and video separately. If yes, you may try to send out audio first and then video.

   Joe

On Thursday, April 18, 2024, 08:13:43 a.m. EDT, Felix Sternkopf via gstreamer-devel <gstreamer-devel@lists.freedesktop.org> wrote:


Dear GST Community,

i have implemented a rtsp server with the gst-rtsp-server module. The server receives an audio signal via an interaudiosrc and a video signal via an intervideosrc:

            intervideosrc channel=videosrc à videoconvert à vaapih264enc bitrate=5000 zerolatency=true à rtph264pay pt=96 name=pay0

            interaudiosrc channel=audiosrc à opusenc bitrate=64 à queue à rtpopuspay pt=97 name=pay1

 

When I try to view the stream via an rtsp client, for example VLC Player the stream works, but the audio signal is about 1 second behind the video signal. I already tried different audio encoders and different queue parameters like buffer size and leaky queues, but nothing solved the problem.

When I start the same pipeline as above but mux both signals and write them into a filesink they are synchronized.

 

I know that the server module internally uses the multiudpsink element. Is there any possibility to edit multiudpsink parameters from outside?

Does anybody have any ideas about this problem? I already read every google result I could find about it.

 

Best Regards,

Felix Sternkopf