'Re: Unsynced Audio and Video signals in RTSP Stream'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       gstreamer-devel
Subject:    Re: Unsynced Audio and Video signals in RTSP Stream
From:       cfd new via gstreamer-devel <gstreamer-devel () lists ! freedesktop ! org>
Date:       2024-04-22 20:20:40
Message-ID: 481703717.1305858.1713817240271 () mail ! yahoo ! com
[Download RAW message or body]

I guess you send out audio and video separately. If yes, you may try to send out \
audio first and then video.  Joe

    On Thursday, April 18, 2024, 08:13:43 a.m. EDT, Felix Sternkopf via \
gstreamer-devel <gstreamer-devel@lists.freedesktop.org> wrote:    
  <!--#yiv2705075862 filtered {}#yiv2705075862 filtered {}#yiv2705075862 filtered \
{}#yiv2705075862 p.yiv2705075862MsoNormal, #yiv2705075862 li.yiv2705075862MsoNormal, \
#yiv2705075862 div.yiv2705075862MsoNormal \
{margin:0cm;margin-bottom:.0001pt;font-size:11.0pt;font-family:"Calibri", \
sans-serif;}#yiv2705075862 a:link, #yiv2705075862 span.yiv2705075862MsoHyperlink \
{color:#0563C1;text-decoration:underline;}#yiv2705075862 a:visited, #yiv2705075862 \
span.yiv2705075862MsoHyperlinkFollowed \
{color:#954F72;text-decoration:underline;}#yiv2705075862 \
span.yiv2705075862E-MailFormatvorlage17 {font-family:"Arial", \
sans-serif;color:windowtext;}#yiv2705075862 .yiv2705075862MsoChpDefault \
{font-family:"Calibri", sans-serif;}#yiv2705075862 filtered {}#yiv2705075862 \
div.yiv2705075862WordSection1 {}--> Dear GST Community,
 
i have implemented a rtsp server with the gst-rtsp-server module. The server receives \
an audio signal via an interaudiosrc and a video signal via an intervideosrc:  
                      intervideosrc channel=videosrc Ă  videoconvertĂ  vaapih264enc \
bitrate=5000 zerolatency=trueĂ  rtph264pay pt=96 name=pay0  
                       interaudiosrc channel=audiosrcĂ  opusenc bitrate=64Ă  queueĂ  \
rtpopuspay pt=97 name=pay1  
   
 
When I try to view the stream via an rtsp client, for example VLC Player the stream \
works, but the audio signal is about 1 second behind the video signal. I already \
tried different audio encoders and different queue parameters like buffer size and \
leaky queues, but nothing solved the problem.  
When I start the same pipeline as above but mux both signals and write them into a \
filesink they are synchronized.  
   
 
I know that the server module internally uses the multiudpsink element. Is there any \
possibility to edit multiudpsink parameters from outside?  
Does anybody have any ideas about this problem? I already read every google result I \
could find about it.  
   
 
Best Regards,
 
Felix Sternkopf
   


[Attachment #3 (text/html)]

<html><head></head><body><div class="ydp78cdc2d0yahoo-style-wrap" \
style="font-family:Helvetica Neue, Helvetica, Arial, \
sans-serif;font-size:13px;"><div></div>  <div dir="ltr" data-setdir="false">I guess \
you send out audio and video separately. If yes, you may try to send out audio first \
and then video.</div><div dir="ltr" data-setdir="false"><br></div><div dir="ltr" \
data-setdir="false">&nbsp;&nbsp; Joe<br></div><div><br></div>  
        </div><div id="yahoo_quoted_4094826741" class="yahoo_quoted">
            <div style="font-family:'Helvetica Neue', Helvetica, Arial, \
sans-serif;font-size:13px;color:#26282a;">  
                <div>
                        On Thursday, April 18, 2024, 08:13:43 a.m. EDT, Felix \
Sternkopf via gstreamer-devel &lt;gstreamer-devel@lists.freedesktop.org&gt; wrote:  \
</div>  <div><br></div>
                    <div><br></div>
                
                
                <div><div id="yiv2705075862">

 
 
<style><!--

#yiv2705075862 filtered {}
#yiv2705075862 filtered {}
#yiv2705075862 filtered {}

#yiv2705075862 p.yiv2705075862MsoNormal, #yiv2705075862 li.yiv2705075862MsoNormal, \
#yiv2705075862 div.yiv2705075862MsoNormal  \
{margin:0cm;margin-bottom:.0001pt;font-size:11.0pt;font-family:"Calibri", \
sans-serif;} #yiv2705075862 a:link, #yiv2705075862 span.yiv2705075862MsoHyperlink
	{color:#0563C1;text-decoration:underline;}
#yiv2705075862 a:visited, #yiv2705075862 span.yiv2705075862MsoHyperlinkFollowed
	{color:#954F72;text-decoration:underline;}
#yiv2705075862 span.yiv2705075862E-MailFormatvorlage17
	{font-family:"Arial", sans-serif;color:windowtext;}
#yiv2705075862 .yiv2705075862MsoChpDefault
	{font-family:"Calibri", sans-serif;}
#yiv2705075862 filtered {}
#yiv2705075862 div.yiv2705075862WordSection1
	{}
--></style>

<div>
<div class="yiv2705075862WordSection1">
<p class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Dear GST Community,</span></p>  <p \
class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">i have implemented a rtsp server \
with the gst-rtsp-server module. The server receives an audio signal via an \
interaudiosrc and a video signal via an intervideosrc:</span></p>  <p \
class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
 <i>intervideosrc channel=videosrc </i></span><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ă </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> videoconvert </span></i><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ă </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> vaapih264enc bitrate=5000 \
zerolatency=true </span></i><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ă </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> rtph264pay pt=96 \
name=pay0</span></i></p>  <p class="yiv2705075862MsoNormal"><i><span \
style="font-size:10.0pt;font-family:sans-serif;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; \
interaudiosrc channel=audiosrc </span></i><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ă </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> opusenc bitrate=64 \
</span></i><i><span style="font-size:10.0pt;font-family:Wingdings;">Ă \
</span></i><i><span style="font-size:10.0pt;font-family:sans-serif;"> queue \
</span></i><i><span style="font-size:10.0pt;font-family:Wingdings;">Ă \
</span></i><i><span style="font-size:10.0pt;font-family:sans-serif;"> rtpopuspay \
pt=97 name=pay1</span></i></p>  <p class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;"> &nbsp;</span></p>  <p \
class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">When I try to view the stream via an \
rtsp client, for example VLC Player the stream works, but the audio signal is about 1 \
second behind the video signal. I already tried different  audio encoders and \
different queue parameters like buffer size and leaky queues, but nothing solved the \
problem.</span></p>  <p class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">When I start the same pipeline as \
above but mux both signals and write them into a filesink they are \
synchronized.</span></p>  <p class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;"> &nbsp;</span></p>  <p \
class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">I know that the server module \
internally uses the multiudpsink element. Is there any possibility to edit \
multiudpsink parameters from outside?</span></p>  <p \
class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Does anybody have any ideas about \
this problem? I already read every google result I could find about it.</span></p>  \
<p class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;"> &nbsp;</span></p>  <p \
class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Best Regards,</span></p>  <p \
class="yiv2705075862MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Felix Sternkopf</span></p>  </div>
</div>

</div></div>
            </div>
        </div></body></html>



[prev in list] [next in list] [prev in thread] [next in thread]
Configure | About | News | Add a list | Sponsored by KoreLogic