[prev in list] [next in list] [prev in thread] [next in thread] 

List:       gstreamer-devel
Subject:    Re: Unsynced Audio and Video signals in RTSP Stream
From:       vinod kesti via gstreamer-devel <gstreamer-devel () lists ! freedesktop ! org>
Date:       2024-04-23 15:46:31
Message-ID: 1735400834.1779776.1713887191343 () mail ! yahoo ! com
[Download RAW message or body]

Try sending SR report. The NTP timestamp in the SR report will help in audio and \
video synchronization.Check rtpbin examples which have SR and RR reort


Sent from Yahoo Mail. Get the app 

    On Monday, 22 April, 2024 at 03:20:51 pm GMT-5, cfd new via gstreamer-devel \
<gstreamer-devel@lists.freedesktop.org> wrote:    
  I guess you send out audio and video separately. If yes, you may try to send out \
audio first and then video.  Joe

    On Thursday, April 18, 2024, 08:13:43 a.m. EDT, Felix Sternkopf via \
gstreamer-devel <gstreamer-devel@lists.freedesktop.org> wrote:    
  <!--#yiv4638044512 filtered {}#yiv4638044512 filtered {}#yiv4638044512 filtered \
{}#yiv4638044512 p.yiv4638044512MsoNormal, #yiv4638044512 li.yiv4638044512MsoNormal, \
#yiv4638044512 div.yiv4638044512MsoNormal \
{margin:0cm;margin-bottom:.0001pt;font-size:11.0pt;font-family:"Calibri", \
sans-serif;}#yiv4638044512 a:link, #yiv4638044512 span.yiv4638044512MsoHyperlink \
{color:#0563C1;text-decoration:underline;}#yiv4638044512 a:visited, #yiv4638044512 \
span.yiv4638044512MsoHyperlinkFollowed \
{color:#954F72;text-decoration:underline;}#yiv4638044512 \
span.yiv4638044512E-MailFormatvorlage17 {font-family:"Arial", \
sans-serif;color:windowtext;}#yiv4638044512 .yiv4638044512MsoChpDefault \
{font-family:"Calibri", sans-serif;}#yiv4638044512 filtered {}#yiv4638044512 \
div.yiv4638044512WordSection1 {}--> Dear GST Community,
 
i have implemented a rtsp server with the gst-rtsp-server module. The server receives \
an audio signal via an interaudiosrc and a video signal via an intervideosrc:  
                      intervideosrc channel=videosrc à videoconvertà vaapih264enc \
bitrate=5000 zerolatency=trueà rtph264pay pt=96 name=pay0  
                       interaudiosrc channel=audiosrcà opusenc bitrate=64à queueà \
rtpopuspay pt=97 name=pay1  
   
 
When I try to view the stream via an rtsp client, for example VLC Player the stream \
works, but the audio signal is about 1 second behind the video signal. I already \
tried different audio encoders and different queue parameters like buffer size and \
leaky queues, but nothing solved the problem.  
When I start the same pipeline as above but mux both signals and write them into a \
filesink they are synchronized.  
   
 
I know that the server module internally uses the multiudpsink element. Is there any \
possibility to edit multiudpsink parameters from outside?  
Does anybody have any ideas about this problem? I already read every google result I \
could find about it.  
   
 
Best Regards,
 
Felix Sternkopf
     


[Attachment #3 (text/html)]

<html><head></head><body><div class="ydpb1b69bc8yahoo-style-wrap" \
style="font-family:Helvetica Neue, Helvetica, Arial, \
sans-serif;font-size:13px;"><div><div dir="ltr" data-setdir="false">Try sending SR \
report. The NTP timestamp in the SR report will help in audio and video \
synchronization.</div><div dir="ltr" data-setdir="false">Check rtpbin examples which \
have SR and RR reort</div><div><br></div><div \
class="ydpb1b69bc8signature"><div><br></div><div><br></div><div>Sent from Yahoo Mail. \
<a href="https://yho.com/148vdq" rel="nofollow" target="_blank">Get the \
app</a></div></div></div>  <div><br></div><div><br></div>
        
        </div><div id="yahoo_quoted_4535870060" class="yahoo_quoted">
            <div style="font-family:'Helvetica Neue', Helvetica, Arial, \
sans-serif;font-size:13px;color:#26282a;">  
                <div>
                        On Monday, 22 April, 2024 at 03:20:51 pm GMT-5, cfd new via \
gstreamer-devel &lt;gstreamer-devel@lists.freedesktop.org&gt; wrote:  </div>
                    <div><br></div>
                    <div><br></div>
                
                
                <div><div id="yiv4638044512"><div><div style="font-family:Helvetica \
Neue, Helvetica, Arial, sans-serif;font-size:13px;" \
class="yiv4638044512ydp78cdc2d0yahoo-style-wrap"><div></div>  <div dir="ltr">I guess \
you send out audio and video separately. If yes, you may try to send out audio first \
and then video.</div><div dir="ltr"><br clear="none"></div><div \
dir="ltr">&nbsp;&nbsp; Joe<br clear="none"></div><div><br clear="none"></div>  
        </div><div id="yiv4638044512yqt63953" class="yiv4638044512yqt9414871302"><div \
                id="yiv4638044512yahoo_quoted_4094826741" \
                class="yiv4638044512yahoo_quoted">
            <div style="font-family:'Helvetica Neue', Helvetica, Arial, \
sans-serif;font-size:13px;color:#26282a;">  
                <div>
                        On Thursday, April 18, 2024, 08:13:43 a.m. EDT, Felix \
Sternkopf via gstreamer-devel &lt;gstreamer-devel@lists.freedesktop.org&gt; wrote:  \
</div>  <div><br clear="none"></div>
                    <div><br clear="none"></div>
                
                
                <div><div id="yiv4638044512">

 
 
<style><!--

#yiv4638044512  filtered {}
#yiv4638044512  filtered {}
#yiv4638044512  filtered {}

#yiv4638044512  p.yiv4638044512MsoNormal, #yiv4638044512  li.yiv4638044512MsoNormal, \
#yiv4638044512  div.yiv4638044512MsoNormal  \
{margin:0cm;margin-bottom:.0001pt;font-size:11.0pt;font-family:"Calibri", \
sans-serif;} #yiv4638044512  a:link, #yiv4638044512  span.yiv4638044512MsoHyperlink
	{color:#0563C1;text-decoration:underline;}
#yiv4638044512  a:visited, #yiv4638044512  span.yiv4638044512MsoHyperlinkFollowed
	{color:#954F72;text-decoration:underline;}
#yiv4638044512  span.yiv4638044512E-MailFormatvorlage17
	{font-family:"Arial", sans-serif;color:windowtext;}
#yiv4638044512  .yiv4638044512MsoChpDefault
	{font-family:"Calibri", sans-serif;}
#yiv4638044512  filtered {}
#yiv4638044512  div.yiv4638044512WordSection1
	{}
--></style>

<div>
<div class="yiv4638044512WordSection1">
<p class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Dear GST Community,</span></p>  <p \
class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">i have implemented a rtsp server \
with the gst-rtsp-server module. The server receives an audio signal via an \
interaudiosrc and a video signal via an intervideosrc:</span></p>  <p \
class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
 <i>intervideosrc channel=videosrc </i></span><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ã </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> videoconvert </span></i><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ã </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> vaapih264enc bitrate=5000 \
zerolatency=true </span></i><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ã </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> rtph264pay pt=96 \
name=pay0</span></i></p>  <p class="yiv4638044512MsoNormal"><i><span \
style="font-size:10.0pt;font-family:sans-serif;">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; \
interaudiosrc channel=audiosrc </span></i><i><span \
style="font-size:10.0pt;font-family:Wingdings;">Ã </span></i><i><span \
style="font-size:10.0pt;font-family:sans-serif;"> opusenc bitrate=64 \
</span></i><i><span style="font-size:10.0pt;font-family:Wingdings;">Ã \
</span></i><i><span style="font-size:10.0pt;font-family:sans-serif;"> queue \
</span></i><i><span style="font-size:10.0pt;font-family:Wingdings;">Ã \
</span></i><i><span style="font-size:10.0pt;font-family:sans-serif;"> rtpopuspay \
pt=97 name=pay1</span></i></p>  <p class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;"> &nbsp;</span></p>  <p \
class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">When I try to view the stream via an \
rtsp client, for example VLC Player the stream works, but the audio signal is about 1 \
second behind the video signal. I already tried different  audio encoders and \
different queue parameters like buffer size and leaky queues, but nothing solved the \
problem.</span></p>  <p class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">When I start the same pipeline as \
above but mux both signals and write them into a filesink they are \
synchronized.</span></p>  <p class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;"> &nbsp;</span></p>  <p \
class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">I know that the server module \
internally uses the multiudpsink element. Is there any possibility to edit \
multiudpsink parameters from outside?</span></p>  <p \
class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Does anybody have any ideas about \
this problem? I already read every google result I could find about it.</span></p>  \
<p class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;"> &nbsp;</span></p>  <p \
class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Best Regards,</span></p>  <p \
class="yiv4638044512MsoNormal"><span \
style="font-size:10.0pt;font-family:sans-serif;">Felix Sternkopf</span></p>  </div>
</div>

</div></div>
            </div>
        </div></div></div></div></div>
            </div>
        </div></body></html>



[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic