[prev in list] [next in list] [prev in thread] [next in thread] 

List:       asterisk-dev
Subject:    Re: [asterisk-dev] Asterisk 1.8 deadlock with Kernel 4.1
From:       Matthew Jordan <mjordan () digium ! com>
Date:       2015-11-18 20:20:04
Message-ID: CAN2PU+5NxM317F35X4S5QVO1i4+2XWtiy9MGzpORs-4AZLhsnw () mail ! gmail ! com
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]


On Wed, Nov 18, 2015 at 2:01 PM, Stefan Priebe <s.priebe@profihost.ag>
wrote:

> Am 18.11.2015 um 19:46 schrieb Matthew Jordan:
>
>>
>>
>> On Wed, Nov 18, 2015 at 12:37 PM, Stefan Priebe <s.priebe@profihost.ag
>> <mailto:s.priebe@profihost.ag>> wrote:
>>
>>     Hello,
>>
>>     since Upgrading our Asterisk System from Kernel 3.18.17 to 4.1.13 it
>>     deadlocks every few hours (kill -9 is the only thing working). Booting
>>     with 3.18 again let it run smooth again.
>>
>>     I've now also two gdb backtraces from two crashes:
>>     http://pastebin.com/raw.php?i=yih5jNt8
>>
>>     http://pastebin.com/raw.php?i=kGEcvH4T
>>
>>     The kernel guys forwarded me to asterisk to find out where it hangs.
>>
>>
>> Your pastebin links don't appear to be working.
>>
>
> Pastebin is down for raw links. It's up for the normal links.
>
> http://pastebin.com/yih5jNt8
> and
> http://pastebin.com/kGEcvH4T
>
>
>> Please either attach the backtraces, or send them along in the text of
>> the e-mail. (Plus, that way we'll have them for posterity.)
>>
>
> Sure here it comes:
> Thread 35 (Thread 0x7f295e945700 (LWP 26637)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04
> "taskprocessor.c", lineno=310,
>     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71
> "&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
>     cond=0x19e9ad0, t=0x19e9b08) at lock.c:565
> #2  0x0000000000555e9a in tps_processing_function (data=0x19e9ac8) at
> taskprocessor.c:310
> #3  0x0000000000569280 in dummy_start (data=0x19eb300) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 34 (Thread 0x7f295e8c9700 (LWP 26638)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=-1)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x000000000043e5e4 in listener (unused=0x0) at asterisk.c:1393
> #2  0x0000000000569280 in dummy_start (data=0x19ec150) at utils.c:1173
> #3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>
> Thread 33 (Thread 0x7f295e84d700 (LWP 26639)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5bcdf4 "logger.c",
> lineno=1072, func=0x5bdc02 "logger_thread",
>     cond_name=0x5bd8ae "&logcond", mutex_name=0x5bd8a0 "&logmsgs.lock",
> cond=0x826b80, t=0x80e550) at lock.c:565
> #2  0x00000000004ea0fa in logger_thread (data=0x0) at logger.c:1072
> #3  0x0000000000569280 in dummy_start (data=0x19ec1c0) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 32 (Thread 0x7f295c08d700 (LWP 26653)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5ae3d4
> "devicestate.c", lineno=549, func=0x5aeb10 "do_devstate_changes",
>     cond_name=0x5ae687 "&change_pending", mutex_name=0x5ae697
> "&state_changes.lock", cond=0x825ea0, t=0x80b4f0) at lock.c:565
> #2  0x00000000004a0764 in do_devstate_changes (data=0x0) at
> devicestate.c:549
> #3  0x0000000000569280 in dummy_start (data=0x1ed7b90) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 31 (Thread 0x7f295c011700 (LWP 26654)):
> #0  0x00007f295de3287d in recvmsg () at
> ../sysdeps/unix/syscall-template.S:82
> #1  0x00007f295de52fcc in make_request (fd=35, pid=26631,
> seen_ipv4=<optimized out>, seen_ipv6=<optimized out>,
>     in6ai=<optimized out>, in6ailen=<optimized out>) at
> ../sysdeps/unix/sysv/linux/check_pf.c:119
> #2  0x00007f295de5344a in __check_pf (seen_ipv4=0x7f295c00e85f,
> seen_ipv6=0x7f295c00e85e, in6ai=0x7f295c00e840,
>     in6ailen=0x7f295c00e838) at ../sysdeps/unix/sysv/linux/check_pf.c:271
> #3  0x00007f295de10007 in *__GI_getaddrinfo (name=0x7f295c00e8b0
> "10.12.12.55", service=0x7f295c00e8bc "2135",
>     hints=0x7f295c00e910, pai=0x7f295c00e908) at
> ../sysdeps/posix/getaddrinfo.c:2389
> #4  0x000000000050287e in ast_sockaddr_resolve (addrs=0x7f295c00e9d0,
> str=0x7f295c00ea30 "10.12.12.55:2135", flags=0, family=2)
>     at netsock2.c:268
> #5  0x00007f2958963ba2 in ast_sockaddr_resolve_first_af
> (addr=0x7f29300591d8, name=0x7f295c00ea30 "10.12.12.55:2135", flag=0,
>     family=2) at chan_sip.c:30689
> #6  0x00007f2958963cb5 in ast_sockaddr_resolve_first_transport
> (addr=0x7f29300591d8, name=0x7f295c00ea30 "10.12.12.55:2135",
> ---Type <return> to continue, or q <return> to quit---
>     flag=0, transport=1) at chan_sip.c:30720
> #7  0x00007f29588fd3cc in set_destination (p=0x7f2930058cc8,
> uri=0x7f29300576e8 "sip:9052@10.12.12.55:2135;line=to7a729l")
>     at chan_sip.c:10455
> #8  0x00007f29588fe6e0 in reqprep (req=0x7f295c00fee0, p=0x7f2930058cc8,
> sipmethod=4, seqno=287, newbranch=1) at chan_sip.c:10778
> #9  0x00007f295890a201 in transmit_state_notify (p=0x7f2930058cc8,
> state=1, full=1, timeout=0) at chan_sip.c:13259
> #10 0x00007f29589141bb in cb_extensionstate (context=0x7f295c010cd0
> "hints", exten=0x7f295c010c80 "9052QS", state=1,
>     data=0x7f2930058cc8) at chan_sip.c:15117
> #11 0x000000000050ebf6 in handle_statechange (datap=0x7f293acef830) at
> pbx.c:4972
> #12 0x0000000000555f8e in tps_processing_function (data=0x1f24f28) at
> taskprocessor.c:327
> #13 0x0000000000569280 in dummy_start (data=0x1ed76f0) at utils.c:1173
> #14 0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #15 0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #16 0x0000000000000000 in ?? ()
>
> Thread 30 (Thread 0x7f295bf95700 (LWP 26655)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=-1)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x00000000004c161d in do_parking_thread (ignore=0x0) at features.c:4975
> #2  0x0000000000569280 in dummy_start (data=0x1aea3c0) at utils.c:1173
> #3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>
> Thread 29 (Thread 0x7f295bf19700 (LWP 26656)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5ada64 "db.c",
> lineno=819, func=0x5ae330 "db_sync_thread",
>     cond_name=0x5ae2d8 "&dbcond", mutex_name=0x5ada9c "&dblock",
> cond=0x825e60, t=0x80af80) at lock.c:565
> #2  0x000000000049f653 in db_sync_thread (data=0x0) at db.c:819
> #3  0x0000000000569280 in dummy_start (data=0x1aea3e0) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 28 (Thread 0x7f295be9d700 (LWP 26657)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04
> "taskprocessor.c", lineno=310,
>     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71
> "&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
>     cond=0x7f2954006c60, t=0x7f2954006c98) at lock.c:565
> #2  0x0000000000555e9a in tps_processing_function (data=0x7f2954006c58) at
> taskprocessor.c:310
> #3  0x0000000000569280 in dummy_start (data=0x7f2954003730) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 27 (Thread 0x7f295be21700 (LWP 26658)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d1144 "sched.c",
> lineno=110, func=0x5d1666 "sched_run",
>     cond_name=0x5d1156 "&st->cond", mutex_name=0x5d114c "&st->lock",
> cond=0x7f29540035d0, t=0x7f2954003598) at lock.c:565
> #2  0x0000000000549bd3 in sched_run (data=0x7f2954003590) at sched.c:110
> #3  0x0000000000569280 in dummy_start (data=0x7f29540048e0) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> ---Type <return> to continue, or q <return> to quit---
> Thread 26 (Thread 0x7f295b13e700 (LWP 26663)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2941c4a3f4
> "res_timing_pthread.c", lineno=476,
>     func=0x7f2941c4a7c3 "do_timing", cond_name=0x7f2941c4a434
> "&timing_thread.cond",
>     mutex_name=0x7f2941c4a420 "&timing_thread.lock", cond=0x7f2941e4b540,
> t=0x7f2941e4b508) at lock.c:565
> #2  0x00007f2941c4a10e in do_timing (arg=0x0) at res_timing_pthread.c:476
> #3  0x0000000000569280 in dummy_start (data=0x20a3d70) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 25 (Thread 0x7f29580b2700 (LWP 26669)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04
> "taskprocessor.c", lineno=310,
>     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71
> "&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
>     cond=0x7f2954ce6c20, t=0x7f2954ce6c58) at lock.c:565
> #2  0x0000000000555e9a in tps_processing_function (data=0x7f2954ce6c18) at
> taskprocessor.c:310
> #3  0x0000000000569280 in dummy_start (data=0x7f2954ce8450) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 24 (Thread 0x7f293dc8e700 (LWP 26670)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d1144 "sched.c",
> lineno=110, func=0x5d1666 "sched_run",
>     cond_name=0x5d1156 "&st->cond", mutex_name=0x5d114c "&st->lock",
> cond=0x7f2957fffe80, t=0x7f2957fffe48) at lock.c:565
> #2  0x0000000000549bd3 in sched_run (data=0x7f2957fffe40) at sched.c:110
> #3  0x0000000000569280 in dummy_start (data=0x7f2954ce8450) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 23 (Thread 0x7f293dc12700 (LWP 26671)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa017e8,
> t=0x7f293aa017b0) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa006f0) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 22 (Thread 0x7f293db96700 (LWP 26672)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa04c98,
> t=0x7f293aa04c60) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa03ba0) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> ---Type <return> to continue, or q <return> to quit---
> Thread 21 (Thread 0x7f293db1a700 (LWP 26673)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa076e8,
> t=0x7f293aa076b0) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa065f0) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 20 (Thread 0x7f293da9e700 (LWP 26674)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa0a1a8,
> t=0x7f293aa0a170) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa090b0) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 19 (Thread 0x7f293da22700 (LWP 26675)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa0cc68,
> t=0x7f293aa0cc30) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa0bb70) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 18 (Thread 0x7f293d9a6700 (LWP 26676)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa0f728,
> t=0x7f293aa0f6f0) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa0e630) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 17 (Thread 0x7f293d92a700 (LWP 26677)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa121e8,
> t=0x7f293aa121b0) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa110f0) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
> ---Type <return> to continue, or q <return> to quit---
>
> Thread 16 (Thread 0x7f293d8ae700 (LWP 26678)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa14ca8,
> t=0x7f293aa14c70) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa13bb0) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 15 (Thread 0x7f293d832700 (LWP 26679)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa17768,
> t=0x7f293aa17730) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa16670) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 14 (Thread 0x7f293d7b6700 (LWP 26680)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4
> "chan_iax2.c", lineno=11943,
>     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1
> "&thread->cond",
>     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa1a228,
> t=0x7f293aa1a1f0) at lock.c:565
> #2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa19130) at
> chan_iax2.c:11943
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 13 (Thread 0x7f293d73a700 (LWP 26681)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=1000)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x00000000004ddfbc in ast_io_wait (ioc=0x7f293a9ec060, howlong=1000)
> at io.c:279
> #2  0x00007f2959b686e3 in network_thread (ignore=0x0) at chan_iax2.c:12413
> #3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 12 (Thread 0x7f293d4b8700 (LWP 26682)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=1000)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x00000000004ddfbc in ast_io_wait (ioc=0x7f293aa1d960, howlong=1000)
> at io.c:279
> #2  0x00007f295894b24c in do_monitor (data=0x0) at chan_sip.c:26701
> #3  0x0000000000569280 in dummy_start (data=0x7f293aa34210) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> ---Type <return> to continue, or q <return> to quit---
> Thread 11 (Thread 0x7f293cc3b700 (LWP 26684)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=-1)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x00007f2958bb07c3 in do_monitor (data=0x0) at chan_phone.c:1086
> #2  0x0000000000569280 in dummy_start (data=0x767c590) at utils.c:1173
> #3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>
> Thread 10 (Thread 0x7f293cbbf700 (LWP 26685)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=-1)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x00007f2953dfdf99 in scan_thread (unused=0x0) at pbx_spool.c:694
> #2  0x0000000000569280 in dummy_start (data=0x1f48510) at utils.c:1173
> #3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>
> Thread 9 (Thread 0x7f293cb43700 (LWP 26686)):
> #0  0x00007f295de0148d in nanosleep () at
> ../sysdeps/unix/syscall-template.S:82
> #1  0x00007f29580b4be6 in cleanup (unused=0x0) at pbx_realtime.c:133
> #2  0x0000000000569280 in dummy_start (data=0x7f293ab4eb60) at utils.c:1173
> #3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>
> Thread 8 (Thread 0x7f293cac7700 (LWP 26687)):
> #0  0x00007f295de0148d in nanosleep () at
> ../sysdeps/unix/syscall-template.S:82
> #1  0x00007f29402c6bce in lock_broker (unused=0x0) at func_lock.c:211
> #2  0x0000000000569280 in dummy_start (data=0x7f293ab4c160) at utils.c:1173
> #3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>
> Thread 7 (Thread 0x7f293ca4b700 (LWP 26688)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04
> "taskprocessor.c", lineno=310,
>     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71
> "&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
>     cond=0x7f293acad850, t=0x7f293acad888) at lock.c:565
> #2  0x0000000000555e9a in tps_processing_function (data=0x7f293acad848) at
> taskprocessor.c:310
> #3  0x0000000000569280 in dummy_start (data=0x7f293ab45d50) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 6 (Thread 0x7f293c9cf700 (LWP 26689)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04
> "taskprocessor.c", lineno=310,
>     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71
> "&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
>     cond=0x7f293acd4120, t=0x7f293acd4158) at lock.c:565
> #2  0x0000000000555e9a in tps_processing_function (data=0x7f293acd4118) at
> taskprocessor.c:310
> #3  0x0000000000569280 in dummy_start (data=0x7f293acd41e0) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> ---Type <return> to continue, or q <return> to quit---
> #6  0x0000000000000000 in ?? ()
>
> Thread 5 (Thread 0x7f293c8d7700 (LWP 26933)):
> #0  0x00007f295de2598d in read () at ../sysdeps/unix/syscall-template.S:82
> #1  0x000000000054e352 in inotify_daemon (data=0x0) at
> stdtime/localtime.c:295
> #2  0x0000000000569280 in dummy_start (data=0x7724c80) at utils.c:1173
> #3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #4  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #5  0x0000000000000000 in ?? ()
>
> Thread 4 (Thread 0x7f293c573700 (LWP 2697)):
> #0  pthread_cond_wait@@GLIBC_2.3.2 () at
> ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
> #1  0x00000000004e51ad in __ast_cond_wait (filename=0x59c654
> "autoservice.c", lineno=102, func=0x59c7f0 "autoservice_run",
>     cond_name=0x59c680 "&as_cond", mutex_name=0x59c673 "&aslist.lock",
> cond=0x825ae0, t=0x808b70) at lock.c:565
> #2  0x000000000044c10e in autoservice_run (ign=0x0) at autoservice.c:102
> #3  0x0000000000569280 in dummy_start (data=0x76b4060) at utils.c:1173
> #4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #5  0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #6  0x0000000000000000 in ?? ()
>
> Thread 3 (Thread 0x7f293c5ef700 (LWP 13169)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=-1)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x0000000000472132 in ast_waitfor_nandfds (c=0x7f293c5e8510, n=2,
> fds=0x0, nfds=0, exception=0x0, outfd=0x0, ms=0x7f293c5e850c)
>     at channel.c:3282
> #2  0x00000000004725ce in ast_waitfor_n (c=0x7f293c5e8510, n=2,
> ms=0x7f293c5e850c) at channel.c:3536
> #3  0x000000000047f61d in ast_generic_bridge (c0=0x7f293acfc368,
> c1=0x7a07b08, config=0x7f293c5e9e50, fo=0x7f293c5e8c88,
>     rc=0x7f293c5e8c80) at channel.c:7283
> #4  0x0000000000481e7a in ast_channel_bridge (c0=0x7f293acfc368,
> c1=0x7a07b08, config=0x7f293c5e9e50, fo=0x7f293c5e8c88,
>     rc=0x7f293c5e8c80) at channel.c:7751
> #5  0x00000000004be6cc in ast_bridge_call (chan=0x7f293acfc368,
> peer=0x7a07b08, config=0x7f293c5e9e50) at features.c:4135
> #6  0x00007f29525c1092 in dial_exec_full (chan=0x7f293acfc368,
> data=0x7f293c5ec610 "SIP/9016,,wt", peerflags=0x7f293c5ea3f0,
>     continue_exec=0x0) at app_dial.c:2957
> #7  0x00007f29525c198e in dial_exec (chan=0x7f293acfc368,
> data=0x7f293c5ec610 "SIP/9016,,wt") at app_dial.c:3061
> #8  0x0000000000503dd5 in pbx_exec (c=0x7f293acfc368, app=0x7f293ab56f60,
> data=0x7f293c5ec610 "SIP/9016,,wt") at pbx.c:1479
> #9  0x000000000050e13d in pbx_extension_helper (c=0x7f293acfc368, con=0x0,
> context=0x7f293acfc8c0 "privat",
>     exten=0x7f293acfc910 "9016", priority=4, label=0x0, callerid=0x77f1b20
> "02202459352", action=E_SPAWN, found=0x7f293c5eed0c,
>     combined_find_spawn=1) at pbx.c:4739
> #10 0x000000000050fcc7 in ast_spawn_extension (c=0x7f293acfc368,
> context=0x7f293acfc8c0 "privat", exten=0x7f293acfc910 "9016",
>     priority=4, callerid=0x77f1b20 "02202459352", found=0x7f293c5eed0c,
> combined_find_spawn=1) at pbx.c:5381
> #11 0x0000000000510643 in __ast_pbx_run (c=0x7f293acfc368, args=0x0) at
> pbx.c:5484
> #12 0x00000000005120d5 in pbx_thread (data=0x7f293acfc368) at pbx.c:5825
> #13 0x0000000000569280 in dummy_start (data=0x7f293aca7fa0) at utils.c:1173
> #14 0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #15 0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #16 0x0000000000000000 in ?? ()
>
> Thread 2 (Thread 0x7f293c85b700 (LWP 15515)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=-1)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x0000000000472132 in ast_waitfor_nandfds (c=0x7f293c852810, n=2,
> fds=0x0, nfds=0, exception=0x0, outfd=0x0, ms=0x7f293c85280c)
>     at channel.c:3282
> #2  0x00000000004725ce in ast_waitfor_n (c=0x7f293c852810, n=2,
> ms=0x7f293c85280c) at channel.c:3536
> #3  0x000000000047f61d in ast_generic_bridge (c0=0x76cadc8, c1=0x771cd58,
> config=0x7f293c854b00, fo=0x7f293c852f88,
> ---Type <return> to continue, or q <return> to quit---
>     rc=0x7f293c852f80) at channel.c:7283
> #4  0x0000000000481e7a in ast_channel_bridge (c0=0x76cadc8, c1=0x771cd58,
> config=0x7f293c854b00, fo=0x7f293c852f88,
>     rc=0x7f293c852f80) at channel.c:7751
> #5  0x00000000004be6cc in ast_bridge_call (chan=0x76cadc8, peer=0x771cd58,
> config=0x7f293c854b00) at features.c:4135
> #6  0x00007f2950161b7c in try_calling (qe=0x7f293c855180,
> options=0x7f293c8550fc "", announceoverride=0x7f293c8550fe "",
>     url=0x7f293c8550fd "", tries=0x7f293c856378, noption=0x7f293c856374,
> agi=0x0, macro=0x0, gosub=0x0, ringing=0)
>     at app_queue.c:5422
> #7  0x00007f29501653ec in queue_exec (chan=0x76cadc8, data=0x7f293c858610
> "q-smm1-lr,tw,,,30") at app_queue.c:6374
> #8  0x0000000000503dd5 in pbx_exec (c=0x76cadc8, app=0x7f293ab5ff20,
> data=0x7f293c858610 "q-smm1-lr,tw,,,30") at pbx.c:1479
> #9  0x000000000050e13d in pbx_extension_helper (c=0x76cadc8, con=0x0,
> context=0x76cb320 "add2q-default", exten=0x76cb370 "1",
>     priority=7, label=0x0, callerid=0x7789650 "015143119706",
> action=E_SPAWN, found=0x7f293c85ad0c, combined_find_spawn=1)
>     at pbx.c:4739
> #10 0x000000000050fcc7 in ast_spawn_extension (c=0x76cadc8,
> context=0x76cb320 "add2q-default", exten=0x76cb370 "1", priority=7,
>     callerid=0x7789650 "015143119706", found=0x7f293c85ad0c,
> combined_find_spawn=1) at pbx.c:5381
> #11 0x0000000000510643 in __ast_pbx_run (c=0x76cadc8, args=0x0) at
> pbx.c:5484
> #12 0x00000000005120d5 in pbx_thread (data=0x76cadc8) at pbx.c:5825
> #13 0x0000000000569280 in dummy_start (data=0x774df20) at utils.c:1173
> #14 0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at
> pthread_create.c:304
> #15 0x00007f295de3195d in clone () at
> ../sysdeps/unix/sysv/linux/x86_64/clone.S:112
> #16 0x0000000000000000 in ?? ()
>
> Thread 1 (Thread 0x7f295e947700 (LWP 26631)):
> #0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>,
> nfds=<optimized out>, timeout=-1)
>     at ../sysdeps/unix/sysv/linux/poll.c:87
> #1  0x0000000000444123 in monitor_sig_flags (unused=0x0) at asterisk.c:3294
> #2  0x0000000000446a53 in main (argc=5, argv=0x7ffca463dfb8) at
> asterisk.c:4165
>
> and
>
> (gdb) thread apply all bt
>
> Thread 34 (Thread 0x7fbeba9c7700 (LWP 2463)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x000000000053c37b in tps_processing_function (data=data@entry=0x1e7bef8)
> at taskprocessor.c:310
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 33 (Thread 0x7fbeba94b700 (LWP 2464)):
> #0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x000000000043f872 in listener (unused=unused@entry=0x0) at
> asterisk.c:1381
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 32 (Thread 0x7fbeba8cf700 (LWP 2465)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00000000004dbd34 in logger_thread (data=data@entry=0x0) at
> logger.c:1072
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 31 (Thread 0x7fbeb8325700 (LWP 2508)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x0000000000498771 in do_devstate_changes (data=data@entry=0x0) at
> devicestate.c:549
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 30 (Thread 0x7fbeb82a9700 (LWP 2509)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x000000000053c37b in tps_processing_function (data=data@entry=0x236eed8)
> at taskprocessor.c:310
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 29 (Thread 0x7fbeb822d700 (LWP 2510)):
> #0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00000000004b09f1 in do_parking_thread (ignore=ignore@entry=0x0) at
> features.c:4969
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 28 (Thread 0x7fbeb81b1700 (LWP 2511)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00000000004962fe in db_sync_thread (data=data@entry=0x0) at db.c:819
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
> ---Type <return> to continue, or q <return> to quit---
>
> Thread 27 (Thread 0x7fbeb8135700 (LWP 2513)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x000000000053c37b in tps_processing_function (data=data@entry=0x7fbeb4013c18)
> at taskprocessor.c:310
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 26 (Thread 0x7fbeb80b9700 (LWP 2514)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x0000000000533d44 in sched_run (data=data@entry=0x7fbeb4013df0) at
> sched.c:110
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 25 (Thread 0x7fbeb33a9700 (LWP 2647)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbe9a5b2787 in do_timing (arg=arg@entry=0x0) at
> res_timing_pthread.c:476
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 24 (Thread 0x7fbe99e75700 (LWP 2648)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x000000000053c37b in tps_processing_function (data=data@entry=0x283ab18)
> at taskprocessor.c:310
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 23 (Thread 0x7fbe99df9700 (LWP 2649)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x0000000000533d44 in sched_run (data=data@entry=0x283ae00) at
> sched.c:110
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 22 (Thread 0x7fbe99d7d700 (LWP 2650)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x2842150)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 21 (Thread 0x7fbe99d01700 (LWP 2651)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x28434d0)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
> ---Type <return> to continue, or q <return> to quit---
>
> Thread 20 (Thread 0x7fbe99c85700 (LWP 2652)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x2844870)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 19 (Thread 0x7fbe99c09700 (LWP 2653)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x2845c10)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 18 (Thread 0x7fbe99b8d700 (LWP 2654)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x2846fb0)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 17 (Thread 0x7fbe99b11700 (LWP 2655)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x2848350)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 16 (Thread 0x7fbe99a95700 (LWP 2656)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x28496f0)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 15 (Thread 0x7fbe99a19700 (LWP 2657)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x284aa90)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 14 (Thread 0x7fbe9999d700 (LWP 2658)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x284be30)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
> ---Type <return> to continue, or q <return> to quit---
>
> Thread 13 (Thread 0x7fbe99921700 (LWP 2659)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb1bb0132 in iax2_process_thread (data=data@entry=0x284d1d0)
> at chan_iax2.c:11943
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 12 (Thread 0x7fbe998a5700 (LWP 2660)):
> #0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00000000004d3aab in ast_io_wait (ioc=0x283bac0, howlong=howlong@entry=1000)
> at io.c:279
> #2  0x00007fbeb1b83485 in network_thread (ignore=ignore@entry=0x0) at
> chan_iax2.c:12413
> #3  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #4  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #5  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #6  0x0000000000000000 in ?? ()
>
> Thread 11 (Thread 0x7fbe99623700 (LWP 2661)):
> #0  0x00007fbeb9665d5c in __lll_lock_wait () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x00007fbeb96613c4 in _L_lock_997 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #2  0x00007fbeb9661227 in pthread_mutex_lock () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #3  0x00007fbeb098cc2a in find_call (req=req@entry=0x7fbe99622310,
> addr=addr@entry=0x7fbe99622280, intended_method=8)
>     at chan_sip.c:8622
> #4  0x00007fbeb09bac2a in handle_request_do (req=req@entry=0x7fbe99622310,
> addr=addr@entry=0x7fbe99622280) at chan_sip.c:26291
> #5  0x00007fbeb09bcdfa in sipsock_read (id=<optimized out>, fd=<optimized
> out>, events=<optimized out>, ignore=<optimized out>)
>     at chan_sip.c:26247
> #6  0x00000000004d3aff in ast_io_wait (ioc=0x285b380, howlong=<optimized
> out>) at io.c:292
> #7  0x00007fbeb09ab675 in do_monitor (data=data@entry=0x0) at
> chan_sip.c:26800
> #8  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #9  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #10 0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #11 0x0000000000000000 in ?? ()
>
> Thread 10 (Thread 0x7fbe995a7700 (LWP 2662)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x000000000053c37b in tps_processing_function (data=data@entry=0x28f6558)
> at taskprocessor.c:310
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 9 (Thread 0x7fbe9952b700 (LWP 2663)):
> #0  0x00007fbeb9e8348d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00007fbe9f7177ff in lock_broker (unused=unused@entry=0x0) at
> func_lock.c:211
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 8 (Thread 0x7fbe98cae700 (LWP 2665)):
> #0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00007fbeaff16f51 in scan_thread (unused=unused@entry=0x0) at
> pbx_spool.c:694
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> ---Type <return> to continue, or q <return> to quit---
> #5  0x0000000000000000 in ?? ()
>
> Thread 7 (Thread 0x7fbe98c32700 (LWP 2666)):
> #0  0x00007fbeb9e8348d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00007fbeb011aa4e in cleanup (unused=unused@entry=0x0) at
> pbx_realtime.c:133
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 6 (Thread 0x7fbe98bb6700 (LWP 2669)):
> #0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00007fbeb0bfb97b in do_monitor (data=data@entry=0x0) at
> chan_phone.c:1086
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 5 (Thread 0x7fbe98b3a700 (LWP 2670)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x000000000053c37b in tps_processing_function (data=data@entry=0x7fbeb4096a28)
> at taskprocessor.c:310
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 4 (Thread 0x7fbe98a42700 (LWP 8202)):
> #0  0x00007fbeb9ea798d in read () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x000000000053650b in inotify_daemon (data=data@entry=0x0) at
> stdtime/localtime.c:295
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 3 (Thread 0x7fbe98abe700 (LWP 10985)):
> #0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #1  0x0000000000447c2b in autoservice_run (ign=ign@entry=0x0) at
> autoservice.c:101
> #2  0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #3  0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #5  0x0000000000000000 in ?? ()
>
> Thread 2 (Thread 0x7fbe989c6700 (LWP 12890)):
> #0  0x00007fbeb9eb487d in recvmsg () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x00007fbeb9ed4fcc in ?? () from /lib/x86_64-linux-gnu/libc.so.6
> #2  0x00007fbeb9ed544a in ?? () from /lib/x86_64-linux-gnu/libc.so.6
> #3  0x00007fbeb9e92007 in getaddrinfo () from
> /lib/x86_64-linux-gnu/libc.so.6
> #4  0x00000000004f2e81 in ast_sockaddr_resolve (addrs=addrs@entry=0x7fbe989c48d8,
> str=<optimized out>,
>     str@entry=0x7fbe989c4a80 "10.12.12.92:2052", flags=flags@entry=0,
> family=2) at netsock2.c:268
> #5  0x00007fbeb095fb8b in ast_sockaddr_resolve_first_af (family=<optimized
> out>, flag=0, name=0x7fbe989c4a80 "10.12.12.92:2052",
>     addr=0x7fbeb4114948) at chan_sip.c:30797
> #6  ast_sockaddr_resolve_first_transport (transport=<optimized out>,
> flag=0, name=0x7fbe989c4a80 "10.12.12.92:2052",
>     addr=0x7fbeb4114948) at chan_sip.c:30828
> #7  set_destination (uri=<optimized out>, p=0x7fbeb4114438) at
> chan_sip.c:10602
> #8  reqprep (req=req@entry=0x7fbe989c4fc0, p=p@entry=0x7fbeb4114438,
> sipmethod=sipmethod@entry=8, seqno=<optimized out>,
>     seqno@entry=0, newbranch=newbranch@entry=1) at chan_sip.c:10925
> ---Type <return> to continue, or q <return> to quit---
> #9  0x00007fbeb0969968 in transmit_request_with_auth (p=p@entry=0x7fbeb4114438,
> newbranch=1, reliable=XMIT_RELIABLE, seqno=0,
>     sipmethod=8) at chan_sip.c:14296
> #10 0x00007fbeb098b704 in sip_hangup (ast=<optimized out>) at
> chan_sip.c:6822
> #11 0x0000000000477b55 in ast_hangup (chan=chan@entry=0x7fbeb40ef018) at
> channel.c:2887
> #12 0x000000000050ce1b in __ast_pbx_run (c=c@entry=0x7fbeb40ef018,
> args=args@entry=0x0) at pbx.c:5729
> #13 0x000000000050e426 in pbx_thread (data=data@entry=0x7fbeb40ef018) at
> pbx.c:5821
> #14 0x0000000000548aaa in dummy_start (data=<optimized out>) at
> utils.c:1151
> #15 0x00007fbeb965eb50 in start_thread () from
> /lib/x86_64-linux-gnu/libpthread.so.0
> #16 0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
> #17 0x0000000000000000 in ?? ()
>
> Thread 1 (Thread 0x7fbeba9c9700 (LWP 2447)):
> #0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
> #1  0x000000000043f2af in monitor_sig_flags (unused=unused@entry=0x7ffdeb743e70)
> at asterisk.c:3281
> #2  0x0000000000423eff in main (argc=<optimized out>, argv=0x7ffdeb7451a8)
> at asterisk.c:4152
>

There's no apparent deadlock here, athough it does appear to be a livelock.
In both backtraces, you have the chan_sip do_monitor thread blocked on a
lock, while another thread is waiting on getaddrinfo to complete:

Thread 2 (Thread 0x7fbe989c6700 (LWP 12890)):
#0  0x00007fbeb9eb487d in recvmsg () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007fbeb9ed4fcc in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#2  0x00007fbeb9ed544a in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#3  0x00007fbeb9e92007 in getaddrinfo () from
/lib/x86_64-linux-gnu/libc.so.6
#4  0x00000000004f2e81 in ast_sockaddr_resolve
(addrs=addrs@entry=0x7fbe989c48d8,
str=<optimized out>,
    str@entry=0x7fbe989c4a80 "10.12.12.92:2052", flags=flags@entry=0,
family=2) at netsock2.c:268
#5  0x00007fbeb095fb8b in ast_sockaddr_resolve_first_af (family=<optimized
out>, flag=0, name=0x7fbe989c4a80 "10.12.12.92:2052",
    addr=0x7fbeb4114948) at chan_sip.c:30797
#6  ast_sockaddr_resolve_first_transport (transport=<optimized out>,
flag=0, name=0x7fbe989c4a80 "10.12.12.92:2052",
    addr=0x7fbeb4114948) at chan_sip.c:30828
#7  set_destination (uri=<optimized out>, p=0x7fbeb4114438) at
chan_sip.c:10602
#8  reqprep (req=req@entry=0x7fbe989c4fc0, p=p@entry=0x7fbeb4114438,
sipmethod=sipmethod@entry=8, seqno=<optimized out>,
    seqno@entry=0, newbranch=newbranch@entry=1) at chan_sip.c:10925
---Type <return> to continue, or q <return> to quit---
#9  0x00007fbeb0969968 in transmit_request_with_auth (p=p@entry=0x7fbeb4114438,
newbranch=1, reliable=XMIT_RELIABLE, seqno=0,
    sipmethod=8) at chan_sip.c:14296
#10 0x00007fbeb098b704 in sip_hangup (ast=<optimized out>) at
chan_sip.c:6822
#11 0x0000000000477b55 in ast_hangup (chan=chan@entry=0x7fbeb40ef018) at
channel.c:2887
#12 0x000000000050ce1b in __ast_pbx_run (c=c@entry=0x7fbeb40ef018,
args=args@entry=0x0) at pbx.c:5729
#13 0x000000000050e426 in pbx_thread (data=data@entry=0x7fbeb40ef018) at
pbx.c:5821
#14 0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#15 0x00007fbeb965eb50 in start_thread () from
/lib/x86_64-linux-gnu/libpthread.so.0
#16 0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#17 0x0000000000000000 in ?? ()

In both cases, the thread is waiting in recvmsg.

Guessing a bit, I would suspect that you have some form of DNS or reverse
DNS issue occurring on your systems, most likely with a very long timeout.
I can't speculate why changing a kernel version would cause this problem,
although given the scope of such a change, it isn't terribly surprising
that some DNS related behaviour would be impacted.

This isn't a bug in Asterisk. Later versions of Asterisk (and different SIP
stacks) can mitigate long running DNS queries to an extent, although it is
still going to cause problems.

-- 
Matthew Jordan
Digium, Inc. | Director of Technology
445 Jan Davis Drive NW - Huntsville, AL 35806 - USA
Check us out at: http://digium.com & http://asterisk.org

[Attachment #5 (text/html)]

<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Nov \
18, 2015 at 2:01 PM, Stefan Priebe <span dir="ltr">&lt;<a \
href="mailto:s.priebe@profihost.ag" \
target="_blank">s.priebe@profihost.ag</a>&gt;</span> wrote:<br><blockquote \
class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"><span class="">Am 18.11.2015 um 19:46 schrieb \
Matthew Jordan:<br> </span><blockquote class="gmail_quote" style="margin:0px 0px 0px \
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class=""> <br>
<br>
On Wed, Nov 18, 2015 at 12:37 PM, Stefan Priebe &lt;<a \
href="mailto:s.priebe@profihost.ag" \
target="_blank">s.priebe@profihost.ag</a><br></span><span class=""> &lt;mailto:<a \
href="mailto:s.priebe@profihost.ag" target="_blank">s.priebe@profihost.ag</a>&gt;&gt; \
wrote:<br> <br>
      Hello,<br>
<br>
      since Upgrading our Asterisk System from Kernel 3.18.17 to 4.1.13 it<br>
      deadlocks every few hours (kill -9 is the only thing working). Booting<br>
      with 3.18 again let it run smooth again.<br>
<br>
      I&#39;ve now also two gdb backtraces from two crashes:<br>
      <a href="http://pastebin.com/raw.php?i=yih5jNt8" rel="noreferrer" \
target="_blank">http://pastebin.com/raw.php?i=yih5jNt8</a><br> <br>
      <a href="http://pastebin.com/raw.php?i=kGEcvH4T" rel="noreferrer" \
target="_blank">http://pastebin.com/raw.php?i=kGEcvH4T</a><br> <br>
      The kernel guys forwarded me to asterisk to find out where it hangs.<br>
<br>
<br>
Your pastebin links don&#39;t appear to be working.<br>
</span></blockquote>
<br>
Pastebin is down for raw links. It&#39;s up for the normal links.<br>
<br>
<a href="http://pastebin.com/yih5jNt8" rel="noreferrer" \
target="_blank">http://pastebin.com/yih5jNt8</a><br> and<br>
<a href="http://pastebin.com/kGEcvH4T" rel="noreferrer" \
target="_blank">http://pastebin.com/kGEcvH4T</a><span class=""><br> <br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid \
rgb(204,204,204);padding-left:1ex"> <br>
Please either attach the backtraces, or send them along in the text of<br>
the e-mail. (Plus, that way we&#39;ll have them for posterity.)<br>
</blockquote>
<br></span>
Sure here it comes:<br>
Thread 35 (Thread 0x7f295e945700 (LWP 26637)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 &quot;taskprocessor.c&quot;, \
lineno=310,<br>  func=0x5d4320 &quot;tps_processing_function&quot;, \
cond_name=0x5d3f71 &quot;&amp;i-&gt;poll_cond&quot;, mutex_name=0x5d3f5a \
&quot;&amp;i-&gt;taskprocessor_lock&quot;,<br>  cond=0x19e9ad0, t=0x19e9b08) at \
lock.c:565<br> #2   0x0000000000555e9a in tps_processing_function (data=0x19e9ac8) at \
taskprocessor.c:310<br> #3   0x0000000000569280 in dummy_start (data=0x19eb300) at \
utils.c:1173<br> #4   0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) \
at pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 34 (Thread 0x7f295e8c9700 (LWP 26638)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=-1)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x000000000043e5e4 in listener \
(unused=0x0) at asterisk.c:1393<br> #2   0x0000000000569280 in dummy_start \
(data=0x19ec150) at utils.c:1173<br> #3   0x00007f295d5dcb50 in start_thread \
(arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #4   0x00007f295de3195d in \
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #5   0x0000000000000000 \
in ?? ()<br> <br>
Thread 33 (Thread 0x7f295e84d700 (LWP 26639)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5bcdf4 &quot;logger.c&quot;, \
                lineno=1072, func=0x5bdc02 &quot;logger_thread&quot;,<br>
      cond_name=0x5bd8ae &quot;&amp;logcond&quot;, mutex_name=0x5bd8a0 \
&quot;&amp;logmsgs.lock&quot;, cond=0x826b80, t=0x80e550) at lock.c:565<br> #2   \
0x00000000004ea0fa in logger_thread (data=0x0) at logger.c:1072<br> #3   \
0x0000000000569280 in dummy_start (data=0x19ec1c0) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 32 (Thread 0x7f295c08d700 (LWP 26653)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5ae3d4 &quot;devicestate.c&quot;, \
                lineno=549, func=0x5aeb10 &quot;do_devstate_changes&quot;,<br>
      cond_name=0x5ae687 &quot;&amp;change_pending&quot;, mutex_name=0x5ae697 \
&quot;&amp;state_changes.lock&quot;, cond=0x825ea0, t=0x80b4f0) at lock.c:565<br> #2  \
0x00000000004a0764 in do_devstate_changes (data=0x0) at devicestate.c:549<br> #3   \
0x0000000000569280 in dummy_start (data=0x1ed7b90) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 31 (Thread 0x7f295c011700 (LWP 26654)):<br>
#0   0x00007f295de3287d in recvmsg () at ../sysdeps/unix/syscall-template.S:82<br>
#1   0x00007f295de52fcc in make_request (fd=35, pid=26631, seen_ipv4=&lt;optimized \
                out&gt;, seen_ipv6=&lt;optimized out&gt;,<br>
      in6ai=&lt;optimized out&gt;, in6ailen=&lt;optimized out&gt;) at \
../sysdeps/unix/sysv/linux/check_pf.c:119<br> #2   0x00007f295de5344a in __check_pf \
                (seen_ipv4=0x7f295c00e85f, seen_ipv6=0x7f295c00e85e, \
                in6ai=0x7f295c00e840,<br>
      in6ailen=0x7f295c00e838) at ../sysdeps/unix/sysv/linux/check_pf.c:271<br>
#3   0x00007f295de10007 in *__GI_getaddrinfo (name=0x7f295c00e8b0 \
                &quot;10.12.12.55&quot;, service=0x7f295c00e8bc &quot;2135&quot;,<br>
      hints=0x7f295c00e910, pai=0x7f295c00e908) at \
../sysdeps/posix/getaddrinfo.c:2389<br> #4   0x000000000050287e in \
ast_sockaddr_resolve (addrs=0x7f295c00e9d0, str=0x7f295c00ea30 &quot;<a \
href="http://10.12.12.55:2135" rel="noreferrer" \
target="_blank">10.12.12.55:2135</a>&quot;, flags=0, family=2)<br>  at \
netsock2.c:268<br> #5   0x00007f2958963ba2 in ast_sockaddr_resolve_first_af \
(addr=0x7f29300591d8, name=0x7f295c00ea30 &quot;<a href="http://10.12.12.55:2135" \
rel="noreferrer" target="_blank">10.12.12.55:2135</a>&quot;, flag=0,<br>  family=2) \
at chan_sip.c:30689<br> #6   0x00007f2958963cb5 in \
ast_sockaddr_resolve_first_transport (addr=0x7f29300591d8, name=0x7f295c00ea30 \
&quot;<a href="http://10.12.12.55:2135" rel="noreferrer" \
                target="_blank">10.12.12.55:2135</a>&quot;,<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
      flag=0, transport=1) at chan_sip.c:30720<br>
#7   0x00007f29588fd3cc in set_destination (p=0x7f2930058cc8, uri=0x7f29300576e8 \
&quot;<a href="http://sip:9052@10.12.12.55:2135" \
target="_blank">sip:9052@10.12.12.55:2135</a>;line=to7a729l&quot;)<br>  at \
chan_sip.c:10455<br> #8   0x00007f29588fe6e0 in reqprep (req=0x7f295c00fee0, \
p=0x7f2930058cc8, sipmethod=4, seqno=287, newbranch=1) at chan_sip.c:10778<br> #9   \
0x00007f295890a201 in transmit_state_notify (p=0x7f2930058cc8, state=1, full=1, \
timeout=0) at chan_sip.c:13259<br> #10 0x00007f29589141bb in cb_extensionstate \
(context=0x7f295c010cd0 &quot;hints&quot;, exten=0x7f295c010c80 &quot;9052QS&quot;, \
state=1,<br>  data=0x7f2930058cc8) at chan_sip.c:15117<br>
#11 0x000000000050ebf6 in handle_statechange (datap=0x7f293acef830) at pbx.c:4972<br>
#12 0x0000000000555f8e in tps_processing_function (data=0x1f24f28) at \
taskprocessor.c:327<br> #13 0x0000000000569280 in dummy_start (data=0x1ed76f0) at \
utils.c:1173<br> #14 0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) \
at pthread_create.c:304<br> #15 0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #16 0x0000000000000000 in ?? ()<br>
<br>
Thread 30 (Thread 0x7f295bf95700 (LWP 26655)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=-1)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x00000000004c161d in do_parking_thread \
(ignore=0x0) at features.c:4975<br> #2   0x0000000000569280 in dummy_start \
(data=0x1aea3c0) at utils.c:1173<br> #3   0x00007f295d5dcb50 in start_thread \
(arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #4   0x00007f295de3195d in \
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #5   0x0000000000000000 \
in ?? ()<br> <br>
Thread 29 (Thread 0x7f295bf19700 (LWP 26656)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5ada64 &quot;db.c&quot;, \
                lineno=819, func=0x5ae330 &quot;db_sync_thread&quot;,<br>
      cond_name=0x5ae2d8 &quot;&amp;dbcond&quot;, mutex_name=0x5ada9c \
&quot;&amp;dblock&quot;, cond=0x825e60, t=0x80af80) at lock.c:565<br> #2   \
0x000000000049f653 in db_sync_thread (data=0x0) at db.c:819<br> #3   \
0x0000000000569280 in dummy_start (data=0x1aea3e0) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 28 (Thread 0x7f295be9d700 (LWP 26657)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 &quot;taskprocessor.c&quot;, \
lineno=310,<br>  func=0x5d4320 &quot;tps_processing_function&quot;, \
cond_name=0x5d3f71 &quot;&amp;i-&gt;poll_cond&quot;, mutex_name=0x5d3f5a \
&quot;&amp;i-&gt;taskprocessor_lock&quot;,<br>  cond=0x7f2954006c60, \
t=0x7f2954006c98) at lock.c:565<br> #2   0x0000000000555e9a in \
tps_processing_function (data=0x7f2954006c58) at taskprocessor.c:310<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f2954003730) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 27 (Thread 0x7f295be21700 (LWP 26658)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5d1144 &quot;sched.c&quot;, \
                lineno=110, func=0x5d1666 &quot;sched_run&quot;,<br>
      cond_name=0x5d1156 &quot;&amp;st-&gt;cond&quot;, mutex_name=0x5d114c \
&quot;&amp;st-&gt;lock&quot;, cond=0x7f29540035d0, t=0x7f2954003598) at \
lock.c:565<br> #2   0x0000000000549bd3 in sched_run (data=0x7f2954003590) at \
sched.c:110<br> #3   0x0000000000569280 in dummy_start (data=0x7f29540048e0) at \
utils.c:1173<br> #4   0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) \
at pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
Thread 26 (Thread 0x7f295b13e700 (LWP 26663)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2941c4a3f4 \
                &quot;res_timing_pthread.c&quot;, lineno=476,<br>
      func=0x7f2941c4a7c3 &quot;do_timing&quot;, cond_name=0x7f2941c4a434 \
                &quot;&amp;timing_thread.cond&quot;,<br>
      mutex_name=0x7f2941c4a420 &quot;&amp;timing_thread.lock&quot;, \
cond=0x7f2941e4b540, t=0x7f2941e4b508) at lock.c:565<br> #2   0x00007f2941c4a10e in \
do_timing (arg=0x0) at res_timing_pthread.c:476<br> #3   0x0000000000569280 in \
dummy_start (data=0x20a3d70) at utils.c:1173<br> #4   0x00007f295d5dcb50 in \
start_thread (arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #5   \
0x00007f295de3195d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> \
#6   0x0000000000000000 in ?? ()<br> <br>
Thread 25 (Thread 0x7f29580b2700 (LWP 26669)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 &quot;taskprocessor.c&quot;, \
lineno=310,<br>  func=0x5d4320 &quot;tps_processing_function&quot;, \
cond_name=0x5d3f71 &quot;&amp;i-&gt;poll_cond&quot;, mutex_name=0x5d3f5a \
&quot;&amp;i-&gt;taskprocessor_lock&quot;,<br>  cond=0x7f2954ce6c20, \
t=0x7f2954ce6c58) at lock.c:565<br> #2   0x0000000000555e9a in \
tps_processing_function (data=0x7f2954ce6c18) at taskprocessor.c:310<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f2954ce8450) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 24 (Thread 0x7f293dc8e700 (LWP 26670)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5d1144 &quot;sched.c&quot;, \
                lineno=110, func=0x5d1666 &quot;sched_run&quot;,<br>
      cond_name=0x5d1156 &quot;&amp;st-&gt;cond&quot;, mutex_name=0x5d114c \
&quot;&amp;st-&gt;lock&quot;, cond=0x7f2957fffe80, t=0x7f2957fffe48) at \
lock.c:565<br> #2   0x0000000000549bd3 in sched_run (data=0x7f2957fffe40) at \
sched.c:110<br> #3   0x0000000000569280 in dummy_start (data=0x7f2954ce8450) at \
utils.c:1173<br> #4   0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) \
at pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 23 (Thread 0x7f293dc12700 (LWP 26671)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa017e8, t=0x7f293aa017b0) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa006f0) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 22 (Thread 0x7f293db96700 (LWP 26672)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa04c98, t=0x7f293aa04c60) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa03ba0) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
Thread 21 (Thread 0x7f293db1a700 (LWP 26673)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa076e8, t=0x7f293aa076b0) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa065f0) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 20 (Thread 0x7f293da9e700 (LWP 26674)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa0a1a8, t=0x7f293aa0a170) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa090b0) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 19 (Thread 0x7f293da22700 (LWP 26675)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa0cc68, t=0x7f293aa0cc30) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa0bb70) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 18 (Thread 0x7f293d9a6700 (LWP 26676)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa0f728, t=0x7f293aa0f6f0) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa0e630) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 17 (Thread 0x7f293d92a700 (LWP 26677)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa121e8, t=0x7f293aa121b0) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa110f0) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
                ()<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
<br>
Thread 16 (Thread 0x7f293d8ae700 (LWP 26678)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa14ca8, t=0x7f293aa14c70) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa13bb0) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 15 (Thread 0x7f293d832700 (LWP 26679)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa17768, t=0x7f293aa17730) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa16670) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 14 (Thread 0x7f293d7b6700 (LWP 26680)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 \
                &quot;chan_iax2.c&quot;, lineno=11943,<br>
      func=0x7f2959b85640 &quot;iax2_process_thread&quot;, cond_name=0x7f2959b7e0e1 \
                &quot;&amp;thread-&gt;cond&quot;,<br>
      mutex_name=0x7f2959b7e0d3 &quot;&amp;thread-&gt;lock&quot;, \
cond=0x7f293aa1a228, t=0x7f293aa1a1f0) at lock.c:565<br> #2   0x00007f2959b662b0 in \
iax2_process_thread (data=0x7f293aa19130) at chan_iax2.c:11943<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 13 (Thread 0x7f293d73a700 (LWP 26681)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=1000)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x00000000004ddfbc in ast_io_wait \
(ioc=0x7f293a9ec060, howlong=1000) at io.c:279<br> #2   0x00007f2959b686e3 in \
network_thread (ignore=0x0) at chan_iax2.c:12413<br> #3   0x0000000000569280 in \
dummy_start (data=0x7f293a9fb640) at utils.c:1173<br> #4   0x00007f295d5dcb50 in \
start_thread (arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #5   \
0x00007f295de3195d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> \
#6   0x0000000000000000 in ?? ()<br> <br>
Thread 12 (Thread 0x7f293d4b8700 (LWP 26682)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=1000)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x00000000004ddfbc in ast_io_wait \
(ioc=0x7f293aa1d960, howlong=1000) at io.c:279<br> #2   0x00007f295894b24c in \
do_monitor (data=0x0) at chan_sip.c:26701<br> #3   0x0000000000569280 in dummy_start \
(data=0x7f293aa34210) at utils.c:1173<br> #4   0x00007f295d5dcb50 in start_thread \
(arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #5   0x00007f295de3195d in \
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 \
in ?? ()<br> <br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
Thread 11 (Thread 0x7f293cc3b700 (LWP 26684)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=-1)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x00007f2958bb07c3 in do_monitor \
(data=0x0) at chan_phone.c:1086<br> #2   0x0000000000569280 in dummy_start \
(data=0x767c590) at utils.c:1173<br> #3   0x00007f295d5dcb50 in start_thread \
(arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #4   0x00007f295de3195d in \
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #5   0x0000000000000000 \
in ?? ()<br> <br>
Thread 10 (Thread 0x7f293cbbf700 (LWP 26685)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=-1)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x00007f2953dfdf99 in scan_thread \
(unused=0x0) at pbx_spool.c:694<br> #2   0x0000000000569280 in dummy_start \
(data=0x1f48510) at utils.c:1173<br> #3   0x00007f295d5dcb50 in start_thread \
(arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #4   0x00007f295de3195d in \
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #5   0x0000000000000000 \
in ?? ()<br> <br>
Thread 9 (Thread 0x7f293cb43700 (LWP 26686)):<br>
#0   0x00007f295de0148d in nanosleep () at ../sysdeps/unix/syscall-template.S:82<br>
#1   0x00007f29580b4be6 in cleanup (unused=0x0) at pbx_realtime.c:133<br>
#2   0x0000000000569280 in dummy_start (data=0x7f293ab4eb60) at utils.c:1173<br>
#3   0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #4   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #5   0x0000000000000000 in ?? \
()<br> <br>
Thread 8 (Thread 0x7f293cac7700 (LWP 26687)):<br>
#0   0x00007f295de0148d in nanosleep () at ../sysdeps/unix/syscall-template.S:82<br>
#1   0x00007f29402c6bce in lock_broker (unused=0x0) at func_lock.c:211<br>
#2   0x0000000000569280 in dummy_start (data=0x7f293ab4c160) at utils.c:1173<br>
#3   0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #4   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #5   0x0000000000000000 in ?? \
()<br> <br>
Thread 7 (Thread 0x7f293ca4b700 (LWP 26688)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 &quot;taskprocessor.c&quot;, \
lineno=310,<br>  func=0x5d4320 &quot;tps_processing_function&quot;, \
cond_name=0x5d3f71 &quot;&amp;i-&gt;poll_cond&quot;, mutex_name=0x5d3f5a \
&quot;&amp;i-&gt;taskprocessor_lock&quot;,<br>  cond=0x7f293acad850, \
t=0x7f293acad888) at lock.c:565<br> #2   0x0000000000555e9a in \
tps_processing_function (data=0x7f293acad848) at taskprocessor.c:310<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293ab45d50) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 6 (Thread 0x7f293c9cf700 (LWP 26689)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 &quot;taskprocessor.c&quot;, \
lineno=310,<br>  func=0x5d4320 &quot;tps_processing_function&quot;, \
cond_name=0x5d3f71 &quot;&amp;i-&gt;poll_cond&quot;, mutex_name=0x5d3f5a \
&quot;&amp;i-&gt;taskprocessor_lock&quot;,<br>  cond=0x7f293acd4120, \
t=0x7f293acd4158) at lock.c:565<br> #2   0x0000000000555e9a in \
tps_processing_function (data=0x7f293acd4118) at taskprocessor.c:310<br> #3   \
0x0000000000569280 in dummy_start (data=0x7f293acd41e0) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
                ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
#6   0x0000000000000000 in ?? ()<br>
<br>
Thread 5 (Thread 0x7f293c8d7700 (LWP 26933)):<br>
#0   0x00007f295de2598d in read () at ../sysdeps/unix/syscall-template.S:82<br>
#1   0x000000000054e352 in inotify_daemon (data=0x0) at stdtime/localtime.c:295<br>
#2   0x0000000000569280 in dummy_start (data=0x7724c80) at utils.c:1173<br>
#3   0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #4   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #5   0x0000000000000000 in ?? \
()<br> <br>
Thread 4 (Thread 0x7f293c573700 (LWP 2697)):<br>
#0   pthread_cond_wait@@GLIBC_2.3.2 () at \
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162<br> #1   \
0x00000000004e51ad in __ast_cond_wait (filename=0x59c654 &quot;autoservice.c&quot;, \
                lineno=102, func=0x59c7f0 &quot;autoservice_run&quot;,<br>
      cond_name=0x59c680 &quot;&amp;as_cond&quot;, mutex_name=0x59c673 \
&quot;&amp;aslist.lock&quot;, cond=0x825ae0, t=0x808b70) at lock.c:565<br> #2   \
0x000000000044c10e in autoservice_run (ign=0x0) at autoservice.c:102<br> #3   \
0x0000000000569280 in dummy_start (data=0x76b4060) at utils.c:1173<br> #4   \
0x00007f295d5dcb50 in start_thread (arg=&lt;optimized out&gt;) at \
pthread_create.c:304<br> #5   0x00007f295de3195d in clone () at \
../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #6   0x0000000000000000 in ?? \
()<br> <br>
Thread 3 (Thread 0x7f293c5ef700 (LWP 13169)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=-1)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x0000000000472132 in \
ast_waitfor_nandfds (c=0x7f293c5e8510, n=2, fds=0x0, nfds=0, exception=0x0, \
outfd=0x0, ms=0x7f293c5e850c)<br>  at channel.c:3282<br>
#2   0x00000000004725ce in ast_waitfor_n (c=0x7f293c5e8510, n=2, ms=0x7f293c5e850c) \
at channel.c:3536<br> #3   0x000000000047f61d in ast_generic_bridge \
(c0=0x7f293acfc368, c1=0x7a07b08, config=0x7f293c5e9e50, fo=0x7f293c5e8c88,<br>  \
rc=0x7f293c5e8c80) at channel.c:7283<br> #4   0x0000000000481e7a in \
ast_channel_bridge (c0=0x7f293acfc368, c1=0x7a07b08, config=0x7f293c5e9e50, \
fo=0x7f293c5e8c88,<br>  rc=0x7f293c5e8c80) at channel.c:7751<br>
#5   0x00000000004be6cc in ast_bridge_call (chan=0x7f293acfc368, peer=0x7a07b08, \
config=0x7f293c5e9e50) at features.c:4135<br> #6   0x00007f29525c1092 in \
dial_exec_full (chan=0x7f293acfc368, data=0x7f293c5ec610 &quot;SIP/9016,,wt&quot;, \
peerflags=0x7f293c5ea3f0,<br>  continue_exec=0x0) at app_dial.c:2957<br>
#7   0x00007f29525c198e in dial_exec (chan=0x7f293acfc368, data=0x7f293c5ec610 \
&quot;SIP/9016,,wt&quot;) at app_dial.c:3061<br> #8   0x0000000000503dd5 in pbx_exec \
(c=0x7f293acfc368, app=0x7f293ab56f60, data=0x7f293c5ec610 &quot;SIP/9016,,wt&quot;) \
at pbx.c:1479<br> #9   0x000000000050e13d in pbx_extension_helper (c=0x7f293acfc368, \
                con=0x0, context=0x7f293acfc8c0 &quot;privat&quot;,<br>
      exten=0x7f293acfc910 &quot;9016&quot;, priority=4, label=0x0, \
callerid=0x77f1b20 &quot;02202459352&quot;, action=E_SPAWN, found=0x7f293c5eed0c,<br> \
combined_find_spawn=1) at pbx.c:4739<br> #10 0x000000000050fcc7 in \
ast_spawn_extension (c=0x7f293acfc368, context=0x7f293acfc8c0 &quot;privat&quot;, \
                exten=0x7f293acfc910 &quot;9016&quot;,<br>
      priority=4, callerid=0x77f1b20 &quot;02202459352&quot;, found=0x7f293c5eed0c, \
combined_find_spawn=1) at pbx.c:5381<br> #11 0x0000000000510643 in __ast_pbx_run \
(c=0x7f293acfc368, args=0x0) at pbx.c:5484<br> #12 0x00000000005120d5 in pbx_thread \
(data=0x7f293acfc368) at pbx.c:5825<br> #13 0x0000000000569280 in dummy_start \
(data=0x7f293aca7fa0) at utils.c:1173<br> #14 0x00007f295d5dcb50 in start_thread \
(arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #15 0x00007f295de3195d in \
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #16 0x0000000000000000 \
in ?? ()<br> <br>
Thread 2 (Thread 0x7f293c85b700 (LWP 15515)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=-1)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x0000000000472132 in \
ast_waitfor_nandfds (c=0x7f293c852810, n=2, fds=0x0, nfds=0, exception=0x0, \
outfd=0x0, ms=0x7f293c85280c)<br>  at channel.c:3282<br>
#2   0x00000000004725ce in ast_waitfor_n (c=0x7f293c852810, n=2, ms=0x7f293c85280c) \
at channel.c:3536<br> #3   0x000000000047f61d in ast_generic_bridge (c0=0x76cadc8, \
                c1=0x771cd58, config=0x7f293c854b00, fo=0x7f293c852f88,<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
      rc=0x7f293c852f80) at channel.c:7283<br>
#4   0x0000000000481e7a in ast_channel_bridge (c0=0x76cadc8, c1=0x771cd58, \
config=0x7f293c854b00, fo=0x7f293c852f88,<br>  rc=0x7f293c852f80) at \
channel.c:7751<br> #5   0x00000000004be6cc in ast_bridge_call (chan=0x76cadc8, \
peer=0x771cd58, config=0x7f293c854b00) at features.c:4135<br> #6   0x00007f2950161b7c \
in try_calling (qe=0x7f293c855180, options=0x7f293c8550fc &quot;&quot;, \
                announceoverride=0x7f293c8550fe &quot;&quot;,<br>
      url=0x7f293c8550fd &quot;&quot;, tries=0x7f293c856378, noption=0x7f293c856374, \
agi=0x0, macro=0x0, gosub=0x0, ringing=0)<br>  at app_queue.c:5422<br>
#7   0x00007f29501653ec in queue_exec (chan=0x76cadc8, data=0x7f293c858610 \
&quot;q-smm1-lr,tw,,,30&quot;) at app_queue.c:6374<br> #8   0x0000000000503dd5 in \
pbx_exec (c=0x76cadc8, app=0x7f293ab5ff20, data=0x7f293c858610 \
&quot;q-smm1-lr,tw,,,30&quot;) at pbx.c:1479<br> #9   0x000000000050e13d in \
pbx_extension_helper (c=0x76cadc8, con=0x0, context=0x76cb320 \
                &quot;add2q-default&quot;, exten=0x76cb370 &quot;1&quot;,<br>
      priority=7, label=0x0, callerid=0x7789650 &quot;015143119706&quot;, \
action=E_SPAWN, found=0x7f293c85ad0c, combined_find_spawn=1)<br>  at pbx.c:4739<br>
#10 0x000000000050fcc7 in ast_spawn_extension (c=0x76cadc8, context=0x76cb320 \
                &quot;add2q-default&quot;, exten=0x76cb370 &quot;1&quot;, \
                priority=7,<br>
      callerid=0x7789650 &quot;015143119706&quot;, found=0x7f293c85ad0c, \
combined_find_spawn=1) at pbx.c:5381<br> #11 0x0000000000510643 in __ast_pbx_run \
(c=0x76cadc8, args=0x0) at pbx.c:5484<br> #12 0x00000000005120d5 in pbx_thread \
(data=0x76cadc8) at pbx.c:5825<br> #13 0x0000000000569280 in dummy_start \
(data=0x774df20) at utils.c:1173<br> #14 0x00007f295d5dcb50 in start_thread \
(arg=&lt;optimized out&gt;) at pthread_create.c:304<br> #15 0x00007f295de3195d in \
clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:112<br> #16 0x0000000000000000 \
in ?? ()<br> <br>
Thread 1 (Thread 0x7f295e947700 (LWP 26631)):<br>
#0   0x00007f295de26d13 in *__GI___poll (fds=&lt;optimized out&gt;, \
nfds=&lt;optimized out&gt;, timeout=-1)<br>  at \
../sysdeps/unix/sysv/linux/poll.c:87<br> #1   0x0000000000444123 in monitor_sig_flags \
(unused=0x0) at asterisk.c:3294<br> #2   0x0000000000446a53 in main (argc=5, \
argv=0x7ffca463dfb8) at asterisk.c:4165<br> <br>
and<br>
<br>
(gdb) thread apply all bt<br>
<br>
Thread 34 (Thread 0x7fbeba9c7700 (LWP 2463)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x000000000053c37b in \
tps_processing_function (data=data@entry=0x1e7bef8) at taskprocessor.c:310<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 33 (Thread 0x7fbeba94b700 (LWP 2464)):<br>
#0   0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x000000000043f872 in listener (unused=unused@entry=0x0) at asterisk.c:1381<br>
#2   0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at \
utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #5   0x0000000000000000 in ?? ()<br>
<br>
Thread 32 (Thread 0x7fbeba8cf700 (LWP 2465)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00000000004dbd34 in logger_thread \
(data=data@entry=0x0) at logger.c:1072<br> #2   0x0000000000548aaa in dummy_start \
(data=&lt;optimized out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in \
start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #4   \
0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 31 (Thread 0x7fbeb8325700 (LWP 2508)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x0000000000498771 in \
do_devstate_changes (data=data@entry=0x0) at devicestate.c:549<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 30 (Thread 0x7fbeb82a9700 (LWP 2509)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x000000000053c37b in \
tps_processing_function (data=data@entry=0x236eed8) at taskprocessor.c:310<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 29 (Thread 0x7fbeb822d700 (LWP 2510)):<br>
#0   0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x00000000004b09f1 in do_parking_thread (ignore=ignore@entry=0x0) at \
features.c:4969<br> #2   0x0000000000548aaa in dummy_start (data=&lt;optimized \
out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #5   0x0000000000000000 in ?? ()<br>
<br>
Thread 28 (Thread 0x7fbeb81b1700 (LWP 2511)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00000000004962fe in db_sync_thread \
(data=data@entry=0x0) at db.c:819<br> #2   0x0000000000548aaa in dummy_start \
(data=&lt;optimized out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in \
start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #4   \
0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
                0x0000000000000000 in ?? ()<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
<br>
Thread 27 (Thread 0x7fbeb8135700 (LWP 2513)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x000000000053c37b in \
tps_processing_function (data=data@entry=0x7fbeb4013c18) at taskprocessor.c:310<br> \
#2   0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at \
utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #5   0x0000000000000000 in ?? ()<br>
<br>
Thread 26 (Thread 0x7fbeb80b9700 (LWP 2514)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x0000000000533d44 in sched_run \
(data=data@entry=0x7fbeb4013df0) at sched.c:110<br> #2   0x0000000000548aaa in \
dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 \
in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #4   \
0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 25 (Thread 0x7fbeb33a9700 (LWP 2647)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbe9a5b2787 in do_timing \
(arg=arg@entry=0x0) at res_timing_pthread.c:476<br> #2   0x0000000000548aaa in \
dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 \
in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #4   \
0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 24 (Thread 0x7fbe99e75700 (LWP 2648)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x000000000053c37b in \
tps_processing_function (data=data@entry=0x283ab18) at taskprocessor.c:310<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 23 (Thread 0x7fbe99df9700 (LWP 2649)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x0000000000533d44 in sched_run \
(data=data@entry=0x283ae00) at sched.c:110<br> #2   0x0000000000548aaa in dummy_start \
(data=&lt;optimized out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in \
start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #4   \
0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 22 (Thread 0x7fbe99d7d700 (LWP 2650)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x2842150) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 21 (Thread 0x7fbe99d01700 (LWP 2651)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x28434d0) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
                0x0000000000000000 in ?? ()<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
<br>
Thread 20 (Thread 0x7fbe99c85700 (LWP 2652)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x2844870) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 19 (Thread 0x7fbe99c09700 (LWP 2653)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x2845c10) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 18 (Thread 0x7fbe99b8d700 (LWP 2654)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x2846fb0) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 17 (Thread 0x7fbe99b11700 (LWP 2655)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x2848350) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 16 (Thread 0x7fbe99a95700 (LWP 2656)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x28496f0) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 15 (Thread 0x7fbe99a19700 (LWP 2657)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x284aa90) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 14 (Thread 0x7fbe9999d700 (LWP 2658)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x284be30) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
                0x0000000000000000 in ?? ()<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
<br>
Thread 13 (Thread 0x7fbe99921700 (LWP 2659)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb1bb0132 in \
iax2_process_thread (data=data@entry=0x284d1d0) at chan_iax2.c:11943<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 12 (Thread 0x7fbe998a5700 (LWP 2660)):<br>
#0   0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x00000000004d3aab in ast_io_wait (ioc=0x283bac0, howlong=howlong@entry=1000) at \
io.c:279<br> #2   0x00007fbeb1b83485 in network_thread (ignore=ignore@entry=0x0) at \
chan_iax2.c:12413<br> #3   0x0000000000548aaa in dummy_start (data=&lt;optimized \
out&gt;) at utils.c:1151<br> #4   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #5   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #6   0x0000000000000000 in ?? ()<br>
<br>
Thread 11 (Thread 0x7fbe99623700 (LWP 2661)):<br>
#0   0x00007fbeb9665d5c in __lll_lock_wait () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x00007fbeb96613c4 in _L_lock_997 () \
from /lib/x86_64-linux-gnu/libpthread.so.0<br> #2   0x00007fbeb9661227 in \
pthread_mutex_lock () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #3   \
0x00007fbeb098cc2a in find_call (req=req@entry=0x7fbe99622310, \
addr=addr@entry=0x7fbe99622280, intended_method=8)<br>  at chan_sip.c:8622<br>
#4   0x00007fbeb09bac2a in handle_request_do (req=req@entry=0x7fbe99622310, \
addr=addr@entry=0x7fbe99622280) at chan_sip.c:26291<br> #5   0x00007fbeb09bcdfa in \
sipsock_read (id=&lt;optimized out&gt;, fd=&lt;optimized out&gt;, \
events=&lt;optimized out&gt;, ignore=&lt;optimized out&gt;)<br>  at \
chan_sip.c:26247<br> #6   0x00000000004d3aff in ast_io_wait (ioc=0x285b380, \
howlong=&lt;optimized out&gt;) at io.c:292<br> #7   0x00007fbeb09ab675 in do_monitor \
(data=data@entry=0x0) at chan_sip.c:26800<br> #8   0x0000000000548aaa in dummy_start \
(data=&lt;optimized out&gt;) at utils.c:1151<br> #9   0x00007fbeb965eb50 in \
start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #10 0x00007fbeb9eb395d \
in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #11 0x0000000000000000 in ?? \
()<br> <br>
Thread 10 (Thread 0x7fbe995a7700 (LWP 2662)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x000000000053c37b in \
tps_processing_function (data=data@entry=0x28f6558) at taskprocessor.c:310<br> #2   \
0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at utils.c:1151<br> #3 \
0x00007fbeb965eb50 in start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> \
#4   0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 9 (Thread 0x7fbe9952b700 (LWP 2663)):<br>
#0   0x00007fbeb9e8348d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x00007fbe9f7177ff in lock_broker (unused=unused@entry=0x0) at \
func_lock.c:211<br> #2   0x0000000000548aaa in dummy_start (data=&lt;optimized \
out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #5   0x0000000000000000 in ?? ()<br>
<br>
Thread 8 (Thread 0x7fbe98cae700 (LWP 2665)):<br>
#0   0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x00007fbeaff16f51 in scan_thread (unused=unused@entry=0x0) at \
pbx_spool.c:694<br> #2   0x0000000000548aaa in dummy_start (data=&lt;optimized \
out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
                /lib/x86_64-linux-gnu/libc.so.6<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
#5   0x0000000000000000 in ?? ()<br>
<br>
Thread 7 (Thread 0x7fbe98c32700 (LWP 2666)):<br>
#0   0x00007fbeb9e8348d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x00007fbeb011aa4e in cleanup (unused=unused@entry=0x0) at \
pbx_realtime.c:133<br> #2   0x0000000000548aaa in dummy_start (data=&lt;optimized \
out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #5   0x0000000000000000 in ?? ()<br>
<br>
Thread 6 (Thread 0x7fbe98bb6700 (LWP 2669)):<br>
#0   0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x00007fbeb0bfb97b in do_monitor (data=data@entry=0x0) at chan_phone.c:1086<br>
#2   0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at \
utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #5   0x0000000000000000 in ?? ()<br>
<br>
Thread 5 (Thread 0x7fbe98b3a700 (LWP 2670)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x000000000053c37b in \
tps_processing_function (data=data@entry=0x7fbeb4096a28) at taskprocessor.c:310<br> \
#2   0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at \
utils.c:1151<br> #3   0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #4   0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #5   0x0000000000000000 in ?? ()<br>
<br>
Thread 4 (Thread 0x7fbe98a42700 (LWP 8202)):<br>
#0   0x00007fbeb9ea798d in read () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x000000000053650b in inotify_daemon (data=data@entry=0x0) at \
stdtime/localtime.c:295<br> #2   0x0000000000548aaa in dummy_start \
(data=&lt;optimized out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in \
start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #4   \
0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 3 (Thread 0x7fbe98abe700 (LWP 10985)):<br>
#0   0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #1   0x0000000000447c2b in autoservice_run \
(ign=ign@entry=0x0) at autoservice.c:101<br> #2   0x0000000000548aaa in dummy_start \
(data=&lt;optimized out&gt;) at utils.c:1151<br> #3   0x00007fbeb965eb50 in \
start_thread () from /lib/x86_64-linux-gnu/libpthread.so.0<br> #4   \
0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6<br> #5   \
0x0000000000000000 in ?? ()<br> <br>
Thread 2 (Thread 0x7fbe989c6700 (LWP 12890)):<br>
#0   0x00007fbeb9eb487d in recvmsg () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x00007fbeb9ed4fcc in ?? () from /lib/x86_64-linux-gnu/libc.so.6<br>
#2   0x00007fbeb9ed544a in ?? () from /lib/x86_64-linux-gnu/libc.so.6<br>
#3   0x00007fbeb9e92007 in getaddrinfo () from /lib/x86_64-linux-gnu/libc.so.6<br>
#4   0x00000000004f2e81 in ast_sockaddr_resolve (addrs=addrs@entry=0x7fbe989c48d8, \
str=&lt;optimized out&gt;,<br>  str@entry=0x7fbe989c4a80 &quot;<a \
href="http://10.12.12.92:2052" rel="noreferrer" \
target="_blank">10.12.12.92:2052</a>&quot;, flags=flags@entry=0, family=2) at \
netsock2.c:268<br> #5   0x00007fbeb095fb8b in ast_sockaddr_resolve_first_af \
(family=&lt;optimized out&gt;, flag=0, name=0x7fbe989c4a80 &quot;<a \
href="http://10.12.12.92:2052" rel="noreferrer" \
target="_blank">10.12.12.92:2052</a>&quot;,<br>  addr=0x7fbeb4114948) at \
chan_sip.c:30797<br> #6   ast_sockaddr_resolve_first_transport \
(transport=&lt;optimized out&gt;, flag=0, name=0x7fbe989c4a80 &quot;<a \
href="http://10.12.12.92:2052" rel="noreferrer" \
target="_blank">10.12.12.92:2052</a>&quot;,<br>  addr=0x7fbeb4114948) at \
chan_sip.c:30828<br> #7   set_destination (uri=&lt;optimized out&gt;, \
p=0x7fbeb4114438) at chan_sip.c:10602<br> #8   reqprep (req=req@entry=0x7fbe989c4fc0, \
p=p@entry=0x7fbeb4114438, sipmethod=sipmethod@entry=8, seqno=&lt;optimized \
out&gt;,<br>  seqno@entry=0, newbranch=newbranch@entry=1) at chan_sip.c:10925<br>
---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---<br>
#9   0x00007fbeb0969968 in transmit_request_with_auth (p=p@entry=0x7fbeb4114438, \
newbranch=1, reliable=XMIT_RELIABLE, seqno=0,<br>  sipmethod=8) at \
chan_sip.c:14296<br> #10 0x00007fbeb098b704 in sip_hangup (ast=&lt;optimized out&gt;) \
at chan_sip.c:6822<br> #11 0x0000000000477b55 in ast_hangup \
(chan=chan@entry=0x7fbeb40ef018) at channel.c:2887<br> #12 0x000000000050ce1b in \
__ast_pbx_run (c=c@entry=0x7fbeb40ef018, args=args@entry=0x0) at pbx.c:5729<br> #13 \
0x000000000050e426 in pbx_thread (data=data@entry=0x7fbeb40ef018) at pbx.c:5821<br> \
#14 0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at \
utils.c:1151<br> #15 0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0<br> #16 0x00007fbeb9eb395d in clone () from \
/lib/x86_64-linux-gnu/libc.so.6<br> #17 0x0000000000000000 in ?? ()<br>
<br>
Thread 1 (Thread 0x7fbeba9c9700 (LWP 2447)):<br>
#0   0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6<br>
#1   0x000000000043f2af in monitor_sig_flags (unused=unused@entry=0x7ffdeb743e70) at \
asterisk.c:3281<br> #2   0x0000000000423eff in main (argc=&lt;optimized out&gt;, \
argv=0x7ffdeb7451a8) at asterisk.c:4152<span class=""><font \
color="#888888"></font></span><br clear="all"></blockquote></div><br></div><div \
class="gmail_extra">There&#39;s no apparent deadlock here, athough it does appear to \
be a livelock. In both backtraces, you have the chan_sip do_monitor thread blocked on \
a lock, while another thread is waiting on getaddrinfo to complete:<br><br><div \
class="">Thread 2 (Thread 0x7fbe989c6700 (LWP 12890)):</div> <div class="">#0   \
0x00007fbeb9eb487d in recvmsg () from /lib/x86_64-linux-gnu/libc.so.6</div> <div \
class="">#1   0x00007fbeb9ed4fcc in ?? () from /lib/x86_64-linux-gnu/libc.so.6</div> \
<div class="">#2   0x00007fbeb9ed544a in ?? () from \
/lib/x86_64-linux-gnu/libc.so.6</div> <div class="">#3   0x00007fbeb9e92007 in \
getaddrinfo () from /lib/x86_64-linux-gnu/libc.so.6</div> <div class="">#4   \
0x00000000004f2e81 in ast_sockaddr_resolve (addrs=addrs@entry=0x7fbe989c48d8, \
str=&lt;optimized out&gt;, </div> <div class="">      str@entry=0x7fbe989c4a80 \
&quot;<a href="http://10.12.12.92:2052">10.12.12.92:2052</a>&quot;, \
flags=flags@entry=0, family=2) at netsock2.c:268</div> <div class="">#5   \
0x00007fbeb095fb8b in ast_sockaddr_resolve_first_af  (family=&lt;optimized out&gt;, \
flag=0, name=0x7fbe989c4a80  &quot;<a \
href="http://10.12.12.92:2052">10.12.12.92:2052</a>&quot;, </div> <div class="">      \
addr=0x7fbeb4114948) at chan_sip.c:30797</div> <div class="">#6   \
ast_sockaddr_resolve_first_transport (transport=&lt;optimized out&gt;, flag=0, \
name=0x7fbe989c4a80 &quot;<a \
href="http://10.12.12.92:2052">10.12.12.92:2052</a>&quot;, </div> <div class="">      \
addr=0x7fbeb4114948) at chan_sip.c:30828</div> <div class="">#7   set_destination \
(uri=&lt;optimized out&gt;, p=0x7fbeb4114438) at chan_sip.c:10602</div> <div \
class="">#8   reqprep (req=req@entry=0x7fbe989c4fc0, p=p@entry=0x7fbeb4114438, \
sipmethod=sipmethod@entry=8, seqno=&lt;optimized out&gt;, </div> <div class="">      \
seqno@entry=0, newbranch=newbranch@entry=1) at chan_sip.c:10925</div> <div \
class="">---Type &lt;return&gt; to continue, or q &lt;return&gt; to quit---</div> \
<div class="">#9   0x00007fbeb0969968 in transmit_request_with_auth \
(p=p@entry=0x7fbeb4114438, newbranch=1, reliable=XMIT_RELIABLE, seqno=0, </div> <div \
class="">      sipmethod=8) at chan_sip.c:14296</div> <div class="">#10 \
0x00007fbeb098b704 in sip_hangup (ast=&lt;optimized out&gt;) at chan_sip.c:6822</div> \
<div class="">#11 0x0000000000477b55 in ast_hangup (chan=chan@entry=0x7fbeb40ef018) \
at channel.c:2887</div> <div class="">#12 0x000000000050ce1b in __ast_pbx_run \
(c=c@entry=0x7fbeb40ef018, args=args@entry=0x0) at pbx.c:5729</div> <div class="">#13 \
0x000000000050e426 in pbx_thread (data=data@entry=0x7fbeb40ef018) at pbx.c:5821</div> \
<div class="">#14 0x0000000000548aaa in dummy_start (data=&lt;optimized out&gt;) at \
utils.c:1151</div> <div class="">#15 0x00007fbeb965eb50 in start_thread () from \
/lib/x86_64-linux-gnu/libpthread.so.0</div> <div class="">#16 0x00007fbeb9eb395d in \
clone () from /lib/x86_64-linux-gnu/libc.so.6</div> #17 0x0000000000000000 in ?? \
()<br></div><div class="gmail_extra"><br></div><div class="gmail_extra">In both \
cases, the thread is waiting in recvmsg.<br><br></div><div \
class="gmail_extra"></div><div class="gmail_extra">Guessing a bit, I would suspect \
that you have some form of DNS or reverse DNS issue occurring on your systems, most \
likely with a very long timeout. I can&#39;t speculate why changing a kernel version \
would cause this problem, although given the scope of such a change, it isn&#39;t \
terribly surprising that some DNS related behaviour would be impacted.<br></div><div \
class="gmail_extra"><br>This isn&#39;t a bug in Asterisk. Later versions of Asterisk \
(and  different SIP stacks) can mitigate long running DNS queries to an 
extent, although it is still going to cause problems.<br><br>-- <br><div \
class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Matthew \
Jordan<br></div><div>Digium, Inc. | Director of Technology<br></div><div>445 Jan \
Davis Drive NW - Huntsville, AL 35806 - USA</div><div>Check us out at: <a \
href="http://digium.com" target="_blank">http://digium.com</a> &amp; <a \
href="http://asterisk.org" \
target="_blank">http://asterisk.org</a></div></div></div></div></div> </div></div>



-- 
_____________________________________________________________________
-- Bandwidth and Colocation Provided by http://www.api-digital.com --

asterisk-dev mailing list
To UNSUBSCRIBE or update options visit:
   http://lists.digium.com/mailman/listinfo/asterisk-dev

[prev in list] [next in list] [prev in thread] [next in thread] 

Configure | About | News | Add a list | Sponsored by KoreLogic