From owner-freebsd-hackers@FreeBSD.ORG Tue Apr 8 21:06:39 2014 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4E90056B; Tue, 8 Apr 2014 21:06:39 +0000 (UTC) Received: from mail.tdx.com (mail.tdx.com [62.13.128.18]) by mx1.freebsd.org (Postfix) with ESMTP id 023AE152B; Tue, 8 Apr 2014 21:06:38 +0000 (UTC) Received: from study64.tdx.co.uk (study64.tdx.co.uk [62.13.130.231]) (authenticated bits=0) by mail.tdx.com (8.14.3/8.14.3/) with ESMTP id s38L6akA088123 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 8 Apr 2014 22:06:37 +0100 (BST) Date: Tue, 08 Apr 2014 22:06:36 +0100 From: Karl Pielorz To: John Baldwin Subject: Re: Stuck CLOSED sockets / sshd / zombies... Message-ID: <92366925229B4C5B21B04D81@study64.tdx.co.uk> In-Reply-To: <201404081533.53990.jhb@freebsd.org> References: <3FE645E9723756F22EF901AE@Mail-PC.tdx.co.uk> <20140408164353.GB21331@kib.kiev.ua> <277FA3F7B4E7A98921F4D631@study64.tdx.co.uk> <201404081533.53990.jhb@freebsd.org> X-Mailer: Mulberry/4.0.8 (Mac OS X) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Cc: Konstantin Belousov , freebsd-hackers@freebsd.org X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Apr 2014 21:06:39 -0000 --On 8 April 2014 15:33:53 -0400 John Baldwin wrote: > I think this patch only changes debug info, so I think you can just build > and install and re-attach gdb without having to restart sshd. Also, this > patch should only require you to build and install libexec/rtld-elf. Ok, patched, re-attached and re-ran bt (output is below). I've got gdb from ports building on that machine but I probably won't be able to do any more with it tonight. -Karl --- [Switching to LWP 100218] 0x00000008038ea89c in __error () from /lib/libthr.so.3 (gdb) bt #0 0x00000008038ea89c in __error () from /lib/libthr.so.3 #1 0x00000008038e104f in __thr_rwlock_rdlock (rwlock=0x803af9480, flags=, tsp=) at /usr/src/lib/libthr/thread/thr_umtx.c:277 #2 0x00000008038e821c in _thr_rtld_rlock_acquire (lock=0x803af9480) at atomic.h:143 #3 0x000000080064f9a2 in _rtld_get_stack_prot () from /libexec/ld-elf.so.1 #4 0x00000008006498c9 in r_debug_state () from /libexec/ld-elf.so.1 #5 0x00000008006470cd in .text () from /libexec/ld-elf.so.1 #6 0x000000000041072c in grace_alarm_handler (sig=-17504) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:378 #7 #8 0x00000008038ea89c in __error () from /lib/libthr.so.3 #9 0x00000008038e104f in __thr_rwlock_rdlock (rwlock=0x803af9480, flags=, tsp=) at /usr/src/lib/libthr/thread/thr_umtx.c:277 #10 0x00000008038e821c in _thr_rtld_rlock_acquire (lock=0x803af9480) at atomic.h:143 #11 0x000000080064f9a2 in _rtld_get_stack_prot () from /libexec/ld-elf.so.1 #12 0x00000008006498c9 in r_debug_state () from /libexec/ld-elf.so.1 #13 0x00000008006470cd in .text () from /libexec/ld-elf.so.1 #14 0x000000000042f9dd in sshpam_sigchld_handler (sig=) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/auth-pam.c:152 #15 #16 0x0000000800653aea in _rtld_atfork_post () from /libexec/ld-elf.so.1 #17 0x000000080064a1eb in dlclose () from /libexec/ld-elf.so.1 #18 0x0000000800edd121 in openpam_clear_chains () from /usr/lib/libpam.so.5 #19 0x0000000800edd0bc in openpam_clear_chains () from /usr/lib/libpam.so.5 #20 0x0000000800edd0bc in openpam_clear_chains () from /usr/lib/libpam.so.5 #21 0x0000000800edd061 in openpam_clear_chains () from /usr/lib/libpam.so.5 #22 0x0000000800ed99e7 in pam_end () from /usr/lib/libpam.so.5 #23 0x000000000042e15d in sshpam_cleanup () at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/auth-pam.c:614 #24 0x000000000041d58f in do_cleanup (authctxt=0x80401a600) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/session.c:2732 #25 0x000000000041064f in ssh_cleanup_exit (i=255) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:2545 #26 0x0000000000428f83 in mm_request_receive (sock=, m=) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor_wrap.c:153 #27 0x0000000000427e26 in monitor_read (pmonitor=0x804022220, ent=0x6465a0, pent=0x7fffffffd0c0) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor.c:593 #28 0x0000000000427b49 in monitor_child_preauth (_authctxt=, pmonitor=0x804022220) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/monitor.c:387 #29 0x000000000040fd15 in main (ac=, av=) at /usr/src/secure/usr.sbin/sshd/../../../crypto/openssh/sshd.c:679