From owner-freebsd-stable@freebsd.org Tue Dec 18 16:06:01 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6ACA1133593B for ; Tue, 18 Dec 2018 16:06:01 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B937173648 for ; Tue, 18 Dec 2018 16:06:00 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from tom.home (kib@localhost [127.0.0.1]) by kib.kiev.ua (8.15.2/8.15.2) with ESMTPS id wBIG5nQD037356 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 18 Dec 2018 18:05:52 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.10.3 kib.kiev.ua wBIG5nQD037356 Received: (from kostik@localhost) by tom.home (8.15.2/8.15.2/Submit) id wBIG5nWX037355; Tue, 18 Dec 2018 18:05:49 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 18 Dec 2018 18:05:49 +0200 From: Konstantin Belousov To: Chuck Tuffli Cc: freebsd-stable@freebsd.org Subject: Re: sporadic core dumps in 12.0-RELEASE Message-ID: <20181218160549.GG60291@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.11.1 (2018-12-01) X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FORGED_GMAIL_RCVD,FREEMAIL_FROM, NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on tom.home X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Dec 2018 16:06:01 -0000 On Tue, Dec 18, 2018 at 07:34:33AM -0800, Chuck Tuffli wrote: > Hi > > When running 12.0-RELEASE in bhyve, nvmecontrol will core dump sporadically > in rtld. This is repeatable, but doesn't happen every time. Peeking at > rlock_acquire(), the function checks for a NULL lockstate and then > dereferences the lock. The backtrace (below) suggests the lock is NULL but > the lockstate pointer is not. Does anyone know if this is expected, weird, > etc.? This is very weird. If you look at the frame #1, you would see that rlock_acquire() is called for the rtld_bind_lock, which should point to rtld_locks[0]. > > root@freebsd:~ # uname -a > FreeBSD freebsd 12.0-RELEASE FreeBSD 12.0-RELEASE r341666 GENERIC amd64 > root@freebsd:~ # /usr/libexec/gdb -q /sbin/nvmecontrol nvmecontrol.core > Core was generated by `nvmecontrol identify nvme0'. > Program terminated with signal 11, Segmentation fault. > Reading symbols from /lib/libc.so.7...Reading symbols from > /usr/lib/debug//lib/libc.so.7.debug...done. > done. > Loaded symbols for /lib/libc.so.7 > Reading symbols from /libexec/ld-elf.so.1...Reading symbols from > /usr/lib/debug//libexec/ld-e > lf.so.1.debug...done. > done. > Loaded symbols for /libexec/ld-elf.so.1 > #0 rlock_acquire (lock=0x0, lockstate=0x7fffffffd9b8) > at /usr/src/libexec/rtld-elf/rtld_lock.c:203 > 203 /usr/src/libexec/rtld-elf/rtld_lock.c: No such file or directory. > in /usr/src/libexec/rtld-elf/rtld_lock.c > (gdb) bt > #0 rlock_acquire (lock=0x0, lockstate=0x7fffffffd9b8) > at /usr/src/libexec/rtld-elf/rtld_lock.c:203 > #1 0x000000080021a2fd in _rtld_bind (obj=0x800236000, reloff=528) > at /usr/src/libexec/rtld-elf/rtld.c:790 > #2 0x000000080021704d in _rtld_bind_start () > at /usr/src/libexec/rtld-elf/amd64/rtld_start.S:121 > #3 0x00000000002087de in identify_ctrlr (argc=2, argv=0x7fffffffebd0) > at /usr/src/sbin/nvmecontrol/identify.c:183 > #4 0x00000000002086e0 in identify (argc=2, argv=0x7fffffffebd0) > at /usr/src/sbin/nvmecontrol/identify.c:292 > #5 0x0000000000207935 in main (argc=, argv= optimized out>) > at /usr/src/sbin/nvmecontrol/nvmecontrol.c:89 > #6 0x000000000020711b in _start (ap=, cleanup= optimized out>) > at /usr/src/lib/csu/amd64/crt1.c:76 > #7 0x0000000800236000 in ?? () > #8 0x0000000000000000 in ?? () > Current language: auto; currently minimal > (gdb) p *lockstate > $1 = {lockstate = 0, env = 0x7fffffffd9c0} > (gdb) > > --chuck > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org"