From owner-freebsd-current@freebsd.org Sat Aug 8 02:06:36 2015 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E1FE59B6505 for ; Sat, 8 Aug 2015 02:06:36 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "thebighonker.lerctr.org", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B7907F39 for ; Sat, 8 Aug 2015 02:06:36 +0000 (UTC) (envelope-from ler@lerctr.org) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date: Content-Transfer-Encoding:Content-Type:MIME-Version; bh=mbGcLJNGAdPzHph1KbbYQxwYIMeNCpADHRt/OaZUQw8=; b=kWYqhQmVh/QYLVMwO0MVjN0gw4 //r0dG2A3zEUB4a9CytQSgFJQDB5FFS36N0cuiOdFI1qhjx8PcBWz0gI5ZN7D3fiBT4g6klS4Q7yk KMXX9DHmSYVHqNKDdPMquCkXwzCzt4tkK5HYTiVCRPmgF5c6yZzrk9/FgRmAHhgwr+ko=; Received: from thebighonker.lerctr.org ([2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]:19789 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLSv1:ECDHE-RSA-AES128-SHA:128) (Exim 4.86 (FreeBSD)) (envelope-from ) id 1ZNtWt-000Gws-EM; Fri, 07 Aug 2015 21:06:35 -0500 Received: from cpe-70-113-56-244.austin.res.rr.com ([70.113.56.244]) by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Fri, 07 Aug 2015 21:06:35 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Fri, 07 Aug 2015 21:06:35 -0500 From: Larry Rosenman To: Adrian Chadd Cc: freebsd-current Subject: Re: traceroute6: panic: pcb not read locked In-Reply-To: References: <20150808010324.GA1392@borg.lerctr.org> <848c2fd97e0833e486a69834184ba2c9@thebighonker.lerctr.org> Message-ID: X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/1.1.2 X-Spam-Score: -1.0 (-) X-LERCTR-Spam-Score: -1.0 (-) X-Spam-Report: SpamScore (-1.0/5.0) ALL_TRUSTED=-1,SHORTCIRCUIT=-0.0001 X-LERCTR-Spam-Report: SpamScore (-1.0/5.0) ALL_TRUSTED=-1, SHORTCIRCUIT=-0.0001 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 08 Aug 2015 02:06:37 -0000 Not always the same hop on the (slow) traceroute, but it DOES seem to panic EVERY time. On 2015-08-07 20:58, Larry Rosenman wrote: > Of course as soon as I sent that I got another one...... > > > On 2015-08-07 20:58, Larry Rosenman wrote: >> just have the 2 panics. it doesn't "just reproduce". >> >> I'll see what I can find. >> >> Is there anything I can get for you from the core(s)? >> >> >> On 2015-08-07 20:32, Larry Rosenman wrote: >>> I got a 2nd one soon after just sitting -- I did JUST update sources, >>> turned off ipV6 to update (I seem to be having issues with TWC's >>> IPV6). >>> >>> Rebuild in process. >>> >>> I **CAN** give you access to the cores, machine, et al. >>> >>> I'd LOVE to figure out wtf is wrong on the IPV6 native stuff with >>> TWC. >>> >>> >>> On 2015-08-07 20:29, Adrian Chadd wrote: >>>> is it easily reproducable for you there? >>>> >>>> >>>> >>>> -a >>>> >>>> >>>> On 7 August 2015 at 18:04, Larry Rosenman wrote: >>>>> Trying to debug TimeWarner IPV6 to my HE.NET tunnel, and running >>>>> traceroute6, >>>>> got the following panic: >>>>> >>>>> borg.lerctr.org dumped core - see /var/crash/vmcore.0 >>>>> >>>>> Fri Aug 7 19:58:40 CDT 2015 >>>>> >>>>> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #32 >>>>> r286338: Wed Aug 5 15:57:55 CDT 2015 >>>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER amd64 >>>>> >>>>> panic: Lock tcp not read locked @ >>>>> /usr/src/sys/netinet/tcp_subr.c:1189 >>>>> >>>>> GNU gdb 6.1.1 [FreeBSD] >>>>> Copyright 2004 Free Software Foundation, Inc. >>>>> GDB is free software, covered by the GNU General Public License, >>>>> and you are >>>>> welcome to change it and/or distribute copies of it under certain >>>>> conditions. >>>>> Type "show copying" to see the conditions. >>>>> There is absolutely no warranty for GDB. Type "show warranty" for >>>>> details. >>>>> This GDB was configured as "amd64-marcel-freebsd"... >>>>> >>>>> Unread portion of the kernel message buffer: >>>>> panic: Lock tcp not read locked @ >>>>> /usr/src/sys/netinet/tcp_subr.c:1189 >>>>> >>>>> cpuid = 2 >>>>> KDB: stack backtrace: >>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >>>>> 0xfffffe2dfc3ef400 >>>>> vpanic() at vpanic+0x189/frame 0xfffffe2dfc3ef480 >>>>> panic() at panic+0x43/frame 0xfffffe2dfc3ef4e0 >>>>> __rw_assert() at __rw_assert+0x154/frame 0xfffffe2dfc3ef4f0 >>>>> tcp_notify() at tcp_notify+0x2d/frame 0xfffffe2dfc3ef520 >>>>> in6_pcbnotify() at in6_pcbnotify+0x2a0/frame 0xfffffe2dfc3ef5b0 >>>>> tcp6_ctlinput() at tcp6_ctlinput+0xf4/frame 0xfffffe2dfc3ef650 >>>>> icmp6_input() at icmp6_input+0x1737/frame 0xfffffe2dfc3ef7f0 >>>>> ip6_input() at ip6_input+0x4a2/frame 0xfffffe2dfc3ef8d0 >>>>> netisr_dispatch_src() at netisr_dispatch_src+0x86/frame >>>>> 0xfffffe2dfc3ef940 >>>>> ether_demux() at ether_demux+0x176/frame 0xfffffe2dfc3ef970 >>>>> ether_nh_input() at ether_nh_input+0x33a/frame 0xfffffe2dfc3ef9b0 >>>>> netisr_dispatch_src() at netisr_dispatch_src+0x86/frame >>>>> 0xfffffe2dfc3efa20 >>>>> ether_input() at ether_input+0x4f/frame 0xfffffe2dfc3efa50 >>>>> if_input() at if_input+0xa/frame 0xfffffe2dfc3efa60 >>>>> em_rxeof() at em_rxeof+0x27f/frame 0xfffffe2dfc3efae0 >>>>> em_handle_que() at em_handle_que+0x40/frame 0xfffffe2dfc3efb20 >>>>> taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame >>>>> 0xfffffe2dfc3efb80 >>>>> taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame >>>>> 0xfffffe2dfc3efbb0 >>>>> fork_exit() at fork_exit+0x84/frame 0xfffffe2dfc3efbf0 >>>>> fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe2dfc3efbf0 >>>>> --- trap 0, rip = 0, rsp = 0, rbp = 0 --- >>>>> Uptime: 19m58s >>>>> Dumping 2903 out of 64454 >>>>> MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% >>>>> >>>>> Reading symbols from /boot/kernel/linux.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/linux.ko.symbols >>>>> Reading symbols from /boot/kernel/linux_common.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/linux_common.ko.symbols >>>>> Reading symbols from /boot/kernel/if_lagg.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/if_lagg.ko.symbols >>>>> Reading symbols from /boot/kernel/snd_envy24ht.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/snd_envy24ht.ko.symbols >>>>> Reading symbols from /boot/kernel/snd_spicds.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/snd_spicds.ko.symbols >>>>> Reading symbols from /boot/kernel/coretemp.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/coretemp.ko.symbols >>>>> Reading symbols from /boot/kernel/ichsmb.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/ichsmb.ko.symbols >>>>> Reading symbols from /boot/kernel/smbus.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/smbus.ko.symbols >>>>> Reading symbols from /boot/kernel/ichwd.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/ichwd.ko.symbols >>>>> Reading symbols from /boot/kernel/cpuctl.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/cpuctl.ko.symbols >>>>> Reading symbols from /boot/kernel/cryptodev.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/cryptodev.ko.symbols >>>>> Reading symbols from /boot/kernel/dtraceall.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/dtraceall.ko.symbols >>>>> Reading symbols from /boot/kernel/profile.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/profile.ko.symbols >>>>> Reading symbols from /boot/kernel/dtrace.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/dtrace.ko.symbols >>>>> Reading symbols from >>>>> /boot/kernel/systrace_freebsd32.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/systrace_freebsd32.ko.symbols >>>>> Reading symbols from /boot/kernel/systrace.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/systrace.ko.symbols >>>>> Reading symbols from /boot/kernel/sdt.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/sdt.ko.symbols >>>>> Reading symbols from /boot/kernel/fasttrap.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/fasttrap.ko.symbols >>>>> Reading symbols from /boot/kernel/fbt.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/fbt.ko.symbols >>>>> Reading symbols from /boot/kernel/dtnfscl.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/dtnfscl.ko.symbols >>>>> Reading symbols from /boot/kernel/dtmalloc.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/dtmalloc.ko.symbols >>>>> Reading symbols from /boot/modules/nvidia.ko...done. >>>>> Loaded symbols for /boot/modules/nvidia.ko >>>>> Reading symbols from /boot/kernel/ipmi.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/ipmi.ko.symbols >>>>> Reading symbols from /boot/kernel/ipmi_linux.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/ipmi_linux.ko.symbols >>>>> Reading symbols from /boot/kernel/radeonkms.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/radeonkms.ko.symbols >>>>> Reading symbols from /boot/kernel/iicbb.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/iicbb.ko.symbols >>>>> Reading symbols from /boot/kernel/iicbus.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/iicbus.ko.symbols >>>>> Reading symbols from /boot/kernel/iic.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/iic.ko.symbols >>>>> Reading symbols from /boot/kernel/drm2.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/drm2.ko.symbols >>>>> Reading symbols from >>>>> /boot/kernel/radeonkmsfw_R100_cp.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/radeonkmsfw_R100_cp.ko.symbols >>>>> Reading symbols from /boot/kernel/uhid.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/uhid.ko.symbols >>>>> Reading symbols from /boot/kernel/linux64.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/linux64.ko.symbols >>>>> Reading symbols from /boot/kernel/pf.ko.symbols...done. >>>>> Loaded symbols for /boot/kernel/pf.ko.symbols >>>>> #0 doadump (textdump=1) at pcpu.h:221 >>>>> 221 pcpu.h: No such file or directory. >>>>> in pcpu.h >>>>> (kgdb) #0 doadump (textdump=1) at pcpu.h:221 >>>>> #1 0xffffffff80b2b255 in kern_reboot (howto=260) >>>>> at /usr/src/sys/kern/kern_shutdown.c:329 >>>>> #2 0xffffffff80b2b848 in vpanic (fmt=, >>>>> ap=) at >>>>> /usr/src/sys/kern/kern_shutdown.c:626 >>>>> #3 0xffffffff80b2b893 in panic (fmt=0x0) >>>>> at /usr/src/sys/kern/kern_shutdown.c:557 >>>>> #4 0xffffffff80b29764 in __rw_assert (c=0x0, what=>>>> out>, >>>>> file=0x0, line=0) at /usr/src/sys/kern/kern_rwlock.c:1183 >>>>> #5 0xffffffff80ceba5d in tcp_notify (inp=0xfffff80090798960, >>>>> error=61) >>>>> at /usr/src/sys/netinet/tcp_subr.c:1189 >>>>> #6 0xffffffff80d0cd20 in in6_pcbnotify (pcbinfo=>>>> out>, >>>>> dst=0xfffffe2dfc3ef720, fport_arg=13568, src=>>>> out>, >>>>> lport_arg=, cmd=, >>>>> notify=0xffffffff80ceba30 ) >>>>> at /usr/src/sys/netinet6/in6_pcb.c:679 >>>>> #7 0xffffffff80cebf24 in tcp6_ctlinput (cmd=10, >>>>> sa=0xfffffe2dfc3ef720, >>>>> d=0xfffffe2dfc3ef6d8) at /usr/src/sys/netinet/tcp_subr.c:1641 >>>>> #8 0xffffffff80cfc607 in icmp6_input (mp=, >>>>> offp=0xfffffe2dfc3ef81c, proto=0) at >>>>> /usr/src/sys/netinet6/icmp6.c:1155 >>>>> #9 0xffffffff80d10f72 in ip6_input (m=0xfffff80049c65100) >>>>> at /usr/src/sys/netinet6/ip6_input.c:810 >>>>> #10 0xffffffff80c10026 in netisr_dispatch_src (proto=>>>> optimized out>, >>>>> source=, m=0xfffff80049c65100) >>>>> at /usr/src/sys/net/netisr.c:972 >>>>> #11 0xffffffff80c06ec6 in ether_demux (ifp=, >>>>> m=) at /usr/src/sys/net/if_ethersubr.c:768 >>>>> #12 0xffffffff80c07b7a in ether_nh_input (m=) >>>>> at /usr/src/sys/net/if_ethersubr.c:575 >>>>> #13 0xffffffff80c10026 in netisr_dispatch_src (proto=>>>> optimized out>, >>>>> source=, m=0xfffff80049c65100) >>>>> at /usr/src/sys/net/netisr.c:972 >>>>> #14 0xffffffff80c071af in ether_input (ifp=0xfffff8002c6d5800, >>>>> m=0x0) >>>>> at /usr/src/sys/net/if_ethersubr.c:676 >>>>> #15 0xffffffff80c03f4a in if_input (ifp=0x0, sendmp=0x0) >>>>> at /usr/src/sys/net/if.c:3847 >>>>> #16 0xffffffff8061d01f in em_rxeof (count=99) >>>>> at /usr/src/sys/dev/e1000/if_em.c:4666 >>>>> #17 0xffffffff8061c940 in em_handle_que >>>>> (context=0xfffffe1ea96cb000, >>>>> pending=) at >>>>> /usr/src/sys/dev/e1000/if_em.c:1564 >>>>> #18 0xffffffff80b78ca0 in taskqueue_run_locked >>>>> (queue=0xfffff8002c6d4300) >>>>> at /usr/src/sys/kern/subr_taskqueue.c:430 >>>>> #19 0xffffffff80b79778 in taskqueue_thread_loop (arg=>>>> optimized out>) >>>>> at /usr/src/sys/kern/subr_taskqueue.c:683 >>>>> #20 0xffffffff80af2154 in fork_exit ( >>>>> callout=0xffffffff80b796f0 , >>>>> arg=0xfffffe1ea96cd730, frame=0xfffffe2dfc3efc00) >>>>> at /usr/src/sys/kern/kern_fork.c:1006 >>>>> #21 0xffffffff80f514ce in fork_trampoline () >>>>> at /usr/src/sys/amd64/amd64/exception.S:610 >>>>> #22 0x0000000000000000 in ?? () >>>>> Current language: auto; currently minimal >>>>> (kgdb) >>>>> >>>>> >>>>> Core *IS* available. >>>>> >>>>> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #32 >>>>> r286338: Wed Aug 5 15:57:55 CDT 2015 >>>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER amd64 1100077 >>>>> 1100077 >>>>> >>>>> >>>>> 11.0-CURRENT >>>>> -- >>>>> Larry Rosenman http://www.lerctr.org/~ler >>>>> Phone: +1 214-642-9640 E-Mail: ler@lerctr.org >>>>> US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961 >>>>> _______________________________________________ >>>>> freebsd-current@freebsd.org mailing list >>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-current >>>>> To unsubscribe, send any mail to >>>>> "freebsd-current-unsubscribe@freebsd.org" -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 E-Mail: ler@lerctr.org US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961