Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 07 Aug 2015 21:06:35 -0500
From:      Larry Rosenman <ler@lerctr.org>
To:        Adrian Chadd <adrian.chadd@gmail.com>
Cc:        freebsd-current <freebsd-current@freebsd.org>
Subject:   Re: traceroute6: panic: pcb not read locked
Message-ID:  <a0093d73e26d7f5538043efe68d62c19@thebighonker.lerctr.org>
In-Reply-To: <d5cd73062d5f7dfba2fd8acc4c414839@thebighonker.lerctr.org>
References:  <20150808010324.GA1392@borg.lerctr.org> <CAJ-Vmok5qzf0y0AtBL6h7XxA4U%2BHuNbigya=j71ijR2hoLvKBg@mail.gmail.com> <eb2c43750c2649fd5f8f4719bf855227@thebighonker.lerctr.org> <848c2fd97e0833e486a69834184ba2c9@thebighonker.lerctr.org> <d5cd73062d5f7dfba2fd8acc4c414839@thebighonker.lerctr.org>

next in thread | previous in thread | raw e-mail | index | archive | help
Not always the same hop on the (slow) traceroute, but it DOES seem to 
panic EVERY time.


On 2015-08-07 20:58, Larry Rosenman wrote:
> Of course as soon as I sent that I got another one......
> 
> 
> On 2015-08-07 20:58, Larry Rosenman wrote:
>> just have the 2 panics.  it doesn't "just reproduce".
>> 
>> I'll see what I can find.
>> 
>> Is there anything I can get for you from the core(s)?
>> 
>> 
>> On 2015-08-07 20:32, Larry Rosenman wrote:
>>> I got a 2nd one soon after just sitting -- I did JUST update sources,
>>> turned off ipV6 to update (I seem to be having issues with TWC's
>>> IPV6).
>>> 
>>> Rebuild in process.
>>> 
>>> I **CAN** give you access to the cores, machine, et al.
>>> 
>>> I'd LOVE to figure out wtf is wrong on the IPV6 native stuff with 
>>> TWC.
>>> 
>>> 
>>> On 2015-08-07 20:29, Adrian Chadd wrote:
>>>> is it easily reproducable for you there?
>>>> 
>>>> 
>>>> 
>>>> -a
>>>> 
>>>> 
>>>> On 7 August 2015 at 18:04, Larry Rosenman <ler@lerctr.org> wrote:
>>>>> Trying to debug TimeWarner IPV6 to my HE.NET tunnel, and running 
>>>>> traceroute6,
>>>>> got the following panic:
>>>>> 
>>>>> borg.lerctr.org dumped core - see /var/crash/vmcore.0
>>>>> 
>>>>> Fri Aug  7 19:58:40 CDT 2015
>>>>> 
>>>>> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #32 
>>>>> r286338: Wed Aug  5 15:57:55 CDT 2015     
>>>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER  amd64
>>>>> 
>>>>> panic: Lock tcp not read locked @ 
>>>>> /usr/src/sys/netinet/tcp_subr.c:1189
>>>>> 
>>>>> GNU gdb 6.1.1 [FreeBSD]
>>>>> Copyright 2004 Free Software Foundation, Inc.
>>>>> GDB is free software, covered by the GNU General Public License, 
>>>>> and you are
>>>>> welcome to change it and/or distribute copies of it under certain 
>>>>> conditions.
>>>>> Type "show copying" to see the conditions.
>>>>> There is absolutely no warranty for GDB.  Type "show warranty" for 
>>>>> details.
>>>>> This GDB was configured as "amd64-marcel-freebsd"...
>>>>> 
>>>>> Unread portion of the kernel message buffer:
>>>>> panic: Lock tcp not read locked @ 
>>>>> /usr/src/sys/netinet/tcp_subr.c:1189
>>>>> 
>>>>> cpuid = 2
>>>>> KDB: stack backtrace:
>>>>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 
>>>>> 0xfffffe2dfc3ef400
>>>>> vpanic() at vpanic+0x189/frame 0xfffffe2dfc3ef480
>>>>> panic() at panic+0x43/frame 0xfffffe2dfc3ef4e0
>>>>> __rw_assert() at __rw_assert+0x154/frame 0xfffffe2dfc3ef4f0
>>>>> tcp_notify() at tcp_notify+0x2d/frame 0xfffffe2dfc3ef520
>>>>> in6_pcbnotify() at in6_pcbnotify+0x2a0/frame 0xfffffe2dfc3ef5b0
>>>>> tcp6_ctlinput() at tcp6_ctlinput+0xf4/frame 0xfffffe2dfc3ef650
>>>>> icmp6_input() at icmp6_input+0x1737/frame 0xfffffe2dfc3ef7f0
>>>>> ip6_input() at ip6_input+0x4a2/frame 0xfffffe2dfc3ef8d0
>>>>> netisr_dispatch_src() at netisr_dispatch_src+0x86/frame 
>>>>> 0xfffffe2dfc3ef940
>>>>> ether_demux() at ether_demux+0x176/frame 0xfffffe2dfc3ef970
>>>>> ether_nh_input() at ether_nh_input+0x33a/frame 0xfffffe2dfc3ef9b0
>>>>> netisr_dispatch_src() at netisr_dispatch_src+0x86/frame 
>>>>> 0xfffffe2dfc3efa20
>>>>> ether_input() at ether_input+0x4f/frame 0xfffffe2dfc3efa50
>>>>> if_input() at if_input+0xa/frame 0xfffffe2dfc3efa60
>>>>> em_rxeof() at em_rxeof+0x27f/frame 0xfffffe2dfc3efae0
>>>>> em_handle_que() at em_handle_que+0x40/frame 0xfffffe2dfc3efb20
>>>>> taskqueue_run_locked() at taskqueue_run_locked+0xf0/frame 
>>>>> 0xfffffe2dfc3efb80
>>>>> taskqueue_thread_loop() at taskqueue_thread_loop+0x88/frame 
>>>>> 0xfffffe2dfc3efbb0
>>>>> fork_exit() at fork_exit+0x84/frame 0xfffffe2dfc3efbf0
>>>>> fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe2dfc3efbf0
>>>>> --- trap 0, rip = 0, rsp = 0, rbp = 0 ---
>>>>> Uptime: 19m58s
>>>>> Dumping 2903 out of 64454 
>>>>> MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%
>>>>> 
>>>>> Reading symbols from /boot/kernel/linux.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/linux.ko.symbols
>>>>> Reading symbols from /boot/kernel/linux_common.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/linux_common.ko.symbols
>>>>> Reading symbols from /boot/kernel/if_lagg.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/if_lagg.ko.symbols
>>>>> Reading symbols from /boot/kernel/snd_envy24ht.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/snd_envy24ht.ko.symbols
>>>>> Reading symbols from /boot/kernel/snd_spicds.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/snd_spicds.ko.symbols
>>>>> Reading symbols from /boot/kernel/coretemp.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/coretemp.ko.symbols
>>>>> Reading symbols from /boot/kernel/ichsmb.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/ichsmb.ko.symbols
>>>>> Reading symbols from /boot/kernel/smbus.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/smbus.ko.symbols
>>>>> Reading symbols from /boot/kernel/ichwd.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/ichwd.ko.symbols
>>>>> Reading symbols from /boot/kernel/cpuctl.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/cpuctl.ko.symbols
>>>>> Reading symbols from /boot/kernel/cryptodev.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/cryptodev.ko.symbols
>>>>> Reading symbols from /boot/kernel/dtraceall.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/dtraceall.ko.symbols
>>>>> Reading symbols from /boot/kernel/profile.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/profile.ko.symbols
>>>>> Reading symbols from /boot/kernel/dtrace.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/dtrace.ko.symbols
>>>>> Reading symbols from 
>>>>> /boot/kernel/systrace_freebsd32.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/systrace_freebsd32.ko.symbols
>>>>> Reading symbols from /boot/kernel/systrace.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/systrace.ko.symbols
>>>>> Reading symbols from /boot/kernel/sdt.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/sdt.ko.symbols
>>>>> Reading symbols from /boot/kernel/fasttrap.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/fasttrap.ko.symbols
>>>>> Reading symbols from /boot/kernel/fbt.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/fbt.ko.symbols
>>>>> Reading symbols from /boot/kernel/dtnfscl.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/dtnfscl.ko.symbols
>>>>> Reading symbols from /boot/kernel/dtmalloc.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/dtmalloc.ko.symbols
>>>>> Reading symbols from /boot/modules/nvidia.ko...done.
>>>>> Loaded symbols for /boot/modules/nvidia.ko
>>>>> Reading symbols from /boot/kernel/ipmi.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/ipmi.ko.symbols
>>>>> Reading symbols from /boot/kernel/ipmi_linux.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/ipmi_linux.ko.symbols
>>>>> Reading symbols from /boot/kernel/radeonkms.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/radeonkms.ko.symbols
>>>>> Reading symbols from /boot/kernel/iicbb.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/iicbb.ko.symbols
>>>>> Reading symbols from /boot/kernel/iicbus.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/iicbus.ko.symbols
>>>>> Reading symbols from /boot/kernel/iic.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/iic.ko.symbols
>>>>> Reading symbols from /boot/kernel/drm2.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/drm2.ko.symbols
>>>>> Reading symbols from 
>>>>> /boot/kernel/radeonkmsfw_R100_cp.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/radeonkmsfw_R100_cp.ko.symbols
>>>>> Reading symbols from /boot/kernel/uhid.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/uhid.ko.symbols
>>>>> Reading symbols from /boot/kernel/linux64.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/linux64.ko.symbols
>>>>> Reading symbols from /boot/kernel/pf.ko.symbols...done.
>>>>> Loaded symbols for /boot/kernel/pf.ko.symbols
>>>>> #0  doadump (textdump=1) at pcpu.h:221
>>>>> 221     pcpu.h: No such file or directory.
>>>>>         in pcpu.h
>>>>> (kgdb) #0  doadump (textdump=1) at pcpu.h:221
>>>>> #1  0xffffffff80b2b255 in kern_reboot (howto=260)
>>>>>     at /usr/src/sys/kern/kern_shutdown.c:329
>>>>> #2  0xffffffff80b2b848 in vpanic (fmt=<value optimized out>,
>>>>>     ap=<value optimized out>) at 
>>>>> /usr/src/sys/kern/kern_shutdown.c:626
>>>>> #3  0xffffffff80b2b893 in panic (fmt=0x0)
>>>>>     at /usr/src/sys/kern/kern_shutdown.c:557
>>>>> #4  0xffffffff80b29764 in __rw_assert (c=0x0, what=<value optimized 
>>>>> out>,
>>>>>     file=0x0, line=0) at /usr/src/sys/kern/kern_rwlock.c:1183
>>>>> #5  0xffffffff80ceba5d in tcp_notify (inp=0xfffff80090798960, 
>>>>> error=61)
>>>>>     at /usr/src/sys/netinet/tcp_subr.c:1189
>>>>> #6  0xffffffff80d0cd20 in in6_pcbnotify (pcbinfo=<value optimized 
>>>>> out>,
>>>>>     dst=0xfffffe2dfc3ef720, fport_arg=13568, src=<value optimized 
>>>>> out>,
>>>>>     lport_arg=<value optimized out>, cmd=<value optimized out>,
>>>>>     notify=0xffffffff80ceba30 <tcp_notify>)
>>>>>     at /usr/src/sys/netinet6/in6_pcb.c:679
>>>>> #7  0xffffffff80cebf24 in tcp6_ctlinput (cmd=10, 
>>>>> sa=0xfffffe2dfc3ef720,
>>>>>     d=0xfffffe2dfc3ef6d8) at /usr/src/sys/netinet/tcp_subr.c:1641
>>>>> #8  0xffffffff80cfc607 in icmp6_input (mp=<value optimized out>,
>>>>>     offp=0xfffffe2dfc3ef81c, proto=0) at 
>>>>> /usr/src/sys/netinet6/icmp6.c:1155
>>>>> #9  0xffffffff80d10f72 in ip6_input (m=0xfffff80049c65100)
>>>>>     at /usr/src/sys/netinet6/ip6_input.c:810
>>>>> #10 0xffffffff80c10026 in netisr_dispatch_src (proto=<value 
>>>>> optimized out>,
>>>>>     source=<value optimized out>, m=0xfffff80049c65100)
>>>>>     at /usr/src/sys/net/netisr.c:972
>>>>> #11 0xffffffff80c06ec6 in ether_demux (ifp=<value optimized out>,
>>>>>     m=<value optimized out>) at /usr/src/sys/net/if_ethersubr.c:768
>>>>> #12 0xffffffff80c07b7a in ether_nh_input (m=<value optimized out>)
>>>>>     at /usr/src/sys/net/if_ethersubr.c:575
>>>>> #13 0xffffffff80c10026 in netisr_dispatch_src (proto=<value 
>>>>> optimized out>,
>>>>>     source=<value optimized out>, m=0xfffff80049c65100)
>>>>>     at /usr/src/sys/net/netisr.c:972
>>>>> #14 0xffffffff80c071af in ether_input (ifp=0xfffff8002c6d5800, 
>>>>> m=0x0)
>>>>>     at /usr/src/sys/net/if_ethersubr.c:676
>>>>> #15 0xffffffff80c03f4a in if_input (ifp=0x0, sendmp=0x0)
>>>>>     at /usr/src/sys/net/if.c:3847
>>>>> #16 0xffffffff8061d01f in em_rxeof (count=99)
>>>>>     at /usr/src/sys/dev/e1000/if_em.c:4666
>>>>> #17 0xffffffff8061c940 in em_handle_que 
>>>>> (context=0xfffffe1ea96cb000,
>>>>>     pending=<value optimized out>) at 
>>>>> /usr/src/sys/dev/e1000/if_em.c:1564
>>>>> #18 0xffffffff80b78ca0 in taskqueue_run_locked 
>>>>> (queue=0xfffff8002c6d4300)
>>>>>     at /usr/src/sys/kern/subr_taskqueue.c:430
>>>>> #19 0xffffffff80b79778 in taskqueue_thread_loop (arg=<value 
>>>>> optimized out>)
>>>>>     at /usr/src/sys/kern/subr_taskqueue.c:683
>>>>> #20 0xffffffff80af2154 in fork_exit (
>>>>>     callout=0xffffffff80b796f0 <taskqueue_thread_loop>,
>>>>>     arg=0xfffffe1ea96cd730, frame=0xfffffe2dfc3efc00)
>>>>>     at /usr/src/sys/kern/kern_fork.c:1006
>>>>> #21 0xffffffff80f514ce in fork_trampoline ()
>>>>>     at /usr/src/sys/amd64/amd64/exception.S:610
>>>>> #22 0x0000000000000000 in ?? ()
>>>>> Current language:  auto; currently minimal
>>>>> (kgdb)
>>>>> 
>>>>> 
>>>>> Core *IS* available.
>>>>> 
>>>>> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #32 
>>>>> r286338: Wed Aug  5 15:57:55 CDT 2015     
>>>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER  amd64 1100077 
>>>>> 1100077
>>>>> 
>>>>> 
>>>>> 11.0-CURRENT
>>>>> --
>>>>> Larry Rosenman                     http://www.lerctr.org/~ler
>>>>> Phone: +1 214-642-9640                 E-Mail: ler@lerctr.org
>>>>> US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961
>>>>> _______________________________________________
>>>>> freebsd-current@freebsd.org mailing list
>>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-current
>>>>> To unsubscribe, send any mail to 
>>>>> "freebsd-current-unsubscribe@freebsd.org"

-- 
Larry Rosenman                     http://www.lerctr.org/~ler
Phone: +1 214-642-9640                 E-Mail: ler@lerctr.org
US Mail: 7011 W Parmer Ln, Apt 1115, Austin, TX 78729-6961




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?a0093d73e26d7f5538043efe68d62c19>