Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 24 Apr 2013 19:20:42 GMT
From:      Nate Denning <nate.denning@gmail.com>
To:        freebsd-gnats-submit@FreeBSD.org
Subject:   amd64/178116: Kernel panic: general protection fault in tcp_do_segment
Message-ID:  <201304241920.r3OJKgOD038024@red.freebsd.org>
Resent-Message-ID: <201304241930.r3OJU0wC080002@freefall.freebsd.org>

next in thread | raw e-mail | index | archive | help

>Number:         178116
>Category:       amd64
>Synopsis:       Kernel panic: general protection fault in tcp_do_segment
>Confidential:   no
>Severity:       non-critical
>Priority:       low
>Responsible:    freebsd-amd64
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Wed Apr 24 19:30:00 UTC 2013
>Closed-Date:
>Last-Modified:
>Originator:     Nate Denning
>Release:        9.1-STABLE
>Organization:
>Environment:
FreeBSD xxx 9.1-STABLE FreeBSD 9.1-STABLE #0 r249765: Mon Apr 22 19:22:46 MDT 2013     nate@xxx:/usr/obj/usr/src-9-stable/sys/GENERIC  amd64
>Description:
I'm getting the below panic at random intervals ranging from about 1 hour to 2 days.

To note, this is a repost of PR 178017 (http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/178017) which was closed due to my email address bouncing (fixed; sorry about that). In that PR it was suggested I upgrade to 9.1-STABLE which I have done to no avail. Stack trace from 9.1-STABLE and 9.1-RELEASE is below.

--- core.txt from 9.1-STABLE (r249765) ---

Unread portion of the kernel message buffer:
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 0 (em1 que)
trap number             = 9
panic: general protection fault
cpuid = 3
KDB: stack backtrace:
#0 0xffffffff80952f46 at kdb_backtrace+0x66
#1 0xffffffff8091a2de at panic+0x1ce
#2 0xffffffff80ca8b80 at trap_fatal+0x290
#3 0xffffffff80ca9391 at trap+0x241
#4 0xffffffff80c92813 at calltrap+0x8
#5 0xffffffff809840a8 at sbappendstream_locked+0x18
#6 0xffffffff80aae74e at tcp_do_segment+0x29ae
#7 0xffffffff80aafa36 at tcp_input+0xbb6
#8 0xffffffff80a403ca at ip_input+0xaa
#9 0xffffffff809e2578 at netisr_dispatch_src+0x218
#10 0xffffffff809d920d at ether_demux+0x14d
#11 0xffffffff809d94e4 at ether_nh_input+0x1f4
#12 0xffffffff809e2578 at netisr_dispatch_src+0x218
#13 0xffffffff804dd248 at em_rxeof+0x1c8
#14 0xffffffff804dd6f8 at em_handle_que+0x48
#15 0xffffffff8095f9b4 at taskqueue_run_locked+0x74
#16 0xffffffff80960966 at taskqueue_thread_loop+0x46
#17 0xffffffff808e83af at fork_exit+0x11f
Uptime: 1d4h4m46s
Dumping 4007 out of 8158 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
Reading symbols from /boot/kernel/ipl.ko...Reading symbols from /boot/kernel/ipl.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ipl.ko
Reading symbols from /boot/kernel/accf_http.ko...Reading symbols from /boot/kernel/accf_http.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/accf_http.ko
Reading symbols from /boot/kernel/accf_data.ko...Reading symbols from /boot/kernel/accf_data.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/accf_data.ko
#0  doadump (textdump=<value optimized out>) at pcpu.h:229
229     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) #0  doadump (textdump=<value optimized out>) at pcpu.h:229
#1  0xffffffff80919db4 in kern_reboot (howto=260)
    at /usr/src-9-stable/sys/kern/kern_shutdown.c:449
#2  0xffffffff8091a2b7 in panic (fmt=0x1 <Address 0x1 out of bounds>)
    at /usr/src-9-stable/sys/kern/kern_shutdown.c:637
#3  0xffffffff80ca8b80 in trap_fatal (frame=0x9, eva=<value optimized out>)
    at /usr/src-9-stable/sys/amd64/amd64/trap.c:878
#4  0xffffffff80ca9391 in trap (frame=0xffffff83428df610)
    at /usr/src-9-stable/sys/amd64/amd64/trap.c:605
#5  0xffffffff80c92813 in calltrap ()
    at /usr/src-9-stable/sys/amd64/amd64/exception.S:228
#6  0xffffffff80983cd6 in sbcompress (sb=0xfffffe002f6fa338, 
    m=0x2a63737717c07a, n=0xfffffe006529b800)
    at /usr/src-9-stable/sys/kern/uipc_sockbuf.c:759
#7  0xffffffff809840a8 in sbappendstream_locked (sb=0xfffffe002f6fa338, 
    m=<value optimized out>) at /usr/src-9-stable/sys/kern/uipc_sockbuf.c:531
#8  0xffffffff80aae74e in tcp_do_segment (m=0xfffffe006529b800, 
    th=<value optimized out>, so=0xfffffe002f6fa2a8, tp=0xfffffe003eb683d0, 
    drop_hdrlen=52, tlen=48, iptos=8 '\b', ti_locked=1)
    at /usr/src-9-stable/sys/netinet/tcp_input.c:1835
#9  0xffffffff80aafa36 in tcp_input (m=0xfffffe006529b800, 
    off0=<value optimized out>)
    at /usr/src-9-stable/sys/netinet/tcp_input.c:1393
#10 0xffffffff80a403ca in ip_input (m=0xfffffe006529b800)
    at /usr/src-9-stable/sys/netinet/ip_input.c:760
#11 0xffffffff809e2578 in netisr_dispatch_src (proto=1, 
    source=<value optimized out>, m=<value optimized out>)
    at /usr/src-9-stable/sys/net/netisr.c:1013
#12 0xffffffff809d920d in ether_demux (ifp=0xfffffe0006050800, 
    m=0xfffffe006529b800) at /usr/src-9-stable/sys/net/if_ethersubr.c:940
#13 0xffffffff809d94e4 in ether_nh_input (m=<value optimized out>)
    at /usr/src-9-stable/sys/net/if_ethersubr.c:759
#14 0xffffffff809e2578 in netisr_dispatch_src (proto=9, 
    source=<value optimized out>, m=<value optimized out>)
    at /usr/src-9-stable/sys/net/netisr.c:1013
#15 0xffffffff804dd248 in em_rxeof (rxr=0xfffffe0006100a00, count=99, 
    done=0x0) at /usr/src-9-stable/sys/dev/e1000/if_em.c:4515
#16 0xffffffff804dd6f8 in em_handle_que (context=<value optimized out>, 
    pending=<value optimized out>)
    at /usr/src-9-stable/sys/dev/e1000/if_em.c:1518
#17 0xffffffff8095f9b4 in taskqueue_run_locked (queue=0xfffffe0006118480)
    at /usr/src-9-stable/sys/kern/subr_taskqueue.c:312
#18 0xffffffff80960966 in taskqueue_thread_loop (arg=<value optimized out>)
    at /usr/src-9-stable/sys/kern/subr_taskqueue.c:501
#19 0xffffffff808e83af in fork_exit (
    callout=0xffffffff80960920 <taskqueue_thread_loop>, 
    arg=0xffffff8000ac6730, frame=0xffffff83428dfc40)
    at /usr/src-9-stable/sys/kern/kern_fork.c:988
#20 0xffffffff80c92d3e in fork_trampoline ()
    at /usr/src-9-stable/sys/amd64/amd64/exception.S:602
#21 0x0000000000000000 in ?? ()
(kgdb) 


--- core.txt from 9.1-RELEASE (r249710) ---

Fatal trap 9: general protection fault while in kernel mode
cpuid = 4; apic id = 32
instruction pointer     = 0x20:0xffffffff8094b595
stack pointer           = 0x28:0xffffff834291c6d0
frame pointer           = 0x28:0xffffff834291c6f0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 0 (em0 que)
trap number             = 9
panic: general protection fault
cpuid = 4
KDB: stack backtrace:
#0 0xffffffff809208a6 at kdb_backtrace+0x66
#1 0xffffffff808ea8be at panic+0x1ce
#2 0xffffffff80bd8240 at trap_fatal+0x290
#3 0xffffffff80bd88d5 at trap+0x105
#4 0xffffffff80bc315f at calltrap+0x8
#5 0xffffffff80a72141 at tcp_do_segment+0x2991
#6 0xffffffff80a73313 at tcp_input+0xa63
#7 0xffffffff80a043dc at ip_input+0xac
#8 0xffffffff809adafb at netisr_dispatch_src+0x20b
#9 0xffffffff809a35cd at ether_demux+0x14d
#10 0xffffffff809a38a4 at ether_nh_input+0x1f4
#11 0xffffffff809adafb at netisr_dispatch_src+0x20b
#12 0xffffffff804ad8ca at em_rxeof+0x1ca
#13 0xffffffff804add48 at em_handle_que+0x48
#14 0xffffffff8092cf55 at taskqueue_run_locked+0x85
#15 0xffffffff8092ded6 at taskqueue_thread_loop+0x46
#16 0xffffffff808bb9ef at fork_exit+0x11f
#17 0xffffffff80bc368e at fork_trampoline+0xe
Uptime: 6h19m5s
Dumping 2649 out of 8160 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%

Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
Reading symbols from /boot/kernel/ipl.ko...Reading symbols from /boot/kernel/ipl.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ipl.ko
Reading symbols from /boot/kernel/accf_http.ko...Reading symbols from /boot/kernel/accf_http.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/accf_http.ko
Reading symbols from /boot/kernel/accf_data.ko...Reading symbols from /boot/kernel/accf_data.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/accf_data.ko
#0  doadump (textdump=Variable "textdump" is not available.
) at pcpu.h:224
224     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) #0  doadump (textdump=Variable "textdump" is not available.
) at pcpu.h:224
#1  0xffffffff808ea3a1 in kern_reboot (howto=260)
    at /usr/src/sys/kern/kern_shutdown.c:448
#2  0xffffffff808ea897 in panic (fmt=0x1 <Address 0x1 out of bounds>)
    at /usr/src/sys/kern/kern_shutdown.c:636
#3  0xffffffff80bd8240 in trap_fatal (frame=0x9, eva=Variable "eva" is not available.
)
    at /usr/src/sys/amd64/amd64/trap.c:857
#4  0xffffffff80bd88d5 in trap (frame=0xffffff834291c620)
    at /usr/src/sys/amd64/amd64/trap.c:599
#5  0xffffffff80bc315f in calltrap ()
    at /usr/src/sys/amd64/amd64/exception.S:228
#6  0xffffffff8094b595 in m_freem (mb=0xcfa96cc23cf42256)
    at /usr/src/sys/kern/uipc_mbuf.c:160
#7  0xffffffff80a72141 in tcp_do_segment (m=0xfffffe001fb67900, 
    th=0xfffffe001fb55022, so=0xfffffe01a66c92a8, tp=0xfffffe01437993d0, 
    drop_hdrlen=52, tlen=0, iptos=0 '\0', ti_locked=1)
    at /usr/src/sys/netinet/tcp_input.c:1697
#8  0xffffffff80a73313 in tcp_input (m=0xfffffe001fb67900, off0=Variable "off0" is not available.
)
    at /usr/src/sys/netinet/tcp_input.c:1387
#9  0xffffffff80a043dc in ip_input (m=0xfffffe001fb67900)
    at /usr/src/sys/netinet/ip_input.c:760
#10 0xffffffff809adafb in netisr_dispatch_src (proto=1, source=Variable "source" is not available.
)
    at /usr/src/sys/net/netisr.c:1013
#11 0xffffffff809a35cd in ether_demux (ifp=0xfffffe0006109000, 
    m=0xfffffe001fb67900) at /usr/src/sys/net/if_ethersubr.c:940
#12 0xffffffff809a38a4 in ether_nh_input (m=Variable "m" is not available.
)
    at /usr/src/sys/net/if_ethersubr.c:759
#13 0xffffffff809adafb in netisr_dispatch_src (proto=9, source=Variable "source" is not available.
)
    at /usr/src/sys/net/netisr.c:1013
#14 0xffffffff804ad8ca in em_rxeof (rxr=0xfffffe0006111400, count=99, 
    done=0x0) at /usr/src/sys/dev/e1000/if_em.c:4502
#15 0xffffffff804add48 in em_handle_que (context=Variable "context" is not available.
)
    at /usr/src/sys/dev/e1000/if_em.c:1509
#16 0xffffffff8092cf55 in taskqueue_run_locked (queue=0xfffffe0006115880)
    at /usr/src/sys/kern/subr_taskqueue.c:308
#17 0xffffffff8092ded6 in taskqueue_thread_loop (arg=Variable "arg" is not available.
)
    at /usr/src/sys/kern/subr_taskqueue.c:497
#18 0xffffffff808bb9ef in fork_exit (
    callout=0xffffffff8092de90 <taskqueue_thread_loop>, 
    arg=0xffffff8000ac9740, frame=0xffffff834291cc40)
    at /usr/src/sys/kern/kern_fork.c:992
#19 0xffffffff80bc368e in fork_trampoline ()
    at /usr/src/sys/amd64/amd64/exception.S:602
#20 0x0000000000000000 in ?? ()
#21 0x0000000000000000 in ?? ()
#22 0x0000000000000000 in ?? ()
#23 0x0000000000000000 in ?? ()
#24 0x0000000000000000 in ?? ()
#25 0x0000000000000000 in ?? ()
#26 0x0000000000000000 in ?? ()
#27 0x0000000000000000 in ?? ()
#28 0x0000000000000000 in ?? ()
#29 0x0000000000000000 in ?? ()
#30 0x0000000000000000 in ?? ()
#31 0x0000000000000000 in ?? ()
#32 0x0000000000000000 in ?? ()
#33 0x0000000000000000 in ?? ()
#34 0x0000000000000000 in ?? ()
#35 0x0000000000000000 in ?? ()
#36 0x0000000000000000 in ?? ()
#37 0x0000000000000000 in ?? ()
#38 0x0000000000000000 in ?? ()
#39 0x0000000000000000 in ?? ()
#40 0x0000000000000000 in ?? ()
#41 0x0000000000000000 in ?? ()
#42 0x0000000000000000 in ?? ()
#43 0x0000000000000000 in ?? ()
#44 0x0000000000000004 in ?? ()
#45 0xffffffff81242c00 in tdq_cpu ()
#46 0xfffffe0003c4f000 in ?? ()
#47 0x0000000000000000 in ?? ()
#48 0xffffff834291caf0 in ?? ()
#49 0xffffff834291ca98 in ?? ()
#50 0xfffffe0003a7b000 in ?? ()
#51 0xffffffff8091352e in sched_switch (td=0x0, newtd=0xffffff8000ac9740, 
    flags=Variable "flags" is not available.
) at /usr/src/sys/kern/sched_ule.c:1921
Previous frame inner to this frame (corrupt stack?)
(kgdb) 

>How-To-Repeat:
Unknown. This system is typically under a moderate load of web, mail, and DNS traffic.
>Fix:


>Release-Note:
>Audit-Trail:
>Unformatted:



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?201304241920.r3OJKgOD038024>