From owner-freebsd-net@FreeBSD.ORG Sat Jan 24 23:11:44 2015 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E978AF89 for ; Sat, 24 Jan 2015 23:11:43 +0000 (UTC) Received: from mail-ie0-x229.google.com (mail-ie0-x229.google.com [IPv6:2607:f8b0:4001:c03::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A8B5AE97 for ; Sat, 24 Jan 2015 23:11:43 +0000 (UTC) Received: by mail-ie0-f169.google.com with SMTP id rl12so3250097iec.0 for ; Sat, 24 Jan 2015 15:11:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=bvFYCB3BPsUzfpAt+brkKHQ+iOcws3odgafB0D1Cdhg=; b=zoGPGabRl7+ZLXgHADIThHb0vyvMYCNJP07ZVXLY4HGZj5yw8W7BdDDZ/7eaNpgMCd 0Wl6EDVWvbrd5STDV5+HXYhiHUlElHVMq5QGuEUiFbzToofbs6dXP+YrUreOexPR1nZa 1nZlu3Hxki2GsSTSq5n3U70Thraoy4N+hwbSmXQiszAAKZ6nlQqwMlg+8jj+OfAwYWCw nruzjSGcWC0FOtgiJGjIJnY7fImwMOJySlFUawxGdryoGWP7Sg5Z79NdtL5lJxMQW6L9 ue5tbZTCIjH9MfKg9+o3vicdFIex+SmkjrfOMmQpEn/y6QjKVB6kpkhXDjiZfaqzszS8 sMWQ== MIME-Version: 1.0 X-Received: by 10.50.107.7 with SMTP id gy7mr9222198igb.49.1422141103050; Sat, 24 Jan 2015 15:11:43 -0800 (PST) Sender: adrian.chadd@gmail.com Received: by 10.36.78.14 with HTTP; Sat, 24 Jan 2015 15:11:42 -0800 (PST) In-Reply-To: <81FCF115-3EE7-4902-9F9A-4852B59348AC@gmail.com> References: <5B08402C-67A7-49E7-ADF8-390C94DCF1D7@gmail.com> <6B125546-E095-4A4C-9B6B-7E80D1D6E8EF@gmail.com> <81FCF115-3EE7-4902-9F9A-4852B59348AC@gmail.com> Date: Sat, 24 Jan 2015 15:11:42 -0800 X-Google-Sender-Auth: nytuXNG6ara9zP8rMOVAefS69h4 Message-ID: Subject: Re: network locks up with udp traffic From: Adrian Chadd To: Dmitry Sivachenko Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: FreeBSD Net X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Jan 2015 23:11:44 -0000 ok, cool. You definitely have enough for a freebsd bug report. Would you mind adding it? https://bugs.freebsd.org/submit/ -a On 24 January 2015 at 15:07, Dmitry Sivachenko wrote: > >> On 25 =D1=8F=D0=BD=D0=B2. 2015 =D0=B3., at 1:45, Dmitry Sivachenko wrote: >> >> >>> On 25 =D1=8F=D0=BD=D0=B2. 2015 =D0=B3., at 0:10, Adrian Chadd wrote: >>> >>> Ah, try adding STACK to your config? >>> >> >> >> It's already there. > > > Ah, sorry, it is options DDB that was missing. Now we have full stack: > > > lock order reversal: > 1st 0xffffffff80ea5588 pcbinfohash (pcbinfohash) @ /opt/WRK/src/sys/neti= net6/ud > p6_usrreq.c:1202 > 2nd 0xffffffff80ea5530 udp (udp) @ /opt/WRK/src/sys/netinet6/in6_pcb.c:6= 14 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0c581= c1270 > kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0c581c1320 > witness_checkorder() at witness_checkorder+0xc04/frame 0xfffffe0c581c13a0 > _rw_wlock_cookie() at _rw_wlock_cookie+0x45/frame 0xfffffe0c581c13e0 > in6_pcbnotify() at in6_pcbnotify+0x12e/frame 0xfffffe0c581c1480 > udp6_common_ctlinput() at udp6_common_ctlinput+0x111/frame 0xfffffe0c581c= 14e0 > pfctlinput2() at pfctlinput2+0x7d/frame 0xfffffe0c581c1520 > ip6_output() at ip6_output+0x15b8/frame 0xfffffe0c581c1780 > udp6_send() at udp6_send+0x75c/frame 0xfffffe0c581c1910 > sosend_dgram() at sosend_dgram+0x30b/frame 0xfffffe0c581c1980 > kern_sendit() at kern_sendit+0x191/frame 0xfffffe0c581c1a30 > sendit() at sendit+0x225/frame 0xfffffe0c581c1a80 > sys_sendmsg() at sys_sendmsg+0x68/frame 0xfffffe0c581c1ae0 > amd64_syscall() at amd64_syscall+0x244/frame 0xfffffe0c581c1bf0 > Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0c581c1bf0 > --- syscall (28, FreeBSD ELF64, sys_sendmsg), rip =3D 0x803ec5eaa, rsp = =3D 0x7fffdf5f6848, rbp =3D 0x7fffdf5f6880 --- > > > lock order reversal: > 1st 0xffffffff80ea5588 pcbinfohash (pcbinfohash) @ /opt/WRK/src/sys/neti= net6/udp6_usrreq.c:1202 > 2nd 0xffffffff80ea52d8 tcp (tcp) @ /opt/WRK/src/sys/netinet6/in6_pcb.c:6= 14 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0c581= c1240 > kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0c581c12f0 > witness_checkorder() at witness_checkorder+0xc04/frame 0xfffffe0c581c1370 > _rw_wlock_cookie() at _rw_wlock_cookie+0x45/frame 0xfffffe0c581c13b0 > in6_pcbnotify() at in6_pcbnotify+0x12e/frame 0xfffffe0c581c1450 > tcp6_ctlinput() at tcp6_ctlinput+0x1a5/frame 0xfffffe0c581c14e0 > pfctlinput2() at pfctlinput2+0x7d/frame 0xfffffe0c581c1520 > ip6_output() at ip6_output+0x15b8/frame 0xfffffe0c581c1780 > udp6_send() at udp6_send+0x75c/frame 0xfffffe0c581c1910 > sosend_dgram() at sosend_dgram+0x30b/frame 0xfffffe0c581c1980 > kern_sendit() at kern_sendit+0x191/frame 0xfffffe0c581c1a30 > sendit() at sendit+0x225/frame 0xfffffe0c581c1a80 > sys_sendmsg() at sys_sendmsg+0x68/frame 0xfffffe0c581c1ae0 > amd64_syscall() at amd64_syscall+0x244/frame 0xfffffe0c581c1bf0 > Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0c581c1bf0 > --- syscall (28, FreeBSD ELF64, sys_sendmsg), rip =3D 0x803ec5eaa, rsp = =3D 0x7fffdf5f6848, rbp =3D 0x7fffdf5f6880 --- > > > > lock order reversal: > 1st 0xffffffff80ea5588 pcbinfohash (pcbinfohash) @ /opt/WRK/src/sys/neti= net6/udp6_usrreq.c:1202 > 2nd 0xffffffff80ea4740 rip (rip) @ /opt/WRK/src/sys/netinet6/in6_pcb.c:6= 14 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0c581= c12b0 > kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0c581c1360 > witness_checkorder() at witness_checkorder+0xc04/frame 0xfffffe0c581c13e0 > _rw_wlock_cookie() at _rw_wlock_cookie+0x45/frame 0xfffffe0c581c1420 > in6_pcbnotify() at in6_pcbnotify+0x12e/frame 0xfffffe0c581c14c0 > rip6_ctlinput() at rip6_ctlinput+0x70/frame 0xfffffe0c581c14e0 > pfctlinput2() at pfctlinput2+0x7d/frame 0xfffffe0c581c1520 > ip6_output() at ip6_output+0x15b8/frame 0xfffffe0c581c1780 > udp6_send() at udp6_send+0x75c/frame 0xfffffe0c581c1910 > sosend_dgram() at sosend_dgram+0x30b/frame 0xfffffe0c581c1980 > kern_sendit() at kern_sendit+0x191/frame 0xfffffe0c581c1a30 > sendit() at sendit+0x225/frame 0xfffffe0c581c1a80 > sys_sendmsg() at sys_sendmsg+0x68/frame 0xfffffe0c581c1ae0 > amd64_syscall() at amd64_syscall+0x244/frame 0xfffffe0c581c1bf0 > Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0c581c1bf0 > --- syscall (28, FreeBSD ELF64, sys_sendmsg), rip =3D 0x803ec5eaa, rsp = =3D 0x7fffdf5f6848, rbp =3D 0x7fffdf5f6880 ---