From owner-freebsd-current@freebsd.org Mon Apr 22 13:28:37 2019 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6B4F61599FCF; Mon, 22 Apr 2019 13:28:37 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 026EF8A7B3; Mon, 22 Apr 2019 13:28:37 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "smtp.codepro.be", Issuer "Let's Encrypt Authority X3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 98E81FAD7; Mon, 22 Apr 2019 13:28:36 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from [137.50.17.195] (unknown [IPv6:2001:630:42:110:d1ea:c255:f4:4af0]) (Authenticated sender: kp) by venus.codepro.be (Postfix) with ESMTPSA id B112331010; Mon, 22 Apr 2019 15:28:34 +0200 (CEST) From: "Kristof Provost" To: "Enji Cooper" Cc: "Hans Petter Selasky" , src-committers , svn-src-all , svn-src-head , "FreeBSD CURRENT" Subject: Re: Panic with r346530 [Re: svn commit: r346530 - in head/sys: netinet netinet6] Date: Mon, 22 Apr 2019 14:28:31 +0100 X-Mailer: MailMate (2.0BETAr6135) Message-ID: <1342BBD2-EE0F-4457-8752-659EA7F01725@FreeBSD.org> In-Reply-To: <8EAC0CFE-E22F-478F-813F-A07E68C0518D@gmail.com> References: <201904220727.x3M7ROpR009729@repo.freebsd.org> <2F3D6B17-AF4F-4B0F-B20E-5EF41DE851F9@gmail.com> <87917500-0381-79d8-a34b-819848abed32@selasky.org> <8EAC0CFE-E22F-478F-813F-A07E68C0518D@gmail.com> MIME-Version: 1.0 X-Rspamd-Queue-Id: 026EF8A7B3 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.95 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.95)[-0.954,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Apr 2019 13:28:37 -0000 On 22 Apr 2019, at 12:25, Enji Cooper wrote: > Either the sys/netinet/ or sys/netipsec/ tests triggered the panic. > Not sure which right now. > That looks to be happening during a vnet jail teardown, so it’s likely the sys/netipsec or sys/netpfil/pf tests. I’ve done a quick test with the pf tests, and they provoke this panic: panic: mtx_lock() of destroyed mutex @ /usr/src/sys/netinet/ip_reass.c:628 cpuid = 0 time = 1555939645 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0091d68530 vpanic() at vpanic+0x19d/frame 0xfffffe0091d68580 panic() at panic+0x43/frame 0xfffffe0091d685e0 __mtx_lock_flags() at __mtx_lock_flags+0x12e/frame 0xfffffe0091d68630 ipreass_cleanup() at ipreass_cleanup+0x86/frame 0xfffffe0091d68670 if_detach_internal() at if_detach_internal+0x786/frame 0xfffffe0091d686f0 if_detach() at if_detach+0x3d/frame 0xfffffe0091d68710 lo_clone_destroy() at lo_clone_destroy+0x16/frame 0xfffffe0091d68730 if_clone_destroyif() at if_clone_destroyif+0x21f/frame 0xfffffe0091d68780 if_clone_detach() at if_clone_detach+0xb8/frame 0xfffffe0091d687b0 vnet_loif_uninit() at vnet_loif_uninit+0x26/frame 0xfffffe0091d687d0 vnet_destroy() at vnet_destroy+0x124/frame 0xfffffe0091d68800 prison_deref() at prison_deref+0x29d/frame 0xfffffe0091d68840 sys_jail_remove() at sys_jail_remove+0x28f/frame 0xfffffe0091d68890 amd64_syscall() at amd64_syscall+0x276/frame 0xfffffe0091d689b0 fast_syscall_common() at fast_syscall_common+0x101/frame 0xfffffe0091d689b0 --- syscall (508, FreeBSD ELF64, sys_jail_remove), rip = 0x80031e12a, rsp = 0x7fffffffe848, rbp = 0x7fffffffe8d0 --- KDB: enter: panic [ thread pid 1223 tid 100501 ] Stopped at kdb_enter+0x3b: movq $0,kdb_why db> To reproduce: kldload pfsync cd /usr/tests/sys/netpfil/pf sudo kyua test Regards, Kristof From owner-freebsd-current@freebsd.org Mon Apr 22 19:30:54 2019 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6427A15808BA; Mon, 22 Apr 2019 19:30:54 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E4AE072FDF; Mon, 22 Apr 2019 19:30:53 +0000 (UTC) (envelope-from hps@selasky.org) Received: from hps2016.home.selasky.org (unknown [176.74.212.121]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 879BA26046D; Mon, 22 Apr 2019 21:30:51 +0200 (CEST) Subject: Re: Panic with r346530 [Re: svn commit: r346530 - in head/sys: netinet netinet6] To: Kristof Provost , Enji Cooper Cc: src-committers , svn-src-all , svn-src-head , FreeBSD CURRENT References: <201904220727.x3M7ROpR009729@repo.freebsd.org> <2F3D6B17-AF4F-4B0F-B20E-5EF41DE851F9@gmail.com> <87917500-0381-79d8-a34b-819848abed32@selasky.org> <8EAC0CFE-E22F-478F-813F-A07E68C0518D@gmail.com> <1342BBD2-EE0F-4457-8752-659EA7F01725@FreeBSD.org> From: Hans Petter Selasky Message-ID: <89bdecf9-970e-f571-a94d-b4ceaea18368@selasky.org> Date: Mon, 22 Apr 2019 21:30:24 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: <1342BBD2-EE0F-4457-8752-659EA7F01725@FreeBSD.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: E4AE072FDF X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-6.97 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.97)[-0.971,0]; REPLY(-4.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Apr 2019 19:30:54 -0000 On 4/22/19 3:28 PM, Kristof Provost wrote: > On 22 Apr 2019, at 12:25, Enji Cooper wrote: >> Either the sys/netinet/ or sys/netipsec/ tests triggered the panic. >> Not sure which right now. >> > That looks to be happening during a vnet jail teardown, so it’s likely > the sys/netipsec or sys/netpfil/pf tests. > > I’ve done a quick test with the pf tests, and they provoke this panic: > >     panic: mtx_lock() of destroyed mutex @ > /usr/src/sys/netinet/ip_reass.c:628 >     cpuid = 0 >     time = 1555939645 >     KDB: stack backtrace: >     db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe0091d68530 >     vpanic() at vpanic+0x19d/frame 0xfffffe0091d68580 >     panic() at panic+0x43/frame 0xfffffe0091d685e0 >     __mtx_lock_flags() at __mtx_lock_flags+0x12e/frame 0xfffffe0091d68630 >     ipreass_cleanup() at ipreass_cleanup+0x86/frame 0xfffffe0091d68670 >     if_detach_internal() at if_detach_internal+0x786/frame > 0xfffffe0091d686f0 >     if_detach() at if_detach+0x3d/frame 0xfffffe0091d68710 >     lo_clone_destroy() at lo_clone_destroy+0x16/frame 0xfffffe0091d68730 >     if_clone_destroyif() at if_clone_destroyif+0x21f/frame > 0xfffffe0091d68780 >     if_clone_detach() at if_clone_detach+0xb8/frame 0xfffffe0091d687b0 >     vnet_loif_uninit() at vnet_loif_uninit+0x26/frame 0xfffffe0091d687d0 >     vnet_destroy() at vnet_destroy+0x124/frame 0xfffffe0091d68800 >     prison_deref() at prison_deref+0x29d/frame 0xfffffe0091d68840 >     sys_jail_remove() at sys_jail_remove+0x28f/frame 0xfffffe0091d68890 >     amd64_syscall() at amd64_syscall+0x276/frame 0xfffffe0091d689b0 >     fast_syscall_common() at fast_syscall_common+0x101/frame > 0xfffffe0091d689b0 >     --- syscall (508, FreeBSD ELF64, sys_jail_remove), rip = > 0x80031e12a, rsp = 0x7fffffffe848, rbp = 0x7fffffffe8d0 --- >     KDB: enter: panic >     [ thread pid 1223 tid 100501 ] >     Stopped at      kdb_enter+0x3b: movq    $0,kdb_why >     db> > > To reproduce: > >     kldload pfsync >     cd /usr/tests/sys/netpfil/pf >     sudo kyua test > I'll revert r346530 until further testing has taken place. Thank you! --HPS