From owner-freebsd-stable@freebsd.org Sun Nov 20 11:11:17 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 38FFCC4B0B8 for ; Sun, 20 Nov 2016 11:11:17 +0000 (UTC) (envelope-from kamisouckova@gmail.com) Received: from mail-wm0-x243.google.com (mail-wm0-x243.google.com [IPv6:2a00:1450:400c:c09::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D7367B59 for ; Sun, 20 Nov 2016 11:11:16 +0000 (UTC) (envelope-from kamisouckova@gmail.com) Received: by mail-wm0-x243.google.com with SMTP id m203so18546168wma.3 for ; Sun, 20 Nov 2016 03:11:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:from:date:message-id:subject:to:cc :content-transfer-encoding; bh=MoOxq38KOU1AHxDGZZRLEFgyPM8OdRpSnKY3d7cMY7Q=; b=Wz6si+1GZxI/JqqwhOR+YU8YRB42lnmeBfQRivVrAarR9T9/j63oR7SbKX7WD97mpQ 09L2jQU3/W+yTTXB8O2MrxoVtQ3ICkixo4JOTAp7/2QjTII59R5X51+Fe29d5uZUcWsM qVeabNWM2MCWtFAdD8JPSHK1gpHJf2W9xz/2JGFSyZceLwK6hbs60822TY6rv0UpaBOf az7S/A7IV3Unb1uSSjkZgbSB6rI2mNc6xK7hocnrpdq8vKt91dPZfC8L3XDKQhEw+rrn 2gmuStcIL6dzRtnHLgIKNFPydPauqOVSQxQAKD2Ou/Tp+LMzNuYr14Gjs/+M1ePm7fpC RQRA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:from:date:message-id:subject :to:cc:content-transfer-encoding; bh=MoOxq38KOU1AHxDGZZRLEFgyPM8OdRpSnKY3d7cMY7Q=; b=WhyTlF8eUsr7W0A9rTwSPh/mp0aYaLy8NdUkrOFwFEmCLGapYAcx1aTkj+QqWNyLzY 0Ite5/Ne1tif+ckAYiXa1gbHffkL7M3LR/Klxeq+3u4IiF+xWbwL4RJZ4imtUd3Uo3P/ TuBRsRNuNhv2VTNbDW7Wmf+em+35ctOqr26CM38nyUXHtnppQRLRMR1DBs0vm5IS24Db GDi1hpA4stR5IouyyFMwzgiCyzufKcFxTycFi3BYuLB+BQGRcK6DnKr3w4Dbyj3SNGfJ 36G3vOKAWgC6OLQ55KfrZQO3s1b1p48ZvRxPgiSkCs8AsqzbGwF3Jte3H7VVfdsqkVeh jLaw== X-Gm-Message-State: AKaTC02EpyrypamH+gSn2AqfJzryRm9td4TF5U5PbhKE89Q6VCTyURAVKx5sUM6ze6QgCP6mPLM+QSxa+HItHw== X-Received: by 10.28.12.80 with SMTP id 77mr8188966wmm.106.1479640274882; Sun, 20 Nov 2016 03:11:14 -0800 (PST) MIME-Version: 1.0 Sender: kamisouckova@gmail.com Received: by 10.194.29.101 with HTTP; Sun, 20 Nov 2016 03:10:54 -0800 (PST) From: =?UTF-8?B?S2FtaWxhIFNvdcSNa292w6E=?= Date: Sun, 20 Nov 2016 12:10:54 +0100 X-Google-Sender-Auth: w0DJpghzfh1vYn1cAjm5kvKfqD8 Message-ID: Subject: VNET + pf => panic [Was: Panic when tearing down a VNET jail; pf mentioned in stack trace] To: freebsd-stable@freebsd.org Cc: =?UTF-8?B?UmljaGFyZCBLcsOhbG92acSN?= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 Nov 2016 11:11:17 -0000 Hello, I had another panic, this time not related to stopping a jail, but also mentioning pf in the stack trace. Therefore the previously mentioned correlation was not causation -- this crash must be connected with simply combining pf and VNET, not with tearing down the VNET interface. I had two crashes in about one hour. I then put `set skip on vnet0:1` in pf.conf, and have not seen a panic since then, even with relatively heavy network traffic (continous 60Mbit/s since my last email, and an evening of 1Gbit/s). The second stack trace follows: Nov 19 15:19:04 oresme kernel: Fatal trap 12: page fault while in kernel mo= de Nov 19 15:19:04 oresme kernel: cpuid =3D 1; apic id =3D 01 Nov 19 15:19:04 oresme kernel: fault virtual address =3D 0x400 Nov 19 15:19:04 oresme kernel: fault code =3D supervisor write data, page not present Nov 19 15:19:04 oresme kernel: instruction pointer =3D 0x20:0xffffffff8263eaa1 Nov 19 15:19:04 oresme kernel: stack pointer =3D 0x28:0xfffffe085315c870 Nov 19 15:19:04 oresme kernel: frame pointer =3D 0x28:0xfffffe085315c8e0 Nov 19 15:19:04 oresme kernel: code segment =3D base 0x0, limit 0xfffff, type 0x1b Nov 19 15:19:04 oresme kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1 Nov 19 15:19:04 oresme kernel: processor eflags =3D interrupt enabled, resume, IOPL =3D 0 Nov 19 15:19:04 oresme kernel: current process =3D 477 (pf purge) Nov 19 15:19:04 oresme kernel: trap number =3D 12 Nov 19 15:19:04 oresme kernel: panic: page fault Nov 19 15:19:04 oresme kernel: cpuid =3D 1 Nov 19 15:19:04 oresme kernel: KDB: stack backtrace: Nov 19 15:19:04 oresme kernel: #0 0xffffffff80aa8787 at kdb_backtrace+0x67 Nov 19 15:19:04 oresme kernel: #1 0xffffffff80a5d632 at vpanic+0x182 Nov 19 15:19:04 oresme kernel: #2 0xffffffff80a5d4a3 at panic+0x43 Nov 19 15:19:04 oresme kernel: #3 0xffffffff80f3cd51 at trap_fatal+0x351 Nov 19 15:19:04 oresme kernel: #4 0xffffffff80f3cf43 at trap_pfault+0x1e3 Nov 19 15:19:04 oresme kernel: #5 0xffffffff80f3c4ec at trap+0x26c Nov 19 15:19:04 oresme kernel: #6 0xffffffff80f1f521 at calltrap+0x8 Nov 19 15:19:04 oresme kernel: #7 0xffffffff8263e32d at pf_purge_expired_states+0x12d Nov 19 15:19:04 oresme kernel: #8 0xffffffff8263e1bb at pf_purge_thread+0x1= 3b Nov 19 15:19:04 oresme kernel: #9 0xffffffff80a13e85 at fork_exit+0x85 Nov 19 15:19:04 oresme kernel: #10 0xffffffff80f1fa5e at fork_trampoline+0x= e Do you need any other information? Thanks! Kamila On Sat, Nov 19, 2016 at 3:01 PM, Kamila Sou=C4=8Dkov=C3=A1 = wrote: > Hello, > > (if this is not the right mailing list, please reroute this email -- I > am not sure where to post VNET-related stuff.) > > I experienced a panic when stopping an iocage-managed jail with VNET. > Some information: > > - The host (which is a physical machine) panicked after calling `iocage s= top`. > - The host has pf enabled and active, the jail does not. > - The standard iocage configuration for VNET is used, i.e. the host > part of the epair device is bridged to the local network. > - It has only happened to me once in about 10 tries, so I assume it > must be a race condition. > - The stack trace is attached below. > > What could be the problem? How can I help debug it? (I do not know > anything about FreeBSD internals, yet.) > > Thank you! > > Kamila > > ------------------------------------------- > > trace: > > Nov 19 14:12:04 oresme kernel: Fatal trap 12: page fault while in kernel = mode > Nov 19 14:12:04 oresme kernel: cpuid =3D 5; apic id =3D 05 > Nov 19 14:12:04 oresme kernel: fault virtual address =3D 0x420 > Nov 19 14:12:04 oresme kernel: fault code =3D supervisor > read data, page not present > Nov 19 14:12:04 oresme kernel: instruction pointer =3D > 0x20:0xffffffff826657a9 > Nov 19 14:12:04 oresme kernel: stack pointer =3D > 0x28:0xfffffe0852d63340 > Nov 19 14:12:04 oresme kernel: frame pointer =3D > 0x28:0xfffffe0852d633b0 > Nov 19 14:12:04 oresme kernel: code segment =3D base 0x0, > limit 0xfffff, type 0x1b > Nov 19 14:12:04 oresme kernel: =3D DPL 0, pres 1, long 1, def32 0, gran 1 > Nov 19 14:12:04 oresme kernel: processor eflags =3D interrupt enabled, > resume, IOPL =3D 0 > Nov 19 14:12:04 oresme kernel: current process =3D 12 (irq272: > igb1:que 1) > Nov 19 14:12:04 oresme kernel: trap number =3D 12 > Nov 19 14:12:04 oresme kernel: panic: page fault > Nov 19 14:12:04 oresme kernel: cpuid =3D 5 > Nov 19 14:12:04 oresme kernel: KDB: stack backtrace: > Nov 19 14:12:04 oresme kernel: #0 0xffffffff80aa8787 at kdb_backtrace+0x6= 7 > Nov 19 14:12:04 oresme kernel: #1 0xffffffff80a5d632 at vpanic+0x182 > Nov 19 14:12:04 oresme kernel: #2 0xffffffff80a5d4a3 at panic+0x43 > Nov 19 14:12:04 oresme kernel: #3 0xffffffff80f3cd51 at trap_fatal+0x351 > Nov 19 14:12:04 oresme kernel: #4 0xffffffff80f3cf43 at trap_pfault+0x1e3 > Nov 19 14:12:04 oresme kernel: #5 0xffffffff80f3c4ec at trap+0x26c > Nov 19 14:12:04 oresme kernel: #6 0xffffffff80f1f521 at calltrap+0x8 > Nov 19 14:12:04 oresme kernel: #7 0xffffffff82641acc at pf_test+0xfdc > Nov 19 14:12:04 oresme kernel: #8 0xffffffff8265408d at pf_check_in+0x1d > Nov 19 14:12:04 oresme kernel: #9 0xffffffff80b820f3 at pfil_run_hooks+0x= 83 > Nov 19 14:12:04 oresme kernel: #10 0xffffffff80be9a5f at ip_input+0x42f > Nov 19 14:12:04 oresme kernel: #11 0xffffffff80b8107f at > netisr_dispatch_src+0xff > Nov 19 14:12:04 oresme kernel: #12 0xffffffff80b6915a at ether_demux+0x13= a > Nov 19 14:12:04 oresme kernel: #13 0xffffffff80b69e75 at ether_nh_input+0= x345 > Nov 19 14:12:04 oresme kernel: #14 0xffffffff80b8107f at > netisr_dispatch_src+0xff > Nov 19 14:12:04 oresme kernel: #15 0xffffffff80b69414 at ether_input+0x54 > Nov 19 14:12:04 oresme kernel: #16 0xffffffff80553b9c at igb_rxeof+0x7fc > Nov 19 14:12:04 oresme kernel: #17 0xffffffff80552def at igb_msix_que+0x1= 8f