From owner-freebsd-pf@freebsd.org Thu Mar 1 09:53:03 2018 Return-Path: Delivered-To: freebsd-pf@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1C5EAF2F6F4 for ; Thu, 1 Mar 2018 09:53:03 +0000 (UTC) (envelope-from Joe@stream-technologies.com) Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0605.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe1f::605]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 578C478E7B for ; Thu, 1 Mar 2018 09:53:02 +0000 (UTC) (envelope-from Joe@stream-technologies.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=streamtechnologiesuk.onmicrosoft.com; s=selector1-streamtechnologies-com01e; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=2McBP/MOG7dN+62pEOsIn0mpomMhzOePNcZDP54+HCc=; b=R7CVYINH27nXlsP2SlXqFqkgPkpGYw74J8rfUOoAwGZssgvb9mNuelrHwP1azA/bRUDF7IgAPPfwAxYB2JE8RvrNlUaosyAcY9c3KphbWIs/XkfLEOucWCjZ8Tnawz+8rwiRTuqqUMUmpn6SozwGrtApq4ekBUSXHfF1Dad9Ru0= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Joe@stream-technologies.com; Received: from [192.168.6.128] (212.250.79.109) by AM4PR07MB3412.eurprd07.prod.outlook.com (2603:10a6:205:a::33) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.548.6; Thu, 1 Mar 2018 09:52:58 +0000 Subject: Re: Kernel Panic To: Kristof Provost Cc: freebsd-pf@freebsd.org References: <5A842FC6.7020806@stream-technologies.com> <5A8443BF.8040208@stream-technologies.com> <5289570D-24E1-4292-B4D2-D2F67D7D2D4F@sigsegv.be> <5A93EDC9.7020407@stream-technologies.com> <9F39A687-FB34-4984-B969-5264DF38544E@sigsegv.be> <19aedb50-34c0-417d-fc1e-e8d519655684@stream-technologies.com> <22A6028C-9BBA-4117-8734-D976EA5A1367@sigsegv.be> <06755C0B-4633-4FF7-988B-97A0A04D4EF6@sigsegv.be> From: Joe Jones Message-ID: Date: Thu, 1 Mar 2018 09:52:56 +0000 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <06755C0B-4633-4FF7-988B-97A0A04D4EF6@sigsegv.be> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Originating-IP: [212.250.79.109] X-ClientProxiedBy: CWXP265CA0024.GBRP265.PROD.OUTLOOK.COM (2603:10a6:400:2e::36) To AM4PR07MB3412.eurprd07.prod.outlook.com (2603:10a6:205:a::33) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 66349f38-75a3-4a4a-4a84-08d57f5a371a X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(5600026)(4604075)(2017052603307)(7153060)(7193020); SRVR:AM4PR07MB3412; X-Microsoft-Exchange-Diagnostics: 1; AM4PR07MB3412; 3:DL5KYYT8PijYkPIumEzonZ6QY/QFPwiXIj7IeJ/CMiy1yQ6nBQMutBE94bDi+DvGc4nUdeRL90Utmgb/TiQiPdlynqk4H7OzI1H0nYB4W7GW6OffBgStMUyclRz3dRNnS5Tz7mKzV/ydXpkc/yDQL9Y45Zn5kf+81KBSgxJqgX5S4nLsi2Vi++jzPa/bWPflRr15zbm/tSDugO26Cp6ifcDqk6vHJVBwjsAhcxw2towj6/iXUdFDv+UVsvZSvX7Y; 25:Z5wIuuYnSoH631dZmUzwY3h6XHEV/NZaPT3Q74dKTS+ueS5iB3JmUXTh2BuCS+QFuYQzzfoDzCgCglBtd92HRTGREWEvNdBqZdzURbdC+7z4/cRX9kbOuljbhHn2eiDO+QYACLtoeBxAATt5W8ibFOlVYdi87Lg9ScNqdulND8GLGj/gQRtDuTxgMyQJghiDZ1W/ylAawSVvzPxjANj6e+NMk3N2wSEpNsIIQ8/QVTRCro0gddXd2ND+hK7UwXLHPD9ISEfe00e9lVywWqI4muPvVCrPxWfdhoS5d1RGEDmfTkXUZFtSo/2NUdDVhe2Nx1ot+xxlaASzSLR4F0KOzA==; 31:A2xn8w6UyfobqTiMk0N/GENZKo9eVtfbaBPs0MtIpyBRFnZxTwtLnhGTeAm9jfe5CYC4yIZAGUfqcL+4ropK4HgquPucw2d4YWoZ2WpyPO3ds9H0GBiaQoFPgiaBjJ7I+FqtcorFQSboF714pdBqY8GoBX8e3d9hyYEgLGKE0+igru3FZjoLvb5X1IB8YLjI73Pu6lVl1RX49LYPHiOR8WQaz/0psmIpkVz55tucIWw= X-MS-TrafficTypeDiagnostic: AM4PR07MB3412: X-Microsoft-Exchange-Diagnostics: 1; AM4PR07MB3412; 20:Y1W/Z4i1nXbb7xd6sE/z7bT0b9j9G3xCfK8Img5q/we9LWTvWvchroSkDmv/LxlVBZRRPUNMXsGQJCFCbSZ/EAeZUXzo6M/CsP+kVszwsQ9hFJ1KCV9w3Wg01d7tzXDxS1bReEDJPeiFuODHCOy1EryP7e3cuV3NeqXU5dIk5Sg=; 4:alinWgRdj66+JSYWPTzRFSEdyZDhSrt6AqLw2JogFkZF9JwqIksDdoXDTH+3bBQWFIVKDAXfCVxcrid100ZYhwl3E+vyflg7lup0V+X6Po1eJUCWiMoAl61LlW1IrDC8jbUFZMmROaJqJJuxV0q3YyssACrYjgxAAvYvoisYW7PVageF6ZySHSqayvJuFv/6fos60IVnEIcqBRyyUbASRdPFc0mff8D9vDIiFirYDYjrilt/WcLbGjWEkIkoZb01A/VHlnD1SZ6ja8IlOXcflA== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040501)(2401047)(5005006)(8121501046)(3231220)(944501226)(93006095)(93001095)(10201501046)(3002001)(6041288)(20161123560045)(20161123558120)(20161123562045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123564045)(6072148)(201708071742011); SRVR:AM4PR07MB3412; BCL:0; PCL:0; RULEID:; SRVR:AM4PR07MB3412; X-Forefront-PRVS: 05986C03E0 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6049001)(39380400002)(346002)(39840400004)(376002)(366004)(396003)(199004)(189003)(59450400001)(2906002)(8676002)(81156014)(81166006)(67846002)(4326008)(221733001)(106356001)(47776003)(386003)(53546011)(52146003)(23676004)(229853002)(3480700004)(6916009)(2950100002)(117156002)(8936002)(80792005)(97736004)(65956001)(76176011)(86362001)(53936002)(6116002)(3846002)(65806001)(68736007)(7116003)(5660300001)(6246003)(7736002)(26005)(36756003)(478600001)(93886005)(72206003)(105586002)(186003)(66066001)(305945005)(2870700001)(6486002)(50466002)(64126003)(77096007)(25786009)(31696002)(65826007)(58126008)(316002)(52116002)(16526019)(16576012)(31686004)(2486003); DIR:OUT; SFP:1101; SCL:1; SRVR:AM4PR07MB3412; H:[192.168.6.128]; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: stream-technologies.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtBTTRQUjA3TUIzNDEyOzIzOmw5NEZvWjdtOFQ5NEdEQ3h4Q0JvSXpWdDNH?= =?utf-8?B?WjE1L1VSTTBXTnFPK3MwcE9WR1h0akVFYkVCblRIK0RENENXVHpUeGw0dE12?= =?utf-8?B?ZTF3eHo3US9yN25rRTFaSmw4VWd6bTlGWS9KV3JwdEtuMXR0bGVkY09DRHc5?= =?utf-8?B?cEx1eWcwOXZvcjloSklqWDJqdlEwUDV1OVFSNVMyejNnTEJZWGhkMktzWmNt?= =?utf-8?B?M21mYzFHcndqSWsyUE1RMDdCTzB0cjNtREtxUFpRcURLdlVsRUpac0UwcFM5?= =?utf-8?B?V1ZuRGhHU21RQ2FtOWpwa1Z5c0oxckNYakRzVUc1MGJScTJHWFowRWhKbkNC?= =?utf-8?B?Zk5VUXdmcGlZdmdKbWt0cW1sM3FBbXU3NHdlNDVHR3Vod0g5b0diN0FLWkd4?= =?utf-8?B?MW1waGVWVHNxbFZsc0NGYU0zM2xsK2dINHFTMzFFck1oTFpEL1BKeElXN01s?= =?utf-8?B?YjEySlpWZStaT2RrbWtqWkFWb04zZXNNQ25sd1dndUl4V0prTlRuSnN2b3kz?= =?utf-8?B?RFI1Yk10eUllY3lIbGdGTDlDSkhrSjZ6cDU2K2VpRGtXTlhpQzhncG5OYkZO?= =?utf-8?B?Sk1xV24yUTUxSWxwenNkWDU3bnJ0S3l3eUdGTWlnYVFVb2syZUtjWWpSWFdv?= =?utf-8?B?andLY1hGUUo2d3lkQ1B1S3RzOEpzeGlVQ3RmZDViSWwySXI4RmlGZ050WTRq?= =?utf-8?B?OE1yZXhrY2RmcFNmak5GczFsS29QM1FJaitwVW9rQ3lpdm1xZnIzNjdldFE5?= =?utf-8?B?MFU1azI0ZUxXbDQ0ak4rM3EzVTlmUkhUZVpiMDZ5MEpzekttSkgvT1d0aXZD?= =?utf-8?B?VEU1eEhlWHBXZEh4UkpraGlkdjY2OUY5ZmJCRXhGR3dXeTRrVElMamtLejFx?= =?utf-8?B?ZExmN1Nrb2xDaG5ua3JGdTBlTmxobDgxVTR3RkxRRWZhTFU2cTFabStHaS9T?= =?utf-8?B?cCsyeHp1cUFoeExmalJEbWl2TUdsUUplc2paZVZTOFlEcUZFNW8xSWpKOWM4?= =?utf-8?B?RE9sdTFscnAyblh5SHVXU05UZTNiYUt4THhDNlRMbEl6eUtoZEZTS0hEREVF?= =?utf-8?B?U3RYY1YzZEorcXE0MnBPNy90RktUVzZXMGpuVjlRVWliOGJZSWlORFpwVG1u?= =?utf-8?B?UzFMMmpERkpJYTV0WDQ4VC9XaFAzYmQ4aW0zZHpoOUxCZHNuUWRZT0ZxOUdP?= =?utf-8?B?dXlLNXhEd05OTnJkQUdqVWYzTjdTdUl5N0QzT1NEQkQ2ck1DcGJvQ0lIV096?= =?utf-8?B?SFo0R015NkhCd1ZaU0htY0UrTGxNSEFUOSs1RmM1TkJid3p0Y0hydEhvN0lD?= =?utf-8?B?YkZ2bkp0WGw4WksxejdQSUdZY2dSOXFLUGk0eHhyZyt0Q29rQVpBNm5wYjBu?= =?utf-8?B?SU5EMWZCcFRXTzVPSzJkTUFvd2ZhY0dVYm43QU9zS0RMaFU3cWJrZmdxRHRZ?= =?utf-8?B?RnNXVGZQZzVVSWY2QkczYURvOENBdmNuVGN5MUxtQTQ1SXZDRlRJR2RDb29R?= =?utf-8?B?ZzYzRDJiK2ZHMzQ1NFBYTUV4L0dnb3BHL2xhNCtXZG5EN0huL0tJTFZ3U2hm?= =?utf-8?B?ellaZ1BYVkphejMzOHllS3hxbUNSRlRkaE81OTNZL0ZnMGIyNHhUMVlyV1pP?= =?utf-8?B?ZG1JbXdUZmdzd0w5QWZCNU1vWjNJZ0dsN0p3enA2NThpMjBYaFY1Z040UTB6?= =?utf-8?B?OFBCSlY2SnNRVEs1ZFI2SDk3cml0VHRwZ3JieEFJQ09XUDJJV0l5eGVwMUky?= =?utf-8?B?UW50d1ltMkpoMThxbmJMb0RkWDNpeEV1Z2ltbkwyWmFHQlF6UjFta2RobmFx?= =?utf-8?B?S1JaeGR0UnRRbUkyYitSdFMrUXo1Y3pOelk3WFdTSnlsMmlrME81dEZGRDc0?= =?utf-8?B?SVEwdDVZMktocGVvTFBPR3VTSEZZZVNucnNrZW9OajlscDFjVlN6YVUwTGlp?= =?utf-8?B?U2M1REQxVE5MNEpuVzVSTHhncXZhZWtiZGU1UzFtUzRQUTFmck1KM2ZFUFRt?= =?utf-8?B?UGJaajk4MVluVGl0cjNtb29oVUg1R095RmpaaHlxT1Z3MVJ4SnNwSm55anV6?= =?utf-8?Q?gLPU=3D?= X-Microsoft-Exchange-Diagnostics: 1; AM4PR07MB3412; 6:peXvxFSJh8rc97fkHW26xuAGjVx8tpJ3rIEAWYogBwdeZzXD+F/MjgWGHdoWhr/QAbdVxby+1oAZ9DT7SQa+7PaEcSeZrI7wW9OyaETCr04JP02SJOayjWWe03LVQ9asOwV8lKNlajmN5mj6YPpGwU9gnnbiYXN34ZNOCnRwQcIEAwViXd3Tb9ewUzS5kHQsmoxNCOeQDQCdBYGAaLJLiWF5RCKlussLv36Em4Ew+O6EsIqpdGldFwM6N2oUs+a25amBVJgq6Nl3p7soKulNkZLSjwNANoeRPU41bsEki03qMRr29bc/U+2vOrgPBfgVeJ0dU92UURho0l8vIbcFRGb0e7BWRQPO1oyBnSloLYI=; 5:yL8mZsWF3EF/wkAOp74KDu52pZTJAsYDx390klfHH+qNwrpSeK+oT4gIVyEDJf2COoKo5o/m+1telNgAYLaP+BXZ/JrEwmB/uhnxt5dCj7e/jX2byEhjuAhIQXmeMfLdNXVLUQwnL6a2CYiq6Uc4RQi12PGwco+Yvk4VOVXRgp8=; 24:Zh6srb4dNq3jN5iC9XU8nogftmU4oCRHdz6EkM2wsbtX8qx8G7Ra/Cnc5gyE+DztCHIi+kTb0TPm4fghtGnok5AXvDnUKDTnGwu+uNKS1bk=; 7:vSwuzT8npHqvpgabsSwmAiCPAIurzT827swDDL7KIICCR2ix86BFyYVKihVdOr6j+JLkjqKhxwUFab/V3HbqD1RRFdIhaLrNl1W+NlE/ON0e0k9dWnI1cFsoEC3/CyR9WKwhN6vR/OkSVU0+9s+45B68V+Ml/6Uffty71yS9xHmBjCaZn0JItm/R1D6UQVJnWm2LIRWYZFgRgwvxTMPMFbHZGfMhKo5KgWqBT0ZMwBEV75jlDo6gzVyqvaNxQRzQ SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: stream-technologies.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Mar 2018 09:52:58.9906 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 66349f38-75a3-4a4a-4a84-08d57f5a371a X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 720fa073-5781-43bf-bc14-7bef2603ed21 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR07MB3412 X-BeenThere: freebsd-pf@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Technical discussion and general questions about packet filter \(pf\)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Mar 2018 09:53:03 -0000 Hi Kristof, yes we use pfsync. Yesterday we tried with pfsync switched off, the box still locked up but this time without a panic. We make the DIOCRADDADDRS ioctl on the master and the backup (we use CARPed pairs). Regards Joe Jones On 01/03/18 03:00, Kristof Provost wrote: > On 28 Feb 2018, at 9:52, Kristof Provost wrote: >> On 27 Feb 2018, at 20:40, Joe Jones wrote: >>> we have a kernel panic after compiling with witness and invariant >>> >>> Feb 27 13:49:33 sovapn1 kernel: lock order reversal: >>> Feb 27 13:49:33 sovapn1 kernel: 1st 0xfffffe000fed78b8 pf_idhash >>> (pf_idhash) @ /usr/src/sys/netpfil/pf/pf.c:1078 >>> Feb 27 13:49:33 sovapn1 kernel: 2nd 0xfffff8001e0474a8 pfsync >>> (pfsync) @ /usr/src/sys/netpfil/pf/if_pfsync.c:1667 >> >> That’s a lock order reversal. It’s not good, but it should at worst >> result in a deadlock. Did the system stop after this? >> It also looks like a different problem from the panic you initially >> reported. >> > Also, do you actively use pfsync in this setup? Does the panic happen > on the box where you DIOCRADDADDRS or the other(s)? > > Regards, > Kristof