From owner-freebsd-stable@freebsd.org Wed Jan 16 17:56:55 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 32B9614903D8 for ; Wed, 16 Jan 2019 17:56:55 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from mail-ed1-x536.google.com (mail-ed1-x536.google.com [IPv6:2a00:1450:4864:20::536]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E5110803A0 for ; Wed, 16 Jan 2019 17:56:53 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: by mail-ed1-x536.google.com with SMTP id y20so6127353edw.9 for ; Wed, 16 Jan 2019 09:56:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=multiplay-co-uk.20150623.gappssmtp.com; s=20150623; h=subject:to:references:from:message-id:date:user-agent:mime-version :in-reply-to:content-transfer-encoding:content-language; bh=cgytR/Rzo7GbYzZPzskb8wptRvpZF0o5UTOBu7ORpMg=; b=B7DGVdPMXcibmKV5iMQNHPTl91hfb6dsVdUA1sBxKRcYFG/qO19bso327AyV1ID+L7 3zHBo2AzWolm9F36v55LdopQpAtP2hhx2nm/meBbQ9OSzIaykYRLT1o9TC7gqjrLTOSs wWvluCiw4hc8ADACNR26jB4FDVmlrWK7Y86KE0lBllw6IiunJ2kPZa3iaPehUgy+qz/L d3vqJSmWchTvpdpIV2dMrOsefjRWvnBv1bMiYzrfDrS8mfb0Sy3XUS/VFe9YVpuXgREf rV4Fzir6pLP17JNH8eNZe86HzvKyybd1MdlS5HlrFmfx9SGybPm1YVwK3KU/YHHLaC+T GnOQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding :content-language; bh=cgytR/Rzo7GbYzZPzskb8wptRvpZF0o5UTOBu7ORpMg=; b=tpsF19QAHmTQVpcOV0Ji7kJolCUfZxgqDwcq72btkis/UxYMriEV4LKAMfDb0BSyWZ wqDfjyiIuM6GhBRdMgkptpU5//7+wyfzQIKvqgK4QYHM9q9iluCVufZ36OidgQWgRNN9 wnYOjRpSQoTpwupqqjkmqhC8UI493qAu+C/CITwY4cupuzuqZuJF9J/j2LMK1GFk+6lF dE/Wu0Alha+mLsYCJcATIUIRAOQB3tFN4BFsE/OZh1I58j0k2QAxCgAg8Cn26QxukvzK jW8hx+ZD9/Qoy3ZBDAkNSvT26QMja6AROVFikZsFLqcwgBuBIz2EKCUjFVXONFQRg8EQ btWw== X-Gm-Message-State: AJcUukfXpakq8mZjbQf7Jef0xp4FmuUF2bc9uvm1yJBwQE+L5+zKFcBe zfXVV1W4Cl+YAUJXq4UeQvCL3Q== X-Google-Smtp-Source: ALg8bN49DIzpuRAEB8fSkYT1fX5z8b9VJq4DbaN/AXA2hmEpyxEI8NW82DAYPbBhFGSOfkdfbnFqBg== X-Received: by 2002:a50:a741:: with SMTP id h59mr8006391edc.106.1547661412568; Wed, 16 Jan 2019 09:56:52 -0800 (PST) Received: from [10.44.128.75] ([161.12.40.153]) by smtp.gmail.com with ESMTPSA id q13-v6sm3164527eja.8.2019.01.16.09.56.51 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 16 Jan 2019 09:56:51 -0800 (PST) Subject: Re: CARP stopped working after upgrade from 11 to 12 To: Pete French , freebsd-stable@freebsd.org, thomas@gibfest.dk References: From: Steven Hartland Message-ID: <9335fa4b-b2cf-038c-706c-d0c7bbbfe00e@multiplay.co.uk> Date: Wed, 16 Jan 2019 17:56:53 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: E5110803A0 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=multiplay-co-uk.20150623.gappssmtp.com header.s=20150623 header.b=B7DGVdPM; spf=pass (mx1.freebsd.org: domain of killing@multiplay.co.uk designates 2a00:1450:4864:20::536 as permitted sender) smtp.mailfrom=killing@multiplay.co.uk X-Spamd-Result: default: False [-6.10 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[multiplay-co-uk.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[multiplay.co.uk]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[multiplay-co-uk.20150623.gappssmtp.com:+]; MX_GOOD(-0.01)[cached: ASPMX.L.GOOGLE.COM]; RCVD_IN_DNSWL_NONE(0.00)[6.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.99)[-0.993,0]; IP_SCORE(-2.60)[ip: (-9.05), ipnet: 2a00:1450::/32(-2.04), asn: 15169(-1.80), country: US(-0.08)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Jan 2019 17:56:55 -0000 On 16/01/2019 17:33, Pete French wrote: >> I have confirmed that pfsync is the culprit. Read on for details. > Excellent work. I;m home now, so won't get a chnace to out this into > practice until tomorrow unfortunately, but it's brilliant that you have > confirmed it. > >> I tried disabling pfsync and rebooting both nodes, they came up as >> MASTER/SLAVE then. > This is very useful to know - I willprobably try tomorrow running my > firewalls back up with pfsync disabled to see if it works for me too. > >> Then I tried enabling pfsync and starting it, and on the SLAVE node I >> immediately got: > That kind of confirms it really doesnt it ? > > So, is it possible to get r342051 backend out of STABLE for now ? This > is a bit 'gotcha' for anyone running a firewall pair with CARp after all. > > -pete. > > PS: are you going to file a PR ? You could also try setting net.pfsync.pfsync_buckets="1" in /boot/loader.conf which reading the code should ensure all items are processed in a single bucket so if its the bucketing split has the issue then this will fix. If the issue is more ingrained then it won't.     Regards     Steve