From owner-freebsd-questions@FreeBSD.ORG Wed Nov 14 11:32:51 2007 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id B9D8916A41A for ; Wed, 14 Nov 2007 11:32:51 +0000 (UTC) (envelope-from girishvenkatachalam@gmail.com) Received: from rv-out-0910.google.com (rv-out-0910.google.com [209.85.198.187]) by mx1.freebsd.org (Postfix) with ESMTP id 896DF13C469 for ; Wed, 14 Nov 2007 11:32:51 +0000 (UTC) (envelope-from girishvenkatachalam@gmail.com) Received: by rv-out-0910.google.com with SMTP id l15so131313rvb for ; Wed, 14 Nov 2007 03:32:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:received:date:from:to:subject:message-id:reply-to:mail-followup-to:references:mime-version:content-type:content-disposition:in-reply-to:user-agent; bh=C5rPbgTPGLWxZLdl6Tl+iochx6nqqy18OauuJ2H97nc=; b=gIt9J0xmmAXUFGUhrt7jVKCjPba8VcPLxA6iK51yBTQ32Q7Rtbepc49oI50poWBvIKNLvB4NGbnIX6bTQKrb7n/MIf0rGjuMO+U67L5SBGPKwB7ZLzyNiPje4BCM+eSKcOuK0cV5I0UDUlO/h748bVzP5YH8vTwlChBoN10OuWM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:date:from:to:subject:message-id:reply-to:mail-followup-to:references:mime-version:content-type:content-disposition:in-reply-to:user-agent; b=RS7bJM6iQpGvRbVEBQKP9RQadwzqwUWMYXLTozfp3AvsYbSBMCbdTC8qwzrgEyFZ/8A1etPZf7y7xur2LHOs36vZ8hSZltfwledp2IaoTnhsl9r3ndkvn+xJI2lTXvSFT9rrOBhhsxAjDwfXKEUjJ/mCXNCEMHoOSsmklxbNdIQ= Received: by 10.140.162.21 with SMTP id k21mr3396046rve.1195039548061; Wed, 14 Nov 2007 03:25:48 -0800 (PST) Received: from saraswathy.susmita.org ( [59.92.36.50]) by mx.google.com with ESMTPS id c19sm1447801rvf.2007.11.14.03.25.45 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 14 Nov 2007 03:25:47 -0800 (PST) Received: by saraswathy.susmita.org (Postfix, from userid 1002) id 4E6F4143E7; Wed, 14 Nov 2007 16:55:41 +0530 (IST) Date: Wed, 14 Nov 2007 16:55:41 +0530 From: Girish Venkatachalam To: freebsd-questions@freebsd.org Message-ID: <20071114112541.GD570@saraswathy.susmita.org> Mail-Followup-To: freebsd-questions@freebsd.org References: <1788688982.20071114095051@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1788688982.20071114095051@gmail.com> User-Agent: Mutt/1.5.12-2006-07-14 Subject: Re: master->backup CARP issue X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: girishvenkatachalam@gmail.com List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Nov 2007 11:32:51 -0000 On 09:50:51 Nov 14, Eugene wrote: > Hello freebsd, > > > We have two FreeBSD boxes, each one has 4 CARP interfaces in preempt > mode, without arp balancing. > > Backup without any reason preempts Master and after a while (an hour > or two) it becomes Backup again. > When Backup becomes Master on Master box > net.inet.carp.suppress_preempt: 1, but all interfaces are up and > seemed to work properly. > > > Is there any ways to debug this issue? > > > Additional info: > > #uname -v > FreeBSD 6.1-RELEASE-p7 > > Master: > # grep carp /var/log/messages > Nov 14 01:50:59 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 01:52:30 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 02:43:55 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 02:59:12 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 03:26:13 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 03:26:32 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 04:58:39 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 05:53:27 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 06:01:12 atlas kernel: carp3: MASTER -> BACKUP (more frequent advertisement received) > Nov 14 06:03:36 atlas kernel: carp2: BACKUP -> MASTER (preempting a slower master) > Nov 14 06:03:36 atlas kernel: carp0: BACKUP -> MASTER (preempting a slower master) > Nov 14 06:03:36 atlas kernel: carp1: BACKUP -> MASTER (preempting a slower master) > Nov 14 06:03:38 atlas kernel: carp3: BACKUP -> MASTER (preempting a slower master) > > Master & Backup (in normal state) > #sysctl -a | grep "net.inet.carp." > net.inet.carp.allow: 1 > net.inet.carp.preempt: 1 > net.inet.carp.log: 2 > net.inet.carp.arpbalance: 0 > net.inet.carp.suppress_preempt: 0 > > all NICs - 3Com 3c905C-TX > > Master: > #ifconfig | grep -A2 carp > carp0: flags=49 mtu 1500 > inet 10.1.1.3 netmask 0xffffff00 > carp: MASTER vhid 1 advbase 1 advskew 10 > carp1: flags=49 mtu 1500 > inet 10.1.2.3 netmask 0xffffff00 > carp: MASTER vhid 2 advbase 1 advskew 10 > carp2: flags=49 mtu 1500 > inet 10.1.3.3 netmask 0xffffff00 > carp: MASTER vhid 3 advbase 1 advskew 10 > carp3: flags=49 mtu 1500 > inet 10.1.4.3 netmask 0xfffffff8 > carp: MASTER vhid 4 advbase 1 advskew 10 > > Backup > #ifconfig |grep -A2 carp > carp0: flags=49 mtu 1500 > inet 10.1.1.3 netmask 0xffffff00 > carp: BACKUP vhid 1 advbase 1 advskew 20 > carp1: flags=49 mtu 1500 > inet 1.1.2.3 netmask 0xffffff00 > carp: BACKUP vhid 2 advbase 1 advskew 20 > carp2: flags=49 mtu 1500 > inet 10.1.3.3 netmask 0xffffff00 > carp: BACKUP vhid 3 advbase 1 advskew 20 > carp3: flags=49 mtu 1500 > inet 10.1.4.3 netmask 0xfffffff8 > carp: BACKUP vhid 4 advbase 1 advskew 20 > > Master: > > #netstat -ni |grep carp > Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll > carp0 1500 311894 1 5926852 0 0 > carp0 1500 10.1.1 10.1.1.3 42293866 - 263238 - - > carp1 1500 48653 1 5663615 0 0 > carp1 1500 10.1.2 10.1.2.3 153785957 - 0 - - > carp2 1500 48661 1 5663615 107 0 > carp2 1500 10.1.3/24 10.1.3.3 476782 - 0 - - > carp3 1500 48974 1 5663634 1155 0 > carp3 1500 10.1.4.3/ 10.1.4.3 6885622 - 0 - - > > > Backup: > > #netstat -ni |grep carp > Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll > carp0 1500 35221 0 6437 0 0 > carp0 1500 10.1.1 10.1.1.3 8699 - 0 - - > carp1 1500 35220 0 6438 0 0 > carp1 1500 10.1.2 10.1.2.3 86000 - 0 - - > carp2 1500 35221 0 6437 0 0 > carp2 1500 10.1.3/24 10.1.3.3 0 - 0 - - > carp3 1500 35190 0 6443 23 0 > carp3 1500 10.1.4.3/ 10.1.4.3 958 - 0 - - > > > Thanks in advance! I could be talking nonsense but still... Have you tried adjusting the "advskew" and "advbase" parameters? Another thing. Are the NICs reliable? Have you tried with a different NIC? Looks like you don't have a faulty NIC here. So it could be the other possibility. Thanks. regards, Girish