From owner-freebsd-bugs@FreeBSD.ORG Mon Mar 10 19:10:03 2008 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 51A551065679 for ; Mon, 10 Mar 2008 19:10:03 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 23F198FC26 for ; Mon, 10 Mar 2008 19:10:03 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m2AJA3fX037205 for ; Mon, 10 Mar 2008 19:10:03 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m2AJA3Bj037198; Mon, 10 Mar 2008 19:10:03 GMT (envelope-from gnats) Resent-Date: Mon, 10 Mar 2008 19:10:03 GMT Resent-Message-Id: <200803101910.m2AJA3Bj037198@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, "Douglas K. Rand" Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8372F1065678 for ; Mon, 10 Mar 2008 19:09:31 +0000 (UTC) (envelope-from rand@meridian-enviro.com) Received: from newman.meridian-enviro.com (newman.meridian-enviro.com [12.192.92.56]) by mx1.freebsd.org (Postfix) with ESMTP id 1C0B88FC24 for ; Mon, 10 Mar 2008 19:09:30 +0000 (UTC) (envelope-from rand@meridian-enviro.com) Received: from luna-0.meridian-enviro.com ([10.10.10.3]) by newman.meridian-enviro.com (8.13.6/8.13.6) with ESMTP id m2AJ9Ubd098481 for ; Mon, 10 Mar 2008 14:09:30 -0500 (CDT) (envelope-from rand@meridian-enviro.com) Received: (from rand@localhost) by luna-0.meridian-enviro.com (8.13.8/8.13.8/Submit) id m2AJ9Tmf017332; Mon, 10 Mar 2008 14:09:29 -0500 (CDT) (envelope-from rand) Message-Id: <200803101909.m2AJ9Tmf017332@luna-0.meridian-enviro.com> Date: Mon, 10 Mar 2008 14:09:29 -0500 (CDT) From: "Douglas K. Rand" To: FreeBSD-gnats-submit@FreeBSD.org X-Send-Pr-Version: 3.113 Cc: Subject: kern/121574: CARP hash dependent on order of IP addresses on interface X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "Douglas K. Rand" List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Mar 2008 19:10:03 -0000 >Number: 121574 >Category: kern >Synopsis: CARP hash dependent on order of IP addresses on interface >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Mar 10 19:10:02 UTC 2008 >Closed-Date: >Last-Modified: >Originator: Douglas K. Rand >Release: FreeBSD 6.2-RELEASE-p7 i386 >Organization: Meridian Environmental Technology, Inc. >Environment: System: FreeBSD luna-0.meridian-enviro.com 6.2-RELEASE-p7 FreeBSD 6.2-RELEASE-p7 #0: Fri Aug 24 20:46:09 CDT 2007 root@:/usr/obj/usr/src/sys/LUNA i386 >Description: Recently I had to reboot one of my redundant firewalls and the /etc/rc.conf file had exchanged the primary and alias addresses of the interface. (We were switching ISPs.) If you have a carp interface with 2 IP addresses, the IP addresses MUST be assigned in the same order on both interfaces. Luna-0 crashed this morning, and when I brought it back up the carp1 interface on BOTH Luna-0 and Luna-1 were in the MASTER state. >From Luna-0: carp1: flags=49 mtu 1500 inet 12.192.93.2 netmask 0xffffffc0 inet 207.109.234.254 netmask 0xfffffff0 carp: MASTER vhid 2 advbase 1 advskew 0 >From Luna-1: carp1: flags=49 mtu 1500 inet 207.109.234.254 netmask 0xfffffff0 inet 12.192.93.2 netmask 0xffffffc0 carp: MASTER vhid 2 advbase 1 advskew 50 Both were trying to act as the master carp interface, which was causing some strange TCP errors. (Bryan noticed his automated SSH sessions to Mars were failing.) Once I got it straightened out, everything worked better. And of course, once I got the addresses added to the interfaces in the right order I realized that since the Qwest stuff is disconnected, I didn't need the 207.109.234.254 address anymore anyway, so I could have just deleted that, which I've now done. Thing thing to watch for is a LOT of "carp.: incorrect hash" messages from the kernel. I ignored the few I saw because you ALWAYS get a few of those at boot, but I didn't realize how many were being generated. >How-To-Repeat: Change the order of the IP addresses on a CARP interface from its peer. >Fix: >Release-Note: >Audit-Trail: >Unformatted: