From owner-freebsd-net@FreeBSD.ORG Wed Mar 28 10:16:08 2012 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 454411065676 for ; Wed, 28 Mar 2012 10:16:08 +0000 (UTC) (envelope-from rsb@berentweb.com) Received: from mail-lpp01m010-f54.google.com (mail-lpp01m010-f54.google.com [209.85.215.54]) by mx1.freebsd.org (Postfix) with ESMTP id B2F808FC1C for ; Wed, 28 Mar 2012 10:16:07 +0000 (UTC) Received: by lagv3 with SMTP id v3so1461239lag.13 for ; Wed, 28 Mar 2012 03:16:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=berentweb.com; s=google; h=mime-version:x-originating-ip:date:message-id:subject:from:to :content-type; bh=w22+wNvMwNAB1PKN9qAWdySXxV5tDhGQ4nhOshlN/IA=; b=MsHuJn6hHoKPcHTNea4GUfoDU2SqvAau3ZFSatKnvHxA55Tk3Rh6eungRLhDWOLPL9 faBQ0Dcz0oMKYx4OtrNb4EQSrnPIU8mjx/TDeolVnWwNTM5B8Agu2aXfI5cXl5Kh76VE rQrCy4Q0a6Fr0vOBsye9ooN0g10QUPupRber4= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-originating-ip:date:message-id:subject:from:to :content-type:x-gm-message-state; bh=w22+wNvMwNAB1PKN9qAWdySXxV5tDhGQ4nhOshlN/IA=; b=OaUjIaNlIZ9kasvQEt/CDPQJi4JUp5ORJNxeHEmP/H1VMq3tshO4BXdgK8+jsTfaUq 9EoIgjH6JBf2gTtj/6bt7T+AL5aqpZLZhzK5OfUnSPjxc2QZVqH8zsOzRPYXIk5nZ7Tg H5GwZLBSBKXi2/3r69F17+gT8/rKIIWmnTn/ltsz/+TmosgGC3NZROQ5hlX+NGVFHQUu BHQI5HD/jZkd47ahRTxJiYX8HNlcbhwoBlWSFdzdPctC4YT9AdraHv6TZqcDuHt7GAvj vAA8Hc6G/X7M9P9Ltocv8/F5pZYz16WkJTYp9R0Yx7ku4xmKDRraC8TuKc1fd+xbMTAL /9ng== MIME-Version: 1.0 Received: by 10.152.133.144 with SMTP id pc16mr22408936lab.0.1332929766506; Wed, 28 Mar 2012 03:16:06 -0700 (PDT) Received: by 10.112.77.15 with HTTP; Wed, 28 Mar 2012 03:16:06 -0700 (PDT) X-Originating-IP: [85.110.15.53] Date: Wed, 28 Mar 2012 13:16:06 +0300 Message-ID: From: "Raif S. Berent" To: freebsd-net@freebsd.org X-Gm-Message-State: ALoCoQnOiEhWE97s7ctjglc/rfxJiuaGEVNvIlgdEiF4ALO1QwhnHez3SU7+KyNHjwSr/Bk5B6Sx Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: lagg problems on diskless client X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Mar 2012 10:16:08 -0000 I have some problems implementing lagg(4) on dual NIC's on the diskless client side. It may be because my switch is a cheap, un-managed Gbit switch or hopefully some other reason. I would like to either get lagg working properly or find an alternative method of solving the problem. HARDWARE DESCRIPTION: I have mobo's with embedded 10/100 NIC's used as diskless cleints. For better performance I have added PCIe Gbit NIC's and Gbit switch. Since PXE cannot boot off an added PCIe NIC, I'm stuck with booting from embedded 10/100, then having to switch the traffic to the GBit NIC. In order to preserve port space on the GBit switch, I also have an old 10/100 hub plugged into one of the ports. Structure is: 10/100 NIC's --> 10/100 hub --> GBit switch --> server GBit NIC's --> GBit switch I concede that under this structure lagg's loadbalance or LACP are probably not going to work. I'll accept failover mode if I'm stuck with that - meaning, after the diskless client is done booting from the BIOS-recognized 10/100 NIC, it should switch traffic to the Gbit NIC and 10/100 should go "down". Unfortunately that does not work either. I have done as much testing as I can think of with: In general, as soon as lagg is brought up, NIC pool no longer responds to pings and gives an "I'm busy now" message. 1. On the server system, after lagg0 gets created as loadbalance, server stops responding to pings. However, tcpdump on server shows that ping requests are being received - it just does not respond. (No firewall running). Does this mean/indicate that my switch cannot handle lagg? 2. On a diskless node, lagg setup as failover behaves as other modes and results in system freeze (no ping response also). In below example, re1 is the Gbit-NIC and is set as primary NIC. > > ifconfig_lagg0="laggproto failover laggport re1 laggport re0 192.168.2.2 netmask 255.255.255.0" Curiously, under this setup tcpdump shows nfs response during frozen status. The second code snippet shows up when I un-plug the ethernet cable on re1 and lagg0 needs to fall back on re0. Server IP is 192.168.2.1, node is 2.2. > > 12:49:12.237477 IP 192.168.2.1.nfs > node2.76575838: reply ok 112 > > 12:59:54.323462 IP 192.168.2.1.nfsd > node2.740: Flags [R.], seq 4209474782, ack 2247908211, win 29127, options [nop,nop,TS val 2033479589 ecr 11647], length 0 Regards.