From owner-freebsd-net@FreeBSD.ORG Fri Oct 7 01:57:44 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 48CC71065672; Fri, 7 Oct 2011 01:57:44 +0000 (UTC) (envelope-from seanbru@yahoo-inc.com) Received: from mrout2.yahoo.com (mrout2.yahoo.com [216.145.54.172]) by mx1.freebsd.org (Postfix) with ESMTP id 2D09F8FC08; Fri, 7 Oct 2011 01:57:43 +0000 (UTC) Received: from [127.0.0.1] (proxy7.corp.yahoo.com [216.145.48.98]) by mrout2.yahoo.com (8.14.4/8.14.4/y.out) with ESMTP id p971vVV1053090; Thu, 6 Oct 2011 18:57:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=yahoo-inc.com; s=cobra; t=1317952652; bh=w/p1eFrsF4CVpvFUx5eWXeYrVAUNL0ZbXQtWWDWULc0=; h=Subject:From:To:Cc:In-Reply-To:References:Content-Type:Date: Message-ID:Mime-Version:Content-Transfer-Encoding; b=DyZoRAfPZvHH3EYn7k89TmcItOE3vnKjo0oQOGJRD4vC3H+JvWtjDs/RpA1pAhOKk 44qEy1Eg5grzsIohNSodDrklBVXMjDyG5Rxt7+sCT/o1xiqkDTgXtIb/H9Scbe0mbf YD66W3XXx76xnf+6hSawHY8LIjhLKnhrv8A/nyfo= From: Sean Bruno To: "freebsd-net@freebsd.org" In-Reply-To: <1317315666.2777.8.camel@hitfishpass-lx.corp.yahoo.com> References: <1317315666.2777.8.camel@hitfishpass-lx.corp.yahoo.com> Content-Type: text/plain; charset="UTF-8" Date: Thu, 06 Oct 2011 18:57:31 -0700 Message-ID: <1317952651.9892.19.camel@hitfishpass-lx.corp.yahoo.com> Mime-Version: 1.0 X-Mailer: Evolution 2.32.3 (2.32.3-1.fc14) Content-Transfer-Encoding: 7bit Cc: David Christensen , Pyun YongHyeon Subject: Re: bce(4) with IPMI [puzzling and puzzling] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Oct 2011 01:57:44 -0000 On Thu, 2011-09-29 at 10:01 -0700, Sean Bruno wrote: > We've been getting reports of odd behavior on our Dell R410 machines > when trying to use IPMI. The servers have two NIC's that we have > assigned as the IPMI interface(bce0) and production interface(bce1) > respectively. > > Since we don't actually configure bce0 in FreeBSD, we've found that the > IPMI interface deactivated when bce(4) loads. I assume that the driver > is not initializing the interface correctly in this case and the default > case is to turn the interface off. Does it make sense to completely > turn off the interface when there is an active link on the port, but no > configuration assigned? > > Sean > > p.s. Dell's IPMI implementation is ... um ... more difficult than it > needs to be. Whoa ... ok, so now I've run into something horrible. According to dmidecode, a Dell R410 has a Broadcom 5716 chipset on it. On Board Device 2 Information Type: Ethernet Status: Enabled Description: Embedded Broadcom 5716 NIC 1 On Board Device 3 Information Type: Ethernet Status: Enabled Description: Embedded Broadcom 5716 NIC 2 However, when I ask the chipset what type it is via: if_bcereg.h:#define BCE_CHIP_NUM(sc) It clearly indicates that it is a 5709???? What on earth is going on here? The following patch, yeilds the following output: === //depot/yahoo/ybsd_7/src/sys/dev/bce/if_bce.c#26 - /home/seanbru/ybsd_7/sys/dev/bce/if_bce.c ==== 5855c5855,5861 < if ((ifp->if_flags & IFF_UP) == 0) { --- > if (BCE_CHIP_NUM(sc) == BCE_CHIP_NUM_5716) > printf("%s: BCE_CHIP_NUM_5716 found\n", __func__); > else > printf("%s: huh, what's this? 0x%8x\n", __func__, BCE_CHIP_NUM(sc)); > > if (((ifp->if_flags & IFF_UP) == 0) && > !(BCE_CHIP_NUM(sc) == BCE_CHIP_NUM_5716)) { bce_ifmedia_sts: huh, what's this? 0x57090000 bce0@pci0:1:0:0: class=0x020000 card=0x028c1028 chip=0x163b14e4 rev=0x20 hdr=0x00 vendor = 'Broadcom Corporation' class = network subclass = ethernet bce1@pci0:1:0:1: class=0x020000 card=0x028c1028 chip=0x163b14e4 rev=0x20 hdr=0x00 vendor = 'Broadcom Corporation' class = network subclass = ethernet bce0: mem 0xd8000000-0xd9ffffff irq 36 at device 0.0 on pci1 bce0: Reserved 0x2000000 bytes for rid 0x10 type 3 at 0xd8000000 bce0: attempting to allocate 1 MSI vectors (16 supported) bce0: using IRQ 256 for MSI miibus0: on bce0 bce0: bpf attached bce0: Ethernet address: a4:ba:db:2b:6d:58 bce0: [MPSAFE] bce0: [ITHREAD] bce0: ASIC (0x57092008); Rev (C0); Bus (PCIe x4, 2.5Gbps); B/C (5.2.2); Flags (MSI|MFW); MFW (NCSI 2.0.8)