From owner-freebsd-stable@FreeBSD.ORG Fri Jan 25 21:54:09 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 7AE35AB9; Fri, 25 Jan 2013 21:54:09 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from noop.in-addr.com (mail.in-addr.com [IPv6:2001:470:8:162::1]) by mx1.freebsd.org (Postfix) with ESMTP id 46B10CD6; Fri, 25 Jan 2013 21:54:09 +0000 (UTC) Received: from gjp by noop.in-addr.com with local (Exim 4.80.1 (FreeBSD)) (envelope-from ) id 1TyrDq-00078E-6B; Fri, 25 Jan 2013 16:54:06 -0500 Date: Fri, 25 Jan 2013 16:54:06 -0500 From: Gary Palmer To: Daniel Braniss Subject: Re: bge numbering Message-ID: <20130125215405.GA74563@in-addr.com> References: <201301251000.52922.jhb@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: gpalmer@freebsd.org X-SA-Exim-Scanned: No (on noop.in-addr.com); SAEximRunCond expanded to false Cc: freebsd-stable@freebsd.org, John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Jan 2013 21:54:09 -0000 On Fri, Jan 25, 2013 at 05:47:39PM +0200, Daniel Braniss wrote: > > On Friday, January 25, 2013 3:46:10 am Daniel Braniss wrote: > > > Hi, > > > this server, a Dell R720 has 4 bge on board, > > > Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000 > > > bge0: APE FW version: NCSI v1.1.7.0 > > > bge0: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E > > > miibus0: on bge0 > > > ... > > > > > > I have connected the ethernet to port labeled 0, but it appears > > > as bge2, how can this be corrected? > > > > It can't really. The order of PCI devices is determined by the layout of the > > PCI device hierarchy which is generally determined by the physical traces on > > your motherboard. > > so you are saying that Dell screwed up yet again? > the 4 bges have consecutive macs, bge1 = bge0 +1, bge2 = bge1 + 1, etc. It's > only the # 'outside' that is wrong? I will try the usual trial and error > to find the mapping, but will have to wait till Sunday. bge0 = port 2 bge1 = port 3 bge2 = port 0 bge3 = port 1 would be my suspicion The R720 Broadcom chips are dual port, so bge0 & 1 are paired and bge2 & 3 are paired. You can force this to be corrected by renaming the devices I believe. Dell "fixed" this in Linux by using DMI/SMBIOS type 41 data to reorder the NICs. The code is in RHEL 6 and later. The Dell white paper is http://linux.dell.com/files/whitepapers/consistent_network_device_naming_in_linux.pdf >From an R720 I have access to: Handle 0x2900, DMI type 41, 11 bytes Onboard Device Reference Designation: Integrated NIC 1 Type: Ethernet Status: Enabled Type Instance: 1 Bus Address: 0000:01:00.0 Handle 0x2901, DMI type 41, 11 bytes Onboard Device Reference Designation: Integrated NIC 2 Type: Ethernet Status: Enabled Type Instance: 2 Bus Address: 0000:01:00.1 Handle 0x2902, DMI type 41, 11 bytes Onboard Device Reference Designation: Integrated NIC 3 Type: Ethernet Status: Enabled Type Instance: 3 Bus Address: 0000:02:00.0 Handle 0x2903, DMI type 41, 11 bytes Onboard Device Reference Designation: Integrated NIC 4 Type: Ethernet Status: Enabled Type Instance: 4 Bus Address: 0000:02:00.1 You can theoretically work from the bus address back to the way Dell wants the NICs ordered. Why on earth they can't get the hardware to do it instead I have *no* idea Gary