From owner-freebsd-amd64@FreeBSD.ORG Tue Jan 13 05:10:01 2009 Return-Path: Delivered-To: freebsd-amd64@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C4C05106568A for ; Tue, 13 Jan 2009 05:10:01 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 9FEEB8FC0A for ; Tue, 13 Jan 2009 05:10:01 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n0D5A105025510 for ; Tue, 13 Jan 2009 05:10:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n0D5A11l025509; Tue, 13 Jan 2009 05:10:01 GMT (envelope-from gnats) Resent-Date: Tue, 13 Jan 2009 05:10:01 GMT Resent-Message-Id: <200901130510.n0D5A11l025509@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-amd64@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Xiuchao Wu Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7CF6F106566B for ; Tue, 13 Jan 2009 05:02:07 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21]) by mx1.freebsd.org (Postfix) with ESMTP id 6B6398FC08 for ; Tue, 13 Jan 2009 05:02:07 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.14.3/8.14.3) with ESMTP id n0D527J0095568 for ; Tue, 13 Jan 2009 05:02:07 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.14.3/8.14.3/Submit) id n0D5275X095567; Tue, 13 Jan 2009 05:02:07 GMT (envelope-from nobody) Message-Id: <200901130502.n0D5275X095567@www.freebsd.org> Date: Tue, 13 Jan 2009 05:02:07 GMT From: Xiuchao Wu To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 X-Mailman-Approved-At: Tue, 13 Jan 2009 05:26:10 +0000 Cc: Subject: amd64/130483: MSI must be disabled when Myricom 10Gbps Card is used on Dell PowerEdge T300 Server X-BeenThere: freebsd-amd64@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting FreeBSD to the AMD64 platform List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Jan 2009 05:10:02 -0000 >Number: 130483 >Category: amd64 >Synopsis: MSI must be disabled when Myricom 10Gbps Card is used on Dell PowerEdge T300 Server >Confidential: no >Severity: serious >Priority: medium >Responsible: freebsd-amd64 >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Tue Jan 13 05:10:01 UTC 2009 >Closed-Date: >Last-Modified: >Originator: Xiuchao Wu >Release: FreeBSD 7.0 >Organization: National University of Singapore >Environment: FreeBSD 7.0/7.1 Release >Description: Computer: Dell PowerEdge T300 Server NICs: Myricom 10G-PCIE-8AL-C OS: FreeBSD 7.0/7.1 Release After I rebuild the kernel (to include NIC driver "mxge") and reboot, kernel panic occurs and the computer is automatically rebooted. After contacting with engineers of Myricom, they suggest to disable message signaled interrupt (MSI) in /boot/loader.conf and these NICs can work now. " hw.pci.enable_msix=0 hw.pci.enable_msi=0 " However, MSI is really very important for high speed data transmission. Huge number of packets generate many interruptions. Considering that Fedora 9 works well on the same computer, it may be a bug of FreeBSD. Below is the screen when kernel panic occurs. ...... p4tcc3: on cpu3 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 2.0 on pci0 pci3: on pcib1 pcib2: at device 3.0 on pci0 pci4: on pcib2 pcib3: at device 4.0 on pci0 pci5: on pcib3 mxge0: mem 0xd8000000-0xd8ffffff, 0xdfa00000-0xdfafffff irq 16 at device 0.0 on pci5 panic: nexus_add_irq: failed ..... Best Regards, Xiuchao Wu (wuxiuchao@gmail.com) >How-To-Repeat: >Fix: >Release-Note: >Audit-Trail: >Unformatted: