From owner-freebsd-stable@FreeBSD.ORG Thu Nov 1 20:41:20 2007 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 361DC16A475 for ; Thu, 1 Nov 2007 20:41:20 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.183]) by mx1.freebsd.org (Postfix) with ESMTP id 2A6A413C4AA for ; Thu, 1 Nov 2007 20:41:17 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: by wa-out-1112.google.com with SMTP id k17so768030waf for ; Thu, 01 Nov 2007 13:40:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=Nk+4nau5z9zjz30wNort+Iwi553N5P8zcMqBiY4LBhU=; b=GUlmg2ZVNXQwf1oXpQ2XdIeIPY0lI4vsP59JeJ/uNx6DtvvQSBBpUaL2GQZzcnBRbrSqNubNpe0I3WVWrI2bl0yl1VVnQl87z/YftycTXrbQVuMXzbk1vuYtKQHdcZvy05syiG6D5MB69r4TGHTTb3EXuOILxAgSxG12+mO6xAk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=NWM+RuGkEHxyoeihv++bRI8+ez4bLIhhlCxp+YQ9L2JngLuDmzSINodBONbsHXCbiRiX96cZSM/VFiZmkt/nRCt9Nz0jYnRbf6JTz1zNd8KKD7Imn7Suve6+SHxhCKnfEJMGX+Z0F4RyHXckaAlJR9smTH2ClLKseLm44/9SrJ4= Received: by 10.114.154.1 with SMTP id b1mr1054690wae.1193949275000; Thu, 01 Nov 2007 13:34:35 -0700 (PDT) Received: by 10.114.177.13 with HTTP; Thu, 1 Nov 2007 13:34:34 -0700 (PDT) Message-ID: <2a41acea0711011334g151b0d36yfb2d798c3a8f3312@mail.gmail.com> Date: Thu, 1 Nov 2007 13:34:34 -0700 From: "Jack Vogel" To: "Mike Tancsa" In-Reply-To: <200710211939.l9LJd4eo024388@lava.sentex.ca> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <5CCABF9E-80DD-4E46-80AA-6E3E1F156645@nevada.net.nz> <20071020040347.GA71660@eos.sc1.parodius.com> <471AD144.60404@bit0.com> <200710211939.l9LJd4eo024388@lava.sentex.ca> Cc: freebsd-stable@freebsd.org, Mike Andrews , Philip Murray Subject: Re: em 6.6.6 - watchdog timeout X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Nov 2007 20:41:20 -0000 On 10/21/07, Mike Tancsa wrote: > At 12:10 AM 10/21/2007, Mike Andrews wrote: > > >I haven't tried the 6.6.6 driver on mine yet, though, so this could > >be something totally different. I was going to bump one of them > >from RELENG_6 to RELENG_7 as a test soon. > > I see this problem running RELENG_6, which has the 6.6.6 driver. I > forget the exact supermicro model # > > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Core(TM)2 CPU 6600 @ 2.40GHz (2402.50-MHz > 686-class CPU) > Origin = "GenuineIntel" Id = 0x6f6 Stepping = 6 > Features=0xbfebfbff > Features2=0xe3bd > AMD Features=0x20100000 > AMD Features2=0x1 > Cores per package: 2 > real memory = 2144329728 (2044 MB) > avail memory = 2092859392 (1995 MB) > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 1 > ioapic0: Changing APIC ID to 5 > ioapic0 irqs 0-23 on motherboard > ioapic1 irqs 30-53 on motherboard > kbd1 at kbdmux0 > acpi0: on motherboard > em0: port > 0x3020-0x303f mem 0x88260000-0x8827ffff,0x88240000-0x8825ffff irq 16 > at device 0.0 on pci1 > em0: Ethernet address: 00:15:17:12:f6:04 > em0: [FAST] > em1: port > 0x3000-0x301f mem 0x88220000-0x8823ffff,0x88200000-0x8821ffff irq 17 > at device 0.1 on pci1 > em1: Ethernet address: 00:15:17:12:f6:05 > em1: [FAST] > em2: port > 0x2000-0x201f mem 0x88180000-0x8819ffff,0x88100000-0x8817ffff irq 17 > at device 0.0 on pci5 > em2: Ethernet address: 00:15:17:29:6f:ef > em2: [FAST] > em3: port > 0x1100-0x113f mem 0x88020000-0x8803ffff,0x88000000-0x8801ffff irq 17 > at device 5.0 on pci6 > em3: Ethernet address: 00:15:17:29:6f:f0 > em3: [FAST] > > I already ran the dos util to "fix" the eeprom, but no difference. I would like you all to try using MSI interrupts, watchdogs don't happen when I do this. If you have hardware that has a system issue with MSI then ignore this, but these SuperMicros systems should be fine. First, you must enable it on the system: sysctl hw.pci.enable_msi=1 Then you must reload the driver. If you use em static in the kernel you will have to change the loader.conf to enable msi on boot. I am going to add a display that will tell you when an adapter uses MSI or MSI/X next time I check in code. Not only does this solve my watchdog problems, I also find on the UDP_STREAM test of netperf that I get better performance when using MSI. Let me know how it works if you try this. Cheers, Jack