From owner-freebsd-net@FreeBSD.ORG Fri Jan 21 09:21:43 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9382C1065670; Fri, 21 Jan 2011 09:21:43 +0000 (UTC) (envelope-from jan.koum@gmail.com) Received: from mail-qy0-f182.google.com (mail-qy0-f182.google.com [209.85.216.182]) by mx1.freebsd.org (Postfix) with ESMTP id 0D41F8FC0A; Fri, 21 Jan 2011 09:21:42 +0000 (UTC) Received: by qyk36 with SMTP id 36so1504999qyk.13 for ; Fri, 21 Jan 2011 01:21:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=ltGeUY4YQGVssVWWTNGNKhFLyvYA0g+PaaNj40t0GpM=; b=wwBmQMGX/RdGxtigd4h6c/abjdpSLAzbqFHPJ1wtsAXT/5MAfJpRGyQRxRCC2yPMMx wX1IwPvjq87u2Y6f1HD/AHBKbx12b2ZDSFozKlaZLNmI7o9CFB4M3Q03bV3N40IVfOY2 Io0Mld/l+bksGYMHv/izOXasnAa6iuUzGBBA0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; b=oZJHpFPXTqbqGhWdvwg8IFzrP+F/i6z594pcBgugEPpJhiUEVPf63T2cB/rbOVA0HK tXbjO8HGVkY2mG0YcjyrBRvWulxh6djLO1a3TTv2nH4IYHmQsB4EKwEHMVELCGZpR4pl ErKYSHd6aP+DzWMYoU0x5u+aonsgjM+ixPZ2s= MIME-Version: 1.0 Received: by 10.229.81.12 with SMTP id v12mr389841qck.132.1295601702129; Fri, 21 Jan 2011 01:21:42 -0800 (PST) Sender: jan.koum@gmail.com Received: by 10.229.241.211 with HTTP; Fri, 21 Jan 2011 01:21:42 -0800 (PST) In-Reply-To: <4D2C636B.5040003@sentex.net> References: <1290533941.3173.50.camel@home-yahoo> <4CEC0548.1080801@sentex.net> <4D2C636B.5040003@sentex.net> Date: Fri, 21 Jan 2011 01:21:42 -0800 X-Google-Sender-Auth: I7GFIa1SqtQFCkpYjIN6devPe0A Message-ID: From: Jan Koum To: Mike Tancsa , Jack Vogel Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: "freebsd-net@freebsd.org" , Sean Bruno , Ivan Voras , "freebsd-hardware@freebsd.org" Subject: Re: em driver, 82574L chip, and possibly ASPM X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Jan 2011 09:21:43 -0000 On Tue, Jan 11, 2011 at 6:04 AM, Mike Tancsa wrote: > On 12/24/2010 5:44 PM, Jan Koum wrote: > > hi Ivan and Mike, > > > > wanted to follow up and see if you found a solid long-term solution to > this > > bug. we are still seeing this problem in our 8.2 environment with ASPM > > already disabled. here is what we have: > > > > 1. motherboard is SuperMicro X8SIE-LN4F Intel Xeon: > > > > Hi Jack, > Looks like this problem is not completely gone :( Dear Mike and Jack, sadly the problem is not gone for us either. here is what we know so far: - we are running latest e1000 drivers from 8.2 - we have ASPM disabled and we have the following bios settings: http://camel.ethereal.net/~jkb/bios/ - we have updated our BIOS and IPMI to the latest firmware available from our ISP - we added hw.em.rxd=4096 and hw.em.txd=4096 to loader.conf (thanks Sean for this tip -- these settings made problem happen much less frequently but didn't go away completely) the ONLY thing sort of saving our butts right now is this cron job that runs every minute: if /sbin/ping -q -c 10 www.google.com> /dev/null; then echo "OK" >> /tmp/em1.out else date >> /tmp/em1.out echo "broken" >> /tmp/em1.out /sbin/ifconfig em1 down sleep 3 /sbin/ifconfig em1 up fi this is obviously no way to run a high performance web servers in a long term. as mentioned in my previous emails, let us know if you need any further information or if you have any debug code you want us to run in production. we are willing to do pretty much anything to get this issue fixed thanks