From owner-freebsd-stable@FreeBSD.ORG Fri Oct 20 17:41:27 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AC0A816A47C for ; Fri, 20 Oct 2006 17:41:27 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from nz-out-0102.google.com (nz-out-0102.google.com [64.233.162.197]) by mx1.FreeBSD.org (Postfix) with ESMTP id B201D43D4C for ; Fri, 20 Oct 2006 17:41:07 +0000 (GMT) (envelope-from jfvogel@gmail.com) Received: by nz-out-0102.google.com with SMTP id o37so392996nzf for ; Fri, 20 Oct 2006 10:41:07 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=If9boSm+HJEQr+QE9Kr4EQsn9S8Aty7HvmQFtLT1H8Up1juP1BcPB0x9rjxOqvc0lGXezYUA7ImScD1q7b8H3AjKgEAQh9IZOtAd1p1zcf58jkFQjz836PZxGX9cIkve6/GBC8pyI5wadKhCuJDA2JpqM0hsZ1K4QCwP+ixOeF0= Received: by 10.35.60.15 with SMTP id n15mr979812pyk; Fri, 20 Oct 2006 10:08:56 -0700 (PDT) Received: by 10.35.119.1 with HTTP; Fri, 20 Oct 2006 10:08:56 -0700 (PDT) Message-ID: <2a41acea0610201008s301d963ds5728d7b145a5e5b4@mail.gmail.com> Date: Fri, 20 Oct 2006 10:08:56 -0700 From: "Jack Vogel" To: "Scott Long" In-Reply-To: <4538FF57.1070109@samsco.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20061020163800.DB21C16A47B@hub.freebsd.org> <4538FF57.1070109@samsco.org> Cc: Bill Paul , freebsd-stable@freebsd.org, kris@obsecurity.org Subject: Re: em network issues X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Oct 2006 17:41:27 -0000 On 10/20/06, Scott Long wrote: > Bill Paul wrote: > > [Charset ISO-8859-1 unsupported, filtering to ASCII...] > > > >>On 10/19/06, Kris Kennaway wrote: > >> > >>>On Thu, Oct 19, 2006 at 02:18:13PM -0700, Jack Vogel wrote: > >>> > >>>>The engineer in our test group has installed 6.2 BETA2 and attempted via a > >>>>number of tests to reproduce this problem, the machine even shares the em > >>>>interrupt with usb, and yet so far he has been unsuccessful. > >>> > >>>What tests is he running? > >> > >>He tried doing something Kip said reliably repro'd the issue, building a big > >>source archive over NFS. Then he has been running a continuous NFS data > >>back and forth copy since, that is still ongoing. > >> > >>Other suggestions? > >> > >>Jack > >> > > > > > > Just out of curiosity, what sort of torture tests does Intel do, in > > general, on the em driver on FreeBSD? One thing that I've found which > > works wonders at exposing race conditions is the Smartbits bi-directional > > IP forwarding test. Put two NICs in a system, configure for it for IP > > forwarding, then connect the Smartbits to each port and run the > > SmartApps router test in bi-directional mode. At 64 bytes per frame, > > it will try to push 2.96 million packets/second through both ports > > simultaneously (1.48 million in each direction). Of course, you won't > > actually be able to forward all the traffic, but the interfaces (not > > to mention the OS) should continue running regardless. > > > > This test exercises both the RX and TX paths and generates hundreds of > > thousands of interrupts per second. You'd be amazed at the sort of > > things you can discover with it. The downside of course is that a > > Smartbits with gigE ports isn't cheap, but I'd be surprised if Intel > > didn't have one kicking around somewhere. > > > > -Bill > > > > This is exactly the test that Andre and I were running, though only in > one direction (I think due to lack of hardware for a full test). > Prior to the INTR_FAST change, the machine would live-lock. Now it > survives, stays responsive, and drops packets as needed. I just checked with our group lead (John Ronciak) and he says I have a Smartbits available to me, so I'm gonna try and get this set up :) Thanks for the suggestion Bill. Jack