From owner-freebsd-current@FreeBSD.ORG Wed Nov 11 20:31:35 2009 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7CDCD1065670; Wed, 11 Nov 2009 20:31:35 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pw0-f44.google.com (mail-pw0-f44.google.com [209.85.160.44]) by mx1.freebsd.org (Postfix) with ESMTP id 36A948FC17; Wed, 11 Nov 2009 20:31:35 +0000 (UTC) Received: by pwj15 with SMTP id 15so1000059pwj.3 for ; Wed, 11 Nov 2009 12:31:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:received:from:date:to:cc :subject:message-id:reply-to:references:mime-version:content-type :content-disposition:in-reply-to:user-agent; bh=MvnqWyyIv60dkx5glhuN5FMnOeBwWS/cqXysmUN/wcc=; b=csoYLXN1qaKcCmJ+GU5Ivaz8nU2NJ0pIJzSy3NeT6H8nWBpmPR2fJZk2ryRTOkiMbc moaDRiBDYWhv4Gf+XrMVlEguVJUGn5oQfGv6E/mWSBJypW3ax18T5rG28zFCdXdwkpos 0pGS3OXitYRU9KE20irHOoOhifDrH/WVyJp5k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; b=GiyVC1DzThUOKQFcSPZHRaz642zKojupBfaBpB6erL4hUAhJ/FNoZofeJaatugdbFW LJi4jK/OuRnijoldFrrpV2kCwMNEM68XJbFcC8FlQ5tvu0fUX/q6L1GDe4GnxQENSvU8 ztLIHfZ/vXnoqfdqOaYVZ3msa5H+II4UrtdC0= Received: by 10.114.69.17 with SMTP id r17mr4145907waa.42.1257971494766; Wed, 11 Nov 2009 12:31:34 -0800 (PST) Received: from pyunyh@gmail.com ([174.35.1.224]) by mx.google.com with ESMTPS id 20sm1205933pzk.9.2009.11.11.12.31.33 (version=TLSv1/SSLv3 cipher=RC4-MD5); Wed, 11 Nov 2009 12:31:33 -0800 (PST) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Wed, 11 Nov 2009 12:31:01 -0800 From: Pyun YongHyeon Date: Wed, 11 Nov 2009 12:31:01 -0800 To: Mike Tancsa Message-ID: <20091111203101.GC15449@michelle.cdnetworks.com> References: <20091017222314.GB19204@michelle.cdnetworks.com> <200911092033.nA9KX6dD013378@lava.sentex.ca> <200911092215.nA9MFeDP013898@lava.sentex.ca> <2a41acea0911091459w2b4fec5djd64d0324557b7da2@mail.gmail.com> <200911100021.nAA0LvMG014534@lava.sentex.ca> <2a41acea0911091633u2899b47ewb514b6276ba2cf62@mail.gmail.com> <200911100227.nAA2RtDY015177@lava.sentex.ca> <2a41acea0911101057q4f913e30m9319e52bbd254cfe@mail.gmail.com> <2a41acea0911101120o39fd695cpa325736d00b11587@mail.gmail.com> <200911102018.nAAKI3s7021614@lava.sentex.ca> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200911102018.nAAKI3s7021614@lava.sentex.ca> User-Agent: Mutt/1.4.2.3i Cc: jfv@freebsd.org, Mykola Dzham , re , Jack Vogel , current@freebsd.org Subject: Re: page fault in igb driver on 8.0-RC2 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Nov 2009 20:31:35 -0000 On Tue, Nov 10, 2009 at 03:18:09PM -0500, Mike Tancsa wrote: > At 02:20 PM 11/10/2009, Jack Vogel wrote: > >This is a fix for this problem, please apply and test this. > > Hi, > Thanks! Yes, I am able to use both ports of the NIC now and > no panics yet. Prior to this patch, bringing up both ports resulted > in a non functioning NIC and panic! Generating some UDP and tcp > traffic through the box, all seems to be OK on first blush. > I think this is a separate issue. Jack's patch surely reduce the number of chance of bus_dmamap_load_mbuf_sg(9) failure because it removed unnecessary DMA alignment restriction but once it happen you would get the same result. Note, original poster's machine is amd64. > I will try some more extensive tests over the next little while. > > igb0: Excessive collisions = 0 > igb0: Sequence errors = 0 > igb0: Defer count = 0 > igb0: Missed Packets = 0 > igb0: Receive No Buffers = 40 > igb0: Receive Length Errors = 0 > igb0: Receive errors = 2 > igb0: Crc errors = 4 > igb0: Alignment errors = 0 > igb0: Collision/Carrier extension errors = 0 > igb0: RX overruns = 0 > igb0: watchdog timeouts = 0 > igb0: XON Rcvd = 0 > igb0: XON Xmtd = 0 > igb0: XOFF Rcvd = 0 > igb0: XOFF Xmtd = 0 > igb0: Good Packets Rcvd = 103212774 > igb0: Good Packets Xmtd = 9347339 > igb0: TSO Contexts Xmtd = 0 > igb0: TSO Contexts Failed = 0 > igb1: Excessive collisions = 0 > igb1: Sequence errors = 0 > igb1: Defer count = 0 > igb1: Missed Packets = 0 > igb1: Receive No Buffers = 0 > igb1: Receive Length Errors = 0 > igb1: Receive errors = 0 > igb1: Crc errors = 0 > igb1: Alignment errors = 0 > igb1: Collision/Carrier extension errors = 0 > igb1: RX overruns = 0 > igb1: watchdog timeouts = 0 > igb1: XON Rcvd = 0 > igb1: XON Xmtd = 0 > igb1: XOFF Rcvd = 0 > igb1: XOFF Xmtd = 0 > igb1: Good Packets Rcvd = 9365642 > igb1: Good Packets Xmtd = 17781877 > igb1: TSO Contexts Xmtd = 988 > igb1: TSO Contexts Failed = 0 > > > > # ./netsend 10.255.255.3 600 300 280000 10 > Sending packet of payload size 300 every 0.000003571s for 10 seconds > > start: 1257884127.000000000 > finish: 1257884137.000003339 > send calls: 2800336 > send errors: 1970 > approx send rate: 279836 > approx error rate: 0 > waited: 1259257 > approx waits/sec: 125925 > approx wait rate: 0 > # traceroute 10.255.255.3 > traceroute to 10.255.255.3 (10.255.255.3), 64 hops max, 40 byte packets > 1 1.1.1.1 (1.1.1.1) 0.096 ms 0.073 ms 0.115 ms > 2 10.255.255.3 (10.255.255.3) 67.953 ms 0.297 ms 0.241 ms > > The box with the igb nics has the interfaces 1.1.1.1 and 10.255.255.1 > > ---Mike > > > >Jack > > > >------- if_igb.c (revision 197079) > >+++ if_igb.c (working copy) > >@@ -2654,7 +2654,7 @@ > > int error; > > > > error = bus_dma_tag_create(bus_get_dma_tag(adapter->dev), /* parent */ > >- IGB_DBA_ALIGN, 0, /* alignment, bounds */ > >+ 1, 0, /* alignment, bounds */ > > BUS_SPACE_MAXADDR, /* lowaddr */ > > BUS_SPACE_MAXADDR, /* highaddr */ > > NULL, NULL, /* filter, filterarg */ > >@@ -2867,7 +2867,7 @@ > > * Setup DMA descriptor areas. > > */ > > if ((error = bus_dma_tag_create(NULL, /* parent */ > >- PAGE_SIZE, 0, /* alignment, bounds */ > >+ 1, 0, /* alignment, bounds */ > > BUS_SPACE_MAXADDR, /* lowaddr */ > > BUS_SPACE_MAXADDR, /* highaddr */ > > NULL, NULL, /* filter, filterarg */ > >@@ -3554,7 +3554,7 @@ > > ** it may not always use this. > > */ > > if ((error = bus_dma_tag_create(NULL, /* parent */ > >- PAGE_SIZE, 0, /* alignment, bounds */ > >+ 1, 0, /* alignment, bounds */ > > BUS_SPACE_MAXADDR, /* lowaddr */ > > BUS_SPACE_MAXADDR, /* highaddr */ > > NULL, NULL, /* filter, filterarg */ > > > > > > > >On Tue, Nov 10, 2009 at 10:57 AM, Jack Vogel > ><jfvogel@gmail.com> wrote: > >I have repro'd this failure this morning and think I have a fix for > >it, I am testing that soon. > > > >Stay tuned, > > > >Jack > > > > > > > >On Mon, Nov 9, 2009 at 6:28 PM, Mike Tancsa > ><mike@sentex.net> wrote: > >At 07:33 PM 11/9/2009, Jack Vogel wrote: > >Some reason you aren't using amd64? I will have a system installed that way > >and see if I can repro it then, thanks. > > > > > > > >I had found in the past i386 was faster for firewall and routing > >applications. Perhaps thats different now, I will give it a try > >again to see if there is any difference. > > > >pciconf and dmesg attached. > > > > ---Mike > > > > > > > >Jack > > > > > > > >On Mon, Nov 9, 2009 at 4:22 PM, Mike Tancsa > ><mike@sentex.net> wrote: > >At 05:59 PM 11/9/2009, Jack Vogel wrote: > >Are you using standard MTU or jumbo? That get_buf error is ENOMEM, looks > >like > >that happens when in the bus_dma stuff reserve_bounce_pages() fails. > > > >Are you maybe using a 32 bit kernel? I have not seen this failure here. > > > > > >Hi Jack, > > Standard MTU and i386 > > > > ---Mike > > > > > > > >-------------------------------------------------------------------- > >Mike Tancsa, tel +1 519 651 3400 > >Sentex Communications, mike@sentex.net > >Providing Internet since > >1994 > ><http://www.sentex.net>www.sentex.net > >Cambridge, Ontario > >Canada > ><http://www.sentex.net/mike>www.sentex.net/mike > > > > > >-------------------------------------------------------------------- > >Mike Tancsa, tel +1 519 651 3400 > >Sentex > >Communications, > >mike@sentex.net > >Providing Internet since > >1994 www.sentex.net > >Cambridge, Ontario > >Canada > >www.sentex.net/mike > > > > > > -------------------------------------------------------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet since 1994 www.sentex.net > Cambridge, Ontario Canada www.sentex.net/mike >