From owner-freebsd-net@FreeBSD.ORG Thu Aug 20 09:42:41 2009 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5769E106568D for ; Thu, 20 Aug 2009 09:42:41 +0000 (UTC) (envelope-from alexpalias-bsdnet@yahoo.com) Received: from web56407.mail.re3.yahoo.com (web56407.mail.re3.yahoo.com [216.252.111.86]) by mx1.freebsd.org (Postfix) with SMTP id F13CF8FC66 for ; Thu, 20 Aug 2009 09:42:40 +0000 (UTC) Received: (qmail 65150 invoked by uid 60001); 20 Aug 2009 09:42:40 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1250761360; bh=8dV90FBevGoXkqghlLqzNbnOcEIHqxfPkWvLHuYlCLI=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=xwdE7hkXfBw86pm/YOhOfSRVXOhG9D124puVJvgegLFtyCV+r5JOTwNuNB2D/Y90hlCvn8OGsbwh/CTKWhtQsqSS07WjDyPCBp3KxduWAmWw4Foh+0vV0LkNNSv+GVMrahhM8lAzwdWdrMVllZlY6VH/APe0JIwQdWRE8RAsRYs= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Reply-To:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=XZj2I7+oZGVroUnQVnEZWfhXXl6N9kx/Zws8wj/+/9ZhQ6LpE9mGR07y7nWRCAJJgjuQss1GsvYqS6eGw7XhvIR2ZFezkpSdKBI0JO4vY9cF0W+BxQr3a2GkfbdOML4Mt5qJ5d4ftxGUCYjteOsmHAaDYVpjsqzfbezq5mo3QS4=; Message-ID: <206677.64959.qm@web56407.mail.re3.yahoo.com> X-YMail-OSG: TQG_2n0VM1l_rToUADNb.KwHwVkRPlJ1Df8EZEfmBl0rGzkVmna4TlZ2jl3TCi8hGvsX6JkCBU_5TjcDgFGDJyLEcris4vPk01wNtj4H.DG8MZapLZFgqJ1sb_lxKibuKH9k2fJJXzYS65crbOWbqPWy05y2KeRtSUi3pYwP167CvzXUH4lzBGCIimIuRyOXUb0.ddGs.P7FCl8xYR4.tpOLOt1Iw7xZ4fsC8NufBxWqtDHf.to0zrSKJqaBxa9RoKSHoPQxRGzMJpXfyCXpvUwjeh_vbIvMcF_KCUW9XWvWetC2GqSuYfmxrZsGx9EFjP06z.8FCA-- Received: from [91.200.96.83] by web56407.mail.re3.yahoo.com via HTTP; Thu, 20 Aug 2009 02:42:40 PDT X-Mailer: YahooMailClassic/6.1.2 YahooMailWebService/0.7.338.1 Date: Thu, 20 Aug 2009 02:42:40 -0700 (PDT) From: alexpalias-bsdnet@yahoo.com To: "H.Fazaeli" In-Reply-To: <4A8D15C9.6020002@sepehrs.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-net@freebsd.org Subject: Re: em driver input errors X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: alexpalias-bsdnet@yahoo.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Aug 2009 09:42:41 -0000 --- On Thu, 8/20/09, H.Fazaeli wrote: > From: H.Fazaeli > Subject: Re: em driver input errors > To: alexpalias-bsdnet@yahoo.com > Cc: freebsd-net@freebsd.org > Date: Thursday, August 20, 2009, 12:22 PM > > > can you provide sysctl dev.em.0.debug=1 output? em0: Adapter hardware address = 0xfffffffe80230320 em0: CTRL = 0x40f00241 RCTL = 0x8002 em0: Packet buffer = Tx=16k Rx=48k em0: Flow control watermarks high = 47104 low = 45604 em0: tx_int_delay = 0, tx_abs_int_delay = 0 em0: rx_int_delay = 0, rx_abs_int_delay = 0 em0: fifo workaround = 0, fifo_reset_count = 0 em0: hw tdh = 259, hw tdt = 259 em0: hw rdh = 603, hw rdt = 602 em0: Num Tx descriptors avail = 4095 em0: Tx Descriptors not avail1 = 0 em0: Tx Descriptors not avail2 = 0 em0: Std mbuf failed = 0 em0: Std mbuf cluster failed = 0 em0: Driver dropped packets = 0 em0: Driver tx dma failure in encap = 0 > There are posts that show the following workarounds have > fixed problems similar to yours on other interface types: > > - disable tso (ifconfig em0 -tso) There's no TSO flag active currently, but I did try it... I guess it's a no-op. Also, the machine is a router, meaning most of the packets are just being forwarded. As far as I understand, TSO is concerned with TCP connections with one local endpoint. Anyway, I did this (after looking in the README for the new intel driver): sysctl net.inet.tcp.tso=0 > - disable msi/msix (hw.em.enable_msi=0 in > /boot/loader.conf. There are also hw.pci.enable_msix and > hw.pci.enable_msi but I don't know their exact > effect). This, and the next one (new driver), will be much harder to try in a production environment... I'll try to find some test machines to torture. > You may also try upgrading to the latest intel em driver > (6.9.12). > http://downloadcenter.intel.com/Filter_Results.aspx?strOSs=52&strTypes=all&ProductID=1067&OSFullName=FreeBSD*&lang=eng > Thanks Alex