From owner-freebsd-net@FreeBSD.ORG Thu Jul 19 08:46:56 2007 Return-Path: X-Original-To: freebsd-net@freebsd.org Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DE2B416A402 for ; Thu, 19 Jul 2007 08:46:56 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.182]) by mx1.freebsd.org (Postfix) with ESMTP id B558E13C4CA for ; Thu, 19 Jul 2007 08:46:56 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: by wa-out-1112.google.com with SMTP id j37so580374waf for ; Thu, 19 Jul 2007 01:46:56 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=XsQUcigE22aJkQDH9MMtQzHxIR9tAJfcc8d2NdobDTbupga6HKpcxE5xZCfpq+co3u4Aq1ODmMydXpBsnmE4EJOmMDd6diQzlOhMuWC3gxhcnIbtUMyEOfrV426kWyAxqbAqOle6ESFqBe4SqIzwT7wOchfOpOe3EOToRy3mzCg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=TXFxWpEKU+/cGczJZFpMxxdfQZLGbtzBOX3rDVQmOb/C4ENXXeiQPCteadUAuIFHILUP3QFofm0Dv/VR0W5pked0vh0F7TfOAYuJroVphCqz6uX6p3CKVFXlI/PPPh6V4qcW/wzMvnxAZF9b97oqpCkFeQr60xnSJsGXUJGt1nk= Received: by 10.114.166.1 with SMTP id o1mr2363352wae.1184834816203; Thu, 19 Jul 2007 01:46:56 -0700 (PDT) Received: by 10.114.103.14 with HTTP; Thu, 19 Jul 2007 01:46:56 -0700 (PDT) Message-ID: <2a41acea0707190146q2fcc5d9cq865e9571cd6104e3@mail.gmail.com> Date: Thu, 19 Jul 2007 01:46:56 -0700 From: "Jack Vogel" To: "Andre Oppermann" In-Reply-To: <469F1D32.2040700@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <2a41acea0707181152r4c662b00tf1be7b6b4dce74f1@mail.gmail.com> <2a41acea0707181542q23d36733o339448ad86f480cb@mail.gmail.com> <469F1D32.2040700@freebsd.org> Cc: freebsd-net , FreeBSD Current Subject: Re: 10G and socket alloc failure X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jul 2007 08:46:57 -0000 On 7/19/07, Andre Oppermann wrote: > Jack Vogel wrote: > > While testing out the ixgbe driver we've observed this failure in the stack > > code, here is the info: > > > > The test engineer is using iperf, typically with 16 threads. If the > > driver is using > > either legacy or MSI interrupts we will see broken pipes, in dmesg its > > due to sonewconn() failing in syncache_socket(). > > > > Whats interesting is that when I have multiple RX queues configured and > > using MSI/X this doesnt happen, at least not very often. > > > > It does not seem to hurt performance horribly, iperf just spawns another > > thread, but I was wondering if there is some underlying tuneable I dont > > know about that would stop this from happening?? > > > > And any theory about why it doesnt happen with multiple queues? > > Do you see any messages in syslog regarding syncache? Yes, the messages are what are emitted in the code i cited above, I could get the dmesg output if that would provide any more help. I figured the point at which it is failing is pretty specific and someone might know just from that what it was :) Jack