From owner-freebsd-net@FreeBSD.ORG Wed Jun 30 17:01:54 2010 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8E4581065673 for ; Wed, 30 Jun 2010 17:01:54 +0000 (UTC) (envelope-from pisymbol@gmail.com) Received: from mail-gy0-f182.google.com (mail-gy0-f182.google.com [209.85.160.182]) by mx1.freebsd.org (Postfix) with ESMTP id 4166B8FC20 for ; Wed, 30 Jun 2010 17:01:53 +0000 (UTC) Received: by gyf3 with SMTP id 3so702412gyf.13 for ; Wed, 30 Jun 2010 10:01:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:in-reply-to :references:date:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=QL7rQQ48BRvFLugYFDeX24cDfkLGL2HriueYEcaI8lA=; b=DhbvZd2yJlmB8HfoPoFhAJrrxLy4GMHuU6hRAyCrOrNQvJTLFkmQwGHZgr1LAChl+C iXwSkbZE0/4kue36yDQ0MTpGRFZEuNbcETEXNChA+brQjedoiJ6gMqtbqzS3pe4uiU1v ahYHYHJFefDRQXbSXkYfnB2pnBFYuup4NU578= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; b=A7ZxnnBfmsBRz5ovPSNTMPMCySy2qNC7elLoHWKcMC32BryBBIsFu/ppBNPr+5C+HG cj35r1b8W60w8BoDsDbm9zkMp+zyA+nsSbNHXj2/oj1l7FpLVcziCr0yTEccOgGewAB2 6peUZe6yG6ydPK6fJpqiszd/0c/HE+4SJ1vR4= MIME-Version: 1.0 Received: by 10.101.2.32 with SMTP id e32mr11085298ani.73.1277917310749; Wed, 30 Jun 2010 10:01:50 -0700 (PDT) Received: by 10.101.13.8 with HTTP; Wed, 30 Jun 2010 10:01:50 -0700 (PDT) In-Reply-To: <4C28CFBE.6050903@llnl.gov> References: <4C28CFBE.6050903@llnl.gov> Date: Wed, 30 Jun 2010 13:01:50 -0400 Message-ID: From: Alexander Sack To: Mike Carlson Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org Subject: Re: Intel 10Gb nic (ix driver) and bizarre netstat output X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jun 2010 17:01:54 -0000 M On Mon, Jun 28, 2010 at 12:37 PM, Mike Carlson wrote: > I've got a 10Gb intel nic on a FreeBSD 8.0-p3/AMD64 system, using the ix > driver: > > ix0: por= t > 0xdce0-0xdcff mem 0xdf3a0000-0xdf3bffff,0xdf3c0000- > 0xdf3fffff,0xdf39c000-0xdf39ffff irq 35 at device 0.0 on pci5 > ix0: Using MSIX interrupts with 17 vectors > ix0: [ITHREAD] > ... > ix0: Ethernet address: 00:1b:21:3f:b5:fc > > ix0: flags=3D8843 metric 0 mtu 91= 94 > > =A0options=3D5bb > =A0 =A0ether 00:1b:21:3f:b5:fc > =A0 =A0inet 192.168.6.56 netmask 0xffffff00 broadcast 192.168.6.255 > =A0 =A0media: Ethernet autoselect (10Gbase-LR ) > =A0 =A0status: active > > What seems a bit odd is even when they system is 'idle', netstat reports = a > burst of outgoing data at an unpredictable interval: > # netstat -I ix0 -w 1 > =A0 =A0 =A0 =A0 =A0 =A0input =A0 =A0 =A0 =A0 =A0(ix0) =A0 =A0 =A0 =A0 =A0= output > =A0 packets =A0errs =A0 =A0 =A0bytes =A0 =A0packets =A0errs =A0 =A0 =A0by= tes colls > =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0496 =A0 =A0 =A0 =A0 =A01 =A0 = =A0 0 18446744073709551436 =A0 =A0 0 > =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0252 =A0 =A0 =A0 =A0 =A01 =A0 = =A0 0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 0 > =A0 =A0 =A0 =A028 =A0 =A0 0 =A0 =A0 =A019768 =A0 =A0 =A0 =A0 42 =A0 =A0 0= =A0 =A0 =A0 =A0 =A00 =A0 =A0 0 > =A0 =A0 =A0 =A0 2 =A0 =A0 0 =A0 =A0 =A0 =A0316 =A0 =A0 =A0 =A0 =A01 =A0 = =A0 0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 0 > =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0252 =A0 =A0 =A0 =A0 =A01 =A0 = =A0 0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 0 > > That large "burst" becomes more frequent if there is a reasonable network > load on the server (like a NFS or Samba file transfer): > # netstat -I ix0 -w 1 > =A0 =A0 =A0 =A0 =A0 =A0input =A0 =A0 =A0 =A0 =A0(ix0) =A0 =A0 =A0 =A0 =A0= output > =A0 packets =A0errs =A0 =A0 =A0bytes =A0 =A0packets =A0errs =A0 =A0 =A0by= tes colls > =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0496 =A0 =A0 =A0 =A0 =A01 =A0 = =A0 0 18446744073709551436 =A0 =A0 0 > =A0 =A0 =A01652 =A0 =A0 0 =A0 =A01601979 =A0 =A0 =A0 2310 =A0 =A0 0 =A0 = =A0 113716 =A0 =A0 0 > =A0 =A0 =A0 337 =A0 =A0 0 =A0 =A0 521230 =A0 =A0 =A0 =A0397 =A0 =A0 0 184= 46744073709437900 =A0 =A0 0 > =A0 =A0 =A07562 =A0 =A0 0 =A0 =A0 276543 =A0 =A0 =A014580 =A0 =A0 0 =A0 2= 1130649 =A0 =A0 0 > =A0 =A0 33784 =A0 =A0 0 =A0 90243561 =A0 =A0 =A065289 =A0 =A0 0 =A0 =A063= 98014 =A0 =A0 0 > =A0 =A0 34929 =A0 =A0 0 =A0101041195 =A0 =A0 =A067431 =A0 =A0 0 184467440= 73708070746 =A0 =A0 0 > =A0 =A0 36180 =A0 =A0 0 =A0102019403 =A0 =A0 =A070112 =A0 =A0 0 =A0 =A0 9= 32461 =A0 =A0 0 > =A0 =A0 36337 =A0 =A0 0 =A0104575965 =A0 =A0 =A070340 =A0 =A0 0 184467440= 73708694467 =A0 =A0 0 > =A0 =A0 35933 =A0 =A0 0 =A0104627291 =A0 =A0 =A069241 =A0 =A0 0 184467440= 73707935998 =A0 =A0 0 > =A0 =A0 36498 =A0 =A0 0 =A0104697232 =A0 =A0 =A070544 =A0 =A0 0 184467440= 73709094889 =A0 =A0 0 > =A0 =A0 36580 =A0 =A0 0 =A0106044621 =A0 =A0 =A070737 =A0 =A0 0 184467440= 73708270130 =A0 =A0 0 > =A0 =A0 22934 =A0 =A0 0 =A0 80783509 =A0 =A0 =A044337 =A0 =A0 0 184467440= 73694340268 =A0 =A0 0 > =A0 =A0 11469 =A0 =A0 0 =A0 34850586 =A0 =A0 =A022131 =A0 =A0 0 184467440= 73707453470 =A0 =A0 0 > =A0 =A0 15661 =A0 =A0 0 =A0 40976798 =A0 =A0 =A030191 =A0 =A0 0 =A0 =A038= 16924 =A0 =A0 0 > =A0 =A0 14885 =A0 =A0 0 =A0 40763491 =A0 =A0 =A028572 =A0 =A0 0 =A0 =A017= 94493 =A0 =A0 0 > =A0 =A0 14554 =A0 =A0 0 =A0 47191162 =A0 =A0 =A028140 =A0 =A0 0 184467440= 73703905316 =A0 =A0 0 > =A0 =A0 16620 =A0 =A0 0 =A0 43843276 =A0 =A0 =A032154 =A0 =A0 0 =A0 =A032= 77056 =A0 =A0 0 > =A0 =A0 11800 =A0 =A0 0 =A0 38234856 =A0 =A0 =A022832 =A0 =A0 0 184467440= 73704976762 =A0 =A0 0 > =A0 =A0 14640 =A0 =A0 0 =A0 37771926 =A0 =A0 =A028340 =A0 =A0 0 =A0 =A037= 20383 =A0 =A0 0 > =A0 =A0 12230 =A0 =A0 0 =A0 37078829 =A0 =A0 =A023631 =A0 =A0 0 184467440= 73707401669 =A0 =A0 0 > > Is this normal? Or, is there something strange about my network environme= nt, > and if so, are there any suggestions to help me narrow down the issue? Have you tried running tcpdump -i ix0 to see what the 42 packets were when its "idle?" -aps