Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 30 Jun 2010 13:01:50 -0400
From:      Alexander Sack <pisymbol@gmail.com>
To:        Mike Carlson <carlson39@llnl.gov>
Cc:        freebsd-net@freebsd.org
Subject:   Re: Intel 10Gb nic (ix driver) and bizarre netstat output
Message-ID:  <AANLkTimuSqZRsbo_yd4iLdNk6xsgSDSwEtEJ46XP-krj@mail.gmail.com>
In-Reply-To: <4C28CFBE.6050903@llnl.gov>
References:  <4C28CFBE.6050903@llnl.gov>

next in thread | previous in thread | raw e-mail | index | archive | help
M

On Mon, Jun 28, 2010 at 12:37 PM, Mike Carlson <carlson39@llnl.gov> wrote:
> I've got a 10Gb intel nic on a FreeBSD 8.0-p3/AMD64 system, using the ix
> driver:
>
> ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 1.8.9> por=
t
> 0xdce0-0xdcff mem 0xdf3a0000-0xdf3bffff,0xdf3c0000-
> 0xdf3fffff,0xdf39c000-0xdf39ffff irq 35 at device 0.0 on pci5
> ix0: Using MSIX interrupts with 17 vectors
> ix0: [ITHREAD]
> ...
> ix0: Ethernet address: 00:1b:21:3f:b5:fc
>
> ix0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 91=
94
>
> =A0options=3D5bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWC=
SUM,TSO4,LRO>
> =A0 =A0ether 00:1b:21:3f:b5:fc
> =A0 =A0inet 192.168.6.56 netmask 0xffffff00 broadcast 192.168.6.255
> =A0 =A0media: Ethernet autoselect (10Gbase-LR <full-duplex>)
> =A0 =A0status: active
>
> What seems a bit odd is even when they system is 'idle', netstat reports =
a
> burst of outgoing data at an unpredictable interval:
> # netstat -I ix0 -w 1
> =A0 =A0 =A0 =A0 =A0 =A0input =A0 =A0 =A0 =A0 =A0(ix0) =A0 =A0 =A0 =A0 =A0=
 output
> =A0 packets =A0errs =A0 =A0 =A0bytes =A0 =A0packets =A0errs =A0 =A0 =A0by=
tes colls
> =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0496 =A0 =A0 =A0 =A0 =A01 =A0 =
=A0 0 18446744073709551436 =A0 =A0 0
> =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0252 =A0 =A0 =A0 =A0 =A01 =A0 =
=A0 0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 0
> =A0 =A0 =A0 =A028 =A0 =A0 0 =A0 =A0 =A019768 =A0 =A0 =A0 =A0 42 =A0 =A0 0=
 =A0 =A0 =A0 =A0 =A00 =A0 =A0 0
> =A0 =A0 =A0 =A0 2 =A0 =A0 0 =A0 =A0 =A0 =A0316 =A0 =A0 =A0 =A0 =A01 =A0 =
=A0 0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 0
> =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0252 =A0 =A0 =A0 =A0 =A01 =A0 =
=A0 0 =A0 =A0 =A0 =A0 =A00 =A0 =A0 0
>
> That large "burst" becomes more frequent if there is a reasonable network
> load on the server (like a NFS or Samba file transfer):
> # netstat -I ix0 -w 1
> =A0 =A0 =A0 =A0 =A0 =A0input =A0 =A0 =A0 =A0 =A0(ix0) =A0 =A0 =A0 =A0 =A0=
 output
> =A0 packets =A0errs =A0 =A0 =A0bytes =A0 =A0packets =A0errs =A0 =A0 =A0by=
tes colls
> =A0 =A0 =A0 =A0 1 =A0 =A0 0 =A0 =A0 =A0 =A0496 =A0 =A0 =A0 =A0 =A01 =A0 =
=A0 0 18446744073709551436 =A0 =A0 0
> =A0 =A0 =A01652 =A0 =A0 0 =A0 =A01601979 =A0 =A0 =A0 2310 =A0 =A0 0 =A0 =
=A0 113716 =A0 =A0 0
> =A0 =A0 =A0 337 =A0 =A0 0 =A0 =A0 521230 =A0 =A0 =A0 =A0397 =A0 =A0 0 184=
46744073709437900 =A0 =A0 0
> =A0 =A0 =A07562 =A0 =A0 0 =A0 =A0 276543 =A0 =A0 =A014580 =A0 =A0 0 =A0 2=
1130649 =A0 =A0 0
> =A0 =A0 33784 =A0 =A0 0 =A0 90243561 =A0 =A0 =A065289 =A0 =A0 0 =A0 =A063=
98014 =A0 =A0 0
> =A0 =A0 34929 =A0 =A0 0 =A0101041195 =A0 =A0 =A067431 =A0 =A0 0 184467440=
73708070746 =A0 =A0 0
> =A0 =A0 36180 =A0 =A0 0 =A0102019403 =A0 =A0 =A070112 =A0 =A0 0 =A0 =A0 9=
32461 =A0 =A0 0
> =A0 =A0 36337 =A0 =A0 0 =A0104575965 =A0 =A0 =A070340 =A0 =A0 0 184467440=
73708694467 =A0 =A0 0
> =A0 =A0 35933 =A0 =A0 0 =A0104627291 =A0 =A0 =A069241 =A0 =A0 0 184467440=
73707935998 =A0 =A0 0
> =A0 =A0 36498 =A0 =A0 0 =A0104697232 =A0 =A0 =A070544 =A0 =A0 0 184467440=
73709094889 =A0 =A0 0
> =A0 =A0 36580 =A0 =A0 0 =A0106044621 =A0 =A0 =A070737 =A0 =A0 0 184467440=
73708270130 =A0 =A0 0
> =A0 =A0 22934 =A0 =A0 0 =A0 80783509 =A0 =A0 =A044337 =A0 =A0 0 184467440=
73694340268 =A0 =A0 0
> =A0 =A0 11469 =A0 =A0 0 =A0 34850586 =A0 =A0 =A022131 =A0 =A0 0 184467440=
73707453470 =A0 =A0 0
> =A0 =A0 15661 =A0 =A0 0 =A0 40976798 =A0 =A0 =A030191 =A0 =A0 0 =A0 =A038=
16924 =A0 =A0 0
> =A0 =A0 14885 =A0 =A0 0 =A0 40763491 =A0 =A0 =A028572 =A0 =A0 0 =A0 =A017=
94493 =A0 =A0 0
> =A0 =A0 14554 =A0 =A0 0 =A0 47191162 =A0 =A0 =A028140 =A0 =A0 0 184467440=
73703905316 =A0 =A0 0
> =A0 =A0 16620 =A0 =A0 0 =A0 43843276 =A0 =A0 =A032154 =A0 =A0 0 =A0 =A032=
77056 =A0 =A0 0
> =A0 =A0 11800 =A0 =A0 0 =A0 38234856 =A0 =A0 =A022832 =A0 =A0 0 184467440=
73704976762 =A0 =A0 0
> =A0 =A0 14640 =A0 =A0 0 =A0 37771926 =A0 =A0 =A028340 =A0 =A0 0 =A0 =A037=
20383 =A0 =A0 0
> =A0 =A0 12230 =A0 =A0 0 =A0 37078829 =A0 =A0 =A023631 =A0 =A0 0 184467440=
73707401669 =A0 =A0 0
>
> Is this normal? Or, is there something strange about my network environme=
nt,
> and if so, are there any suggestions to help me narrow down the issue?

Have you tried running tcpdump -i ix0 to see what the 42 packets were
when its "idle?"

-aps



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?AANLkTimuSqZRsbo_yd4iLdNk6xsgSDSwEtEJ46XP-krj>