Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 19 Aug 2009 12:13:37 +0200
From:      Invernizzi Fabrizio <fabrizio.invernizzi@telecomitalia.it>
To:        "freebsd-performance@freebsd.org" <freebsd-performance@freebsd.org>
Subject:   Strange CPU distributionat very high level bandwidth
Message-ID:  <36A93B31228D3B49B691AD31652BCAE9A456967AF4@GRFMBX702BA020.griffon.local>

next in thread | raw e-mail | index | archive | help
--_845582a1-7dd3-48da-9f34-4f3673aeb813_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi all

i am going on with some performance tests on a 10gbe network card with Free=
BSD.

I am doing this test: I send UDP traffic to be forwarded to the other port =
of the card on both the card ports.
Using 1492-long packets i am uppering the number  of packets per second i s=
ent In order to see wich is the maximum bandwidth (or pps) the system can s=
upport without losses.

The limit seems to be about 1890Mbps per port (3870 Mbps total).
Looking more in deep the CPU behaviour i see this :
  - uppering the sent pps results in uppering the intterrupt time (about 90=
%)
  - when i am very strict to the limit, interrupt time falls to about 10% a=
nd CPU is always (85%) in system (rx/tx driver procedure)

Questions:
- Is not the AIM intended to contrast this behaviour to limit interrupts se=
nt to CPU? (nothing changes if i disable it)
- Why does the system start loosing pkts in that condition?
- Why does the system seem to perform better when it is managing more conte=
xt switches?



These are my system details:

- HP 380 G5 (XEON X5420, CPU speed: 2.50GHz, BUS speed: 1333 MHz, L2 cache =
size: 12 MB, L2 cache speed: 2,5 GHz) with 1 quad-core installed.

- Network card: Silicom PE10G2i-LR - Dual Port Fiber (LR) 10 Gigabit Ethern=
et PCI Express Server Adapter Intel(r) based (chip 82598EB).

- FreeBSD 7.2-RELEASE (64 bit)

Driver ixgbe-1.8.6

hw.intr_storm_threshold:2000000

dev.ix.0.low_latency: 128
dev.ix.0.ave_latency: 400
dev.ix.0.bulk_latency: 1200
dev.ix.1.low_latency: 128
dev.ix.1.ave_latency: 400
dev.ix.1.bulk_latency: 1200

------------------------------------------------------------------
Telecom Italia
Fabrizio INVERNIZZI
Technology - TILAB
Accesso Fisso e Trasporto
Via Reiss Romoli, 274 10148 Torino
Tel.  +39 011 2285497
Mob. +39 3316001344
Fax +39 06 41867287

Questo messaggio e i suoi allegati sono indirizzati esclusivamente alle per=
sone indicate. La diffusione, copia o qualsiasi altra azione derivante dall=
a conoscenza di queste informazioni sono rigorosamente vietate. Qualora abb=
iate ricevuto questo documento per errore siete cortesemente pregati di dar=
ne immediata comunicazione al mittente e di provvedere alla sua distruzione=
, Grazie.

This e-mail and any attachments is confidential and may contain privileged =
information intended for the addressee(s) only. Dissemination, copying, pri=
nting or use by anybody else is unauthorised. If you are not the intended r=
ecipient, please delete this message and any attachments and advise the sen=
der by return e-mail, Thanks.

[cid:00000000000000000000000000000001@TI.Disclaimer]Rispetta l'ambiente. No=
n stampare questa mail se non ? necessario.


--_845582a1-7dd3-48da-9f34-4f3673aeb813_--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?36A93B31228D3B49B691AD31652BCAE9A456967AF4>