Date: Tue, 31 May 2005 14:19:15 -0700 From: "Singh, Vijay" <Vijay.Singh@netapp.com> To: "John Baldwin" <jhb@FreeBSD.org>, <freebsd-smp@FreeBSD.org> Subject: RE: 5.4 network performance Message-ID: <637A278D8D0DBC438EA5E75C6E1818B904410F31@magenta.hq.netapp.com>
next in thread | raw e-mail | index | archive | help
> On Tuesday 31 May 2005 01:37 pm, Singh, Vijay wrote:
> > Hello. I am trying to benchmark 5.4 performance for a=20
> company project.
> > I've got:
> >
> > FreeBSD 5.4-RELEASE #0: Fri May 27 20:52:58 PDT 2005
> > admin@netpc13.lab.netapp.com:/usr/obj/usr/src/sys/SMP
> > Timecounter "i8254" frequency 1193182 Hz quality 0
> > CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2395.92-MHz 686-class CPU)
> > Origin =3D "GenuineIntel" Id =3D 0xf27 Stepping =3D 7
> >
> >=20
> =
Features=3D0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,P
> > GE ,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,S
> > SE2,SS,HTT,TM,PBE>
> > Hyperthreading: 2 logical CPUs
> > real memory =3D 1073676288 (1023 MB)
> > avail memory =3D 1041121280 (992 MB)
> > ACPI APIC Table: <RCC GCHE >
> > FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0=20
> (BSP): APIC=20
> > ID: 0
> > cpu1 (AP): APIC ID: 1
> > cpu2 (AP): APIC ID: 2
> > cpu3 (AP): APIC ID: 3
> >
> > em0: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port=20
> > 0xc800-0xc83f mem 0xfe8c0000-0xfe8dffff irq 18 at device 2.0 on pci1
> > em1: <Intel(R) PRO/1000 Network Connection, Version - 1.7.35> port=20
> > 0xd000-0xd03f mem 0xfe8e0000-0xfe8fffff irq 19 at device 2.1 on pci1
> >
> > The UP version of the builds is able to deliver close to=20
> line rate on=20
> > these 2 interfaces. However the SMP build (with WITNESS and=20
> INVARIANTS
> > disabled) gives me half the line rate on them. I am using netperf.
> >
> > /opt/netperf/netperf -H x.x.x.x -f m -l 120
> >
> > Socket Socket Message Elapsed
> > Size Size Size Time Throughput
> > bytes bytes bytes secs. 10^6bits/sec
> >
> > 65536 16384 16384 120.00 429.14
> > 65536 16384 16384 120.00 501.74
> >
> > Is there something I can do to make the system scale? I=20
> cannot move to=20
> > -CURRENT, but I can try pulling patches.
>=20
> Does UP with 'device apic' also show poor performance? Try=20
> disabling USB support in the kernel as some Intel server=20
> motherboards have a "feature" that our APIC code trips over=20
> that can hurt performance by adding lots of stray interrupts=20
> on one of the USB controllers.
>=20
Thanks. I have the following in GENERIC, do I need to comment out all?
Is the problem you mention responsible for the "Interrupt storm
detected" messages? Also I see some ACPI messages (below). Could that
also be a problem?
# USB support
device uhci # UHCI PCI->USB interface
device ohci # OHCI PCI->USB interface
#device ehci # EHCI PCI->USB interface (USB 2.0)
device usb # USB Bus (required)
#device udbp # USB Double Bulk Pipe devices
device ugen # Generic
device uhid # "Human Interface Devices"
device ukbd # Keyboard
device ulpt # Printer
device umass # Disks/Mass storage - Requires scbus
and da
device ums # Mouse
device urio # Diamond Rio 500 MP3 player
device uscanner # Scanners
# USB Ethernet, requires mii
device aue # ADMtek USB Ethernet
device axe # ASIX Electronics USB Ethernet
device cdce # Generic USB over Ethernet
device cue # CATC USB Ethernet
device kue # Kawasaki LSI USB Ethernet
device rue # RealTek RTL8150 USB Ethernet
ACPI-0698: *** Warning: Type override - [DEB_] had invalid type
(Integer) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [MLIB] had invalid type
(Integer) for Scope operator, changed to (Scope)
[...]
ACPI-0698: *** Warning: Type override - [KBC_] had invalid type
(Integer) for Scope operator, changed to (Scope)
ACPI-0698: *** Warning: Type override - [OEM_] had invalid type
(Integer) for Scope operator, changed to (Scope)
Br
vijay
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?637A278D8D0DBC438EA5E75C6E1818B904410F31>