Date: Tue, 4 May 2010 09:57:45 -0500 From: Bryce Edwards <bryce@bryce.net> To: George Neville-Neil <gnn@neville-neil.com> Cc: freebsd-performance@freebsd.org Subject: Re: 8-STABLE performance issues on Supermicro Core i7 Message-ID: <n2i34da63c51005040757x74466058o2b1f19c7604e26b2@mail.gmail.com> In-Reply-To: <799E6FA3-58E1-473F-A249-AF606C19F7A2@neville-neil.com> References: <m2j34da63c51005010810r21e40b23m76d9beccd5daaf8c@mail.gmail.com> <799E6FA3-58E1-473F-A249-AF606C19F7A2@neville-neil.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Bingo, looks it was the Legacy USB setting in the BIOS. I had it on
"Auto" (default) and the docs say it will disable unless there is
legacy USB devices.
I have now put all the other BIOS options to default (except enabling
AHCI) and here's what buildworld now looks like:
2h39m29.20s real 11h35m35.36s user
3h28m19.15s sys
Now I need to go research more about this to understand more about the
Legacy USB behavior.
::Bryce::
On Mon, May 3, 2010 at 1:34 PM, George Neville-Neil
<gnn@neville-neil.com> wrote:
>
> On May 1, 2010, at 11:10 , Bryce Edwards wrote:
>
>> Hello,
>>
>> I've got a new Supermicro X58 system with an Intel Core i7 930 with 6
>> GB ram that is not performing nearly as fast as it should in many ways
>> (compiling, network transfers). =A0To give an example, it has been
>> building the gcc44 port for about 10 hours now and at the same time
>> rsync'ing from a Linux box on the same Gigabit network is only getting
>> throughput of between 10-25 MB/sec. =A0When I did a buildkernel for
>> 8-STABLE, it took 17 hours!
>>
>> In the BIOS, I have played with a few settings and some actually made
>> it worse. =A0What I have done now is disabled Hyperthreading and
>> Speedstep. =A0I have attached the dmesg details, and here's some system
>> info and then some system stats:
>>
>>
>> bryce@tahiti[~]>uname -a
>> FreeBSD tahiti.bryce.net 8.0-STABLE FreeBSD 8.0-STABLE #0: Wed Apr 28
>> 10:53:37 CDT 2010
>> root@tahiti.bryce.net:/usr/obj/usr/src/sys/GENERIC =A0amd64
>>
>>
>>
>> bryce@tahiti[~]>cat /boot/loader.conf
>> ahci_load=3D"YES"
>> ichsmb_load=3D"YES"
>> smb_load=3D"YES"
>> coretemp_load=3D"YES"
>>
>> zfs_load=3D"YES"
>> vfs.root.mountfrom=3D"zfs:system"
>>
>> hint.p4tcc.0.disabled=3D1
>> hint.acpi_throttle.0.disabled=3D1
>>
>>
>> bryce@tahiti[~]>cat /etc/sysctl.conf
>> kern.timecounter.hardware=3DHPET
>>
>>
>> bryce@tahiti[~]>vmstat 1
>> procs =A0 =A0 =A0memory =A0 =A0 =A0page =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =
=A0 =A0disks =A0 =A0 faults =A0 =A0 =A0 =A0 cpu
>> r b w =A0 =A0 avm =A0 =A0fre =A0 flt =A0re =A0pi =A0po =A0 =A0fr =A0sr a=
d0 ad1 =A0 in =A0 sy
>> cs us sy id
>> 5 0 0 =A0 1068M =A03478M =A0 572 =A0 1 =A0 1 =A0 0 =A0 862 =A0 0 =A0 0 =
=A0 0 9370 16514
>> 16157 71 22 =A07
>> 5 0 0 =A0 1068M =A03478M =A0 =A0 2 =A0 0 =A0 0 =A0 0 =A0 =A0 0 =A0 0 =A0=
0 =A0 0 8008 14504
>> 11716 81 17 =A02
>> 5 0 0 =A0 1068M =A03478M =A0 =A0 0 =A0 0 =A0 0 =A0 0 =A0 =A0 0 =A0 0 =A0=
0 =A0 0 12429 22323
>> 18125 77 23 =A00
>> 5 0 0 =A0 1068M =A03478M =A0 =A0 0 =A0 0 =A0 0 =A0 0 =A0 =A0 0 =A0 0 =A0=
0 =A0 0 12348 22125
>> 17988 73 27 =A00
>>
>>
>> bryce@tahiti[~]>vmstat -i
>> interrupt =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0total =A0 =
=A0 =A0 rate
>> irq1: atkbd0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A09291 =A0 =A0=
=A0 =A0 =A00
>> irq17: fwohci0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 1 =A0 =A0=
=A0 =A0 =A00
>> cpu0: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75416246 =A0 =A0 =A0=
2000
>> irq256: em0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0137590284 =A0 =A0 =A0=
3649
>> irq257: em0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0206367605 =A0 =A0 =A0=
5473
>> irq260: em0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A01 =A0=
=A0 =A0 =A0 =A00
>> irq266: ahci0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A09892384 =A0 =A0 =A0=
=A0262
>> cpu2: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75415653 =A0 =A0 =A0=
2000
>> cpu3: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75415702 =A0 =A0 =A0=
2000
>> cpu1: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75415561 =A0 =A0 =A0=
2000
>> Total =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0655522728 =A0 =
=A0 =A017385
>>
>>
>> bryce@tahiti[~]>netstat -I em0 -h 1
>> =A0 =A0 =A0 =A0 =A0 =A0input =A0 =A0 =A0 =A0 =A0(em0) =A0 =A0 =A0 =A0 =
=A0 output
>> =A0 packets =A0errs idrops =A0 =A0 =A0bytes =A0 =A0packets =A0errs =A0 =
=A0 =A0bytes colls
>> =A0 =A0 =A07.7K =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A011M =A0 =A0 =A0 7.2K =
=A0 =A0 0 =A0 =A0 =A0 475K =A0 =A0 0
>> =A0 =A0 =A08.1K =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A012M =A0 =A0 =A0 7.4K =
=A0 =A0 0 =A0 =A0 =A0 491K =A0 =A0 0
>> =A0 =A0 =A07.8K =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A011M =A0 =A0 =A0 7.2K =
=A0 =A0 0 =A0 =A0 =A0 476K =A0 =A0 0
>>
>> bryce@tahiti[/usr/adm]>iostat 1
>> =A0 =A0 =A0 tty =A0 =A0 =A0 =A0 =A0 =A0ada0 =A0 =A0 =A0 =A0 =A0 =A0 ada1=
=A0 =A0 =A0 =A0 =A0 =A0 ada2 =A0 =A0 =A0 =A0 =A0 =A0 cpu
>> tin =A0tout =A0KB/t tps =A0MB/s =A0 KB/t tps =A0MB/s =A0 KB/t tps =A0MB/=
s =A0us ni sy in id
>> =A0 0 =A0 108 22.35 =A0 3 =A00.07 =A020.61 =A0 3 =A00.07 =A058.60 =A0 0 =
=A00.00 =A071 =A00 =A04 17 =A07
>> =A0 0 =A0 222 64.00 =A0 1 =A00.06 =A0128.00 =A0 1 =A00.12 =A0 0.00 =A0 0=
=A00.00 =A087 =A00 =A02 11 =A00
>
> First thing to try. =A0Turn off Legacy USB in the BIOS.
>
> Is this a 2 CPU machine with only one CPU installed? =A0Make sure your me=
mory is all
> in the correct slots, on modern (non Front Side Bus) machines like Nehale=
m
> only the memory in the slots that are adjacent to a CPU are seen by the C=
PU.
>
> I gather you have a kernel with INVARIANTS, WITNESS and the like turned o=
ff, correct?
>
> Best,
> George
>
>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?n2i34da63c51005040757x74466058o2b1f19c7604e26b2>