From owner-freebsd-performance@FreeBSD.ORG Tue May 4 14:58:00 2010 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CF75B106566C for ; Tue, 4 May 2010 14:58:00 +0000 (UTC) (envelope-from bryce@bryce.net) Received: from mail-gw0-f54.google.com (mail-gw0-f54.google.com [74.125.83.54]) by mx1.freebsd.org (Postfix) with ESMTP id 9629C8FC25 for ; Tue, 4 May 2010 14:58:00 +0000 (UTC) Received: by gwj21 with SMTP id 21so1842838gwj.13 for ; Tue, 04 May 2010 07:57:56 -0700 (PDT) MIME-Version: 1.0 Received: by 10.150.246.8 with SMTP id t8mr11357361ybh.97.1272985065382; Tue, 04 May 2010 07:57:45 -0700 (PDT) Received: by 10.150.57.11 with HTTP; Tue, 4 May 2010 07:57:45 -0700 (PDT) In-Reply-To: <799E6FA3-58E1-473F-A249-AF606C19F7A2@neville-neil.com> References: <799E6FA3-58E1-473F-A249-AF606C19F7A2@neville-neil.com> Date: Tue, 4 May 2010 09:57:45 -0500 Message-ID: From: Bryce Edwards To: George Neville-Neil Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@freebsd.org Subject: Re: 8-STABLE performance issues on Supermicro Core i7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 May 2010 14:58:00 -0000 Bingo, looks it was the Legacy USB setting in the BIOS. I had it on "Auto" (default) and the docs say it will disable unless there is legacy USB devices. I have now put all the other BIOS options to default (except enabling AHCI) and here's what buildworld now looks like: 2h39m29.20s real 11h35m35.36s user 3h28m19.15s sys Now I need to go research more about this to understand more about the Legacy USB behavior. ::Bryce:: On Mon, May 3, 2010 at 1:34 PM, George Neville-Neil wrote: > > On May 1, 2010, at 11:10 , Bryce Edwards wrote: > >> Hello, >> >> I've got a new Supermicro X58 system with an Intel Core i7 930 with 6 >> GB ram that is not performing nearly as fast as it should in many ways >> (compiling, network transfers). =A0To give an example, it has been >> building the gcc44 port for about 10 hours now and at the same time >> rsync'ing from a Linux box on the same Gigabit network is only getting >> throughput of between 10-25 MB/sec. =A0When I did a buildkernel for >> 8-STABLE, it took 17 hours! >> >> In the BIOS, I have played with a few settings and some actually made >> it worse. =A0What I have done now is disabled Hyperthreading and >> Speedstep. =A0I have attached the dmesg details, and here's some system >> info and then some system stats: >> >> >> bryce@tahiti[~]>uname -a >> FreeBSD tahiti.bryce.net 8.0-STABLE FreeBSD 8.0-STABLE #0: Wed Apr 28 >> 10:53:37 CDT 2010 >> root@tahiti.bryce.net:/usr/obj/usr/src/sys/GENERIC =A0amd64 >> >> >> >> bryce@tahiti[~]>cat /boot/loader.conf >> ahci_load=3D"YES" >> ichsmb_load=3D"YES" >> smb_load=3D"YES" >> coretemp_load=3D"YES" >> >> zfs_load=3D"YES" >> vfs.root.mountfrom=3D"zfs:system" >> >> hint.p4tcc.0.disabled=3D1 >> hint.acpi_throttle.0.disabled=3D1 >> >> >> bryce@tahiti[~]>cat /etc/sysctl.conf >> kern.timecounter.hardware=3DHPET >> >> >> bryce@tahiti[~]>vmstat 1 >> procs =A0 =A0 =A0memory =A0 =A0 =A0page =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 = =A0 =A0disks =A0 =A0 faults =A0 =A0 =A0 =A0 cpu >> r b w =A0 =A0 avm =A0 =A0fre =A0 flt =A0re =A0pi =A0po =A0 =A0fr =A0sr a= d0 ad1 =A0 in =A0 sy >> cs us sy id >> 5 0 0 =A0 1068M =A03478M =A0 572 =A0 1 =A0 1 =A0 0 =A0 862 =A0 0 =A0 0 = =A0 0 9370 16514 >> 16157 71 22 =A07 >> 5 0 0 =A0 1068M =A03478M =A0 =A0 2 =A0 0 =A0 0 =A0 0 =A0 =A0 0 =A0 0 =A0= 0 =A0 0 8008 14504 >> 11716 81 17 =A02 >> 5 0 0 =A0 1068M =A03478M =A0 =A0 0 =A0 0 =A0 0 =A0 0 =A0 =A0 0 =A0 0 =A0= 0 =A0 0 12429 22323 >> 18125 77 23 =A00 >> 5 0 0 =A0 1068M =A03478M =A0 =A0 0 =A0 0 =A0 0 =A0 0 =A0 =A0 0 =A0 0 =A0= 0 =A0 0 12348 22125 >> 17988 73 27 =A00 >> >> >> bryce@tahiti[~]>vmstat -i >> interrupt =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0total =A0 = =A0 =A0 rate >> irq1: atkbd0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A09291 =A0 =A0= =A0 =A0 =A00 >> irq17: fwohci0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 1 =A0 =A0= =A0 =A0 =A00 >> cpu0: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75416246 =A0 =A0 =A0= 2000 >> irq256: em0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0137590284 =A0 =A0 =A0= 3649 >> irq257: em0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0206367605 =A0 =A0 =A0= 5473 >> irq260: em0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A01 =A0= =A0 =A0 =A0 =A00 >> irq266: ahci0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A09892384 =A0 =A0 =A0= =A0262 >> cpu2: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75415653 =A0 =A0 =A0= 2000 >> cpu3: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75415702 =A0 =A0 =A0= 2000 >> cpu1: timer =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 75415561 =A0 =A0 =A0= 2000 >> Total =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0655522728 =A0 = =A0 =A017385 >> >> >> bryce@tahiti[~]>netstat -I em0 -h 1 >> =A0 =A0 =A0 =A0 =A0 =A0input =A0 =A0 =A0 =A0 =A0(em0) =A0 =A0 =A0 =A0 = =A0 output >> =A0 packets =A0errs idrops =A0 =A0 =A0bytes =A0 =A0packets =A0errs =A0 = =A0 =A0bytes colls >> =A0 =A0 =A07.7K =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A011M =A0 =A0 =A0 7.2K = =A0 =A0 0 =A0 =A0 =A0 475K =A0 =A0 0 >> =A0 =A0 =A08.1K =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A012M =A0 =A0 =A0 7.4K = =A0 =A0 0 =A0 =A0 =A0 491K =A0 =A0 0 >> =A0 =A0 =A07.8K =A0 =A0 0 =A0 =A0 0 =A0 =A0 =A0 =A011M =A0 =A0 =A0 7.2K = =A0 =A0 0 =A0 =A0 =A0 476K =A0 =A0 0 >> >> bryce@tahiti[/usr/adm]>iostat 1 >> =A0 =A0 =A0 tty =A0 =A0 =A0 =A0 =A0 =A0ada0 =A0 =A0 =A0 =A0 =A0 =A0 ada1= =A0 =A0 =A0 =A0 =A0 =A0 ada2 =A0 =A0 =A0 =A0 =A0 =A0 cpu >> tin =A0tout =A0KB/t tps =A0MB/s =A0 KB/t tps =A0MB/s =A0 KB/t tps =A0MB/= s =A0us ni sy in id >> =A0 0 =A0 108 22.35 =A0 3 =A00.07 =A020.61 =A0 3 =A00.07 =A058.60 =A0 0 = =A00.00 =A071 =A00 =A04 17 =A07 >> =A0 0 =A0 222 64.00 =A0 1 =A00.06 =A0128.00 =A0 1 =A00.12 =A0 0.00 =A0 0= =A00.00 =A087 =A00 =A02 11 =A00 > > First thing to try. =A0Turn off Legacy USB in the BIOS. > > Is this a 2 CPU machine with only one CPU installed? =A0Make sure your me= mory is all > in the correct slots, on modern (non Front Side Bus) machines like Nehale= m > only the memory in the slots that are adjacent to a CPU are seen by the C= PU. > > I gather you have a kernel with INVARIANTS, WITNESS and the like turned o= ff, correct? > > Best, > George > >