From owner-freebsd-performance@FreeBSD.ORG Wed Nov 28 14:56:22 2007 Return-Path: Delivered-To: Freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4340316A41B for ; Wed, 28 Nov 2007 14:56:22 +0000 (UTC) (envelope-from prvs=18527e4b27=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id CB20F13C504 for ; Wed, 28 Nov 2007 14:56:21 +0000 (UTC) (envelope-from prvs=18527e4b27=killing@multiplay.co.uk) DKIM-Signature: v=1; a=rsa-sha256; c=simple; d=multiplay.co.uk; s=Multiplay; t=1196260807; x=1196865607; q=dns/txt; h=Received: Message-ID:From:To:Subject:Date:MIME-Version:Content-Type: Content-Transfer-Encoding; bh=uY+cdHHW9Xzi/OEkoR2NN/kA9m2RyeBIp0 pjxlvPPAI=; b=QPa+vLIdFwJ9+5YpiPDLBakYb3Kfj+QPVc6XHVU1n3g6ZDttrB lU2CSIbglKvorlDy65O4SyLF88CbvFGLLfugzYOpqsSUNRjN66qTZle/peeoIaZ7 +D9+Fq9Reyz3iGynXcv765Zc1aXPYECxdaNEVlmS8JZXXP9s6+gTjrIj0= X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on mail1.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-14.7 required=6.0 tests=BAYES_00, USER_IN_WHITELIST, USER_IN_WHITELIST_TO autolearn=ham version=3.1.8 Received: from r2d2 by mail1.multiplay.co.uk (MDaemon PRO v9.6.2) with ESMTP id md50004539671.msg for ; Wed, 28 Nov 2007 14:40:06 +0000 Message-ID: <03db01c831cc$8ead9890$b6db87d4@multiplay.co.uk> From: "Steven Hartland" To: Date: Wed, 28 Nov 2007 14:40:01 -0000 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3138 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3198 X-Authenticated-Sender: Killing@multiplay.co.uk X-MDRemoteIP: 212.135.219.182 X-Return-Path: prvs=18527e4b27=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: Freebsd-performance@freebsd.org X-Spam-Processed: mail1.multiplay.co.uk, Wed, 28 Nov 2007 14:40:07 +0000 X-MDAV-Processed: mail1.multiplay.co.uk, Wed, 28 Nov 2007 14:40:07 +0000 Cc: Subject: Poor mysql scaling across the board pre 5.1.22? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Nov 2007 14:56:22 -0000 Some interesting comments here: http://www.anandtech.com/IT/showdoc.aspx?i=3162&p=10 Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-performance@FreeBSD.ORG Wed Nov 28 19:13:35 2007 Return-Path: Delivered-To: Freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 83FD416A421 for ; Wed, 28 Nov 2007 19:13:35 +0000 (UTC) (envelope-from kris@FreeBSD.org) Received: from weak.local (pointyhat.freebsd.org [IPv6:2001:4f8:fff6::2b]) by mx1.freebsd.org (Postfix) with ESMTP id D8ACF13C4CE; Wed, 28 Nov 2007 19:13:34 +0000 (UTC) (envelope-from kris@FreeBSD.org) Message-ID: <474DBDE8.10107@FreeBSD.org> Date: Wed, 28 Nov 2007 20:13:44 +0100 From: Kris Kennaway User-Agent: Thunderbird 2.0.0.9 (Macintosh/20071031) MIME-Version: 1.0 To: Steven Hartland References: <03db01c831cc$8ead9890$b6db87d4@multiplay.co.uk> In-Reply-To: <03db01c831cc$8ead9890$b6db87d4@multiplay.co.uk> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Freebsd-performance@freebsd.org Subject: Re: Poor mysql scaling across the board pre 5.1.22? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Nov 2007 19:13:35 -0000 Steven Hartland wrote: > Some interesting comments here: > http://www.anandtech.com/IT/showdoc.aspx?i=3162&p=10 Indeed, mysql 5.0 has poor scaling compared to postgresql (this affects reads but severely affects writes). However when I tested the latest beta of 5.1 about 6 months ago I found it had about 50% lower performance than 5.0 in a read-only configuration. Maybe they had left some debugging enabled or have since fixed it. Kris From owner-freebsd-performance@FreeBSD.ORG Wed Nov 28 19:34:36 2007 Return-Path: Delivered-To: Freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 570C016A4A9; Wed, 28 Nov 2007 19:34:36 +0000 (UTC) (envelope-from kris@FreeBSD.org) Received: from weak.local (pointyhat.freebsd.org [IPv6:2001:4f8:fff6::2b]) by mx1.freebsd.org (Postfix) with ESMTP id 78B3413C4D1; Wed, 28 Nov 2007 19:34:35 +0000 (UTC) (envelope-from kris@FreeBSD.org) Message-ID: <474DC2D5.60107@FreeBSD.org> Date: Wed, 28 Nov 2007 20:34:45 +0100 From: Kris Kennaway User-Agent: Thunderbird 2.0.0.9 (Macintosh/20071031) MIME-Version: 1.0 To: Alfred Perlstein References: <03db01c831cc$8ead9890$b6db87d4@multiplay.co.uk> <474DBDE8.10107@FreeBSD.org> <20071128193158.GD71382@elvis.mu.org> In-Reply-To: <20071128193158.GD71382@elvis.mu.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Freebsd-performance@freebsd.org, Steven Hartland Subject: Re: Poor mysql scaling across the board pre 5.1.22? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Nov 2007 19:34:36 -0000 Alfred Perlstein wrote: > * Kris Kennaway [071128 11:13] wrote: >> Steven Hartland wrote: >>> Some interesting comments here: >>> http://www.anandtech.com/IT/showdoc.aspx?i=3162&p=10 >> Indeed, mysql 5.0 has poor scaling compared to postgresql (this affects >> reads but severely affects writes). However when I tested the latest >> beta of 5.1 about 6 months ago I found it had about 50% lower >> performance than 5.0 in a read-only configuration. Maybe they had left >> some debugging enabled or have since fixed it. > > One thing that mysql can suffer from is the lack of row level locking > for MYISAM tables, I found that to be a write performance killer with > multiple concurrent accesses. > > INNODB is supposedly better. This was innodb, afaicr. Kris From owner-freebsd-performance@FreeBSD.ORG Wed Nov 28 19:51:51 2007 Return-Path: Delivered-To: Freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0806F16A476 for ; Wed, 28 Nov 2007 19:51:51 +0000 (UTC) (envelope-from bright@elvis.mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id F2DEE13C447 for ; Wed, 28 Nov 2007 19:51:50 +0000 (UTC) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id 32A081A4D81; Wed, 28 Nov 2007 11:31:58 -0800 (PST) Date: Wed, 28 Nov 2007 11:31:58 -0800 From: Alfred Perlstein To: Kris Kennaway Message-ID: <20071128193158.GD71382@elvis.mu.org> References: <03db01c831cc$8ead9890$b6db87d4@multiplay.co.uk> <474DBDE8.10107@FreeBSD.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <474DBDE8.10107@FreeBSD.org> User-Agent: Mutt/1.4.2.3i Cc: Freebsd-performance@freebsd.org, Steven Hartland Subject: Re: Poor mysql scaling across the board pre 5.1.22? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Nov 2007 19:51:51 -0000 * Kris Kennaway [071128 11:13] wrote: > Steven Hartland wrote: > >Some interesting comments here: > >http://www.anandtech.com/IT/showdoc.aspx?i=3162&p=10 > > Indeed, mysql 5.0 has poor scaling compared to postgresql (this affects > reads but severely affects writes). However when I tested the latest > beta of 5.1 about 6 months ago I found it had about 50% lower > performance than 5.0 in a read-only configuration. Maybe they had left > some debugging enabled or have since fixed it. One thing that mysql can suffer from is the lack of row level locking for MYISAM tables, I found that to be a write performance killer with multiple concurrent accesses. INNODB is supposedly better. -- - Alfred Perlstein From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 00:29:25 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6A09516A417 for ; Sat, 1 Dec 2007 00:29:25 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from webaccess-cl.virtdom.com (webaccess-cl.virtdom.com [216.240.101.25]) by mx1.freebsd.org (Postfix) with ESMTP id 257EC13C442 for ; Sat, 1 Dec 2007 00:29:25 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from [192.168.1.107] (cpe-24-94-75-93.hawaii.res.rr.com [24.94.75.93]) (authenticated bits=0) by webaccess-cl.virtdom.com (8.13.6/8.13.6) with ESMTP id lB10TMBE085707; Fri, 30 Nov 2007 19:29:23 -0500 (EST) (envelope-from jroberson@chesapeake.net) Date: Fri, 30 Nov 2007 14:31:50 -1000 (HST) From: Jeff Roberson X-X-Sender: jroberson@192.168.1.107 To: Gergely CZUCZY In-Reply-To: <20071129101729.GA57985@harmless.hu> Message-ID: <20071130143023.I884@192.168.1.107> References: <20071129101729.GA57985@harmless.hu> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 00:29:25 -0000 I've forwarded this mail to the freebsd performance list so more people can take a look at it. Thanks for all of the details. What was the test that you're doing? sysbench? With writes or without? Or some other benchmark? Thanks, Jeff On Thu, 29 Nov 2007, Gergely CZUCZY wrote: > Hello > > I've been testing mysql on 7-BETA2 for a few days, compared to a > linux -2.6.19.2-grsec, and i've found that the linux setup does > around two times more queries then the FreeBSD ones. This seems > to be a bit different according to your test results. > > Could you help me to check out what am I missing? > > I've installed mysql from ports, 5.0.45, and i'm using a production > config file from a linux system, slightly modified (i've updated the > paths, and the bind-address). > > For 1 2 4 8 16 32 64 128 192 256 384 512 threads it does the > following results (queries/sec) on freebsd with UFS: > 1740.98 > 1605.12 > 1520.87 > 1548.42 > 1566.22 > 1465.80 > 1464.17 > 1420.33 > 1384.02 > 1433.44 > 1489.23 > 1445.75 > > And for linux (it stops at 128 threads, i'm debugging this atm): > 2791.05 > 3328.08 > 4459.14 > 3668.25 > 3489.43 > 3954.07 > 3055.25 > > As you see, it's a bit more the two times more. Something isn't right > it seems to me. > > About the FreeBSD system: > FreeBSD sqltest.in.publishing.hu 7.0-BETA2 FreeBSD 7.0-BETA2 #3: Mon Nov 5 10:49:48 CET 2007 toor@sqltest.in.publishing.hu:/usr/obj/usr/src/sys/SQLTEST amd64 > > I have the following kernel config: > cpu HAMMER > ident GENERIC > options SCHED_ULE > options PREEMPTION # Enable kernel thread preemption > options INET # InterNETworking > options FFS # Berkeley Fast Filesystem > options SOFTUPDATES # Enable FFS soft updates support > options UFS_ACL # Support for access control lists > options UFS_DIRHASH # Improve performance on big directories > options UFS_GJOURNAL # Enable gjournal-based UFS journaling > options MD_ROOT # MD is a potential root device > options NFSCLIENT # Network Filesystem Client > options NFSSERVER # Network Filesystem Server > options NFS_ROOT # NFS usable as /, requires NFSCLIENT > options NTFS # NT File System > options MSDOSFS # MSDOS Filesystem > options CD9660 # ISO 9660 Filesystem > options PROCFS # Process filesystem (requires PSEUDOFS) > options PSEUDOFS # Pseudo-filesystem framework > options GEOM_PART_GPT # GUID Partition Tables. > options GEOM_LABEL # Provides labelization > options COMPAT_43TTY # BSD 4.3 TTY compat [KEEP THIS!] > options COMPAT_IA32 # Compatible with i386 binaries > options COMPAT_FREEBSD6 # Compatible with FreeBSD6 > options SCSI_DELAY=5000 # Delay (in ms) before probing SCSI > options KTRACE # ktrace(1) support > options SYSVSHM # SYSV-style shared memory > options SYSVMSG # SYSV-style message queues > options SYSVSEM # SYSV-style semaphores > options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions > options KBD_INSTALL_CDEV # install a CDEV entry in /dev > options ADAPTIVE_GIANT # Giant mutex is adaptive. > options STOP_NMI # Stop CPUS using NMI instead of IPI > options AUDIT # Security event auditing > options SMP # Symmetric MultiProcessor Kernel > device cpufreq > device acpi > device pci > device fdc > device ata > device atadisk # ATA disk drives > device ataraid # ATA RAID drives > device atapicd # ATAPI CDROM drives > device atapifd # ATAPI floppy drives > device atapist # ATAPI tape drives > options ATA_STATIC_ID # Static device numbering > device scbus # SCSI bus (required for SCSI) > device ch # SCSI media changers > device da # Direct Access (disks) > device sa # Sequential Access (tape etc) > device cd # CD > device pass # Passthrough device (direct SCSI access) > device ses # SCSI Environmental Services (and SAF-TE) > device twa # 3ware 9000 series PATA/SATA RAID > device atkbdc # AT keyboard controller > device atkbd # AT keyboard > device psm # PS/2 mouse > device kbdmux # keyboard multiplexer > device vga # VGA video card driver > device sc > device sio # 8250, 16[45]50 based serial ports > device uart # Generic UART driver > device de # DEC/Intel DC21x4x (``Tulip'') > device em # Intel PRO/1000 adapter Gigabit Ethernet Card > device le # AMD Am7900 LANCE and Am79C9xx PCnet > device txp # 3Com 3cR990 (``Typhoon'') > device vx # 3Com 3c590, 3c595 (``Vortex'') > device miibus # MII bus support > device bge # Broadcom BCM570xx Gigabit Ethernet > device fxp # Intel EtherExpress PRO/100B (82557, 82558) > device msk # Marvell/SysKonnect Yukon II Gigabit Ethernet > device loop # Network loopback > device random # Entropy device > device ether # Ethernet support > device ppp # Kernel PPP > device tun # Packet tunnel. > device pty # Pseudo-ttys (telnet etc) > device md # Memory "disks" > device firmware # firmware assist module > device bpf # Berkeley packet filter > device uhci # UHCI PCI->USB interface > device ehci # EHCI PCI->USB interface (USB 2.0) > device usb # USB Bus (required) > device ugen # Generic > device uhid # "Human Interface Devices" > device ukbd # Keyboard > device ulpt # Printer > device umass # Disks/Mass storage - Requires scbus and da > device ums # Mouse > > It's a slightly modified GENERIC. > > Loaded modules: > Id Refs Address Size Name > 1 2 0xffffffff80100000 65cb90 kernel > 2 1 0xffffffff8075d000 f4da0 zfs.ko > > The my.cnf: > # grep '^[\[a-z]' /var/db/mysql/my.cnf > [client] > port = 3307 > socket = /tmp/mysql.sock > > [mysqld_safe] > socket = /tmp/mysql.sock > nice = 0 > > [mysqld] > default-character-set = latin2 > default-collation = latin2_hungarian_ci > user = mysql > pid-file = /var/run/mysqld/mysqld.pid > socket = /var/run/mysqld/mysqld.sock > port = 3306 > basedir = /usr/local > datadir = /var/db/mysql/ > tmpdir = /tmp > old_passwords = 1 > bind-address = 10.0.0.1 > key_buffer = 1024M > max_allowed_packet = 16M > thread_stack = 512K > query_cache_limit = 20M > query_cache_size = 1024M > query_cache_type = 1 > max_connections = 3600 > thread_cache_size = 200 > wait_timeout = 60 > table_cache = 2048 > sort_buffer = 12M > join_buffer_size = 12M > record_buffer = 12M > read_rnd_buffer_size = 8M > max_heap_table_size = 128M > tmp_table_size = 128M > myisam_sort_buffer_size = 64M > max_connect_errors = 64 > server-id = 2 > skip-bdb > skip-innodb > > [mysqldump] > quick > quote-names > max_allowed_packet = 16M > > [mysql] > > [isamchk] > key_buffer = 16M > > The box is a dual opteron 246 with 12GB of memory with 10K RPM > SATA disks on a 9550 3ware. > > So, what can cause this big difference? > > the MySQL binary is statically linked, i've built it > that way. > > ldd: /usr/local/libexec/mysqld: not a dynamic executable > > Though, maybe I should rebuild it dynamically to ensure it's > linked against libthr (and not pthread or c_r)... > > So, any tips, guesses, anything what can cause this? > > Thanks in advance. > > Sincerely, > > Gergely Czuczy > mailto: gergely.czuczy@harmless.hu > > -- > Weenies test. Geniuses solve problems that arise. > From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 04:21:47 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4601316A418 for ; Sat, 1 Dec 2007 04:21:47 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [64.7.153.18]) by mx1.freebsd.org (Postfix) with ESMTP id E244D13C448 for ; Sat, 1 Dec 2007 04:21:46 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by smarthost1.sentex.ca (8.13.8/8.13.8) with ESMTP id lB13j9dV095211; Fri, 30 Nov 2007 22:45:09 -0500 (EST) (envelope-from mike@sentex.net) Received: from mdt-xp.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.8/8.13.3) with ESMTP id lB13j8Ql001167 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 30 Nov 2007 22:45:08 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <200712010345.lB13j8Ql001167@lava.sentex.ca> X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Fri, 30 Nov 2007 22:43:10 -0500 To: phoemix@harmless.hu From: Mike Tancsa In-Reply-To: <20071130143023.I884@192.168.1.107> References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Cc: freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 04:21:47 -0000 At 07:31 PM 11/30/2007, Jeff Roberson wrote: >>Though, maybe I should rebuild it dynamically to ensure it's >>linked against libthr (and not pthread or c_r)... >> >>So, any tips, guesses, anything what can cause this? I would make it dynamic instead of static. I seem to recall this issue in the past ---Mike From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 15:41:43 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C311F16A469 for ; Sat, 1 Dec 2007 15:41:43 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [82.208.36.70]) by mx1.freebsd.org (Postfix) with ESMTP id 2E36B13C455 for ; Sat, 1 Dec 2007 15:41:42 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id DF51319E023; Sat, 1 Dec 2007 16:41:41 +0100 (CET) Received: from [192.168.1.2] (r3a200.net.upc.cz [213.220.192.200]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTP id 69B9E19E019; Sat, 1 Dec 2007 16:41:39 +0100 (CET) Message-ID: <475180C6.2000502@quip.cz> Date: Sat, 01 Dec 2007 16:41:58 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> In-Reply-To: <20071130143023.I884@192.168.1.107> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: Gergely CZUCZY , freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 15:41:43 -0000 Jeff Roberson wrote: [...] >> the MySQL binary is statically linked, i've built it >> that way. >> >> ldd: /usr/local/libexec/mysqld: not a dynamic executable >> >> Though, maybe I should rebuild it dynamically to ensure it's >> linked against libthr (and not pthread or c_r)... >> >> So, any tips, guesses, anything what can cause this? >> As Mike Tancsa suggested - rebuild MySQL dynamic and use these values in /etc/libmap.conf # /etc/libmap.conf # # candidate mapping # [/usr/local/libexec/mysqld] libpthread.so.2 libthr.so.2 libpthread.so libthr.so Miroslav Lachman From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 17:04:12 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 10CDC16A420 for ; Sat, 1 Dec 2007 17:04:12 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id E3EA313C4EF for ; Sat, 1 Dec 2007 17:04:09 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id C40877C0CE6; Sat, 1 Dec 2007 17:33:38 +0100 (CET) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id wkX23XvzR+IY; Sat, 1 Dec 2007 17:33:38 +0100 (CET) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id C81567BFEF8; Sat, 1 Dec 2007 17:33:34 +0100 (CET) Date: Sat, 1 Dec 2007 17:33:34 +0100 From: Gergely CZUCZY To: Jeff Roberson Message-ID: <20071201163334.GA21709@harmless.hu> References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="J/dobhs11T7y2rNN" Content-Disposition: inline In-Reply-To: <20071130143023.I884@192.168.1.107> User-Agent: mutt-ng/devel-r804 (FreeBSD) Cc: freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 17:04:12 -0000 --J/dobhs11T7y2rNN Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Nov 30, 2007 at 02:31:50PM -1000, Jeff Roberson wrote: > I've forwarded this mail to the freebsd performance list so more people c= an take a look at it. Thanks for all of the details. What=20 > was the test that you're doing? sysbench? With writes or without? Or s= ome other benchmark? Answering the questions: I am using sysbench, with read-write tests. The test-table has 10M tuples, and i'm querying it for two minutes. On Sat, Dec 01, 2007 at 04:41:58PM +0100, Miroslav Lachman wrote: > > As Mike Tancsa suggested - rebuild MySQL dynamic and use these values in = /etc/libmap.conf > > # /etc/libmap.conf > # > # candidate mapping > # > [/usr/local/libexec/mysqld] > libpthread.so.2 libthr.so.2 > libpthread.so libthr.so > > Miroslav Lachman no need for this, since on 7 libthr is the default threading implementation. Now, some test results. The numbers show Queries/Second and in order they correspond to the following number of threads: 1 2 4 8 16 32 64 128 192 256 384 512 fbsd7_ufs_TSC_rw_plot: 1891.74 1935.85 1630.94 1966.75 1816.05 1700.58 1590.84 1536.18 1533.99 152= 6.05 1520.00 1464.44 fbsd7_ufs_rw_plot: 1740.98 1605.12 1520.87 1548.42 1566.22 1465.80 1464.17 1420.33 1384.02 143= 3.44 1489.23 1445.75 (ZM stands for zmirror with 2 drives) fbsd7_zfs_zm_rw_plot: 333.62 297.55 265.34 312.15 315.67 241.05 200.08 177.46 162.11 147.02 146.5= 2 125.72 (cdb2 means a setup we have. It's mysql 5.0.22) linux26_cdb2_rw_plot: 2013.59 2591.36 3515.02 3629.28 3129.89 3139.59 2747.31 linux26_mysql5041_rw_plot: 3415.20 4193.24 4670.92 4619.93 4288.13 3942.70 3591.34 3192.13 2966.72 285= 5.82 2580.51 2405.44 (This one is still in progress) linux26_mysql5041_tcmalloc_rw_plot: 2916.28 3551.13 3728.86 3856.79 3866.78 3707.94 3440.99 3251.88 3180.07 307= 0.65 2937.17 The testbox has a dual opteron 246, 12G of memory and a 3ware-9550 with two disks in a mirror for the rootfs (also this is where the mysql datafiles were, except for the ZFS setup). The freebsd has mysql-5.0.45_1. As you see for the best case linux outperforms fbsd7 around twice, this means that i couldn't reproduce jeff@'s results. >=20 > Thanks, > Jeff >=20 > On Thu, 29 Nov 2007, Gergely CZUCZY wrote: >=20 > >Hello > > > >I've been testing mysql on 7-BETA2 for a few days, compared to a > >linux -2.6.19.2-grsec, and i've found that the linux setup does > >around two times more queries then the FreeBSD ones. This seems > >to be a bit different according to your test results. > > > >Could you help me to check out what am I missing? > > > >I've installed mysql from ports, 5.0.45, and i'm using a production > >config file from a linux system, slightly modified (i've updated the > >paths, and the bind-address). > > > >For 1 2 4 8 16 32 64 128 192 256 384 512 threads it does the > >following results (queries/sec) on freebsd with UFS: > >1740.98 > >1605.12 > >1520.87 > >1548.42 > >1566.22 > >1465.80 > >1464.17 > >1420.33 > >1384.02 > >1433.44 > >1489.23 > >1445.75 > > > >And for linux (it stops at 128 threads, i'm debugging this atm): > >2791.05 > >3328.08 > >4459.14 > >3668.25 > >3489.43 > >3954.07 > >3055.25 > > > >As you see, it's a bit more the two times more. Something isn't right > >it seems to me. > > > >About the FreeBSD system: > >FreeBSD sqltest.in.publishing.hu 7.0-BETA2 FreeBSD 7.0-BETA2 #3: Mon Nov= 5 10:49:48 CET 2007 =20 > >toor@sqltest.in.publishing.hu:/usr/obj/usr/src/sys/SQLTEST amd64 > > > >I have the following kernel config: > >cpu HAMMER > >ident GENERIC > >options SCHED_ULE > >options PREEMPTION # Enable kernel thread preemption > >options INET # InterNETworking > >options FFS # Berkeley Fast Filesystem > >options SOFTUPDATES # Enable FFS soft updates support > >options UFS_ACL # Support for access control lis= ts > >options UFS_DIRHASH # Improve performance on big dir= ectories > >options UFS_GJOURNAL # Enable gjournal-based UFS jour= naling > >options MD_ROOT # MD is a potential root device > >options NFSCLIENT # Network Filesystem Client > >options NFSSERVER # Network Filesystem Server > >options NFS_ROOT # NFS usable as /, requires NFSC= LIENT > >options NTFS # NT File System > >options MSDOSFS # MSDOS Filesystem > >options CD9660 # ISO 9660 Filesystem > >options PROCFS # Process filesystem (requires P= SEUDOFS) > >options PSEUDOFS # Pseudo-filesystem framework > >options GEOM_PART_GPT # GUID Partition Tables. > >options GEOM_LABEL # Provides labelization > >options COMPAT_43TTY # BSD 4.3 TTY compat [KEEP THIS!] > >options COMPAT_IA32 # Compatible with i386 binaries > >options COMPAT_FREEBSD6 # Compatible with FreeBSD6 > >options SCSI_DELAY=3D5000 # Delay (in ms) before probing= SCSI > >options KTRACE # ktrace(1) support > >options SYSVSHM # SYSV-style shared memory > >options SYSVMSG # SYSV-style message queues > >options SYSVSEM # SYSV-style semaphores > >options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time e= xtensions > >options KBD_INSTALL_CDEV # install a CDEV entry in /dev > >options ADAPTIVE_GIANT # Giant mutex is adaptive. > >options STOP_NMI # Stop CPUS using NMI instead of= IPI > >options AUDIT # Security event auditing > >options SMP # Symmetric MultiProcessor Kernel > >device cpufreq > >device acpi > >device pci > >device fdc > >device ata > >device atadisk # ATA disk drives > >device ataraid # ATA RAID drives > >device atapicd # ATAPI CDROM drives > >device atapifd # ATAPI floppy drives > >device atapist # ATAPI tape drives > >options ATA_STATIC_ID # Static device numbering > >device scbus # SCSI bus (required for SCSI) > >device ch # SCSI media changers > >device da # Direct Access (disks) > >device sa # Sequential Access (tape etc) > >device cd # CD > >device pass # Passthrough device (direct SCSI access) > >device ses # SCSI Environmental Services (and SAF-T= E) > >device twa # 3ware 9000 series PATA/SATA RAID > >device atkbdc # AT keyboard controller > >device atkbd # AT keyboard > >device psm # PS/2 mouse > >device kbdmux # keyboard multiplexer > >device vga # VGA video card driver > >device sc > >device sio # 8250, 16[45]50 based serial ports > >device uart # Generic UART driver > >device de # DEC/Intel DC21x4x (``Tulip'') > >device em # Intel PRO/1000 adapter Gigabit Etherne= t Card > >device le # AMD Am7900 LANCE and Am79C9xx PCnet > >device txp # 3Com 3cR990 (``Typhoon'') > >device vx # 3Com 3c590, 3c595 (``Vortex'') > >device miibus # MII bus support > >device bge # Broadcom BCM570xx Gigabit Ethernet > >device fxp # Intel EtherExpress PRO/100B (82557, 82= 558) > >device msk # Marvell/SysKonnect Yukon II Gigabit Et= hernet > >device loop # Network loopback > >device random # Entropy device > >device ether # Ethernet support > >device ppp # Kernel PPP > >device tun # Packet tunnel. > >device pty # Pseudo-ttys (telnet etc) > >device md # Memory "disks" > >device firmware # firmware assist module > >device bpf # Berkeley packet filter > >device uhci # UHCI PCI->USB interface > >device ehci # EHCI PCI->USB interface (USB 2.0) > >device usb # USB Bus (required) > >device ugen # Generic > >device uhid # "Human Interface Devices" > >device ukbd # Keyboard > >device ulpt # Printer > >device umass # Disks/Mass storage - Requires scbus an= d da > >device ums # Mouse > > > >It's a slightly modified GENERIC. > > > >Loaded modules: > >Id Refs Address Size Name > >1 2 0xffffffff80100000 65cb90 kernel > >2 1 0xffffffff8075d000 f4da0 zfs.ko > > > >The my.cnf: > ># grep '^[\[a-z]' /var/db/mysql/my.cnf > >[client] > >port =3D 3307 > >socket =3D /tmp/mysql.sock > > > >[mysqld_safe] > >socket =3D /tmp/mysql.sock > >nice =3D 0 > > > >[mysqld] > >default-character-set =3D latin2 > >default-collation =3D latin2_hungarian_ci > >user =3D mysql > >pid-file =3D /var/run/mysqld/mysqld.pid > >socket =3D /var/run/mysqld/mysqld.sock > >port =3D 3306 > >basedir =3D /usr/local > >datadir =3D /var/db/mysql/ > >tmpdir =3D /tmp > >old_passwords =3D 1 > >bind-address =3D 10.0.0.1 > >key_buffer =3D 1024M > >max_allowed_packet =3D 16M > >thread_stack =3D 512K > >query_cache_limit =3D 20M > >query_cache_size =3D 1024M > >query_cache_type =3D 1 > >max_connections =3D 3600 > >thread_cache_size =3D 200 > >wait_timeout =3D 60 > >table_cache =3D 2048 > >sort_buffer =3D 12M > >join_buffer_size =3D 12M > >record_buffer =3D 12M > >read_rnd_buffer_size =3D 8M > >max_heap_table_size =3D 128M > >tmp_table_size =3D 128M > >myisam_sort_buffer_size =3D 64M > >max_connect_errors =3D 64 > >server-id =3D 2 > >skip-bdb > >skip-innodb > > > >[mysqldump] > >quick > >quote-names > >max_allowed_packet =3D 16M > > > >[mysql] > > > >[isamchk] > >key_buffer =3D 16M > > > >The box is a dual opteron 246 with 12GB of memory with 10K RPM > >SATA disks on a 9550 3ware. > > > >So, what can cause this big difference? > > > >the MySQL binary is statically linked, i've built it > >that way. > > > >ldd: /usr/local/libexec/mysqld: not a dynamic executable > > > >Though, maybe I should rebuild it dynamically to ensure it's > >linked against libthr (and not pthread or c_r)... > > > >So, any tips, guesses, anything what can cause this? > > > >Thanks in advance. > > > >Sincerely, > > > >Gergely Czuczy > >mailto: gergely.czuczy@harmless.hu > > > >--=20 > >Weenies test. Geniuses solve problems that arise. > > >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 Sincerely, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --J/dobhs11T7y2rNN Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) owGVWb1vI0l2X+/BCYHD4UIbMFzeCUbCis1mNz9lcGcpktLwRpS4IjXr2bk5XrG7 SPaqv6Y/JHGiiwwb2MC4wIHPNi65xICBCy504MCBo8scOLg/wID/AduJf6+qSZFU U7vH+WCz6r1X76ve+1X133z/ex99/MPf/vo3bz/95ue/+IN/Lv7n9FMvTRJ/XvR4 dOv4xbKul4tGua43i81i3bYsvVw3jUpFr9pW5eyLb37XCfxE+ElxvAzFMUvEfVIK Xe74f86sBY9ikbTSZFZsFFZ0XScOg9hJnMA/Zo7vOr5Yz40j7sczERV7vhXYjj8/ Zu/TIBF2MYwcP+FTVxQKlz47jZwjdhHcMlM/Yoau1xlPmG4cm+Xjqj4cMNIaMz8S sxm7CqYiigOf3UWQdFz4jPWf3wo2C6I7HtnCZsnCiZnHHZclAX5gKhJiGtssFBGo PO5bgrlOnLA4YF4QCUwEoSuY1SpwnyX8RjDO3CC4IS2cRGNsvOD+TUxrMO66LJhJ ubZIsEqM+S8XPGkZOnS547GcSwTkJxhmyyB9jjXsAOa/YCxexlPhWws8fukkC1jh gJZB8h1+BmmCicuIxa1C4AkWQFbEJAPid/Oi0PbjOwHfzeUq71MsA8fHx4VCn3GP pTFNrdY4kjJZJLhdlOtItWKtMM40LMoQsAWULusDlqRwQ3zEuG8z57lH4qMlCXQS aXtyB4c5fgpWTcZtxJMj1hUW08sbcascVxC3BuL2qV6muA2cKIhdfsvOOdnxEDo4 rB1jGh4fIywxZ3E6n0MxhLEIvaep49pssBx9cc7spc89x5LKpbEg+/H/LXfhA+Qd axVKIrFKrjP1eKhZgT+T8p+xx8PsmZywIMqxOdyy/oAmhMEZydtSGkclN7C4SwLE vbBK3jJ+79rvMIuRMFmQc7U40AwlAIMYkwO7JKs11iRSv13fFPyA+QL2S4cjlY8Y YoqMRcbXM17mxFkCznjqUp7REqS34yGCHrYep7RAkC6COwigVJIZGYkYDEhZygA/ 9WgrsXgR3LEvEGtHxKWRgI9slQJ+IcCOIjXEkllBBO6QJlf7KnDd4I7yQ0lS+4JU QT6WmcEqrMHKNWYarFZhZQM/mgYzqhhpVFi1bBQKM+zL+iSdxZPxqDOJ7iahGyRg bjTLWh08TbOqNaoQYupak37Xalodvxvlmqbju67rWhVyq01dg8xy1axpZfptmlqz iW+jVVCUVUPXdJ2VK7WKVqlsrvywar2CVUhlvaqVDcXTqOO70tAq9BurGwbJgFaZ rDLmK6AzTVaGWZpO82arYGIVPDWamoGZSqUKvQuFg68GLE7gXFVMPnhOFGVbH/6y I+dWxIeZbh+g2wfvQT0TNtXgv2Zdq1aZAR3MCjPLhlau4quq1erMqJTJWOxETYcd 9bpWqcEckJShQ10pV9OqrQIeDKiEEBxY9tRgnkClRtlDfU9Ddkc14VZorJ88Ry2l lGdVTYfxhwUU+PTeqE2I7UE5Qy+bWrWJ6CJyJiJchUZYzqwZ8ECD9GxqjSa+zaak q0Mds1xYi5OLVPVKecPgCmQYOqsgDTSjwiq1OuKDtKqVm1rTZBWj0dDKJjObFUOr 61iT1iafNA0aN2S2wGMNGIyIUe41kC9ITbQ7mQUHY2oWgS9oS6GUorijlIRRMEeu x4c52iWWhxYQWBumN5GMZGK1Wpbq1I2G1qAkr2J5mNwgNTBf1+uUxGaF0gzjBugb 5BoohdJp6vVWQddqiF/TrCOxCus6PQ3uZZHmzE45+k+YiAj1wKjUjhDHM9p4nkAr W8p9y5mJViiKzWpVl6lVoMJtO/GNLJScZVmnKoxgURAks5gdcDcOVPfE3zs0Hllk s/CjTvKZg/ZQQP8RR0zcWyJM1jK+Oh2p3DlUtWXVc0lrKaBI+VOpTsooSqj56Iqg F2v+KVUni8fUmeFyhkaYtWvsFNoOjEdBSrXnzrHEUUE1eZm0sss6qE+pa/vPqcYh fnaKkvk18MLnSOBV1SsUPlNdWvXzIzwRpFiNoqGNFykaWVNiEepnR+xMRHPhLlnn q+vOV2/WnUtxfPZSIBfogf5JHDIVwpcxo7qoXEeVu3jSG7cNhSDYTNzBn0uUdivw QoRKllROMpT1RUNDHcPGKc6BuKxVR5YwRzqBTCa3KXK1ae0AwYGItaMQTMdDc5QY 572q78TlS9ZTROhk1KXkl/2ANoAQnhQBbaYEgqZo/LYzA4JDS2HcQg+wJfYIKIDR dk9ZuaFDgZABXgg3ZNR6AmBHYd1QVJFY0B1QpY80jAmuvNjyn+OjProuXKKcN4sC j4VBlMBbKoUe8IlCO5ypeFPHIzHU4505o2RV3HzlpiWAhYd26DrzRYKYesCkMwdL HUjfpiGBAfKuIDkhTxYZGJIZ6vh2kdu2LAxrY08R0O/S6laNkaAUBWq1yEMPzdzI DrJIlRD4Q8qd1VaSTeL6dESQ97OsV8lH1a7ko+pY6lE2LfUo+5Z8VK0re6TupR5l A5OPqoepUZOamHqUfUw9qlaW2d/2FVJRHj6AdXEShDHhQPJCZvWRDJcNPDefK+zq EIl3KG0x6k1qW/RomqidujQL6zS1slzerNUamqEISJOK1MRsVqGqNMDUq9WMQCq1 ri9YmDqYymS5DyQ439oaGhsBH0ElArqxrCCUHySIzKE9QRnsiXXQ21NK5M1NpFJL WrMeeu/S9tAcXwvTKc4btIC2SBnacFYNVqQPI8/MYzZAzFF/WgXGgFv040rzuNJg nd5YIWx8suKTBEH0+b5ljiV2DaZfy+84skrQsQQgPe6Nxgwb0K5V1htPdvsdTHcj Il+4TO0maZkVpmzz87I9GPSupJ9sqg8Pn7PeRe+q36Ep9Co6oKynRp2Xve7k+ryX Nzm86vUGw3H/8mJrIWD1ni9PKplSKq2w7xGccLXvd4X1L+CynM8z1sfpNMLsXRDd KLT/iPkU/Syf+UREN8IFID7lKH6n1BJl8HONvTwdXw+7bfg83x5aJg5mSVZ7UILT kIpdnjBs/Um7c56j0kgxqe5iWShQFLYkClw657YKSbxPXrd/9bI9ernrHw8V9VZs HZiRlFNUVduJWgVhJQGVqH1Sz350eX110T7flpqZPP8ancPnbnGKbm8TPaORVgFj e4Ix6E6uLi8fB/MZZgiroAMEdN/gABsRmEGluQVKyBN1cTrqnPd7F7vCnrELkVA+ bESUdVwHUveIGfWuXveuvouYkYhuRbRHTK5lz2gG7U06DAiqdIT28D510COkBa2C tCFX5Dg/cyFyLJVio73pOhh1L0c57M/UzLcke6cLvK3nrdwfXTI597SA4dVlJ0/5 Z2wYBTKrZw9OPVg7ZNgqjHrX3cvT0WGu1GwyR2osUjsobgidRdwTFL48QWe9y8Fk 2L4aT86G4y1BZ9f9LhvyKJG3YGxMYVN4KFfGefukt7ONpYm3KKMxc/lUuM4Hvq+s dS4Hw/Z4UjHH4zfbIqiVVDST0YQElgl7+6rXG7Lxy/7oz949IazfNo0dfTpSgEMJ KIGHg2MMYSC+b+Nnok5RwqFI7QlRWdur5beHUX/S7Z2337TMblXX9Q05XeHyJTCG z7z4EAB1Ju/uogBazdEtiTVP5KvxVbvT2w0/CbxJIm6Jg/LhU2V39Gb0evRykMNO M8U4WcKueCFRvDqE7ZMyGJ09LQWIJOZzidXTfCdLZXrfpozweLiAc3JFTF4NL0f9 v5gMr/qXV/3xm4nsyNfn/YszSkOaY8OyrpuT8gldHbpFgkpMtAr3qLExycr18kl3 0r8Yjdvn55NOt/f6QbMM0aNKy3FUVJxTEcQSqnSepHa3DQjwujc567c36zT2mcMB M7w0Efey7NscrLcid6eNxpfDycWgn+MpAFTWGV6PsvMDEZGOhCiCGRKpP8zNo/Z1 t58HKCBRWGnkJEsmbuU5KbWdZE8rGw2GOSKkkKUHFBo5FhvgHOBkJQ8d/ZXEPCRM tbUHJgAyHA7e501xK3TyxkMrd3hmW7lSEr5nmG4TNpRvj9vygiG7wtrDFHHH3mG6 aqN0PskUOtYO07CPTLq6HHwb3+wx38wNwnD5bYxx8ogRw2KD7VFujNsT5P6435nA HpVlKHlWhkSyC9IsJ3bXjK1p+iBKMqOUMRpcdTl1yKLhw9xEWLCtTybBE7bD6bWN PxdRrrk232XsYjUrYW0FIw/krVHumvEj1hF0zVDYil26TSRWvtb2roRONzdneRxv 0w0xgjNAkM4XKw9DU6m4NFyB4Hy1xZaslat6/q0TBb68OnclYgMX3YnhfDtqnxbH rUIvV15yx3fkycs31qTeFas7F/TFdmm0Svf8tLuZ2tamlPYYh53lNOCRvQLzrgKR ubxsD2+uP2NvR+XhqGTgLJzGIo8e4j0c7jfo15p5VKpCV9znq3Y733XO67M2I5wT MIv45Y7KZY1zCxLaz47AhlHVj1i59rZSfVfVmTpUkN8RRnltlCcmBVbbFnMmfEG1 9xr47gmtbMHYNmO31ynRedJl3Y5Rvq/cs4Of/nScuk74/HluwghvV4RiB/ot0WtO 1dZEhG4353Rt0aN3gD76b8I6eyLqPlKrjZNR26sjC9l5+wLwhxKZBjrN+3s27Pgi yc3m+3BHkAn0xkzrqtnUpWVLIIvA32Pb7T3LZ682EST6qpKQ14iLuN8jw3OcrXKI w0dfFcMNkLbLNJ1vewBgOAq4DRTMTjqDal2H0Tv+zJUze2S/Co7k6d2HdPm3itQJ O0DyVetHyMFWoVpt5Juz0SczcziOg65bwjnsVeD7VLTepDc4N8DMBx1bhf1aukEQ bstcnTppZsqtmzyuCCkQeJtcPSor1A7Xx+VHySrfP2/xZN57KhphuOtFhWHYcDjM zbrU36EfwgasgQmwablrAG7t8KjjXJIsqfEIl5Tc13q8R61noN6ffCIb3ie5ueFE nizta571CNoRgQYvsFM314/TcLaz3voaKVSm4hSa5NecdGE527zXLzt97OF+8bPr 0QmwKxhnfE8AHzH38pnZAf00ND3XX2k83dGfqE82EUo+31z423xZoc031LG3iT95 mXrcV/d1UsmuZMmPT7rdBmXW7W+CqRvutIBhJJ2RS+xtQxCCSUiT0oCG4ySI6NRW ZFerKwmF6LjfKqDF5ULo1NuFIYNV+5U3surW+vGbiuxmdX0VfY4qRwdPmXmxvKbt 21BkFrO2elexucrI+aB0uOCeXKtMPwym38+yT0OnHoSuUata0yadvm/Wxw95RVDe Iq5XbSKeVWwuT+ofZrF2s34hNpZvDzXLn0nFnrF5JEL2/Cdvf/yWFz+8e85Ktzwq 2dOSfNVTUqRE+daSN2/yykLebG58WmaXmaa6948DuXe25kqJFyqBGk2vdHkrh+xJ zGfi3e/B62+FTZHpO0LfqQjPONBQEXA74hYSqRhDPJG7OAn4xhYNwJy84NmYnyxS f86BW/yJOqMhHaLdleV60iuOLS+utrQnb0apryywsy8NpHvtzedY2b7H9fLiRgIt J9oWR68a3MDi6rQqj4nR4wXXAZcvMbxwk2gdBnnKQrwI/KO12XE2V5aLb7yL21Ww rGv0R9IBp06mKb2/ZE9+FJ9RGRCTx+8nnN6CCFp922lr4pokVe8hJnECsn1yq2Xj FdHSa73lxOLWQkxcx3OSDRpDH+ySxKutuqveJlGyDLeJVvpbClhsnVG3oljT9Q0D Hi+5pZwkveNOMqGrIHr3tcfWmhJK959K5rd63dArDZWdUfJdQiWtNKQjvg4cP2PJ U32TFCdDpNB++Vuk8Efk27uSiaSxzo+F4OFE2floaSVM0SKR95E9ovWWTsy9yYYn FJN07ENqZqGdiCgKojiblS6UrxmKjp2zhqw+8Y0TFqf2dP3s+H6gfm4Us9QL36k8 c1QVeJ8GiSj66BjxU9tjY1s8SHu3/km2WYubd09tyx0R1D6mgbrqY3aKA11AByNU TaNSU1fJZePshAWz7OI1G9NfsauhlDJa3UvF9P6Ks2YVR0R5Pl830FFwxO4WPMF5 1Mc/FF31dlq97CIdhW+JFytyekc6WI6+OFd34UtSLpZXPfDJkrmOfyNset19C91T YDrmJIoPS9zx5Xpd17aPNwpmyXWmOEVbWQk+Zn6QkNVL+B3HUppKZSI9OIduP46Y x5dTwfosxm/XZpGgVW2suuKVeiUBE36cAqo6QBZyfakp43NOd59QfIpaoO47aOkw e8UaRMyaRIeatuUw7kOkE8ZHbJ6iBItYDiX06jnPmS8elOY+YuEgFvYtvVZ8kOrg VyTc5dFq5ExEc/xmnQ+p9WGpMg/+DI7ZXM1olpz5HP3WA/aJtUW64i0WW4YsRV8K 4dMNTCLiRCPs6aR0ARQH7q16deAKADEZHLTeeKWP5P6O/xU2VC/sKP0dNC4oXX9/ Rf/qxff+8KOzL7753W9//Zu3n37z81/88OPv//tH//Cn//rL4X//15cXP/uTX/31 v40//slf/t/f/cdHv/zbl60P//TmZ/97+cc/+KNf/eM3f5/+S/g//w8= =CRF9 -----END PGP SIGNATURE----- --J/dobhs11T7y2rNN-- From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 20:46:55 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6875416A417 for ; Sat, 1 Dec 2007 20:46:55 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from ag-out-0708.google.com (ag-out-0708.google.com [72.14.246.245]) by mx1.freebsd.org (Postfix) with ESMTP id 19DEE13C461 for ; Sat, 1 Dec 2007 20:46:54 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by ag-out-0708.google.com with SMTP id 35so3122547aga for ; Sat, 01 Dec 2007 12:46:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=fktBFczkDF1i2rH0vsVFIfjooaE4YncHHz5N43HFRoM=; b=ck20Issjibs53P6odzXM5U2FkZsbVlYfVXPaHzKiCNO5rKR+BSENapAlykLKKVhapPZUn4019gFJVm9IWzb9xbP4Yfck2D0idphubJPrJ4AYbRiNn3EWG0gJ9LkM+n8A8IfYF6XAv5SBKiizJSm5gx1yih/tQ0pnaiqfZUsfRc4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=mplPMWilkKubcIXTvsJN1m4zS+OI+t1rJeAVYx2vNcjweTPCft+XmLkTuwHaxce85Q5oon7eWP0o4edo/jalnXlREyNmaDV54gMfYdzudd+eiuRGFZLcLyfFaTzQ+6bWlmZ9VhvLxwe4gg4B63Sm9AmYCfC0b5730TVkr+Wk678= Received: by 10.150.201.13 with SMTP id y13mr302072ybf.1196542014446; Sat, 01 Dec 2007 12:46:54 -0800 (PST) Received: by 10.35.129.13 with HTTP; Sat, 1 Dec 2007 12:46:54 -0800 (PST) Message-ID: <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> Date: Sat, 1 Dec 2007 15:46:54 -0500 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071109145827.W639@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 20:46:55 -0000 Jeff, I just ran through some of my benchmarks on a kernel build from sources as of today, and I've noticed an improvement for the ffmpeg workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3). This is vanilla source with no patches applied: x 4bsd + ule * uleb3 +--------------------------------------------------------------------------------------------------+ |x x x x * * * * * + + ++ +| | |____A_____| |_______AM_____| |______A_______| | +--------------------------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 93.28 94.05 93.74 93.746 0.29686697 + 5 97.56 98.7 98.03 98.042 0.41924933 Difference at 95.0% confidence 4.296 +/- 0.529778 4.5826% +/- 0.565121% (Student's t, pooled s = 0.363249) * 5 95.58 96.69 96.37 96.278 0.42446437 Difference at 95.0% confidence 2.532 +/- 0.534176 2.70092% +/- 0.569812% (Student's t, pooled s = 0.366265) Unfortunately, I only have 3 data points for the buildworld and sysbench runs. buildworld has slowed down slightly, and sysbench has slightly improved: buildworld: x 4bsd + ule * uleb3 +--------------------------------------------------------------------------------------------------+ |x x x xx + + + + +* * *| | |____________MA_____________| |________A________| |__MA____|| +--------------------------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 804.27 813.06 808.75 808.976 3.9655807 + 5 822.11 828.74 825.13 825.248 2.5607655 Difference at 95.0% confidence 16.272 +/- 4.86816 2.01143% +/- 0.601768% (Student's t, pooled s = 3.33791) * 3 829.15 831.33 829.73 830.07 1.1290704 Difference at 95.0% confidence 21.094 +/- 5.90231 2.60749% +/- 0.729603% (Student's t, pooled s = 3.30285) sysbench (8 threads): x 4bsd + ule * uleb3 +--------------------------------------------------------------------------------------------------+ |x x xx x + ++ * + * *| | |___A_M__| |______AM_|____|MA______|| +--------------------------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 2151.75 2172.05 2166.7 2163.14 8.1262968 + 5 2274.13 2309.66 2298.99 2296.89 13.648515 Difference at 95.0% confidence 133.75 +/- 16.3813 6.18314% +/- 0.757294% (Student's t, pooled s = 11.2321) * 3 2303.61 2327.29 2313.17 2314.69 11.912951 Difference at 95.0% confidence 151.55 +/- 17.0782 7.00602% +/- 0.789509% (Student's t, pooled s = 9.5567) Thanks, Josh From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 20:55:14 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 443CC16A41A for ; Sat, 1 Dec 2007 20:55:14 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [205.211.164.50]) by mx1.freebsd.org (Postfix) with ESMTP id DD78A13C455 for ; Sat, 1 Dec 2007 20:55:13 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by smarthost2.sentex.ca (8.14.1/8.13.8) with ESMTP id lB1Kt6kX094557; Sat, 1 Dec 2007 15:55:06 -0500 (EST) (envelope-from mike@sentex.net) Received: from mdt-xp.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.8/8.13.3) with ESMTP id lB1Kt5IQ005728 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 1 Dec 2007 15:55:05 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <200712012055.lB1Kt5IQ005728@lava.sentex.ca> X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sat, 01 Dec 2007 15:53:08 -0500 To: Gergely CZUCZY , Jeff Roberson From: Mike Tancsa In-Reply-To: <20071201163334.GA21709@harmless.hu> References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> <20071201163334.GA21709@harmless.hu> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Cc: freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 20:55:14 -0000 At 11:33 AM 12/1/2007, Gergely CZUCZY wrote: > > > > > >The box is a dual opteron 246 with 12GB of memory with 10K RPM > > >SATA disks on a 9550 3ware. > > > > > >So, what can cause this big difference? Are the caching options for the 3ware the same on FreeBSD as Linux ? ---Mike From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 20:56:16 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 89B8F16A46B for ; Sat, 1 Dec 2007 20:56:16 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id 05E5513C461 for ; Sat, 1 Dec 2007 20:56:15 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id 3D6507C1870; Sat, 1 Dec 2007 21:56:12 +0100 (CET) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id w94aozd0prdV; Sat, 1 Dec 2007 21:56:11 +0100 (CET) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id E05E27C186B; Sat, 1 Dec 2007 21:56:09 +0100 (CET) Date: Sat, 1 Dec 2007 21:56:09 +0100 From: Gergely CZUCZY To: Mike Tancsa Message-ID: <20071201205609.GA54238@harmless.hu> References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> <20071201163334.GA21709@harmless.hu> <200712012055.lB1Kt5IQ005728@lava.sentex.ca> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="envbJBWh7q8WU6mo" Content-Disposition: inline In-Reply-To: <200712012055.lB1Kt5IQ005728@lava.sentex.ca> User-Agent: mutt-ng/devel-r804 (FreeBSD) Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 20:56:16 -0000 --envbJBWh7q8WU6mo Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Dec 01, 2007 at 03:53:08PM -0500, Mike Tancsa wrote: > At 11:33 AM 12/1/2007, Gergely CZUCZY wrote: > >> > > >> >The box is a dual opteron 246 with 12GB of memory with 10K RPM > >> >SATA disks on a 9550 3ware. > >> > > >> >So, what can cause this big difference? >=20 > Are the caching options for the 3ware the same on FreeBSD as Linux ? I don't quite understand the question. It's the very same box, with a dualboot configuration. Sincerely, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --envbJBWh7q8WU6mo Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) owFVks9r1EAUx9dWPQQ99OL5nSzYZDvZ7bbbSLdut7aUuth2V8QKwmzykoxNZrYz k263FwURPPQgQhEsCB48Ch78I6TQHvwHxIsH7568OEl/iJCQ4Tvv+3588l5fHy2N jJ18/vJ4Yv/N4aVPI996t9JMax45KZU7jDsuIa5Tm6pU6860U5sNiB/4ldmpOgkJ WV4/Yi3BNXLtdId99EDjrp7sJ5Tx2+DHVCrUc5kOnbp1HrfIVF8oppngHjCeMI4X d11JuQpROne5LwLGIw+2M6ExcPqScU17CVrWfQ4dqm1YRB+Ia0OFkBmgGkjVq1U9 Ul9rg0NqhNjQZlsIXcp9RWEgTR7PakBTg+t61So02+BWJt3J3G/DMsoIkyG0Nh+0 Nh/9C2+Y5+zTjRF6YheYAgpBRhMQfY1ScKhMTcOA6dgkXF4AEUKKqZDDM42swsZa +yxJp9ltQsDUlgJjpDBbqxGoDqjE8v/VOsKGQWzm8ik3b6YQdGxK91hk/KGhhNzH easxVyH5WDK/RxPpxwZc3pohrCAUstCLEsVJ0RTz2ksScaGzCFTBPcazXZi3ViAQ fFwb6EwjZDxAqTTlQeHbzlDlOcuwosdVIe2gGbLIZ7jYxbjWKZqeEKZzwUMWZZIW NsvqMNOxNJRty7rgvZf5e0MrpSzRwoPoVC77hXzHbFCaoFLlOLMsx8lHfYjIGZr6 ppuy+W2cGTQKlEh2EPpSmB1J8+4MOSqZMlhfzY9eKeWrer7mYyPrB6X3M1ePJ57/ +Fn9eu3dx9bS95tH3oeN0uHl1ZNf+52nM8cvbxy8fYIvfkfP/vwF =9KQz -----END PGP SIGNATURE----- --envbJBWh7q8WU6mo-- From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 21:08:59 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CA25816A421 for ; Sat, 1 Dec 2007 21:08:59 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost2.sentex.ca (smarthost2.sentex.ca [205.211.164.50]) by mx1.freebsd.org (Postfix) with ESMTP id 85B6813C448 for ; Sat, 1 Dec 2007 21:08:59 +0000 (UTC) (envelope-from mike@sentex.net) Received: from lava.sentex.ca (pyroxene.sentex.ca [199.212.134.18]) by smarthost2.sentex.ca (8.14.1/8.13.8) with ESMTP id lB1L8rH6095495; Sat, 1 Dec 2007 16:08:53 -0500 (EST) (envelope-from mike@sentex.net) Received: from mdt-xp.sentex.net (simeon.sentex.ca [192.168.43.27]) by lava.sentex.ca (8.13.8/8.13.3) with ESMTP id lB1L8qAd005766 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 1 Dec 2007 16:08:52 -0500 (EST) (envelope-from mike@sentex.net) Message-Id: <200712012108.lB1L8qAd005766@lava.sentex.ca> X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sat, 01 Dec 2007 16:06:55 -0500 To: Gergely CZUCZY From: Mike Tancsa In-Reply-To: <20071201205609.GA54238@harmless.hu> References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> <20071201163334.GA21709@harmless.hu> <200712012055.lB1Kt5IQ005728@lava.sentex.ca> <20071201205609.GA54238@harmless.hu> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 21:08:59 -0000 At 03:56 PM 12/1/2007, Gergely CZUCZY wrote: >I don't quite understand the question. It's the very same box, with >a dualboot configuration. Fire up the 3ware controller's RAID management software and make sure the same write caching strategy is set for FreeBSD and Linux. The driver my default to different values. i.e. under "controller settings" make sure "write cache" and "queuing" are the same values for linux and freebsd. ---Mike From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 21:10:18 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 775EB16A41B for ; Sat, 1 Dec 2007 21:10:18 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from marvin.harmless.hu (marvin.harmless.hu [195.56.55.204]) by mx1.freebsd.org (Postfix) with ESMTP id E2A0B13C458 for ; Sat, 1 Dec 2007 21:10:17 +0000 (UTC) (envelope-from gergely.czuczy@harmless.hu) Received: from localhost (marvin-mail [192.168.0.2]) by marvin.harmless.hu (Postfix) with ESMTP id 511587BFF00; Sat, 1 Dec 2007 22:10:15 +0100 (CET) X-Virus-Scanned: by amavisd-new-2.4.2 (20060627) (Debian) at harmless.hu Received: from marvin.harmless.hu ([192.168.0.2]) by localhost (marvin.harmless.hu [192.168.0.2]) (amavisd-new, port 10024) with ESMTP id 8H1-yNzqjy0y; Sat, 1 Dec 2007 22:10:15 +0100 (CET) Received: from marvin.harmless.hu (localhost [127.0.0.1]) by marvin.harmless.hu (Postfix) with ESMTP id E271E7C0AC2; Sat, 1 Dec 2007 22:10:13 +0100 (CET) Date: Sat, 1 Dec 2007 22:10:12 +0100 From: Gergely CZUCZY To: Mike Tancsa Message-ID: <20071201211012.GA55519@harmless.hu> References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> <20071201163334.GA21709@harmless.hu> <200712012055.lB1Kt5IQ005728@lava.sentex.ca> <20071201205609.GA54238@harmless.hu> <200712012108.lB1L8qAd005766@lava.sentex.ca> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=x-unknown; protocol="application/pgp-signature"; boundary="DocE+STaALJfprDB" Content-Disposition: inline In-Reply-To: <200712012108.lB1L8qAd005766@lava.sentex.ca> User-Agent: mutt-ng/devel-r804 (FreeBSD) Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 21:10:18 -0000 --DocE+STaALJfprDB Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Dec 01, 2007 at 04:06:55PM -0500, Mike Tancsa wrote: > At 03:56 PM 12/1/2007, Gergely CZUCZY wrote: > >I don't quite understand the question. It's the very same box, with > >a dualboot configuration. >=20 > Fire up the 3ware controller's RAID management software and make sure the= same write caching strategy is set for FreeBSD and Linux. The=20 > driver my default to different values. >=20 > i.e. under "controller settings" make sure "write cache" and "queuing" ar= e the same values for linux and freebsd. Let's get back to this on monday. I'm at home now, and the box is at me workplace, still running a test (i can't reboot it). Sincerely, Gergely Czuczy mailto: gergely.czuczy@harmless.hu --=20 Weenies test. Geniuses solve problems that arise. --DocE+STaALJfprDB Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.4 (FreeBSD) owFNU01PFEEQRVAPbThw0JMmlT2Ihp1hFtgFxyyKrJCNED/AGNFL70zNboeZ7rW7 Z5clxqsePBg9mqAmnkyMmpAYE88mHvTmX+BvaPWg4LGqX1W996r62ejI0PDYz4+7 9yaePn955P3Iq9ZEllsr217GdU9IrxIEFa9arVYueDVvNuaztVowVavxuDqTJMs3 f+wuKmlRWm990MUQLG7ZyW7KhbwIUYdrg7ae28SbY/9wDWG6yggrlAxByFRIPHhb 11yaBLV3VUYqFrIdwoNcWYy9rhbS8laKjF2XsMZtGRoYQVApw1QQzAK3EMyEQS2s Vm+sghdUg6AMq2ITYZ3LyHDoa+oTsnlYIOR0WK0B4SpTk5VJV1+GZdRtTAewuHF7 cePuIXy+CbGS45aICIuQyxi1sVzGYDtISTROiQ9NO26KVA/1AAzPEFpqqwx9YTuu DYc452lLKQuRkolo55oXlWy+PhUQYkloat8tekz3OQWEs1qlKWpqfWuh2YCMS97G jKwCoxJboByVjJNQk1NE1XW2P76vHeGIRx0yEoyledgegDBAS4FEaVjSiFfWGkWL FSHzLR/Wqb6gE2tBSiAbQIwJz1MLVkEsEtqOG9/jKUk/IC989Pe9gdIhbTfI0nBT +o9h6ZAXlorRJXIxJxhFus4KDfsK9ocUVFNHr0AnRLplYp+toLO8TVpaPNp09GyH xCkJmZIxH9BOxjN3GB1FvaTql+Hv2hhtxvlAb84npTfpYiMsk0kiTUHnUjrLOF2z sXBOEFl3ARqL9Ql73mdsTciIrEgHZcYObmc7j7YHLOMitSokakXaj4r0ZfoNWYrG +J2cMc9zxt1BlIIUujk+naAUuaHQqLSH0NWK7j1zV0VEuRYGffbk0sixIfft/v3Z seGHZ4Zev3j3rX7tw9elubdvTu5F3z9/+u0fH9oJv4yePdH89ej+qaOP1+LRmZ3T e80/ =qDYS -----END PGP SIGNATURE----- --DocE+STaALJfprDB-- From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 21:19:04 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D8C8916A420 for ; Sat, 1 Dec 2007 21:19:04 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.178]) by mx1.freebsd.org (Postfix) with ESMTP id 86B3813C461 for ; Sat, 1 Dec 2007 21:19:04 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so5869047pyb for ; Sat, 01 Dec 2007 13:19:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=SMpbyZxtGSuNR98U++rmtX1LlI3sIwhqS2xwFMEgQaI=; b=nw749aFGj1MTkZBevfgKTVSdouH0yYPvxnT8YRs9+ugR62hiqKpUi0Oz9BTmHVNAZ86xIozbATu0LYZIj7nBMDMv4AuDiEnNx6wsYIuH44K9bXScTs4foes68DtYglbMVldvD6skQUUwRbK7pfab/5lsttknqSkdywXZnb3Xn/A= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ROMUK2RIedN0Fb/WX3qVAPlHgkaM035QnE3V+be7hfKnlHpKY2knQ82WWr/4P9ln9gGMjGWOOgRKjyTRHQD79MamzQd9HE4LLYGlgBCkXaj7pKK9EssKHaZeoid8JsM+FD28YpRiiVKbXqMr7W03Ij1r3xTlQiuhqAlxpjQUTAs= Received: by 10.35.91.1 with SMTP id t1mr242969pyl.1196543943632; Sat, 01 Dec 2007 13:19:03 -0800 (PST) Received: by 10.35.129.13 with HTTP; Sat, 1 Dec 2007 13:19:03 -0800 (PST) Message-ID: <8cb6106e0712011319q59efa8absb81eb7e18a0867c6@mail.gmail.com> Date: Sat, 1 Dec 2007 16:19:03 -0500 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 21:19:05 -0000 > I just ran through some of my benchmarks on a kernel build from > sources as of today, and I've noticed an improvement for the ffmpeg > workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3). > This is vanilla source with no patches applied: Sorry, the ministat output was mangled. I'll try this again with 80 columns instead. Also, please disregard the buildworld comparison, as world has changed since the previous 4bsd and ule runs, so obviously that's not a valid comparison. Sorry about that. Here are the ministat outputs for ffmpeg and sysbench, truncated to 80 columns instead. Hopefully that'll come through properly. Josh ffmpeg: x 4bsd + ule * uleb3 +------------------------------------------------------------------------------+ |x xx xx * * * * * + + ++ +| | |____A___| |_____AM____| |____MA_____| | +------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 93.28 94.05 93.74 93.746 0.29686697 + 5 97.56 98.7 98.03 98.042 0.41924933 Difference at 95.0% confidence 4.296 +/- 0.529778 4.5826% +/- 0.565121% (Student's t, pooled s = 0.363249) * 5 95.58 96.69 96.37 96.278 0.42446437 Difference at 95.0% confidence 2.532 +/- 0.534176 2.70092% +/- 0.569812% (Student's t, pooled s = 0.366265) sysbench: x 4bsd + ule * uleb3 +------------------------------------------------------------------------------+ |x x x x + ++ * + * *| | |___A_M_| |_____AM|___|A_____|| +------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 2151.75 2172.05 2166.7 2163.14 8.1262968 + 5 2274.13 2309.66 2298.99 2296.89 13.648515 Difference at 95.0% confidence 133.75 +/- 16.3813 6.18314% +/- 0.757294% (Student's t, pooled s = 11.2321) * 3 2303.61 2327.29 2313.17 2314.69 11.912951 Difference at 95.0% confidence 151.55 +/- 17.0782 7.00602% +/- 0.789509% (Student's t, pooled s = 9.5567) From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 22:20:04 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E27CA16A419 for ; Sat, 1 Dec 2007 22:20:04 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from webaccess-cl.virtdom.com (webaccess-cl.virtdom.com [216.240.101.25]) by mx1.freebsd.org (Postfix) with ESMTP id 9BF3F13C448 for ; Sat, 1 Dec 2007 22:20:04 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from [192.168.1.107] (cpe-24-94-75-93.hawaii.res.rr.com [24.94.75.93]) (authenticated bits=0) by webaccess-cl.virtdom.com (8.13.6/8.13.6) with ESMTP id lB1MK1AJ057539; Sat, 1 Dec 2007 17:20:03 -0500 (EST) (envelope-from jroberson@chesapeake.net) Date: Sat, 1 Dec 2007 12:22:34 -1000 (HST) From: Jeff Roberson X-X-Sender: jroberson@192.168.1.107 To: Gergely CZUCZY In-Reply-To: <20071201211012.GA55519@harmless.hu> Message-ID: <20071201122122.S884@192.168.1.107> References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> <20071201163334.GA21709@harmless.hu> <200712012055.lB1Kt5IQ005728@lava.sentex.ca> <20071201205609.GA54238@harmless.hu> <200712012108.lB1L8qAd005766@lava.sentex.ca> <20071201211012.GA55519@harmless.hu> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-performance@freebsd.org, Mike Tancsa Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 22:20:05 -0000 On Sat, 1 Dec 2007, Gergely CZUCZY wrote: > On Sat, Dec 01, 2007 at 04:06:55PM -0500, Mike Tancsa wrote: >> At 03:56 PM 12/1/2007, Gergely CZUCZY wrote: >>> I don't quite understand the question. It's the very same box, with >>> a dualboot configuration. >> >> Fire up the 3ware controller's RAID management software and make sure the same write caching strategy is set for FreeBSD and Linux. The >> driver my default to different values. >> >> i.e. under "controller settings" make sure "write cache" and "queuing" are the same values for linux and freebsd. > Let's get back to this on monday. I'm at home now, and the > box is at me workplace, still running a test (i can't reboot it). Also, can you verify with a read-only test to see where it's at? I have not tested writes with that many threads. I notice mysql goes much faster with a fresh table too. So can you blow away and recreate the sysbench tables and then do read-only? If that is much slower we'll know there is some configuration problem or similar. Thanks, Jeff > > Sincerely, > > Gergely Czuczy > mailto: gergely.czuczy@harmless.hu > > -- > Weenies test. Geniuses solve problems that arise. > From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 22:35:18 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 15D2116A420 for ; Sat, 1 Dec 2007 22:35:18 +0000 (UTC) (envelope-from bsam@ipt.ru) Received: from services.ipt.ru (services.ipt.ru [194.62.233.110]) by mx1.freebsd.org (Postfix) with ESMTP id BCF4A13C4D5 for ; Sat, 1 Dec 2007 22:35:17 +0000 (UTC) (envelope-from bsam@ipt.ru) Received: from bb.ipt.ru ([194.62.233.89]) by services.ipt.ru with esmtp (Exim 4.54 (FreeBSD)) id 1Iyaky-0006pg-IO; Sun, 02 Dec 2007 01:24:16 +0300 To: Gergely CZUCZY References: <20071129101729.GA57985@harmless.hu> <20071130143023.I884@192.168.1.107> <20071201163334.GA21709@harmless.hu> From: Boris Samorodov Date: Sun, 02 Dec 2007 01:22:38 +0300 In-Reply-To: <20071201163334.GA21709@harmless.hu> (Gergely CZUCZY's message of "Sat\, 1 Dec 2007 17\:33\:34 +0100") Message-ID: <10228705@bb.ipt.ru> User-Agent: Gnus/5.11 (Gnus v5.11) Emacs/22.1 (berkeley-unix) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-performance@freebsd.org Subject: Re: mysql scaling questions X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 22:35:18 -0000 On Sat, 1 Dec 2007 17:33:34 +0100 Gergely CZUCZY wrote: > I am using sysbench, with read-write tests. > The test-table has 10M tuples, and i'm querying it for two minutes. [...] > The testbox has a dual opteron 246, 12G of memory and a 3ware-9550 with > two disks in a mirror for the rootfs (also this is where the mysql datafiles > were, except for the ZFS setup). The freebsd has mysql-5.0.45_1. > As you see for the best case linux outperforms fbsd7 around twice, > this means that i couldn't reproduce jeff@'s results. 3ware driver is under GIANT at 7.x. I don't know if it's the same for linux. WBR -- Boris Samorodov (bsam) Research Engineer, http://www.ipt.ru Telephone & Internet SP FreeBSD committer, http://www.FreeBSD.org The Power To Serve