From owner-freebsd-performance@FreeBSD.ORG Mon Aug 25 06:30:14 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A5F7E16A4BF; Mon, 25 Aug 2003 06:30:14 -0700 (PDT) Received: from abe.micropat.com (abe.micropat.com [204.17.221.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9652243FE3; Mon, 25 Aug 2003 06:30:11 -0700 (PDT) (envelope-from paul@pathiakis.com) Received: from 10.0.0.101 ([204.17.221.104]) by abe.micropat.com (Netscape Messaging Server 4.15) with ESMTP id HK6FUH00.T1D; Mon, 25 Aug 2003 09:23:05 -0400 From: Paul Pathiakis To: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Date: Mon, 25 Aug 2003 09:29:32 -0400 User-Agent: KMail/1.5.3 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200308250929.32143.paul@pathiakis.com> Subject: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: paul@pathiakis.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Aug 2003 13:30:14 -0000 Hi, I'd like to thank everyone for their help so far. I'm implement most of the enhancements and changes on the database so far. I now have a bigger problem... the machine is generating some large reports (term used by the DB people here) and the processes start and instantly drop off to no utilization... they sit there and hang... seemingly resource starved. I'd like know if someone could help me. I've enclosed the postgresql.conf file, the systctl.conf file, loader.conf and the Kernel memory parameters. Again, the machine is a twin 2.8 Xeon HTT machine. HTT is turned on and the machine sees 4 cpus. It has 4 GB of RAM and I'm starting to put on SCSI drives as the machine had the IDE drives maxed out at 100% utilization at all times. (Again, I didn't order this machine, otherwise it would have had dual U320 channels etc on its I/O system) Presently, due to scavenging a PCI SCSI card (ADAPTEC U2W), disks (U320 10K rpm) and an enclosure for 4 disks, I have the following: /dev/ar1s1d 114244630 479980 104625080 0% /usr/local /dev/da0s1d 138860928 81448860 46303194 64% /usr/local/pgsql /dev/md0 1031916 4 949360 0% /usr/local/pgsql/data/base/16978/pgsql_tmp procfs 4 4 0 100% /proc /dev/da1s1d 138860928 131202 127620852 0% /usr/local/pgsql/data/pg_xlog /dev/da2s1d 142801720 3277472 128100112 2% /pg_index /dev/da3s1d 142801720 1049616 130327968 1% /pg_table noatime is configured on the pgsql hierarchy and related links to disks on /pg_* . I configured a MD as the pgsql_tmp directory, etc. I've created UFS2+S filesystems with block and frag sizes of 8K as this is optimal for PG. I hope this makes sense all the way around. I'm not a DBA, just a UNIX admin. Anyhow, I'm looking at the postgresql.conf file and I don't see a whole lot that makes sense to me. Please help! I've got a bunch of people saying Linux just runs faster and the DB group is using a Linux config file on the FreeBSD machine. (Don't get me going) It is my belief that a BSD DB is going to run faster on it's platform of choice for development (FreeBSD) than another OS. Please help! Thanks! Paul Pathiakis sysctl.conf: kern.maxfiles=10000 kern.ipc.shm_use_phys=1 kern.ipc.shmall=524288 kern.ipc.shmmax=1073741824 vfs.vmiodirenable=1 loader.conf kern.maxfiles=32768 kern.nbuf=16384 GENERIC SMP: options SYSVMSG #SYSV-style message queues options SYSVSHM #SYSV-style shared memory options SYSVSEM #SYSV-style semaphores options SHMMAXPGS=4096 options SHMSEG=256 options SEMMNI=256 options SEMMNS=512 options SEMMNU=256 options SEMMAP=256 Postgresql.conf: # # PostgreSQL configuration file # ----------------------------- # # This file consists of lines of the form: # # name = value # # (The '=' is optional.) White space may be used. Comments are introduced # with '#' anywhere on a line. The complete list of option names and # allowed values can be found in the PostgreSQL documentation. The # commented-out settings shown in this file represent the default values. # # Any option can also be given as a command line switch to the # postmaster, e.g. 'postmaster -c log_connections=on'. Some options # can be changed at run-time with the 'SET' SQL command. # # This file is read on postmaster startup and when the postmaster # receives a SIGHUP. If you edit the file on a running system, you have # to SIGHUP the postmaster for the changes to take effect, or use # "pg_ctl reload". #======================================================================== # # Connection Parameters # #tcpip_socket = false #ssl = false max_connections = 128 #superuser_reserved_connections = 2 #port = 5432 #hostname_lookup = false #show_source_port = false #unix_socket_directory = '' #unix_socket_group = '' #unix_socket_permissions = 0777 # octal #virtual_host = '' #krb_server_keyfile = '' # # Shared Memory Size # shared_buffers = 48000 # min max_connections*2 or 16, 8KB each #max_fsm_relations = 1000 # min 10, fsm is free space map, ~40 bytes #max_fsm_pages = 10000 # min 1000, fsm is free space map, ~6 bytes #max_locks_per_transaction = 64 # min 10 #wal_buffers = 8 # min 4, typically 8KB each # # Non-shared Memory Sizes # sort_mem = 32768 # min 64, size in KB #vacuum_mem = 8192 # min 1024, size in KB # # Write-ahead log (WAL) # #checkpoint_segments = 3 # in logfile segments, min 1, 16MB each #checkpoint_timeout = 300 # range 30-3600, in seconds # #commit_delay = 0 # range 0-100000, in microseconds #commit_siblings = 5 # range 1-1000 # #fsync = true #wal_sync_method = fsync # the default varies across platforms: # # fsync, fdatasync, open_sync, or open_datasync #wal_debug = 0 # range 0-16 # # Optimizer Parameters # #enable_seqscan = true #enable_indexscan = true #enable_tidscan = true #enable_sort = true #enable_nestloop = true #enable_mergejoin = true #enable_hashjoin = true #effective_cache_size = 1000 # typically 8KB each #random_page_cost = 4 # units are one sequential page fetch cost #cpu_tuple_cost = 0.01 # (same) #cpu_index_tuple_cost = 0.001 # (same) #cpu_operator_cost = 0.0025 # (same) #default_statistics_target = 10 # range 1-1000 # # GEQO Optimizer Parameters # #geqo = true #geqo_selection_bias = 2.0 # range 1.5-2.0 #geqo_threshold = 11 #geqo_pool_size = 0 # default based on tables in statement, # range 128-1024 #geqo_effort = 1 #geqo_generations = 0 #geqo_random_seed = -1 # auto-compute seed # # Message display # #server_min_messages = notice # Values, in order of decreasing detail: # debug5, debug4, debug3, debug2, debug1, # info, notice, warning, error, log, fatal, # panic #client_min_messages = notice # Values, in order of decreasing detail: # debug5, debug4, debug3, debug2, debug1, # log, info, notice, warning, error #silent_mode = false #log_connections = false #log_pid = false #log_statement = false #log_duration = false #log_timestamp = false #log_min_error_statement = panic # Values in order of increasing severity: # debug5, debug4, debug3, debug2, debug1, # info, notice, warning, error, panic(off) #debug_print_parse = false #debug_print_rewritten = false #debug_print_plan = false #debug_pretty_print = false #explain_pretty_print = true # requires USE_ASSERT_CHECKING #debug_assertions = true # # Syslog # #syslog = 0 # range 0-2 #syslog_facility = 'LOCAL0' #syslog_ident = 'postgres' # # Statistics # #show_parser_stats = false #show_planner_stats = false #show_executor_stats = false #show_statement_stats = false # requires BTREE_BUILD_STATS #show_btree_build_stats = false # # Access statistics collection # #stats_start_collector = true #stats_reset_on_server_start = true #stats_command_string = false #stats_row_level = false #stats_block_level = false # # Lock Tracing # #trace_notify = false # requires LOCK_DEBUG #trace_locks = false #trace_userlocks = false #trace_lwlocks = false #debug_deadlocks = false #trace_lock_oidmin = 16384 #trace_lock_table = 0 # # Misc # #autocommit = true #dynamic_library_path = '$libdir' #search_path = '$user,public' #datestyle = 'iso, us' #timezone = unknown # actually, defaults to TZ environment setting #australian_timezones = false #client_encoding = sql_ascii # actually, defaults to database encoding #authentication_timeout = 60 # 1-600, in seconds #deadlock_timeout = 1000 # in milliseconds #default_transaction_isolation = 'read committed' #max_expr_depth = 10000 # min 10 #max_files_per_process = 1000 # min 25 #password_encryption = true #sql_inheritance = true #transform_null_equals = false #statement_timeout = 0 # 0 is disabled, in milliseconds #db_user_namespace = false # # Locale settings # # (initialized by initdb -- may be changed) LC_MESSAGES = 'C' LC_MONETARY = 'C' LC_NUMERIC = 'C' LC_TIME = 'C' From owner-freebsd-performance@FreeBSD.ORG Mon Aug 25 20:05:29 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 36A8516A4BF; Mon, 25 Aug 2003 20:05:29 -0700 (PDT) Received: from perrin.nxad.com (internal.ext.nxad.com [69.1.70.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id B59BF43FE1; Mon, 25 Aug 2003 20:05:28 -0700 (PDT) (envelope-from sean@nxad.com) Received: by perrin.nxad.com (Postfix, from userid 1001) id 1CE6D20F01; Mon, 25 Aug 2003 20:05:28 -0700 (PDT) Date: Mon, 25 Aug 2003 20:05:28 -0700 From: Sean Chittenden To: Paul Pathiakis Message-ID: <20030826030527.GB1514@perrin.nxad.com> References: <200308250929.32143.paul@pathiakis.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200308250929.32143.paul@pathiakis.com> X-PGP-Key: finger seanc@FreeBSD.org X-PGP-Fingerprint: 3849 3760 1AFE 7B17 11A0 83A6 DD99 E31F BC84 B341 X-Web-Homepage: http://sean.chittenden.org/ User-Agent: Mutt/1.5.4i cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 03:05:29 -0000 > I now have a bigger problem... the machine is generating some large > reports and the processes start and instantly drop off to no > utilization... they sit there and hang... seemingly resource > starved. Prove it. Uses iostat or vmstat and come with proof that it is resource starved. > I've enclosed the postgresql.conf file, the systctl.conf file, > loader.conf and the Kernel memory parameters. Looking through these aren't going to help until you figure out why things are "stalling." > Again, the machine is a twin 2.8 Xeon HTT machine. HTT is turned on > and the machine sees 4 cpus. Have you played with toggling the sysctl machdep.cpu_idle_hlt? Turn off the use of your memory disk for PG's temp files. If you tune your PostgreSQL settings correctly, your temp files need to be disk backed, not RAM backed. > I've got a bunch of people saying Linux just runs faster and the DB > group is using a Linux config file on the FreeBSD machine. (Don't > get me going) It is my belief that a BSD DB is going to run faster > on it's platform of choice for development (FreeBSD) than another > OS. *grumps* I hate this call to arms bit about people clammering for Linux if things are slow on BSD. BSD is, on average, the preferred OS of PostgreSQL developers and DBAs when reliability and speed are issues (if for no other reason than UFS+softupdates). Linux has problems with memory over commit situations and file system integrity while still maintaining reasonable file system performance (ext2 is faster than ext3 by a wide margin, but ext2 is _not_ a reliable FS). As for your postgresql.conf, please read: http://www.varlena.com/varlena/GeneralBits/Tidbits/annotated_conf_e.html >From your postgresql.conf: > shared_buffers = 48000 # min max_connections*2 or 16, 8KB each WHOA! This is too high by a factor of about 10. You probably want a shared buffers set to 4096. > #max_fsm_relations = 1000 # min 10, fsm is free space map, ~40 bytes > #max_fsm_pages = 10000 # min 1000, fsm is free space map, ~6 bytes You probably want to increase these both by a factor of about 10. > sort_mem = 32768 # min 64, size in KB This also seems high, divide by 8 and you're at a more reasonable level. > #fsync = true Change this to false. Let us know if your machine was swapping, I bet it was. -sc -- Sean Chittenden From owner-freebsd-performance@FreeBSD.ORG Mon Aug 25 20:41:49 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 56AE516A4BF for ; Mon, 25 Aug 2003 20:41:49 -0700 (PDT) Received: from mailav.tor1.inquent.com (mail.inquent.com [216.208.117.106]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7E52143F93 for ; Mon, 25 Aug 2003 20:41:48 -0700 (PDT) (envelope-from rbt@rbt.ca) Received: from localhost (localhost [127.0.0.1]) by mailav.tor1.inquent.com (Postfix) with ESMTP id E75281024D; Mon, 25 Aug 2003 23:33:54 -0400 (EDT) Received: from [192.168.1.200] (dyn-133-83.tor.dsl.tht.net [134.22.133.83]) by mailav.tor1.inquent.com (Postfix) with ESMTP id 6DBB610248; Mon, 25 Aug 2003 23:33:52 -0400 (EDT) From: Rod Taylor To: Sean Chittenden In-Reply-To: <20030826030527.GB1514@perrin.nxad.com> References: <200308250929.32143.paul@pathiakis.com> <20030826030527.GB1514@perrin.nxad.com> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-5dlwBRBS1yEjIh39X/Eg" Message-Id: <1061869321.3193.9.camel@jester> Mime-Version: 1.0 X-Mailer: Ximian Evolution 1.4.4 Date: Mon, 25 Aug 2003 23:42:02 -0400 X-Virus-Scanned: by AMaViS perl-11 cc: freebsd-performance@freebsd.org cc: Paul Pathiakis Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 03:41:49 -0000 --=-5dlwBRBS1yEjIh39X/Eg Content-Type: text/plain Content-Transfer-Encoding: quoted-printable > while still maintaining reasonable file system performance (ext2 is > faster than ext3 by a wide margin, but ext2 is _not_ a reliable FS). > > #fsync =3D true >=20 > Change this to false. This is a funny thing to suggest after the filesystem comment. --=-5dlwBRBS1yEjIh39X/Eg Content-Type: application/pgp-signature; name=signature.asc Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQA/StcJ6DETLow6vwwRAuhcAJ46IxrXNQNcbdWjrfcdYV1QNcD4VQCdGV2O LyT7G9ADCGEUttjsNYmf1KQ= =UGjm -----END PGP SIGNATURE----- --=-5dlwBRBS1yEjIh39X/Eg-- From owner-freebsd-performance@FreeBSD.ORG Mon Aug 25 21:20:47 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BFDF916A4BF for ; Mon, 25 Aug 2003 21:20:47 -0700 (PDT) Received: from perrin.nxad.com (internal.ext.nxad.com [69.1.70.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3FCE143FE5 for ; Mon, 25 Aug 2003 21:20:47 -0700 (PDT) (envelope-from sean@nxad.com) Received: by perrin.nxad.com (Postfix, from userid 1001) id 4C26120F01; Mon, 25 Aug 2003 21:20:46 -0700 (PDT) Date: Mon, 25 Aug 2003 21:20:46 -0700 From: Sean Chittenden To: Rod Taylor Message-ID: <20030826042046.GC1514@perrin.nxad.com> References: <200308250929.32143.paul@pathiakis.com> <20030826030527.GB1514@perrin.nxad.com> <1061869321.3193.9.camel@jester> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="XsQoSWH+UP9D9v3l" Content-Disposition: inline In-Reply-To: <1061869321.3193.9.camel@jester> X-PGP-Key: finger seanc@FreeBSD.org X-PGP-Fingerprint: 3849 3760 1AFE 7B17 11A0 83A6 DD99 E31F BC84 B341 X-Web-Homepage: http://sean.chittenden.org/ User-Agent: Mutt/1.5.4i cc: freebsd-performance@freebsd.org cc: Paul Pathiakis Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 04:20:47 -0000 --XsQoSWH+UP9D9v3l Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable > > while still maintaining reasonable file system performance (ext2 is > > faster than ext3 by a wide margin, but ext2 is _not_ a reliable FS). >=20 > > > #fsync =3D true > >=20 > > Change this to false. >=20 > This is a funny thing to suggest after the filesystem comment. :) Did you enjoy that? :) I should clarify that piece of "advice" though. If you're _sure_ power isn't going to fail (using a UPS) and make regular backups (standard operating procedure), then fsync =3D false can be a good thing in terms of performance (roughly speaking, it doubles performance of any write/update operation). A disk failure is a disk failure and there is no substitute for RAID. Leaving stability in the OS and PostgreSQL... this is a FreeBSD mailing list, stability goes without saying. :) That said though, if you're unable to stomach the possibility of possibly loosing data when one of the above fails, keep fsync =3D true. If, however, you have mitigated the risks to levels that your business/operation is comfortable with (your data center is on generators, your DB systems have UPSs, are using RAID, and make frequent backups), then I would set fsync =3D false for most noncritical apps (non-financial, non-medical). -sc --=20 Sean Chittenden --XsQoSWH+UP9D9v3l Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Comment: Sean Chittenden iD8DBQE/SuAe3ZnjH7yEs0ERAmUiAKChZA4sZaHOUi5ia0TDywtMri2FtACfXU8W l4+GrFca0eDgWvWsWSlCAHk= =3jT7 -----END PGP SIGNATURE----- --XsQoSWH+UP9D9v3l-- From owner-freebsd-performance@FreeBSD.ORG Mon Aug 25 21:49:16 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0CA1316A4BF for ; Mon, 25 Aug 2003 21:49:16 -0700 (PDT) Received: from mail.lambertfam.org (www.lambertfam.org [216.223.208.55]) by mx1.FreeBSD.org (Postfix) with ESMTP id 449BF43FE3 for ; Mon, 25 Aug 2003 21:49:13 -0700 (PDT) (envelope-from lambert@lambertfam.org) Received: from laptop.lambertfam.org (laptop.int.lambertfam.org [10.1.0.2]) by mail.lambertfam.org (Postfix) with ESMTP id AC13F34D2D for ; Tue, 26 Aug 2003 00:48:00 -0400 (EDT) Received: by laptop.lambertfam.org (Postfix, from userid 1000) id 0B00C8879; Tue, 26 Aug 2003 00:48:56 -0400 (EDT) Date: Tue, 26 Aug 2003 00:48:56 -0400 From: Scott Lambert To: freebsd-performance@freebsd.org Message-ID: <20030826044855.GB8831@laptop.lambertfam.org> Mail-Followup-To: freebsd-performance@freebsd.org References: <200308250929.32143.paul@pathiakis.com> <20030826030527.GB1514@perrin.nxad.com> <1061869321.3193.9.camel@jester> <20030826042046.GC1514@perrin.nxad.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable In-Reply-To: <20030826042046.GC1514@perrin.nxad.com> User-Agent: Mutt/1.4.1i Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 04:49:16 -0000 On Mon, Aug 25, 2003 at 09:20:46PM -0700, Sean Chittenden wrote: > > > while still maintaining reasonable file system performance (ext2 is > > > faster than ext3 by a wide margin, but ext2 is _not_ a reliable FS). > >=20 > > > > #fsync =3D true > > >=20 > > > Change this to false. > >=20 > > This is a funny thing to suggest after the filesystem comment. >=20 > :) Did you enjoy that? :) I should clarify that piece of "advice" > though. >=20 > If you're _sure_ power isn't going to fail (using a UPS) and make > regular backups (standard operating procedure), then fsync =3D false > can be a good thing in terms of performance (roughly speaking, it > > keep fsync =3D true. If, however, you have mitigated the risks to > levels that your business/operation is comfortable with (your data > center is on generators, your DB systems have UPSs, are using RAID, > and make frequent backups), then I would set fsync =3D false for most > noncritical apps (non-financial, non-medical). I've had more UPS failures than grid failures in the past year and a half. In the blackout, one of my APCs smoked rather than do it's job the second time the power went down. The UPS maintainance people at on of the colo facilities I use managed to drop power to everything while doing routine maintenance on their UPS. That left me with a lot of unexpected softupdates inconsistencies. And three machines that dropped to single user mode on restart. One machine's disk didn't survive. We lost a lot of files on the other two systems. The sad part being that the backups had just started for the day when they burped the UPS. Two hours later and it wouldn't have hurt as bad. =20 A UPS doesn't necesarily reduce your likelyhood of having a power failure. Two fully online UPS's and redundant power supplies in each machine might. =20 BTW, e-mail and web hosting for Grandma and Aunt Bessie and Uncle Joe are critical services too. No, really, I'm serious. --=20 Scott Lambert KC5MLE Unix SysAdmin lambert@lambertfam.org =20 From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 03:41:04 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 80DEB16A4C0; Tue, 26 Aug 2003 03:41:04 -0700 (PDT) Received: from student.uci.agh.edu.pl (student.uci.agh.edu.pl [149.156.98.60]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1B5B043FA3; Tue, 26 Aug 2003 03:41:03 -0700 (PDT) (envelope-from fahren@student.uci.agh.edu.pl) Received: from piggie (pf178.bochnia.sdi.tpnet.pl [217.97.94.178]) by student.uci.agh.edu.pl (Postfix) with SMTP id 1E90564613; Tue, 26 Aug 2003 12:40:41 +0200 (CEST) Received: by piggie (sSMTP sendmail emulation); Tue, 26 Aug 2003 12:40:38 +0200 Date: Tue, 26 Aug 2003 12:40:38 +0200 From: Maciej Freudenheim To: Sean Chittenden Message-ID: <20030826104038.GA63155@piggie> References: <200308250929.32143.paul@pathiakis.com> <20030826030527.GB1514@perrin.nxad.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FL5UXtIhxfXey3p5" Content-Disposition: inline In-Reply-To: <20030826030527.GB1514@perrin.nxad.com> X-PGP-Key-URL: http://student.uci.agh.edu.pl/~fahren/fahren.gpg User-Agent: Mutt/1.5.4i cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 10:41:04 -0000 --FL5UXtIhxfXey3p5 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Sean Chittenden wrote: > issues (if for no other reason than UFS+softupdates). Linux has > problems with memory over commit situations and file system integrity > while still maintaining reasonable file system performance (ext2 is > faster than ext3 by a wide margin, but ext2 is _not_ a reliable FS). Even heard of reiserfs or xfs? I'm not going to start Linux advocacy here, but it's so funny for me when somebody says 'leenoox sux, it has crappy filesystem' that i can't leave it without reply :) fahren. --FL5UXtIhxfXey3p5 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.3 (FreeBSD) iD8DBQE/SzkmiZPiEPhhqGARAssOAJsGWNKUEc8G2wJWHvOfAwvT0pdzqQCeKCjI vQhD04PT6SdVQSuJxCy3BC0= =gmVZ -----END PGP SIGNATURE----- --FL5UXtIhxfXey3p5-- From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 05:42:15 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4E32016A4BF; Tue, 26 Aug 2003 05:42:15 -0700 (PDT) Received: from meitner.wh.uni-dortmund.de (meitner.wh.uni-dortmund.de [129.217.129.133]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7F21343FBD; Tue, 26 Aug 2003 05:42:14 -0700 (PDT) (envelope-from michaelnottebrock@gmx.net) Received: from lofi.dyndns.org (pc2-105.intern.meitner [10.3.12.105]) by meitner.wh.uni-dortmund.de (Postfix) with ESMTP id 4DAE9167657; Tue, 26 Aug 2003 14:42:13 +0200 (CEST) Received: from gmx.net (kiste.my.domain [192.168.8.4]) (authenticated bits=0) by lofi.dyndns.org (8.12.9/8.12.9) with ESMTP id h7QCgBIv051290 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 26 Aug 2003 14:42:12 +0200 (CEST) (envelope-from michaelnottebrock@gmx.net) Message-ID: <3F4B55A1.6000601@gmx.net> Date: Tue, 26 Aug 2003 14:42:09 +0200 From: Michael Nottebrock User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax) X-Accept-Language: en-us, en, de-de MIME-Version: 1.0 To: paul@pathiakis.com References: <200308250929.32143.paul@pathiakis.com> In-Reply-To: <200308250929.32143.paul@pathiakis.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 12:42:15 -0000 Paul Pathiakis wrote: > It is my belief that a BSD DB is > going to run faster on it's platform of choice for development (FreeBSD) than > another OS. Why? I mean, seriously, what has the platform you run your gcc and vim on to do with performance at the end of the day? -- ,_, | Michael Nottebrock | lofi@freebsd.org (/^ ^\) | FreeBSD - The Power to Serve | http://www.freebsd.org \u/ | K Desktop Environment on FreeBSD | http://freebsd.kde.org From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 06:20:04 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E251F16A4BF; Tue, 26 Aug 2003 06:20:04 -0700 (PDT) Received: from abe.micropat.com (abe.micropat.com [204.17.221.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id ADE2143FE1; Tue, 26 Aug 2003 06:20:03 -0700 (PDT) (envelope-from paul@pathiakis.com) Received: from 10.0.0.101 ([204.17.221.104]) by abe.micropat.com (Netscape Messaging Server 4.15) with ESMTP id HK8A1O00.6UF; Tue, 26 Aug 2003 09:13:00 -0400 From: Paul Pathiakis To: Michael Nottebrock Date: Tue, 26 Aug 2003 09:19:28 -0400 User-Agent: KMail/1.5.3 References: <200308250929.32143.paul@pathiakis.com> <3F4B55A1.6000601@gmx.net> In-Reply-To: <3F4B55A1.6000601@gmx.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200308260919.28371.paul@pathiakis.com> cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: paul@pathiakis.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 13:20:05 -0000 Ummm....seriously? Well, after you get all the marginal parameters on the compilation and everything else cleared away, you have the "platform of choice". This is what development takes place on "in-house" so to speak. The developers become a lot more familiar through symbiosis with OS developers and sysadmins. They get to know a lot more about how to tune and performance enhance the machines on that platform. Usually, (not an absolute, only a fool speaks in absolutes) there's just a lot more understood about the OS and tuning is at a higher level and performance is better overall. (We can split hairs on this philosophy all day, however, this is just my opinion and response to your query. I REALLY DON'T want to start a thread on this.) Also, thanks to everyone whose responded so far! I will check on the starvation aspect, however, I did notice while using systat -vm that there was no starvation on memory or anything else. That's why I was concerned as to why the machine halted/stalled. I'm turning off HTT now and will see how it performs. P. On Tuesday 26 August 2003 08:42 am, Michael Nottebrock wrote: > Paul Pathiakis wrote: > > It is my belief that a BSD DB is > > going to run faster on it's platform of choice for development (FreeBSD) > > than another OS. > > Why? I mean, seriously, what has the platform you run your gcc and vim on > to do with performance at the end of the day? From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 11:39:18 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B11DF16A4BF; Tue, 26 Aug 2003 11:39:18 -0700 (PDT) Received: from abe.micropat.com (abe.micropat.com [204.17.221.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id A043243F85; Tue, 26 Aug 2003 11:39:13 -0700 (PDT) (envelope-from paul@pathiakis.com) Received: from 10.0.0.101 ([204.17.221.104]) by abe.micropat.com (Netscape Messaging Server 4.15) with ESMTP id HK8OTJ00.PVZ; Tue, 26 Aug 2003 14:32:07 -0400 From: Paul Pathiakis To: "Marc G. Fournier" , Sean Chittenden Date: Tue, 26 Aug 2003 14:38:29 -0400 User-Agent: KMail/1.5.3 References: <200308250929.32143.paul@pathiakis.com> <20030826030527.GB1514@perrin.nxad.com> <20030826013926.E691@ganymede.hub.org> In-Reply-To: <20030826013926.E691@ganymede.hub.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200308261438.29700.paul@pathiakis.com> cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: paul@pathiakis.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 18:39:18 -0000 Marc, I've tried disabling HTT in the BIOS (it's an Intel board). I've disable HTT, saved the changes and the kernel is still seeing 4 CPUs when it boots. Any ideas? Thanks, P. On Tuesday 26 August 2003 12:44 am, Marc G. Fournier wrote: > > > Again, the machine is a twin 2.8 Xeon HTT machine. HTT is turned on > > > and the machine sees 4 cpus. > > > > Have you played with toggling the sysctl machdep.cpu_idle_hlt? > > In fact, disabled HTT altogether ... I have a machine with pretty much the > same specs (2.4 vs 2.8 Xeon's) and I found performance noticeably improved > with HTT disabled ... not just with processes, but with interactive > sessions as well ... > > > >From your postgresql.conf: > > > > > > shared_buffers = 48000 # min max_connections*2 or 16, 8KB each > > > > WHOA! This is too high by a factor of about 10. You probably want a > > shared buffers set to 4096. > > Why? If you have the memory and all that ... All my production servers > run: > > /usr/local/bin/postmaster -B 40960 -N 512 -i -p 5432 > -D/usr/local/pgsql/5432 -S (postgres) > > > > sort_mem = 32768 # min 64, size in KB > > > > This also seems high, divide by 8 and you're at a more reasonable > > level. > > Again, depends on alot of things here ... if he only has the one > connection to the DB, allowing for 32M of RAM to be used for sorting isn't > a bad thing, since it keeps the sorts off of the hard drive ... that is > one stat that I wish we kept somehow ... "max sort size" ... From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 11:57:56 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3430B16A4BF; Tue, 26 Aug 2003 11:57:56 -0700 (PDT) Received: from abe.micropat.com (abe.micropat.com [204.17.221.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id F32CB43FFB; Tue, 26 Aug 2003 11:57:52 -0700 (PDT) (envelope-from paul@pathiakis.com) Received: from 10.0.0.101 ([204.17.221.104]) by abe.micropat.com (Netscape Messaging Server 4.15) with ESMTP id HK8POP00.IO3; Tue, 26 Aug 2003 14:50:49 -0400 From: Paul Pathiakis To: "Paul Pathiakis" , freebsd-database@freebsd.org, freebsd-performance@freebsd.org Date: Tue, 26 Aug 2003 14:57:16 -0400 User-Agent: KMail/1.5.3 References: <200308250929.32143.paul@pathiakis.com> <200308261420.16894.ppathiakis@micropat.com> In-Reply-To: <200308261420.16894.ppathiakis@micropat.com> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200308261457.16182.paul@pathiakis.com> Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: paul@pathiakis.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 18:57:56 -0000 Hi, the next question was: what does this do? From one of the db guys: It does 'selects' from several tables in database restricting results with where clauses and sorting with order by these reports contain lists of 40,000 entries. Looking at one of the reports ...it's big select statement with lots of join conditions stuff like... LEFT OUTER JOIN prod.t_dbmap AS pdb ON pt.patentid = pdb.patentid LEFT OUTER JOIN prod.t_inventors AS i ON pt.first_inventor = i.inventorid They're expensive queries to run especially with large datasets Does this clarify what we're attempting? Is DBbench a good tool to run against this beast? Thanks! Paul Pathiakis On Tuesday 26 August 2003 02:20 pm, Paul Pathiakis wrote: > Ok....everyone wanted more info so..... > > I've attached the ipcs -a log for the run > I've attached the vmstat log for the run > > (I wanted the iostat, but screwed that up.) > > 5 large processes were kicked off. The processes started off ok but then > just stalled. They continued to run until completion but VERY slowly. > Many times I saw the processes in semwait states. However, the CPU load > never went over 0.80. Everything just kind of stalled and waited. They > consumed huge amounts of memory but never swapped. > > Again, thanks to everyone for taking the time!! > > Paul Pathiakis > > I disabled HTT in the BIOS, but the OS still saw 4 cpus... I'm going to > again try to disable HTT and see what occurs in the kernel boot. For right > now, I've enable and modified all the parameters according to what Sean > suggested. I'm hoping they've turned up something here. In the event that > somehow I can't disable, I'll use the cpu sysctl parameter that was > suggested. > > The stats from top are from 5 processes that were run simultaneously: > > last pid: 8704; load averages: 0.10, 0.15, 0.10 up 0+04:26:55 > 14:22:37 > 52 processes: 1 running, 51 sleeping > CPU states: 2.4% user, 0.0% nice, 0.9% system, 0.6% interrupt, 96.1% > idle Mem: 181M Active, 3185M Inact, 296M Wired, 187M Cache, 255M Buf, 5516K > Free Swap: 4096M Total, 4096M Free > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU CPU COMMAND > 8171 pgsql -8 0 129M 116M biord 0 1:01 5.32% 5.32% > postgres 8173 pgsql -8 0 137M 125M biord 0 0:43 3.76% 3.76% > postgres 8320 pgsql 96 0 2188K 1176K select 2 0:01 0.00% 0.00% > top 598 pgsql 96 0 6164K 2232K select 2 0:00 0.00% 0.00% sshd > 652 pgsql 96 0 48696K 4160K select 0 0:00 0.00% 0.00% postgres > 599 pgsql 8 0 2556K 1664K wait 0 0:00 0.00% 0.00% ksh93 655 > pgsql 96 0 48748K 2976K select 0 0:00 0.00% 0.00% postgres 653 > pgsql 96 0 49684K 2944K select 0 0:00 0.00% 0.00% postgres > > On Monday 25 August 2003 09:29 am, Paul Pathiakis wrote: > > Hi, > > > > I'd like to thank everyone for their help so far. I'm implement most of > > the enhancements and changes on the database so far. I now have a bigger > > problem... the machine is generating some large reports (term used by > > the DB people here) and the processes start and instantly drop off to no > > utilization... they sit there and hang... seemingly resource starved. > > I'd like know if someone could help me. I've enclosed the > > postgresql.conf file, the systctl.conf file, loader.conf and the Kernel > > memory parameters. Again, the machine is a twin 2.8 Xeon HTT machine. > > HTT is turned on and the machine sees 4 cpus. It has 4 GB of RAM and I'm > > starting to put on SCSI drives as the machine had the IDE drives maxed > > out at 100% utilization at all times. (Again, I didn't order this > > machine, otherwise it would have had dual U320 channels etc on its I/O > > system) Presently, due to scavenging a PCI SCSI card (ADAPTEC U2W), > > disks (U320 10K rpm) and an enclosure for 4 disks, I have the following: > > > > /dev/ar1s1d 114244630 479980 104625080 0% /usr/local > > /dev/da0s1d 138860928 81448860 46303194 64% /usr/local/pgsql > > /dev/md0 1031916 4 949360 0% > > /usr/local/pgsql/data/base/16978/pgsql_tmp > > procfs 4 4 0 100% /proc > > /dev/da1s1d 138860928 131202 127620852 0% > > /usr/local/pgsql/data/pg_xlog > > /dev/da2s1d 142801720 3277472 128100112 2% /pg_index > > /dev/da3s1d 142801720 1049616 130327968 1% /pg_table > > > > noatime is configured on the pgsql hierarchy and related links to disks > > on /pg_* . I configured a MD as the pgsql_tmp directory, etc. I've > > created UFS2+S filesystems with block and frag sizes of 8K as this is > > optimal for PG. I hope this makes sense all the way around. I'm not a > > DBA, just a UNIX admin. > > > > Anyhow, I'm looking at the postgresql.conf file and I don't see a whole > > lot that makes sense to me. Please help! I've got a bunch of people > > saying Linux just runs faster and the DB group is using a Linux config > > file on the FreeBSD machine. (Don't get me going) It is my belief that > > a BSD DB is going to run faster on it's platform of choice for > > development (FreeBSD) than another OS. Please help! > > > > Thanks! > > > > Paul Pathiakis > > > > > > sysctl.conf: > > > > kern.maxfiles=10000 > > kern.ipc.shm_use_phys=1 > > kern.ipc.shmall=524288 > > kern.ipc.shmmax=1073741824 > > vfs.vmiodirenable=1 > > > > loader.conf > > > > kern.maxfiles=32768 > > kern.nbuf=16384 > > > > GENERIC SMP: > > > > options SYSVMSG #SYSV-style message queues > > options SYSVSHM #SYSV-style shared memory > > options SYSVSEM #SYSV-style semaphores > > options SHMMAXPGS=4096 > > options SHMSEG=256 > > options SEMMNI=256 > > options SEMMNS=512 > > options SEMMNU=256 > > options SEMMAP=256 > > > > Postgresql.conf: > > > > # > > # PostgreSQL configuration file > > # ----------------------------- > > # > > # This file consists of lines of the form: > > # > > # name = value > > # > > # (The '=' is optional.) White space may be used. Comments are introduced > > # with '#' anywhere on a line. The complete list of option names and > > # allowed values can be found in the PostgreSQL documentation. The > > # commented-out settings shown in this file represent the default values. > > # > > # Any option can also be given as a command line switch to the > > # postmaster, e.g. 'postmaster -c log_connections=on'. Some options > > # can be changed at run-time with the 'SET' SQL command. > > # > > # This file is read on postmaster startup and when the postmaster > > # receives a SIGHUP. If you edit the file on a running system, you have > > # to SIGHUP the postmaster for the changes to take effect, or use > > # "pg_ctl reload". > > > > > > #======================================================================== > > > > > > # > > # Connection Parameters > > # > > #tcpip_socket = false > > #ssl = false > > > > max_connections = 128 > > #superuser_reserved_connections = 2 > > > > #port = 5432 > > #hostname_lookup = false > > #show_source_port = false > > > > #unix_socket_directory = '' > > #unix_socket_group = '' > > #unix_socket_permissions = 0777 # octal > > > > #virtual_host = '' > > > > #krb_server_keyfile = '' > > > > > > # > > # Shared Memory Size > > # > > shared_buffers = 48000 # min max_connections*2 or 16, 8KB each > > #max_fsm_relations = 1000 # min 10, fsm is free space map, ~40 > > bytes #max_fsm_pages = 10000 # min 1000, fsm is free space map, > > ~6 bytes #max_locks_per_transaction = 64 # min 10 > > #wal_buffers = 8 # min 4, typically 8KB each > > > > # > > # Non-shared Memory Sizes > > # > > sort_mem = 32768 # min 64, size in KB > > #vacuum_mem = 8192 # min 1024, size in KB > > > > > > # > > # Write-ahead log (WAL) > > # > > #checkpoint_segments = 3 # in logfile segments, min 1, 16MB each > > #checkpoint_timeout = 300 # range 30-3600, in seconds > > # > > #commit_delay = 0 # range 0-100000, in microseconds > > #commit_siblings = 5 # range 1-1000 > > # > > #fsync = true > > #wal_sync_method = fsync # the default varies across platforms: > > # # fsync, fdatasync, open_sync, or > > open_datasync > > #wal_debug = 0 # range 0-16 > > > > > > # > > # Optimizer Parameters > > # > > #enable_seqscan = true > > #enable_indexscan = true > > #enable_tidscan = true > > #enable_sort = true > > #enable_nestloop = true > > #enable_mergejoin = true > > #enable_hashjoin = true > > > > #effective_cache_size = 1000 # typically 8KB each > > #random_page_cost = 4 # units are one sequential page fetch > > cost #cpu_tuple_cost = 0.01 # (same) > > #cpu_index_tuple_cost = 0.001 # (same) > > #cpu_operator_cost = 0.0025 # (same) > > > > #default_statistics_target = 10 # range 1-1000 > > > > # > > # GEQO Optimizer Parameters > > # > > #geqo = true > > #geqo_selection_bias = 2.0 # range 1.5-2.0 > > #geqo_threshold = 11 > > #geqo_pool_size = 0 # default based on tables in statement, > > # range 128-1024 > > #geqo_effort = 1 > > #geqo_generations = 0 > > #geqo_random_seed = -1 # auto-compute seed > > > > > > # > > # Message display > > # > > #server_min_messages = notice # Values, in order of decreasing detail: > > # debug5, debug4, debug3, debug2, > > debug1, # info, notice, warning, error, log, fatal, # panic > > #client_min_messages = notice # Values, in order of decreasing detail: > > # debug5, debug4, debug3, debug2, > > debug1, # log, info, notice, warning, error #silent_mode = false > > > > #log_connections = false > > #log_pid = false > > #log_statement = false > > #log_duration = false > > #log_timestamp = false > > > > #log_min_error_statement = panic # Values in order of increasing > > severity: # debug5, debug4, debug3, debug2, debug1, # info, notice, > > warning, error, panic(off) > > > > #debug_print_parse = false > > #debug_print_rewritten = false > > #debug_print_plan = false > > #debug_pretty_print = false > > > > #explain_pretty_print = true > > > > # requires USE_ASSERT_CHECKING > > #debug_assertions = true > > > > > > # > > # Syslog > > # > > #syslog = 0 # range 0-2 > > #syslog_facility = 'LOCAL0' > > #syslog_ident = 'postgres' > > > > > > # > > # Statistics > > # > > #show_parser_stats = false > > #show_planner_stats = false > > #show_executor_stats = false > > #show_statement_stats = false > > > > # requires BTREE_BUILD_STATS > > #show_btree_build_stats = false > > > > > > # > > # Access statistics collection > > # > > #stats_start_collector = true > > #stats_reset_on_server_start = true > > #stats_command_string = false > > #stats_row_level = false > > #stats_block_level = false > > > > > > # > > # Lock Tracing > > # > > #trace_notify = false > > > > # requires LOCK_DEBUG > > #trace_locks = false > > #trace_userlocks = false > > #trace_lwlocks = false > > #debug_deadlocks = false > > #trace_lock_oidmin = 16384 > > #trace_lock_table = 0 > > > > > > # > > # Misc > > # > > #autocommit = true > > #dynamic_library_path = '$libdir' > > #search_path = '$user,public' > > #datestyle = 'iso, us' > > #timezone = unknown # actually, defaults to TZ environment > > setting #australian_timezones = false > > #client_encoding = sql_ascii # actually, defaults to database encoding > > #authentication_timeout = 60 # 1-600, in seconds > > #deadlock_timeout = 1000 # in milliseconds > > #default_transaction_isolation = 'read committed' > > #max_expr_depth = 10000 # min 10 > > #max_files_per_process = 1000 # min 25 > > #password_encryption = true > > #sql_inheritance = true > > #transform_null_equals = false > > #statement_timeout = 0 # 0 is disabled, in milliseconds > > #db_user_namespace = false > > > > > > > > # > > # Locale settings > > # > > # (initialized by initdb -- may be changed) > > LC_MESSAGES = 'C' > > LC_MONETARY = 'C' > > LC_NUMERIC = 'C' > > LC_TIME = 'C' > > > > > > > > > > > > _______________________________________________ > > freebsd-database@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-database > > To unsubscribe, send any mail to > > "freebsd-database-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 12:13:59 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DC6D016A4BF for ; Tue, 26 Aug 2003 12:13:59 -0700 (PDT) Received: from mail.numachi.com (meisai.numachi.com [198.175.254.6]) by mx1.FreeBSD.org (Postfix) with SMTP id 7328643F93 for ; Tue, 26 Aug 2003 12:13:57 -0700 (PDT) (envelope-from reichert@numachi.com) Received: (qmail 934 invoked from network); 26 Aug 2003 19:13:55 -0000 Received: from natto.numachi.com (198.175.254.216) by meisai.numachi.com with SMTP; 26 Aug 2003 19:13:55 -0000 Received: (qmail 16618 invoked by uid 1001); 26 Aug 2003 19:13:54 -0000 Date: Tue, 26 Aug 2003 15:13:54 -0400 From: Brian Reichert To: Paul Pathiakis Message-ID: <20030826191354.GM360@numachi.com> References: <200308250929.32143.paul@pathiakis.com> <200308261420.16894.ppathiakis@micropat.com> <200308261457.16182.paul@pathiakis.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200308261457.16182.paul@pathiakis.com> User-Agent: Mutt/1.4i cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org cc: Paul Pathiakis Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 19:14:00 -0000 On Tue, Aug 26, 2003 at 02:57:16PM -0400, Paul Pathiakis wrote: > Does this clarify what we're attempting? Is DBbench a good tool to run > against this beast? MySQL comes with a 'crashme' suite; could that be reapplied to Postgres? > Thanks! > > Paul Pathiakis -- Brian 'you Bastard' Reichert 37 Crystal Ave. #303 Daytime number: (603) 434-6842 Derry NH 03038-1713 USA BSD admin/developer at large From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 12:34:01 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4FAF016A4BF; Tue, 26 Aug 2003 12:34:01 -0700 (PDT) Received: from abe.micropat.com (abe.micropat.com [204.17.221.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id A194743FE1; Tue, 26 Aug 2003 12:33:59 -0700 (PDT) (envelope-from paul@pathiakis.com) Received: from 10.0.0.101 ([204.17.221.104]) by abe.micropat.com (Netscape Messaging Server 4.15) with ESMTP id HK8RCV00.EV7; Tue, 26 Aug 2003 15:26:55 -0400 From: Paul Pathiakis To: "Marc G. Fournier" Date: Tue, 26 Aug 2003 15:33:22 -0400 User-Agent: KMail/1.5.3 References: <200308250929.32143.paul@pathiakis.com> <200308261438.29700.paul@pathiakis.com> <20030826161914.E691@ganymede.hub.org> In-Reply-To: <20030826161914.E691@ganymede.hub.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200308261533.22411.paul@pathiakis.com> cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list Reply-To: paul@pathiakis.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 19:34:01 -0000 Hi, I'm running 5.1-RELEASE. No, I didn't enable it in my kernel config. Top shows only cpu 0 and cpu 2 running. However, as the machine boots it tells me that it enables cpu 1, 2, and 3. The only thing in my kernel that I enabled is SMP and APIC_IO. Thanks! P. On Tuesday 26 August 2003 03:19 pm, Marc G. Fournier wrote: > You are running -STABLE? Did you enable HTT in your kernel config file? > > On Tue, 26 Aug 2003, Paul Pathiakis wrote: > > Marc, > > > > I've tried disabling HTT in the BIOS (it's an Intel board). I've > > disable HTT, saved the changes and the kernel is still seeing 4 CPUs when > > it boots. Any ideas? > > > > Thanks, > > > > P. > > > > On Tuesday 26 August 2003 12:44 am, Marc G. Fournier wrote: > > > > > Again, the machine is a twin 2.8 Xeon HTT machine. HTT is turned > > > > > on and the machine sees 4 cpus. > > > > > > > > Have you played with toggling the sysctl machdep.cpu_idle_hlt? > > > > > > In fact, disabled HTT altogether ... I have a machine with pretty much > > > the same specs (2.4 vs 2.8 Xeon's) and I found performance noticeably > > > improved with HTT disabled ... not just with processes, but with > > > interactive sessions as well ... > > > > > > > >From your postgresql.conf: > > > > > > > > > > shared_buffers = 48000 # min max_connections*2 or 16, 8KB > > > > > each > > > > > > > > WHOA! This is too high by a factor of about 10. You probably want a > > > > shared buffers set to 4096. > > > > > > Why? If you have the memory and all that ... All my production servers > > > run: > > > > > > /usr/local/bin/postmaster -B 40960 -N 512 -i -p 5432 > > > -D/usr/local/pgsql/5432 -S (postgres) > > > > > > > > sort_mem = 32768 # min 64, size in KB > > > > > > > > This also seems high, divide by 8 and you're at a more reasonable > > > > level. > > > > > > Again, depends on alot of things here ... if he only has the one > > > connection to the DB, allowing for 32M of RAM to be used for sorting > > > isn't a bad thing, since it keeps the sorts off of the hard drive ... > > > that is one stat that I wish we kept somehow ... "max sort size" ... From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 11:21:03 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9E06916A4BF; Tue, 26 Aug 2003 11:21:03 -0700 (PDT) Received: from abe.micropat.com (abe.micropat.com [204.17.221.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id DE3C343FBD; Tue, 26 Aug 2003 11:20:55 -0700 (PDT) (envelope-from ppathiakis@micropat.com) Received: from 10.0.0.101 ([204.17.221.104]) by abe.micropat.com (Netscape Messaging Server 4.15) with ESMTP id HK8NZ100.BN0; Tue, 26 Aug 2003 14:13:49 -0400 From: "Paul Pathiakis" Organization: Micropatent To: paul@pathiakis.com, freebsd-database@freebsd.org, freebsd-performance@freebsd.org Date: Tue, 26 Aug 2003 14:20:16 -0400 User-Agent: KMail/1.5.3 References: <200308250929.32143.paul@pathiakis.com> In-Reply-To: <200308250929.32143.paul@pathiakis.com> MIME-Version: 1.0 Content-Type: Multipart/Mixed; boundary="Boundary-00=_gT6S/r3TMhmEE2n" Message-Id: <200308261420.16894.ppathiakis@micropat.com> X-Mailman-Approved-At: Tue, 26 Aug 2003 15:08:33 -0700 Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 18:21:03 -0000 --Boundary-00=_gT6S/r3TMhmEE2n Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Ok....everyone wanted more info so..... I've attached the ipcs -a log for the run I've attached the vmstat log for the run (I wanted the iostat, but screwed that up.) 5 large processes were kicked off. The processes started off ok but then just stalled. They continued to run until completion but VERY slowly. Many times I saw the processes in semwait states. However, the CPU load never went over 0.80. Everything just kind of stalled and waited. They consumed huge amounts of memory but never swapped. Again, thanks to everyone for taking the time!! Paul Pathiakis I disabled HTT in the BIOS, but the OS still saw 4 cpus... I'm going to again try to disable HTT and see what occurs in the kernel boot. For right now, I've enable and modified all the parameters according to what Sean suggested. I'm hoping they've turned up something here. In the event that somehow I can't disable, I'll use the cpu sysctl parameter that was suggested. The stats from top are from 5 processes that were run simultaneously: last pid: 8704; load averages: 0.10, 0.15, 0.10 up 0+04:26:55 14:22:37 52 processes: 1 running, 51 sleeping CPU states: 2.4% user, 0.0% nice, 0.9% system, 0.6% interrupt, 96.1% idle Mem: 181M Active, 3185M Inact, 296M Wired, 187M Cache, 255M Buf, 5516K Free Swap: 4096M Total, 4096M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU CPU COMMAND 8171 pgsql -8 0 129M 116M biord 0 1:01 5.32% 5.32% postgres 8173 pgsql -8 0 137M 125M biord 0 0:43 3.76% 3.76% postgres 8320 pgsql 96 0 2188K 1176K select 2 0:01 0.00% 0.00% top 598 pgsql 96 0 6164K 2232K select 2 0:00 0.00% 0.00% sshd 652 pgsql 96 0 48696K 4160K select 0 0:00 0.00% 0.00% postgres 599 pgsql 8 0 2556K 1664K wait 0 0:00 0.00% 0.00% ksh93 655 pgsql 96 0 48748K 2976K select 0 0:00 0.00% 0.00% postgres 653 pgsql 96 0 49684K 2944K select 0 0:00 0.00% 0.00% postgres On Monday 25 August 2003 09:29 am, Paul Pathiakis wrote: > Hi, > > I'd like to thank everyone for their help so far. I'm implement most of > the enhancements and changes on the database so far. I now have a bigger > problem... the machine is generating some large reports (term used by the > DB people here) and the processes start and instantly drop off to no > utilization... they sit there and hang... seemingly resource starved. > I'd like know if someone could help me. I've enclosed the postgresql.conf > file, the systctl.conf file, loader.conf and the Kernel memory parameters. > Again, the machine is a twin 2.8 Xeon HTT machine. HTT is turned on and > the machine sees 4 cpus. It has 4 GB of RAM and I'm starting to put on > SCSI drives as the machine had the IDE drives maxed out at 100% utilization > at all times. (Again, I didn't order this machine, otherwise it would have > had dual U320 channels etc on its I/O system) Presently, due to scavenging > a PCI SCSI card (ADAPTEC U2W), disks (U320 10K rpm) and an enclosure for 4 > disks, I have the following: > > /dev/ar1s1d 114244630 479980 104625080 0% /usr/local > /dev/da0s1d 138860928 81448860 46303194 64% /usr/local/pgsql > /dev/md0 1031916 4 949360 0% > /usr/local/pgsql/data/base/16978/pgsql_tmp > procfs 4 4 0 100% /proc > /dev/da1s1d 138860928 131202 127620852 0% > /usr/local/pgsql/data/pg_xlog > /dev/da2s1d 142801720 3277472 128100112 2% /pg_index > /dev/da3s1d 142801720 1049616 130327968 1% /pg_table > > noatime is configured on the pgsql hierarchy and related links to disks on > /pg_* . I configured a MD as the pgsql_tmp directory, etc. I've created > UFS2+S filesystems with block and frag sizes of 8K as this is optimal for > PG. I hope this makes sense all the way around. I'm not a DBA, just a UNIX > admin. > > Anyhow, I'm looking at the postgresql.conf file and I don't see a whole > lot that makes sense to me. Please help! I've got a bunch of people > saying Linux just runs faster and the DB group is using a Linux config file > on the FreeBSD machine. (Don't get me going) It is my belief that a BSD > DB is going to run faster on it's platform of choice for development > (FreeBSD) than another OS. Please help! > > Thanks! > > Paul Pathiakis > > > sysctl.conf: > > kern.maxfiles=10000 > kern.ipc.shm_use_phys=1 > kern.ipc.shmall=524288 > kern.ipc.shmmax=1073741824 > vfs.vmiodirenable=1 > > loader.conf > > kern.maxfiles=32768 > kern.nbuf=16384 > > GENERIC SMP: > > options SYSVMSG #SYSV-style message queues > options SYSVSHM #SYSV-style shared memory > options SYSVSEM #SYSV-style semaphores > options SHMMAXPGS=4096 > options SHMSEG=256 > options SEMMNI=256 > options SEMMNS=512 > options SEMMNU=256 > options SEMMAP=256 > > Postgresql.conf: > > # > # PostgreSQL configuration file > # ----------------------------- > # > # This file consists of lines of the form: > # > # name = value > # > # (The '=' is optional.) White space may be used. Comments are introduced > # with '#' anywhere on a line. The complete list of option names and > # allowed values can be found in the PostgreSQL documentation. The > # commented-out settings shown in this file represent the default values. > # > # Any option can also be given as a command line switch to the > # postmaster, e.g. 'postmaster -c log_connections=on'. Some options > # can be changed at run-time with the 'SET' SQL command. > # > # This file is read on postmaster startup and when the postmaster > # receives a SIGHUP. If you edit the file on a running system, you have > # to SIGHUP the postmaster for the changes to take effect, or use > # "pg_ctl reload". > > > #======================================================================== > > > # > # Connection Parameters > # > #tcpip_socket = false > #ssl = false > > max_connections = 128 > #superuser_reserved_connections = 2 > > #port = 5432 > #hostname_lookup = false > #show_source_port = false > > #unix_socket_directory = '' > #unix_socket_group = '' > #unix_socket_permissions = 0777 # octal > > #virtual_host = '' > > #krb_server_keyfile = '' > > > # > # Shared Memory Size > # > shared_buffers = 48000 # min max_connections*2 or 16, 8KB each > #max_fsm_relations = 1000 # min 10, fsm is free space map, ~40 bytes > #max_fsm_pages = 10000 # min 1000, fsm is free space map, ~6 bytes > #max_locks_per_transaction = 64 # min 10 > #wal_buffers = 8 # min 4, typically 8KB each > > # > # Non-shared Memory Sizes > # > sort_mem = 32768 # min 64, size in KB > #vacuum_mem = 8192 # min 1024, size in KB > > > # > # Write-ahead log (WAL) > # > #checkpoint_segments = 3 # in logfile segments, min 1, 16MB each > #checkpoint_timeout = 300 # range 30-3600, in seconds > # > #commit_delay = 0 # range 0-100000, in microseconds > #commit_siblings = 5 # range 1-1000 > # > #fsync = true > #wal_sync_method = fsync # the default varies across platforms: > # # fsync, fdatasync, open_sync, or > open_datasync > #wal_debug = 0 # range 0-16 > > > # > # Optimizer Parameters > # > #enable_seqscan = true > #enable_indexscan = true > #enable_tidscan = true > #enable_sort = true > #enable_nestloop = true > #enable_mergejoin = true > #enable_hashjoin = true > > #effective_cache_size = 1000 # typically 8KB each > #random_page_cost = 4 # units are one sequential page fetch cost > #cpu_tuple_cost = 0.01 # (same) > #cpu_index_tuple_cost = 0.001 # (same) > #cpu_operator_cost = 0.0025 # (same) > > #default_statistics_target = 10 # range 1-1000 > > # > # GEQO Optimizer Parameters > # > #geqo = true > #geqo_selection_bias = 2.0 # range 1.5-2.0 > #geqo_threshold = 11 > #geqo_pool_size = 0 # default based on tables in statement, > # range 128-1024 > #geqo_effort = 1 > #geqo_generations = 0 > #geqo_random_seed = -1 # auto-compute seed > > > # > # Message display > # > #server_min_messages = notice # Values, in order of decreasing detail: > # debug5, debug4, debug3, debug2, debug1, > # info, notice, warning, error, log, > fatal, # panic > #client_min_messages = notice # Values, in order of decreasing detail: > # debug5, debug4, debug3, debug2, debug1, > # log, info, notice, warning, error > #silent_mode = false > > #log_connections = false > #log_pid = false > #log_statement = false > #log_duration = false > #log_timestamp = false > > #log_min_error_statement = panic # Values in order of increasing severity: > # debug5, debug4, debug3, debug2, > debug1, # info, notice, warning, error, panic(off) > > #debug_print_parse = false > #debug_print_rewritten = false > #debug_print_plan = false > #debug_pretty_print = false > > #explain_pretty_print = true > > # requires USE_ASSERT_CHECKING > #debug_assertions = true > > > # > # Syslog > # > #syslog = 0 # range 0-2 > #syslog_facility = 'LOCAL0' > #syslog_ident = 'postgres' > > > # > # Statistics > # > #show_parser_stats = false > #show_planner_stats = false > #show_executor_stats = false > #show_statement_stats = false > > # requires BTREE_BUILD_STATS > #show_btree_build_stats = false > > > # > # Access statistics collection > # > #stats_start_collector = true > #stats_reset_on_server_start = true > #stats_command_string = false > #stats_row_level = false > #stats_block_level = false > > > # > # Lock Tracing > # > #trace_notify = false > > # requires LOCK_DEBUG > #trace_locks = false > #trace_userlocks = false > #trace_lwlocks = false > #debug_deadlocks = false > #trace_lock_oidmin = 16384 > #trace_lock_table = 0 > > > # > # Misc > # > #autocommit = true > #dynamic_library_path = '$libdir' > #search_path = '$user,public' > #datestyle = 'iso, us' > #timezone = unknown # actually, defaults to TZ environment > setting #australian_timezones = false > #client_encoding = sql_ascii # actually, defaults to database encoding > #authentication_timeout = 60 # 1-600, in seconds > #deadlock_timeout = 1000 # in milliseconds > #default_transaction_isolation = 'read committed' > #max_expr_depth = 10000 # min 10 > #max_files_per_process = 1000 # min 25 > #password_encryption = true > #sql_inheritance = true > #transform_null_equals = false > #statement_timeout = 0 # 0 is disabled, in milliseconds > #db_user_namespace = false > > > > # > # Locale settings > # > # (initialized by initdb -- may be changed) > LC_MESSAGES = 'C' > LC_MONETARY = 'C' > LC_NUMERIC = 'C' > LC_TIME = 'C' > > > > > > _______________________________________________ > freebsd-database@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-database > To unsubscribe, send any mail to "freebsd-database-unsubscribe@freebsd.org" --Boundary-00=_gT6S/r3TMhmEE2n Content-Type: text/plain; charset="iso-8859-1"; name="ipcspg04" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="ipcspg04" Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:21 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:26 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:29 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:35 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:38 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:38 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:51 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:56 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:56 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:15:56 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:08 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:14 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:20 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:26 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:30 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:37 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:42 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:47 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:52 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:16:56 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:02 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:06 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:12 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:16 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:19 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:26 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:32 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:36 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:42 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:47 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:52 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:17:57 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:02 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:07 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:12 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:17 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:22 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:27 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:32 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:37 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:42 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:45 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:52 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:18:57 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:19:02 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME m 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 5 43335680 652 65210:12:02 14:14:39 10:12:02 Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME s 131072 5432001 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131073 5432002 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131074 5432003 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131075 5432004 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131076 5432005 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131077 5432006 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131078 5432007 --rw------- pgsql pgsql pgsql pgsql 1710:12:02 10:12:02 s 131079 5432008 --rw------- pgsql pgsql pgsql pgsql 1714:19:07 10:12:02 s 131080 5432009 --rw------- pgsql pgsql pgsql pgsql 1710:24:26 10:12:02 ^C ehpg04# --Boundary-00=_gT6S/r3TMhmEE2n Content-Type: text/plain; charset="iso-8859-1"; name="vmstatpg04" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="vmstatpg04" vmstat -c 100 -w 5 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 3 1 278636 3360400 41 0 0 0 28 0 0 0 299 0 266 0 0 100 0 3 1 279736 3335692 765 0 0 0 90 0 0 0 636 0 1840 19 2 78 0 4 0 288000 3311564 885 0 0 0 209 0 0 0 651 0 1849 17 2 81 0 3 1 289816 3288048 611 0 0 0 46 0 0 0 624 0 1747 18 1 81 0 3 1 297964 3264508 517 0 0 0 72 0 0 0 640 0 1781 16 2 82 1 2 1 298016 3241008 552 0 0 0 49 0 0 0 621 0 1822 19 2 79 0 3 1 298016 3218120 403 0 0 0 44 0 0 0 635 0 1779 15 2 83 1 2 1 314480 3193404 456 0 0 0 56 0 0 0 628 0 1798 17 2 81 0 3 1 314480 3167328 399 0 0 0 40 0 0 0 642 0 1772 16 2 83 0 3 2 322768 3142112 376 0 0 0 55 0 0 0 632 0 1687 15 2 83 1 3 0 322768 3120292 239 0 0 0 40 0 0 0 657 0 1626 8 2 90 0 3 1 322768 3097116 249 0 0 0 51 0 0 0 1127 0 2772 15 2 83 0 3 0 243684 3157872 116 0 0 0 3744 0 0 0 1531 0 3608 14 2 84 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 0 3 0 243684 3144180 121 0 0 0 50 0 0 0 604 0 1312 2 1 97 0 3 0 243684 3128372 103 0 0 0 40 0 0 0 618 0 1362 1 1 98 0 3 0 243684 3113168 94 0 0 0 50 0 0 0 618 0 1354 1 1 98 0 3 0 243684 3097104 90 0 0 0 40 0 0 0 620 0 1365 1 1 97 0 3 0 243684 3081036 97 0 0 0 50 0 0 0 627 0 1390 1 1 98 0 3 0 251836 3065572 84 0 0 0 42 0 0 0 612 0 1339 1 1 98 0 3 0 251836 3050152 103 0 0 0 47 0 0 0 609 0 1323 2 1 97 0 3 0 251836 3031904 104 0 0 0 43 0 0 0 643 0 1440 2 1 97 0 3 0 251836 3014108 110 0 0 0 47 0 0 0 636 0 1423 3 1 96 0 2 1 250020 2996772 111 0 0 0 73 0 0 0 641 0 1432 2 1 97 0 3 0 250020 2977176 117 0 0 0 54 0 0 0 652 0 1477 3 1 96 0 2 1 251144 2958916 101 0 0 0 37 0 0 0 621 0 1389 2 1 96 0 3 0 251144 2939364 99 0 0 0 40 0 0 0 632 0 1430 3 1 96 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 3 0 251144 2921084 85 0 0 0 32 0 0 0 622 0 1401 2 1 97 0 3 0 251144 2902056 97 0 0 0 40 0 0 0 628 0 1406 3 1 96 0 3 0 249332 2883892 91 0 0 0 58 0 0 0 630 0 1421 2 1 97 0 3 0 249332 2864940 88 0 0 0 29 0 0 0 627 0 1407 3 1 96 0 3 0 249332 2846724 82 0 0 0 25 0 0 0 624 0 1407 2 1 97 0 3 0 249332 2826664 90 0 0 0 29 0 0 0 631 0 1436 3 1 96 0 3 0 258220 2808180 105 0 0 0 42 0 0 0 622 0 1398 3 1 96 1 4 0 261476 2786664 275 0 0 0 39 0 0 0 668 0 1559 3 1 96 0 4 0 261684 2764796 465 0 0 0 137 0 0 0 739 0 1810 3 2 96 0 1 2 260084 2741868 400 0 0 0 141 0 0 0 668 0 1662 9 1 90 0 3 0 268340 2718016 264 0 0 0 46 0 0 0 622 0 1498 10 1 89 0 3 1 270080 2694204 503 0 0 0 48 0 0 0 731 0 1822 10 1 89 0 4 0 270096 2673052 323 0 0 0 43 0 0 0 723 0 1776 6 1 92 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 0 2 2 276436 2654884 203 0 0 0 109 0 0 0 684 0 1580 3 1 96 0 3 0 276436 2637452 96 0 0 0 43 0 0 0 620 0 1378 3 1 96 0 3 0 278188 2618920 639 0 0 0 48 0 0 0 779 0 1838 3 2 95 1 2 0 276436 2603428 131 0 0 0 114 0 0 0 632 0 1416 3 1 96 0 3 0 276436 2587024 96 0 0 0 47 0 0 0 613 0 1346 3 1 96 0 3 0 276436 2569512 122 0 0 0 43 0 0 0 607 0 1346 4 1 95 0 3 0 276436 2553040 104 0 0 0 48 0 0 0 612 0 1343 4 1 95 0 3 0 276436 2536256 98 0 0 0 43 0 0 0 619 0 1384 3 1 96 0 3 0 274624 2519248 130 0 0 0 90 0 0 0 615 0 1403 3 1 96 1 2 0 282896 2503360 91 0 0 0 40 0 0 0 611 0 1347 2 1 96 0 3 0 282896 2487508 89 0 0 0 36 0 0 0 609 0 1354 3 1 96 1 2 0 282896 2471268 640 0 0 0 94 0 0 0 779 0 1899 3 2 95 0 3 0 282896 2454352 103 0 0 0 37 0 0 0 612 0 1374 3 1 95 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 3 0 284708 2436620 129 0 0 0 43 0 0 0 614 0 1397 4 1 95 0 3 0 284708 2420640 98 0 0 0 47 0 0 0 608 0 1350 3 1 96 0 3 0 284708 2404004 111 0 0 0 43 0 0 0 605 0 1346 3 1 96 0 3 0 282892 2388684 116 0 0 0 73 0 0 0 607 0 1354 4 1 95 0 3 0 292264 2372828 111 0 0 0 46 0 0 0 605 0 1346 3 1 96 0 3 0 294000 2355092 434 0 0 0 37 0 0 0 680 0 1582 3 1 95 0 3 0 292264 2340496 315 0 0 0 93 0 0 0 688 0 1604 4 1 95 0 3 0 300464 2324044 205 0 0 0 88 0 0 0 608 0 1364 3 1 96 0 3 0 299372 2309060 203 0 0 0 101 0 0 0 609 0 1353 3 1 96 0 2 1 299372 2292480 106 0 0 0 36 0 0 0 618 0 1350 4 1 95 0 3 0 301188 2275352 117 0 0 0 42 0 0 0 619 0 1393 3 1 96 1 3 0 301188 2258784 305 0 0 0 112 0 0 0 636 0 1441 3 1 96 0 3 0 301188 2242352 108 0 0 0 47 0 0 0 617 0 1382 3 1 96 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 0 3 1 309236 2226204 104 0 0 0 48 0 0 0 615 0 1383 4 1 95 0 4 0 310980 2208688 268 0 0 0 48 0 0 0 645 0 1502 3 1 96 0 4 0 310996 2193132 256 0 0 0 43 0 0 0 699 0 1630 2 1 97 0 4 0 310996 2176788 238 0 0 0 47 0 0 0 717 0 1695 3 1 96 1 2 0 309236 2161040 144 0 0 0 102 0 0 0 642 0 1455 3 1 96 0 4 0 310976 2141980 286 0 0 0 47 0 0 0 631 0 1449 3 1 95 0 4 0 310992 2112152 294 0 0 0 43 0 0 0 809 0 1953 3 2 95 0 3 0 309236 2070056 164 0 0 0 105 0 0 0 820 0 1985 2 2 96 0 2 1 309236 2053228 51 0 0 0 43 0 0 0 617 0 1395 3 1 96 0 3 0 309236 2037112 57 0 0 0 47 0 0 0 631 0 1454 2 1 96 1 3 0 309236 2020984 49 0 0 0 45 0 0 0 642 0 1484 2 1 97 0 3 0 309236 2003812 60 0 0 0 50 0 0 0 638 0 1505 3 1 96 0 3 0 317388 1987004 605 0 0 0 101 0 0 0 792 0 1953 4 2 95 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 0 3 1 317388 1969896 218 0 0 0 122 0 0 0 636 0 1451 3 1 96 0 3 0 304872 1962208 53 0 0 0 565 0 0 0 630 0 1459 4 1 95 0 3 0 304872 1945344 61 0 0 0 51 0 0 0 622 0 1400 3 1 96 0 2 1 304872 1927884 49 0 0 0 41 0 0 0 627 0 1414 3 1 96 0 2 0 213324 2049392 62 0 0 0 6883 0 0 0 600 0 1390 10 2 88 0 3 0 215084 2034908 564 0 0 0 39 0 0 0 720 0 1672 1 1 97 0 2 0 213324 2024596 101 0 0 0 107 0 0 0 596 0 1323 1 1 99 0 2 0 213324 2012348 45 0 0 0 38 0 0 0 570 0 1279 0 1 99 0 2 0 213324 2000252 56 0 0 0 50 0 0 0 574 0 1275 0 1 99 0 2 0 213324 1985868 50 0 0 0 41 0 0 0 586 0 1310 1 1 98 0 2 0 213324 1972084 59 0 0 0 49 0 0 0 581 0 1327 1 1 98 0 2 0 213324 1958728 50 0 0 0 38 0 0 0 584 0 1323 1 1 98 0 2 0 213320 1944800 69 0 0 0 56 0 0 0 588 0 1317 1 1 98 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 0 2 1 213320 1929904 55 0 0 0 38 0 0 0 591 0 1323 1 1 98 0 2 0 213320 1915624 631 0 0 0 113 0 0 0 748 0 1755 2 1 97 0 2 0 213320 1900212 54 0 0 0 38 0 0 0 590 0 1335 1 1 98 0 2 0 213320 1886192 62 0 0 0 49 0 0 0 577 0 1289 1 1 98 0 2 0 213320 1870872 202 0 0 0 109 0 0 0 603 0 1367 1 1 98 0 2 0 213320 1856396 61 0 0 0 49 0 0 0 579 0 1289 1 1 98 0 2 0 206320 1843120 68 0 0 0 127 0 0 0 582 0 1289 1 1 98 0 2 0 206320 1827332 56 0 0 0 39 0 0 0 585 0 1306 1 1 99 0 1 1 206320 1812224 50 0 0 0 32 0 0 0 587 0 1309 2 1 98 ehpg04# !! vmstat -c 100 -w 5 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 2 0 205092 1630596 47 0 0 0 32 0 0 0 312 0 311 0 0 99 0 2 0 206320 1615784 68 0 0 0 37 0 0 0 584 0 1337 1 1 98 0 2 0 206320 1601156 45 0 0 0 32 0 0 0 581 0 1342 1 1 98 0 2 0 206320 1586272 54 0 0 0 39 0 0 0 576 0 1301 1 1 98 0 2 0 206320 1572148 46 0 0 0 32 0 0 0 583 0 1329 1 1 98 0 2 0 206320 1558556 51 0 0 0 38 0 0 0 570 0 1269 1 1 98 0 2 0 206320 1544816 45 0 0 0 32 0 0 0 577 0 1264 1 1 98 0 2 0 206320 1530060 134 0 0 0 110 0 0 0 583 0 1320 1 1 98 0 2 0 206320 1514880 48 0 0 0 32 0 0 0 591 0 1320 1 1 98 0 2 0 206320 1499328 54 0 0 0 39 0 0 0 594 0 1361 1 1 98 0 2 0 206320 1485084 46 0 0 0 32 0 0 0 587 0 1328 1 1 98 0 2 0 206320 1470724 55 0 0 0 38 0 0 0 588 0 1337 2 0 98 0 2 0 206320 1455396 49 0 0 0 32 0 0 0 584 0 1295 1 1 98 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 2 0 206320 1440568 55 0 0 0 38 0 0 0 581 0 1302 1 1 98 0 2 0 206320 1425512 47 0 0 0 32 0 0 0 589 0 1339 1 1 98 0 2 0 222768 1411080 60 0 0 0 43 0 0 0 595 0 1352 1 1 98 0 2 0 222768 1396448 47 0 0 0 32 0 0 0 591 0 1341 1 1 98 0 2 0 222768 1381116 54 0 0 0 38 0 0 0 603 0 1412 1 1 98 0 2 0 222768 1366084 49 0 0 0 32 0 0 0 585 0 1316 1 1 98 0 2 0 222768 1350156 58 0 0 0 38 0 0 0 594 0 1338 1 1 98 0 2 0 222768 1336228 49 0 0 0 32 0 0 0 579 0 1323 1 1 97 0 2 0 222768 1321100 56 0 0 0 39 0 0 0 586 0 1298 2 1 98 0 2 0 222768 1305696 48 0 0 0 32 0 0 0 593 0 1354 1 1 98 0 2 0 222768 1290496 56 0 0 0 38 0 0 0 581 0 1281 2 1 98 0 2 0 222768 1276128 47 0 0 0 32 0 0 0 587 0 1318 1 1 98 0 2 0 222768 1260644 56 0 0 0 38 0 0 0 603 0 1381 2 1 98 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 0 2 1 222768 1246592 48 0 0 0 32 0 0 0 583 0 1316 1 1 98 0 2 0 222768 1231576 54 0 0 0 38 0 0 0 590 0 1301 1 1 98 0 2 0 222768 1217048 46 0 0 0 32 0 0 0 577 0 1259 1 1 98 0 2 0 222768 1201452 54 0 0 0 38 0 0 0 579 0 1297 1 1 98 0 0 2 222768 1185060 50 0 0 0 32 0 0 0 583 0 1292 1 1 98 0 2 0 222768 1169208 57 0 0 0 38 0 0 0 590 0 1316 1 1 98 0 2 0 222768 1153456 51 0 0 0 32 0 0 0 586 0 1351 1 1 98 0 2 0 222768 1134688 59 0 0 0 38 0 0 0 651 0 1603 1 1 97 0 2 0 222768 1116088 53 0 0 0 32 0 0 0 648 0 1608 1 1 98 0 2 0 222768 1097904 58 0 0 0 38 0 0 0 649 0 1610 2 1 97 0 2 0 222768 1079636 52 0 0 0 32 0 0 0 611 0 1391 1 1 98 0 2 0 222768 1063636 54 0 0 0 38 0 0 0 597 0 1374 1 1 98 0 2 0 222768 1048568 48 0 0 0 32 0 0 0 590 0 1336 1 1 98 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 2 0 222768 1033172 56 0 0 0 38 0 0 0 591 0 1330 2 1 97 0 2 0 222768 1017516 48 0 0 0 32 0 0 0 582 0 1291 2 1 98 0 2 0 222768 1001860 56 0 0 0 38 0 0 0 588 0 1313 1 1 98 0 2 0 222768 985876 50 0 0 0 32 0 0 0 586 0 1302 1 1 97 0 2 0 222768 969520 63 0 0 0 38 0 0 0 618 0 1506 2 1 97 0 2 0 222768 954616 44 0 0 0 32 0 0 0 602 0 1509 1 1 98 0 2 0 222768 938668 50 0 0 0 38 0 0 0 610 0 1479 2 1 97 0 1 1 222768 922932 41 0 0 0 32 0 0 0 621 0 1522 1 1 98 1 1 0 222768 908192 46 0 0 0 38 0 0 0 615 0 1526 1 1 98 0 2 0 222768 893736 40 0 0 0 32 0 0 0 603 0 1471 1 1 98 0 2 0 222768 882244 46 0 0 0 38 0 0 0 563 0 1230 1 1 98 0 2 0 222768 871648 38 0 0 0 32 0 0 0 548 0 1184 0 1 99 0 2 0 222768 860480 64 0 0 0 52 0 0 0 571 0 1257 1 1 98 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 2 0 222768 847668 42 0 0 0 32 0 0 0 588 0 1319 1 1 98 0 2 0 222768 835628 44 0 0 0 35 0 0 0 582 0 1288 1 1 99 0 2 0 222768 824484 45 0 0 0 35 0 0 0 571 0 1307 1 1 99 0 2 0 222768 810516 77 0 0 0 56 0 0 0 578 0 1251 2 1 97 0 2 0 222768 793740 70 0 0 0 38 0 0 0 615 0 1380 2 1 97 0 2 0 222768 777248 50 0 0 0 32 0 0 0 651 0 1480 2 1 98 0 2 0 222768 760584 59 0 0 0 38 0 0 0 654 0 1489 2 1 98 0 2 0 222768 744084 52 0 0 0 32 0 0 0 659 0 1505 1 1 98 0 2 0 222768 727444 57 0 0 0 38 0 0 0 645 0 1455 1 1 98 0 2 0 231024 711324 59 0 0 0 34 0 0 0 634 0 1410 2 1 97 0 2 0 231024 693732 70 0 0 0 38 0 0 0 653 0 1486 2 2 97 0 2 0 231024 677096 53 0 0 0 32 0 0 0 641 0 1434 2 1 97 0 2 0 231024 659932 60 0 0 0 38 0 0 0 663 0 1511 1 1 98 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 0 2 1 231024 641452 55 0 0 0 32 0 0 0 673 0 1552 1 1 98 0 2 0 231024 621344 69 0 0 0 38 0 0 0 692 0 1620 2 1 97 0 2 0 239280 604188 63 0 0 0 34 0 0 0 634 0 1420 2 1 98 0 2 0 239280 587976 62 0 0 0 38 0 0 0 643 0 1443 1 1 98 1 2 0 239280 570492 55 0 0 0 32 0 0 0 653 0 1488 1 1 98 0 2 0 239280 553548 65 0 0 0 38 0 0 0 643 0 1455 1 1 98 0 2 0 239280 535636 57 0 0 0 32 0 0 0 642 0 1444 1 1 98 0 2 0 239280 516468 70 0 0 0 38 0 0 0 651 0 1482 2 1 97 0 2 0 239280 497564 58 0 0 0 32 0 0 0 690 0 1618 2 1 97 0 2 0 239280 475932 67 0 0 0 38 0 0 0 686 0 1586 2 1 97 0 1 1 239280 449404 67 0 0 0 32 0 0 0 738 0 1814 2 1 96 0 2 0 239280 423104 82 0 0 0 38 0 0 0 732 0 1820 3 1 96 0 2 0 239280 394872 75 0 0 0 32 0 0 0 748 0 1855 2 2 96 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 2 0 239280 370248 77 0 0 0 38 0 0 0 730 0 1768 2 1 96 0 2 0 239280 347028 64 0 0 0 32 0 0 0 723 0 1739 2 1 97 0 2 0 247376 323404 75 0 0 0 42 0 0 0 737 0 1789 2 1 97 0 2 0 247376 300644 63 0 0 0 32 0 0 0 705 0 1676 2 1 97 0 2 0 247376 278516 71 0 0 0 38 0 0 0 707 0 1675 2 1 97 0 2 0 247376 260368 73 0 0 0 32 0 0 0 636 0 1444 2 1 97 0 2 0 247376 242408 71 0 0 0 38 0 0 0 629 0 1408 2 1 97 0 2 0 247376 224680 67 0 0 0 32 0 0 0 623 0 1394 2 1 97 0 2 0 247376 207052 74 0 0 0 38 0 0 0 622 0 1411 2 1 97 0 2 0 247376 188032 78 0 0 0 32 0 0 0 641 0 1496 3 1 96 0 2 0 247376 168912 91 0 0 0 38 0 0 0 621 0 1406 3 1 96 1 1 0 247376 147136 85 0 0 0 32 0 0 0 650 0 1560 3 2 95 0 2 0 247376 127892 94 0 0 0 38 0 0 0 617 0 1395 3 1 96 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr ad4 ad6 in sy cs us sy id 1 2 0 247376 210608 77 0 0 0 85 5405 0 0 608 0 1361 2 2 96 0 2 0 247376 192004 82 6 0 0 38 0 0 0 604 0 1358 3 1 96 0 2 0 247376 173072 80 0 0 0 32 0 0 0 592 0 1308 3 1 96 0 2 0 247376 153852 85 0 0 0 38 0 0 0 602 0 1345 3 1 96 0 2 0 255648 135848 88 0 0 0 35 0 0 0 595 0 1328 3 1 95 0 2 0 255648 117344 78 0 0 0 38 0 0 0 601 0 1339 2 1 96 0 2 0 263912 199304 83 0 0 0 469 5102 0 0 608 0 1397 3 1 96 0 2 0 263912 181756 90 0 0 0 914 0 0 0 598 0 1368 3 1 95 0 2 0 263912 163764 86 0 0 0 931 0 0 0 597 0 1324 3 2 95 ehpg04# --Boundary-00=_gT6S/r3TMhmEE2n-- From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 15:35:15 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6A82916A4BF; Tue, 26 Aug 2003 15:35:15 -0700 (PDT) Received: from perrin.nxad.com (internal.ext.nxad.com [69.1.70.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id E718D43FBF; Tue, 26 Aug 2003 15:35:14 -0700 (PDT) (envelope-from sean@nxad.com) Received: by perrin.nxad.com (Postfix, from userid 1001) id 424AF20F00; Tue, 26 Aug 2003 15:35:14 -0700 (PDT) Date: Tue, 26 Aug 2003 15:35:14 -0700 From: Sean Chittenden To: Paul Pathiakis Message-ID: <20030826223514.GB44347@perrin.nxad.com> References: <200308250929.32143.paul@pathiakis.com> <200308261420.16894.ppathiakis@micropat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200308261420.16894.ppathiakis@micropat.com> X-PGP-Key: finger seanc@FreeBSD.org X-PGP-Fingerprint: 3849 3760 1AFE 7B17 11A0 83A6 DD99 E31F BC84 B341 X-Web-Homepage: http://sean.chittenden.org/ User-Agent: Mutt/1.5.4i cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org cc: paul@pathiakis.com Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Aug 2003 22:35:15 -0000 [ Please post follow ups oon this topic to just -databases, this is off topic for performance@ ] > 5 large processes were kicked off. The processes started off ok but > then just stalled. They continued to run until completion but VERY > slowly. Many times I saw the processes in semwait states. However, > the CPU load never went over 0.80. Everything just kind of stalled > and waited. They consumed huge amounts of memory but never swapped. I don't think semaphores are swap backed, but I could be wrong. That said, if I'm right (I think I am), your backends are contending for a finite amount of shared memory/semaphores. Did you turn down values to the levels I suggested? It looks like you've over stated the amount of ram available in your system in your various configs (over use of md, overly large values in postgresql.conf, and an under sized effective_cache_size, etc). Is your effective_cache_size set correctly, btw? Run the following in /bin/sh and you'll get the correct value. echo "effective_cache_size = $((`sysctl -n vfs.hibufspace` / 8192))" > I disabled HTT in the BIOS, but the OS still saw 4 cpus... I'm > going to again try to disable HTT and see what occurs in the kernel > boot. For right now, I've enable and modified all the parameters > according to what Sean suggested. I'm hoping they've turned up > something here. In the event that somehow I can't disable, I'll use > the cpu sysctl parameter that was suggested. The kernel manually walks the table. To really disable HTT, you have to recompile your kernel. -sc -- Sean Chittenden From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 17:44:42 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 1881116A4BF for ; Tue, 26 Aug 2003 17:44:42 -0700 (PDT) Received: from ns.aratech.co.kr (ns.aratech.co.kr [61.34.11.200]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6003F43FA3 for ; Tue, 26 Aug 2003 17:44:41 -0700 (PDT) (envelope-from tj@atj.dyndns.org) Received: from tj.aratech.co.kr ([61.34.11.212] helo=atj.dyndns.org ident=mail) by ns.aratech.co.kr with esmtp (Exim 3.36 #1 (Debian)) id 19roQM-0001ua-00 for ; Wed, 27 Aug 2003 09:44:34 +0900 Received: from tj by atj.dyndns.org with local (Exim 4.22) id 19roSZ-0005hP-DK for freebsd-performance@freebsd.org; Wed, 27 Aug 2003 09:46:51 +0900 Date: Wed, 27 Aug 2003 09:46:51 +0900 From: TeJun Huh To: freebsd-performance@freebsd.org Message-ID: <20030827004651.GA21881@atj.dyndns.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.4i Sender: TeJun Huh X-Mailman-Approved-At: Tue, 26 Aug 2003 17:54:32 -0700 Subject: Performance of freeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 00:44:42 -0000 Hello, I've been conducting performance tests using simple HTTP proxies and web polygraph . Web polygraph is believed to generate realistic Internet load (high number of sessions, many idle, req rate independent of resp rate, and so on). I built several equivalent HTTP proxies using various concurrency mechanisms and comparing those on linux and freeBSD. The following result is obtained on p4 xeon 2.4g (UP kernels). Custom version of Kqueue is used on Linux. FreeBSD 5.1 is updated to the latest cvs tree three weeks ago (due to thread stability issues) and compiled with GENERIC option. FreeBSD Linux Select Kqueue Select Kqueue rps 400 500 500 2500 I feel something is very wrong with FreeBSD kqueue result. Used tuning parameters are * Loader tunables kern.maxusers="512" kern.ipc.maxsockets="200000" kern.ipc.nmbclusters="51200" kern.ipc.nmbufs="102400" net.inet.tcp.tcbhashsize="65536" * Sysctls sysctl -w net.inet.ip.portrange.first=1024 sysctl -w net.inet.ip.portrange.last=65535 sysctl -w kern.ipc.somaxconn=1024 sysctl -w kern.maxfiles=200000 sysctl -w kern.maxfilesperproc=200000 sysctl -w kern.threads.max_threads_per_proc=100000 sysctl -w kern.threads.max_groups_per_proc=8000 As soon as the test machine becomes available, I'm gonna run tests on freeBSD 4.8 and compare the results. Any suggestions are welcomed. P.S. Please don't forget to CC me. TIA. -- tejun From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 19:15:26 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CE23E16A4BF; Tue, 26 Aug 2003 19:15:26 -0700 (PDT) Received: from mta10.adelphia.net (mta10.adelphia.net [68.168.78.202]) by mx1.FreeBSD.org (Postfix) with ESMTP id D866A44005; Tue, 26 Aug 2003 19:15:25 -0700 (PDT) (envelope-from wmoran@potentialtech.com) Received: from potentialtech.com ([24.53.179.151]) by mta10.adelphia.net (InterMail vM.5.01.05.32 201-253-122-126-132-20030307) with ESMTP id <20030827021526.YAEX19518.mta10.adelphia.net@potentialtech.com>; Tue, 26 Aug 2003 22:15:26 -0400 Message-ID: <3F4C143D.7000909@potentialtech.com> Date: Tue, 26 Aug 2003 22:15:25 -0400 From: Bill Moran User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.3) Gecko/20030429 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-fs@freebsd.org, freebsd-performance@freebsd.org Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Tue, 26 Aug 2003 19:18:18 -0700 Subject: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 02:15:26 -0000 Like all benchmarks, I doubt these are perfect (or even close) examples of real-world use. However, in the hopes that they will be useful for improving FreeBSD, I present them to the community. http://www.potentialtech.com/wmoran/postgresql.php Intelligent comments are welcome. -- Bill Moran Potential Technologies http://www.potentialtech.com From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 19:22:31 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 59FF216A4BF; Tue, 26 Aug 2003 19:22:31 -0700 (PDT) Received: from perrin.nxad.com (internal.ext.nxad.com [69.1.70.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id C5E1943FF2; Tue, 26 Aug 2003 19:22:28 -0700 (PDT) (envelope-from sean@nxad.com) Received: by perrin.nxad.com (Postfix, from userid 1001) id 3E54720F00; Tue, 26 Aug 2003 19:22:28 -0700 (PDT) Date: Tue, 26 Aug 2003 19:22:28 -0700 From: Sean Chittenden To: Bill Moran Message-ID: <20030827022228.GA51167@perrin.nxad.com> References: <3F4C143D.7000909@potentialtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F4C143D.7000909@potentialtech.com> X-PGP-Key: finger seanc@FreeBSD.org X-PGP-Fingerprint: 3849 3760 1AFE 7B17 11A0 83A6 DD99 E31F BC84 B341 X-Web-Homepage: http://sean.chittenden.org/ User-Agent: Mutt/1.5.4i cc: freebsd-fs@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 02:22:31 -0000 > Like all benchmarks, I doubt these are perfect (or even close) examples > of real-world use. > > However, in the hopes that they will be useful for improving FreeBSD, I > present them to the community. > > http://www.potentialtech.com/wmoran/postgresql.php > > Intelligent comments are welcome. Could you please repeat your testing with 4.X? I'm quite sure you'll see a much different picture. FreeBSD 5.X's state of locking isn't ready for production or benchmarking. If, however, you are ready to profile a 5.X kernel, those results would be very interesting to the people on this list. -sc -- Sean Chittenden From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 23:06:47 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4C2CB16A4BF; Tue, 26 Aug 2003 23:06:47 -0700 (PDT) Received: from HAL9000.homeunix.com (12-233-57-131.client.attbi.com [12.233.57.131]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8600D43FF3; Tue, 26 Aug 2003 23:06:46 -0700 (PDT) (envelope-from das@FreeBSD.ORG) Received: from HAL9000.homeunix.com (localhost [127.0.0.1]) by HAL9000.homeunix.com (8.12.9/8.12.9) with ESMTP id h7R66iXR030383; Tue, 26 Aug 2003 23:06:44 -0700 (PDT) (envelope-from das@FreeBSD.ORG) Received: (from das@localhost) by HAL9000.homeunix.com (8.12.9/8.12.9/Submit) id h7R66i7k030382; Tue, 26 Aug 2003 23:06:44 -0700 (PDT) (envelope-from das@FreeBSD.ORG) Date: Tue, 26 Aug 2003 23:06:44 -0700 From: David Schultz To: Bill Moran Message-ID: <20030827060644.GA9321@HAL9000.homeunix.com> Mail-Followup-To: Bill Moran , freebsd-fs@freebsd.org, freebsd-performance@freebsd.org References: <3F4C143D.7000909@potentialtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3F4C143D.7000909@potentialtech.com> X-Mailman-Approved-At: Tue, 26 Aug 2003 23:09:12 -0700 cc: freebsd-fs@FreeBSD.ORG cc: freebsd-performance@FreeBSD.ORG Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 06:06:47 -0000 On Tue, Aug 26, 2003, Bill Moran wrote: > Like all benchmarks, I doubt these are perfect (or even close) examples > of real-world use. > > However, in the hopes that they will be useful for improving FreeBSD, I > present them to the community. > > http://www.potentialtech.com/wmoran/postgresql.php > > Intelligent comments are welcome. Well, a little trussing revealed that pgsql uses a block size of 8K, which can be a significant pessimization when the filesystem block size is 16K, which is the default in FreeBSD! ext2fs uses 4K blocks and reiserfs uses extents, so those filesystems would not suffer from that problem. You might consider trying your test on a UFS filesystem with 8K blocks, or you could tune pgsql to use a different block size. (For pgsql, I think the appropriate tunable is BLCKSZ in include/pg_config.h. You'll have to recompile it and create a new database.) I used to think that the lack of fdatasync() in FreeBSD would significantly pessimize databases such as pgsql, but after running your script, I discovered that the fsync() overhead was only about 1% of the total execution time. Maybe that would be more significant if you tried to execute lots of little transactions, rather than a few large ones. That kind of workload is probably more common these days anyway. As previously mentioned, it would also be interesting to see what you get out of FreeBSD 4.8+softupdates, just in case the performance problems you're seeing are a result of known (or unknown) regressions in 5.X. You might also consider running your results by the pgsql people, since they understand how the database works. ;-) From owner-freebsd-performance@FreeBSD.ORG Tue Aug 26 23:28:08 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AD78D16A4BF for ; Tue, 26 Aug 2003 23:28:08 -0700 (PDT) Received: from silver.he.iki.fi (silver.he.iki.fi [193.64.42.241]) by mx1.FreeBSD.org (Postfix) with ESMTP id 241F243FE1 for ; Tue, 26 Aug 2003 23:28:07 -0700 (PDT) (envelope-from pete@he.iki.fi) Received: from he.iki.fi (h81.vuokselantie10.fi [193.64.42.129]) by silver.he.iki.fi (8.12.9/8.11.4) with ESMTP id h7R6Rd5L003552; Wed, 27 Aug 2003 09:27:45 +0300 (EEST) (envelope-from pete@he.iki.fi) Message-ID: <3F4C4F58.1060203@he.iki.fi> Date: Wed, 27 Aug 2003 09:27:36 +0300 From: Petri Helenius User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.4) Gecko/20030624 X-Accept-Language: en-us, en MIME-Version: 1.0 To: TeJun Huh References: <20030827004651.GA21881@atj.dyndns.org> In-Reply-To: <20030827004651.GA21881@atj.dyndns.org> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-performance@freebsd.org Subject: Re: Performance of freeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 06:28:08 -0000 Did you disable INVARIANTS and WITNESS when running the tests? Pete TeJun Huh wrote: > Hello, > > I've been conducting performance tests using simple HTTP proxies and >web polygraph . Web polygraph is >believed to generate realistic Internet load (high number of sessions, >many idle, req rate independent of resp rate, and so on). I built >several equivalent HTTP proxies using various concurrency mechanisms >and comparing those on linux and freeBSD. > > The following result is obtained on p4 xeon 2.4g (UP kernels). >Custom version of Kqueue is used on Linux. FreeBSD 5.1 is updated to >the latest cvs tree three weeks ago (due to thread stability issues) >and compiled with GENERIC option. > > FreeBSD Linux > Select Kqueue Select Kqueue >rps 400 500 500 2500 > > I feel something is very wrong with FreeBSD kqueue result. Used >tuning parameters are > >* Loader tunables > >kern.maxusers="512" >kern.ipc.maxsockets="200000" >kern.ipc.nmbclusters="51200" >kern.ipc.nmbufs="102400" >net.inet.tcp.tcbhashsize="65536" > >* Sysctls > >sysctl -w net.inet.ip.portrange.first=1024 >sysctl -w net.inet.ip.portrange.last=65535 >sysctl -w kern.ipc.somaxconn=1024 >sysctl -w kern.maxfiles=200000 >sysctl -w kern.maxfilesperproc=200000 >sysctl -w kern.threads.max_threads_per_proc=100000 >sysctl -w kern.threads.max_groups_per_proc=8000 > > As soon as the test machine becomes available, I'm gonna run tests on >freeBSD 4.8 and compare the results. Any suggestions are welcomed. > >P.S. Please don't forget to CC me. TIA. > > > From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 02:42:01 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A022216A4BF; Wed, 27 Aug 2003 02:42:01 -0700 (PDT) Received: from mailout01.sul.t-online.com (mailout01.sul.t-online.com [194.25.134.80]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8A9F343FBD; Wed, 27 Aug 2003 02:42:00 -0700 (PDT) (envelope-from Alexander@Leidinger.net) Received: from fwd02.aul.t-online.de by mailout01.sul.t-online.com with smtp id 19rwoR-0001hV-00; Wed, 27 Aug 2003 11:41:59 +0200 Received: from Andro-Beta.Leidinger.net (Gn3VbeZFwetCv-kc+sWe9dqEklA6TOWM2LcaO7-SajLcj3uBjxum8k@[80.131.113.207]) by fmrl02.sul.t-online.com with esmtp id 19rwo8-1nj51c0; Wed, 27 Aug 2003 11:41:40 +0200 Received: from Magelan.Leidinger.net (Magelan [192.168.1.1]) h7R9gg9O084999; Wed, 27 Aug 2003 11:42:42 +0200 (CEST) (envelope-from Alexander@Leidinger.net) Received: from Magelan.Leidinger.net (netchild@localhost [127.0.0.1]) by Magelan.Leidinger.net (8.12.9/8.12.9) with SMTP id h7R9hGBA008201; Wed, 27 Aug 2003 11:43:16 +0200 (CEST) (envelope-from Alexander@Leidinger.net) Date: Wed, 27 Aug 2003 11:43:16 +0200 From: Alexander Leidinger To: freebsd-performance@freebsd.org Message-Id: <20030827114316.300fd455.Alexander@Leidinger.net> In-Reply-To: <3F4C143D.7000909@potentialtech.com> References: <3F4C143D.7000909@potentialtech.com> X-Mailer: Sylpheed version 0.9.3claws (GTK+ 1.2.10; i386-portbld-freebsd5.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Seen: false X-ID: Gn3VbeZFwetCv-kc+sWe9dqEklA6TOWM2LcaO7-SajLcj3uBjxum8k@t-dialin.net cc: freebsd-fs@freebsd.org cc: Bill Moran Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 09:42:01 -0000 On Tue, 26 Aug 2003 22:15:25 -0400 Bill Moran wrote: > http://www.potentialtech.com/wmoran/postgresql.php You don't talk about integrity on this page. The ext2fs async mount may lose the FS in the power failure case, ufs+SU doesn't. You also present only the ufs sync and async numbers, but not the noasync (default) numbers, you should either present them or add a note why you don't present them. About the "without debugging" description: did you really only remove INVARIANTS? If yes: you also need to remove WITNESS. I don't know if 5.1-RELEASE has malloc debugging enabled, but to be on the safe side you should maybe do a "ln -s aj /etc/malloc.conf" before you start PostgreSQL. Bye, Alexander. -- I believe the technical term is "Oops!" http://www.Leidinger.net Alexander @ Leidinger.net GPG fingerprint = C518 BC70 E67F 143F BE91 3365 79E2 9C60 B006 3FE7 From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 03:27:26 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 250EC16A4BF; Wed, 27 Aug 2003 03:27:26 -0700 (PDT) Received: from stork.mail.pas.earthlink.net (stork.mail.pas.earthlink.net [207.217.120.188]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1D1CB44011; Wed, 27 Aug 2003 03:27:25 -0700 (PDT) (envelope-from tlambert2@mindspring.com) Received: from user-2ivfmq8.dialup.mindspring.com ([165.247.219.72] helo=mindspring.com) by stork.mail.pas.earthlink.net with asmtp (SSLv3:RC4-MD5:128) (Exim 3.33 #1) id 19rxWL-0002Zl-00; Wed, 27 Aug 2003 03:27:21 -0700 Message-ID: <3F4C8749.8DA398E0@mindspring.com> Date: Wed, 27 Aug 2003 03:26:17 -0700 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Maciej Freudenheim References: <200308250929.32143.paul@pathiakis.com> <20030826104038.GA63155@piggie> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-ELNK-Trace: b1a02af9316fbb217a47c185c03b154d40683398e744b8a432cd7acef4e97917fecad25b4d24dfae548b785378294e88350badd9bab72f9c350badd9bab72f9c cc: freebsd-database@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Tuning Postgresql on FreeBSD 5.1 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 10:27:26 -0000 Maciej Freudenheim wrote: > > issues (if for no other reason than UFS+softupdates). Linux has > > problems with memory over commit situations and file system integrity > > while still maintaining reasonable file system performance (ext2 is > > faster than ext3 by a wide margin, but ext2 is _not_ a reliable FS). > > Even heard of reiserfs or xfs? > I'm not going to start Linux advocacy here, but it's so funny for me > when somebody says 'leenoox sux, it has crappy filesystem' that i can't > leave it without reply :) He didn't say that. He said that it had problems with memory overcommit situations; most OS's do. FreeBSD has done a lot of work on graceful degradation (i.e. it doesn't crash when it runs out of memory and there's no more swap available). So it's you whose bringing that interpretation to the data. I haven't seen any reasonable benchmarks on ReiserFS or XFS vs. Ext2FS or Ext3FS that didn't involve sticking too many files in a single directory and actually measuring btree vs. linear directory entry layout instead of actual raw I/O performance. For most modern hardware, you never get CPU bound, so the real determining factor on raw I/O performance is almost always going to be raw disk I/O speed, and safe speed is going to be lower than the manufacturer benchmarks; some disks are "unsafe at any speed", to paraphrase Ralph Nader, because they cache when you tell them not to using the commands the manufacturer has stated actually work to tell them not to. Also, FYI, Postgress, unlike Postfix or qmail, doesn't dump a zillion files into the same directory so they can measure themselves against a situational benchmark; they are actually smart enough to port to the POSIX interface, and not depend on FS implementation-specific tricks to get their performance. If you wanted to join the XFS porting project, I'm sure they'd like the help. If you wanted to port ReiserFS, realize that software patents will probably prevent your work from being used in the U.S. or Japan, unless you could prove it to be non-infringing on the Novell D.O.W. patents. -- Terry From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 06:53:24 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 72AE116A4BF; Wed, 27 Aug 2003 06:53:24 -0700 (PDT) Received: from mta6.adelphia.net (mta6.adelphia.net [68.168.78.190]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7087B44005; Wed, 27 Aug 2003 06:53:23 -0700 (PDT) (envelope-from wmoran@potentialtech.com) Received: from potentialtech.com ([24.53.179.151]) by mta6.adelphia.net (InterMail vM.5.01.05.32 201-253-122-126-132-20030307) with ESMTP id <20030827135324.UAND18217.mta6.adelphia.net@potentialtech.com>; Wed, 27 Aug 2003 09:53:24 -0400 Message-ID: <3F4CB7D2.9000503@potentialtech.com> Date: Wed, 27 Aug 2003 09:53:22 -0400 From: Bill Moran User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.3) Gecko/20030429 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Alexander Leidinger References: <3F4C143D.7000909@potentialtech.com> <20030827114316.300fd455.Alexander@Leidinger.net> In-Reply-To: <20030827114316.300fd455.Alexander@Leidinger.net> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: freebsd-fs@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 13:53:24 -0000 Alexander Leidinger wrote: > On Tue, 26 Aug 2003 22:15:25 -0400 > Bill Moran wrote: > >>http://www.potentialtech.com/wmoran/postgresql.php > > You don't talk about integrity on this page. Yes I do. It's in the conclusion section. It's not a major part of that document because I didn't test integrity, therefore I have no real conclusions beyond the fact that ext2 is not designed with integrity in mind. > You also present > only the ufs sync and async numbers, but not the noasync (default) > numbers, you should either present them or add a note why you don't > present them. You're right. I'll correct this. > About the "without debugging" description: did you really only remove > INVARIANTS? If yes: you also need to remove WITNESS. WITNESS is not enabled in the GENERIC kernel for 5.1-RELEASE, so there was no need to disable it. > I don't know if 5.1-RELEASE has malloc debugging enabled, but to be on > the safe side you should maybe do a "ln -s aj /etc/malloc.conf" before > you start PostgreSQL. I may look into that, but it seems like the more important thing to do is test 4.8 at this point. If you look at the times, these tests are time-consuming. I probably should have reduced the number of records involved, but if I do that now, I have to rerun all the tests ... -- Bill Moran Potential Technologies http://www.potentialtech.com From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 07:28:53 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id F3E8216A4BF for ; Wed, 27 Aug 2003 07:28:52 -0700 (PDT) Received: from jagor.srce.hr (jagor.srce.hr [161.53.2.130]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9559543FFB for ; Wed, 27 Aug 2003 07:28:51 -0700 (PDT) (envelope-from ivoras@fer.hr) Received: from flatline (cmung3692.cmu.carnet.hr [193.198.142.136]) by jagor.srce.hr (8.12.9/8.12.5) with SMTP id h7RESEeu004245 for ; Wed, 27 Aug 2003 16:28:30 +0200 (MEST) Message-ID: <001e01c36ca7$852c5840$888ec6c1@flatline> From: "Ivan Voras" To: References: <20030827094210.2073116A4DD@hub.freebsd.org> Date: Wed, 27 Aug 2003 16:28:05 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2800.1106 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1106 X-Virus-Scanned: by amavisd-milter at jagor.srce.hr Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 14:28:53 -0000 > Date: Tue, 26 Aug 2003 22:15:25 -0400 > From: Bill Moran > Subject: Performance tests I did with FreeBSD, Linux and PostgreSQL > > Like all benchmarks, I doubt these are perfect (or even close) examples > of real-world use. > > However, in the hopes that they will be useful for improving FreeBSD, I > present them to the community. > > http://www.potentialtech.com/wmoran/postgresql.php > > Intelligent comments are welcome. Maybe I missed it, but you don't state if the postgresql fsync option was on or off for all the tests...? -- Logic is a systematic method of coming to the wrong conclusion with confidence. From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 08:51:22 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5FFA416A4BF for ; Wed, 27 Aug 2003 08:51:22 -0700 (PDT) Received: from smtp.mho.com (smtp.mho.net [64.58.4.6]) by mx1.FreeBSD.org (Postfix) with SMTP id 3591D43F93 for ; Wed, 27 Aug 2003 08:51:20 -0700 (PDT) (envelope-from scottl@freebsd.org) Received: (qmail 29108 invoked by uid 1002); 27 Aug 2003 15:51:19 -0000 Received: from unknown (HELO freebsd.org) (64.58.1.252) by smtp.mho.net with SMTP; 27 Aug 2003 15:51:19 -0000 Message-ID: <3F4CD36C.40604@freebsd.org> Date: Wed, 27 Aug 2003 09:51:08 -0600 From: Scott Long User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.3) Gecko/20030425 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Bill Moran References: <3F4C143D.7000909@potentialtech.com> <20030827114316.300fd455.Alexander@Leidinger.net> <3F4CB7D2.9000503@potentialtech.com> In-Reply-To: <3F4CB7D2.9000503@potentialtech.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Wed, 27 Aug 2003 09:25:16 -0700 cc: freebsd-fs@freebsd.org cc: Alexander Leidinger cc: freebsd-performance@freebsd.org Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 15:51:22 -0000 Bill Moran wrote: > Alexander Leidinger wrote: >> I don't know if 5.1-RELEASE has malloc debugging enabled, but to be on >> the safe side you should maybe do a "ln -s aj /etc/malloc.conf" before >> you start PostgreSQL. malloc debugging is disabled in 5.0-R and 5.1-R. Once we hit 5-STABLE it will be turned off for good in the branch. > > I may look into that, but it seems like the more important thing to do > is test 4.8 at this point. > > If you look at the times, these tests are time-consuming. I probably > should have reduced the number of records involved, but if I do that > now, I have to rerun all the tests ... > It would be interesting to see if the recent locking of the ATA driver has any benefit on these tests. Of course if you update to 5-CURRENT then you'll need to disable INVARIANTS, WITNESS, and malloc debugging. Scott From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 09:50:30 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3CD5A16A4BF; Wed, 27 Aug 2003 09:50:30 -0700 (PDT) Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5A85E43FE3; Wed, 27 Aug 2003 09:50:29 -0700 (PDT) (envelope-from robert@fledge.watson.org) Received: from fledge.watson.org (localhost [127.0.0.1]) by fledge.watson.org (8.12.9/8.12.9) with ESMTP id h7RGo5rO026285; Wed, 27 Aug 2003 12:50:05 -0400 (EDT) (envelope-from robert@fledge.watson.org) Received: from localhost (robert@localhost)h7RGo5CT026282; Wed, 27 Aug 2003 12:50:05 -0400 (EDT) Date: Wed, 27 Aug 2003 12:50:05 -0400 (EDT) From: Robert Watson X-Sender: robert@fledge.watson.org To: Bill Moran In-Reply-To: <3F4C143D.7000909@potentialtech.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Mailman-Approved-At: Wed, 27 Aug 2003 09:51:55 -0700 cc: freebsd-fs@freebsd.org cc: freebsd-performance@freebsd.org Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 16:50:30 -0000 On Tue, 26 Aug 2003, Bill Moran wrote: > Like all benchmarks, I doubt these are perfect (or even close) examples > of real-world use. > > However, in the hopes that they will be useful for improving FreeBSD, I > present them to the community. > > http://www.potentialtech.com/wmoran/postgresql.php > > Intelligent comments are welcome. I'd have to chime in here with two recommendations: (1) Try 4.8-STABLE (2) Try 5.1-CURRENT With a distinct preference for (1) before (2). Some parts of -CURRENT have gotten faster, others have gotten temporarily slower (new locks in place without Giant coming off them yet, which adds overhead). I'd also check your block sizes for interaction with Postgres and see if different block and fragment sizes help/hurt. It could be that postgres would benefit from different tuning parameters on FreeBSD, especially with newer UFS file systems. Robert N M Watson FreeBSD Core Team, TrustedBSD Projects robert@fledge.watson.org Network Associates Laboratories From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 10:05:52 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BEF5016A4C0 for ; Wed, 27 Aug 2003 10:05:52 -0700 (PDT) Received: from web14908.mail.yahoo.com (web14908.mail.yahoo.com [216.136.225.60]) by mx1.FreeBSD.org (Postfix) with SMTP id DCAE543F85 for ; Wed, 27 Aug 2003 10:05:51 -0700 (PDT) (envelope-from nirv199@yahoo.com) Message-ID: <20030827170551.36265.qmail@web14908.mail.yahoo.com> Received: from [200.96.0.204] by web14908.mail.yahoo.com via HTTP; Wed, 27 Aug 2003 10:05:51 PDT Date: Wed, 27 Aug 2003 10:05:51 -0700 (PDT) From: Paulo Roberto To: Bill Moran , freebsd-performance@freebsd.org In-Reply-To: <3F4C143D.7000909@potentialtech.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 17:05:52 -0000 --- Bill Moran wrote: > Like all benchmarks, I doubt these are perfect (or even close) > examples > of real-world use. Bill, Quoting your conclusion: "I was extremely disappointed in FreeBSD's poor showing." I think you should compare tomatoes to tomatoes. You are comparing Linux 2.4.20-8 which is a pretty stable release to FreeBSD 5.1, which by no means has the same maturity (I am pretty sure a flame war might be started by this point of view, but that's just my opinion). I think a good approach would be comparing Linux 2.4.20-8 to FreeBSD 4.8 or as a second option: FReeBSD 5.1 "against" Linux 2.6.0. Just my 2 cents... best regards, Paulo Roberto __________________________________ Do you Yahoo!? Yahoo! SiteBuilder - Free, easy-to-use web site design software http://sitebuilder.yahoo.com From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 10:29:20 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2F8FF16A4BF; Wed, 27 Aug 2003 10:29:20 -0700 (PDT) Received: from fledge.watson.org (fledge.watson.org [204.156.12.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0F11B43FDD; Wed, 27 Aug 2003 10:29:19 -0700 (PDT) (envelope-from robert@fledge.watson.org) Received: from fledge.watson.org (localhost [127.0.0.1]) by fledge.watson.org (8.12.9/8.12.9) with ESMTP id h7RHStrO026607; Wed, 27 Aug 2003 13:28:55 -0400 (EDT) (envelope-from robert@fledge.watson.org) Received: from localhost (robert@localhost)h7RHStTV026604; Wed, 27 Aug 2003 13:28:55 -0400 (EDT) Date: Wed, 27 Aug 2003 13:28:55 -0400 (EDT) From: Robert Watson X-Sender: robert@fledge.watson.org To: David Schultz In-Reply-To: <20030827060644.GA9321@HAL9000.homeunix.com> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-fs@FreeBSD.ORG cc: freebsd-performance@FreeBSD.ORG cc: Bill Moran Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 17:29:20 -0000 On Tue, 26 Aug 2003, David Schultz wrote: > On Tue, Aug 26, 2003, Bill Moran wrote: > > Like all benchmarks, I doubt these are perfect (or even close) examples > > of real-world use. > > > > However, in the hopes that they will be useful for improving FreeBSD, I > > present them to the community. > > > > http://www.potentialtech.com/wmoran/postgresql.php > > > > Intelligent comments are welcome. > > Well, a little trussing revealed that pgsql uses a block size of 8K, > which can be a significant pessimization when the filesystem block size > is 16K, which is the default in FreeBSD! ext2fs uses 4K blocks and > reiserfs uses extents, so those filesystems would not suffer from that > problem. You might consider trying your test on a UFS filesystem with > 8K blocks, or you could tune pgsql to use a different block size. (For > pgsql, I think the appropriate tunable is BLCKSZ in include/pg_config.h. > You'll have to recompile it and create a new database.) I wonder if it would benefit us to do some tweaks to Postgres to tune the pgsql block size to the file system it's running on, and get it integrated back into the distribution.... As disks get bigger, a 16k block size is going to become more common, so this won't just hit FreeBSD, I expect. Robert N M Watson FreeBSD Core Team, TrustedBSD Projects robert@fledge.watson.org Network Associates Laboratories From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 10:44:52 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C433716A4BF; Wed, 27 Aug 2003 10:44:52 -0700 (PDT) Received: from perrin.nxad.com (internal.ext.nxad.com [69.1.70.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id 337A643FCB; Wed, 27 Aug 2003 10:44:49 -0700 (PDT) (envelope-from sean@nxad.com) Received: by perrin.nxad.com (Postfix, from userid 1001) id B27BC21058; Wed, 27 Aug 2003 10:44:48 -0700 (PDT) Date: Wed, 27 Aug 2003 10:44:48 -0700 From: Sean Chittenden To: Robert Watson Message-ID: <20030827174448.GB72378@perrin.nxad.com> References: <20030827060644.GA9321@HAL9000.homeunix.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="envbJBWh7q8WU6mo" Content-Disposition: inline In-Reply-To: X-PGP-Key: finger seanc@FreeBSD.org X-PGP-Fingerprint: 3849 3760 1AFE 7B17 11A0 83A6 DD99 E31F BC84 B341 X-Web-Homepage: http://sean.chittenden.org/ User-Agent: Mutt/1.5.4i cc: freebsd-database@freebsd.org cc: David Schultz cc: freebsd-performance@FreeBSD.ORG cc: Bill Moran Subject: Re: Performance tests I did with FreeBSD, Linux and PostgreSQL X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Aug 2003 17:44:52 -0000 --envbJBWh7q8WU6mo Content-Type: text/plain; charset=us-ascii Content-Disposition: inline > > > Like all benchmarks, I doubt these are perfect (or even close) > > > examples of real-world use. > > > > > > However, in the hopes that they will be useful for improving FreeBSD, I > > > present them to the community. > > > > > > http://www.potentialtech.com/wmoran/postgresql.php > > > > > > Intelligent comments are welcome. > > > > Well, a little trussing revealed that pgsql uses a block size of > > 8K, which can be a significant pessimization when the filesystem > > block size is 16K, which is the default in FreeBSD! ext2fs uses > > 4K blocks and reiserfs uses extents, so those filesystems would > > not suffer from that problem. You might consider trying your test > > on a UFS filesystem with 8K blocks, or you could tune pgsql to use > > a different block size. (For pgsql, I think the appropriate > > tunable is BLCKSZ in include/pg_config.h. You'll have to > > recompile it and create a new database.) > > I wonder if it would benefit us to do some tweaks to Postgres to > tune the pgsql block size to the file system it's running on, and > get it integrated back into the distribution.... As disks get > bigger, a 16k block size is going to become more common, so this > won't just hit FreeBSD, I expect. Hrm, that sounds like a good idea to me. The appropriate patch is included (src/include/pg_config_manual.h). I'll bounce this by the PostgreSQL guys to see what their reaction is, but I'm inclined to include this patch in the postgresql-devel port for now, and if things go well there, possibly in the main postgresql7 port (pending feedback). I haven't ever played with this setting before and would welcome feedback from anyone who has (rergardless of their results). -sc PS You have to re-initdb/reload your data after applying this patch because the size of data on disk has changed. -- Sean Chittenden --envbJBWh7q8WU6mo Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename=patch Index: src/include/pg_config_manual.h =================================================================== RCS file: /home/ncvs/pgsql/pgsql-server/src/include/pg_config_manual.h,v retrieving revision 1.5 diff -u -r1.5 pg_config_manual.h --- src/include/pg_config_manual.h 4 Aug 2003 00:43:29 -0000 1.5 +++ src/include/pg_config_manual.h 27 Aug 2003 17:40:12 -0000 @@ -23,7 +23,7 @@ * * Changing BLCKSZ requires an initdb. */ -#define BLCKSZ 8192 +#define BLCKSZ 16384 /* * RELSEG_SIZE is the maximum number of blocks allowed in one disk --envbJBWh7q8WU6mo-- From owner-freebsd-performance@FreeBSD.ORG Wed Aug 27 18:22:33 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C64F716A4BF; Wed, 27 Aug 2003 18:22:33 -0700 (PDT) Received: from mta6.adelphia.net (mta6.adelphia.net [68.168.78.190]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2D27F43F75; Wed, 27 Aug 2003 18:22:32 -0700 (PDT) (envelope-from wmoran@potentialtech.com) Received: from potentialtech.com ([24.53.179.151]) by mta6.adelphia.net (InterMail vM.5.01.05.32 201-253-122-126-132-20030307) with ESMTP id <20030828012232.SPEO18217.mta6.adelphia.net@potentialtech.com>; Wed, 27 Aug 2003 21:22:32 -0400 Message-ID: <3F4D5957.8000204@potentialtech.com> Date: Wed, 27 Aug 2003 21:22:31 -0400 From: Bill Moran User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.3) Gecko/20030429 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-performance@freebsd.org, freebsd-database@freebsd.org, freebsd-fs@freebsd.org Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Subject: Some additional tests run on my performance testing X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Aug 2003 01:22:34 -0000 First off, I want to thank everyone who responded with suggestions and comments. I was worried that I might get a lot of flames about these test, and that's not what happened. The most common suggestion I received was "use FreeBSD 4.8", so I managed to make some time between the electrical storms today, and my regular work to do just that. Unfortunately (as you'll see) the results were _worse_ than with FreeBSD 5.1. I'm interested in two major things right now: 1 - can anyone suggest anything I might be doing wrong to get such lousy results? 2 - Can someone please try the tests on SCSI hardware? I don't have any SCSI systems available to test on, and I'd like to figure out if it's the filesystem or the ATA driver that's the problem. Hell, can someone try out the tests on some other brand of ATA/HDD, to make sure FreeBSD doesn't just have some grief with this particular piece of hardware? The updated test results are the same place the previous tests were: http://www.potentialtech.com/wmoran/postgresql.php I'm attaching dmesg from the test machine to this email, if anyone knows of any problems with this hardware and FreeBSD, please let me know so I can stop banging my head against this and just accept that it's a hardware problem ;) I was assuming that the "falling back to PIO mode" was because this board didn't support DMA, but I'm beginning to wonder ... -- Bill Moran Potential Technologies http://www.potentialtech.com Copyright (c) 1992-2003 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.8-RELEASE #0: Thu Apr 3 10:53:38 GMT 2003 root@freebsd-stable.sentex.ca:/usr/obj/usr/src/sys/GENERIC Timecounter "i8254" frequency 1193182 Hz CPU: AMD-K6(tm) 3D processor (450.13-MHz 586-class CPU) Origin = "AuthenticAMD" Id = 0x58c Stepping = 12 Features=0x8021bf AMD Features=0x80000800 real memory = 58720256 (57344K bytes) avail memory = 51949568 (50732K bytes) Preloaded elf kernel "kernel" at 0xc051d000. K6-family MTRR support enabled (2 registers) md0: Malloc disk Using $PIR table, 7 entries at 0xc00fa040 npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard pci0: on pcib0 agp0: mem 0x50000000-0x5fffffff at device 0.0 on pci0 atapci0: port 0x2040-0x204f,0-0x3,0-0x7,0-0x3,0-0x7 irq 0 at device 0.1 on pci0 ata0: at 0x1f0 irq 14 on atapci0 ata1: at 0x170 irq 15 on atapci0 isab0: at device 1.0 on pci0 isa0: on isab0 pci0: (vendor=0x1039, dev=0x0009) at 1.1 ohci0: irq 11 at device 1.2 on pci0 ohci0: Could not map memory device_probe_and_attach: ohci0 attach returned 6 pcib2: at device 2.0 on pci0 pci1: on pcib2 pci1: at 0.0 rl0: port 0x2400-0x24ff mem 0x41000000-0x410000ff irq 10 at device 5.0 on pci0 rl0: Ethernet address: 00:c0:ca:14:03:eb miibus0: on rl0 rlphy0: on miibus0 rlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto pci0: (vendor=0x125d, dev=0x1969) at 10.0 irq 5 pcib1: on motherboard pci2: on pcib1 orm0: