From owner-freebsd-questions@FreeBSD.ORG Tue Apr 10 19:07:47 2007 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1055216A403 for ; Tue, 10 Apr 2007 19:07:47 +0000 (UTC) (envelope-from tkocher@mtadistributors.com) Received: from mail40.messagelabs.com (mail40.messagelabs.com [216.82.245.83]) by mx1.freebsd.org (Postfix) with SMTP id ADF8C13C469 for ; Tue, 10 Apr 2007 19:07:46 +0000 (UTC) (envelope-from tkocher@mtadistributors.com) X-VirusChecked: Checked X-Env-Sender: tkocher@mtadistributors.com X-Msg-Ref: server-6.tower-40.messagelabs.com!1176232065!41367582!1 X-StarScan-Version: 5.5.10.7.1; banners=mtadistributors.com,-,- X-Originating-IP: [63.243.109.114] Received: (qmail 17909 invoked from network); 10 Apr 2007 19:07:45 -0000 Received: from uslec-63-243-109-114.cust.uslec.net (HELO mail.mtadistributors.com) (63.243.109.114) by server-6.tower-40.messagelabs.com with SMTP; 10 Apr 2007 19:07:45 -0000 Received: from [10.0.0.11] (squidward.mtadistributors.com [10.0.0.11]) by mail.mtadistributors.com (Mail Daemon) with ESMTP id 165FA13C551; Tue, 10 Apr 2007 14:06:48 -0500 (CDT) Mime-Version: 1.0 (Apple Message framework v752.2) References: <65FF46C4-38DC-43B6-864B-EEBBEEE56602@mtadistributors.com> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: Content-Transfer-Encoding: 7bit From: Troy Kocher Date: Tue, 10 Apr 2007 14:07:55 -0500 To: freebsd-questions@freebsd.org X-Pgp-Agent: GPGMail 1.1.2 (Tiger) X-Gpgmail-State: signed X-Mailer: Apple Mail (2.752.2) Cc: dmehler26@woh.rr.com Subject: Fwd: Jail is pausing . . Ideas please. . ? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Apr 2007 19:07:47 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Listers, I appears I found the solution. . http://www.freebsd.org/doc/en_US.ISO8859-1/books/arch-handbook/jail- restrictions.html excerpt. . Semaphore system calls allow processes to synchronize execution by doing a set of operations atomically on a set of semaphores. Basically semaphores provide another way for processes lock resources. However, process waiting on a semaphore, that is being used, will sleep until the resources are relinquished. I had two scripts that run on this jail, they both connect to the database jail (pgsql) that is running on the same host. . Stopped those scripts and in the last 18 hrs the pausing has been eliminated. Thanks to those who had comments. . Troy > > Listers, > > Currently I am having some strange issues with regard to a jail > pausing, hoping someone here might have some ideas. . > Here is my Usenet post. . : > > I am running FreeBSD 6.1-STABLE (SMP), and the the system seems to be > pausing. System details: > > I have da0, da1, da2, da3, each 500GB, I'm also using GEOM_CONCAT to > concatenation, amd64 SMP kernel, and 16GB of ram. Running 7 jails, > primarily running apache, samba, postfix, pgsql. > > On what appears to be random occasions (usually several times in 5m) > the system seems to pause. For instance, vipw takes >40s to respond, > or the smbd which clients use for their mailbox.pst ignores requests > from outlook to act on the file. Then moments later it is happy > again, and begins working normally. I have been monitoring top while > it happens and it appears like it is doing very little. . ie. . > > last pid: 75014; load averages: 0.00, 0.02, > 0.07 up 203+07:20:57 15:24:53 > 246 processes: 1 running, 244 sleeping, 1 stopped > CPU states: 0.0% user, 0.0% nice, 0.2% system, 0.1% interrupt, > 99.7% idle > Mem: 967M Active, 13G Inact, 320M Wired, 782M Cache, 214M Buf, 569M > Free > Swap: 4096M Total, 2504K Used, 4093M Free > > Tried running nice -20 vipw and it still took some time for it to > run. Could it be a file locking issue?. . > > Any thoughts or ideas on further troubleshooting would really be > appreciated > > ---------- > Since that post it actually appears to only be happening in one jail > called drzoe. The host system seems to be working properly during > these slow downs > > Other things I've considered: > 1) Is there an upper limit to the number of connections a NIC can > support? Am I exceeding it? NiC & Switches aren't showing any packet > loss. > 2) Am I running out of IO, to and from the disks? Tried looking at > iostat, but I'm exactly sure what a problem would look like. Seems > like this wouldn't be jail specific > > Give it seems to be limited to this jail it seems unlikely to be > hardware. . > > from rc.conf > > jail_enable="YES" > jail_list="droutward drinward database drzoe development drimage > drmail" > # Disaster recovery setup for drzoe > jail_drzoe_rootdir="/usr/home/drzoe-jail" > jail_drzoe_hostname="drzoe.mtadistributors.com" > jail_drzoe_ip="10.0.0.115" > jail_drzoe_exec_start="/bin/sh /etc/rc" > jail_drzoe_exec_stop="/bin/sh /etc/rc.shutdown" > jail_drzoe_devfs_enable="YES" > > [root@drzoe /]#pkg_info > autoconf-2.59_2 Automatically configure source code on many Un*x > platforms > bash-3.1.10_1 The GNU Project's Bourne Again SHell > bsdpan-Filesys-Virtual-0.05 Filesys::Virtual - Perl extension to > provide a framework fo > bsdpan-Filesys-Virtual-Plain-0.08 Filesys::Virtual::Plain - A Plain > virtual filesystem > bsdpan-Net-DAV-Server-1.28 Net::DAV::Server - Provide a DAV Server > cups-base-1.1.23.0_8 The Common UNIX Printing System: headers, libs, > & daemons > cvsup-without-gui-16.1h_2 General network file distribution system > optimized for CVS > elinks-0.11.1 Elinks - links text WWW browser with enhancements > gettext-0.14.5_1 GNU gettext package > gmake-3.81_1 GNU version of 'make' utility > gnutls-1.2.9 GNU Transport Layer Security library > help2man-1.36.4_1 Automatically generating simple manual pages from > program o > identify-0.7 Client side ident protocol daemon wrapper > jbigkit-1.6 Lossless compression for bi-level images such as > scanned pa > jpeg-6b_3 IJG's jpeg compression utilities > libgcrypt-1.2.2 "General purpose crypto library based on code > used in GnuPG > libgpg-error-1.1 Common error values for all GnuPG components > libiconv-1.9.2_1 A character set conversion library > m4-1.4.8_1 GNU m4 > netpbm-10.26.41 A toolkit for conversion of images between > different format > p5-Authen-PAM-0.14 A Perl interface to the PAM library > p5-Net-SSLeay-1.30_1 Perl5 interface to SSL > p5-gettext-1.05_1 Message handling functions > pcre-6.6_1 Perl Compatible Regular Expressions library > perl-5.8.7_2 Practical Extraction and Report Language > pkgconfig-0.20 A utility to retrieve information about installed > libraries > png-1.2.8_3 Library for manipulating PNG images > popt-1.7 A getopt(3) like library with a number of > enhancements, fro > portaudit-0.5.10 Checks installed ports against a list of security > vulnerabi > postgresql-client-8.1.4 PostgreSQL database (client) > proftpd-1.3.1.r2_3 Highly configurable ftp daemon > rsync-2.6.7_1 A network file distribution/synchronization > utility > samba-2.2.12_2 A free SMB and CIFS client and server for UNIX > tiff-3.8.0 Tools and library routines for working with TIFF > images > unison-2.13.16_1 A user-level file synchronization tool > usermin-1.220_1 Web-based interface for performing some user tasks > vim-lite-7.0.66 Vi "workalike", with many additional features > (Lite package > webmin-1.290 Web-based interface for system administration for > Unix > > [root@drzoe /]# portaudit > Affected package: gnutls-1.2.9 > Type of problem: gnutls -- RSA Signature Forgery Vulnerability. > Reference: 64bf6234-520d-11db-8f1a-000a48049292.html> > > Affected package: samba-2.2.12_2 > Type of problem: samba -- integer overflow vulnerability. > Reference: a9e7-0001020eed82.html> > > 2 problem(s) in your installed packages found. > > Any ideas you may have on troubleshooting or better yet what is > causing it would be > really appreciated. > > Troy Kocher > MTA Distributors > tkocher(at)mtadistributors(dot)com > > -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (Darwin) iD8DBQFGG+CM7N3ahyl93usRAsxpAJ9Pdl1rnDb0GuPmQAnh9s0R8Ou0bQCdFjhz rw+RpZlZ9Dyc6FBwazy0/3A= =bT8W -----END PGP SIGNATURE----- _________________________________________________ Scanned by IBM Email Security Management Services powered by MessageLabs. _________________________________________________