From owner-freebsd-questions@FreeBSD.ORG Thu Nov 1 20:55:11 2007 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7117616A417 for ; Thu, 1 Nov 2007 20:55:11 +0000 (UTC) (envelope-from Peter.Uthoff@reuters.com) Received: from outbound2-dub-R.bigfish.com (outbound-dub.frontbridge.com [213.199.154.16]) by mx1.freebsd.org (Postfix) with ESMTP id 5704813C4B2 for ; Thu, 1 Nov 2007 20:55:08 +0000 (UTC) (envelope-from Peter.Uthoff@reuters.com) Received: from outbound2-dub.bigfish.com (localhost.localdomain [127.0.0.1]) by outbound2-dub-R.bigfish.com (Postfix) with ESMTP id 060F064ABF5 for ; Thu, 1 Nov 2007 19:35:20 +0000 (UTC) Received: from mail61-dub-R.bigfish.com (unknown [10.5.252.3]) by outbound2-dub.bigfish.com (Postfix) with ESMTP id EE4221930014 for ; Thu, 1 Nov 2007 19:35:19 +0000 (UTC) Received: from mail61-dub (localhost.localdomain [127.0.0.1]) by mail61-dub-R.bigfish.com (Postfix) with ESMTP id 99F9DCE81DD for ; Thu, 1 Nov 2007 19:35:19 +0000 (UTC) X-BigFish: VP X-MS-Exchange-Organization-Antispam-Report: OrigIP: 167.206.189.56; Service: EHS Received: by mail61-dub (MessageSwitch) id 1193945719378326_6409; Thu, 1 Nov 2007 19:35:19 +0000 (UCT) Received: from hpgsmime04.rit.reuters.com (hpgsmime04.rit.reuters.com [167.206.189.56]) by mail61-dub.bigfish.com (Postfix) with ESMTP id E2979133006F for ; Thu, 1 Nov 2007 19:35:18 +0000 (UTC) Received: from uspig2 (unverified [10.88.1.88]) by hpgsmime04.rit.reuters.com (Content Technologies SMTPRS 4.3.19) with ESMTP id for ; Thu, 1 Nov 2007 19:35:18 +0000 Received: from nycsmsxb01.amers.ime.reuters.com ([10.65.97.50]) by uspig2.hpg.ime.reuters.com (PMDF V6.2-1x9 #31185) with ESMTP id <0JQU00FFKEEU9V@uspig2.hpg.ime.reuters.com> for freebsd-questions@freebsd.org; Thu, 01 Nov 2007 19:35:18 +0000 (GMT) Received: from STLSMSXM02.amers.ime.reuters.com ([10.91.10.139]) by nycsmsxb01.amers.ime.reuters.com with Microsoft SMTPSVC (6.0.3790.1830); Thu, 01 Nov 2007 15:35:17 -0400 Date: Thu, 01 Nov 2007 14:35:17 -0500 From: Peter Uthoff To: freebsd-questions@freebsd.org Message-id: <05616E1516E61D4C9B338EA2C7DFD26636758F@STLSMSXM02.amers.ime.reuters.com> MIME-version: 1.0 X-MIMEOLE: Produced By Microsoft Exchange V6.5 Content-type: text/plain; charset="us-ascii" Content-transfer-encoding: quoted-printable Thread-Topic: Problem with Apache22 Thread-Index: AcgcvhmhezkQq2XOTj2nznzAlO3u7g== Content-class: urn:content-classes:message X-MS-Has-Attach: X-MS-TNEF-Correlator: X-OriginalArrivalTime: 01 Nov 2007 19:35:17.0912 (UTC) FILETIME=[55377180:01C81CBE] Subject: Problem with Apache22 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Nov 2007 20:55:11 -0000 Hello, I have a problem where my Apache procs are dying almost exactly every ten minutes as you can from the messages and web logs below: Oct 25 10:34:44 kernel: pid 66337 (httpd), uid 80: exited on signal 4 Oct 25 10:35:33 kernel: pid 66357 (httpd), uid 80: exited on signal 4 Oct 25 10:45:11 kernel: pid 66395 (httpd), uid 80: exited on signal 4 Oct 25 10:55:21 kernel: pid 66340 (httpd), uid 80: exited on signal 4 Looking at the Apache logs, I find the following: [Thu Oct 25 10:25:01 2007] [notice] child pid 66379 exit signal Illegal instruction (4) [Thu Oct 25 10:34:44 2007] [notice] child pid 66337 exit signal Illegal instruction (4) [Thu Oct 25 10:35:33 2007] [notice] child pid 66357 exit signal Illegal instruction (4) [Thu Oct 25 10:45:11 2007] [notice] child pid 66395 exit signal Illegal instruction (4) I tried upping the logs all the way to debug today and it really wasn't very helpful: [Wed Oct 31 15:59:19 2007] [debug] prefork.c(991): AcceptMutex: flock (default: flock) [Wed Oct 31 16:05:39 2007] [notice] child pid 73668 exit signal Illegal instruction (4) [Wed Oct 31 16:12:01 2007] [info] server seems busy, (you may need to increase StartServers, or Min/MaxSpareServers), spawning 8 children, there are 4 idle, and 17 total children [Wed Oct 31 16:15:04 2007] [notice] child pid 73779 exit signal Illegal instruction (4) [Wed Oct 31 16:15:28 2007] [notice] child pid 73717 exit signal Illegal instruction (4) [Wed Oct 31 16:18:37 2007] [notice] child pid 95939 exit signal Illegal instruction (4) I don't believe the 'busy' message is accurate. I think it's a result of the procs dying constantly as I just don't get that much traffic. I also have no idea what is causing the illegal instructions because none of the logs point out any specific detail to help me track it down. I'm running the following: FreeBSD 6.2-RELEASE-p8 FreeBSD 6.2-RELEASE-p8 #3: Thu Oct 25 20:04:14 CDT 2007 :/usr/obj/usr/src/sys/GENERIC i386 apache-2.2.6_2 Version 2.2 of Apache web server with prefork MPM. php5-5.2.4_1 PHP Scripting Language mysql-client-5.0.45_1 Multithreaded SQL database (client) mysql-server-5.0.45_1 Multithreaded SQL database (server) p5-DBD-mysql50-4.005 MySQL 5.0 driver for the Perl5 Database Interface (DBI) php5-mysql-5.2.4_1 The mysql shared extension for php php5-mysqli-5.2.4_1 The mysqli shared extension for php I'm using vhosts to host 4 different websites with different domains. The sad part is that these all show no errors in their logs even with them turned up to debug level. I've been looking at this off and on trying to solve it as time allowed since mid-September. I'm completely stumped and would appreciate any helpful suggestions where else I can look. Thank you! This email was sent to you by Reuters, the global news and information comp= any. = To find out more about Reuters visit www.about.reuters.com Any views expressed in this message are those of the individual sender, = except where the sender specifically states them to be the views of Reuters= Limited. Reuters Limited is part of the Reuters Group of companies, of which Reuters= Group PLC is the ultimate parent company. Reuters Group PLC - Registered office address: The Reuters Building, South = Colonnade, Canary Wharf, London E14 5EP, United Kingdom Registered No: 3296375 Registered in England and Wales