From owner-freebsd-questions@FreeBSD.ORG Fri Feb 25 19:15:43 2011 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9C5011065672 for ; Fri, 25 Feb 2011 19:15:43 +0000 (UTC) (envelope-from glarkin@FreeBSD.org) Received: from mail1.sourcehosting.net (113901-app1.sourcehosting.net [72.32.213.11]) by mx1.freebsd.org (Postfix) with ESMTP id 7346D8FC1C for ; Fri, 25 Feb 2011 19:15:43 +0000 (UTC) Received: from 68-189-245-235.dhcp.oxfr.ma.charter.com ([68.189.245.235] helo=cube.entropy.prv) by mail1.sourcehosting.net with esmtp (Exim 4.73 (FreeBSD)) (envelope-from ) id 1Pt38U-000Kru-PW; Fri, 25 Feb 2011 14:15:41 -0500 Received: from v105.entropy.prv (v105.entropy.prv [192.168.1.105]) by cube.entropy.prv (Postfix) with ESMTP id D66954B20925; Fri, 25 Feb 2011 14:15:29 -0500 (EST) Message-ID: <4D67FFD1.6090905@FreeBSD.org> Date: Fri, 25 Feb 2011 14:15:29 -0500 From: Greg Larkin Organization: The FreeBSD Project User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.13) Gecko/20101207 Lightning/1.0b2 Thunderbird/3.1.7 MIME-Version: 1.0 To: Mark Felder References: In-Reply-To: X-Enigmail-Version: 1.1.1 OpenPGP: id=1C940290 X-SA-Exim-Connect-IP: 68.189.245.235 X-SA-Exim-Mail-From: glarkin@FreeBSD.org X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on mail1.sourcehosting.net X-Spam-Level: X-Spam-Status: No, score=0.6 required=5.0 tests=AWL, BAYES_00, RCVD_IN_RP_RNBL, RCVD_IN_SORBS_DUL,RDNS_DYNAMIC,TVD_RCVD_IP autolearn=no version=3.3.1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-SA-Exim-Version: 4.2 X-SA-Exim-Scanned: Yes (on mail1.sourcehosting.net) Cc: freebsd-questions@freebsd.org Subject: Re: Help: Looking to contact someone running FreeBSD on ESX X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: glarkin@FreeBSD.org List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Feb 2011 19:15:43 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 2/25/11 12:52 PM, Mark Felder wrote: > Hi all, > > We have quite a few BSD VMs on our infrastructure and are having some > issues with our main webservers. They die randomly -- ESX shows > high/100% CPU the exact moment it dies (very, very low up until that > point), the console takes keyboard input but doesn't really do anything > or switch VTs, and the server is pingable, but does nothing. We have to > hard reboot. This has been going on for a while and we moved the VMs off > our iSCSI SAN and onto local storge and it's happening still. (Found a > few configuration issues with our SAN; thought it was the issue with > preferred paths being problematic, etc). We really need to contact > someone else who has had success and find out what's different about > their environment. > > I'd like to note that we're still on ESX 4.0 (and behind a bit there) > because our SAN wouldn't support 4.1 until recently and we haven't had > time to switch. > > Personally, I'm convinced this is an ESX issue because BSD never panics > and there's never anything reported on the console when this happens. > I'd really like to hear from someone who has been running FreeBSD in > production on ESX without issues and hopefully they could describe their > setup so we can begin to compare issues. > > A few relavent things to note: > > The ones that crash are usually our main webservers (Apache, PHP, no > MySQL locally though). We have LOTS of IPs on them and they do a ton of > network traffic, but usually don't have a super high load average (maybe > .75 - 1.0 on a normal day?). Currently we're running 8.1-RELEASE on them. > > As I said, they're on local storage right now, but they were on iSCSI to > Dell MD3000i SANs (booo, hisss, we're dumping them so dont worry) > > ESX servers are a mix of Dell and HP.... > > Can't think of many more details. > > Thanks everyone. > > Mark Hi Mark, Are there any relevant messages logged in /var/log/messages prior to the FreeBSD hard reboot? I haven't used watchdogd(8) (http://bit.ly/eKHUEN) before, but I wonder if it would help you by firing some data logging command (-e option) so you have some information to go on. Regards, Greg - -- Greg Larkin http://www.FreeBSD.org/ - The Power To Serve http://www.sourcehosting.net/ - Ready. Set. Code. http://twitter.com/sourcehosting/ - Follow me, follow you -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk1n/9EACgkQ0sRouByUApBdoQCgtq2MMP+xidLoFc5JEkEaRyN5 H8wAoIGrgMd5dx2QvambZeR0l1SEptkK =EoiA -----END PGP SIGNATURE-----