From owner-freebsd-stable@FreeBSD.ORG Tue Mar 27 15:48:31 2012 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 862811065674 for ; Tue, 27 Mar 2012 15:48:31 +0000 (UTC) (envelope-from c.kworr@gmail.com) Received: from mail-bk0-f54.google.com (mail-bk0-f54.google.com [209.85.214.54]) by mx1.freebsd.org (Postfix) with ESMTP id 112B78FC12 for ; Tue, 27 Mar 2012 15:48:30 +0000 (UTC) Received: by bkcjc3 with SMTP id jc3so48954bkc.13 for ; Tue, 27 Mar 2012 08:48:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=4wYqLd/+lQNUJnN6AwZdnpvpq2GLRLsyGLd+h/d3sic=; b=0FWyWc3LyTUgxnQ6tdJ6LbaqTCN7grJenKBFNbujeJ9Bd7pgpHB5ceuYztQHa6L6Hz CGSYI1ezmRehqKyRcriNKr4bqbqzemt4V9HcmJqtH39gvn42auig1gMBAo470eCTVBrV sxcxp4x5F/tt7Q5I0pUh9GXEXzZL+C5pVy8aVDKAhhPNem9KTlZfaPVdiym7K8rngPqf jnm4ZSD0Y+SJ0sWSKSHFz2+4Wx/zV/L+e2xpkiYx9N7a+OlT12KA7/3zTHzDxxWb2IKQ bYWgMWjx7L2HM1NlMnC1SfEafcs3Clr6VFrEJDeT/FGzVp8ggTNl8SezSFSkqDT140b+ 8DXQ== Received: by 10.204.149.204 with SMTP id u12mr5115075bkv.45.1332863309675; Tue, 27 Mar 2012 08:48:29 -0700 (PDT) Received: from green.tandem.local (16-184-132-95.pool.ukrtel.net. [95.132.184.16]) by mx.google.com with ESMTPS id p19sm450864bka.1.2012.03.27.08.48.27 (version=SSLv3 cipher=OTHER); Tue, 27 Mar 2012 08:48:28 -0700 (PDT) Message-ID: <4F71E14A.8010605@gmail.com> Date: Tue, 27 Mar 2012 18:48:26 +0300 From: Volodymyr Kostyrko User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:11.0) Gecko/20120315 Firefox/11.0 SeaMonkey/2.8 MIME-Version: 1.0 To: stable@freebsd.org Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: trap 12 on 9.0 when memcache gets some load X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2012 15:48:31 -0000 Hi all. I'm just puzzled with this. At first I though this happens because of some memory problems. But now project was moved to another server with some other brands for motherboard/memory and different cpu's. And still once in an hour this happens again: == screenshot current_process = 1935 (memcached) trap number = 12 panic: page fault cpuid = 2 KDB: stack backtrace: #0 0xffffffff8038ab38 at kdb_backtrace+0x58 #1 0xffffffff80358f80 at panic+0x190 #2 0xffffffff80567b15 at trap_fatal+0x395 #3 0xffffffff80567ce9 at trap_pfault+0x1c9 #4 0xffffffff80567536 at trap+0x3a6 #5 0xffffffff80552603 at calltrap+0x8 #6 0xffffffff803b2c90 at socow_setup+0xd0 #7 0xffffffff803bc12a at sosend_copyin+0x10a #8 0xffffffff803bc7c6 at sosend_generic+0x4f6 #9 0xffffffff803c2028 at kern_sendit+0x1e8 #10 0xffffffff803c22a1 at sendit+0xd1 #11 0xffffffff803c2331 at sys_sendmsg+0x61 #12 0xffffffff805681c5 at amd64_syscall+0x2a5 #13 0xffffffff805528eb at Xfast_syscall+0xfb GEOM_MIRROR: Device beeb0swap: provider mirror/beeb0swap destroyed. GEOM_MIRROR: Device beeb0swap destroyed. GEOM_MIRROR: Device kohrah0swap: provider mirror/kohrah0swap destroyed. GEOM_MIRROR: Device kohrah0swap destroyed. Uptime: 1d10h46m37s Dumping 9737 out of 12268 MB: == And everything stalls. I have dumpdev_auto set at /etc/rc.conf and selected swap device (kohrah0swap) size is 32Gb so it should save dumps but it doesn't. Next time i'll try to give it raw volume for dump. The most curious thing for me is userland app crashing whole kernel. If I switch to redis everything works like a charm. -- Sphinx of black quartz judge my vow.