From owner-freebsd-xen@FreeBSD.ORG Mon Nov 19 11:06:56 2012 Return-Path: Delivered-To: freebsd-xen@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3E2E5223 for ; Mon, 19 Nov 2012 11:06:56 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) by mx1.freebsd.org (Postfix) with ESMTP id 20A138FC1B for ; Mon, 19 Nov 2012 11:06:56 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id qAJB6ulH013529 for ; Mon, 19 Nov 2012 11:06:56 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.5/8.14.5/Submit) id qAJB6t1D013527 for freebsd-xen@FreeBSD.org; Mon, 19 Nov 2012 11:06:55 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 19 Nov 2012 11:06:55 GMT Message-Id: <201211191106.qAJB6t1D013527@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-xen@FreeBSD.org Subject: Current problem reports assigned to freebsd-xen@FreeBSD.org X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Nov 2012 11:06:56 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/171873 xen [xen] xn network device floods warning in dmesg o kern/171138 xen [xen] [panic] Deactivating network interface produces o kern/171118 xen [xen] FreeBSD XENHVM guest doesn't shutdown cleanly o kern/166174 xen [xen] Problems ROOT MOUNT ERROR o kern/165418 xen [xen] Problems mounting root filesystem from XENHVM o kern/164630 xen [xen] XEN HVM kernel: run_interrupt_driven_hooks: stil o kern/164450 xen [xen] Failed to install FreeeBSD 9.0-RELEASE from CD i o kern/162677 xen [xen] FreeBSD not compatible with "Current Stable Xen" o kern/161318 xen [xen] sysinstall crashes with floating point exception o kern/155468 xen [xen] Xen PV i386 multi-kernel CPU system is not worki o kern/155353 xen [xen] [patch] put "nudging TOD" message under boot_ver o kern/154833 xen [xen]: xen 4.0 - DomU freebsd8.2RC3 i386, XEN kernel. o kern/154473 xen [xen] xen 4.0 - DomU freebsd8.1 i386, XEN kernel. Not o kern/154472 xen [xen] xen 4.0 - DomU freebsd8.1 i386 xen kernel reboot o kern/154428 xen [xen] xn0 network interface and PF - Massive performan o kern/153674 xen [xen] i386/XEN idle thread shows wrong percentages o kern/153672 xen [xen] [panic] i386/XEN panics under heavy fork load o kern/153620 xen [xen] Xen guest system clock drifts in AWS EC2 (FreeBS o kern/153477 xen [xen] XEN pmap code abuses vm page queue lock o kern/153150 xen [xen] xen/ec2: disable checksum offloading on interfac o kern/152228 xen [xen] [panic] Xen/PV panic with machdep.idle_mwait=1 o kern/144629 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143398 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor o kern/143340 xen [xen] FreeBSD 8-RELEASE XEN pvm networking doesn't wor f kern/143069 xen [xen] [panic] Xen Kernel Panic - Memory modified after f kern/135667 xen ufs filesystem corruption on XEN DomU system f kern/135421 xen [xen] FreeBSD Xen PVM DomU network failure - netfronc. f kern/135178 xen [xen] Xen domU outgoing data transfer stall when TSO i p kern/135069 xen [xen] FreeBSD-current/Xen SMP doesn't function at all f i386/124516 xen [xen] FreeBSD-CURRENT Xen Kernel Segfaults when config o kern/118734 xen [xen] FreeBSD 6.3-RC1 and FreeBSD 7.0-BETA 4 fail to b 31 problems total. From owner-freebsd-xen@FreeBSD.ORG Wed Nov 21 02:24:16 2012 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 27D3F657 for ; Wed, 21 Nov 2012 02:24:16 +0000 (UTC) (envelope-from bounces+73574-0602-freebsd-xen=freebsd.org@sendgrid.me) Received: from o3.shared.sendgrid.net (o3.shared.sendgrid.net [208.117.48.85]) by mx1.freebsd.org (Postfix) with SMTP id C2A098FC0C for ; Wed, 21 Nov 2012 02:24:15 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=sendgrid.info; h=from :mime-version:to:subject:content-type:content-transfer-encoding; s=smtpapi; bh=MLOC/0l3UafNb4W9UixTtk/Zwl8=; b=k1vCjBQm7cFcQaYBK /7wrXGV7tpYL9GIvqqzlFxrrIpCYjVQnfvktb8y4rwGr/S91M3KjXuwVtfh50odl SquB0l137I0zoR8sNm+CDKNyBBq04JGDNboSWSFPa3lxZHL6YEQeROz467aMZXdT ugpotIgKP2Xgj9rWGIDYzKxn1I= Received: by 10.4.35.202 with SMTP id mf34.32365.50AC3B492 Tue, 20 Nov 2012 20:24:09 -0600 (CST) Received: from mail.tarsnap.com (unknown [10.60.208.13]) by None (SG) with ESMTP id 50ac3b48.42cf.23adb66 for ; Tue, 20 Nov 2012 20:24:08 -0600 (CST) Received: (qmail 54032 invoked from network); 21 Nov 2012 02:24:08 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by ec2-107-20-205-189.compute-1.amazonaws.com with ESMTP; 21 Nov 2012 02:24:08 -0000 Received: (qmail 10765 invoked from network); 21 Nov 2012 02:23:07 -0000 Received: from unknown (HELO clamshell.daemonology.net) (127.0.0.1) by clamshell.daemonology.net with SMTP; 21 Nov 2012 02:23:07 -0000 Message-ID: <50AC3B0B.5080700@freebsd.org> Date: Tue, 20 Nov 2012 18:23:07 -0800 From: Colin Percival User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:16.0) Gecko/20121014 Thunderbird/16.0.1 MIME-Version: 1.0 To: freebsd-xen@freebsd.org Subject: FreeBSD in AWS Marketplace X-Enigmail-Version: 1.4.5 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Sendgrid-EID: RUbAm5H8PjswBj/QH+sYVehaJogg3iBnZcyVi1bw/IxMoJdo67CrKLLJIYQjL7GuUB3ViNIVXxB+cdlj0Gubp9UMombAr5TvL822ZTCGlUIQ7xB/iliBC41Tntw0BqvQ X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2012 02:24:16 -0000 Hi all, Another small piece of progress in the ongoing FreeBSD/EC2 saga -- I've managed to get FreeBSD into the curated "Amazon Web Services Marketplace" for cluster compute and high-I/O instance types. These run HVM normally and thus don't need you to pay the "windows tax" which applies to running FreeBSD on most other instance types. https://aws.amazon.com/marketplace/pp/B00AA25MLK For now it's just 9.0-RELEASE; I didn't want to bother the Amazon folks with the BETA and RC images, but I'll make sure 9.1-RELEASE also gets into the AWS Marketplace when it's released. I'm continuing to nag at EC2 folks about finding a way for FreeBSD to run on all the other instance types without paying the Windows tax. I would not be surprised if seeing more people using the existing FreeBSD options (either on HPC instances via the Marketplace, or on other instance types via the images listed on my website) would help to convince Amazon that this should be a priority. ;-) -- Colin Percival Security Officer Emeritus, FreeBSD | The power to serve Founder, Tarsnap | www.tarsnap.com | Online backups for the truly paranoid From owner-freebsd-xen@FreeBSD.ORG Wed Nov 21 17:27:11 2012 Return-Path: Delivered-To: freebsd-xen@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 859E72C0 for ; Wed, 21 Nov 2012 17:27:11 +0000 (UTC) (envelope-from james.mcjones@gmail.com) Received: from mail-lb0-f196.google.com (mail-lb0-f196.google.com [209.85.217.196]) by mx1.freebsd.org (Postfix) with ESMTP id 02CA68FC0C for ; Wed, 21 Nov 2012 17:27:10 +0000 (UTC) Received: by mail-lb0-f196.google.com with SMTP id m4so715196lbo.7 for ; Wed, 21 Nov 2012 09:27:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=q1mIhEmK4bbDl7JQ1AbUE5ustLdcYISSlrilmifxq2k=; b=jXE/+7xuS6ek73L5Slse7HZOoA3mtLg/OH10eePXMdEKevn1SjLrBSX3xZ5v4oZ8p/ UdNaSc9xHnm9cV40UGsj5KCPO1G+j8x/6qpRYDpZiLxRpU3ZEEcroJepOKXGZGdNT+rm +smUoQ0hZnNNv/rRjEmulBGiJUMHOz1aDXnCCljMfoWXyRKWCpsPzcLIzWJas6E9sErm j0V/6MDzXX0Bonodf3y9zf8YF0g4Jgb3SM3syYupk8lMmivgQO3DUlmCDDiZaAekoQHS 5r2RkNCT/3eMPoBDSPprOfbw05Z8fXnmdEoWY1GYx1vlUo56JIn4XBgD+C8xfFHp1zaY 7CRA== MIME-Version: 1.0 Received: by 10.112.102.130 with SMTP id fo2mr8236355lbb.35.1353518829528; Wed, 21 Nov 2012 09:27:09 -0800 (PST) Received: by 10.112.46.137 with HTTP; Wed, 21 Nov 2012 09:27:09 -0800 (PST) Date: Wed, 21 Nov 2012 18:27:09 +0100 Message-ID: Subject: 8.3-RELEASE-p4 with pfsense 2.1-BETA0 patches running as PV xen domU randomly crashes From: James McJones To: freebsd-xen@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2012 17:27:11 -0000 Hi We have a significant number of pfsense 2.0 firewalls (with freebsd 8.1-RELEASE-p6 under the hood) all running in HVM mode on xen 4.1, with which we've been experiencing performance issues recently. In essence, the (virtual) firewall load goes through the roof as we reach a certain throughput level. The xen host server's CPU only runs at 20-30% when this happens. A first improvement was noticed by switching from the default realtek 8139 drivers (re$x) to the e1000 drivers (em$x). As the results were still not acceptable, we've attempted to build a xen PV-aware freebsd 8.3-RELEASE-p4 kernel with pfsense 2.1-BETA0 patches, in which we've eventually succeeded. The performance gain was massive. Firewalls that were previously becoming unresponsive at a throughput of 20mbit, would now do 200mbit with a load of max 4. The issue we're facing with the 2.1-BETA running in PV mode however, is that it randomly crashes and reboots. This does not appear to be load related at all. Happens roughly once a day. The output on the console when it crashes can be found here: https://gist.github.com/d943d0c97fd4d9fba1e9 The headline of this crash is: panic: HYPERVISOR_update_va_mapping(((unsigned long)(sysmaps->CADDR2)), (0x001 | 0x002 | xpmap_ptom(((dst)->phys_addr)) | 0x020 | 0x040), UVMF_INVLPG| UVMF_ALL) < 0: /usr/pfSensesrc/src/sys/i386/xen/pmap.c:342 Has anyone else been successful in running pfsense in PV mode? Any experiences to share? Or any pointers towards what the issue could be with our PV kernel? Thanks in advance James