From owner-freebsd-virtualization@FreeBSD.ORG Tue May 28 16:15:12 2013 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 977F56E; Tue, 28 May 2013 16:15:12 +0000 (UTC) (envelope-from roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [46.33.159.39]) by mx1.freebsd.org (Postfix) with ESMTP id E01FF6DA; Tue, 28 May 2013 16:15:11 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.87,758,1363132800"; d="scan'208";a="5059085" Received: from lonpex01cl01.citrite.net ([10.30.203.101]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/AES128-SHA; 28 May 2013 16:15:01 +0000 Received: from [192.168.1.30] (10.30.203.1) by LONPEX01CL01.citrite.net (10.30.203.101) with Microsoft SMTP Server id 14.2.342.3; Tue, 28 May 2013 17:15:01 +0100 Message-ID: <51A4D804.9050208@citrix.com> Date: Tue, 28 May 2013 18:15:00 +0200 From: =?UTF-8?B?Um9nZXIgUGF1IE1vbm7DqQ==?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:17.0) Gecko/20130509 Thunderbird/17.0.6 MIME-Version: 1.0 To: Colin Percival Subject: Re: FreeBSD PVHVM call for testing References: <519131D8.9010307@citrix.com> <51952BAE.6010609@freebsd.org> <51957D42.9060801@citrix.com> <51959ED9.6040405@freebsd.org> <51974EC9.9030204@citrix.com> <5197A1EA.2040404@freebsd.org> <519CAFC7.1070908@citrix.com> <519D24A9.3050407@freebsd.org> <519DDC0A.9000201@citrix.com> <519E6958.6020606@freebsd.org> <519F3CD0.5090405@citrix.com> In-Reply-To: <519F3CD0.5090405@citrix.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.30.203.1] Cc: "freebsd-xen@freebsd.org" , "xen-users@lists.xen.org" , Matt Wilson , "freebsd-virtualization@freebsd.org" , xen-devel X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 16:15:12 -0000 On 24/05/13 12:11, Roger Pau Monné wrote: > On 23/05/13 21:09, Colin Percival wrote: >> On 05/23/13 02:06, Roger Pau Monné wrote: >>> On 22/05/13 22:03, Colin Percival wrote: >>>> Testing on a cr1.8xlarge EC2 instance, I get Xen 4.2, but it ends up with >>>> a panic -- console output below. I can get a backtrace and possibly even >>>> a dump if those would help. >>> >>> Thanks for the test, I've been using Xen 4.2 (and 4.3) without problems >>> so far. By looking at the Xen code, the only reason the timer setup >>> could return -22 (EINVAL), is that we try to set the timer for a >>> different vCPU than the one we are running on. >>> >>> I've been able to boot a 32 vCPU DomU on my 8way box using Xen 4.2.1 >>> (using both qemu-xen and qemu-xen-traditional device models), so I'm >>> unsure if this could be due to some patch Amazon applies to Xen. Could >>> you try the following patch and post the error message? I would like to >>> see if the cpuid reported by kdb and the vCPU that we are trying to set >>> the timer are the same. >> >> Looks like there's agreement about the cpuids here. Anything else I should >> try testing? > > Thanks for the test, this is what I expected. I'm a little bit out of > ideas since I'm not able to reproduce this on upstream Xen 4.2. Without > knowing what's happening inside the hypervisor it's hard to tell what's > wrong. It would be interesting to try if the same happens with a Linux > PVHVM (not PV) running on the same instance type. Hello Matt, Colin has found an issue on the FreeBSD PVHVM port that I haven't been able to reproduce using open source Xen, even when using the same version as the one reported by EC2. Is there anyway you could provide some help debugging this? Without seeing the Xen code that causes VCPUOP_set_singleshot_timer to return EINVAL it is quite hard to figure out what's happening inside the hypervisor. Thanks, Roger.