From owner-freebsd-xen@freebsd.org Tue Aug 9 13:16:50 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E451ABB342D; Tue, 9 Aug 2016 13:16:50 +0000 (UTC) (envelope-from prvs=022e014eb=roger.pau@citrix.com) Received: from SMTP02.CITRIX.COM (smtp02.citrix.com [66.165.176.63]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5A0301B7B; Tue, 9 Aug 2016 13:16:49 +0000 (UTC) (envelope-from prvs=022e014eb=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.28,494,1464652800"; d="scan'208";a="378600540" Date: Tue, 9 Aug 2016 13:32:41 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Miguel C CC: freebsd-current , Subject: Re: FreeBSD 11 - BETA-1 Xen DOMU loses network when jail (VIMAGE) starts Message-ID: <20160809113210.p2rkqmjnypg2iw5l@mac> References: <20160809085523.kow2qbpirzppytv6@mac> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.6.2-neo (2016-06-11) X-DLP: MIA1 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Aug 2016 13:16:51 -0000 On Tue, Aug 09, 2016 at 12:12:34PM +0100, Miguel C wrote: > Melhores Cumprimentos // Best Regards > ----------------------------------------------- > *Miguel Clara* > *IT - Sys Admin & Developer* > > On Tue, Aug 9, 2016 at 9:55 AM, Roger Pau Monné > wrote: > > > On Sat, Jul 23, 2016 at 08:46:49PM +0100, Miguel C wrote: > > > Just as a note using netgraph (with jng script as a workaround) works.... > > > > > > Also manually creating a bridge in the domu and adding xn0 as a member > > > makes this fail.... so the issue is indeed related to the bridge. > > > > > > I'll open a PR later in case someone want to look into it, but I'm happy > > it > > > works with netgraph. > > > > I seem to be able to use xn* interfaces with bridges without problems: > > > > xn0: flags=8943 metric 0 > > mtu 1500 > > options=3 > > ether 00:16:3e:74:3d:76 > > nd6 options=29 > > media: Ethernet manual > > status: active > > bridge0: flags=8843 metric 0 mtu > > 1500 > > ether 02:77:3d:4a:18:00 > > inet 172.16.1.140 netmask 0xffffff00 broadcast 172.16.1.255 > > nd6 options=9 > > groups: bridge > > id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 > > maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 > > root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 > > member: xn0 flags=143 > > ifmaxaddr 0 port 2 priority 128 path cost 2000000 > > > > Is this a GENERIC kernel or are you using some custom > > configuration/patches? > > Can you provide some more information about how to reproduce this? > > > > GENERIC + VIMAGE, but that's just it, no other custom changes or patches. > > Note however that this is under a NetbBSD Dom0, and I see the "vifXX" > interface disappear in the Dom0 side when the bridge is create on FreeBSD > DomU. > > I'm actually happy with netgraph, although I've never played with it, and > seems more complex, the script provide in /share/examples is perfect to use > with "jail.conf" and pf seems happy in FreeBSD-11 (which is not CURRENT, > should we move this to a different mailing list!?) too, no panics so far. > > I suspect the main issue, since it works fine for you is the fact that this > is in a NetBSD Dom0. Oh, from your previous email I thought that it was the interface inside of the DomU that disappeared. Does then same happen on a NetBSD Dom0 with a NetBSD DomU? Roger. From owner-freebsd-xen@freebsd.org Tue Aug 9 14:09:41 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 19015BB4371; Tue, 9 Aug 2016 14:09:41 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: from mail-wm0-x22b.google.com (mail-wm0-x22b.google.com [IPv6:2a00:1450:400c:c09::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B913D16AC; Tue, 9 Aug 2016 14:09:40 +0000 (UTC) (envelope-from miguelmclara@gmail.com) Received: by mail-wm0-x22b.google.com with SMTP id d196so5352224wmd.0; Tue, 09 Aug 2016 07:09:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=cBOmICYxej69ZJHMLKojdXg0nxKPYj5SSIlYI8FOs14=; b=Pb/HMkIDipiXaIoLdEJzA5DSJjl9a2nV0Tq7vhFqoBZSQHoDoGzvZ4fAzLyEf79n7N PBAIP57RF/uvMOrCE5ml6syGJyDTYTlZ7HZ3KwVpjzZQestBZ3uuuKg3qp8NTdp/GAb4 pV1fgTWtCnOzgZr4OFea7ZMC0+8yW8VypRt+GYtnnNdgpJO5pLLq3DAzc1ohl8xps90K lGVaYsKSX24up2oweVEyAc2ri6XNuPr0jJdjPuneioR0U0ZlF63fH2yBGe7vXJ/zSj4L zTqTKSv0ce5NpTLsxNr8+P2zV9wUdAiZLxzPx5Cj+DXWC++CtBtoyNgXP8Fs+jAmlKtm /arA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=cBOmICYxej69ZJHMLKojdXg0nxKPYj5SSIlYI8FOs14=; b=Btx2IffhBShSxlBHJ6qRjNfcgJn4gYBS0Lio9/5SP5cxWe6ohAswmwTGoLiUAghIOA j8DVeedpMak5bFgHtU/5JUxqw2NUguHoLjA5OezjSwFtsnEom6UBmkr2Ki+TyIqAB8QP lCT77TnmxKLLS9IjMl3XW8C1/RAQ/39CXE5M+t7dZRhHlMaxwae7u0X7ZTlDRxiHNlJG K46migLBn7mzP5KLvwoI3cgtdyro+uUvzla9XPWZZa4U5rCg2NANWTfUzDNDyTnFX4y4 OL9yDTXoM/dJp0tkDdemgRhJF7fd3KZDBxg/o9xXES+xrV93N044QfnWUK82SGW+ze5T sJBA== X-Gm-Message-State: AEkoouuvmO88GRYKotzGAsH0O/svIPhCuUMSSKEHlO+AO6pFO3IyWrMdwEFDpyyERLbonDFRJrgf/4ohMKAFiQ== X-Received: by 10.194.18.35 with SMTP id t3mr88847792wjd.174.1470751778681; Tue, 09 Aug 2016 07:09:38 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.198.201 with HTTP; Tue, 9 Aug 2016 07:09:37 -0700 (PDT) In-Reply-To: <20160809113210.p2rkqmjnypg2iw5l@mac> References: <20160809085523.kow2qbpirzppytv6@mac> <20160809113210.p2rkqmjnypg2iw5l@mac> From: Miguel C Date: Tue, 9 Aug 2016 15:09:37 +0100 Message-ID: Subject: Re: FreeBSD 11 - BETA-1 Xen DOMU loses network when jail (VIMAGE) starts To: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Cc: freebsd-current , "freebsd-xen@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Aug 2016 14:09:41 -0000 On Tuesday, August 9, 2016, Roger Pau Monn=C3=A9 wro= te: > On Tue, Aug 09, 2016 at 12:12:34PM +0100, Miguel C wrote: > > Melhores Cumprimentos // Best Regards > > ----------------------------------------------- > > *Miguel Clara* > > *IT - Sys Admin & Developer* > > > > On Tue, Aug 9, 2016 at 9:55 AM, Roger Pau Monn=C3=A9 > > > wrote: > > > > > On Sat, Jul 23, 2016 at 08:46:49PM +0100, Miguel C wrote: > > > > Just as a note using netgraph (with jng script as a workaround) > works.... > > > > > > > > Also manually creating a bridge in the domu and adding xn0 as a > member > > > > makes this fail.... so the issue is indeed related to the bridge. > > > > > > > > I'll open a PR later in case someone want to look into it, but I'm > happy > > > it > > > > works with netgraph. > > > > > > I seem to be able to use xn* interfaces with bridges without problems= : > > > > > > xn0: flags=3D8943 > metric 0 > > > mtu 1500 > > > options=3D3 > > > ether 00:16:3e:74:3d:76 > > > nd6 options=3D29 > > > media: Ethernet manual > > > status: active > > > bridge0: flags=3D8843 metric = 0 > mtu > > > 1500 > > > ether 02:77:3d:4a:18:00 > > > inet 172.16.1.140 netmask 0xffffff00 broadcast 172.16.1.255 > > > nd6 options=3D9 > > > groups: bridge > > > id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 > > > maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 > > > root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 > > > member: xn0 flags=3D143 > > > ifmaxaddr 0 port 2 priority 128 path cost 2000000 > > > > > > Is this a GENERIC kernel or are you using some custom > > > configuration/patches? > > > Can you provide some more information about how to reproduce this? > > > > > > GENERIC + VIMAGE, but that's just it, no other custom changes or > patches. > > > > Note however that this is under a NetbBSD Dom0, and I see the "vifXX" > > interface disappear in the Dom0 side when the bridge is create on FreeB= SD > > DomU. > > > > I'm actually happy with netgraph, although I've never played with it, a= nd > > seems more complex, the script provide in /share/examples is perfect to > use > > with "jail.conf" and pf seems happy in FreeBSD-11 (which is not CURRENT= , > > should we move this to a different mailing list!?) too, no panics so fa= r. > > > > I suspect the main issue, since it works fine for you is the fact that > this > > is in a NetBSD Dom0. > > Oh, from your previous email I thought that it was the interface inside o= f > the DomU that disappeared. Does then same happen on a NetBSD Dom0 with a > NetBSD DomU? > > Sorry I should have explained better, and no it does not happen with othe= r guests not even FreeBSD 9 or 10, but VIMAGE has major issues there and some have been fixed in 11 (panics while using of for example), and I also needed a patch for xn to even work (also related to NetBSD dom0) but bridge did not give any issues. It seems with 11 when I add xn0 to the bridge the dom0 thinks the interface was disconnected, and when that happens I guess the vif bridge script ( on dom0 ) destroys the interface. Roger. --=20 Miguel Clara, Sent from Gmail Mobile From owner-freebsd-xen@freebsd.org Tue Aug 9 14:24:51 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59E16BB490F; Tue, 9 Aug 2016 14:24:51 +0000 (UTC) (envelope-from prvs=022e014eb=roger.pau@citrix.com) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 039A91394; Tue, 9 Aug 2016 14:24:50 +0000 (UTC) (envelope-from prvs=022e014eb=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.28,494,1464652800"; d="scan'208";a="371225454" Date: Tue, 9 Aug 2016 16:24:41 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Miguel C CC: freebsd-current , "freebsd-xen@freebsd.org" Subject: Re: FreeBSD 11 - BETA-1 Xen DOMU loses network when jail (VIMAGE) starts Message-ID: <20160809142433.hxevvocxwokrftbs@mac> References: <20160809085523.kow2qbpirzppytv6@mac> <20160809113210.p2rkqmjnypg2iw5l@mac> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.6.2-neo (2016-06-11) X-DLP: MIA1 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Aug 2016 14:24:51 -0000 On Tue, Aug 09, 2016 at 03:09:37PM +0100, Miguel C wrote: > On Tuesday, August 9, 2016, Roger Pau Monné wrote: > > > On Tue, Aug 09, 2016 at 12:12:34PM +0100, Miguel C wrote: > > > Melhores Cumprimentos // Best Regards > > > ----------------------------------------------- > > > *Miguel Clara* > > > *IT - Sys Admin & Developer* > > > > > > On Tue, Aug 9, 2016 at 9:55 AM, Roger Pau Monné > > > > > wrote: > > > > > > > On Sat, Jul 23, 2016 at 08:46:49PM +0100, Miguel C wrote: > > > > > Just as a note using netgraph (with jng script as a workaround) > > works.... > > > > > > > > > > Also manually creating a bridge in the domu and adding xn0 as a > > member > > > > > makes this fail.... so the issue is indeed related to the bridge. > > > > > > > > > > I'll open a PR later in case someone want to look into it, but I'm > > happy > > > > it > > > > > works with netgraph. > > > > > > > > I seem to be able to use xn* interfaces with bridges without problems: > > > > > > > > xn0: flags=8943 > > metric 0 > > > > mtu 1500 > > > > options=3 > > > > ether 00:16:3e:74:3d:76 > > > > nd6 options=29 > > > > media: Ethernet manual > > > > status: active > > > > bridge0: flags=8843 metric 0 > > mtu > > > > 1500 > > > > ether 02:77:3d:4a:18:00 > > > > inet 172.16.1.140 netmask 0xffffff00 broadcast 172.16.1.255 > > > > nd6 options=9 > > > > groups: bridge > > > > id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 > > > > maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200 > > > > root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 > > > > member: xn0 flags=143 > > > > ifmaxaddr 0 port 2 priority 128 path cost 2000000 > > > > > > > > Is this a GENERIC kernel or are you using some custom > > > > configuration/patches? > > > > Can you provide some more information about how to reproduce this? > > > > > > > > GENERIC + VIMAGE, but that's just it, no other custom changes or > > patches. > > > > > > Note however that this is under a NetbBSD Dom0, and I see the "vifXX" > > > interface disappear in the Dom0 side when the bridge is create on FreeBSD > > > DomU. > > > > > > I'm actually happy with netgraph, although I've never played with it, and > > > seems more complex, the script provide in /share/examples is perfect to > > use > > > with "jail.conf" and pf seems happy in FreeBSD-11 (which is not CURRENT, > > > should we move this to a different mailing list!?) too, no panics so far. > > > > > > I suspect the main issue, since it works fine for you is the fact that > > this > > > is in a NetBSD Dom0. > > > > Oh, from your previous email I thought that it was the interface inside of > > the DomU that disappeared. Does then same happen on a NetBSD Dom0 with a > > NetBSD DomU? > > > > Sorry I should have explained better, and no it does not happen with other > guests not even FreeBSD 9 or 10, but VIMAGE has major issues there and some > have been fixed in 11 (panics while using of for example), and I also > needed a patch for xn to even work (also related to NetBSD dom0) but bridge > did not give any issues. > > It seems with 11 when I add xn0 to the bridge the dom0 thinks the interface > was disconnected, and when that happens I guess the vif bridge script ( on > dom0 ) destroys the interface. Can you paste the output of `xenstore-ls -fp` on the Dom0 when that happens? Also are there any messages in the Dom0 dmesg? You might want to modify src/sys/arch/xen/xen/xennetback_xenbus.c (on the NetBSD sources) to define XENDEBUG_NET, so that you get verbose output. Roger. From owner-freebsd-xen@freebsd.org Thu Aug 11 12:51:40 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B8AA8BB3FFA for ; Thu, 11 Aug 2016 12:51:40 +0000 (UTC) (envelope-from Christian.Hoyer-Reuther@cac-chem.de) Received: from mail.cac-chem.de (mail.cac-chem.de [213.187.69.85]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.cac-chem.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8EC861B46 for ; Thu, 11 Aug 2016 12:51:38 +0000 (UTC) (envelope-from Christian.Hoyer-Reuther@cac-chem.de) Received: from mh01.cac.loc (mh01.lc-intern.org [172.30.77.47]) by mail.cac-chem.de (Postfix) with ESMTP id 7A9603042D9; Thu, 11 Aug 2016 14:29:11 +0200 (CEST) Received: from mh01.cac.loc (localhost [127.0.0.1]) by mh01.cac.loc (Postfix) with ESMTP id 6AC943811C; Thu, 11 Aug 2016 14:29:11 +0200 (CEST) X-Virus-Scanner: This message was checked by ESET Mail Security for Linux/BSD. For more information on ESET Mail Security, please, visit our website: http://www.eset.com/. Received: from EX1.cac.loc (ex1.cac.loc [172.30.77.30]) by mh01.cac.loc (Postfix) with ESMTP id 660E5380BD; Thu, 11 Aug 2016 14:29:11 +0200 (CEST) Received: from EX1.cac.loc ([172.30.77.30]) by ex1 ([172.30.77.30]) with mapi; Thu, 11 Aug 2016 14:29:10 +0200 From: "Hoyer-Reuther, Christian" To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= , Wei Liu CC: "freebsd-xen@freebsd.org" Date: Thu, 11 Aug 2016 14:29:10 +0200 Subject: Re: 'Live' Migrate messes up NTP on FreeBSD domU - any suggestions? Thread-Topic: 'Live' Migrate messes up NTP on FreeBSD domU - any suggestions? Thread-Index: AdHpc1JeMlhGFQjsQweMHxFlMrqk+AKVeqLA Message-ID: <41E487BC91654544B2B8F31096F2D9D4D1516495CA@ex1> References: <41E487BC91654544B2B8F31096F2D9D4D1514D1D8E@ex1> <20160714103016.4hgfzsjgkkgtkkgg@mac> <41E487BC91654544B2B8F31096F2D9D4D1514D1E88@ex1> <20160720093111.mpmp27wol7j3ge3d@mac> <41E487BC91654544B2B8F31096F2D9D4D1516490E9@ex1> <20160722115542.dopzb63dgkilqall@mac> <20160725144314.yhggviqhsqzgux2w@mac> <20160725153714.GW27082@citrix.com> <20160729082905.46js7o3zp6iwuibd@mac> In-Reply-To: <20160729082905.46js7o3zp6iwuibd@mac> Accept-Language: de-DE Content-Language: de-DE X-MS-Has-Attach: yes X-MS-TNEF-Correlator: acceptlanguage: de-DE MIME-Version: 1.0 X-EsetResult: clean X-ESET-AS: R=OK; S=0; OP=CALC; TIME=1470918551; VERSION=4140; MFE-VER=46; MC=1499245350; TRN=0 X-I-ESET-AS: RN=0;RNP= X-ESET-Antispam: OK Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 12:51:40 -0000 Hello, sorry for the late response, but now I'm back from vacation and did some ne= w tests. I installed a new VM using the FreeBSD-11.0-ALPHA6-amd64-20160701-r302303-d= isc1.iso, then updated to HEAD r303908 and installed xe-guest-utilities-6.2= .0_2 from HEAD ports r420055. Xenguest_enable=3D"YES" is set in /etc/rc.con= f. I tested VM migration from XenCenter (XenMotion). There are no more time issues after migration. I did 4 migrations and at 2 migrations I noticed the following problems: When the migration finishes then the VM console switches to the VGA BIOS sc= reen (Plex86/Bochs VGABios ...), the VM console freezes, the VM is not reac= hable over network and in XenCenter I see the first 2 CPU's raising up to 1= 00 percent. Screenshots attached. Then after 10 minutes the CPU usage goes down, the VM console is responsive= again and the machine is reachable over network. Regards, Christian > -----Original Message----- > From: Roger Pau Monn=E9 [mailto:roger.pau@citrix.com] > Sent: Friday, July 29, 2016 10:29 AM > To: Wei Liu > Cc: Karl Pielorz; Hoyer-Reuther, Christian; freebsd-xen@freebsd.org > Subject: Re: 'Live' Migrate messes up NTP on FreeBSD domU - any suggestio= ns? >=20 > On Mon, Jul 25, 2016 at 04:37:14PM +0100, Wei Liu wrote: > > On Mon, Jul 25, 2016 at 04:43:43PM +0200, Roger Pau Monn=E9 wrote: > > > Adding Wei to the Cc list since he added the multiqueue functionality= . > > > > > > On Mon, Jul 25, 2016 at 02:59:02PM +0100, Karl Pielorz wrote: > > > > > > > > --On 22 July 2016 13:55 +0200 Roger Pau Monn=E9 > wrote: > > > > > > > > > In my environment I've migrated a FreeBSD VM with 2 cpus for > 10= 0 > > > > > consecutive times without seeing any issues (or freezes), althoug= h > this > > > > > was with OSS Xen and without xe-guest-utilities. Karl, have you > tested > > > > > HEAD recently? > > > > > > > > Ok, I have tested this with r303286 - it seems to work OK. The host= s > gain no > > > > time that I can see while migrating, and NTP stays happy. > > > > > > > > I did get a panic after about 40 migrations - but that seems to be > some > > > > network issue or something... > > > > > > > > ('panic called with 0 available queues / dbt_trace_self_wrapper / > vpanic / > > > > kassert_panic / xn_txq_mq_start / ether_output / udp_send / > sosend_dgram / > > > > kern_sendit / sendit / sys_sendto / amd64_syscall / Xfast_syscall) > > > > > > I haven't been able to reproduce this, but I think it's possible that= if > you > > > migrate an active netfront xn_txq_mq_start might be called during the > > > migration, just in the middle of the setup_device reconfiguation (whi= le > > > info->num_queues is 0). > > > > > > Wei, I think netif_disconnect_backend should set IFF_DRV_OACTIVE in > order to > > > notify the net subsystem that the queues are full, so no further call= s > to > > > xn_txq_mq_start happen until the resume has finished, do you agree? > > > > > > > Perhaps clear IFF_DRV_RUNNING and only set it when the device is ready? > > Looking at the manpage is seems more appropriate to me semantically. >=20 > Hello Karl and Christian, I have the following patches that solve all the > issues I've seen with live migration, with those I've been able to migrat= e a > VM > 100 times without seeing any issues. Could you give them a try? >=20 > BTW, I haven't been able to reproduce Karl's crash ("called with 0 availa= ble > queues"), but I've added a condition that should prevent it from triggeri= ng > anyway. Patches are here: >=20 > https://reviews.freebsd.org/D7349 > https://reviews.freebsd.org/D7362 > https://reviews.freebsd.org/D7363 >=20 > It doesn't really matter in which order you apply them as long as both 3 = are > applied. Ideally I would like to commit them on Monday, so that I can MFC > them to stable/11 before the releng/11 branch, could you please provide s= ome > feedback before then? >=20 > Thanks, Roger. From owner-freebsd-xen@freebsd.org Fri Aug 12 08:01:18 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A39E6BB7589 for ; Fri, 12 Aug 2016 08:01:18 +0000 (UTC) (envelope-from prvs=025313e5c=roger.pau@citrix.com) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5476C194A for ; Fri, 12 Aug 2016 08:01:17 +0000 (UTC) (envelope-from prvs=025313e5c=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.28,509,1464652800"; d="scan'208";a="371924692" Date: Fri, 12 Aug 2016 10:01:03 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: "Hoyer-Reuther, Christian" CC: Wei Liu , "freebsd-xen@freebsd.org" Subject: Re: 'Live' Migrate messes up NTP on FreeBSD domU - any suggestions? Message-ID: <20160812080103.s77fxs6jitl2itry@mac> References: <20160714103016.4hgfzsjgkkgtkkgg@mac> <41E487BC91654544B2B8F31096F2D9D4D1514D1E88@ex1> <20160720093111.mpmp27wol7j3ge3d@mac> <41E487BC91654544B2B8F31096F2D9D4D1516490E9@ex1> <20160722115542.dopzb63dgkilqall@mac> <20160725144314.yhggviqhsqzgux2w@mac> <20160725153714.GW27082@citrix.com> <20160729082905.46js7o3zp6iwuibd@mac> <41E487BC91654544B2B8F31096F2D9D4D1516495CA@ex1> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <41E487BC91654544B2B8F31096F2D9D4D1516495CA@ex1> User-Agent: Mutt/1.6.2-neo (2016-06-11) X-DLP: MIA2 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Aug 2016 08:01:18 -0000 On Thu, Aug 11, 2016 at 02:29:10PM +0200, Hoyer-Reuther, Christian wrote: > Hello, > > sorry for the late response, but now I'm back from vacation and did some new tests. > > I installed a new VM using the FreeBSD-11.0-ALPHA6-amd64-20160701-r302303-disc1.iso, then updated to HEAD r303908 and installed xe-guest-utilities-6.2.0_2 from HEAD ports r420055. Xenguest_enable="YES" is set in /etc/rc.conf. > > I tested VM migration from XenCenter (XenMotion). > > There are no more time issues after migration. > > I did 4 migrations and at 2 migrations I noticed the following problems: > > When the migration finishes then the VM console switches to the VGA BIOS screen (Plex86/Bochs VGABios ...), the VM console freezes, the VM is not reachable over network and in XenCenter I see the first 2 CPU's raising up to 100 percent. Screenshots attached. Hm, not sure what's going on there, and why you seem to be the only one to hit this issue. Are you maybe booting with boot_verbose="YES"? > Then after 10 minutes the CPU usage goes down, the VM console is responsive again and the machine is reachable over network. Hm, could you give a try to 11.0-RC1 when it comes out? It should be out today or tomorrow (builds are already underway). Roger. From owner-freebsd-xen@freebsd.org Fri Aug 12 08:28:07 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BFFABBB7FED for ; Fri, 12 Aug 2016 08:28:07 +0000 (UTC) (envelope-from Christian.Hoyer-Reuther@cac-chem.de) Received: from mail.cac-chem.de (mail.cac-chem.de [213.187.69.85]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "mail.cac-chem.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7CDAB11F1 for ; Fri, 12 Aug 2016 08:28:06 +0000 (UTC) (envelope-from Christian.Hoyer-Reuther@cac-chem.de) Received: from mh01.cac.loc (mh01.lc-intern.org [172.30.77.47]) by mail.cac-chem.de (Postfix) with ESMTP id 307CE3042FB; Fri, 12 Aug 2016 10:28:04 +0200 (CEST) Received: from mh01.cac.loc (localhost [127.0.0.1]) by mh01.cac.loc (Postfix) with ESMTP id 17C72380AC; Fri, 12 Aug 2016 10:28:04 +0200 (CEST) X-Virus-Scanner: This message was checked by ESET Mail Security for Linux/BSD. For more information on ESET Mail Security, please, visit our website: http://www.eset.com/. Received: from EX1.cac.loc (ex1.cac.loc [172.30.77.30]) by mh01.cac.loc (Postfix) with ESMTP id 0E38F380A2; Fri, 12 Aug 2016 10:28:04 +0200 (CEST) Received: from EX1.cac.loc ([172.30.77.30]) by ex1 ([172.30.77.30]) with mapi; Fri, 12 Aug 2016 10:28:03 +0200 From: "Hoyer-Reuther, Christian" To: =?iso-8859-1?Q?Roger_Pau_Monn=E9?= CC: Wei Liu , "freebsd-xen@freebsd.org" Date: Fri, 12 Aug 2016 10:28:02 +0200 Subject: Re: 'Live' Migrate messes up NTP on FreeBSD domU - any suggestions? Thread-Topic: 'Live' Migrate messes up NTP on FreeBSD domU - any suggestions? Thread-Index: AdH0b7iMKQldAFdbRxGEjmXOIpCnBAAAzSpw Message-ID: <41E487BC91654544B2B8F31096F2D9D4D15164960C@ex1> References: <20160714103016.4hgfzsjgkkgtkkgg@mac> <41E487BC91654544B2B8F31096F2D9D4D1514D1E88@ex1> <20160720093111.mpmp27wol7j3ge3d@mac> <41E487BC91654544B2B8F31096F2D9D4D1516490E9@ex1> <20160722115542.dopzb63dgkilqall@mac> <20160725144314.yhggviqhsqzgux2w@mac> <20160725153714.GW27082@citrix.com> <20160729082905.46js7o3zp6iwuibd@mac> <41E487BC91654544B2B8F31096F2D9D4D1516495CA@ex1> <20160812080103.s77fxs6jitl2itry@mac> In-Reply-To: <20160812080103.s77fxs6jitl2itry@mac> Accept-Language: de-DE Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: de-DE Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-EsetResult: clean X-ESET-AS: R=OK; S=0; OP=CALC; TIME=1470990484; VERSION=4144; MFE-VER=46; MC=2833403615; TRN=0 X-I-ESET-AS: RN=0;RNP= X-ESET-Antispam: OK X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Aug 2016 08:28:07 -0000 Hello, > -----Original Message----- > From: Roger Pau Monn=E9 [mailto:roger.pau@citrix.com] > Sent: Friday, August 12, 2016 10:01 AM > To: Hoyer-Reuther, Christian > Cc: Wei Liu; freebsd-xen@freebsd.org > Subject: Re: 'Live' Migrate messes up NTP on FreeBSD domU - any suggestio= ns? >=20 > On Thu, Aug 11, 2016 at 02:29:10PM +0200, Hoyer-Reuther, Christian wrote: > > Hello, > > > > sorry for the late response, but now I'm back from vacation and did som= e > new tests. > > > > I installed a new VM using the FreeBSD-11.0-ALPHA6-amd64-20160701-r3023= 03- > disc1.iso, then updated to HEAD r303908 and installed xe-guest-utilities- > 6.2.0_2 from HEAD ports r420055. Xenguest_enable=3D"YES" is set in > /etc/rc.conf. > > > > I tested VM migration from XenCenter (XenMotion). > > > > There are no more time issues after migration. > > > > I did 4 migrations and at 2 migrations I noticed the following problems= : > > > > When the migration finishes then the VM console switches to the VGA BIO= S > screen (Plex86/Bochs VGABios ...), the VM console freezes, the VM is not > reachable over network and in XenCenter I see the first 2 CPU's raising u= p > to 100 percent. Screenshots attached. >=20 > Hm, not sure what's going on there, and why you seem to be the only one t= o > hit this issue. Are you maybe booting with boot_verbose=3D"YES"? >=20 > > Then after 10 minutes the CPU usage goes down, the VM console is > responsive again and the machine is reachable over network. >=20 > Hm, could you give a try to 11.0-RC1 when it comes out? It should be out > today or tomorrow (builds are already underway). >=20 > Roger. No, I'm not booting with boot_verbose=3D"YES". I will give 11.0-RC1 a try when it is available. Regards, Christian