From owner-freebsd-virtualization@freebsd.org Fri Jan 20 18:05:29 2017 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C04EDCB9649; Fri, 20 Jan 2017 18:05:29 +0000 (UTC) (envelope-from fbstable@cps-intl.org) Received: from mailer.parlicentre.org (mailer.parlicentre.org [199.48.132.166]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9F61A1B26; Fri, 20 Jan 2017 18:05:29 +0000 (UTC) (envelope-from fbstable@cps-intl.org) To: The Doctor , "Andrey V. Elsukov" References: <7c06aea6-0b10-e9c0-d750-f42d4a406258@cps-intl.org> <20170120164306.GA53685@doctor.nl2k.ab.ca> Cc: freebsd-xen@freebsd.org, "freebsd-stable@freebsd.org" , freebsd-virtualization@freebsd.org From: SK Message-ID: Date: Fri, 20 Jan 2017 17:36:37 +0000 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 MIME-Version: 1.0 In-Reply-To: <20170120164306.GA53685@doctor.nl2k.ab.ca> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-SA-Exim-Mail-From: fbstable@cps-intl.org X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mailer.parlicentre.org X-Spam-Level: X-Spam-Status: No, score=-4.1 required=5.0 tests=ALL_TRUSTED,RP_MATCHES_RCVD autolearn=unavailable autolearn_force=no version=3.4.1 Subject: Re: FreeBSD 11 Stable on a Xen :: bridge0 crashing server X-SA-Exim-Version: 4.2 X-SA-Exim-Scanned: Yes (on mailer.parlicentre.org) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jan 2017 18:05:29 -0000 On 20/01/2017 16:43, The Doctor wrote: > On Fri, Jan 20, 2017 at 07:20:15PM +0300, Andrey V. Elsukov wrote: >> On 20.01.2017 18:57, Trond Endrest??l wrote: >>>> Here is the situation: >>>> I have a VPS server from a well reputed provider (and they deserve the >>>> reputation), running FreeBSD 11 stable x64 under Xen Full Virtualization >>>> (HVM). I have the xn0 interface which is working fine. I intend to use VIMAGE, >>>> so I compiled the kernel, added cloned_interface="bridge0" and restarted the >>>> server. But as soon as I am attaching the xn0 to bridge0, the kernel is >>>> panicking and the server restarting. >>>> Any suggestion/pointer/test-instruction is highly appreciated. >>> The code crashes at line 427 of sys/netinet/if_ether.c: >>> >>> ARPSTAT_INC(txrequests); >>> >>> See >>> https://svnweb.freebsd.org/base/stable/11/sys/netinet/if_ether.c?view=annotate#l427 >>> >>> stable/11 has problems accounting the outgoing octets of any xn >>> interface, although this isn't connected to your case. >>> >>> Just to rule out any uncertainty, try this patch: >>> >>> https://svnweb.freebsd.org/base?view=revision&revision=308126 >>> >>> See PR 213439, >>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=213439 >>> >>> Note, I'm not a developer nor a committer, just a humble sysadmin. >> This problem is unrelated. ARP statistics is global and isn't related to >> some specific interface. IMHO, the kernel panics due to missing VNET >> context. As I see from the code in sys/dev/xen, it is not capable with >> VIMAGE. >> >> -- >> WBR, Andrey V. Elsukov > Still we need to address this issue! > > Even here in FreeBSD-11 stable I see crashing > of the bhyve. > > What I need to help you is what is needed for running gdb ../bhyve ../bhyve.core > Apologies, but I might be missing something here. I am not trying to run bhyve, bhyve is not crashing. FreeBSD 11 in my case (FreeBSD testBox.test.domain 11.0-STABLE FreeBSD 11.0-STABLE #0 r312349: Fri Jan 20 12:29:17 GMT 2017 root@testBox.test.domain:/usr/obj/usr/src/sys/vnet-test amd64) is running on a Xen HVM, and as I am trying to attach bridge0 to any interface (either xn0, or epair0a, or so on), the server is crashing and rebooting. I had the line ifconfig_bridge0="addm xn0 addm epair0a up" on the /etc/rc.conf , and the server went into an infinite crash-reboot loop. What I would like to have, if possible, is running FreeBSD 11 stable on the server, use vnet/vimage for my jails so I can isolate each of them from one another. Currently I am building world with the patch suggested by Trond (started that before I read the mail from Andrey). But if that is unlikely to bring a solution, that would mean most people on VPS with jails that are using Xen are going to suffer from any upgrade to 11 (or having new servers running 11) -- which is definitely undesirable. If anyone would like me to run further test on the box, please let me know what you'd like me to run, and I can come back with the response. Having a reliable/stable solution is the objective from my end. Thanks to all for your suggestions/comments. Regards SK