From owner-freebsd-xen@freebsd.org Mon Jun 6 15:08:16 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F07FB6D2AB for ; Mon, 6 Jun 2016 15:08:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F398D1E29 for ; Mon, 6 Jun 2016 15:08:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u56F8Fni007460 for ; Mon, 6 Jun 2016 15:08:15 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Mon, 06 Jun 2016 15:08:16 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Jun 2016 15:08:16 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #14 from Roger Pau Monn=C3=83=C2=A9 --- Hello, I've recently committed a bunch of netfront fixes that I think should help solve this issue. ATM, the only reliable way to do packet forwarding on a FreeBSD DomU is to disable all the hardware offload features on both nics (rxcsum, txcsum, tso and lro). Could someone give it a try? I'm also working on making forwarding work _without_ having to disable all those features, so that we can get optimal performance, however those patch= es have not yet been reviewed: https://reviews.freebsd.org/D6656 https://reviews.freebsd.org/D6612 https://reviews.freebsd.org/D6612 Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Mon Jun 6 18:36:30 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D8EFAB6DF31 for ; Mon, 6 Jun 2016 18:36:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C942519C2 for ; Mon, 6 Jun 2016 18:36:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u56IaUgN042633 for ; Mon, 6 Jun 2016 18:36:30 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Mon, 06 Jun 2016 18:36:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: meyer.sydney@gmail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Jun 2016 18:36:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #15 from Sydney Meyer --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #14) Hello Roger, https://reviews.freebsd.org/D6656 https://reviews.freebsd.org/D6612 https://reviews.freebsd.org/D6612 is this a typo or are there actually three patches? Sydney --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Jun 7 07:17:45 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 69B5FB6DB63 for ; Tue, 7 Jun 2016 07:17:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 59C9919A3 for ; Tue, 7 Jun 2016 07:17:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u577Hi3l068744 for ; Tue, 7 Jun 2016 07:17:45 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Tue, 07 Jun 2016 07:17:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jun 2016 07:17:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #16 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to Sydney Meyer from comment #15) Hello, To clarify this, the current code in HEAD should work when doing packet forwarding if rxcsum, txcsum, tso and lro are disabled. Then, the 3 patches that you mention should allow packet forwarding to work _without_ disabling those features, and yes, you need all 3. Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Jun 7 13:15:00 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A3CD3B6DE70 for ; Tue, 7 Jun 2016 13:15:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 944281A3D for ; Tue, 7 Jun 2016 13:15:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u57DF0ZI026814 for ; Tue, 7 Jun 2016 13:15:00 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Tue, 07 Jun 2016 13:15:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kpielorz@tdx.co.uk X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jun 2016 13:15:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #17 from kpielorz@tdx.co.uk --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #16) Hi, I've tested these patches now. I installed a HEAD snapshot, and updated it = to r301543M. The VM can route traffic with '-rxcsum -txcsum -tso -lro' applied to xn0 / = xn1. I applied the patches - rebuilt / installed the kernel / rebooted and sadly= it still cannot forward traffic - unless I again set the above ifconfig option= s on both interfaces. The patches only affect the kernel right - I don't need to buildworld again? Cheers, -Karl --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Jun 7 18:40:41 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DCFAAB6E5F1 for ; Tue, 7 Jun 2016 18:40:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CD74A1F40 for ; Tue, 7 Jun 2016 18:40:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u57IednW004772 for ; Tue, 7 Jun 2016 18:40:41 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Tue, 07 Jun 2016 18:40:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: meyer.sydney@gmail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Jun 2016 18:40:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #18 from Sydney Meyer --- I don't know if i missed something, but i see only two diffs on phabricator, D6656 and D6612, where the last one is linked two times. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Jun 8 07:16:00 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3FAFCB6E319 for ; Wed, 8 Jun 2016 07:16:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 301B71C69 for ; Wed, 8 Jun 2016 07:16:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u587FwxN055170 for ; Wed, 8 Jun 2016 07:16:00 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Wed, 08 Jun 2016 07:15:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 07:16:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #19 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to Sydney Meyer from comment #18) Sorry, I've failed to post the three links, and the also failed to understa= nd what you were trying to tell me. Here are the proper links: https://reviews.freebsd.org/D6611 https://reviews.freebsd.org/D6612 https://reviews.freebsd.org/D6656 Karl, could you please try again with all three patches applied? (a buildwo= rld is indeed not needed, only the kernel needs to be updated). Thanks, Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Jun 8 11:01:59 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0A60B6FFFA for ; Wed, 8 Jun 2016 11:01:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E129A1658 for ; Wed, 8 Jun 2016 11:01:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u58B1x2R023430 for ; Wed, 8 Jun 2016 11:01:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Wed, 08 Jun 2016 11:02:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kpielorz@tdx.co.uk X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 11:02:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #20 from kpielorz@tdx.co.uk --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #19) Hi, I applied the previously missing d6611 patch (so I have d6611, d6612, d6656 applied) - but it still doesn't work :( If I live migrate the test VM router FreeBSD domU to another node in the po= ol - it starts working. Migrate it back to the same node as the VM's I'm using to test traffic thro= ugh it - and it fails again. As before I can 'ping' through the FreeBSD VM domU - and 'telnet test-websi= te 80' through it connects - but either manually requesting a page, or using 'fetch' - just hangs / fails as before (if the other VM is on the same node= ). I can get tcpdumps and stuff (or anything else you need) if you let me know, -Karl --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Jun 8 11:22:09 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6DB7DB6F755 for ; Wed, 8 Jun 2016 11:22:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5DF60118D for ; Wed, 8 Jun 2016 11:22:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u58BM8X1069896 for ; Wed, 8 Jun 2016 11:22:09 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Wed, 08 Jun 2016 11:22:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 11:22:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #21 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to kpielorz from comment #20) Yes, I think I know what the issue is. What OS are the other DomUs on the s= ame host using? If you can provide me with complete tcpdump traces on both interfaces (xn0/xn1), that would help me quite a lot, the following rune should get you the traces: # tcpdump -n -i -s0 -w .pcap The resulting pcap files are going to be quite big, so you will probably ha= ve to upload them somewhere. Just 10s of capture while trying to route traffic= is probably fine. Thanks, Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Jun 8 12:48:11 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F0ACCB6E5C2 for ; Wed, 8 Jun 2016 12:48:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E105D1828 for ; Wed, 8 Jun 2016 12:48:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u58CmBWT013157 for ; Wed, 8 Jun 2016 12:48:11 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Wed, 08 Jun 2016 12:48:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kpielorz@tdx.co.uk X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 12:48:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #22 from kpielorz@tdx.co.uk --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #21) Hi, pcaps are at (for a short time) http://www.pielorz.com/xn_pcaps.tar.gz These are xn0.pcap.san and xn1.pcap.san ('.san' because I sanitised them to remove local LAN/switch chatter etc.) This shows a Windows 7 host on the same XenServer node trying to get to 'news.bbc.co.uk' in Internet Explorer via the FreeBSD domU. When testing I tried: Windows 7 <--> FreeBSD Current w/patches <--> Internet and, FreeBSD 10.3-R p3 <--> FreeBSD Current w/patches <--> Internet In both cases moving the FreeBSD Current domU off of the same XenServer node (to a different one in the pool) it works, but not if all the domU's are on= the same XenServer node [i.e. as before]. If you need anything else, let me know, -Karl --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Jun 8 13:11:35 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8203DB6F040 for ; Wed, 8 Jun 2016 13:11:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 727E1188C for ; Wed, 8 Jun 2016 13:11:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u58DBZD9097056 for ; Wed, 8 Jun 2016 13:11:35 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Wed, 08 Jun 2016 13:11:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 13:11:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #23 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to kpielorz from comment #22) Thanks for the traces, I will try to prepare a debug patch for you either t= his afternoon or tomorrow morning. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Jun 8 22:18:17 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5DA37B70DAB for ; Wed, 8 Jun 2016 22:18:17 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id ECDFD11D5; Wed, 8 Jun 2016 22:18:13 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u58MIAKs065098 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 8 Jun 2016 22:18:11 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u58MI9X1065095; Wed, 8 Jun 2016 22:18:10 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Wed, 8 Jun 2016 22:18:09 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virt@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7 and blkback changes In-Reply-To: <20160603120921.y5l362zgrhf4fdcb@mac> Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=ISO-8859-15 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 22:18:17 -0000 On Fri, 3 Jun 2016, Roger Pau Monné wrote: > Hello, > > First of all, this message is only relevant to those that use FreeBSD as > Dom0 (host), not as a DomU (guest), so don't panic. > > I've imported the latest Xen version (4.7-rc4) into the ports tree, it's > still not the final version, but it's quite close, so we better start > testing it to make sure it works fine with FreeBSD. Thank you Roger, this is excellent. Are xen-tools-devel 4.5 now? Looks confusing. I have also tried building xen-tools (4.7) without python and qemu configure reported this. Also got this: ===> Registering installation for xen-tools-4.7.0 (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/python2.7/site-packages/xen/lowlevel/xc.so - required shared library libxenctrl.so.4.5 not found (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/python2.7/site-packages/xen/lowlevel/xc.so - required shared library libxenguest.so.4.5 not found (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/xen/bin/qemu-system-i386 - required shared library libxenctrl.so.4.5 not found (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/xen/bin/qemu-system-i386 - required shared library libxenguest.so.4.5 not found Installing xen-tools-4.7.0... Adding Python manually and rebuilding seems to fix those issues. It seems to work, I only wish we've had ports from https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192012 committed... Marcin From owner-freebsd-xen@freebsd.org Wed Jun 8 22:35:25 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7362FB6F3BA; Wed, 8 Jun 2016 22:35:25 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id F03891080; Wed, 8 Jun 2016 22:35:24 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u58MZMq9065253 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Wed, 8 Jun 2016 22:35:22 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u58MZMpT065250; Wed, 8 Jun 2016 22:35:22 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Wed, 8 Jun 2016 22:35:22 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, freebsd-virtualization@freebsd.org, xen-devel@lists.xenproject.org Subject: Re: HEADS UP: Imported Xen 4.7 and blkback changes - domU respawning on_crash In-Reply-To: Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=iso-8859-15 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 22:35:25 -0000 On Wed, 8 Jun 2016, Marcin Cieslak wrote: > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > Hello, > > > > First of all, this message is only relevant to those that use FreeBSD as > > Dom0 (host), not as a DomU (guest), so don't panic. > > > > I've imported the latest Xen version (4.7-rc4) into the ports tree, it's > > still not the final version, but it's quite close, so we better start > > testing it to make sure it works fine with FreeBSD. One issue maybe unrelated to FreeBSD: This domain: builder = "hvm" memory = 4096 vcpus = 2 name = "Windows2016" disk = [ '/dev/zvol/zroot/windows0,raw,hda,w', '/dev/zvol/zroot/vs2013,raw,hdb,w', # '/root/win/install.iso,raw,hdc:cdrom,r' ] boot = "c" # Boot to hard disk image vnc = 2 #vnclisten = "0.0.0.0" usbdevice = 'tablet' on_poweroff = 'destroy' on_reboot = 'restart' on_crash = 'restart' acpi = 1 bios = 'ovmf' vif = [ 'bridge=bridge0,mac=00:16:3e:5d:0d:48' ] videoram=16 vga = "stdvga" crashes because I didn't have ovmf image: (d203) HVM Loader (d203) Detected Xen v4.7.0-rc (d203) Xenbus rings @0xfeffc000, event channel 1 (d203) Unknown BIOS ovmf, no ROM image found (d203) *** HVMLoader bug at hvmloader.c:229 (d203) *** HVMLoader crashed. But I seem unable to kill it with "xl destroy" - it keeps respawning again: Windows2016 211 4079 1 --p--- 0.0 Windows2016 213 4096 1 --psc- 0.0 (disappears) Windows2016 221 4096 1 --psc- 0.0 (null) 221 147 1 --psc- 0.0 ... ... I have finally managed to snatch it by issuing this a few times, after changing the "on_crash" to 'destroy': # xl config-update Windows2016 xen/windows-run.cfg WARNING: xl now has better capability to manage domain configuration, avoid using this command when possible setting dom243 configuration Marcin From owner-freebsd-xen@freebsd.org Wed Jun 8 22:37:55 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 69486B6F534 for ; Wed, 8 Jun 2016 22:37:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5794212FE for ; Wed, 8 Jun 2016 22:37:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u58Mbt4G070339 for ; Wed, 8 Jun 2016 22:37:55 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Wed, 08 Jun 2016 22:37:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: meyer.sydney@gmail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jun 2016 22:37:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #24 from Sydney Meyer --- FWIW, i have applied the three patches to r301515M and on a dom0 running Xen 4.4.1 with Linux 4.5.1, and a Xen 4.5.3 / NetBSD 7.0.1 host i was able to p= ing, connect via ssh, scp a file and nc some data between two FreeBSD VMs connec= ted trough a third VM, all running this revision, on the same Linux, respective NetBSD dom0 host. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Thu Jun 9 00:17:02 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4E2AB703D3; Thu, 9 Jun 2016 00:17:02 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5E4B21D6D; Thu, 9 Jun 2016 00:17:02 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u590H0UT065998 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 9 Jun 2016 00:17:00 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u590Gxd7065995; Thu, 9 Jun 2016 00:16:59 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Thu, 9 Jun 2016 00:16:59 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7: no blkback In-Reply-To: <20160603120921.y5l362zgrhf4fdcb@mac> Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=ISO-8859-15 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 00:17:02 -0000 On Fri, 3 Jun 2016, Roger Pau Monné wrote: > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > block hotplug scripts. This means that we now have the option to use > backends different than simple block or regular files, provided that someone > writes the proper hotplug scripts to attach them (I've heard there are some > iSCSI hotplug scripts around). This however requires changes in blkback, so > if you plan to use the Xen 4.7 port, please make sure that you are running a > kernel that contains revision r301269 (or any later version). The same also I am running it with r301685 and the HVM guests have some trouble with block devices. SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD from, after chaging to "hda" I get up to the kernel mountroot prompt (Xen block devices seem to be detected in dmesg). What used to be Windows 2016 domU with /dev/zvol/zroot/windows0,raw,hda,w ends up in the Tianocore UEFI shell. Block devices seem to be available, I can even list the fs0: partition, but no booting further possible. Marcin # more freebsd.cfg builder = "hvm" name = "FreeBSD" disk = [ '/dev/zvol/zroot/freebsd1,raw,xvda,w', '/dev/zvol/zroot/freebsd2,raw,xvdb,w' ] boot = "c" #usbdevice = 'tablet' #nographics = 1 serial = [ "file:/tmp/boot.log" ] vnc = 1 #vnclisten = '0.0.0.0' vif = ['bridge=bridge0,mac=00:02:04:08:fd:f0'] memory=2048 vcpus=1 vga = "cirrus" videoram = 16 # more windows-run.cfg builder = "hvm" memory = 4096 vcpus = 2 name = "Windows2016" disk = [ '/dev/zvol/zroot/windows0,raw,hda,w', '/dev/zvol/zroot/vs2013,raw,hdb,w', # '/root/win/install.iso,raw,hdc:cdrom,r' ] boot = "c" # Boot to hard disk image vnc = 2 #vnclisten = "0.0.0.0" usbdevice = 'tablet' on_poweroff = 'destroy' on_reboot = 'restart' #on_crash = 'restart' on_crash = 'destroy' acpi = 1 bios = 'ovmf' vif = [ 'bridge=bridge0,mac=00:16:3e:5d:0d:48' ] videoram=16 vga = "stdvga" From owner-freebsd-xen@freebsd.org Thu Jun 9 07:40:29 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 616BAAC89C6 for ; Thu, 9 Jun 2016 07:40:29 +0000 (UTC) (envelope-from royger@gmail.com) Received: from mail-wm0-x231.google.com (mail-wm0-x231.google.com [IPv6:2a00:1450:400c:c09::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E77981717 for ; Thu, 9 Jun 2016 07:40:28 +0000 (UTC) (envelope-from royger@gmail.com) Received: by mail-wm0-x231.google.com with SMTP id k184so20996558wme.1; Thu, 09 Jun 2016 00:40:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=sH3BZmcFw4pjods6fsP3KfUUC+99yXKqA9TQmLvZ1Sw=; b=ruisvFMEQVlAp/NW0qj8a2Zj47fm84OkEzRbUpdOJUaO8rJ9hwDb1rMBfmAQbXDBGg eTD1chIt2mLjJ3sN5Nzyq082xXwGyKy8LKjzSoV4xcTdBKag2IGQsvFlBLzY8NekIYjf fUICGL/sSAmL8uif8PHhVTDo+T8vvvGHeeToKAe2BcSoJ9XhJ3aM1fUo3T6OPiAYVy2w WLu59Py6KK/cPIB+D6yu8k1eeHutJg0PliO9TkkZvN8h6a/rDHQRug88hBqlX5A3VjcX oaOAxhrnxZwEt9SiUv5MJghK2Snucjdvy5ER4AypJI11fUGLr5Rd6Q58SapgceoGWSY/ 7o1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=sH3BZmcFw4pjods6fsP3KfUUC+99yXKqA9TQmLvZ1Sw=; b=Wi/IAUEzVbYA35QrwgRStPL0NbqUjlkdWCPjIfzXoIiAgF4E+uZ9fohYAdCIDX9b2p ZMS+8xD6lOtviRSUhRCnqvFeBgb5RvelCFwEMLDq7EsbbFzzQFmr6x1/YHoXPZYilDQx R4CjzEOMiMeVLRTmJ8MFhWXp7HG15jkObQ6NcF9ApYorLlPDeJpNNpS+MlY6qa3Duxu1 JoarXkzBmvddsF9nvpDkAUg8hb+0WfHHlAAuhMa0dANHu3dCtz299rBR8hMwWCZ35ARW lNq6Y1K9NWDb1B9wsHiDoDMRgFzspHTgG+p8ApAZliEaBbXipj+T8czWiNCFMzDPxxaF jpFA== X-Gm-Message-State: ALyK8tK++wxsI8LS55z2WgW+jfvmUZEywWqepFady5HyLAZbDLVCoDOYctCgaZsC0kMBzQ== X-Received: by 10.28.136.200 with SMTP id k191mr11211343wmd.57.1465458026458; Thu, 09 Jun 2016 00:40:26 -0700 (PDT) Received: from localhost (220.red-79-152-208.dynamicip.rima-tde.net. [79.152.208.220]) by smtp.gmail.com with ESMTPSA id xw8sm5548258wjb.30.2016.06.09.00.40.25 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 09 Jun 2016 00:40:25 -0700 (PDT) Sender: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Date: Thu, 9 Jun 2016 09:40:21 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Marcin Cieslak Cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virt@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7 and blkback changes Message-ID: <20160609074021.uqtjio2vn7wo5h4m@mac> References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.6.0-neo (2016-04-07) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 07:40:29 -0000 On Wed, Jun 08, 2016 at 10:18:09PM +0000, Marcin Cieslak wrote: > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > Hello, > > > > First of all, this message is only relevant to those that use FreeBSD as > > Dom0 (host), not as a DomU (guest), so don't panic. > > > > I've imported the latest Xen version (4.7-rc4) into the ports tree, it's > > still not the final version, but it's quite close, so we better start > > testing it to make sure it works fine with FreeBSD. > > Thank you Roger, this is excellent. Are xen-tools-devel 4.5 now? > Looks confusing. > > I have also tried building xen-tools (4.7) without python > and qemu configure reported this. Python is required, you cannot get rid of it. > Also got this: > > ===> Registering installation for xen-tools-4.7.0 > (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/python2.7/site-packages/xen/lowlevel/xc.so - required shared library libxenctrl.so.4.5 not found > (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/python2.7/site-packages/xen/lowlevel/xc.so - required shared library libxenguest.so.4.5 not found > (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/xen/bin/qemu-system-i386 - required shared library libxenctrl.so.4.5 not found > (xen-tools-4.7.0) /usr/ports/sysutils/xen-tools/work/stage//usr/local/lib/xen/bin/qemu-system-i386 - required shared library libxenguest.so.4.5 not found > Installing xen-tools-4.7.0... > > Adding Python manually and rebuilding seems to fix those issues. AFAICT, this is caused by compiling the new xen-tools-4.7 port while still having the xen-tools-4.5 port installed. Due to the ports build environment the first path searched for libraries is /usr/local/lib instead of the one passed on the command line by the Xen build system. > It seems to work, I only wish we've had ports from https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192012 committed... My plate is completely full right now, so I cannot really pick this up. However if you manage to get the ports committed I should be able to add them to the xen-tools package. Roger. From owner-freebsd-xen@freebsd.org Thu Jun 9 07:44:33 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0F54BADC07D; Thu, 9 Jun 2016 07:44:33 +0000 (UTC) (envelope-from royger@gmail.com) Received: from mail-wm0-x230.google.com (mail-wm0-x230.google.com [IPv6:2a00:1450:400c:c09::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 994991B96; Thu, 9 Jun 2016 07:44:32 +0000 (UTC) (envelope-from royger@gmail.com) Received: by mail-wm0-x230.google.com with SMTP id k204so47699619wmk.0; Thu, 09 Jun 2016 00:44:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=QwO/iVi955J6ZFFb3I8jauzwxIK2qnuOIm0qRljetlY=; b=wcy90EUzuOoXDHPuwz/zQTXwE8sba0q6T3+p/dwpyI9Lxr2zBKylvMNvCwaUahcCwG AGiPA8kK5Vehxaeu/Py8ucYH+Ba758uy4Yr13sRlG9V0NQ17hh724SuYMmBk36Rr0BlZ /G/sXGmdB3VcrOIHHv0Dn76/ILTceB3Fa6Wv5vcdYCSAfQWK72VrDi3vG0koXruTLLI4 CA9DNyB0sSnygko9iaPrDdoEzBotbDwXWP++KNiUkdxt+AKw0HhtNDC9a8N9dX3qdZvn h05FWOkvbjEgKy+Zn4rcaY2rJ2vQUac0A6reQPR2s2CNUjMGJJ6gkgKyOffhdtPL3zGi qskA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=QwO/iVi955J6ZFFb3I8jauzwxIK2qnuOIm0qRljetlY=; b=Kf7N8IcV4CfyTR4Dm8Q10imassEzhBJM6ubR15GXWFgFtdfV/QYhRfRL+Mh1pGZ/lO Ng7hGjbDbFlZx9hl7nUaxQ+Uj6RhkzYkAqBsd6rsuT6pOG/TNeuQzZoYz65xtNgwEAGR 5YvetY/71v/OcD3yYL1VFSLwJ5e63xvCkmIrXpUYVAOMSKzY5Ehx/xi+WqDMGcvMmxaD XOX4HAMj6Lqpgopt1DHCWd/yC637GLBmXJqnN/sDjsfGE3OJL67ceMg7Q18pYs/814jR 8lIwoeE+G6Q0OYqxWWI4ieqk+HvNtNUBXFWZHaPVQwRVroaHpnLuaLZ7YtsY5FUAkaLd /p8w== X-Gm-Message-State: ALyK8tJyquJHtzvNcCiClXl6vJMGYfVCwjx+/lejuZ7+Ww0TlKFZgO07KgJjrXSnp6CEIA== X-Received: by 10.194.163.166 with SMTP id yj6mr8163383wjb.116.1465458271003; Thu, 09 Jun 2016 00:44:31 -0700 (PDT) Received: from localhost (220.red-79-152-208.dynamicip.rima-tde.net. [79.152.208.220]) by smtp.gmail.com with ESMTPSA id c4sm5533606wjb.38.2016.06.09.00.44.29 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 09 Jun 2016 00:44:30 -0700 (PDT) Sender: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Date: Thu, 9 Jun 2016 09:44:25 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Marcin Cieslak Cc: freebsd-xen@FreeBSD.org, freebsd-virtualization@freebsd.org, xen-devel@lists.xenproject.org Subject: Re: HEADS UP: Imported Xen 4.7 and blkback changes - domU respawning on_crash Message-ID: <20160609074425.dqstpupeqb7yueus@mac> References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.6.0-neo (2016-04-07) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 07:44:33 -0000 On Wed, Jun 08, 2016 at 10:35:22PM +0000, Marcin Cieslak wrote: > On Wed, 8 Jun 2016, Marcin Cieslak wrote: > > > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > > > Hello, > > > > > > First of all, this message is only relevant to those that use FreeBSD as > > > Dom0 (host), not as a DomU (guest), so don't panic. > > > > > > I've imported the latest Xen version (4.7-rc4) into the ports tree, it's > > > still not the final version, but it's quite close, so we better start > > > testing it to make sure it works fine with FreeBSD. > > One issue maybe unrelated to FreeBSD: > > This domain: > > builder = "hvm" > memory = 4096 > vcpus = 2 > name = "Windows2016" > disk = [ > '/dev/zvol/zroot/windows0,raw,hda,w', > '/dev/zvol/zroot/vs2013,raw,hdb,w', > # '/root/win/install.iso,raw,hdc:cdrom,r' > ] > boot = "c" # Boot to hard disk image > vnc = 2 > #vnclisten = "0.0.0.0" > usbdevice = 'tablet' > on_poweroff = 'destroy' > on_reboot = 'restart' > on_crash = 'restart' > acpi = 1 > bios = 'ovmf' > vif = [ 'bridge=bridge0,mac=00:16:3e:5d:0d:48' ] > videoram=16 > vga = "stdvga" > > crashes because I didn't have ovmf image: > > (d203) HVM Loader > (d203) Detected Xen v4.7.0-rc > (d203) Xenbus rings @0xfeffc000, event channel 1 > (d203) Unknown BIOS ovmf, no ROM image found > (d203) *** HVMLoader bug at hvmloader.c:229 > (d203) *** HVMLoader crashed. > > But I seem unable to kill it with "xl destroy" - it keeps > respawning again: > > Windows2016 211 4079 1 --p--- 0.0 > Windows2016 213 4096 1 --psc- 0.0 > (disappears) > Windows2016 221 4096 1 --psc- 0.0 > (null) 221 147 1 --psc- 0.0 > ... > ... > > I have finally managed to snatch it by issuing this a few times, after > changing the "on_crash" to 'destroy': > > # xl config-update Windows2016 xen/windows-run.cfg > WARNING: xl now has better capability to manage domain configuration, avoid using this command when possible > setting dom243 configuration The problem is that the domain crashed so early on boot that you weren't able to destroy it, and kept rebooting due to the "on_crash = 'restart'" option. IIRC I've also used the following hacky rune in order to terminate this kind of domains: "while [ 1 ]; do xl destroy ; done", but your solution seems better. Roger. From owner-freebsd-xen@freebsd.org Thu Jun 9 08:03:50 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F4000ADC8AA; Thu, 9 Jun 2016 08:03:49 +0000 (UTC) (envelope-from royger@gmail.com) Received: from mail-wm0-x22a.google.com (mail-wm0-x22a.google.com [IPv6:2a00:1450:400c:c09::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8048614D3; Thu, 9 Jun 2016 08:03:49 +0000 (UTC) (envelope-from royger@gmail.com) Received: by mail-wm0-x22a.google.com with SMTP id n184so213160220wmn.1; Thu, 09 Jun 2016 01:03:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=TgyMnnpyBccEzZw7NvLMgvDhsq5p9pnmaBhETU0o0pc=; b=a2XlvuMG8M7fWbC4FP0/vDgSx8C/6QuyIvP/rxMlvNB4Se83k6ICHmZidtoIjQKDPs SJ+eXFTRph2W7HvvgV7zNbBYh2EdVtPPrtl747kQ4ZgyWQI0wgApdGGwtuV4RxKu+awQ neUoKgy4oCnnOLN1cznI0R156WAdulmCfXumaYAc89JeYVHA539Ub9cSP3L70lZA9nim 2TYLEpr7VcS20d3M7YpMviJWYQqNQzHIPv9Uvp0EXDyApkVfpzoUjICemyeKWRvijjt0 VVRvq4bTW3IRyZyeMGks6MDozbeR1RFxjGZ/k7w3x+/LuzGSjg8xTagHYXYItFDH9LF+ 3INw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=TgyMnnpyBccEzZw7NvLMgvDhsq5p9pnmaBhETU0o0pc=; b=LPaE31/5e5R3pPHxvplQkdTels/k6UqmV24EajY55NuowuOnxc1EzTEmE/VTXpgjMr lIT2IvjzZjEao8WMRowYe4B4AhRLe33lQIbrSxVznIdzvrYV33QJTbcBGjxgpNz7/sro Cl9GWQJNcqd0xV9lPmtdV1xao25zccmC1JyZreI+5ZXcEq1LCFngFahEpO7Ug3QIBqL9 p9hpDEP3k3twhC9XkFf1+EsAvRCPEsWzm8O/ke5EBziIhj0BlXp8h7R/VWzru+3gT0N5 PVwfa4mFVKl190lVm1nJ9Nv0gxfqvGZWFXGkb4BAFgdvXcViX8C+zN+lo3TF3BaSZp8Q 2kIQ== X-Gm-Message-State: ALyK8tIfhZb8Fs9Je5WfKRQ3zF5kNP4n7v4WtfHY9amxSXV1AFaqKC+QWPnkpuo4Ma3TBA== X-Received: by 10.28.43.129 with SMTP id r123mr11053521wmr.99.1465459427854; Thu, 09 Jun 2016 01:03:47 -0700 (PDT) Received: from localhost (220.red-79-152-208.dynamicip.rima-tde.net. [79.152.208.220]) by smtp.gmail.com with ESMTPSA id r16sm15367248wmb.23.2016.06.09.01.03.46 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 09 Jun 2016 01:03:47 -0700 (PDT) Sender: =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Date: Thu, 9 Jun 2016 10:03:43 +0200 From: Roger Pau =?iso-8859-1?Q?Monn=E9?= To: Marcin Cieslak Cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7: no blkback Message-ID: <20160609080343.44rvpda4hskiy3ge@mac> References: <20160603120921.y5l362zgrhf4fdcb@mac> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.6.0-neo (2016-04-07) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 08:03:50 -0000 On Thu, Jun 09, 2016 at 12:16:59AM +0000, Marcin Cieslak wrote: > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > > block hotplug scripts. This means that we now have the option to use > > backends different than simple block or regular files, provided that someone > > writes the proper hotplug scripts to attach them (I've heard there are some > > iSCSI hotplug scripts around). This however requires changes in blkback, so > > if you plan to use the Xen 4.7 port, please make sure that you are running a > > kernel that contains revision r301269 (or any later version). The same also > > I am running it with r301685 and the HVM guests have some trouble with > block devices. > > SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD > from, after chaging to "hda" I get up to the kernel mountroot prompt > (Xen block devices seem to be detected in dmesg). Yes, this is intentional, see: https://marc.info/?l=xen-devel&m=144482080812353 Have you checked if you need to change your /etc/fstab to correctly point to the new device? Does FreeBSD correctly list the disk(s) at the mountroot prompt when issuing a "?" command? Also, can you paste the output of `xenstore-ls -fp` from Dom0 when this happens? > What used to be Windows 2016 domU with /dev/zvol/zroot/windows0,raw,hda,w > ends up in the Tianocore UEFI shell. Block devices seem to be available, > I can even list the fs0: partition, but no booting further possible. Hm, I've never used Tianocore myself, so I'm not sure what the issue could be here. Again, can you post the output of `xenstore-ls -fp` from Dom0 when this happens? At least this will show if the PV block device has been correctly attached. Roger. From owner-freebsd-xen@freebsd.org Thu Jun 9 09:08:32 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 91FA8AEE10B; Thu, 9 Jun 2016 09:08:32 +0000 (UTC) (envelope-from prvs=9619a384d=wei.liu2@citrix.com) Received: from SMTP.CITRIX.COM (smtp.citrix.com [66.165.176.89]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "Verizon Public SureServer CA G14-SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2F2801C83; Thu, 9 Jun 2016 09:08:31 +0000 (UTC) (envelope-from prvs=9619a384d=wei.liu2@citrix.com) X-IronPort-AV: E=Sophos;i="5.26,443,1459814400"; d="scan'208";a="359377564" Date: Thu, 9 Jun 2016 10:07:14 +0100 From: Wei Liu To: Roger Pau =?iso-8859-1?Q?Monn=E9?= CC: Marcin Cieslak , , , , "Wei Liu" Subject: Re: [Xen-devel] HEADS UP: Imported Xen 4.7: no blkback Message-ID: <20160609090714.GA24655@citrix.com> References: <20160603120921.y5l362zgrhf4fdcb@mac> <20160609080343.44rvpda4hskiy3ge@mac> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20160609080343.44rvpda4hskiy3ge@mac> User-Agent: Mutt/1.5.23 (2014-03-12) X-DLP: MIA2 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 09:08:32 -0000 On Thu, Jun 09, 2016 at 10:03:43AM +0200, Roger Pau Monné wrote: > On Thu, Jun 09, 2016 at 12:16:59AM +0000, Marcin Cieslak wrote: > > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > > > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > > > block hotplug scripts. This means that we now have the option to use > > > backends different than simple block or regular files, provided that someone > > > writes the proper hotplug scripts to attach them (I've heard there are some > > > iSCSI hotplug scripts around). This however requires changes in blkback, so > > > if you plan to use the Xen 4.7 port, please make sure that you are running a > > > kernel that contains revision r301269 (or any later version). The same also > > > > I am running it with r301685 and the HVM guests have some trouble with > > block devices. > > > > SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD > > from, after chaging to "hda" I get up to the kernel mountroot prompt > > (Xen block devices seem to be detected in dmesg). > > Yes, this is intentional, see: > > https://marc.info/?l=xen-devel&m=144482080812353 > Note that I reverted that change yesterday. 4.7 will behave as before. Wei. From owner-freebsd-xen@freebsd.org Thu Jun 9 18:35:55 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A8BE8B70248 for ; Thu, 9 Jun 2016 18:35:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 979F61990 for ; Thu, 9 Jun 2016 18:35:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u59IZsKS003565 for ; Thu, 9 Jun 2016 18:35:55 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Thu, 09 Jun 2016 18:35:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 18:35:55 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #25 from Roger Pau Monn=C3=83=C2=A9 --- Could you please apply the following patch on top of the other three and re= port the results back? It should print some messages on the console (dmesg) when doing packet forwarding. https://people.freebsd.org/~royger/fwd_debug.patch Thanks, Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Thu Jun 9 22:04:46 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E3E60B70C7A for ; Thu, 9 Jun 2016 22:04:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D3E331127 for ; Thu, 9 Jun 2016 22:04:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u59M4kcX053829 for ; Thu, 9 Jun 2016 22:04:46 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Thu, 09 Jun 2016 22:04:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: meyer.sydney@gmail.com X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jun 2016 22:04:47 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #26 from Sydney Meyer --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #25) I have applied your patch on top of the others and there seems to be no out= put related to packet forwarding, when doing the above described tests. Here's the full dmesg output: Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-ALPHA2 #0 r301752M: Thu Jun 9 23:05:34 CEST 2016 sydney@head:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. can't re-use a leaf (ixl_rx_miss_bufs)! VT(vga): text 80x25 XEN: Hypervisor version 4.4 detected. CPU: Intel(R) Core(TM) i3-4160 CPU @ 3.60GHz (3600.07-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x306c3 Family=3D0x6 Model=3D0x3c Steppi= ng=3D3 =20 Features=3D0x1783fbff =20 Features2=3D0xfffa3203 AMD Features=3D0x28100800 AMD Features2=3D0x21 Structured Extended Features=3D0x72a XSAVE Features=3D0x1 Hypervisor: Origin =3D "XenVMMXenVMM" real memory =3D 528482304 (504 MB) avail memory =3D 465608704 (444 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: random: unblocking device. ioapic0: Changing APIC ID to 1 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-47 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80f2eb70, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) cpu0: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 62500000 Hz quality 950 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0xb008-0xb00b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc400-0xc40f at device 1.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 pci0: at device 1.3 (no driver attached) xenpci0: port 0xc000-0xc0ff mem 0xf2000000-0xf2ffffff= irq 24 at device 2.0 on pci0 vgapci0: mem 0xf0000000-0xf1ffffff,0xf30d0000-0xf30d0fff at device 3.0 on pci0 vgapci0: Boot video device atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: does not respond device_attach: fdc0 attach returned 6 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (9600,n,8,1) xenpv0: on motherboard granttable0: on xenpv0 xen_et0: on xenpv0 Event timer "XENTIMER" frequency 1000000000 Hz quality 950 Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 xenstore0: on xenpv0 evtchn0: on xenpv0 privcmd0: on xenpv0 debug0: on xenpv0 orm0: at iomem 0xef000-0xeffff on isa0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 fdc0: No FDOUT register! ppc0: cannot reserve I/O port range Timecounters tick every 1.000 msec xenballoon0: on xenstore0 xctrl0: on xenstore0 xs_dev0: on xenstore0 xenbusb_front0: on xenstore0 xenbusb_add_device: Device device/suspend/event-channel ignored. State 6 xn0: at device/vif/0 on xenbusb_front0 xn0: Ethernet address: 00:16:3e:f1:04:bd xn1: at device/vif/1 on xenbusb_front0 xn1: Ethernet address: 00:16:3e:f1:14:bd xn0: backend features: feature-sg feature-gso-tcp4 xn2: at device/vif/2 on xenbusb_front0 xn1: backend features: feature-sg feature-gso-tcp4 xn2: Ethernet address: 00:16:3e:f1:24:bd xenbusb_back0: on xenstore0 xn2: backend features: feature-sg feature-gso-tcp4 xbd0: 3072MB at device/vbd/51712 on xenbusb_front0 xbd0: features: flush, write_barrier xbd0: synchronize cache commands enabled. taskqgroup_adjust failed cnt: 1 stride: 1 mp_ncpus: 1 smp_started: 0 taskqgroup_adjust failed cnt: 1 stride: 1 mp_ncpus: 1 smp_started: 0 Timecounter "TSC-low" frequency 1800037036 Hz quality 800 WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/xbd0p2 [rw]... xn0: link state changed to DOWN xn0: link state changed to UP xn1: link state changed to DOWN xn1: link state changed to UP xn2: link state changed to DOWN xn2: link state changed to UP --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Jun 10 10:59:56 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1F10BB71A63 for ; Fri, 10 Jun 2016 10:59:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 0F1801952 for ; Fri, 10 Jun 2016 10:59:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id u5AAxr0k091951 for ; Fri, 10 Jun 2016 10:59:55 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 188261] [xen] FreeBSD DomU PVHVM guests cannot 'route' traffic for other Xen PV guests on same Dom0 Host. Date: Fri, 10 Jun 2016 10:59:54 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 9.2-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jun 2016 10:59:56 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D188261 --- Comment #27 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to Sydney Meyer from comment #26) Thanks, since in your case the patches seem to solve the issue, I'm waiting= for the feedback from Karl with the debug patch applied. Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Jun 10 21:39:04 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5345EAEF1DE; Fri, 10 Jun 2016 21:39:04 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C8CD0279C; Fri, 10 Jun 2016 21:39:03 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u5ALd10X089279 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 10 Jun 2016 21:39:01 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u5ALcxRw089276; Fri, 10 Jun 2016 21:39:00 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Fri, 10 Jun 2016 21:38:59 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virtualization@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7: no blkback In-Reply-To: <20160609080343.44rvpda4hskiy3ge@mac> Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> <20160609080343.44rvpda4hskiy3ge@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=iso-8859-1 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jun 2016 21:39:04 -0000 On Thu, 9 Jun 2016, Roger Pau Monné wrote: > On Thu, Jun 09, 2016 at 12:16:59AM +0000, Marcin Cieslak wrote: > > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > > > One of the more relevant changes in 4.7 regarding FreeBSD is the support for > > > block hotplug scripts. This means that we now have the option to use > > > backends different than simple block or regular files, provided that someone > > > writes the proper hotplug scripts to attach them (I've heard there are some > > > iSCSI hotplug scripts around). This however requires changes in blkback, so > > > if you plan to use the Xen 4.7 port, please make sure that you are running a > > > kernel that contains revision r301269 (or any later version). The same also > > > > I am running it with r301685 and the HVM guests have some trouble with > > block devices. > > > > SeaBIOS does not find /dev/zvol/zroot/freebsd1,raw,xvda,w to boot FreeBSD > > from, after chaging to "hda" I get up to the kernel mountroot prompt > > (Xen block devices seem to be detected in dmesg). > > Yes, this is intentional, see: > > https://marc.info/?l=xen-devel&m=144482080812353 those guests worked fine with 4.5, that's why I am surprised. xbd0 and xbd1 show up in dmesg, mouting root from xbd0p2 fails, but ada0p2 seems to work. I remember that during my previous attempts ZFS ate most of my machine's memory (dom0 was too small I think) and the symptom was very similar if not identical. One thing which struck me is that I was able to fully but one Linux HVM domU. I am also toying with OpenFirmware which boots from floppy as a HVM guest. > Have you checked if you need to change your /etc/fstab to correctly point > to the new device? Does FreeBSD correctly list the disk(s) at the mountroot > prompt when issuing a "?" command? "?" does not work - it mostly causes a panic, the console is slow, but I managed to switch it to /dev/ada0p2, dmesg below: Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-CURRENT #1 r298620: Tue Apr 26 13:21:50 UTC 2016 root@o.saper.info:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) WARNING: WITNESS option enabled, expect reduced performance. VT(vga): text 80x25 XEN: Hypervisor version 4.7 detected. CPU: Intel(R) Xeon(R) CPU E31245 @ 3.30GHz (3300.08-MHz K8-class CPU) Origin="GenuineIntel" Id=0x206a7 Family=0x6 Model=0x2a Stepping=7 Features=0x17c3fbff Features2=0x9fba2203 AMD Features=0x28100800 AMD Features2=0x1 XSAVE Features=0x1 Hypervisor: Origin = "XenVMMXenVMM" real memory = 2130706432 (2032 MB) avail memory = 2018213888 (1924 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: WARNING: L1 data cache covers less APIC IDs than a core 0 < 1 WARNING: L2 data cache covers less APIC IDs than a core 0 < 1 WARNING: L3 data cache covers less APIC IDs than a core 0 < 1 FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) random: unblocking device. ioapic0: Changing APIC ID to 1 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-47 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80f0ffb0, 0) error 19 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) cpu0: on acpi0 cpu1: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 62500000 Hz quality 950 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0xb008-0xb00b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc200-0xc20f at device 1.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 pci0: at device 1.3 (no driver attached) xenpci0: port 0xc000-0xc0ff mem 0xf0000000-0xf0ffffff irq 24 at device 2.0 on pci0 vgapci0: mem 0xf1000000-0xf1ffffff,0xf2050000-0xf2050fff at device 3.0 on pci0 vgapci0: Boot video device atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: does not respond device_attach: fdc0 attach returned 6 xenpv0: on motherboard granttable0: on xenpv0 xen_et0: on xenpv0 Event timer "XENTIMER" frequency 1000000000 Hz quality 950 Timecounter "XENTIMER" frequency 1000000000 Hz quality 950 xenstore0: on xenpv0 evtchn0: on xenpv0 privcmd0: on xenpv0 debug0: on xenpv0 orm0: at iomem 0xed800-0xeffff on isa0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 fdc0: No FDOUT register! ppc0: cannot reserve I/O port range Timecounters tick every 1.000 msec xenballoon0: on xenstore0 xctrl0: on xenstore0 xs_dev0: on xenstore0 xenbusb_front0: on xenstore0 xenbusb_add_device: Device device/suspend/event-channel ignored. State 6 xn0: at device/vif/0 on xenbusb_front0 xbd0: 16384MB at device/vbd/768 on xenbusb_front0 xbd0: attaching as ada0 xbd0: features: flush, write_barrier xbd0: synchronize cache commands enabled. xn0: Ethernet address: 00:02:04:08:fd:f0 xenbusb_back0: on xenstore0 xbd1: 40960MB at device/vbd/832 on xenbusb_front0 xbd1: attaching as ada1 xbd1: features: flush, write_barrier xbd1: synchronize cache commands enabled. xn0: backend features: feature-sg SMP: AP CPU #1 Launched! WARNING: WITNESS option enabled, expect reduced performance. Trying to mount root from ufs:/dev/xbd0p2 [rw]... mountroot: waiting for device /dev/xbd0p2... Mounting from ufs:/dev/xbd0p2 failed with error 19. Loader variables: vfs.root.mountfrom=ufs:/dev/xbd0p2 vfs.root.mountfrom.options=rw Manual root filesystem specification: : [options] Mount using filesystem and with the specified (optional) option list. eg. ufs:/dev/da0s1a zfs:tank cd9660:/dev/cd0 ro (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /) ? List valid disk boot devices . Yield 1 second (for background tasks) Abort manual input mountroot> Trying to mount root from ufs:/dev/ada0p2 []... xn0: link state changed to DOWN xn0: link state changed to UP > Also, can you paste the output of `xenstore-ls -fp` from Dom0 when this > happens? Windows: /tool = "" (n0) /tool/xenstored = "" (n0) /vm = "" (n0) /vm/744e8146-2e7b-11e6-80cd-5404a6685907 = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/name = "Windows2016" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/uuid = "744e8146-2e7b-11e6-80cd-5404a6685907" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/rtc = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/rtc/timeoffset = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/image = "" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/image/ostype = "hvm" (n0,r279) /vm/744e8146-2e7b-11e6-80cd-5404a6685907/start_time = "1465501844.89" (n0,r279) /libxl = "" (n0) /libxl/279 = "" (n0) /libxl/279/dm-version = "qemu_xen" (n0) /local = "" (n0) /local/domain = "" (n0) /local/domain/0 = "" (n0) /local/domain/0/domid = "0" (n0) /local/domain/0/name = "Domain-0" (n0) /local/domain/0/device-model = "" (n0) /local/domain/0/device-model/279 = "" (n0) /local/domain/0/device-model/279/state = "running" (n0) /local/domain/0/device-model/279/physmap = "" (n0) /local/domain/0/device-model/279/physmap/10f000000 = "" (n0) /local/domain/0/device-model/279/physmap/10f000000/start_addr = "f1000000" (n0) /local/domain/0/device-model/279/physmap/10f000000/size = "1000000" (n0) /local/domain/0/device-model/279/physmap/10f000000/name = "vga.vram" (n0) /local/domain/0/backend = "" (n0) /local/domain/0/backend/vbd = "" (n0) /local/domain/0/backend/vbd/279 = "" (n0) /local/domain/0/backend/vbd/279/768 = "" (n0,r279) /local/domain/0/backend/vbd/279/768/frontend = "/local/domain/279/device/vbd/768" (n0,r279) /local/domain/0/backend/vbd/279/768/params = "/dev/zvol/zroot/windows0" (n0,r279) /local/domain/0/backend/vbd/279/768/script = "/usr/local/etc/xen/scripts/block" (n0,r279) /local/domain/0/backend/vbd/279/768/frontend-id = "279" (n0,r279) /local/domain/0/backend/vbd/279/768/online = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/removable = "0" (n0,r279) /local/domain/0/backend/vbd/279/768/bootable = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/state = "3" (n0,r279) /local/domain/0/backend/vbd/279/768/dev = "hda" (n0,r279) /local/domain/0/backend/vbd/279/768/type = "phy" (n0,r279) /local/domain/0/backend/vbd/279/768/mode = "w" (n0,r279) /local/domain/0/backend/vbd/279/768/device-type = "disk" (n0,r279) /local/domain/0/backend/vbd/279/768/discard-enable = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/feature-barrier = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/feature-flush-cache = "1" (n0,r279) /local/domain/0/backend/vbd/279/768/max-ring-page-order = "5" (n0,r279) /local/domain/0/backend/vbd/279/768/physical-device-path = "/dev/zvol/zroot/windows0" (n0,r279) /local/domain/0/backend/vbd/279/768/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/vbd/279/832 = "" (n0,r279) /local/domain/0/backend/vbd/279/832/frontend = "/local/domain/279/device/vbd/832" (n0,r279) /local/domain/0/backend/vbd/279/832/params = "/dev/zvol/zroot/vs2013" (n0,r279) /local/domain/0/backend/vbd/279/832/script = "/usr/local/etc/xen/scripts/block" (n0,r279) /local/domain/0/backend/vbd/279/832/frontend-id = "279" (n0,r279) /local/domain/0/backend/vbd/279/832/online = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/removable = "0" (n0,r279) /local/domain/0/backend/vbd/279/832/bootable = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/state = "3" (n0,r279) /local/domain/0/backend/vbd/279/832/dev = "hdb" (n0,r279) /local/domain/0/backend/vbd/279/832/type = "phy" (n0,r279) /local/domain/0/backend/vbd/279/832/mode = "w" (n0,r279) /local/domain/0/backend/vbd/279/832/device-type = "disk" (n0,r279) /local/domain/0/backend/vbd/279/832/discard-enable = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/feature-barrier = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/feature-flush-cache = "1" (n0,r279) /local/domain/0/backend/vbd/279/832/max-ring-page-order = "5" (n0,r279) /local/domain/0/backend/vbd/279/832/physical-device-path = "/dev/zvol/zroot/vs2013" (n0,r279) /local/domain/0/backend/vbd/279/832/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/console = "" (n0) /local/domain/0/backend/console/279 = "" (n0) /local/domain/0/backend/console/279/0 = "" (n0,r279) /local/domain/0/backend/console/279/0/frontend = "/local/domain/279/console" (n0,r279) /local/domain/0/backend/console/279/0/frontend-id = "279" (n0,r279) /local/domain/0/backend/console/279/0/online = "1" (n0,r279) /local/domain/0/backend/console/279/0/state = "1" (n0,r279) /local/domain/0/backend/console/279/0/protocol = "vt100" (n0,r279) /local/domain/0/backend/vkbd = "" (n0) /local/domain/0/backend/vkbd/279 = "" (n0) /local/domain/0/backend/vkbd/279/0 = "" (n0,r279) /local/domain/0/backend/vkbd/279/0/frontend = "/local/domain/279/device/vkbd/0" (n0,r279) /local/domain/0/backend/vkbd/279/0/frontend-id = "279" (n0,r279) /local/domain/0/backend/vkbd/279/0/online = "1" (n0,r279) /local/domain/0/backend/vkbd/279/0/state = "2" (n0,r279) /local/domain/0/backend/vkbd/279/0/feature-abs-pointer = "1" (n0,r279) /local/domain/0/backend/vkbd/279/0/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/vif = "" (n0) /local/domain/0/backend/vif/279 = "" (n0) /local/domain/0/backend/vif/279/0 = "" (n0,r279) /local/domain/0/backend/vif/279/0/frontend = "/local/domain/279/device/vif/0" (n0,r279) /local/domain/0/backend/vif/279/0/frontend-id = "279" (n0,r279) /local/domain/0/backend/vif/279/0/online = "1" (n0,r279) /local/domain/0/backend/vif/279/0/state = "2" (n0,r279) /local/domain/0/backend/vif/279/0/script = "/usr/local/etc/xen/scripts/vif-bridge" (n0,r279) /local/domain/0/backend/vif/279/0/mac = "00:16:3e:5d:0d:48" (n0,r279) /local/domain/0/backend/vif/279/0/bridge = "bridge0" (n0,r279) /local/domain/0/backend/vif/279/0/handle = "0" (n0,r279) /local/domain/0/backend/vif/279/0/type = "vif_ioemu" (n0,r279) /local/domain/0/backend/vif/279/0/hotplug-status = "connected" (n0,r279) /local/domain/0/backend/vif/279/0/feature-sg = "1" (n0,r279) /local/domain/0/backend/vif/279/0/feature-gso-tcpv4 = "0" (n0,r279) /local/domain/0/backend/vif/279/0/feature-rx-copy = "1" (n0,r279) /local/domain/0/backend/vif/279/0/feature-rx-flip = "0" (n0,r279) /local/domain/279 = "" (n0,r279) /local/domain/279/vm = "/vm/744e8146-2e7b-11e6-80cd-5404a6685907" (n0,r279) /local/domain/279/name = "Windows2016" (n0,r279) /local/domain/279/cpu = "" (n0,r279) /local/domain/279/cpu/0 = "" (n0,r279) /local/domain/279/cpu/0/availability = "online" (n0,r279) /local/domain/279/cpu/1 = "" (n0,r279) /local/domain/279/cpu/1/availability = "online" (n0,r279) /local/domain/279/memory = "" (n0,r279) /local/domain/279/memory/static-max = "4194304" (n0,r279) /local/domain/279/memory/target = "4177920" (n0,r279) /local/domain/279/memory/videoram = "16384" (n0,r279) /local/domain/279/device = "" (n0,r279) /local/domain/279/device/suspend = "" (n0,r279) /local/domain/279/device/suspend/event-channel = "" (n279) /local/domain/279/device/vbd = "" (n0,r279) /local/domain/279/device/vbd/768 = "" (n279,r0) /local/domain/279/device/vbd/768/backend = "/local/domain/0/backend/vbd/279/768" (n279,r0) /local/domain/279/device/vbd/768/backend-id = "0" (n279,r0) /local/domain/279/device/vbd/768/state = "1" (n279,r0) /local/domain/279/device/vbd/768/virtual-device = "768" (n279,r0) /local/domain/279/device/vbd/768/device-type = "disk" (n279,r0) /local/domain/279/device/vbd/832 = "" (n279,r0) /local/domain/279/device/vbd/832/backend = "/local/domain/0/backend/vbd/279/832" (n279,r0) /local/domain/279/device/vbd/832/backend-id = "0" (n279,r0) /local/domain/279/device/vbd/832/state = "1" (n279,r0) /local/domain/279/device/vbd/832/virtual-device = "832" (n279,r0) /local/domain/279/device/vbd/832/device-type = "disk" (n279,r0) /local/domain/279/device/vkbd = "" (n0,r279) /local/domain/279/device/vkbd/0 = "" (n279,r0) /local/domain/279/device/vkbd/0/backend = "/local/domain/0/backend/vkbd/279/0" (n279,r0) /local/domain/279/device/vkbd/0/backend-id = "0" (n279,r0) /local/domain/279/device/vkbd/0/state = "1" (n279,r0) /local/domain/279/device/vif = "" (n0,r279) /local/domain/279/device/vif/0 = "" (n279,r0) /local/domain/279/device/vif/0/backend = "/local/domain/0/backend/vif/279/0" (n279,r0) /local/domain/279/device/vif/0/backend-id = "0" (n279,r0) /local/domain/279/device/vif/0/state = "1" (n279,r0) /local/domain/279/device/vif/0/handle = "0" (n279,r0) /local/domain/279/device/vif/0/mac = "00:16:3e:5d:0d:48" (n279,r0) /local/domain/279/control = "" (n0,r279) /local/domain/279/control/shutdown = "" (n279) /local/domain/279/control/platform-feature-multiprocessor-suspend = "1" (n0,r279) /local/domain/279/control/platform-feature-xs_reset_watches = "1" (n0,r279) /local/domain/279/hvmloader = "" (n0,r279) /local/domain/279/hvmloader/bios = "ovmf" (n0,r279) /local/domain/279/hvmloader/allow-memory-relocate = "0" (n0,r279) /local/domain/279/data = "" (n279) /local/domain/279/drivers = "" (n279) /local/domain/279/feature = "" (n279) /local/domain/279/attr = "" (n279) /local/domain/279/domid = "279" (n0,r279) /local/domain/279/store = "" (n0,r279) /local/domain/279/store/port = "1" (n0,r279) /local/domain/279/store/ring-ref = "1044476" (n0,r279) /local/domain/279/platform = "" (n0,r279) /local/domain/279/platform/acpi = "1" (n0,r279) /local/domain/279/platform/acpi_s3 = "1" (n0,r279) /local/domain/279/platform/acpi_s4 = "1" (n0,r279) /local/domain/279/console = "" (n0,r279) /local/domain/279/console/backend = "/local/domain/0/backend/console/279/0" (n0,r279) /local/domain/279/console/backend-id = "0" (n279,r0) /local/domain/279/console/limit = "1048576" (n0,r279) /local/domain/279/console/type = "xenconsoled" (n0,r279) /local/domain/279/console/output = "pty" (n0,r279) /local/domain/279/console/tty = "/dev/pts/1" (n0,r279) /local/domain/279/console/port = "2" (n0,r279) /local/domain/279/console/ring-ref = "1044479" (n0,r279) /local/domain/279/console/vnc-listen = "127.0.0.1" (n0,r279) /local/domain/279/console/vnc-port = "5900" (n0,r279) /local/domain/279/image = "" (n0,r279) /local/domain/279/image/device-model-pid = "78745" (n0,r279) FreeBSD: /tool = "" (n0) /tool/xenstored = "" (n0) /vm = "" (n0) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907 = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/name = "FreeBSD" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/uuid = "faefcbb0-2e7b-11e6-80cd-5404a6685907" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/rtc = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/rtc/timeoffset = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/image = "" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/image/ostype = "hvm" (n0,r281) /vm/faefcbb0-2e7b-11e6-80cd-5404a6685907/start_time = "1465502070.75" (n0,r281) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907 = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/name = "FreeBSD" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/uuid = "7bbb396a-2f43-11e6-8abe-5404a6685907" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/rtc = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/rtc/timeoffset = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/image = "" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/image/ostype = "hvm" (n0,r11) /vm/7bbb396a-2f43-11e6-8abe-5404a6685907/start_time = "1465587756.69" (n0,r11) /libxl = "" (n0) /libxl/281 = "" (n0) /libxl/281/dm-version = "qemu_xen" (n0) /libxl/11 = "" (n0) /libxl/11/dm-version = "qemu_xen" (n0) /local = "" (n0) /local/domain = "" (n0) /local/domain/0 = "" (n0) /local/domain/0/domid = "0" (n0) /local/domain/0/name = "Domain-0" (n0) /local/domain/0/device-model = "" (n0) /local/domain/0/device-model/11 = "" (n0) /local/domain/0/device-model/11/state = "running" (n0) /local/domain/0/device-model/11/physmap = "" (n0) /local/domain/0/device-model/11/physmap/7f000000 = "" (n0) /local/domain/0/device-model/11/physmap/7f000000/start_addr = "f1000000" (n0) /local/domain/0/device-model/11/physmap/7f000000/size = "1000000" (n0) /local/domain/0/device-model/11/physmap/7f000000/name = "vga.vram" (n0) /local/domain/0/backend = "" (n0) /local/domain/0/backend/vbd = "" (n0) /local/domain/0/backend/vbd/11 = "" (n0) /local/domain/0/backend/vbd/11/768 = "" (n0,r11) /local/domain/0/backend/vbd/11/768/frontend = "/local/domain/11/device/vbd/768" (n0,r11) /local/domain/0/backend/vbd/11/768/params = "/dev/zvol/zroot/freebsd1" (n0,r11) /local/domain/0/backend/vbd/11/768/script = "/usr/local/etc/xen/scripts/block" (n0,r11) /local/domain/0/backend/vbd/11/768/frontend-id = "11" (n0,r11) /local/domain/0/backend/vbd/11/768/online = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/removable = "0" (n0,r11) /local/domain/0/backend/vbd/11/768/bootable = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/state = "4" (n0,r11) /local/domain/0/backend/vbd/11/768/dev = "hda" (n0,r11) /local/domain/0/backend/vbd/11/768/type = "phy" (n0,r11) /local/domain/0/backend/vbd/11/768/mode = "w" (n0,r11) /local/domain/0/backend/vbd/11/768/device-type = "disk" (n0,r11) /local/domain/0/backend/vbd/11/768/discard-enable = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/feature-barrier = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/feature-flush-cache = "1" (n0,r11) /local/domain/0/backend/vbd/11/768/max-ring-page-order = "5" (n0,r11) /local/domain/0/backend/vbd/11/768/physical-device-path = "/dev/zvol/zroot/freebsd1" (n0,r11) /local/domain/0/backend/vbd/11/768/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vbd/11/768/sectors = "33554432" (n0,r11) /local/domain/0/backend/vbd/11/768/info = "0" (n0,r11) /local/domain/0/backend/vbd/11/768/sector-size = "512" (n0,r11) /local/domain/0/backend/vbd/11/832 = "" (n0,r11) /local/domain/0/backend/vbd/11/832/frontend = "/local/domain/11/device/vbd/832" (n0,r11) /local/domain/0/backend/vbd/11/832/params = "/dev/zvol/zroot/freebsd2" (n0,r11) /local/domain/0/backend/vbd/11/832/script = "/usr/local/etc/xen/scripts/block" (n0,r11) /local/domain/0/backend/vbd/11/832/frontend-id = "11" (n0,r11) /local/domain/0/backend/vbd/11/832/online = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/removable = "0" (n0,r11) /local/domain/0/backend/vbd/11/832/bootable = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/state = "4" (n0,r11) /local/domain/0/backend/vbd/11/832/dev = "hdb" (n0,r11) /local/domain/0/backend/vbd/11/832/type = "phy" (n0,r11) /local/domain/0/backend/vbd/11/832/mode = "w" (n0,r11) /local/domain/0/backend/vbd/11/832/device-type = "disk" (n0,r11) /local/domain/0/backend/vbd/11/832/discard-enable = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/feature-barrier = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/feature-flush-cache = "1" (n0,r11) /local/domain/0/backend/vbd/11/832/max-ring-page-order = "5" (n0,r11) /local/domain/0/backend/vbd/11/832/physical-device-path = "/dev/zvol/zroot/freebsd2" (n0,r11) /local/domain/0/backend/vbd/11/832/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vbd/11/832/sectors = "83886080" (n0,r11) /local/domain/0/backend/vbd/11/832/info = "0" (n0,r11) /local/domain/0/backend/vbd/11/832/sector-size = "512" (n0,r11) /local/domain/0/backend/console = "" (n0) /local/domain/0/backend/console/11 = "" (n0) /local/domain/0/backend/console/11/0 = "" (n0,r11) /local/domain/0/backend/console/11/0/frontend = "/local/domain/11/console" (n0,r11) /local/domain/0/backend/console/11/0/frontend-id = "11" (n0,r11) /local/domain/0/backend/console/11/0/online = "1" (n0,r11) /local/domain/0/backend/console/11/0/state = "1" (n0,r11) /local/domain/0/backend/console/11/0/protocol = "vt100" (n0,r11) /local/domain/0/backend/vkbd = "" (n0) /local/domain/0/backend/vkbd/11 = "" (n0) /local/domain/0/backend/vkbd/11/0 = "" (n0,r11) /local/domain/0/backend/vkbd/11/0/frontend = "/local/domain/11/device/vkbd/0" (n0,r11) /local/domain/0/backend/vkbd/11/0/frontend-id = "11" (n0,r11) /local/domain/0/backend/vkbd/11/0/online = "1" (n0,r11) /local/domain/0/backend/vkbd/11/0/state = "2" (n0,r11) /local/domain/0/backend/vkbd/11/0/feature-abs-pointer = "1" (n0,r11) /local/domain/0/backend/vkbd/11/0/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vif = "" (n0) /local/domain/0/backend/vif/11 = "" (n0) /local/domain/0/backend/vif/11/0 = "" (n0,r11) /local/domain/0/backend/vif/11/0/frontend = "/local/domain/11/device/vif/0" (n0,r11) /local/domain/0/backend/vif/11/0/frontend-id = "11" (n0,r11) /local/domain/0/backend/vif/11/0/online = "1" (n0,r11) /local/domain/0/backend/vif/11/0/state = "4" (n0,r11) /local/domain/0/backend/vif/11/0/script = "/usr/local/etc/xen/scripts/vif-bridge" (n0,r11) /local/domain/0/backend/vif/11/0/mac = "00:02:04:08:fd:f0" (n0,r11) /local/domain/0/backend/vif/11/0/bridge = "bridge0" (n0,r11) /local/domain/0/backend/vif/11/0/handle = "0" (n0,r11) /local/domain/0/backend/vif/11/0/type = "vif_ioemu" (n0,r11) /local/domain/0/backend/vif/11/0/hotplug-status = "connected" (n0,r11) /local/domain/0/backend/vif/11/0/feature-sg = "1" (n0,r11) /local/domain/0/backend/vif/11/0/feature-gso-tcpv4 = "0" (n0,r11) /local/domain/0/backend/vif/11/0/feature-rx-copy = "1" (n0,r11) /local/domain/0/backend/vif/11/0/feature-rx-flip = "0" (n0,r11) /local/domain/11 = "" (n0,r11) /local/domain/11/vm = "/vm/7bbb396a-2f43-11e6-8abe-5404a6685907" (n0,r11) /local/domain/11/name = "FreeBSD" (n0,r11) /local/domain/11/cpu = "" (n0,r11) /local/domain/11/cpu/0 = "" (n0,r11) /local/domain/11/cpu/0/availability = "online" (n0,r11) /local/domain/11/cpu/1 = "" (n0,r11) /local/domain/11/cpu/1/availability = "online" (n0,r11) /local/domain/11/memory = "" (n0,r11) /local/domain/11/memory/static-max = "2097152" (n0,r11) /local/domain/11/memory/target = "2080768" (n0,r11) /local/domain/11/memory/videoram = "16384" (n0,r11) /local/domain/11/device = "" (n0,r11) /local/domain/11/device/suspend = "" (n0,r11) /local/domain/11/device/suspend/event-channel = "" (n11) /local/domain/11/device/vbd = "" (n0,r11) /local/domain/11/device/vbd/768 = "" (n11,r0) /local/domain/11/device/vbd/768/backend = "/local/domain/0/backend/vbd/11/768" (n11,r0) /local/domain/11/device/vbd/768/backend-id = "0" (n11,r0) /local/domain/11/device/vbd/768/state = "4" (n11,r0) /local/domain/11/device/vbd/768/virtual-device = "768" (n11,r0) /local/domain/11/device/vbd/768/device-type = "disk" (n11,r0) /local/domain/11/device/vbd/768/ring-ref0 = "8" (n11,r0) /local/domain/11/device/vbd/768/ring-ref1 = "9" (n11,r0) /local/domain/11/device/vbd/768/ring-ref2 = "10" (n11,r0) /local/domain/11/device/vbd/768/ring-ref3 = "11" (n11,r0) /local/domain/11/device/vbd/768/ring-ref4 = "12" (n11,r0) /local/domain/11/device/vbd/768/ring-ref5 = "13" (n11,r0) /local/domain/11/device/vbd/768/ring-ref6 = "14" (n11,r0) /local/domain/11/device/vbd/768/ring-ref7 = "15" (n11,r0) /local/domain/11/device/vbd/768/ring-ref8 = "16" (n11,r0) /local/domain/11/device/vbd/768/ring-ref9 = "17" (n11,r0) /local/domain/11/device/vbd/768/ring-ref10 = "18" (n11,r0) /local/domain/11/device/vbd/768/ring-ref11 = "19" (n11,r0) /local/domain/11/device/vbd/768/ring-ref12 = "20" (n11,r0) /local/domain/11/device/vbd/768/ring-ref13 = "21" (n11,r0) /local/domain/11/device/vbd/768/ring-ref14 = "22" (n11,r0) /local/domain/11/device/vbd/768/ring-ref15 = "23" (n11,r0) /local/domain/11/device/vbd/768/ring-ref16 = "24" (n11,r0) /local/domain/11/device/vbd/768/ring-ref17 = "25" (n11,r0) /local/domain/11/device/vbd/768/ring-ref18 = "26" (n11,r0) /local/domain/11/device/vbd/768/ring-ref19 = "27" (n11,r0) /local/domain/11/device/vbd/768/ring-ref20 = "28" (n11,r0) /local/domain/11/device/vbd/768/ring-ref21 = "29" (n11,r0) /local/domain/11/device/vbd/768/ring-ref22 = "30" (n11,r0) /local/domain/11/device/vbd/768/ring-ref23 = "31" (n11,r0) /local/domain/11/device/vbd/768/ring-ref24 = "32" (n11,r0) /local/domain/11/device/vbd/768/ring-ref25 = "33" (n11,r0) /local/domain/11/device/vbd/768/ring-ref26 = "34" (n11,r0) /local/domain/11/device/vbd/768/ring-ref27 = "35" (n11,r0) /local/domain/11/device/vbd/768/ring-ref28 = "36" (n11,r0) /local/domain/11/device/vbd/768/ring-ref29 = "37" (n11,r0) /local/domain/11/device/vbd/768/ring-ref30 = "38" (n11,r0) /local/domain/11/device/vbd/768/ring-ref31 = "39" (n11,r0) /local/domain/11/device/vbd/768/num-ring-pages = "32" (n11,r0) /local/domain/11/device/vbd/768/ring-page-order = "5" (n11,r0) /local/domain/11/device/vbd/768/event-channel = "10" (n11,r0) /local/domain/11/device/vbd/768/protocol = "x86_64-abi" (n11,r0) /local/domain/11/device/vbd/832 = "" (n11,r0) /local/domain/11/device/vbd/832/backend = "/local/domain/0/backend/vbd/11/832" (n11,r0) /local/domain/11/device/vbd/832/backend-id = "0" (n11,r0) /local/domain/11/device/vbd/832/state = "4" (n11,r0) /local/domain/11/device/vbd/832/virtual-device = "832" (n11,r0) /local/domain/11/device/vbd/832/device-type = "disk" (n11,r0) /local/domain/11/device/vbd/832/ring-ref0 = "40" (n11,r0) /local/domain/11/device/vbd/832/ring-ref1 = "41" (n11,r0) /local/domain/11/device/vbd/832/ring-ref2 = "42" (n11,r0) /local/domain/11/device/vbd/832/ring-ref3 = "43" (n11,r0) /local/domain/11/device/vbd/832/ring-ref4 = "44" (n11,r0) /local/domain/11/device/vbd/832/ring-ref5 = "45" (n11,r0) /local/domain/11/device/vbd/832/ring-ref6 = "46" (n11,r0) /local/domain/11/device/vbd/832/ring-ref7 = "47" (n11,r0) /local/domain/11/device/vbd/832/ring-ref8 = "48" (n11,r0) /local/domain/11/device/vbd/832/ring-ref9 = "49" (n11,r0) /local/domain/11/device/vbd/832/ring-ref10 = "50" (n11,r0) /local/domain/11/device/vbd/832/ring-ref11 = "51" (n11,r0) /local/domain/11/device/vbd/832/ring-ref12 = "52" (n11,r0) /local/domain/11/device/vbd/832/ring-ref13 = "53" (n11,r0) /local/domain/11/device/vbd/832/ring-ref14 = "54" (n11,r0) /local/domain/11/device/vbd/832/ring-ref15 = "55" (n11,r0) /local/domain/11/device/vbd/832/ring-ref16 = "56" (n11,r0) /local/domain/11/device/vbd/832/ring-ref17 = "57" (n11,r0) /local/domain/11/device/vbd/832/ring-ref18 = "58" (n11,r0) /local/domain/11/device/vbd/832/ring-ref19 = "59" (n11,r0) /local/domain/11/device/vbd/832/ring-ref20 = "60" (n11,r0) /local/domain/11/device/vbd/832/ring-ref21 = "61" (n11,r0) /local/domain/11/device/vbd/832/ring-ref22 = "62" (n11,r0) /local/domain/11/device/vbd/832/ring-ref23 = "63" (n11,r0) /local/domain/11/device/vbd/832/ring-ref24 = "64" (n11,r0) /local/domain/11/device/vbd/832/ring-ref25 = "65" (n11,r0) /local/domain/11/device/vbd/832/ring-ref26 = "66" (n11,r0) /local/domain/11/device/vbd/832/ring-ref27 = "67" (n11,r0) /local/domain/11/device/vbd/832/ring-ref28 = "68" (n11,r0) /local/domain/11/device/vbd/832/ring-ref29 = "69" (n11,r0) /local/domain/11/device/vbd/832/ring-ref30 = "70" (n11,r0) /local/domain/11/device/vbd/832/ring-ref31 = "71" (n11,r0) /local/domain/11/device/vbd/832/num-ring-pages = "32" (n11,r0) /local/domain/11/device/vbd/832/ring-page-order = "5" (n11,r0) /local/domain/11/device/vbd/832/event-channel = "11" (n11,r0) /local/domain/11/device/vbd/832/protocol = "x86_64-abi" (n11,r0) /local/domain/11/device/vkbd = "" (n0,r11) /local/domain/11/device/vkbd/0 = "" (n11,r0) /local/domain/11/device/vkbd/0/backend = "/local/domain/0/backend/vkbd/11/0" (n11,r0) /local/domain/11/device/vkbd/0/backend-id = "0" (n11,r0) /local/domain/11/device/vkbd/0/state = "1" (n11,r0) /local/domain/11/device/vif = "" (n0,r11) /local/domain/11/device/vif/0 = "" (n11,r0) /local/domain/11/device/vif/0/backend = "/local/domain/0/backend/vif/11/0" (n11,r0) /local/domain/11/device/vif/0/backend-id = "0" (n11,r0) /local/domain/11/device/vif/0/state = "4" (n11,r0) /local/domain/11/device/vif/0/handle = "0" (n11,r0) /local/domain/11/device/vif/0/mac = "00:02:04:08:fd:f0" (n11,r0) /local/domain/11/device/vif/0/tx-ring-ref = "768" (n11,r0) /local/domain/11/device/vif/0/rx-ring-ref = "329" (n11,r0) /local/domain/11/device/vif/0/event-channel = "12" (n11,r0) /local/domain/11/device/vif/0/request-rx-copy = "1" (n11,r0) /local/domain/11/device/vif/0/feature-rx-notify = "1" (n11,r0) /local/domain/11/device/vif/0/feature-sg = "1" (n11,r0) /local/domain/11/device/vif/0/feature-gso-tcpv4 = "1" (n11,r0) /local/domain/11/control = "" (n0,r11) /local/domain/11/control/shutdown = "" (n11) /local/domain/11/control/platform-feature-multiprocessor-suspend = "1" (n0,r11) /local/domain/11/control/platform-feature-xs_reset_watches = "1" (n0,r11) /local/domain/11/hvmloader = "" (n0,r11) /local/domain/11/hvmloader/bios = "seabios" (n0,r11) /local/domain/11/hvmloader/allow-memory-relocate = "0" (n0,r11) /local/domain/11/data = "" (n11) /local/domain/11/drivers = "" (n11) /local/domain/11/feature = "" (n11) /local/domain/11/attr = "" (n11) /local/domain/11/domid = "11" (n0,r11) /local/domain/11/store = "" (n0,r11) /local/domain/11/store/port = "1" (n0,r11) /local/domain/11/store/ring-ref = "1044476" (n0,r11) /local/domain/11/platform = "" (n0,r11) /local/domain/11/platform/acpi = "1" (n0,r11) /local/domain/11/platform/acpi_s3 = "1" (n0,r11) /local/domain/11/platform/acpi_s4 = "1" (n0,r11) /local/domain/11/console = "" (n0,r11) /local/domain/11/console/backend = "/local/domain/0/backend/console/11/0" (n0,r11) /local/domain/11/console/backend-id = "0" (n11,r0) /local/domain/11/console/limit = "1048576" (n0,r11) /local/domain/11/console/type = "xenconsoled" (n0,r11) /local/domain/11/console/output = "pty" (n0,r11) /local/domain/11/console/tty = "/dev/pts/1" (n0,r11) /local/domain/11/console/port = "2" (n0,r11) /local/domain/11/console/ring-ref = "1044479" (n0,r11) /local/domain/11/console/vnc-listen = "127.0.0.1" (n0,r11) /local/domain/11/console/vnc-port = "5900" (n0,r11) /local/domain/11/image = "" (n0,r11) /local/domain/11/image/device-model-pid = "6311" (n0,r11) > > What used to be Windows 2016 domU with /dev/zvol/zroot/windows0,raw,hda,w > > ends up in the Tianocore UEFI shell. Block devices seem to be available, > > I can even list the fs0: partition, but no booting further possible. > > Hm, I've never used Tianocore myself, so I'm not sure what the issue could > be here. Again, can you post the output of `xenstore-ls -fp` from Dom0 when > this happens? At least this will show if the PV block device has been > correctly attached. See above. How do I rollback to 4.5.2, do I need to downgrade the FreeBSD kernel as well? Marcin From owner-freebsd-xen@freebsd.org Fri Jun 10 21:41:06 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C8CB1AEF271 for ; Fri, 10 Jun 2016 21:41:06 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (m.saper.info [IPv6:2a01:4f8:a0:7383::]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "m.saper.info", Issuer "Marcin Cieslak 2016" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 60DA92991; Fri, 10 Jun 2016 21:41:06 +0000 (UTC) (envelope-from saper@saper.info) Received: from m.saper.info (saper@m.saper.info [IPv6:2a01:4f8:a0:7383::]) by m.saper.info (8.15.2/8.15.2) with ESMTPS id u5ALf4Cn089307 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Fri, 10 Jun 2016 21:41:04 GMT (envelope-from saper@saper.info) Received: from localhost (saper@localhost) by m.saper.info (8.15.2/8.15.2/Submit) with ESMTP id u5ALf4qb089304; Fri, 10 Jun 2016 21:41:04 GMT (envelope-from saper@saper.info) X-Authentication-Warning: m.saper.info: saper owned process doing -bs Date: Fri, 10 Jun 2016 21:41:04 +0000 From: Marcin Cieslak To: =?ISO-8859-15?Q?Roger_Pau_Monn=E9?= cc: freebsd-xen@FreeBSD.org, xen-devel@lists.xenproject.org, freebsd-virt@freebsd.org Subject: Re: HEADS UP: Imported Xen 4.7 and blkback changes In-Reply-To: <20160609074021.uqtjio2vn7wo5h4m@mac> Message-ID: References: <20160603120921.y5l362zgrhf4fdcb@mac> <20160609074021.uqtjio2vn7wo5h4m@mac> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=iso-8859-1 Content-Transfer-Encoding: 8BIT X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Jun 2016 21:41:06 -0000 On Thu, 9 Jun 2016, Roger Pau Monné wrote: > On Wed, Jun 08, 2016 at 10:18:09PM +0000, Marcin Cieslak wrote: > > On Fri, 3 Jun 2016, Roger Pau Monné wrote: > > > > > Hello, > > > > > > First of all, this message is only relevant to those that use FreeBSD as > > > Dom0 (host), not as a DomU (guest), so don't panic. > > > > > > I've imported the latest Xen version (4.7-rc4) into the ports tree, it's > > > still not the final version, but it's quite close, so we better start > > > testing it to make sure it works fine with FreeBSD. > > > > Thank you Roger, this is excellent. Are xen-tools-devel 4.5 now? > > Looks confusing. > > > > I have also tried building xen-tools (4.7) without python > > and qemu configure reported this. > > Python is required, you cannot get rid of it. Strange, seems USES= python in the port's Makefile didn't work for me and continued happily after. Marcin