From owner-freebsd-xen@freebsd.org Tue Dec 6 03:48:05 2016 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8216DC6889C for ; Tue, 6 Dec 2016 03:48:05 +0000 (UTC) (envelope-from nathan.friess@gmail.com) Received: from mail-io0-x22f.google.com (mail-io0-x22f.google.com [IPv6:2607:f8b0:4001:c06::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4B7449B0 for ; Tue, 6 Dec 2016 03:48:05 +0000 (UTC) (envelope-from nathan.friess@gmail.com) Received: by mail-io0-x22f.google.com with SMTP id a124so632955873ioe.2 for ; Mon, 05 Dec 2016 19:48:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=to:from:subject:message-id:date:user-agent:mime-version :content-transfer-encoding; bh=YxXKdA8znRxPPHfB8nq2d/XJYjmn5UhWja6qtF4LmEM=; b=iVbuh/sJrIWDJQAkIr/isHXxKOIyLGu4Y/R+PydS01t50HNVh6nqKeXn/W5swMy5fk fRZ9ncy5cJ8WAg1zGtolTgUTXC+HZs27jToNc0Ij3w+3ZelNTL2V2pvlDGrhPZrsedrh bi0NOQ4PGGJ61rKZ5bZhuoq5EdyDXP5iVvzhRVTF2V3YFqOhaauq0oY+A2FYU9XVfdEw nftrZnjVB9BpGHw7ZQB8MF0nau2L6GhgUjNtZkcqROsnNfW4cdNt8Y+bliV7nXUd+419 VvzLD/sl/LmLGDcJ+ajwLKzBVPldf4PLHyBVctB3/VKbiv8W55zs7LozwsIeX5jOjNPz kJtg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:to:from:subject:message-id:date:user-agent :mime-version:content-transfer-encoding; bh=YxXKdA8znRxPPHfB8nq2d/XJYjmn5UhWja6qtF4LmEM=; b=AfpHAAUHuRbc3Dkf98zg6AU+FB4yYxvsOrzZWdJcE6A+TPQ6Zl4suUDEeXKW/PwDmJ sUmJAHV2DyCHsjvkBQV1AkxOY9UlZsWWWxohCKBhM1J+h+FJFuII0lGri97QaaCyX+9z uP6ZJjkc+b0JDh0fw9leYiGTjvYZZc0MtjpZ5FC/EO1tVFWxRM9KB7aAbvoYIcrtSx4J vUoXpsxR9sL/9oexVNaRLK9NIBPH6KkpQkgj6sCaJ3sKgr3nXuZoAjMDXKla+HOEkyZ/ jsdetTIqZTGttaB9H0qloyldZvPfIg95pRXhhKCYIPvkMVVHkxE6dxK184BwHIOgFjgC EqeQ== X-Gm-Message-State: AKaTC00Os+FrgHRudDwZCuG80MdfcMfGyqy4PnmLwhocAK0clUyvVOQhAJZQ8bRrAS3y+g== X-Received: by 10.107.8.105 with SMTP id 102mr49023232ioi.154.1480996084526; Mon, 05 Dec 2016 19:48:04 -0800 (PST) Received: from [10.2.1.1] (S01060018e7c4b870.cg.shawcable.net. [50.66.15.125]) by smtp.gmail.com with ESMTPSA id p71sm8360695ioe.33.2016.12.05.19.48.03 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 05 Dec 2016 19:48:04 -0800 (PST) To: freebsd-xen@freebsd.org From: Nathan Friess Subject: 11-RELEASE acting as vbd backend Message-ID: <247e5b6c-2713-27cf-f8fa-61e55c9e2025@gmail.com> Date: Mon, 5 Dec 2016 20:48:00 -0700 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Dec 2016 03:48:05 -0000 Hi, After upgrading a FreeBSD domU from 10.3-RELEASE to 11-RELEASE, it seems that FreeBSD can no longer act as a vbd backend for other domUs. *** My setup before upgrading: Xen 4.4 dom0: Linux (Debian) with a custom compiled 4.2 kernel FreeBSD domU: FreeBSD 10.3-RELEASE-p7 in hvm mode. Filesystem is ZFS, with zvols created for other domUs. xen-guest-tools-4.2.2_1 is installed through pkg. Other domU: Linux with the same compiled 4.2 kernel in pv mode. Xen disk configuration is 'format=raw,vdev=xvda1,backendtype=phy,backend=FREEBSD,access=w,target=/dev/zvol/.../rootfs' *** *** Now that FreeBSD 11-RELEASE is out I upgraded it in place. After upgrading FreeBSD the other Linux domU can no longer find /dev/xvda1 to mount as its root. It hangs at boot waiting for the device to appear. While the Linux domU is waiting for the vbd I ran xenstore-ls in dom0 to see what is going on. The backend appears in FreeBSD and the frontend in the Linux domU, but FreeBSD shows state=2 and Linux shows state=3. FreeBSD backend: /local/domain/6/backend/vbd = "" (n0,r6) /local/domain/6/backend/vbd/7 = "" (n0,r6) /local/domain/6/backend/vbd/7/51713 = "" (n6,r7) /local/domain/6/backend/vbd/7/51713/frontend = "/local/domain/7/device/vbd/51713" (n6,r7) /local/domain/6/backend/vbd/7/51713/params = "/dev/zvol/.../rootfs" (n6,r7) /local/domain/6/backend/vbd/7/51713/script = "/etc/xen/scripts/block" (n6,r7) /local/domain/6/backend/vbd/7/51713/frontend-id = "7" (n6,r7) /local/domain/6/backend/vbd/7/51713/online = "1" (n6,r7) /local/domain/6/backend/vbd/7/51713/removable = "0" (n6,r7) /local/domain/6/backend/vbd/7/51713/bootable = "1" (n6,r7) /local/domain/6/backend/vbd/7/51713/state = "2" (n6,r7) /local/domain/6/backend/vbd/7/51713/dev = "xvda1" (n6,r7) /local/domain/6/backend/vbd/7/51713/type = "phy" (n6,r7) /local/domain/6/backend/vbd/7/51713/mode = "w" (n6,r7) /local/domain/6/backend/vbd/7/51713/device-type = "disk" (n6,r7) /local/domain/6/backend/vbd/7/51713/feature-barrier = "1" (n6,r7) /local/domain/6/backend/vbd/7/51713/feature-flush-cache = "1" (n6,r7) /local/domain/6/backend/vbd/7/51713/max-ring-page-order = "5" (n6,r7) Linux frontend: /local/domain/7/device/vbd = "" (n0,r7) /local/domain/7/device/vbd/51713 = "" (n7,r6) /local/domain/7/device/vbd/51713/backend = "/local/domain/6/backend/vbd/7/51713" (n7,r6) /local/domain/7/device/vbd/51713/backend-id = "6" (n7,r6) /local/domain/7/device/vbd/51713/state = "3" (n7,r6) /local/domain/7/device/vbd/51713/virtual-device = "51713" (n7,r6) /local/domain/7/device/vbd/51713/device-type = "disk" (n7,r6) /local/domain/7/device/vbd/51713/protocol = "x86_64-abi" (n7,r6) /local/domain/7/device/vbd/51713/ring-ref = "8" (n7,r6) /local/domain/7/device/vbd/51713/event-channel = "15" (n7,r6) /local/domain/7/device/vbd/51713/feature-persistent = "1" (n7,r6) When the vbd was working in 10.3, the backend also shows the following: /local/domain/8/backend/vbd/9/51713/hotplug-status = "connected" (n8,r9) /local/domain/8/backend/vbd/9/51713/sectors = "41943040" (n8,r9) /local/domain/8/backend/vbd/9/51713/info = "0" (n8,r9) /local/domain/8/backend/vbd/9/51713/sector-size = "512" (n8,r9) *** In case there is a version incompatibility with the new FreeBSD, I later upgraded Xen to 4.7 and dom0 to a Linux 4.4 kernel. This did not help. How might I get this setup working again? Thanks, Nathan