From owner-freebsd-xen@FreeBSD.ORG  Tue Nov 12 17:07:17 2013
Return-Path: <owner-freebsd-xen@FreeBSD.ORG>
Delivered-To: freebsd-xen@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 1F9E1596
 for <freebsd-xen@freebsd.org>; Tue, 12 Nov 2013 17:07:17 +0000 (UTC)
Received: from mail-pb0-x22b.google.com (mail-pb0-x22b.google.com
 [IPv6:2607:f8b0:400e:c01::22b])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id 00F2B2D3B
 for <freebsd-xen@freebsd.org>; Tue, 12 Nov 2013 17:07:16 +0000 (UTC)
Received: by mail-pb0-f43.google.com with SMTP id md4so7161665pbc.30
 for <freebsd-xen@freebsd.org>; Tue, 12 Nov 2013 09:07:16 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:date:message-id:subject:from:to:content-type;
 bh=QVRszLoKGHYijo3cuySpR+PJvdY5Y4XqITO3hEsIiKM=;
 b=Bt0H10q3F2dlliy8AZVmem3a9pZan0U82e/EnXJuMQe9mNtCVr2uL1mi2fcSnv6aTP
 aYa0NIllzk0NMzP08uOlF5Uiq8zmTLCxCMZAF1PMJ4GlIq/wl5Iog7/3XLISXRE+zpUH
 X31XzP1lRqwoWlEGYB6h2mUyMzKncPBYIllBoZPIvTNkAWhokYLhcP1IroFmZMoSM6vm
 zV30WoHWuDr40fx/vke92n5/usfCGBa53PlIKwuLbql3cnX0zGFP66dfVJDyrZ7XXrA6
 vOPAHOeQ0aE3rWS83/94Uy+Hk4N2JiIg7gYgToTO712oXpYsU842Ryyyaoa6hhoHWqar
 hcbQ==
MIME-Version: 1.0
X-Received: by 10.68.133.198 with SMTP id pe6mr36926691pbb.10.1384276036692;
 Tue, 12 Nov 2013 09:07:16 -0800 (PST)
Received: by 10.66.75.167 with HTTP; Tue, 12 Nov 2013 09:07:16 -0800 (PST)
Date: Tue, 12 Nov 2013 18:07:16 +0100
Message-ID: <CAF+a0-G1mXpyf=Ve3TvC35TV+9Q6k+3oVD-7Y_xP2uMGxZMwxQ@mail.gmail.com>
Subject: Hang on subsequent boot with PCI-passthrough
From: Marek R <marek321@gmail.com>
To: freebsd-xen@freebsd.org
Content-Type: text/plain; charset=UTF-8
X-BeenThere: freebsd-xen@freebsd.org
X-Mailman-Version: 2.1.16
Precedence: list
List-Id: Discussion of the freebsd port to xen - implementation and usage
 <freebsd-xen.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-xen>,
 <mailto:freebsd-xen-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-xen/>
List-Post: <mailto:freebsd-xen@freebsd.org>
List-Help: <mailto:freebsd-xen-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-xen>,
 <mailto:freebsd-xen-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 12 Nov 2013 17:07:17 -0000

I'm trying to passthrough a LSI HBA to a fbsd xen hvm guest.
The problem is, it only works the first time. On subsequent boots fbsd
hangs on the LSI driver, trying to initialize it.
I presume this is because the PCI device is left in a different state
than right after the host boot.
The HBA supports function level reset and I tested it with another OS
to make sure it indeed works.

Steps to reproduce:
1. Boot host.
2. Boot fbsd guest with passed PCI device. Fbsd boots fine.
3. Restart the guest. Boot hangs on device initialization.

The fbsd guest reboots fine without the passed in device.

The host is Linux, Xen is 4.3.0. Tried with fbsd 9.2 and 10beta3. The
host does not initialize the device (it's "hidden" with pciback)

Is this a fbsd bug? Is there maybe some setting or boot option I could
try to fix this?