From owner-freebsd-stable@freebsd.org Mon Sep 7 20:30:31 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E84639CCD32 for ; Mon, 7 Sep 2015 20:30:30 +0000 (UTC) (envelope-from jim.harris@gmail.com) Received: from mail-oi0-x243.google.com (mail-oi0-x243.google.com [IPv6:2607:f8b0:4003:c06::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id ABBCA149C for ; Mon, 7 Sep 2015 20:30:30 +0000 (UTC) (envelope-from jim.harris@gmail.com) Received: by oibi136 with SMTP id i136so5133885oib.3 for ; Mon, 07 Sep 2015 13:30:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=czoL0boUfTRNaNv4ajlj8U0nd29ml7IYcCLrpznJPno=; b=lD77iVvHkQ6sad7Iqgntoqn0tdaLv60GIPt2x94cMom+qjkF8vJN1xAft9BjO8UVCH 1kHMEagTR0pS+476zElIKCvQOORC4A+wBClFR23V5EFWNUFUA9Tn0+ePEJi5X41lhUDS bPwd2oUf6PCWD12GNb6dZqo786tcHFfbSWN6EGLIM1tcWzeqK/07LmIGoDjDGYSapbIL eXGH8DfLjDzCml5VgFffu/ziWO9Y5GptqeHDFWGPuAOgdIiAKIYrQi2LZRqZtgWmkpJ7 txLD55+wCmDIc7RKMwpoVMgwJho47WviwlFwEyCbNwLKxdxccOl2RVQEJkB542i204k0 +L9w== MIME-Version: 1.0 X-Received: by 10.202.190.87 with SMTP id o84mr15577870oif.111.1441657829934; Mon, 07 Sep 2015 13:30:29 -0700 (PDT) Received: by 10.202.212.7 with HTTP; Mon, 7 Sep 2015 13:30:29 -0700 (PDT) In-Reply-To: <20150907103435.Horde.z4GgTZD3-chqVxPgZhMklyM@duttonbros.com> References: <20150907103435.Horde.z4GgTZD3-chqVxPgZhMklyM@duttonbros.com> Date: Mon, 7 Sep 2015 13:30:29 -0700 Message-ID: Subject: Re: ISCI bus_alloc_resource failed From: Jim Harris To: "Bradley W. Dutton" Cc: FreeBSD-STABLE Mailing List Content-Type: multipart/mixed; boundary=001a113d6772d7b858051f2e1ec4 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Sep 2015 20:30:31 -0000 --001a113d6772d7b858051f2e1ec4 Content-Type: text/plain; charset=UTF-8 On Mon, Sep 7, 2015 at 10:34 AM, Bradley W. Dutton < brad-fbsd-stable@duttonbros.com> wrote: > Hi, > > I'm having trouble with the isci driver in both stable and current. I see > the following dmesg in stable: > > isci0: port > 0x5000-0x50ff mem 0xe7afc000-0xe7afffff,0xe7400000-0xe77fffff irq 19 at > device 0.0 on pci11 > isci: 1:000051 ISCI bus_alloc_resource failed > > > I'm running FreeBSD on VMWare ESXi 6 with vt-d passthrough of the isci > devices, here is the relevant pciconf output: > > none2@pci0:3:0:0: class=0x0c0500 card=0x062815d9 chip=0x1d708086 > rev=0x06 hdr=0x00 > vendor = 'Intel Corporation' > device = 'C600/X79 series chipset SMBus Controller 0' > class = serial bus > subclass = SMBus > cap 10[90] = PCI-Express 2 endpoint max data 128(128) link x32(x32) > speed 5.0(5.0) ASPM disabled(L0s) > cap 01[cc] = powerspec 3 supports D0 D3 current D0 > cap 05[d4] = MSI supports 1 message > ecap 000e[100] = ARI 1 > isci0@pci0:11:0:0: class=0x010700 card=0x062815d9 chip=0x1d6b8086 > rev=0x06 hdr=0x00 > vendor = 'Intel Corporation' > device = 'C602 chipset 4-Port SATA Storage Control Unit' > class = mass storage > subclass = SAS > cap 01[98] = powerspec 3 supports D0 D3 current D0 > cap 10[c4] = PCI-Express 2 endpoint max data 128(128) link x32(x32) > speed 5.0(5.0) ASPM disabled(L0s) > cap 11[a0] = MSI-X supports 2 messages > Table in map 0x10[0x2000], PBA in map 0x10[0x3000] > ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected > ecap 000e[138] = ARI 1 > ecap 0017[180] = TPH Requester 1 > ecap 0010[140] = SRIOV 1 > > > I haven't tried booting on bare metal but running a linux distro (centos > 7) in the same VM works without issue. Is is possible the SRIOV option is > causing trouble? I don't see a BIOS option to disable that setting on this > server like I have on some others. Any other ideas to get this working? > I do not think the SRIOV is the problem here. I do notice that isci(4) does not explicitly enable PCI busmaster, which will cause problems with PCI passthrough. I've attached a patch that rectifies that issue. I'm not certain that is the root cause of the interrupt resource allocation failure though. Could you: 1) Apply the attached patch and retest. 2) If you still see the resource allocation failure, reboot in verbose mode and provide the resulting dmesg output. Thanks, -Jim > Thanks, > Brad > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > --001a113d6772d7b858051f2e1ec4 Content-Type: application/octet-stream; name="isci_busmaster.patch" Content-Disposition: attachment; filename="isci_busmaster.patch" Content-Transfer-Encoding: base64 X-Attachment-Id: f_ieadtkck0 ZGlmZiAtLWdpdCBhL3N5cy9kZXYvaXNjaS9pc2NpLmMgYi9zeXMvZGV2L2lzY2kvaXNjaS5jCmlu ZGV4IDJmMDcyN2QuLjVhMTA2NmMgMTAwNjQ0Ci0tLSBhL3N5cy9kZXYvaXNjaS9pc2NpLmMKKysr IGIvc3lzL2Rldi9pc2NpL2lzY2kuYwpAQCAtMTYzLDYgKzE2Myw3IEBAIGlzY2lfYXR0YWNoKGRl dmljZV90IGRldmljZSkKIAogCWdfaXNjaSA9IGlzY2k7CiAJaXNjaS0+ZGV2aWNlID0gZGV2aWNl OworCXBjaV9lbmFibGVfYnVzbWFzdGVyKGRldmljZSk7CiAKIAlpc2NpX2FsbG9jYXRlX3BjaV9t ZW1vcnkoaXNjaSk7CiAKQEAgLTI3Miw2ICsyNzMsNyBAQCBpc2NpX2RldGFjaChkZXZpY2VfdCBk ZXZpY2UpCiAKIAkJcGNpX3JlbGVhc2VfbXNpKGRldmljZSk7CiAJfQorCXBjaV9kaXNhYmxlX2J1 c21hc3RlcihkZXZpY2UpOwogCiAJcmV0dXJuICgwKTsKIH0K --001a113d6772d7b858051f2e1ec4--