From owner-freebsd-virtualization@freebsd.org Sun Mar 25 00:11:20 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 71B29F59D16 for ; Sun, 25 Mar 2018 00:11:20 +0000 (UTC) (envelope-from jmaloney@ixsystems.com) Received: from mail-qt0-x22e.google.com (mail-qt0-x22e.google.com [IPv6:2607:f8b0:400d:c0d::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 11F2F87709 for ; Sun, 25 Mar 2018 00:11:19 +0000 (UTC) (envelope-from jmaloney@ixsystems.com) Received: by mail-qt0-x22e.google.com with SMTP id l25so16264408qtj.1 for ; Sat, 24 Mar 2018 17:11:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ixsystems-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=kflciAnKTMbOu0N3mIqYQCC9HTtfukLHLghHihMcSPI=; b=NMScKEy/7TfCh/BjJZb+8HhNr4VabenpR0rue8IAUugEkUyxMtnSuw+Nu7EpuQ78yZ 1Ze5y1TwDRK9HoIzE642JvTDXwV0zEJQj8ZPEWGHaCJhgqh71+30X425alL+ACH8BOhq 6gGx0I4ALQ8NpSdCw0fkoHvde626BcKhN/miYzjyUHIzYjB+NP/tfqwsbbSvGaIuCR45 GD6UFFHNBgXGYIxfKz+zCPmBcZoB7eiAtP12D4bupIk9fqJomgiFLWfVHAyQhO7jkXiR fHsB70UnZpZmlgiZJ1P1YoJFg9LJtKyvvKIircj5Myids7LIQqYdZJh2ByD7hbZpNe1K /T6w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=kflciAnKTMbOu0N3mIqYQCC9HTtfukLHLghHihMcSPI=; b=PcS6AqnbXSSKsFDyErF1Y7rjd2pVsEE2M8+pO/cwH81Dqal40Oor/eUz4200Azm7ZV US3gLmrK3HlstmQCsMHtE71U96apfMYoVSMT7f9FYvnLdrL2Rzbtu9VY74njzWMaoCH6 HTMlGGGPpeKDzUC6XwZzFRKkSwtSpZyBkf+waG5QrMX1jT4JZQPnEjFcDYlGMh8kY8b5 jHFaOiuWdfcw3P6TIgxtRAgD7i3ti0/RdCkFRMxpH/3UQrZexiSkcXLQQAiW7LmfJEFm uXv+8v3Me3HWjt08WKZ9wTKIvwFHXTPTHEfQFkrcKwKFdgQgc+RfAMpdzWz5X0OwPzGD tJow== X-Gm-Message-State: AElRT7H18JremsJLEz53pZZ3PSKH6zSyZtE+xcS3Rd/OgC8iwwrAkM19 iJkNf8PSRVqENxfrWjBER+6SHdLPlLEC6MZKSNypPxr2 X-Google-Smtp-Source: AG47ELu9hGiSXVi5ADlo76GAM8yqxpVwyiRvv5Ci2pJ6joQjfj2isFdFfB03ydmiA/Vhjok3DZtxpyoWOPtYjHwuEoU= X-Received: by 10.237.53.47 with SMTP id a44mr50005015qte.96.1521936679331; Sat, 24 Mar 2018 17:11:19 -0700 (PDT) MIME-Version: 1.0 Received: by 10.237.63.119 with HTTP; Sat, 24 Mar 2018 17:11:18 -0700 (PDT) In-Reply-To: References: <201803231812.w2NICLEW032460@pdx.rh.CN85.dnsmgr.net> <624f4ac2-ada1-64af-1c4f-250d3de551de@freebsd.org> From: Joe Maloney Date: Sat, 24 Mar 2018 20:11:18 -0400 Message-ID: Subject: Re: Issue encountered booting FreeBSD STABLE and CURRENT snapshots with EFI To: Kyle Evans Cc: Peter Grehan , Marcelo Araujo , "Rodney W. Grimes" , "freebsd-virtualization@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Mar 2018 00:11:20 -0000 I can confirm the new firmware does fix the issue for us. Thanks for the quick resolution. It at least allowed me to script a proper workaround for our automated tests. It turns out my previous vm-bhyve workaround was a bad idea, and broke installs. I would assume vm-bhyve copies the iso to null.iso but I haven't had time to look further so I just reverted that patch, and applied the new firmware instead. Anyways thanks again. Joe Maloney QA Manager / iXsystems Enterprise Storage & Servers Driven By Open Source On Sat, Mar 24, 2018 at 10:26 AM, Kyle Evans wrote: > On Sat, Mar 24, 2018 at 12:59 AM, Peter Grehan wrote: >> Hi Kyle, >> >>> FYI- I've created PR #2 [1] against the freebsd/uefi-edk2 repository >>> and have confirmed that this fixes the broken-looking firmware along >>> with the booting problem experienced in this thread. >>> >>> [1] https://github.com/freebsd/uefi-edk2/pull/2 >> >> >> Thanks - merged. I've asked Fabian to update the UEFI ports. >> > > Awesome, thanks! =) > > It didn't seem right to hack around the hack around that was > implemented for our formerly bad behavior, but we can look at it again > if we run into further problems with the way we do this. I don't think > our devpath usage is unreasonable, though- we don't expect these > pointers to live forever, just long enough to locate all of the > partitions on it. > > Thanks, > > Kyle Evans > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" From owner-freebsd-virtualization@freebsd.org Sun Mar 25 01:01:31 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 06C94F5DB06 for ; Sun, 25 Mar 2018 01:01:31 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12]) by mx1.freebsd.org (Postfix) with ESMTP id 6E3E269400 for ; Sun, 25 Mar 2018 01:01:30 +0000 (UTC) (envelope-from grehan@freebsd.org) Received: from iredmail.onthenet.com.au (iredmail.onthenet.com.au [203.13.68.150]) by alto.onthenet.com.au (Postfix) with ESMTPS id D84032094A41 for ; Sun, 25 Mar 2018 11:01:21 +1000 (AEST) Received: from localhost (iredmail.onthenet.com.au [127.0.0.1]) by iredmail.onthenet.com.au (Postfix) with ESMTP id D0FDC2809BD for ; Sun, 25 Mar 2018 11:01:21 +1000 (AEST) X-Amavis-Modified: Mail body modified (using disclaimer) - iredmail.onthenet.com.au Received: from iredmail.onthenet.com.au ([127.0.0.1]) by localhost (iredmail.onthenet.com.au [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id PQifMc5tlVXx for ; Sun, 25 Mar 2018 11:01:21 +1000 (AEST) Received: from Peters-MacBook-Pro-2.local (c-67-180-92-13.hsd1.ca.comcast.net [67.180.92.13]) by iredmail.onthenet.com.au (Postfix) with ESMTPSA id F3F932804D6; Sun, 25 Mar 2018 11:01:18 +1000 (AEST) Subject: Re: bhyve pci passthrough usb controller To: Wouter Snels Cc: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org References: <201803240230.w2O2U21F033917@pdx.rh.CN85.dnsmgr.net> From: Peter Grehan Message-ID: <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> Date: Sat, 24 Mar 2018 18:01:19 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Score: 0 X-CMAE-Analysis: v=2.3 cv=dNCIZtRb c=1 sm=1 tr=0 a=A6CF0fG5TOl4vs6YHvqXgw==:117 a=5eVCmCvhg37cu/pjidAGzw==:17 a=IkcTkHD0fZMA:10 a=v2DPQv5-lfwA:10 a=z1x4mbJ5c0PGvg0TxjkA:9 a=QEXdDO2ut3YA:10 wl=host:3 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Mar 2018 01:01:31 -0000 > I surely will try this out, but what about device 4/0/0 showing the > same issue. Both tests where performed separately showing the exact > same result, of course I'd be happy if either one of them worked. I think what is happening here is that Windows is enabling legacy interrupts on the device, and that happens to be on the same shared IRQ line that the ATA controller is on, resulting in spurious interrupts. The dmesg for the system may be able to confirm this, since it should list the legacy IRQs that have been assigned. bhyve PCI passthru relies not only on the device supporting MSI/MSI-x interrupts, but the guest using those. later, Peter. From owner-freebsd-virtualization@freebsd.org Sun Mar 25 21:00:46 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D5EDEF6CC95 for ; Sun, 25 Mar 2018 21:00:46 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 75A49781C7 for ; Sun, 25 Mar 2018 21:00:46 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id A1B1814B54 for ; Sun, 25 Mar 2018 21:00:45 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w2PL0jCE072457 for ; Sun, 25 Mar 2018 21:00:45 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w2PL0jki072444 for freebsd-virtualization@FreeBSD.org; Sun, 25 Mar 2018 21:00:45 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201803252100.w2PL0jki072444@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: freebsd-virtualization@FreeBSD.org Subject: Problem reports for freebsd-virtualization@FreeBSD.org that need special attention Date: Sun, 25 Mar 2018 21:00:45 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Mar 2018 21:00:47 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 212820 | FreeBSD 10-STABLE from latest HEAD and 11-RELEASE 1 problems total for which you should take action. From owner-freebsd-virtualization@freebsd.org Mon Mar 26 06:26:36 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8D6E3F6F6DC for ; Mon, 26 Mar 2018 06:26:36 +0000 (UTC) (envelope-from nospam@ofloo.net) Received: from loki.ofloo.net (unknown [IPv6:2001:470:7acd:0:1:1:0:1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "loki.ofloo.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E72F26D37A; Mon, 26 Mar 2018 06:26:35 +0000 (UTC) (envelope-from nospam@ofloo.net) Received: from [IPv6:fc03:1337:dead:cafe:c52d:3513:57fd:67bc] ([IPv6:fc03:1337:dead:cafe:c52d:3513:57fd:67bc]) by loki.ofloo.net (8.15.2/8.15.2) with ESMTPS id w2Q6PcwK058352 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Mon, 26 Mar 2018 06:25:44 GMT (envelope-from nospam@ofloo.net) Subject: Re: bhyve pci passthrough usb controller To: Peter Grehan , freebsd-virtualization@freebsd.org References: <201803240230.w2O2U21F033917@pdx.rh.CN85.dnsmgr.net> <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> From: Wouter Snels Message-ID: <57744ffe-605a-bce5-7d70-864e9ac9c560@ofloo.net> Date: Mon, 26 Mar 2018 08:25:32 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="0CxSYz6WXwKvSgQdEsSKaCPjiJvUk3Jcj" X-Spam-Status: No, score=-1.6 required=5.0 tests=ALL_TRUSTED,BAYES_00, RDNS_NONE,SPF_PASS,TW_AQ,TW_BD,TW_II,TW_KB,TW_PF,TW_TK,TW_VC autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on loki.ofloo.net X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Mar 2018 06:26:36 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --0CxSYz6WXwKvSgQdEsSKaCPjiJvUk3Jcj Content-Type: multipart/mixed; boundary="7b1ReIjPgK8kBpG6FzBHC0HGTFpdCTxRY"; protected-headers="v1" From: Wouter Snels To: Peter Grehan , freebsd-virtualization@freebsd.org Message-ID: <57744ffe-605a-bce5-7d70-864e9ac9c560@ofloo.net> Subject: Re: bhyve pci passthrough usb controller References: <201803240230.w2O2U21F033917@pdx.rh.CN85.dnsmgr.net> <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> In-Reply-To: <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> --7b1ReIjPgK8kBpG6FzBHC0HGTFpdCTxRY Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Content-Language: nl-BE Would making the host system boot in legacy help to avoid this? Or is this some other sort of legacy mode you're referring to? Not quite sure but if grasp a bit about what you're saying then, .. then shouldn't it work with the uPD720202 controller since it's not using pci0= =2E pci0: at device 20.0 (no driver attached) pci4: at device 0.0 (no driver attached) # cat /var/run/dmesg.boot Copyright (c) 1992-2017 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 The Regents of the University = of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.1-STABLE #1 r331092M: Wed Mar 21 07:06:43 CET 2018 =C2=A0=C2=A0=C2=A0 ofloo@bull:/usr/obj/usr/src/sys/OFL amd64 FreeBSD clang version 5.0.1 (tags/RELEASE_501/final 320880) (based on LLVM 5.0.1) VT(vga): resolution 640x480 CPU: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz (3192.16-MHz K8-class CPU) =C2=A0 Origin=3D"GenuineIntel"=C2=A0 Id=3D0x506e3=C2=A0 Family=3D0x6=C2=A0= Model=3D0x5e=C2=A0 Stepping=3D3 =C2=A0 Features=3D0xbfebfbff =C2=A0 Features2=3D0x7ffafbff =C2=A0 AMD Features=3D0x2c100800 =C2=A0 AMD Features2=3D0x121 =C2=A0 Structured Extended Features=3D0x29c6fbf =C2=A0 Structured Extended Features3=3D0xc000000 =C2=A0 XSAVE Features=3D0xf =C2=A0 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID =C2=A0 TSC: P-state invariant, performance statistics real memory=C2=A0 =3D 8589934592 (8192 MB) avail memory =3D 8010182656 (7639 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) random: unblocking device. ioapic0 irqs 0-119 on motherboard SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #3 Launched! Timecounter "TSC-low" frequency 1596078966 Hz quality 1000 random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff80f973b0, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" nexus0 vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) unknown: memory range not supported cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 24000000 Hz quality 950 Event timer "HPET" frequency 24000000 Hz quality 550 Event timer "HPET1" frequency 24000000 Hz quality 440 Event timer "HPET2" frequency 24000000 Hz quality 440 Event timer "HPET3" frequency 24000000 Hz quality 440 Event timer "HPET4" frequency 24000000 Hz quality 440 atrtc0: port 0x70-0x77 irq 8 on acpi0 atrtc0: Warning: Couldn't map I/O. atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pcib0: _OSC returned error 0x4 pci0: on pcib0 pcib1: irq 16 at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0xf000-0xf03f mem 0xf6000000-0xf6ffffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0 vgapci0: Boot video device pci0: at device 20.0 (no driver attached) pci0: at device 22.0 (no driver attached) ahci0: port 0xf090-0xf097,0xf080-0xf083,0xf060-0xf07f mem 0xf7248000-0xf7249fff,0xf724c000-0xf724c0ff,0xf724b000-0xf724b7ff irq 17 at device 23.0 on pci0 ahci0: AHCI v1.31 with 4 6Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 ahcich2: at channel 2 on ahci0 ahcich3: at channel 3 on ahci0 ahciem0: on ahci0 pcib2: irq 16 at device 28.0 on pci0 pci2: on pcib2 pcib3: at device 0.0 on pci2 pci3: on pcib3 xl0: <3Com 3c905B-TX Fast Etherlink XL> port 0xe000-0xe07f mem 0xf7120000-0xf712007f irq 16 at device 0.0 on pci3 miibus0: on xl0 bmtphy0: PHY 24 on miibus0 bmtphy0:=C2=A0 none, 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto= , auto-flow xl0: Ethernet address: 00:50:04:69:e4:82 pcib4: irq 18 at device 28.6 on pci0 pci4: on pcib4 pci4: at device 0.0 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 pci0: at device 31.2 (no driver attached) hdac0: mem 0xf7240000-0xf7243fff,0xf7220000-0xf722ffff irq 16 at device 31.3 on pci0= em0: mem 0xf7200000-0xf721ffff irq 19 at device 31.6 on pci0 em0: Using an MSI interrupt em0: Ethernet address: 50:9a:4c:08:fd:c6 em0: netmap queues/slots: TX 1/1024, RX 1/1024 acpi_button0: on acpi0 acpi_button1: on acpi0 acpi_tz0: on acpi0 acpi_tz1: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (115200,n,8,1) atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] driver bug: Unable to set devclass (class: atkbdc devname: (unknown)) psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model Generic PS/2 mouse, device ID 0 orm0: at iomem 0xc0000-0xcffff,0xd0000-0xd0fff,0xd1000-0xd1fff on isa0 ppc0: cannot reserve I/O port range est0: on cpu0 est1: on cpu1 est2: on cpu2 est3: on cpu3 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec ipfw2 (+ipv6) initialized, divert enabled, nat loadable, default to accept, logging disabled DUMMYNET 0 with IPv6 initialized (100409) load_dn_sched dn_sched FIFO loaded load_dn_sched dn_sched FQ_CODEL loaded load_dn_sched dn_sched FQ_PIE loaded load_dn_sched dn_sched PRIO loaded load_dn_sched dn_sched QFQ loaded load_dn_sched dn_sched RR loaded load_dn_sched dn_sched WF2Q+ loaded load_dn_aqm dn_aqm CODEL loaded load_dn_aqm dn_aqm PIE loaded usb_needs_explore_all: no devclass hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 pcm0: at nid 20,33 on hdaa0 pcm1: at nid 27 on hdaa0 hdacc1: at cad 2 on hdac0 hdaa1: at nid 1 on hdacc1 pcm2: at nid 3 on hdaa1 ses0 at ahciem0 bus 0 scbus4 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device cd0 at ahcich1 bus 0 scbus1 target 0 lun 0 cd0: Removable CD-ROM SCSI device cd0: Serial Number M16H4JG4543 cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes= ) cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA8-ACS SATA 3.x device ada0: Serial Number ZA4292G6 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 476940MB (976773168 512 byte sectors) ada0: quirks=3D0x1<4K> Trying to mount root from zfs:zroot/ROOT/default []... xl0: link state changed to DOWN xl0: link state changed to UP ppt0 mem 0xf7000000-0xf7001fff irq 18 at device 0.0 on pci4 em0: link state changed to UP Regards, .. Op 25-03-18 om 03:01 schreef Peter Grehan: > >> I surely will try this out, but what about device 4/0/0 showing the >> same issue. Both tests where performed separately showing the exact >> same result, of course I'd be happy if either one of them worked. > > =C2=A0I think what is happening here is that Windows is enabling legacy= > interrupts on the device, and that happens to be on the same shared > IRQ line that the ATA controller is on, resulting in spurious interrupt= s. > > =C2=A0The dmesg for the system may be able to confirm this, since it sh= ould > list the legacy IRQs that have been assigned. > > =C2=A0bhyve PCI passthru relies not only on the device supporting MSI/M= SI-x > interrupts, but the guest using those. > > later, > > Peter. --7b1ReIjPgK8kBpG6FzBHC0HGTFpdCTxRY-- --0CxSYz6WXwKvSgQdEsSKaCPjiJvUk3Jcj Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJauJJcAAoJENWumses7+9mwSYQAI9mbCMsVTEIO9VDYAiFoSp0 qD58nBggHEz/d81yjtx2GW0n20vyqmuXRrmAYkeiFN6Zv3f3wpKkfD6f5n0NKren 7YogU2rBGtoRP1TkVSZeAJMhHW+nZVxTfol9x2GpH3jV1AsqeIvz7HntPCFbToTB sQgzYqYdMSxUv5sQztS7MFvcBc72tOE1mGv1YcsrozOUB+Ahuc5bhlTcSt14fbTI vUfOBbJ5s2fIkl6SOAGZtd+JR81RAGGw1fT9YZXRydN4CwTb6AdFtqOcIl/8pnZH EHF9LSDfmrKBT9crVRdR/U+q9vL+0tZhDiU/Z5INkdXYOjYgaB7UcZth3t13pXgs 9KWxx3D0DW3j9qBv0D53kkJJKWiJo0k0zpnX49HTxI9pJFTJJXLYd6Tb5CLgHMMq Nzb4w3qGigPvf9tHJb7VYTv65I39LneewsQWgxz1EYpNxEOmd1BLIDsATwLOf/0i LCHQ93Qa/A2d7jWHugh1B+Usnd6IozgN/DmJhg5moff4KnXAgkKFQklXShLBTYOg s+Iw7GxS6ntvjDxf1Oh7PbRln/cNVqtBZe9AG4sZa+Yf1y0YjmTkxvZhCrpNr26r 8GjmCMZublnHczDhrU83SVGlIscZjNhYzHCeyM+/uQ1S1sIHYVWcvOuQBaPpDauT soi6MZpUvzkwQg2zJSU9 =cNyq -----END PGP SIGNATURE----- --0CxSYz6WXwKvSgQdEsSKaCPjiJvUk3Jcj-- From owner-freebsd-virtualization@freebsd.org Mon Mar 26 07:14:19 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 94E88F4ACBC for ; Mon, 26 Mar 2018 07:14:19 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from kagate.punkt.de (kagate.punkt.de [217.29.33.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 103706EA84; Mon, 26 Mar 2018 07:14:18 +0000 (UTC) (envelope-from hausen@punkt.de) Received: from hugo10.ka.punkt.de (hugo10.ka.punkt.de [217.29.44.10]) by gate2.intern.punkt.de with ESMTP id w2Q7EA9i041632; Mon, 26 Mar 2018 09:14:10 +0200 (CEST) Received: from [217.29.44.49] ([217.29.44.49]) by hugo10.ka.punkt.de (8.14.2/8.14.2) with ESMTP id w2Q7E9YZ021702; Mon, 26 Mar 2018 09:14:10 +0200 (CEST) (envelope-from hausen@punkt.de) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: Issue encountered booting FreeBSD STABLE and CURRENT snapshots with EFI From: "Patrick M. Hausen" In-Reply-To: <096c805a0aa84bf3bcff3256b9a22a14@SERVER.ad.usd-group.com> Date: Mon, 26 Mar 2018 09:14:10 +0200 Cc: Kyle Evans , Joe Maloney , Warner Losh , "freebsd-virtualization@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <6224D45B-AAEF-480A-97D4-438E653E7B62@punkt.de> References: <096c805a0aa84bf3bcff3256b9a22a14@SERVER.ad.usd-group.com> To: Matt Churchyard X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Mar 2018 07:14:19 -0000 Hi all, > Am 23.03.2018 um 14:19 schrieb Matt Churchyard = : > The original reason for null.iso was due to notes on the bhyve wiki > https://wiki.freebsd.org/bhyve/Windows >=20 > " The install.iso is only required for the first boot of Windows = Server and must be removed from the bhyve command after the first boot. = Desktop editions of Windows require that a null install.iso file remains = and it can be created with touch install.iso" >=20 > At the time the UEFI support was primarily used for loading Windows = guests, and some desktop versions apparently needed an empty iso file to = boot. I was not able to verify which guests needed this file and so it = was supplied to all, as it seemed to have no ill effects on the server = versions of Windows I was testing with. this looks like a piece of outdated folklore to me. At least all = versions from Windows 7 SP1 onwards boot from CD into a dialog reading like "press a key to boot from CD" and fail over to the hard disk if you = don't. So the installation continues as it should. I installed Windows 7 and 10 numerous times and never had to use that "null.iso" hack. Patrick --=20 punkt.de GmbH Internet - Dienstleistungen - Beratung Kaiserallee 13a Tel.: 0721 9109-0 Fax: -100 76133 Karlsruhe info@punkt.de http://punkt.de AG Mannheim 108285 Gf: Juergen Egeling From owner-freebsd-virtualization@freebsd.org Tue Mar 27 13:32:35 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3E673F537C4 for ; Tue, 27 Mar 2018 13:32:35 +0000 (UTC) (envelope-from nospam@ofloo.net) Received: from spanky.ofloo.net (spanky.ofloo.net [IPv6:2001:470:c9dc:2::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "spanky.ofloo.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3D67C85324; Tue, 27 Mar 2018 13:32:34 +0000 (UTC) (envelope-from nospam@ofloo.net) Received: from [IPv6:2001:470:1f13:57f::1000] ([IPv6:2001:470:1f13:57f:0:0:0:1000]) by spanky.ofloo.net (8.15.2/8.15.2) with ESMTPS id w2RDWJJC098809 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 27 Mar 2018 15:32:20 +0200 (CEST) (envelope-from nospam@ofloo.net) X-Authentication-Warning: spanky.ofloo.net: Host [IPv6:2001:470:1f13:57f:0:0:0:1000] claimed to be [IPv6:2001:470:1f13:57f::1000] Subject: Re: bhyve pci passthrough usb controller To: Peter Grehan Cc: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org References: <201803240230.w2O2U21F033917@pdx.rh.CN85.dnsmgr.net> <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> From: Wouter Snels Message-ID: Date: Tue, 27 Mar 2018 15:32:19 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Spam-Status: No, score=-2.1 required=5.0 tests=ALL_TRUSTED,BAYES_00, RDNS_NONE,SPF_FAIL autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spanky.ofloo.net X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 13:32:35 -0000 Hi, .. I've looked up if the "upd720202" supports msi interrupts and it does. http://www.phasure.com/index.php?action=dlattach;topic=2784.0;attach=3281 Regards, .. Op 25-03-18 om 03:01 schreef Peter Grehan: > >> I surely will try this out, but what about device 4/0/0 showing the >> same issue. Both tests where performed separately showing the exact >> same result, of course I'd be happy if either one of them worked. > >  I think what is happening here is that Windows is enabling legacy > interrupts on the device, and that happens to be on the same shared > IRQ line that the ATA controller is on, resulting in spurious interrupts. > >  The dmesg for the system may be able to confirm this, since it should > list the legacy IRQs that have been assigned. > >  bhyve PCI passthru relies not only on the device supporting MSI/MSI-x > interrupts, but the guest using those. > > later, > > Peter. From owner-freebsd-virtualization@freebsd.org Tue Mar 27 13:35:16 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7577BF53B65 for ; Tue, 27 Mar 2018 13:35:16 +0000 (UTC) (envelope-from ofloo@h4ck.io) Received: from spanky.ofloo.net (spanky.ofloo.net [IPv6:2001:470:c9dc:2::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "spanky.ofloo.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D95078569D for ; Tue, 27 Mar 2018 13:35:15 +0000 (UTC) (envelope-from ofloo@h4ck.io) Received: from [IPv6:2001:470:1f13:57f::1000] ([IPv6:2001:470:1f13:57f:0:0:0:1000]) by spanky.ofloo.net (8.15.2/8.15.2) with ESMTPS id w2RDZ1ft098966 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 27 Mar 2018 15:35:02 +0200 (CEST) (envelope-from ofloo@h4ck.io) X-Authentication-Warning: spanky.ofloo.net: Host [IPv6:2001:470:1f13:57f:0:0:0:1000] claimed to be [IPv6:2001:470:1f13:57f::1000] Subject: Re: bhyve pci passthrough usb controller To: freebsd-virtualization@freebsd.org, "Rodney W. Grimes" References: <201803240230.w2O2U21F033917@pdx.rh.CN85.dnsmgr.net> From: Wouter Snels Message-ID: <26fdde13-f297-a0b7-e696-00a87c7a56eb@h4ck.io> Date: Tue, 27 Mar 2018 15:35:01 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit Content-Language: en-US X-Spam-Status: No, score=-1.8 required=5.0 tests=ALL_TRUSTED,BAYES_00, RDNS_NONE,SPF_FAIL,TW_EV,TW_SV,TW_TD,TW_XH autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spanky.ofloo.net X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 13:35:16 -0000 I tried what you've suggested and it makes no difference. Even if pci device 0/20/2 is passed through it still gives these errors. Regards, .. Op 24-03-18 om 07:47 schreef Wouter Snels: > I surely will try this out, but what about device 4/0/0 showing the same issue. Both tests where performed separately showing the exact same result, of course I'd be happy if either one of them worked. > > Regards,.. > > > -------- Oorspronkelijk bericht -------- > Van: "Rodney W. Grimes" > Verzonden: Sat Mar 24 03:30:02 GMT+01:00 2018 > Aan: Wouter Snels > Cc: Julian Elischer , freebsd-virtualization@freebsd.org > Onderwerp: Re: bhyve pci passthrough usb controller > > -- Start of PGP signed section. >> Hi, .. >> >> I'm trying to pci passhthrough a usb controller to a bhyve windows 7 >> virtualization. >> When I start the virtual machine it freezes the entire system. See >> console.log >> To be clear the system runs without any problems without the pci >> passthrough. >> >> kernel configuration >> >> include GENERIC >> ident?? OFL >> options IPFIREWALL >> options IPFIREWALL_VERBOSE >> options IPFIREWALL_DEFAULT_TO_ACCEPT >> options DUMMYNET >> options IPDIVERT >> options CONSPEED=115200 >> >> * note: removed xhci driver from GENERIC >> >> >> I've recompiled the kernel without the xhci driver. I've tested both usb >> controllers. >> Both "Sunrise Point-H USB 3.0 xHCI Controller" and "uPD720202 USB 3.0 >> Host Controller", both showed >> the same error on the console screen. >> >> # uname >> FreeBSD 11.1-STABLE #1 r331092M >> >> # custom kernel >> include GENERIC >> ident?? OFL >> options IPFIREWALL >> options IPFIREWALL_VERBOSE >> options IPFIREWALL_DEFAULT_TO_ACCEPT >> options DUMMYNET >> options IPDIVERT >> options CONSPEED=115200 >> >> * note commented "device xhci" in generic >> >> # svn info >> Path: . >> Working Copy Root Path: /usr/src >> URL: https://svn0.eu.freebsd.org/base/stable/11 >> Relative URL: ^/stable/11 >> Repository Root: https://svn0.eu.freebsd.org/base >> Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f >> Revision: 331092 >> Node Kind: directory >> Schedule: normal >> Last Changed Author: eadler >> Last Changed Rev: 331092 >> Last Changed Date: 2018-03-17 07:44:39 +0100 (Sat, 17 Mar 2018) >> >> # vm passthru >> DEVICE???? BHYVE ID???? READY??????? DESCRIPTION >> hostb0???? 0/0/0??????? No?????????? Xeon E3-1200 v5/E3-1500 v5/6th Gen >> Core Processor Host Bridge/DRAM Registers >> pcib1????? 0/1/0??????? No?????????? Xeon E3-1200 v5/E3-1500 v5/6th Gen >> Core Processor PCIe Controller (x16) >> vgapci0??? 0/2/0??????? No?????????? HD Graphics 530 >> ppt0?????? 0/20/0?????? Yes????????? Sunrise Point-H USB 3.0 xHCI Controller > 0/20/0 > >> none0????? 0/20/2?????? No?????????? Sunrise Point-H Thermal subsystem > has a subdevice 0/20/2 that is not being passed, this may cause odd > things to happen. > >> none1????? 0/22/0?????? No?????????? Sunrise Point-H CSME HECI >> ahci0????? 0/23/0?????? No?????????? Sunrise Point-H SATA controller >> [AHCI mode] >> pcib2????? 0/28/0?????? No?????????? Sunrise Point-H PCI Express Root Port >> pcib4????? 0/28/6?????? No?????????? Sunrise Point-H PCI Express Root Port >> isab0????? 0/31/0?????? No?????????? Sunrise Point-H LPC Controller >> none2????? 0/31/2?????? No?????????? Sunrise Point-H PMC >> hdac0????? 0/31/3?????? No?????????? Sunrise Point-H HD Audio >> none3????? 0/31/4?????? No?????????? Sunrise Point-H SMBus >> em0??????? 0/31/6?????? No?????????? Ethernet Connection (2) I219-V >> pcib3????? 2/0/0??????? No?????????? XIO2001 PCI Express-to-PCI Bridge >> xl0??????? 3/0/0??????? No?????????? 3c905B 100BaseTX [Cyclone] >> ppt1?????? 4/0/0??????? Yes????????? uPD720202 USB 3.0 Host Controller >> >> ppt1@pci0:4:0:0:??? class=0x0c0330 card=0x00151912 chip=0x00151912 >> rev=0x02 hdr=0x00 >> ??? vendor???? = 'Renesas Technology Corp.'/mailman >> ??? device???? = 'uPD720202 USB 3.0 Host Controller' >> ??? class????? = serial bus >> ??? subclass?? = USB >> >> ppt0@pci0:0:20:0:????? class=0x0c0330 card=0x06ba1028 chip=0xa12f8086 >> rev=0x31 hdr=0x00 >> ??? vendor???? = 'Intel Corporation' >> ??? device???? = 'Sunrise Point-H USB 3.0 xHCI Controller' >> ??? class????? = serial bus >> ??? subclass?? = USB >> >> # grep -i pptdevfs loader.conf >> pptdevs="0/20/0 4/0/0" > add 0/20/2 to this > >> # vm configure >> passthru0="0/20/0" >> >> # vm configure >> passthru0="4/0/0" >> >> Any suggestions on what I'm doing wrong? >> >> >> * Sorry kinda new to this mailing list thing >> >> >> Op 23-03-18 om 18:25 schreef Julian Elischer: >>> On 23/3/18 11:40 pm, Wouter Snels wrote: >>> >>> >>> new wrapping is no better >>> It looks like the device you are passing though is not removed from >>> freebsd first. >>> but it's hard to tell. >>> >>>> |Hi, .. I'm trying to pci passhthrough a usb controller to a bhyve >>>> windows 7 virtualization. When I start the virtual machine it freezes >>>> the entire system and this shows up on the console. To be clear the >>>> system runs without any problems without the pci passthrough. | >>>> ||(ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 08 e0 ff 40 40 29 00 >>>> 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: CCB request was invalid >>>> (ada0:ahcich0:0:0:0): Error 22, Unretryable error >>>> (aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 >>>> 00 00 00 (aprobe0:ahcich0:0:0:0): CAM status: CCB request was invalid >>>> (aprobe0:ahcich0:0:0:0): Error 22, Unretryable error ada0 at ahcich0 bus >>>> 0 scbus0 target 0 lun 0 ada0: s/n ZA4292G6 >>>> detached (aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 >>>> 00 00 00 00 00 00 (aprobe0:ahcich0:0:0:0): CAM status: CCB request was >>>> invalid (aprobe0:ahcich0:0:0:0): Error 22, Unretryable error ahcich0: >>>> Poll timeout on slot 28 port 0 ahcich0: is 20000000 cs 10000000 ss >>>> 00000000 rs 10000000 tfd 1d0 serr 00000800 cmd 00005c17 >>>> (aprobe0:ahcich0:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 >>>> 00 00 (aprobe0:ahcich0:0:0:0): CAM status: Command timeout >>>> (aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted >>>> (ada0:ahcich0:0:0:0): SETFEATURES ENABLE RCACHE. ACB: ef aa 00 00 00 40 >>>> 00 00 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: CCB request was >>>> invalid (ada0:ahcich0:0:0:0): Error 22, Unretryable error ahcich0: Poll >>>> timeout on slot 30 port 0 ahcich0: is 20000000 cs 40000000 ss 00000000 >>>> rs 40000000 tfd 1d0 serr 00000800 cmd 00005e17 (aprobe0:ahcich0:0:0:0): >>>> SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 >>>> (aprobe0:ahcich0:0:0:0): CAM status: Command timeout >>>> (aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted >>>> (ada0:ahcich0:0:0:0): SETFEATURES ENABLE WCACHE. ACB: ef 02 00 00 00 40 >>>> 00 00 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: CCB request was >>>> invalid (ada0:ahcich0:0:0:0): Error 22, Unretryable error >>>> (ada0:ahcich0:0:0:0): Periph destroyed em0: Watchdog timeout Queue[0]-- >>>> resetting Interface is RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw >>>> tdh = 428, hw tdt = 471 em0: Tx Queue Status = -2147483648 em0: TX >>>> descriptors avail = 981 em0: Tx Descriptors avail failure = 0 em0: RX >>>> Queue 0 ------ em0: hw rdh = 912, hw rdt = 908 em0: RX discarded packets >>>> = 0 em0: RX Next to Check = 909 em0: RX Next to Refresh = 908 xl0: >>>> watchdog timeout em0: Watchdog timeout Queue[0]-- resetting Interface is >>>> RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw tdh = 0, hw tdt = 58 >>>> em0: Tx Queue Status = -2147483648 em0: TX descriptors avail = 966 em0: >>>> Tx Descriptors avail failure = 0 em0: RX Queue 0 ------ em0: hw rdh = 0, >>>> hw rdt = 1023 em0: RX discarded packets = 0 em0: RX Next to Check = 0 >>>> em0: RX Next to Refresh = 1023 em0: Watchdog timeout Queue[0]-- >>>> resetting Interface is RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw >>>> tdh = 0, hw tdt = 58 em0: Tx Queue Status = -2147483648 em0: TX >>>> descriptors avail = 966 em0: Tx Descriptors avail failure = 0 em0: RX >>>> Queue 0 ------ em0: hw rdh = 0, hw rdt = 1023 em0: RX discarded packets >>>> = 0 em0: RX Next to Check = 0 em0: RX Next to Refresh = 1023 xl0: >>>> watchdog timeout em0: Watchdog timeout Queue[0]-- resetting Interface is >>>> RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw tdh = 0, hw tdt = 54 >>>> em0: Tx Queue Status = -2147483648 em0: TX descriptors avail = 970 em0: >>>> Tx Descriptors avail failure = 0 em0: RX Queue 0 ------ em0: hw rdh = 0, >>>> hw rdt = 1023 em0: RX discarded packets = 0include GENERIC ident OFL >>>> options IPFIREWALL|||||| >>>> >>>> |Hi, .. I'm trying to pci passhthrough a usb controller to a bhyve >>>> windows 7 virtualization. When I start the virtual machine it freezes >>>> the entire system and this shows up on the console. To be clear the >>>> system runs without any problems without the pci passthrough. | >>>> ||(ada0:ahcich0:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 08 e0 ff 40 40 29 00 >>>> 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: CCB request was invalid >>>> (ada0:ahcich0:0:0:0): Error 22, Unretryable error >>>> (aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 >>>> 00 00 00 (aprobe0:ahcich0:0:0:0): CAM status: CCB request was invalid >>>> (aprobe0:ahcich0:0:0:0): Error 22, Unretryable error ada0 at ahcich0 bus >>>> 0 scbus0 target 0 lun 0 ada0: s/n ZA4292G6 >>>> detached (aprobe0:ahcich0:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 >>>> 00 00 00 00 00 00 (aprobe0:ahcich0:0:0:0): CAM status: CCB request was >>>> invalid (aprobe0:ahcich0:0:0:0): Error 22, Unretryable error ahcich0: >>>> Poll timeout on slot 28 port 0 ahcich0: is 20000000 cs 10000000 ss >>>> 00000000 rs 10000000 tfd 1d0 serr 00000800 cmd 00005c17 >>>> (aprobe0:ahcich0:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 >>>> 00 00 (aprobe0:ahcich0:0:0:0): CAM status: Command timeout >>>> (aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted >>>> (ada0:ahcich0:0:0:0): SETFEATURES ENABLE RCACHE. ACB: ef aa 00 00 00 40 >>>> 00 00 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: CCB request was >>>> invalid (ada0:ahcich0:0:0:0): Error 22, Unretryable error ahcich0: Poll >>>> timeout on slot 30 port 0 ahcich0: is 20000000 cs 40000000 ss 00000000 >>>> rs 40000000 tfd 1d0 serr 00000800 cmd 00005e17 (aprobe0:ahcich0:0:0:0): >>>> SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 >>>> (aprobe0:ahcich0:0:0:0): CAM status: Command timeout >>>> (aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted >>>> (ada0:ahcich0:0:0:0): SETFEATURES ENABLE WCACHE. ACB: ef 02 00 00 00 40 >>>> 00 00 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: CCB request was >>>> invalid (ada0:ahcich0:0:0:0): Error 22, Unretryable error >>>> (ada0:ahcich0:0:0:0): Periph destroyed em0: Watchdog timeout Queue[0]-- >>>> resetting Interface is RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw >>>> tdh = 428, hw tdt = 471 em0: Tx Queue Status = -2147483648 em0: TX >>>> descriptors avail = 981 em0: Tx Descriptors avail failure = 0 em0: RX >>>> Queue 0 ------ em0: hw rdh = 912, hw rdt = 908 em0: RX discarded packets >>>> = 0 em0: RX Next to Check = 909 em0: RX Next to Refresh = 908 xl0: >>>> watchdog timeout em0: Watchdog timeout Queue[0]-- resetting Interface is >>>> RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw tdh = 0, hw tdt = 58 >>>> em0: Tx Queue Status = -2147483648 em0: TX descriptors avail = 966 em0: >>>> Tx Descriptors avail failure = 0 em0: RX Queue 0 ------ em0: hw rdh = 0, >>>> hw rdt = 1023 em0: RX discarded packets = 0 em0: RX Next to Check = 0 >>>> em0: RX Next to Refresh = 1023 em0: Watchdog timeout Queue[0]-- >>>> resetting Interface is RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw >>>> tdh = 0, hw tdt = 58 em0: Tx Queue Status = -2147483648 em0: TX >>>> descriptors avail = 966 em0: Tx Descriptors avail failure = 0 em0: RX >>>> Queue 0 ------ em0: hw rdh = 0, hw rdt = 1023 em0: RX discarded packets >>>> = 0 em0: RX Next to Check = 0 em0: RX Next to Refresh = 1023 xl0: >>>> watchdog timeout em0: Watchdog timeout Queue[0]-- resetting Interface is >>>> RUNNING and ACTIVE em0: TX Queue 0 ------ em0: hw tdh = 0, hw tdt = 54 >>>> em0: Tx Queue Status = -2147483648 em0: TX descriptors avail = 970 em0: >>>> Tx Descriptors avail failure = 0 em0: RX Queue 0 ------ em0: hw rdh = 0, >>>> hw rdt = 1023 em0: RX discarded packets = 0include GENERIC ident OFL >>>> options IPFIREWALL options IPFIREWALL_VERBOSE options >>>> IPFIREWALL_DEFAULT_TO_ACCEPT options DUMMYNET options IPDIVERT options >>>> CONSPEED=115200 em0: RX Next to Check = 0 em0: RX Next to Refresh = >>>> 1023 |||| >>>> |||I've recompiled the kernel without the xhci driver. I've tested both >>>> usb controllers. Both "|||||Sunrise Point-H USB 3.0 xHCI >>>> Controller|"||||| and "|||uPD720202 USB 3.0 Host Controller|", both >>>> showed the same error on the console screen.| # uname FreeBSD >>>> 11.1-STABLE #1 r331092M # custom kernel include GENERIC ident OFL >>>> options IPFIREWALL options IPFIREWALL_VERBOSE options >>>> IPFIREWALL_DEFAULT_TO_ACCEPT options DUMMYNET options IPDIVERT options >>>> CONSPEED=115200 * note commented "device xhci" in generic # svn info >>>> |||Path: . Working Copy Root Path: /usr/src URL: >>>> https://svn0.eu.freebsd.org/base/stable/11 Relative URL: ^/stable/11 >>>> Repository Root: https://svn0.eu.freebsd.org/base Repository UUID: >>>> ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 331092 Node Kind: >>>> directory Schedule: normal Last Changed Author: eadler Last Changed Rev: >>>> 331092 Last Changed Date: 2018-03-17 07:44:39 +0100 (Sat, 17 Mar 2018) >>>> |# vm passthru DEVICE BHYVE ID READY DESCRIPTION hostb0 0/0/0 No Xeon >>>> E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers >>>> pcib1 0/1/0 No Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe >>>> Controller (x16) vgapci0 0/2/0 No HD Graphics 530 |||ppt0| 0/20/0 Yes >>>> Sunrise Point-H USB 3.0 xHCI Controller none0 0/20/2 >>>> No Sunrise Point-H Thermal subsystem none1 0/22/0 No Sunrise Point-H >>>> CSME HECI ahci0 0/23/0 No Sunrise Point-H SATA controller [AHCI mode] >>>> pcib2 0/28/0 No Sunrise Point-H PCI Express Root Port pcib4 0/28/6 No >>>> Sunrise Point-H PCI Express Root Port isab0 0/31/0 No Sunrise Point-H >>>> LPC Controller none2 0/31/2 No Sunrise Point-H PMC hdac0 0/31/3 No >>>> Sunrise Point-H HD Audio none3 0/31/4 No Sunrise Point-H SMBus em0 >>>> 0/31/6 No Ethernet Connection (2) I219-V pcib3 2/0/0 No XIO2001 PCI >>>> Express-to-PCI Bridge xl0 3/0/0 No 3c905B 100BaseTX [Cyclone] ppt1 4/0/0 >>>> Yes uPD720202 USB 3.0 Host Controller ||ppt1@pci0:4:0:0: >>>> class=0x0c0330 card=0x00151912 chip=0x00151912 rev=0x02 >>>> hdr=0x00 vendor = 'Renesas Technology Corp.' device = 'uPD720202 USB 3.0 >>>> Host Controller' class = serial bus subclass = USB >>>> |||ppt|0@pci0:0:20:0: class=0x0c0330 card=0x06ba1028 chip=0xa12f8086 >>>> rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H >>>> USB 3.0 xHCI Controller' class = serial bus subclass = USB # grep -i >>>> pptdevfs loader.conf ||pptdevs="0/20/0 4/0/0" # vm configure >>>> ||passthru0="0/20/0"| >>>> >>>> |# vm configure ||passthru0="4/0/0"| >>>> ||Any suggestions on what I'm doing wrong?|| >>>> ? Regards, Ofloo >>>> |||||| >>>> >>>> ||options IPFIREWALL_VERBOSE options IPFIREWALL_DEFAULT_TO_ACCEPT >>>> options >>>> DUMMYNET options IPDIVERT options CONSPEED=115200 em0: RX Next to Check >>>> = 0 em0: RX Next to Refresh = 1023 |||| >>>> |||I've recompiled the kernel without the xhci driver. I've tested both >>>> usb controllers. Both "|||||Sunrise Point-H USB 3.0 xHCI >>>> Controller|"||||| and "|||uPD720202 USB 3.0 Host Controller|", both >>>> showed the same error on the console screen.| # uname FreeBSD >>>> 11.1-STABLE #1 r331092M # custom kernel include GENERIC ident OFL >>>> options IPFIREWALL options IPFIREWALL_VERBOSE options >>>> IPFIREWALL_DEFAULT_TO_ACCEPT options DUMMYNET options IPDIVERT options >>>> CONSPEED=115200 * note commented "device xhci" in generic # svn info >>>> |||Path: . Working Copy Root Path: /usr/src URL: >>>> https://svn0.eu.freebsd.org/base/stable/11 Relative URL: ^/stable/11 >>>> Repository Root: https://svn0.eu.freebsd.org/base Repository UUID: >>>> ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 331092 Node Kind: >>>> directory Schedule: normal Last Changed Author: eadler Last Changed Rev: >>>> 331092 Last Changed Date: 2018-03-17 07:44:39 +0100 (Sat, 17 Mar 2018) >>>> |# vm passthru DEVICE BHYVE ID READY DESCRIPTION hostb0 0/0/0 No Xeon >>>> E3-1200 v5/E3-1500 v5/6th Gen Core Processor Host Bridge/DRAM Registers >>>> pcib1 0/1/0 No Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor PCIe >>>> Controller (x16) vgapci0 0/2/0 No HD Graphics 530 |||ppt0| 0/20/0 Yes >>>> Sunrise Point-H USB 3.0 xHCI Controller none0 0/20/2 >>>> No Sunrise Point-H Thermal subsystem none1 0/22/0 No Sunrise Point-H >>>> CSME HECI ahci0 0/23/0 No Sunrise Point-H SATA controller [AHCI mode] >>>> pcib2 0/28/0 No Sunrise Point-H PCI Express Root Port pcib4 0/28/6 No >>>> Sunrise Point-H PCI Express Root Port isab0 0/31/0 No Sunrise Point-H >>>> LPC Controller none2 0/31/2 No Sunrise Point-H PMC hdac0 0/31/3 No >>>> Sunrise Point-H HD Audio none3 0/31/4 No Sunrise Point-H SMBus em0 >>>> 0/31/6 No Ethernet Connection (2) I219-V pcib3 2/0/0 No XIO2001 PCI >>>> Express-to-PCI Bridge xl0 3/0/0 No 3c905B 100BaseTX [Cyclone] ppt1 4/0/0 >>>> Yes uPD720202 USB 3.0 Host Controller ||ppt1@pci0:4:0:0: >>>> class=0x0c0330 card=0x00151912 chip=0x00151912 rev=0x02 >>>> hdr=0x00 vendor = 'Renesas Technology Corp.' device = 'uPD720202 USB 3.0 >>>> Host Controller' class = serial bus subclass = USB >>>> |||ppt|0@pci0:0:20:0: class=0x0c0330 card=0x06ba1028 chip=0xa12f8086 >>>> rev=0x31 hdr=0x00 vendor = 'Intel Corporation' device = 'Sunrise Point-H >>>> USB 3.0 xHCI Controller' class = serial bus subclass = USB # grep -i >>>> pptdevfs loader.conf ||pptdevs="0/20/0 4/0/0" # vm configure >>>> ||passthru0="0/20/0"| >>>> >>>> |# vm configure ||passthru0="4/0/0"| >>>> ||Any suggestions on what I'm doing wrong?|| >>>> >>>> edit: previous wrapping was all wrong. >>>> ?? Regards, Ofloo >>>> |||||| >>>> >>>> > -- End of PGP section, PGP failed! > From owner-freebsd-virtualization@freebsd.org Tue Mar 27 13:58:31 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AE3CFF560F8 for ; Tue, 27 Mar 2018 13:58:31 +0000 (UTC) (envelope-from nospam@ofloo.net) Received: from spanky.ofloo.net (spanky.ofloo.net [IPv6:2001:470:c9dc:2::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "spanky.ofloo.net", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2CC9F869F9; Tue, 27 Mar 2018 13:58:31 +0000 (UTC) (envelope-from nospam@ofloo.net) Received: from [IPv6:2001:470:1f13:57f::1000] ([IPv6:2001:470:1f13:57f:0:0:0:1000]) by spanky.ofloo.net (8.15.2/8.15.2) with ESMTPS id w2RDwJvE000260 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Tue, 27 Mar 2018 15:58:19 +0200 (CEST) (envelope-from nospam@ofloo.net) X-Authentication-Warning: spanky.ofloo.net: Host [IPv6:2001:470:1f13:57f:0:0:0:1000] claimed to be [IPv6:2001:470:1f13:57f::1000] Subject: Re: bhyve pci passthrough usb controller To: Peter Grehan Cc: "Rodney W. Grimes" , freebsd-virtualization@freebsd.org References: <201803240230.w2O2U21F033917@pdx.rh.CN85.dnsmgr.net> <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> From: Wouter Snels Message-ID: Date: Tue, 27 Mar 2018 15:55:32 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <48cef2a2-f8de-1784-9094-daeb2dd7d55a@freebsd.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Spam-Status: No, score=-2.1 required=5.0 tests=ALL_TRUSTED,BAYES_00, RDNS_NONE,SPF_FAIL autolearn=no autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spanky.ofloo.net X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Mar 2018 13:58:31 -0000 It seems that this is not limited to only windows7. I tried passing through to a generic test install of freebsd 11. And this crashes as well. Regards, .. Op 25-03-18 om 03:01 schreef Peter Grehan: > >> I surely will try this out, but what about device 4/0/0 showing the >> same issue. Both tests where performed separately showing the exact >> same result, of course I'd be happy if either one of them worked. > >  I think what is happening here is that Windows is enabling legacy > interrupts on the device, and that happens to be on the same shared > IRQ line that the ATA controller is on, resulting in spurious interrupts. > >  The dmesg for the system may be able to confirm this, since it should > list the legacy IRQs that have been assigned. > >  bhyve PCI passthru relies not only on the device supporting MSI/MSI-x > interrupts, but the guest using those. > > later, > > Peter. From owner-freebsd-virtualization@freebsd.org Fri Mar 30 11:16:44 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DE4F8F60501 for ; Fri, 30 Mar 2018 11:16:43 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 779798338B for ; Fri, 30 Mar 2018 11:16:43 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from imac.bk.cs.huji.ac.il ([132.65.179.42]) by kabab.cs.huji.ac.il with esmtp id 1f1s1M-000IGF-4u for freebsd-virtualization@freebsd.org; Fri, 30 Mar 2018 14:16:36 +0300 From: Daniel Braniss Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: bhyve and arp problem Message-Id: Date: Fri, 30 Mar 2018 14:16:07 +0300 To: freebsd-virtualization@freebsd.org X-Mailer: Apple Mail (2.3445.5.20) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Mar 2018 11:16:44 -0000 hi, this is my first attempt at bhyve, and so far all seems ok, except in my guest, the mac address of the hosting keeps flipping, ie, every 20 = minutes i see a message : =E2=80=A6 arp: nnn (the hosting ip) moved from xxxx to yyyy on both the host and guest I=E2=80=99m running a very resent -stable. the yyyy is the mac of the host nic, while the xxxx is the tap0 i know this looks harmless, but it=E2=80=99s annoying danny= From owner-freebsd-virtualization@freebsd.org Fri Mar 30 15:44:45 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4CEE1F764D2 for ; Fri, 30 Mar 2018 15:44:45 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 026EA6DE97 for ; Fri, 30 Mar 2018 15:44:44 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 544D7142A4 for ; Fri, 30 Mar 2018 15:44:38 +0000 (UTC) Subject: Re: bhyve and arp problem To: freebsd-virtualization@freebsd.org References: From: Allan Jude Message-ID: <8364b0ca-1ac2-10d9-6c60-0d4057debe4b@freebsd.org> Date: Fri, 30 Mar 2018 11:44:45 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Mar 2018 15:44:45 -0000 On 2018-03-30 07:16, Daniel Braniss wrote: > hi, > this is my first attempt at bhyve, and so far all seems ok, except > in my guest, the mac address of the hosting keeps flipping, ie, every 20 minutes > i see a message : > … arp: nnn (the hosting ip) moved from xxxx to yyyy > on both the host and guest I’m running a very resent -stable. > the yyyy is the mac of the host nic, while the xxxx is the tap0 > > i know this looks harmless, but it’s annoying > > danny > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" > The MAC address is likely not changing. That sounds more like an IP conflict. -- Allan Jude From owner-freebsd-virtualization@freebsd.org Sat Mar 31 07:06:33 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6B5C5F68A76 for ; Sat, 31 Mar 2018 07:06:33 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from kabab.cs.huji.ac.il (kabab.cs.huji.ac.il [132.65.116.210]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F131175863; Sat, 31 Mar 2018 07:06:32 +0000 (UTC) (envelope-from danny@cs.huji.ac.il) Received: from imac.bk.cs.huji.ac.il ([132.65.179.42]) by kabab.cs.huji.ac.il with esmtp id 1f2Aao-000HUA-QE; Sat, 31 Mar 2018 10:06:26 +0300 Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 11.2 \(3445.5.20\)) Subject: Re: bhyve and arp problem From: Daniel Braniss In-Reply-To: <8364b0ca-1ac2-10d9-6c60-0d4057debe4b@freebsd.org> Date: Sat, 31 Mar 2018 10:06:26 +0300 Cc: freebsd-virtualization@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <6FBF3AB0-B1D1-4DFC-B4ED-88C5FAEC89FA@cs.huji.ac.il> References: <8364b0ca-1ac2-10d9-6c60-0d4057debe4b@freebsd.org> To: Allan Jude X-Mailer: Apple Mail (2.3445.5.20) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Mar 2018 07:06:33 -0000 > On 30 Mar 2018, at 18:44, Allan Jude wrote: >=20 > On 2018-03-30 07:16, Daniel Braniss wrote: >> hi, >> this is my first attempt at bhyve, and so far all seems ok, except >> in my guest, the mac address of the hosting keeps flipping, ie, every = 20 minutes >> i see a message : >> =E2=80=A6 arp: nnn (the hosting ip) moved from xxxx to yyyy >> on both the host and guest I=E2=80=99m running a very resent -stable. >> the yyyy is the mac of the host nic, while the xxxx is the tap0 >>=20 >> i know this looks harmless, but it=E2=80=99s annoying >>=20 >> danny >> _______________________________________________ >> freebsd-virtualization@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization >> To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org" >>=20 >=20 > The MAC address is likely not changing. That sounds more like an IP > conflict. I think the problem starts with the host seeing the client/guest on 2 = interfaces, the nic (mlnxen0) and the tap(tap0) on the host: arp -a ... bhv-00.cs.huji.ac.il (132.65.80.246) at xx.xx.xx.xx.xx on tap0 expires = in 1001 seconds [ethernet] bhv-00.cs.huji.ac.il (132.65.80.246) at xx.xx.xx.xx.xx on mlxen0 expires = in 644 seconds [ethernet] >=20 > --=20 > Allan Jude > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to = "freebsd-virtualization-unsubscribe@freebsd.org"