From owner-freebsd-hackers@freebsd.org Wed Dec 11 18:17:29 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5D4751DD2B2 for ; Wed, 11 Dec 2019 18:17:29 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: from puchar.net (puchar.net [194.1.144.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 47Y4sM2kmWz4SBq for ; Wed, 11 Dec 2019 18:17:26 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: Received: from 127.0.0.1 (localhost [127.0.0.1]) by puchar.net (8.15.2/8.15.2) with ESMTPS id xBBIHhQw004057 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Wed, 11 Dec 2019 19:17:44 +0100 (CET) (envelope-from puchar-wojtek@puchar.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=puchar.net; s=default; t=1576088264; bh=AUwyTYnDaGlXHpI+R7whdQ35GONmIDYQjJHpf2e5MrA=; h=Date:From:To:Subject; b=aw7yi0tLLQbpN1Idn6CC/GyRSA5OxFa2k5S8w3CPs5velEbpyPNvQjGd/nFyrd/Q+ Tkq5YI643/Ayoc5Q6E0Z7ZbpIy9j8inngIRFsp4FgQtn3w/zryXReCDHSyK18zn+Uk lXfdgpnDqRdgWHOWz4c7dQHch2b+n48AZ835FPdM= Received: from localhost (puchar-wojtek@localhost) by puchar.net (8.15.2/8.15.2/Submit) with ESMTP id xBBIHhIS004054 for ; Wed, 11 Dec 2019 19:17:43 +0100 (CET) (envelope-from puchar-wojtek@puchar.net) Date: Wed, 11 Dec 2019 19:17:43 +0100 (CET) From: Wojciech Puchar To: freebsd-hackers@freebsd.org Subject: bhyve+PCIe passthrough = UEFI fail to boot Message-ID: User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 Content-Type: multipart/mixed; BOUNDARY="1968328438-828518114-1576088263=:1013" X-Rspamd-Queue-Id: 47Y4sM2kmWz4SBq X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=fail (rsa verify failed) header.d=puchar.net header.s=default header.b=aw7yi0tL; dmarc=none; spf=pass (mx1.freebsd.org: domain of wojtek@puchar.net designates 194.1.144.90 as permitted sender) smtp.mailfrom=wojtek@puchar.net X-Spamd-Result: default: False [-2.93 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_REJECT(1.00)[puchar.net:s=default]; HAS_ATTACHMENT(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_BAD_ATTACHMENT(1.60)[png]; DMARC_NA(0.00)[puchar.net]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[puchar.net:-]; RCVD_IN_DNSWL_NONE(0.00)[90.144.1.194.list.dnswl.org : 127.0.10.0]; IP_SCORE(-3.23)[ip: (-8.54), ipnet: 194.1.144.0/24(-4.27), asn: 43476(-3.41), country: PL(0.07)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:43476, ipnet:194.1.144.0/24, country:PL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Dec 2019 18:17:29 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --1968328438-828518114-1576088263=:1013 Content-Type: text/plain; format=flowed; charset=US-ASCII i added PCIe USB controller card to server to be used in windows virtual machine, so i can have USB key (copy protection software for one app) visible directly in windows. USB key is pendrive compatible (actually you can use it as pendrive) + some propertiary functions. shouldn't matter IMHO as windows would handle it. i installed it. and as with instruction here https://wiki.freebsd.org/bhyve/pci_passthru i first booted freebsd, checked if it's detected (it was, as xhci1), then used pciconf -lv and got ppt0@pci0:2:0:0: class=0x0c0330 card=0xffffffff chip=0x01941033 rev=0x03 hdr=0x00 vendor = 'NEC Corporation' device = 'uPD720200 USB 3.0 Host Controller' class = serial bus subclass = USB so i put pptdevs="2/0/0" in loader.conf and rebooted. xhci1 doesn't show up again so everything seemed fine. then i modified my bhyve startup /usr/sbin/bhyve -s 0,hostbridge -m 22528M -H -S -c cpus=12,sockets=1,cores=12,threads=1 \ -s 7,fbuf,rfb=10.10.10.1:5900,password=passwordhere \ -s 3,ahci,hd:/dev/ada2p5.eli,hd:/dev/ada2p6.eli,hd:/dev/ada2p127.eli \ -s 5,virtio-net,tap0,mac=08:00:27:b7:ca:16 \ -s 30,virtio-rnd -s 31,lpc -U 0072c755-0e33-11ea-a92a-3c52820d28a6 \ -l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI.fd -w windows by adding -s 8,passthru,2/0/0 \ this resulted in UEFI boot failed. in uefi shell i was unable to display directory of disk drive (attached screen shot). i've tried to change -s 8 to other numbers like 2,10,20 - no difference. What i'm doing wrong? 11.3-STABLE --1968328438-828518114-1576088263=:1013 Content-Type: application/octet-stream; name=1.png Content-Transfer-Encoding: BASE64 Content-ID: Content-Description: Content-Disposition: attachment; filename=1.png iVBORw0KGgoAAAANSUhEUgAABAAAAAMAAgMAAADH1P2eAAAADFBMVEUAAAD/ /wD///+YmJgeBKWmAAAKX0lEQVR42u3dQW7jOBbGcaY1BhqBAW3sOxhZ1QEI MEdQgOQ+OYqXjT6FjkTAWwFqvvdISXZcg8zMImPy/zPi2JKSKn2RKJomaecA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAPLzo5yndonPy1S3L 10chTum+H/vRnqV1Y1UBiF52MX+ZftnNtIUEMtrz6CWMugLY+/33A3DpSags gLRP9wLYbnEdQG2nwOh/2c5f4hxDvMQwhvSoH2OUM96n8z5ECyDGCgOQ3bUA pCyQMiHtp5dTIEY744OPfgkgVnwE5AB0P9cAZNEagNx3tZYBEsA8ySFfApjl CpiOiXkqAfSu8gDkJI/rEeAsgOhKAL7CAPb/PoB4FUBcrwcVVYTWAHzUMjAV gumsD6P8wTWAXAakJfvKAkgXvGl2VhX2vksXvNkFny57sU/nu1wGU1U4PU/P ooQkpUKYeAkBAEANUi1gTNX/VAuYY5MBaDVPXvRumkDaCmCvVf2GA3CtBzB6 L42czQYQJADHEUAZQABNXwabrge0XhFqvioMAEDD1l5iuQdY1C5Qfo7Ry3uE +ga5douSfmL92I19vsVaAii9xKwHWBd9fkvYAtAOQk6WyQKf4rHvXt8oryOA 3EtMXxm5ftMrRAPYl2hsr+UdY7vVE0DuILENoBuXANx1AN0SQF9NALmPkPUA 87cBjLZVuVUYQOklZj3AfLxoANJvQA536xR58bJcbt1o3y81HgHWCeayHAHa ZywH0I/1BpDLAOsBNk/xOoC8VT/WWwYsAejOxtsA9LjwUjbUGsC+BCA9wNzm MtjLtX//uwDquQzmXmLWA8xtKkJ9qv15LwHI7tt+d7VVhNZeYtYDrJvWqnAY u7RMu9CNUgrILUyVVYUBAGjYcLh+/pS+3t3utZkA3t/zjudd3qWvw/KMAOr3 8X79vMEAjq9vw9uwS/fHVB58DMfX4/CUvhoJ4O2QysHk6fVwGAY9AgZ5dls4 1nwVaD2A400ARw3gtmyoOIDhJoDBjgBHAI0GcBiaKwNSKXAcdmm35dL3NMjz 3dDMZdBpxSf/uVva6XsBDK0G8JFu4vjqAKBVH8OHez9YY9gf7vkzLz45d3ba m9xN3uaOsMehtvfGUnVQvvRS+Pz5R7rp4rNmIOMKZIoNDcAe1/Lu6HUAg1WB T+e7AcSwBqA9iqoN4HzKu+/k+/Oy013tARzTiyBpD5QAnj9fPl/SkfByfk4x yE6HsdObPXa+qtlknDSEuKN7WwJIf/uzfD+fJICQTvngLAB77GJlAdgR8Kan wN9/5QDSrp+XUyCM6ykQxsp2/2sZIAd/OQXulQHVjTL7GkA6AKQwPN0PwFcY wL9SNWBTBkgA6TJ4OlkhuPd+KQT3Nr9YbQGIYRvA+SQFYQ7AbwKQ8Zb7ygJI VeH3UhVOJf/5+fxyekl//5dzrgpPqfo7aW8yfTwzoxgAABWyYZR236Warw2b jNqHXDfQJdIktq4JZXL+m3WbbR6Hz2NG5HHvbASB1v29rbElumBZo5Nwyw/c rNts87gB5Ml1890yqsSX8YQ+b2MBXK/bbPNYAZR7nWBZd6Ff9sOWrDvZbwK4 XbfZ5pECCDJG2Mu0+nMso4R6PSpkjS1xy2hSXePCOMfwZd26zUMFIIOjQiw7 Z8Mm+zyWTF4PyhKZaHldk4o6aSKJts4t69ZtHkjQ8WM2TNoCkGGTMtNQyHOL yxLny4BKnYMorgH02lxm69ZtHukIcLKbfjkCbNik7KatsSV2mJc1ciGUgGyd DsPTdes2Dx2A18+c8JsA5H2B7RoZWdfr8FsdYLf81LrN4wVQCq9ou+CXAGzJ GoAuzwHkrb8E4B8sAL8EYPumf9WY19gS3WZZowHIntu6fVm3bvNIVWEn0+lP ehnsorNzeJSi3dbYEjnn1zVpW5mc39s6GW6ZB1su2wAAgP/P5i/z918v5+dz eXb9zl9XGsjU+q7Y0+be3Btq0i0/MS1Ltmt/vPHDnE7n0+lUdv3mcyVjbh/K dcUSz25zb+4NNOiXDkV+WbJd+4Nvs14F8Of5dP6zBBAaDMClANz9U+AmgOWn /uMA/L0AfvQUuMSgtxTA50l7hfbjJX+sYsjrLukVQNCP47IP35Jp9WSb4yAD Ld/S/TC8Dc69DUcdayI/IcfQRdsKg36SpS3zMeiy8ptk6ay/zT7f8gcC8Mus OC+fz59nV1qEbf6gPGeQ97nZ05o4wmjbDAcbZ2hDraSThQzBscl5XJ6Mx5pE g7dl1s60/qaosxnqa8/4Iy8ZpctbtEa8dAS4800Atk73P7rlv60d5jQAG2jp NgG4w2FpPt4EkGfwTj95FYD78QCkMWOe8ikgfWSvApBZhkoA+m6Ps0O6HAHH QQdabgI4DmsA4SoA+SxLOQJstrJ7AfxInxNr5dFvdwJwemxYAG75bztr6JBH dvBvAtDOZjmAeH0EaEFobSa/OQLcTwewXAb/uwBk7OH/FsAPXA5ze57+R9eK 0NdCMH8Ery+fQbkUgtq1sAy3lELwbgBlFn/n87/V+00h6EsZ8AMBzNrMZWVA qQr3+n+VHmHlMuh9mGzS3fIZlHZZPA4y0PIjD7e0MuD9oGWHnO/ee/stnTaw yTJtaJvW3xT0cy7lXwyPNgTjtsg+fG+z3y17PN8MIH5z2QO+jrx5/nF/q/F7 ywDgR6Trtryef7Ve4lN6KTzdtgXVTavw7unVZg3x2tnFxyYDOCwB1Dca5lsB 7EoAvqkADk4asSQAGSoT8vv5XTulwO71qAOl0u4P8lpNOkddWgpAzoEcwCEH 4C4tnQLSgPHxfn0ExNYCGFwpA3zu99PWVSAHoFcB31whqAEclnqANk752FAA 0oQlc4ftdBop6x3WVFUYAICGrTOI2XSSzdUB1hnEBo2gazIAnTvGZhZtOoBd qwHYDGI7/VQBGS/YVADrDGI7LQe7xppDNjOIWaNY19ronrUMsEax5k6BzQxi g5UBrrlToMwgNuSrQHMBlBnEDlYPaKwQ3MwgphPK9jEwxhEAgEbIKA1rBtMP Xc9LRNdGfcBmipVHU54LahkS10gA+xLAXALYtxWAK81gSwCurQB+9aO1Acwy pkOGD/0KMepQySYCkI5x9grwMtl0RzqHmA4TauQIKAHEHID/lScOaqUMkADk 0rcE4BoMIDobwkYAzQaQBzH2vrkAZtfnuQFkdjCp/upAyjzkEQAA1Oy2l1hz bnuJtRnAppdY0wHsWg1g20usObe9xBo9AtZeYg2XAdZLrOEArJdYiwFc9RJr MYCrXmItVoWveomhdfNMAAQAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA AAAAAAAAAAAAAAAAAG37B4yenmdWwLsxAAAAAElFTkSuQmCC --1968328438-828518114-1576088263=:1013--