From owner-freebsd-net@freebsd.org Tue Nov 22 15:04:01 2016 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4DDCFC4F222 for ; Tue, 22 Nov 2016 15:04:01 +0000 (UTC) (envelope-from Steven@stream-technologies.com) Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0078.outbound.protection.outlook.com [104.47.1.78]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8C038139F for ; Tue, 22 Nov 2016 15:03:59 +0000 (UTC) (envelope-from Steven@stream-technologies.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=streamtechnologiesuk.onmicrosoft.com; s=selector1-streamtechnologies-com01e; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=/ujkrekcBm1hZ8xU5Ps1lKYsVPYrTWOlEcIMFjsacAc=; b=lNr/Wu7TSomglG5M3wVZhhAX26r7p+k6gRbrsVGTScuD9FEesOu4YCfRc0aWFr6ODBnNLZm8Lny/lIk8wv4wqF/0tME1ifIeaqKErQYI/SSnGXxndhX8z7VgnzLNV+jBih3+rGzwZwD9SDyOVUmSEkhnpxB1HGm3z2k5MnPb544= Received: from DB5PR07MB1685.eurprd07.prod.outlook.com (10.166.13.14) by DB5PR07MB1687.eurprd07.prod.outlook.com (10.166.13.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.747.5; Mon, 21 Nov 2016 15:25:41 +0000 Received: from DB5PR07MB1685.eurprd07.prod.outlook.com ([10.166.13.14]) by DB5PR07MB1685.eurprd07.prod.outlook.com ([10.166.13.14]) with mapi id 15.01.0747.006; Mon, 21 Nov 2016 15:25:40 +0000 From: Steven Crangle To: "freebsd-net@freebsd.org" Subject: Looking for some help with netmap/ptnetmap within a bhyve Thread-Topic: Looking for some help with netmap/ptnetmap within a bhyve Thread-Index: AQHSRAEwtfJdq2M/akKY6I+2uWxX1g== Date: Mon, 21 Nov 2016 15:25:40 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: yes X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=Steven@stream-technologies.com; x-originating-ip: [212.20.240.118] x-ms-office365-filtering-correlation-id: bc7ea0ad-5274-4ccb-347e-08d41222a727 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:DB5PR07MB1687; x-microsoft-exchange-diagnostics: 1; DB5PR07MB1687; 7:mcIueOl1/eNLsmWEGpTKBtCadbOtpqe6V4HFUaa6y10xZifNbPkhYlKjBbBEpRlYQdl4uLJIn2ilxG8kJJ8GjVuvLaEfVSOI7vYx1dIss9OwY0im8RwB0tOmPvBHUv5gnUeyqUZMwpyEov/PWE8ib+wjdCw5HVEf+kQisQr03hK0yIDmO1tBXlHalpKq72eehaRcGQvUZQw2hagoKqykOOBUQIcijDnT/PvsLEpuJGwJO0VYG4cpXicOz82KKLiFUZOjGzFnoNAg6iCKB1w3DaLUj1DuHu9LQE/aOwRPfImyKCcD7hZg6pumQ08SEFShUPQA6BK9HAfBdUDXkRoUvAVBRc4XPxt/b+o20JbliQkrPU2G1IXwieBg0/tvtrwJClVODEfpsLO6hrgTeM7o7K05fxh01p7YtXRZmAtZM3tQg4QQasxSfCKX6swqb9GAyWvsbX2BvV3Wos7yAQtE4A== x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(56005881305849)(203790808753936)(266611908612381); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(102415395)(6040307)(6045199)(6060326)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6041248)(6061324)(2016111802025)(6072148)(6043046); SRVR:DB5PR07MB1687; BCL:0; PCL:0; RULEID:; SRVR:DB5PR07MB1687; x-forefront-prvs: 01334458E5 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(7916002)(199003)(189002)(5660300001)(92566002)(106356001)(77096005)(106116001)(38730400001)(105586002)(2900100001)(122556002)(81156014)(68736007)(33656002)(7846002)(110136003)(9686002)(74316002)(2351001)(7906003)(861006)(3280700002)(7736002)(76576001)(6606003)(7696004)(6916009)(19627405001)(8936002)(81166006)(101416001)(3660700001)(66066001)(8676002)(80792005)(97736004)(6116002)(2501003)(3846002)(107886002)(99936001)(102836003)(19273905006)(575784001)(87936001)(450100001)(6506003)(5640700001)(189998001)(606004)(86362001)(54356999)(2906002)(5890100001)(50986999)(7099028)(16866105001)(473944003); DIR:OUT; SFP:1101; SCL:1; SRVR:DB5PR07MB1687; H:DB5PR07MB1685.eurprd07.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; received-spf: None (protection.outlook.com: stream-technologies.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: multipart/mixed; boundary="_004_DB5PR07MB16854389D2EB1687A1789C099BB50DB5PR07MB1685eurp_" MIME-Version: 1.0 X-OriginatorOrg: stream-technologies.com X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Nov 2016 15:25:40.5542 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 720fa073-5781-43bf-bc14-7bef2603ed21 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR07MB1687 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Nov 2016 15:04:01 -0000 --_004_DB5PR07MB16854389D2EB1687A1789C099BB50DB5PR07MB1685eurp_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Hi, I've recently been trying to boot up several bhyves so that I can test netm= ap communication between instances. The problem is, no matter what configur= ation I try, the guest vm running in bhyve completely hangs and becomes unu= sable as soon as a packet hits the netmap interface. When testing with pkt-= gen, the TX side successfully starts sending packets, but the RX side will = reliable freeze with the only option being killing the bhyve process. The bhyve command used for the above test was: bhyve -c 1 -s 0,hostbridge -s 1,lpc -s 2,virtio-blk,/dev/zvol/zroot/vip= er1vol -s 3,virtio-net,tap0,mac=3D00:01:23:45:67:83 -s 4,virtio-net,tap4= -l com1,/dev/nmdm0A -A -H -P -m 6g viper1 & bhyve -c 1 -s 0,hostbridge -s 1,lpc -s 2,virtio-blk,/dev/zvol/zroot/vip= er2vol -s 3,virtio-net,tap1,mac=3D00:01:23:45:67:84 -s 4,virtio-net,tap5= -l com1,/dev/nmdm1A -A -H -P -m 6g viper2 For this test the host OS was FreeBSD-11.0-p3 and the guest OS was FreeBSD-= 11.0-p3. After failing to get this solution working, I pulled down the source from t= he following url and installed it on the host box: https://svnweb.freebsd.org/socsvn/soc2016/vincenzo/head/ I then ran the fo= llowing commands to try and bring up the machines using the ptnetmap interf= ace (the guest still running 11.0p3) : bhyve -c 1 -s 0,hostbridge -s 1,lpc -s 1:1,virtio-blk,/dev/zvol/zroot/v= iper1vol -s 2:0,virtio-net,tap0,mac=3D00:01:23:45:67:83 -s 2:1,ptnetmap-= memdev -s 2:2,ptnet,vale0:0 -l com1,/dev/nmdm0A -A -H -P -m 6g viper1 & bhyve -c 1 -s 0,hostbridge -s 1,lpc -s 1:1,virtio-blk,/dev/zvol/zroot/v= iper2vol -s 2:0,virtio-net,tap1,mac=3D00:01:23:45:67:84 -s 2:1,ptnetmap-= memdev -s 2:2,ptnet,vale0:1 -l com1,/dev/nmdm1A -A -H -P -m 6g viper2 With the above commands the vm's fail to boot with the following message: ptnet_init: failed to get ptnetmap I've also attached a txt with the output in /var/log/messages Is there something I'm doing wrong with regards to running netmap or ptnetm= ap within a bhyve? Any pointers in the right direction will be much appreci= ated! Kind Regards Steven ________________________________ [Stream Logo] Steven Crangle Systems Developer | Stream Technologies | Glasgow, UK [http://www.stream-technologies.com/img/phone.png] +44 (0)844 800 8520 | [http://www.stream-technologies.com/img/mouse.png] www.stream-technologies.com --_004_DB5PR07MB16854389D2EB1687A1789C099BB50DB5PR07MB1685eurp_ Content-Type: application/octet-stream; name="messages_dump" Content-Description: messages_dump Content-Disposition: attachment; filename="messages_dump"; size=4146; creation-date="Mon, 21 Nov 2016 15:25:05 GMT"; modification-date="Mon, 21 Nov 2016 15:25:05 GMT" Content-Transfer-Encoding: base64 Tm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6IHRhcDA6IGxpbmsgc3RhdGUgY2hhbmdl ZCB0byBVUApOb3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtlcm5lbDogYnJpZGdlMDogbGluayBz dGF0ZSBjaGFuZ2VkIHRvIFVQCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAyNjEu MzgyMjgyIFsxMTY5XSBuZXRtYXBfZ2V0X3B0X2hvc3RfbmEgICAgIFJlcXVlc3RpbmcgYSBwdG5l dG1hcCBob3N0IGFkYXB0ZXIKTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6IDI2MS4z ODIzNzkgWzExODhdIG5ldG1hcF9nZXRfcHRfaG9zdF9uYSAgICAgZm91bmQgcGFyZW50OiB2YWxl MDowCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAyNjEuMzgyNDA5IFsxMjQ0XSBu ZXRtYXBfZ2V0X3B0X2hvc3RfbmEgICAgIHZhbGUwOjAtUFROIHB0bmV0bWFwIHJlcXVlc3QgRE9O RQpOb3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtlcm5lbDogMjYxLjM4MjQ0MyBbMTAzNV0gbm1f cHRfaG9zdF9jb25maWcgICAgICAgICByeHI6IDEgdHhyOiAxIHR4ZDogMTAyNCByeGQ6IDEwMjQK Tm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6IHRhcDI6IGxpbmsgc3RhdGUgY2hhbmdl ZCB0byBVUApOb3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtlcm5lbDogdGFwMTogbGluayBzdGF0 ZSBjaGFuZ2VkIHRvIFVQCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiB0YXAzOiBs aW5rIHN0YXRlIGNoYW5nZWQgdG8gVVAKTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6 IDI2MS40MjcwNDQgWzEwNTBdIG5tX3B0X2hvc3Rfa3JpbmdzX2NyZWF0ZSAgdmFsZTA6MC1QVE4K Tm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6IDI2MS40MjczMDUgWzExMDZdIG5tX3B0 X2hvc3RfcmVnaXN0ZXIgICAgICAgdmFsZTA6MC1QVE4gb25vZmYgMQpOb3YgMjEgMTU6MTQ6MjEg c2FjcmlmaWNlIGtlcm5lbDogMjYxLjQyNzM2MiBbMTE2OV0gbmV0bWFwX2dldF9wdF9ob3N0X25h ICAgICBSZXF1ZXN0aW5nIGEgcHRuZXRtYXAgaG9zdCBhZGFwdGVyCk5vdiAyMSAxNToxNDoyMSBz YWNyaWZpY2Uga2VybmVsOiAyNjEuNDI3NDI0IFsxMTg4XSBuZXRtYXBfZ2V0X3B0X2hvc3RfbmEg ICAgIGZvdW5kIHBhcmVudDogdmFsZTA6MgpOb3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtlcm5l bDogMjYxLjQyNzQ1OSBbMTI0NF0gbmV0bWFwX2dldF9wdF9ob3N0X25hICAgICB2YWxlMDoyLVBU TiBwdG5ldG1hcCByZXF1ZXN0IERPTkUKTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6 IDI2MS40Mjc0OTkgWzEwMzVdIG5tX3B0X2hvc3RfY29uZmlnICAgICAgICAgcnhyOiAxIHR4cjog MSB0eGQ6IDEwMjQgcnhkOiAxMDI0Ck5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAy NjEuNDY3OTU2IFsxMDUwXSBubV9wdF9ob3N0X2tyaW5nc19jcmVhdGUgIHZhbGUwOjItUFROCk5v diAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAyNjEuNDY4MjE4IFsxMTA2XSBubV9wdF9o b3N0X3JlZ2lzdGVyICAgICAgIHZhbGUwOjItUFROIG9ub2ZmIDEKTm92IDIxIDE1OjE0OjIxIHNh Y3JpZmljZSBrZXJuZWw6IDI2MS40NjgyNTQgWzExNjldIG5ldG1hcF9nZXRfcHRfaG9zdF9uYSAg ICAgUmVxdWVzdGluZyBhIHB0bmV0bWFwIGhvc3QgYWRhcHRlcgpOb3YgMjEgMTU6MTQ6MjEgc2Fj cmlmaWNlIGtlcm5lbDogMjYxLjQ2ODMyMCBbMTE4OF0gbmV0bWFwX2dldF9wdF9ob3N0X25hICAg ICBmb3VuZCBwYXJlbnQ6IHZhbGUwOjMKTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6 IDI2MS40NjgzNTEgWzEyNDRdIG5ldG1hcF9nZXRfcHRfaG9zdF9uYSAgICAgdmFsZTA6My1QVE4g cHRuZXRtYXAgcmVxdWVzdCBET05FCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAy NjEuNDY4Mzg2IFsxMDM1XSBubV9wdF9ob3N0X2NvbmZpZyAgICAgICAgIHJ4cjogMSB0eHI6IDEg dHhkOiAxMDI0IHJ4ZDogMTAyNApOb3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtlcm5lbDogMjYx LjUwNzc4MiBbMTA1MF0gbm1fcHRfaG9zdF9rcmluZ3NfY3JlYXRlICB2YWxlMDozLVBUTgpOb3Yg MjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtlcm5lbDogMjYxLjUwODA1NiBbMTEwNl0gbm1fcHRfaG9z dF9yZWdpc3RlciAgICAgICB2YWxlMDozLVBUTiBvbm9mZiAxCk5vdiAyMSAxNToxNDoyMSBzYWNy aWZpY2Uga2VybmVsOiAyNjEuNTA4MTIyIFsxMjE4XSBuZXRtYXBfYmRnX2N0bCAgICAgICAgICAg IFVzaW5nIHZuZXRfaGRyX2xlbiAxMiBmb3IgMHhmZmZmZjgwMTg2ZWQ2ODAwCk5vdiAyMSAxNTox NDoyMSBzYWNyaWZpY2Uga2VybmVsOiAyNjEuNTA4MTcwIFsxMTY5XSBuZXRtYXBfZ2V0X3B0X2hv c3RfbmEgICAgIFJlcXVlc3RpbmcgYSBwdG5ldG1hcCBob3N0IGFkYXB0ZXIKTm92IDIxIDE1OjE0 OjIxIHNhY3JpZmljZSBrZXJuZWw6IDI2MS41MDgyMjggWzExODhdIG5ldG1hcF9nZXRfcHRfaG9z dF9uYSAgICAgZm91bmQgcGFyZW50OiB2YWxlMDoxCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Ug a2VybmVsOiAyNjEuNTA4MjYxIFsxMjQ0XSBuZXRtYXBfZ2V0X3B0X2hvc3RfbmEgICAgIHZhbGUw OjEtUFROIHB0bmV0bWFwIHJlcXVlc3QgRE9ORQpOb3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtl cm5lbDogMjYxLjUwODI5NCBbMTAzNV0gbm1fcHRfaG9zdF9jb25maWcgICAgICAgICByeHI6IDEg dHhyOiAxIHR4ZDogMTAyNCByeGQ6IDEwMjQKTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJu ZWw6IDI2MS41NDQzOTkgWzEwNTBdIG5tX3B0X2hvc3Rfa3JpbmdzX2NyZWF0ZSAgdmFsZTA6MS1Q VE4KTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6IDI2MS41NDQ2NjggWzExMDZdIG5t X3B0X2hvc3RfcmVnaXN0ZXIgICAgICAgdmFsZTA6MS1QVE4gb25vZmYgMQpOb3YgMjEgMTU6MTQ6 MjEgc2FjcmlmaWNlIGtlcm5lbDogMjYxLjU0NDcwMCBbMTIxOF0gbmV0bWFwX2JkZ19jdGwgICAg ICAgICAgICBVc2luZyB2bmV0X2hkcl9sZW4gMCBmb3IgMHhmZmZmZjgwMTg2ZWQ2ODAwCk5vdiAy MSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAyNjEuNTQ0NzQzIFsxMjE4XSBuZXRtYXBfYmRn X2N0bCAgICAgICAgICAgIFVzaW5nIHZuZXRfaGRyX2xlbiAxMiBmb3IgMHhmZmZmZjgwMDA0NjY0 NDAwCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAyNjEuNTQ0Nzg4IFsxMjE4XSBu ZXRtYXBfYmRnX2N0bCAgICAgICAgICAgIFVzaW5nIHZuZXRfaGRyX2xlbiAxMiBmb3IgMHhmZmZm ZjgwMDA0OGMwNDAwCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiAyNjEuNTQ0ODM4 IFsxMjE4XSBuZXRtYXBfYmRnX2N0bCAgICAgICAgICAgIFVzaW5nIHZuZXRfaGRyX2xlbiAwIGZv ciAweGZmZmZmODAwMDQ2NjQ0MDAKTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6IDI2 MS41NDQ4OTEgWzEyMThdIG5ldG1hcF9iZGdfY3RsICAgICAgICAgICAgVXNpbmcgdm5ldF9oZHJf bGVuIDEyIGZvciAweGZmZmZmODAxYTI3NzM0MDAKTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBr ZXJuZWw6IDI2MS41NDQ5NDAgWzEyMThdIG5ldG1hcF9iZGdfY3RsICAgICAgICAgICAgVXNpbmcg dm5ldF9oZHJfbGVuIDAgZm9yIDB4ZmZmZmY4MDAwNDhjMDQwMApOb3YgMjEgMTU6MTQ6MjEgc2Fj cmlmaWNlIGtlcm5lbDogMjYxLjU0NDk4MyBbMTIxOF0gbmV0bWFwX2JkZ19jdGwgICAgICAgICAg ICBVc2luZyB2bmV0X2hkcl9sZW4gMCBmb3IgMHhmZmZmZjgwMWEyNzczNDAwCk5vdiAyMSAxNTox NDoyMSBzYWNyaWZpY2Uga2VybmVsOiB0YXAwOiBsaW5rIHN0YXRlIGNoYW5nZWQgdG8gRE9XTgpO b3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtlcm5lbDogdGFwMTogbGluayBzdGF0ZSBjaGFuZ2Vk IHRvIERPV04KTm92IDIxIDE1OjE0OjIxIHNhY3JpZmljZSBrZXJuZWw6IHRhcDI6IGxpbmsgc3Rh dGUgY2hhbmdlZCB0byBET1dOCk5vdiAyMSAxNToxNDoyMSBzYWNyaWZpY2Uga2VybmVsOiB0YXAz OiBsaW5rIHN0YXRlIGNoYW5nZWQgdG8gRE9XTgpOb3YgMjEgMTU6MTQ6MjEgc2FjcmlmaWNlIGtl cm5lbDogYnJpZGdlMDogbGluayBzdGF0ZSBjaGFuZ2VkIHRvIERPV04K --_004_DB5PR07MB16854389D2EB1687A1789C099BB50DB5PR07MB1685eurp_--