From owner-freebsd-virtualization@freebsd.org Wed Apr 25 21:37:31 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BE3F4FB101C for ; Wed, 25 Apr 2018 21:37:30 +0000 (UTC) (envelope-from paul.esson@redstor.com) Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-am5eur03on060f.outbound.protection.outlook.com [IPv6:2a01:111:f400:fe08::60f]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT TLS CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D38227158D for ; Wed, 25 Apr 2018 21:37:29 +0000 (UTC) (envelope-from paul.esson@redstor.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redstorltd.onmicrosoft.com; s=selector1-redstor-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=rGJfBjOTO7ABzs3rCQQHXEuP7aK/FKjrw3OBmOUxDu8=; b=ovtIoXoRVf2vkuWqdm0X1kc3Xg56HzixkPTCg0Wt9bdZCjkFrM5E8+AxAJkCp+FmganuQj4zCQH/Qjr2HKiAenL3gGR5gwrQ7Hl9RCbN9jGVPjG5xQHsmL8C+PkWgeJNC9f/JgHB4kp6qEkhWrb584xZuRDwqpBJ3jbbOyIrnxc= Received: from HE1PR0102MB2588.eurprd01.prod.exchangelabs.com (10.170.251.141) by HE1PR0102MB3225.eurprd01.prod.exchangelabs.com (10.167.124.30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.696.13; Wed, 25 Apr 2018 21:37:27 +0000 Received: from HE1PR0102MB2588.eurprd01.prod.exchangelabs.com ([fe80::dd48:cd01:a067:e152]) by HE1PR0102MB2588.eurprd01.prod.exchangelabs.com ([fe80::dd48:cd01:a067:e152%13]) with mapi id 15.20.0696.020; Wed, 25 Apr 2018 21:37:27 +0000 From: Paul Esson To: "Rodney W. Grimes" CC: "freebsd-virtualization@freebsd.org" Subject: Re: bhyve networking Thread-Topic: bhyve networking Thread-Index: AdPcwrhbbh0fzB+SRv2CNcsNb6p8OQABdzsAAAJH2bQAAMHYgAABdrkYAACLqoAAADVg/Q== Date: Wed, 25 Apr 2018 21:37:27 +0000 Message-ID: References: , <201804252131.w3PLVTs3098068@pdx.rh.CN85.dnsmgr.net> In-Reply-To: <201804252131.w3PLVTs3098068@pdx.rh.CN85.dnsmgr.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=paul.esson@redstor.com; x-originating-ip: [40.68.209.210] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; HE1PR0102MB3225; 7:q3l9nHS5XCFVazMkUXoXGX0vEc+qYOxoD8+J7E+dK/kfOS1XPcD3ajfpgskBnjaMZciMNAxIvtKsbcmA8oX05GB8rrkcJNiiO9FcERsi/fFiJXbUFtxiczfMJVdx8eNNzWpDRpOvt3RJlmkPt9q1RtA1R43jPDfcujJGFK62RHMBHjUBEvixXZ4uDwlH8QytRXOqc6Klo9i8maOV6lSmxQDWuy0uXeUilVaCfZUKmPqsc6fWFN9cMP0uxe7qyrug x-ms-exchange-antispam-srfa-diagnostics: SOS; x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020); SRVR:HE1PR0102MB3225; x-ms-traffictypediagnostic: HE1PR0102MB3225: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863)(209352067349851)(788757137089)(81439100147899)(75325880899374)(21532816269658)(17755550239193); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(3002001)(3231232)(944501410)(52105095)(93006095)(93001095)(10201501046)(6041310)(20161123564045)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123562045)(6072148)(201708071742011); SRVR:HE1PR0102MB3225; BCL:0; PCL:0; RULEID:; SRVR:HE1PR0102MB3225; x-forefront-prvs: 06530126A4 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(366004)(39850400004)(376002)(396003)(39380400002)(199004)(189003)(81166006)(97736004)(8676002)(54896002)(7736002)(11346002)(486006)(476003)(6506007)(6246003)(106356001)(8936002)(3660700001)(6306002)(59450400001)(86362001)(105586002)(81156014)(446003)(55016002)(53546011)(74316002)(3280700002)(4326008)(221733001)(6916009)(5250100002)(316002)(7696005)(25786009)(229853002)(99286004)(76176011)(66066001)(606006)(14454004)(44832011)(26005)(68736007)(3480700004)(186003)(6116002)(5660300001)(33656002)(7116003)(478600001)(2900100001)(3846002)(2906002)(6436002)(102836004)(53936002)(966005)(236005)(9686003)(111123002); DIR:OUT; SFP:1101; SCL:1; SRVR:HE1PR0102MB3225; H:HE1PR0102MB2588.eurprd01.prod.exchangelabs.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: redstor.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: pjoZvdypmHsideyGfw5wL2qUobEzGXE7dxBFKee2Pq91LCT4qiAFouj81BLfaGRq8a5MrChA0MXst8NAKLjZU4fDxTK3lc9r32uM2IhdguHMZcFnqbU38RG9MP0yLS++fMkzrmNsrbzEKB+WPSSIjiRjU8QtTewDGwGHwBIrO3A3G9+9WVAk6LwaMqRnto1I spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: 81642689-ca3b-4917-d455-08d5aaf4bdad X-OriginatorOrg: redstor.com X-MS-Exchange-CrossTenant-Network-Message-Id: 81642689-ca3b-4917-d455-08d5aaf4bdad X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Apr 2018 21:37:27.3352 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 24ac53ae-15a7-4211-afef-61d8f34e2571 X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0102MB3225 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2018 21:37:31 -0000 Hi Rod, Apologies, predictive testing - for trimmed read trunked. I'll get some co= mmand output when I get back online to system tomorrow. Regards, Paul Esson | Redstor Limited t +44 (0)118 951 5235 m +44 (0)776 690 6514 e paul.esson@redstor.com ________________________________ From: Rodney W. Grimes Sent: Wednesday, April 25, 2018 10:31:29 PM To: Paul Esson Cc: freebsd-virtualization@freebsd.org Subject: Re: bhyve networking > Hi Rod, > Can you share a command line for that? Its not just a single command, but you want these in /etc/rc.conf of the GU= EST: network_interfaces=3D"lo0" cloned_interfaces=3D"vlan48" ifconfig_lo0=3D" inet 127.0.0.1 netmask 0xff000000" ifconfig_vtnet0=3D" up" ifconfig_vlan48=3D" inet 192.168.48.38 netmask 0xffffff00 vlan 4= 8 vlandev vtnet0" That may be your issue... is your vtnet0 "up" in the guest. It would help a whole lot to share more of the info about your system, from commands, not from "vm-bhyve" settings. Like ifconfig -a on the host and the guest would be a starting point. > I also tried presenting an access port from my switch on a specific VLAN = - not trimmed. Trimmed? You mean you set the switch port to untagged mode, and had the switch tag/untag the packets to a specific vlan. Be sure you also set the default incoming tag at the switch if you did this= , some switches do not follow the vlan setting. > Would I still have to tag the interface on the guest in that scenario? No. If I understand what I think you meant by trimmed. > Regards, > > > Paul Esson | Redstor Limited > t +44 (0)118 951 5235 > m +44 (0)776 690 6514 > e paul.esson@redstor.com > > ________________________________ > From: Rodney W. Grimes > Sent: Wednesday, April 25, 2018 9:33:57 PM > To: Paul Esson > Cc: Harry Schmalzbauer; freebsd-virtualization@freebsd.org > Subject: Re: bhyve networking > > [ Charset windows-1252 unsupported, converting... ] > > Hi Harry, > > I?m simply using the ?vm? utility as in > > > > vm switch create public > > vm switch add public igb1 > > > > That must make underlying calls to if config or equivalent as the bridg= e and tap interfaces are created automatically. > > > > The vm template file has these relevant parameters > > > > network0_type=3D?virtio-net? > > network0_switch=3D?public? > > > > I?ve done nothing to the igb1 interface other than connect it to a phys= ical switch on the appropriate VLAN. > > How have you configured your vtnet devices inside the guest? If your pas= s a "trunked" ethernet device > to a guest the guest is going to need to run vlan decapuslation. I do th= is here, and it works fine. > > vtnet0: flags=3D8943 metr= ic 0 mtu 1500 > options=3D80028 > ether 58:9c:fc:0e:8b:ec > nd6 options=3D29 > media: Ethernet 10Gbase-T > status: active > lo0: flags=3D8049 metric 0 mtu 16384 > options=3D600003 > inet 127.0.0.1 netmask 0xff000000 > inet6 ::1 prefixlen 128 > inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 > nd6 options=3D21 > groups: lo > vlan48: flags=3D8843 metric 0 mtu= 1500 > ether 58:9c:fc:0e:8b:ec > inet 192.168.48.38 netmask 0xffffff00 broadcast 192.168.48.255 > nd6 options=3D29 > media: Ethernet 10Gbase-T > status: active > vlan: 48 vlanpcp: 0 parent interface: vtnet0 > groups: vlan > > ... > > > > Bez?glich Paul Esson's Nachricht vom 25.04.2018 20:44 (localtime): > > > Hi Folks, > > > > > > I'm struggling with networking when using vm-bhyve on FreeBSD 11.1-RE= LEASE. I have two NICs and have configured the first (igb0) on a management= network and want to use the second (igb1) for VMs. However, I can't get a= ny VM to communicate through the virtual switch if I have igb1 added to it.= If I take the NIC out of the switch and configure an ipv4 address on it I= can reach other hosts on the relevant subnet so I believe the poet set-up = is valid. If I replace igb1 in the switch with igb0, I can then configure = VMs on my management network and they have network connectivity. Can I onl= y use > > > > Hello, > > > > a example of the command you used was nice. > > I guess you're using if_bridge(4) ? the example would clarify. > > But there's ng_bridge(4) and vale(4) also, and others are using > > OpenVSwitch... > > > > > an interface that has an IP address configured at the host level bef= ore adding it to the switch? I've used other > > > > No. > > But the interface has to be in promisc mode. And some offloading > > functions must be disabled, but in case of if_bridge(4), it's done > > automagically (and reverted if you remove the interface again). > > > > Hth, > > > > -harry > > _______________________________________________ > > freebsd-virtualization@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@fr= eebsd.org" > > > > > > -- > Rod Grimes rgrimes@freebs= d.org > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@free= bsd.org" > -- Rod Grimes rgrimes@freebsd.= org