Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 12 Jun 2014 23:00:43 +0400
From:      Roman Bogorodskiy <novel@FreeBSD.org>
To:        Craig Rodrigues <rodrigc@FreeBSD.org>
Cc:        "freebsd-testing@freebsd.org" <freebsd-testing@freebsd.org>, Roman Bogorodskiy <bogorodskiy@gmail.com>, "freebsd-virtualization@freebsd.org" <freebsd-virtualization@freebsd.org>
Subject:   Re: libvirt and bhyve problems
Message-ID:  <20140612190042.GA2858@kloomba>
In-Reply-To: <CAG=rPVdqCkS2s9_QtSY4m6ThaR_zqBJcC=3jLDR3-DqwP9ZnfQ@mail.gmail.com>
References:  <CAG=rPVeKCW7WE=XUTkv_fzuqoEz8VTYb3gXOuKsVZFiczkat-Q@mail.gmail.com> <CAG=rPVd_oqrPXjMdSLJdoLM0AfB5eP4yh1_UgnaxYhP4%2BabdWw@mail.gmail.com> <CAG=rPVdWJZX9ZPinM5AqPgGocVnPQLfFbQuyRx-rhhSR1jPa=A@mail.gmail.com> <20140611182101.GD2855@kloomba> <CAG=rPVffHEFNUwtp4uFk_Sye1iMYixRaJ6D9v-LHjyUKJgkQ0g@mail.gmail.com> <20140611192514.GE2855@kloomba> <CAG=rPVcN-O=cowV7VbD8OW2dtw6BN0H54y5p9_rAPMAHwAxBhQ@mail.gmail.com> <20140612080057.GA93486@kloomba> <CAG=rPVc2jDSXuq_YM3cW_CJ9b5rpECG30Q7Vv9-XjWdsJ9uL2Q@mail.gmail.com> <CAG=rPVdqCkS2s9_QtSY4m6ThaR_zqBJcC=3jLDR3-DqwP9ZnfQ@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help

--fdj2RfSjLxBAspz7
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

  Craig Rodrigues wrote:

> On Thu, Jun 12, 2014 at 11:28 AM, Craig Rodrigues <rodrigc@freebsd.org> w=
rote:
> > On Thu, Jun 12, 2014 at 1:00 AM, Roman Bogorodskiy <novel@freebsd.org> =
wrote:
> >>
> >> http://people.freebsd.org/~novel/misc/libvirt_port_updated.tgz
> >>
> >> With this setup, I'm able to get networking (e.g. virsh net-list works)
> >> and updated the fix for the previous problem. I was able to start a VM
> >> with that setup.
> >
> >
> > I deleted the old port from my system and took your modified port,
> > built it, and installed it.
> >
> > I followed my previous steps in:
> > http://lists.freebsd.org/pipermail/freebsd-virtualization/2014-June/002=
588.html
> > and got this:
> >
> > 2014-06-12 18:23:54.328+0000: 34485605376: info : libvirt version: 1.2.5
> > 2014-06-12 18:23:54.328+0000: 34485605376: error :
> > dnsmasqCapsRefreshInternal:726 : Cannot check dnsmasq binary dnsmasq:
> > No such file or directory
> > 2014-06-12 18:23:54.328+0000: 34485605376: info :
> > networkReloadFirewallRules:1750 : Reloading iptables rules
> > 2014-06-12 18:23:54.328+0000: 34485605376: info :
> > networkRefreshDaemons:1722 : Refreshing network daemons
> > 2014-06-12 18:23:54.438+0000: 34485605376: error : virExec:417 :
> > Cannot find 'pm-is-supported' in path: No such file or directory
> > 2014-06-12 18:23:54.439+0000: 34485605376: warning :
> > virQEMUCapsInit:948 : Failed to get host power management capabilities
> > 2014-06-12 18:23:54.460+0000: 34485605376: info :
> > virDomainObjListLoadAllConfigs:18249 : Scanning for configs in
> > /usr/local/var/run/libvirt/qemu
> > 2014-06-12 18:23:54.461+0000: 34485605376: info :
> > virDomainObjListLoadAllConfigs:18249 : Scanning for configs in
> > /usr/local/etc/libvirt/qemu
> > 2014-06-12 18:23:54.560+0000: 34485605376: info :
> > virDomainObjListLoadAllConfigs:18249 : Scanning for configs in
> > /usr/local/etc/libvirt/bhyve
> > 2014-06-12 18:23:54.560+0000: 34485605376: info :
> > virDomainObjListLoadAllConfigs:18273 : Loading config file 'bhyve.xml'
> > 2014-06-12 18:24:17.940+0000: 34485598208: error :
> > virNetDevBridgeAddPort:399 : Unable to add bridge tap0 port vnet0:
> > Invalid argument
> > 2014-06-12 18:24:18.056+0000: 34485598208: error : virCommandWait:2426
> > : internal error: Child process (/usr/sbin/bhyvectl --destroy
> > --vm=3Dbhyve) unexpected exit status 255
> >
> >
> > --
> > Craig
>=20
>=20
> After the program fails, these are my tap and bridge devices, as shown
> by ifconfig:
>=20
> bridge0: flags=3D8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mt=
u 1500
>         ether 02:29:45:c7:8f:00
>         nd6 options=3D9<PERFORMNUD,IFDISABLED>
>         id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
>         maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
>         root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
>         member: em0 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
>                 ifmaxaddr 0 port 1 priority 128 path cost 20000
>         member: tap2 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
>                 ifmaxaddr 0 port 7 priority 128 path cost 2000000
>         member: tap1 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
>                 ifmaxaddr 0 port 6 priority 128 path cost 2000000
>         member: tap0 flags=3D143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
>                 ifmaxaddr 0 port 5 priority 128 path cost 2000000
> tap0: flags=3D8902<BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
>         options=3D80000<LINKSTATE>
>         ether 00:bd:53:27:00:00
>         nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>         media: Ethernet autoselect
>         status: no carrier
> tap1: flags=3D8902<BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu
> 1500
>         options=3D80000<LINKSTATE>
>         ether 00:bd:59:27:00:01
>         nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>         media: Ethernet autoselect
>         status: no carrier
> tap2: flags=3D8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST>
> metric 0 mtu 1500
>         options=3D80000<LINKSTATE>
>         ether 00:bd:5e:27:00:02
>         nd6 options=3D29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
>         media: Ethernet autoselect
>         status: active
>         Opened by PID 1506
> vnet0: flags=3D8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
>         options=3D80000<LINKSTATE>
>         ether fe:54:00:33:20:8c
>         nd6 options=3D21<PERFORMNUD,AUTO_LINKLOCAL>
>         media: Ethernet autoselect
>         status: no carrier
>=20
>=20
> This is in my /etc/rc.conf for creating bridge and tap devices on bootup:
>=20
> #####################################################
> # Create tap devices, one tap interface per BHyve VM.
> # Add the tap interfaces to bridge0
> ####################################################
> cloned_interfaces=3D"bridge0 tap0 tap1 tap2"
>=20
> autobridge_interfaces=3D"bridge0"
> autobridge_bridge0=3D"tap* em0"

Ah. Actually, libvirt manages bridges and taps on its own. So, the
preferred flow is that libvirt starts its networks on startup
automatically. By default it has a network with the 'virbr0' device
which it creates on its own.

Later on it creates vnet devices (which are tap devices) automatically
as well on VM startup and plugs them to the bridge.

The configuration you have probably confuses it, could you consider
trying without that?

Also, do you have working 'net-list' command in virsh with my version of
port?

PS If you're available for some real-time conversation such as on IRC, I
think some kind of things would be faster to discuss there.

Thanks,

Roman Bogorodskiy

--fdj2RfSjLxBAspz7
Content-Type: application/pgp-signature

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.13 (FreeBSD)

iQEcBAEBAgAGBQJTmfjaAAoJEMltX/4IwiJq4K8H/1o5UX77Kw3FO+CN/cCOt4H7
Aa06bB9vCSJrRK8qlc2HJgiXvQgC2IeczkcCJ4EVkc6tLSnSdSTtvJt6u1PKaAz1
varEsL5KMHhP9KSXfqZ7VJC4/EY/mnJRkWtUErZDnFA51i4wDEFZa7KFm19TxZHI
oP3DLkG5PwkaB+9WccuPWyNKYNwtvzYVAXsjyZKlfmC0bw5/ebWE9VWppXNoC2Ui
guDLQGo8HYa+tpxSZg11xs4Obn9aQufn7idPs6/2FV+aTiPmI7UCYs2HA3WaO3fh
BPGpQiEcG7rNQbjQ6xfsquQNv689zxm0RPK7ZeMvbtvn4dsDI9Xl7uANGYWv5Q0=
=Bs7F
-----END PGP SIGNATURE-----

--fdj2RfSjLxBAspz7--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20140612190042.GA2858>