Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 6 May 2022 19:44:07 +0800
From:      Khairil Yusof <khairil.yusof@gmail.com>
To:        freebsd-questions@freebsd.org
Subject:   No route for ULA ipv6 bridged bhyve VMs until ping from host
Message-ID:  <CAMkFsd=X3%2BarX9W3JdV_WcuvtpJZZC_e7WK2RMGWM=5fwTkYNg@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
--000000000000f2e72c05de566027
Content-Type: text/plain; charset="UTF-8"

I have a bridged interface on host with VMs connected via tap like so:

vm-public: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu
1500
        ether e6:18:17:1a:62:e0
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        member: tap1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 11 priority 128 path cost 2000000
        member: tap0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 9 priority 128 path cost 2000000
        member: em1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 3 priority 128 path cost 20000
        groups: bridge vm-switch viid-4c918@
        nd6 options=9<PERFORMNUD,IFDISABLED>

The bridged host interface is configured like this:

em1: flags=8963<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0
mtu 1500

options=4812099<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,VLAN_HWFILTER,NOMAP>
        ether 00:15:17:f0:9c:d6
        inet 192.168.0.1 netmask 0xffffff00 broadcast 192.168.0.255
        inet6 fe80::215:17ff:fef0:9cd6%em1 prefixlen 64 scopeid 0x3
        inet6 fdd5:674c:9795::1 prefixlen 64
        inet6 2001:e68:545a:xxx:xxxx:xxxx:xxxx:xxxx prefixlen 64
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

Everything else works as a bridged interface should.

- VMs get IPv4 DHCP addresses, dns and works as they should including being
able
  to reach host on 192.168.0.1 from VM
- VMs get IPv6 global and local ULA addresses via SLAAC from from host, and
global addresses work as they should. VMs are able to reach ipv6 global
addresses/internet, including the ipv6 global address of em1 on host. VMs
are also able to reach link local addresses(fe:80::) including that of the
host.
- VMs are able to reach ULA fdd5:: addresses of other hosts on the network

However VMs cannot reach host ULA address on em1 of fdd5:674c:9795::1.
The VM can only reach host ULA address off dd5:674c:9795::1., after I ping
the ULA address of a VM.

There is some ipv6 routing or bridge interface setting I'm missing here (or
understanding) that makes VM not automatically have a route for the fixed
ULA ip address of the host.

Would really appreciate any pointers.

--000000000000f2e72c05de566027
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div class=3D"gmail_default" style=3D"font-family:monospac=
e,monospace">I have a bridged interface on host with VMs connected via tap =
like so:<br></div><div class=3D"gmail_default" style=3D"font-family:monospa=
ce,monospace"><br></div><div class=3D"gmail_default" style=3D"font-family:m=
onospace,monospace">vm-public: flags=3D8843&lt;UP,BROADCAST,RUNNING,SIMPLEX=
,MULTICAST&gt; metric 0 mtu 1500<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether e6:18=
:17:1a:62:e0<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:00:00 prior=
ity 32768 ifcost 0 port 0<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:0=
0:00:00 priority 32768 ifcost 0 port 0<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 root =
id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0<br>=C2=A0 =C2=A0 =C2=A0=
 =C2=A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0<br>=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port=
 0<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:00:00 priority 32768 =
ifcost 0 port 0<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 root id 00:00:00:00:00:00 pr=
iority 32768 ifcost 0 port 0<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: tap1 fl=
ags=3D143&lt;LEARNING,DISCOVER,AUTOEDGE,AUTOPTP&gt;<br>=C2=A0 =C2=A0 =C2=A0=
 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 11 priority 128 path c=
ost 2000000<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: tap0 flags=3D143&lt;LEAR=
NING,DISCOVER,AUTOEDGE,AUTOPTP&gt;<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 ifmaxaddr 0 port 9 priority 128 path cost 2000000<br>=
=C2=A0 =C2=A0 =C2=A0 =C2=A0 member: em1 flags=3D143&lt;LEARNING,DISCOVER,AU=
TOEDGE,AUTOPTP&gt;<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 ifmaxaddr 0 port 3 priority 128 path cost 20000<br>=C2=A0 =C2=A0 =C2=A0=
 =C2=A0 groups: bridge vm-switch viid-4c918@<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0=
 nd6 options=3D9&lt;PERFORMNUD,IFDISABLED&gt;</div><div class=3D"gmail_defa=
ult" style=3D"font-family:monospace,monospace"><br></div><div class=3D"gmai=
l_default" style=3D"font-family:monospace,monospace">The bridged host inter=
face is configured like this:</div><div class=3D"gmail_default" style=3D"fo=
nt-family:monospace,monospace"><br></div><div class=3D"gmail_default" style=
=3D"font-family:monospace,monospace">em1: flags=3D8963&lt;UP,BROADCAST,RUNN=
ING,PROMISC,SIMPLEX,MULTICAST&gt; metric 0 mtu 1500<br>=C2=A0 =C2=A0 =C2=A0=
 =C2=A0 options=3D4812099&lt;RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL=
_MAGIC,VLAN_HWFILTER,NOMAP&gt;<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 ether 00:15:1=
7:f0:9c:d6<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet 192.168.0.1 netmask 0xffffff=
00 broadcast 192.168.0.255<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet6 fe80::215:1=
7ff:fef0:9cd6%em1 prefixlen 64 scopeid 0x3<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 i=
net6 fdd5:674c:9795::1 prefixlen 64<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 inet6 20=
01:e68:545a:xxx:xxxx:xxxx:xxxx:xxxx prefixlen 64<br>=C2=A0 =C2=A0 =C2=A0 =
=C2=A0 media: Ethernet autoselect (1000baseT &lt;full-duplex&gt;)<br>=C2=A0=
 =C2=A0 =C2=A0 =C2=A0 status: active<br>=C2=A0 =C2=A0 =C2=A0 =C2=A0 nd6 opt=
ions=3D21&lt;PERFORMNUD,AUTO_LINKLOCAL&gt;<br></div><div class=3D"gmail_def=
ault" style=3D"font-family:monospace,monospace"><br></div><div class=3D"gma=
il_default" style=3D"font-family:monospace,monospace">Everything else works=
 as a bridged interface should.</div><div class=3D"gmail_default" style=3D"=
font-family:monospace,monospace"><br></div><div class=3D"gmail_default" sty=
le=3D"font-family:monospace,monospace">- VMs get IPv4 DHCP addresses, dns a=
nd works as they should including being able</div><div class=3D"gmail_defau=
lt" style=3D"font-family:monospace,monospace">=C2=A0 to reach host on 192.1=
68.0.1 from VM</div><div class=3D"gmail_default" style=3D"font-family:monos=
pace,monospace">- VMs get IPv6 global and local ULA addresses via SLAAC fro=
m from host, and global addresses work as they should. VMs are able to reac=
h ipv6 global addresses/internet, including the ipv6 global address of em1 =
on host. VMs are also able to reach link local addresses(fe:80::) including=
 that of the host.</div><div class=3D"gmail_default" style=3D"font-family:m=
onospace,monospace">- VMs are able to reach ULA fdd5:: addresses of other h=
osts on the network</div><div class=3D"gmail_default" style=3D"font-family:=
monospace,monospace"><br></div><div class=3D"gmail_default" style=3D"font-f=
amily:monospace,monospace">However VMs cannot reach host ULA address on em1=
 of fdd5:674c:9795::1.</div><div class=3D"gmail_default" style=3D"font-fami=
ly:monospace,monospace"></div><div class=3D"gmail_default" style=3D"font-fa=
mily:monospace,monospace">The VM can only reach host ULA address off dd5:67=
4c:9795::1., after I ping the ULA address of a VM.</div><div class=3D"gmail=
_default" style=3D"font-family:monospace,monospace"><br></div><div class=3D=
"gmail_default" style=3D"font-family:monospace,monospace">There is some ipv=
6 routing or bridge interface setting I&#39;m missing here (or understandin=
g) that makes VM not automatically have a route for the fixed ULA ip addres=
s of the host. <br></div><div class=3D"gmail_default" style=3D"font-family:=
monospace,monospace"><br></div><div class=3D"gmail_default" style=3D"font-f=
amily:monospace,monospace">Would really appreciate any pointers.</div><div =
class=3D"gmail_default" style=3D"font-family:monospace,monospace"><br></div=
><div class=3D"gmail_default" style=3D"font-family:monospace,monospace"><br=
></div></div>

--000000000000f2e72c05de566027--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAMkFsd=X3%2BarX9W3JdV_WcuvtpJZZC_e7WK2RMGWM=5fwTkYNg>