Date: Mon, 15 Aug 2022 12:14:31 +0200 From: John Hay <jhay@meraka.org.za> To: Benoit Chesneau <benoitc@enki-multimedia.eu> Cc: "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org> Subject: Re: what to check? no IPV6 pings between nodes on the same switch Message-ID: <CAGv8uar9BnYycuQMsGysrEi49ZfsJA-TUpLpGxjvnTum_AejpA@mail.gmail.com> In-Reply-To: <zfer6kfZBYJkkTe-22_SStLs0QMsHdJe3WQV6h03qY2nDNBLpKopPsXiOPChXNNqZVp7X_U2RptGsA12GHJjzJD7w3COHfy6Ri1Q3F9820A=@enki-multimedia.eu> References: <qcer8535Q1qdsyEXRpYZO7cRAnjTNz5qlcjbiwNFg7b_13lzwo15Y0-72_pOdSZnVe2AwHHNBLJbPycVb2SCS-evQV-Of1bgpBRyr1C9RU8=@enki-multimedia.eu> <718207270.67.1660552177215@localhost> <hMqENjOsAd2Dv-OG6Ge2FxSuQuyPc73a8Y4Kp2FzSdldA7QzFJGlV2AKaQjuHd3Q-k7I8uRLZ8eR44LJ9FVRdKXQ5-I623xO8BrA5PPnU38=@enki-multimedia.eu> <GQsCACVdQaleA6RlMjW5LebnRhR9jPTsyWhhZPvVA0SOLj9keYDaUQ_dcGLZB3etCMhk7hRjg13epmaQtF0rrWpPeSZ3QkPrWoL43UZKOYg=@enki-multimedia.eu> <1540677665.110.1660556486732@localhost> <GyTA2rUetn_DdIzJv1S7TSTlgJrbDSwo42Egc0kUsUTmCcHfeZ0MXCBtqqaUJgV4ygPEqsmKtjrbyhSOwM0HQgFhMDF5UPrmxL4psPBcd20=@enki-multimedia.eu> <zfer6kfZBYJkkTe-22_SStLs0QMsHdJe3WQV6h03qY2nDNBLpKopPsXiOPChXNNqZVp7X_U2RptGsA12GHJjzJD7w3COHfy6Ri1Q3F9820A=@enki-multimedia.eu>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
Hi Benoit,
It will allow multicast packets to go through, which IPv6 depends on. Maybe
there is a problem setting up the multicast filter for that driver / card.
Regards
John
On Mon, 15 Aug 2022 at 12:08, Benoit Chesneau <benoitc@enki-multimedia.eu>
wrote:
> So I noticed that tcpdump was enabling the "promiscuous" mode to the
> interface. So I tried to do it manually: `ifconfig ql0 promisc` and ping
> worked even after disabling this mode `ifconfig ql0 -promisc`.
>
> What does happen when the promiscuous mode is enabled? I'm not sure to
> understand what is the issue :/
>
> Benoît
> ------- Original Message -------
> On Monday, August 15th, 2022 at 11:53, Benoit Chesneau <
> benoitc@enki-multimedia.eu> wrote:
>
> Unfortunately I get the same results with rtsold enabled and the interface
> up. It doesn't seems related to teh switch since link-local ping work :/
>
>
> Benoît
> ------- Original Message -------
> On Monday, August 15th, 2022 at 11:41, Ronald Klop <ronald-lists@klop.ws>
> wrote:
>
> Set rtsold_enable="YES" in rc.conf and restart.
> Does that help?
>
> "
> DESCRIPTION
> rtsold is the daemon program to send ICMPv6 Router Solicitation
> messages
> on the specified interfaces. If a node (re)attaches to a link, rtsold
> sends some Router Solicitations on the link destined to the link-local
> scope all-routers multicast address to discover new routers and to get
> non link-local addresses.
>
> rtsold should be used on IPv6 hosts (non-router nodes) only.
> "
>
> Btw: accept_rtadv makes "rtsol" to run once on startup if you set it in
> rc.conf and use it to boot the machine. (BTW: for me this does not work
> well enough, so I run rtsold explicitly.) Setting accept_rtadv by ifconfig
> will not run rtsol.
>
> Regards,
> Ronald.
>
>
>
> *Van:* Benoit Chesneau <benoitc@enki-multimedia.eu>
> *Datum:* maandag, 15 augustus 2022 11:25
> *Aan:* Benoit Chesneau <benoitc@enki-multimedia.eu>
> *CC:* Ronald Klop <ronald-lists@klop.ws>, "freebsd-net@FreeBSD.org" <
> freebsd-net@freebsd.org>
> *Onderwerp:* Re: what to check? no IPV6 pings between nodes on the same
> switch
>
> OK here is the weird but interesting thing. When I start to capture icmp6
> packets using tcpdump `tcpdump -i ql0 icmp6` then ping6 starts to work.
> Even after stopping the capture. Any idea what could it be ?
>
> Benoît
> ------- Original Message -------
> On Monday, August 15th, 2022 at 10:50, Benoit Chesneau <
> benoitc@enki-multimedia.eu> wrote:
>
>
> Hi,
>
> Thanks for the help :) The nodes can indeed ping each others using the
> link-local address. What does it means? I tested to set `accept_rtadv`
> using the ifconfig command without much success.
>
>
> Here are the ifconfigs, the prefix is the same for all To be sure, I
> replaced the content by <PREFIX> using sed.
>
> node 1:
>
> ```
> $ ifconfig ql0
> ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>
> options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
> ether b4:7a:f1:7a:9c:10
> inet6 <PREFIX>::11 prefixlen 64
> inet6 fe80::b67a:f1ff:fe7a:9c10%ql0 prefixlen 64 scopeid 0x1
> media: Ethernet autoselect (25GBase-SR <full-duplex>)
> status: active
> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
> ```
>
> node 2:
>
> ```
> $ ifconfig ql0
> ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>
> options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
> ether b4:7a:f1:7a:99:52
> inet6 <PREFIX>::12 prefixlen 64
> inet6 fe80::b67a:f1ff:fe7a:9952%ql0 prefixlen 64 scopeid 0x1
> media: Ethernet autoselect (25GBase-SR <full-duplex>)
> status: active
> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
> ```
>
> node 3
> ```
> ifconfig ql0
> ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>
> options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
> ether b4:7a:f1:18:ff:d8
> inet6 <PREFIX>::13 prefixlen 64
> inet6 fe80::b67a:f1ff:fe18:ffd8%ql0 prefixlen 64 scopeid 0x1
> media: Ethernet autoselect (25GBase-SR <full-duplex>)
> status: active
> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
> ```
>
>
> ------- Original Message -------
> On Monday, August 15th, 2022 at 10:29, Ronald Klop <ronald-lists@klop.ws>
> wrote:
>
>
> Hi,
>
> My rc.conf config has:
> ifconfig_genet0_ipv6="inet6 accept_rtadv"
>
> Can you post the output of "ifconfig" and "ipfw show"?
> Can you ping the link-local address of the other hosts?
>
> Regards.
> Ronald.
>
>
>
> *Van:* Benoit Chesneau <benoitc@enki-multimedia.eu>
> *Datum:* maandag, 15 augustus 2022 08:59
> *Aan:* "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org>
> *Onderwerp:* what to check? no IPV6 pings between nodes on the same switch
>
>
> I have setup 3 nodes on a fresh Freebsd 13.1-RELEASE-p1. They have the
> same gateway and IPS are in same /64. All 3 nodes are on the same switch
> (mikrotik) and same vlan untagged.
>
> I can ping them from an external machine through the router/gateway but the
> nodes can't ping each others. When I run `ndp-a` it only return the
> gateway and the node ipv6 (+ their libks) but not the ips of the other
> nodes.
>
> Previously these nodes wee under linux and were able to ping each others.
>
> What could be the issue? What do I need to check?
>
> Configuration is pretty straightforward:
>
> ```
>
> hostname="node1.domain.tld"
>
> keymap="fr.macbook.kbd"
>
> ifconfig_ql0=""
>
> ifconfig_ql0_ipv6="inet6 <PREFIX>::11/64"
>
> ipv6_defaultrouter="<PREFIX>::1"
>
> sshd_enable="YES"
>
> ntpd_enable="YES"
>
> # Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable
>
> dumpdev="AUTO"
>
> zfs_enable="YES"
> ```
>
> Others machines are `<PREFIX>::12`, `<PREFIX>::13`Sent from Proton Mail
> for iOS
>
> Benoît
>
>
>
>
[-- Attachment #2 --]
<div dir="ltr"><div>Hi Benoit,</div><div><br></div><div>It will allow multicast packets to go through, which IPv6 depends on. Maybe there is a problem setting up the multicast filter for that driver / card.</div><div><br></div><div>Regards</div><div><br></div><div>John</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, 15 Aug 2022 at 12:08, Benoit Chesneau <<a href="mailto:benoitc@enki-multimedia.eu">benoitc@enki-multimedia.eu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div style="font-family:arial;font-size:14px">So I noticed that tcpdump was enabling the "promiscuous" mode to the interface. So I tried to do it manually: `ifconfig ql0 promisc` and ping worked even after disabling this mode <span style="background-color:rgb(255,255,255);display:inline">`ifconfig ql0 -promisc`.</span></div><div style="font-family:arial;font-size:14px"><span style="background-color:rgb(255,255,255);display:inline"><br></span></div><div style="font-family:arial;font-size:14px">What does happen when the promiscuous mode is enabled? I'm not sure to understand what is the issue :/</div><div style="font-family:arial;font-size:14px"><br></div>
<div style="font-family:arial;font-size:14px">
<div>
<div style="font-style:normal;font-weight:normal;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;color:rgb(0,0,0);font-family:Helvetica;font-size:12px">Benoît </div></div></div><div>
------- Original Message -------<br>
On Monday, August 15th, 2022 at 11:53, Benoit Chesneau <<a href="mailto:benoitc@enki-multimedia.eu" target="_blank">benoitc@enki-multimedia.eu</a>> wrote:<br><br>
<blockquote type="cite">
<div style="font-family:arial;font-size:14px">Unfortunately I get the same results with rtsold enabled and the interface up. It doesn't seems related to teh switch since link-local ping work :/</div><div style="font-family:arial;font-size:14px"><br></div><div style="font-family:arial;font-size:14px"><br></div>
<div style="font-family:arial;font-size:14px">
<div>
<div style="font-style:normal;font-weight:normal;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;color:rgb(0,0,0);font-family:Helvetica;font-size:12px">Benoît</div></div></div><div>
------- Original Message -------<br>
On Monday, August 15th, 2022 at 11:41, Ronald Klop <<a href="mailto:ronald-lists@klop.ws" target="_blank">ronald-lists@klop.ws</a>> wrote:<br><br>
<blockquote type="cite">
Set rtsold_enable="YES" in rc.conf and restart.<br>
Does that help?<br>
<br>
"<br>
DESCRIPTION<br>
rtsold is the daemon program to send ICMPv6 Router Solicitation messages<br>
on the specified interfaces. If a node (re)attaches to a link, rtsold<br>
sends some Router Solicitations on the link destined to the link-local<br>
scope all-routers multicast address to discover new routers and to get<br>
non link-local addresses.<br>
<br>
rtsold should be used on IPv6 hosts (non-router nodes) only.<br>
"<br>
<br>
Btw: accept_rtadv makes "rtsol" to run once on startup if you set it in rc.conf and use it to boot the machine. (BTW: for me this does not work well enough, so I run rtsold explicitly.) Setting accept_rtadv by ifconfig will not run rtsol.<br>
<br>
Regards,<br>
Ronald.<br>
<br>
<p><strong>Van:</strong> Benoit Chesneau <<a href="mailto:benoitc@enki-multimedia.eu" target="_blank">benoitc@enki-multimedia.eu</a>><br>
<strong>Datum:</strong> maandag, 15 augustus 2022 11:25<br>
<strong>Aan:</strong> Benoit Chesneau <<a href="mailto:benoitc@enki-multimedia.eu" target="_blank">benoitc@enki-multimedia.eu</a>><br>
<strong>CC:</strong> Ronald Klop <<a href="mailto:ronald-lists@klop.ws" target="_blank">ronald-lists@klop.ws</a>>, "freebsd-net@FreeBSD.org" <<a href="mailto:freebsd-net@freebsd.org" target="_blank">freebsd-net@freebsd.org</a>><br>
<strong>Onderwerp:</strong> Re: what to check? no IPV6 pings between nodes on the same switch</p>
<blockquote style="padding-right:0px;padding-left:5px;margin-left:5px;border-left:2px solid rgb(0,0,0);margin-right:0px">
<div id="gmail-m_-5598946522798820636P">
<div>
<div id="gmail-m_-5598946522798820636P.P.P">
<div style="font-family:arial;font-size:14px">OK here is the weird but interesting thing. When I start to capture icmp6 packets using tcpdump `tcpdump -i ql0 icmp6` then ping6 starts to work. Even after stopping the capture. Any idea what could it be ?</div>
<div style="font-family:arial;font-size:14px"> </div>
<div style="font-family:arial;font-size:14px">
<div>
<div style="font-style:normal;font-weight:normal;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;color:rgb(0,0,0);font-family:Helvetica;font-size:12px">Benoît </div>
</div>
</div>
<div>------- Original Message -------<br>
On Monday, August 15th, 2022 at 10:50, Benoit Chesneau <<a href="mailto:benoitc@enki-multimedia.eu" target="_blank">benoitc@enki-multimedia.eu</a>> wrote:<br>
<blockquote>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">Hi,</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">Thanks for the help :) The nodes can indeed ping each others using the link-local address. What does it means? I tested to set `<span>accept_rtadv` using the ifconfig command without much success.</span></div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">Here are the ifconfigs, the prefix is the same for all To be sure, I replaced the content by <PREFIX> using sed.</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">node 1:</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">```</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"><span> $ ifconfig ql0</span>
<div><span>ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500</span></div>
<div><span>options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO></span></div>
<div><span>ether b4:7a:f1:7a:9c:10</span></div>
<div><span>inet6 <PREFIX>::11 prefixlen 64</span></div>
<div><span>inet6 fe80::b67a:f1ff:fe7a:9c10%ql0 prefixlen 64 scopeid 0x1</span></div>
<div><span>media: Ethernet autoselect (25GBase-SR <full-duplex>)</span></div>
<div><span>status: active</span></div>
<span> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL></span></div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">```</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">node 2:</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"><span style="background-color:rgb(255,255,255)">```</span></div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"><span> $ ifconfig ql0</span>
<div><span>ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500</span></div>
<div><span>options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO></span></div>
<div><span>ether b4:7a:f1:7a:99:52</span></div>
<div><span>inet6 <PREFIX>::12 prefixlen 64</span></div>
<div><span>inet6 fe80::b67a:f1ff:fe7a:9952%ql0 prefixlen 64 scopeid 0x1</span></div>
<div><span>media: Ethernet autoselect (25GBase-SR <full-duplex>)</span></div>
<div><span>status: active</span></div>
<span> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL></span></div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">```</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"><span>node 3</span></div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">```</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"><span>ifconfig ql0</span></div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">
<div><span>ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500</span></div>
<div><span>options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO></span></div>
<div><span>ether b4:7a:f1:18:ff:d8</span></div>
<div><span>inet6 <PREFIX>::13 prefixlen 64</span></div>
<div><span>inet6 fe80::b67a:f1ff:fe18:ffd8%ql0 prefixlen 64 scopeid 0x1</span></div>
<div><span>media: Ethernet autoselect (25GBase-SR <full-duplex>)</span></div>
<div><span>status: active</span></div>
<span>nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL></span></div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)">```</div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div style="font-family:arial;font-size:14px;color:rgb(0,0,0)"> </div>
<div>------- Original Message -------<br>
On Monday, August 15th, 2022 at 10:29, Ronald Klop <<a href="mailto:ronald-lists@klop.ws" target="_blank">ronald-lists@klop.ws</a>> wrote:<br>
<blockquote>Hi,<br>
<br>
My rc.conf config has:<br>
ifconfig_genet0_ipv6="inet6 accept_rtadv"<br>
<br>
Can you post the output of "ifconfig" and "ipfw show"?<br>
Can you ping the link-local address of the other hosts?<br>
<br>
Regards.<br>
Ronald.<br>
<br>
<p><strong>Van:</strong> Benoit Chesneau <<a href="mailto:benoitc@enki-multimedia.eu" target="_blank">benoitc@enki-multimedia.eu</a>><br>
<strong>Datum:</strong> maandag, 15 augustus 2022 08:59<br>
<strong>Aan:</strong> "freebsd-net@FreeBSD.org" <<a href="mailto:freebsd-net@freebsd.org" target="_blank">freebsd-net@freebsd.org</a>><br>
<strong>Onderwerp:</strong> what to check? no IPV6 pings between nodes on the same switch</p>
<blockquote style="padding-right:0px;padding-left:5px;margin-left:5px;border-left:2px solid rgb(0,0,0);margin-right:0px">
<div id="gmail-m_-5598946522798820636P">
<div>
<div id="gmail-m_-5598946522798820636P.P.P">
<div> </div>
<span>I have setup 3 nodes on a fresh Freebsd 13.1-RELEASE-p1. They have the same gateway and IPS are in same /64. All 3 nodes are on the same switch (mikrotik) and same vlan untagged.</span><br>
<br>
<span>I can ping them from an external machine through the router/gateway but </span><span>the nodes can't ping each others.</span><span> When I run `ndp-a` it only return the gateway and the node ipv6 (+ their libks) but not the ips of the other nodes.</span><br>
<br>
<span>Previously these nodes wee under linux and were able to ping each others.</span><br>
<br>
<span>What could be the issue? What do I need to check?</span><br>
<br>
<span>Configuration is pretty straightforward:</span>
<div>
<div>```</div>
<div>
<p>hostname="node1.domain.tld"</p>
<p><span>keymap="fr.macbook.kbd"</span></p>
<p>ifconfig_ql0=""</p>
<p>ifconfig_ql0_ipv6="inet6 <PREFIX>::11/64"</p>
<p>ipv6_defaultrouter="<PREFIX>::1"</p>
<p>sshd_enable="YES"</p>
<p>ntpd_enable="YES"</p>
<p># Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable</p>
<p>dumpdev="AUTO"</p>
<p>zfs_enable="YES"</p>
<font face="Segoe UI, Helvetica Neue, Helvetica, Roboto, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, sans-serif" color="#141414"><span>```</span></font></div>
<div>
<div><span><span>Others machines are `<PREFIX>::12`, `<PREFIX>::13`</span>Sent from Proton Mail for iOS</span></div>
</div>
</div>
<div> </div>
<div><span>Benoît </span></div>
</div>
</div>
</div>
</blockquote>
</blockquote>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</blockquote><br>
</div>
</blockquote><br>
</div></blockquote></div>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGv8uar9BnYycuQMsGysrEi49ZfsJA-TUpLpGxjvnTum_AejpA>