Date: Mon, 15 Aug 2022 10:07:54 +0000 From: Benoit Chesneau <benoitc@enki-multimedia.eu> To: Benoit Chesneau <benoitc@enki-multimedia.eu> Cc: Ronald Klop <ronald-lists@klop.ws>, "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org> Subject: Re: what to check? no IPV6 pings between nodes on the same switch Message-ID: <zfer6kfZBYJkkTe-22_SStLs0QMsHdJe3WQV6h03qY2nDNBLpKopPsXiOPChXNNqZVp7X_U2RptGsA12GHJjzJD7w3COHfy6Ri1Q3F9820A=@enki-multimedia.eu> In-Reply-To: <GyTA2rUetn_DdIzJv1S7TSTlgJrbDSwo42Egc0kUsUTmCcHfeZ0MXCBtqqaUJgV4ygPEqsmKtjrbyhSOwM0HQgFhMDF5UPrmxL4psPBcd20=@enki-multimedia.eu> References: <qcer8535Q1qdsyEXRpYZO7cRAnjTNz5qlcjbiwNFg7b_13lzwo15Y0-72_pOdSZnVe2AwHHNBLJbPycVb2SCS-evQV-Of1bgpBRyr1C9RU8=@enki-multimedia.eu> <718207270.67.1660552177215@localhost> <hMqENjOsAd2Dv-OG6Ge2FxSuQuyPc73a8Y4Kp2FzSdldA7QzFJGlV2AKaQjuHd3Q-k7I8uRLZ8eR44LJ9FVRdKXQ5-I623xO8BrA5PPnU38=@enki-multimedia.eu> <GQsCACVdQaleA6RlMjW5LebnRhR9jPTsyWhhZPvVA0SOLj9keYDaUQ_dcGLZB3etCMhk7hRjg13epmaQtF0rrWpPeSZ3QkPrWoL43UZKOYg=@enki-multimedia.eu> <1540677665.110.1660556486732@localhost> <GyTA2rUetn_DdIzJv1S7TSTlgJrbDSwo42Egc0kUsUTmCcHfeZ0MXCBtqqaUJgV4ygPEqsmKtjrbyhSOwM0HQgFhMDF5UPrmxL4psPBcd20=@enki-multimedia.eu>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
So I noticed that tcpdump was enabling the "promiscuous" mode to the interface. So I tried to do it manually: `ifconfig ql0 promisc` and ping worked even after disabling this mode `ifconfig ql0 -promisc`.
What does happen when the promiscuous mode is enabled? I'm not sure to understand what is the issue :/
Benoît
------- Original Message -------
On Monday, August 15th, 2022 at 11:53, Benoit Chesneau <benoitc@enki-multimedia.eu> wrote:
> Unfortunately I get the same results with rtsold enabled and the interface up. It doesn't seems related to teh switch since link-local ping work :/
>
> Benoît
> ------- Original Message -------
> On Monday, August 15th, 2022 at 11:41, Ronald Klop <ronald-lists@klop.ws> wrote:
>
>> Set rtsold_enable="YES" in rc.conf and restart.
>> Does that help?
>>
>> "
>> DESCRIPTION
>> rtsold is the daemon program to send ICMPv6 Router Solicitation messages
>> on the specified interfaces. If a node (re)attaches to a link, rtsold
>> sends some Router Solicitations on the link destined to the link-local
>> scope all-routers multicast address to discover new routers and to get
>> non link-local addresses.
>>
>> rtsold should be used on IPv6 hosts (non-router nodes) only.
>> "
>>
>> Btw: accept_rtadv makes "rtsol" to run once on startup if you set it in rc.conf and use it to boot the machine. (BTW: for me this does not work well enough, so I run rtsold explicitly.) Setting accept_rtadv by ifconfig will not run rtsol.
>>
>> Regards,
>> Ronald.
>>
>> Van: Benoit Chesneau <benoitc@enki-multimedia.eu>
>> Datum: maandag, 15 augustus 2022 11:25
>> Aan: Benoit Chesneau <benoitc@enki-multimedia.eu>
>> CC: Ronald Klop <ronald-lists@klop.ws>, "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org>
>> Onderwerp: Re: what to check? no IPV6 pings between nodes on the same switch
>>
>>> OK here is the weird but interesting thing. When I start to capture icmp6 packets using tcpdump `tcpdump -i ql0 icmp6` then ping6 starts to work. Even after stopping the capture. Any idea what could it be ?
>>>
>>> Benoît
>>> ------- Original Message -------
>>> On Monday, August 15th, 2022 at 10:50, Benoit Chesneau <benoitc@enki-multimedia.eu> wrote:
>>>
>>>> Hi,
>>>>
>>>> Thanks for the help :) The nodes can indeed ping each others using the link-local address. What does it means? I tested to set `accept_rtadv` using the ifconfig command without much success.
>>>>
>>>> Here are the ifconfigs, the prefix is the same for all To be sure, I replaced the content by <PREFIX> using sed.
>>>>
>>>> node 1:
>>>>
>>>> ```
>>>> $ ifconfig ql0
>>>> ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>>>> options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
>>>> ether b4:7a:f1:7a:9c:10
>>>> inet6 <PREFIX>::11 prefixlen 64
>>>> inet6 fe80::b67a:f1ff:fe7a:9c10%ql0 prefixlen 64 scopeid 0x1
>>>> media: Ethernet autoselect (25GBase-SR <full-duplex>)
>>>> status: active nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>>>> ```
>>>>
>>>> node 2:
>>>>
>>>> ```
>>>> $ ifconfig ql0
>>>> ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>>>> options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
>>>> ether b4:7a:f1:7a:99:52
>>>> inet6 <PREFIX>::12 prefixlen 64
>>>> inet6 fe80::b67a:f1ff:fe7a:9952%ql0 prefixlen 64 scopeid 0x1
>>>> media: Ethernet autoselect (25GBase-SR <full-duplex>)
>>>> status: active nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>>>> ```
>>>>
>>>> node 3
>>>> ```
>>>> ifconfig ql0
>>>> ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
>>>> options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO>
>>>> ether b4:7a:f1:18:ff:d8
>>>> inet6 <PREFIX>::13 prefixlen 64
>>>> inet6 fe80::b67a:f1ff:fe18:ffd8%ql0 prefixlen 64 scopeid 0x1
>>>> media: Ethernet autoselect (25GBase-SR <full-duplex>)
>>>> status: active nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
>>>> ```
>>>>
>>>> ------- Original Message -------
>>>> On Monday, August 15th, 2022 at 10:29, Ronald Klop <ronald-lists@klop.ws> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> My rc.conf config has:
>>>>> ifconfig_genet0_ipv6="inet6 accept_rtadv"
>>>>>
>>>>> Can you post the output of "ifconfig" and "ipfw show"?
>>>>> Can you ping the link-local address of the other hosts?
>>>>>
>>>>> Regards.
>>>>> Ronald.
>>>>>
>>>>> Van: Benoit Chesneau <benoitc@enki-multimedia.eu>
>>>>> Datum: maandag, 15 augustus 2022 08:59
>>>>> Aan: "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org>
>>>>> Onderwerp: what to check? no IPV6 pings between nodes on the same switch
>>>>>
>>>>>> I have setup 3 nodes on a fresh Freebsd 13.1-RELEASE-p1. They have the same gateway and IPS are in same /64. All 3 nodes are on the same switch (mikrotik) and same vlan untagged.
>>>>>>
>>>>>> I can ping them from an external machine through the router/gateway but the nodes can't ping each others. When I run `ndp-a` it only return the gateway and the node ipv6 (+ their libks) but not the ips of the other nodes.
>>>>>>
>>>>>> Previously these nodes wee under linux and were able to ping each others.
>>>>>>
>>>>>> What could be the issue? What do I need to check?
>>>>>>
>>>>>> Configuration is pretty straightforward:
>>>>>> ```
>>>>>>
>>>>>> hostname="node1.domain.tld"
>>>>>>
>>>>>> keymap="fr.macbook.kbd"
>>>>>>
>>>>>> ifconfig_ql0=""
>>>>>>
>>>>>> ifconfig_ql0_ipv6="inet6 <PREFIX>::11/64"
>>>>>>
>>>>>> ipv6_defaultrouter="<PREFIX>::1"
>>>>>>
>>>>>> sshd_enable="YES"
>>>>>>
>>>>>> ntpd_enable="YES"
>>>>>>
>>>>>> # Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable
>>>>>>
>>>>>> dumpdev="AUTO"
>>>>>>
>>>>>> zfs_enable="YES"
>>>>>>
>>>>>> ```
>>>>>> Others machines are `<PREFIX>::12`, `<PREFIX>::13`Sent from Proton Mail for iOS
>>>>>>
>>>>>> Benoît
[-- Attachment #2 --]
<div style="font-family: arial; font-size: 14px;">So I noticed that tcpdump was enabling the "promiscuous" mode to the interface. So I tried to do it manually: `ifconfig ql0 promisc` and ping worked even after disabling this mode <span style="caret-color:rgb(0, 0, 0);background-color:rgb(255, 255, 255);display:inline !important">`ifconfig ql0 -promisc`.</span></div><div style="font-family: arial; font-size: 14px;"><span style="caret-color:rgb(0, 0, 0);background-color:rgb(255, 255, 255);display:inline !important"><br></span></div><div style="font-family: arial; font-size: 14px;">What does happen when the promiscuous mode is enabled? I'm not sure to understand what is the issue :/</div><div style="font-family: arial; font-size: 14px;"><br></div>
<div class="protonmail_signature_block" style="font-family: arial; font-size: 14px;">
<div class="protonmail_signature_block-user">
<div style="font-style:normal;font-weight:normal;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;color:rgb(0,0,0);font-family:Helvetica;font-size:12px;">Benoît </div></div></div><div class="protonmail_quote">
------- Original Message -------<br>
On Monday, August 15th, 2022 at 11:53, Benoit Chesneau <benoitc@enki-multimedia.eu> wrote:<br><br>
<blockquote class="protonmail_quote" type="cite">
<div style="font-family: arial; font-size: 14px;">Unfortunately I get the same results with rtsold enabled and the interface up. It doesn't seems related to teh switch since link-local ping work :/</div><div style="font-family: arial; font-size: 14px;"><br></div><div style="font-family: arial; font-size: 14px;"><br></div>
<div style="font-family: arial; font-size: 14px;" class="protonmail_signature_block">
<div class="protonmail_signature_block-user">
<div style="font-style:normal;font-weight:normal;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;color:rgb(0,0,0);font-family:Helvetica;font-size:12px;">Benoît</div></div></div><div class="protonmail_quote">
------- Original Message -------<br>
On Monday, August 15th, 2022 at 11:41, Ronald Klop <ronald-lists@klop.ws> wrote:<br><br>
<blockquote type="cite" class="protonmail_quote">
Set rtsold_enable="YES" in rc.conf and restart.<br>
Does that help?<br>
<br>
"<br>
DESCRIPTION<br>
rtsold is the daemon program to send ICMPv6 Router Solicitation messages<br>
on the specified interfaces. If a node (re)attaches to a link, rtsold<br>
sends some Router Solicitations on the link destined to the link-local<br>
scope all-routers multicast address to discover new routers and to get<br>
non link-local addresses.<br>
<br>
rtsold should be used on IPv6 hosts (non-router nodes) only.<br>
"<br>
<br>
Btw: accept_rtadv makes "rtsol" to run once on startup if you set it in rc.conf and use it to boot the machine. (BTW: for me this does not work well enough, so I run rtsold explicitly.) Setting accept_rtadv by ifconfig will not run rtsol.<br>
<br>
Regards,<br>
Ronald.<br>
<br>
<p><strong>Van:</strong> Benoit Chesneau <benoitc@enki-multimedia.eu><br>
<strong>Datum:</strong> maandag, 15 augustus 2022 11:25<br>
<strong>Aan:</strong> Benoit Chesneau <benoitc@enki-multimedia.eu><br>
<strong>CC:</strong> Ronald Klop <ronald-lists@klop.ws>, "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org><br>
<strong>Onderwerp:</strong> Re: what to check? no IPV6 pings between nodes on the same switch</p>
<blockquote style="padding-right: 0px; padding-left: 5px; margin-left: 5px; border-left: #000000 2px solid; margin-right: 0px">
<div class="MessageRFC822Viewer" id="P">
<div class="MultipartAlternativeViewer">
<div class="TextHTMLViewer" id="P.P.P">
<div style="font-family: arial; font-size: 14px;">OK here is the weird but interesting thing. When I start to capture icmp6 packets using tcpdump `tcpdump -i ql0 icmp6` then ping6 starts to work. Even after stopping the capture. Any idea what could it be ?</div>
<div style="font-family: arial; font-size: 14px;"> </div>
<div class="protonmail_signature_block" style="font-family: arial; font-size: 14px;">
<div class="protonmail_signature_block-user">
<div style="font-style:normal;font-weight:normal;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;color:rgb(0,0,0);font-family:Helvetica;font-size:12px;">Benoît </div>
</div>
</div>
<div class="protonmail_quote">------- Original Message -------<br>
On Monday, August 15th, 2022 at 10:50, Benoit Chesneau <benoitc@enki-multimedia.eu> wrote:<br>
<blockquote class="protonmail_quote">
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">Hi,</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">Thanks for the help :) The nodes can indeed ping each others using the link-local address. What does it means? I tested to set `<span>accept_rtadv` using the ifconfig command without much success.</span></div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">Here are the ifconfigs, the prefix is the same for all To be sure, I replaced the content by <PREFIX> using sed.</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">node 1:</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">```</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"><span> $ ifconfig ql0</span>
<div><span>ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500</span></div>
<div><span>options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO></span></div>
<div><span>ether b4:7a:f1:7a:9c:10</span></div>
<div><span>inet6 <PREFIX>::11 prefixlen 64</span></div>
<div><span>inet6 fe80::b67a:f1ff:fe7a:9c10%ql0 prefixlen 64 scopeid 0x1</span></div>
<div><span>media: Ethernet autoselect (25GBase-SR <full-duplex>)</span></div>
<div><span>status: active</span></div>
<span> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL></span></div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">```</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">node 2:</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"><span style="caret-color:rgb(0, 0, 0);background-color:rgb(255, 255, 255)">```</span></div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"><span> $ ifconfig ql0</span>
<div><span>ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500</span></div>
<div><span>options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO></span></div>
<div><span>ether b4:7a:f1:7a:99:52</span></div>
<div><span>inet6 <PREFIX>::12 prefixlen 64</span></div>
<div><span>inet6 fe80::b67a:f1ff:fe7a:9952%ql0 prefixlen 64 scopeid 0x1</span></div>
<div><span>media: Ethernet autoselect (25GBase-SR <full-duplex>)</span></div>
<div><span>status: active</span></div>
<span> nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL></span></div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">```</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"><span>node 3</span></div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">```</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"><span>ifconfig ql0</span></div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">
<div><span>ql0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500</span></div>
<div><span>options=507bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWFILTER,VLAN_HWTSO></span></div>
<div><span>ether b4:7a:f1:18:ff:d8</span></div>
<div><span>inet6 <PREFIX>::13 prefixlen 64</span></div>
<div><span>inet6 fe80::b67a:f1ff:fe18:ffd8%ql0 prefixlen 64 scopeid 0x1</span></div>
<div><span>media: Ethernet autoselect (25GBase-SR <full-duplex>)</span></div>
<div><span>status: active</span></div>
<span>nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL></span></div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);">```</div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div style="font-family: arial; font-size: 14px; color: rgb(0, 0, 0);"> </div>
<div class="protonmail_quote">------- Original Message -------<br>
On Monday, August 15th, 2022 at 10:29, Ronald Klop <ronald-lists@klop.ws> wrote:<br>
<blockquote class="protonmail_quote">Hi,<br>
<br>
My rc.conf config has:<br>
ifconfig_genet0_ipv6="inet6 accept_rtadv"<br>
<br>
Can you post the output of "ifconfig" and "ipfw show"?<br>
Can you ping the link-local address of the other hosts?<br>
<br>
Regards.<br>
Ronald.<br>
<br>
<p><strong>Van:</strong> Benoit Chesneau <benoitc@enki-multimedia.eu><br>
<strong>Datum:</strong> maandag, 15 augustus 2022 08:59<br>
<strong>Aan:</strong> "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org><br>
<strong>Onderwerp:</strong> what to check? no IPV6 pings between nodes on the same switch</p>
<blockquote style="padding-right: 0px; padding-left: 5px; margin-left: 5px; border-left: #000000 2px solid; margin-right: 0px">
<div class="MessageRFC822Viewer" id="P">
<div class="MultipartAlternativeViewer">
<div class="TextHTMLViewer" id="P.P.P">
<div> </div>
<span>I have setup 3 nodes on a fresh Freebsd 13.1-RELEASE-p1. They have the same gateway and IPS are in same /64. All 3 nodes are on the same switch (mikrotik) and same vlan untagged.</span><br>
<br>
<span>I can ping them from an external machine through the router/gateway but </span><span>the nodes can't ping each others.</span><span> When I run `ndp-a` it only return the gateway and the node ipv6 (+ their libks) but not the ips of the other nodes.</span><br>
<br>
<span>Previously these nodes wee under linux and were able to ping each others.</span><br>
<br>
<span>What could be the issue? What do I need to check?</span><br>
<br>
<span>Configuration is pretty straightforward:</span>
<div>
<div>```</div>
<div>
<p>hostname="node1.domain.tld"</p>
<p><span style="color: var(--text-color); background: var(--bg-color);">keymap="fr.macbook.kbd"</span></p>
<p>ifconfig_ql0=""</p>
<p>ifconfig_ql0_ipv6="inet6 <PREFIX>::11/64"</p>
<p>ipv6_defaultrouter="<PREFIX>::1"</p>
<p>sshd_enable="YES"</p>
<p>ntpd_enable="YES"</p>
<p># Set dumpdev to "AUTO" to enable crash dumps, "NO" to disable</p>
<p>dumpdev="AUTO"</p>
<p>zfs_enable="YES"</p>
<font color="#141414" face="Segoe UI, Helvetica Neue, Helvetica, Roboto, Oxygen, Ubuntu, Cantarell, Fira Sans, Droid Sans, sans-serif"><span>```</span></font></div>
<div>
<div><span><span>Others machines are `<PREFIX>::12`, `<PREFIX>::13`</span>Sent from Proton Mail for iOS</span></div>
</div>
</div>
<div> </div>
<div><span>Benoît </span></div>
</div>
</div>
</div>
</blockquote>
</blockquote>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</blockquote>
</blockquote><br>
</div>
</blockquote><br>
</div>
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?zfer6kfZBYJkkTe-22_SStLs0QMsHdJe3WQV6h03qY2nDNBLpKopPsXiOPChXNNqZVp7X_U2RptGsA12GHJjzJD7w3COHfy6Ri1Q3F9820A=>