Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 25 Jan 2024 22:10:49 +0100
From:      Santiago Martinez <sm@codenetworks.net>
To:        Daniel <freebsd-net@c0decafe.de>
Cc:        Zhenlei Huang <zlei@freebsd.org>, freebsd-net@freebsd.org
Subject:   Re: problem with ixl(4) and vlans
Message-ID:  <063A269F-B479-4A43-8E3B-B044C2E779F0@codenetworks.net>
In-Reply-To: <401ae00d-730c-4ac7-a18c-a2b1b75b3edf@c0decafe.de>
References:  <401ae00d-730c-4ac7-a18c-a2b1b75b3edf@c0decafe.de>

next in thread | previous in thread | raw e-mail | index | archive | help

--Apple-Mail-63F0A263-997C-4872-BFBB-3F96575D20C1
Content-Type: text/html;
	charset=utf-8
Content-Transfer-Encoding: quoted-printable

<html><head><meta http-equiv=3D"content-type" content=3D"text/html; charset=3D=
utf-8"></head><body dir=3D"auto"><div dir=3D"ltr"></div><div dir=3D"ltr">Hi D=
aniel,&nbsp;</div><div dir=3D"ltr"><br></div><div dir=3D"ltr">have you try d=
isabling hardware vlan filtering?</div><div dir=3D"ltr"><br></div><div dir=3D=
"ltr">Also I guess there is not ipfw or pf modules loaded right?</div><div d=
ir=3D"ltr"><br></div><div dir=3D"ltr">Best&nbsp;</div><div dir=3D"ltr">Santi=
</div><div dir=3D"ltr"><br><blockquote type=3D"cite">On 25 Jan 2024, at 10:0=
7, Daniel &lt;freebsd-net@c0decafe.de&gt; wrote:<br><br></blockquote></div><=
blockquote type=3D"cite"><div dir=3D"ltr">=EF=BB=BF

 =20
    <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DUTF-8"=
>
 =20
 =20
    <p>Hi,</p>
    <p>thanks for your suggestion. Turns out, when i unplug the vlan
      interface from the bridge and put the ip address on the vlan
      interface, as you suggested, things start to work, e.g. arp
      resolves.</p>
    <p>as soon as i put the ip and the vlan interface back on the
      bridge, things stop again. so where does this lead me? the problem
      is not in the vlan handling, but on the bridge? <br>
    </p>
    <p>I started playing with the net.link.bridge sysctls and indeed,
      when i set <br>
    </p>
    <p><br>
    </p>
    <p># sysctl net.link.bridge.inherit_mac=3D1</p>
    <p><br>
    </p>
    <p>and then recreate the bridge</p>
    <p><br>
    </p>
    <p># ifconfig bridge0 deletem ixl3.15 deletem vnet0.1<br>
      # ifconfig bridge0 addm ixl3.15 addm vnet0.1</p>
    <p><br>
    </p>
    <p>with the ip address still on bridge0 and ixl3, ixl3.15 and
      bridge0 all sharing the same mac address, arp starts resolving.
      but only for requests sent from the bridge0 interface. inside of
      the jail things still don't work (as the vnet interface again has
      another mac address).</p>
    <p><br>
    </p>
    <p># ifconfig ixl3 <br>
      ixl3:
      flags=3D28963&lt;UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST&gt;
      metric 0 mtu 1500<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
options=3D4a500b9&lt;RXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VL=
AN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,NOMAP&gt;<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ether a4:bf:01:76:ef:9d<br>=

      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; media: Ethernet autoselect (=
10Gbase-SR
      &lt;full-duplex&gt;)<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; status: active<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nd6 options=3D29&lt;PERFORM=
NUD,IFDISABLED,AUTO_LINKLOCAL&gt;<br>
      # ifconfig ixl3.15<br>
      ixl3.15:
      flags=3D8943&lt;UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST&gt;
      metric 0 mtu 1500<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; options=3D4200001&lt;RXCSUM=
,RXCSUM_IPV6,NOMAP&gt;<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ether a4:bf:01:76:ef:9d<br>=

      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; groups: vlan<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; vlan: 15 vlanproto: 802.1q v=
lanpcp: 0 parent interface:
      ixl3<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; media: Ethernet autoselect (=
10Gbase-SR
      &lt;full-duplex&gt;)<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; status: active<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nd6 options=3D29&lt;PERFORM=
NUD,IFDISABLED,AUTO_LINKLOCAL&gt;<br>
      # ifconfig bridge0<br>
      bridge0: flags=3D8843&lt;UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST&gt;
      metric 0 mtu 1500<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ether a4:bf:01:76:ef:9d<br>=

      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet 192.168.55.20 netmask 0=
xffffff00 broadcast
      192.168.55.255<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; id 00:00:00:00:00:00 priori=
ty 32768 hellotime 2 fwddelay
      15<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; maxage 20 holdcnt 6 proto r=
stp maxaddr 2000 timeout 1200<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; root id 00:00:00:00:00:00 p=
riority 32768 ifcost 0 port 0<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; member: vnet0.1
      flags=3D143&lt;LEARNING,DISCOVER,AUTOEDGE,AUTOPTP&gt;<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp; ifmaxaddr 0 port 9 priority 128 path cost 2000<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; member: ixl3.15
      flags=3D143&lt;LEARNING,DISCOVER,AUTOEDGE,AUTOPTP&gt;<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp; ifmaxaddr 0 port 8 priority 128 path cost 2000<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; groups: bridge<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nd6 options=3D9&lt;PERFORMN=
UD,IFDISABLED&gt;<br>
      # ping 192.168.55.1<br>
      PING 192.168.55.1 (192.168.55.1): 56 data bytes<br>
      ^C<br>
      --- 192.168.55.1 ping statistics ---<br>
      2 packets transmitted, 0 packets received, 100.0% packet loss<br>
    </p>
    <p>[! yes, the host does not answer on ICMP, but that is to be
      expected !]<br>
    </p>
    <p># arp -an<br>
      ? (192.168.55.20) at a4:bf:01:76:ef:9d on bridge0 permanent
      [bridge]<br>
      ? (192.168.55.1) at b8:27:eb:47:8f:43 on bridge0 expires in 1197
      seconds [bridge]<br>
      [...]</p>
    <p>
      [! into the jail !]<br>
    </p>
    <p>JAIL # ifconfig epair0b<br>
      epair0b: flags=3D8863&lt;UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST&gt;
      metric 0 mtu 1500<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; options=3D8&lt;VLAN_MTU&gt;=
<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ether ac:16:2d:bd:b7:34<br>=

      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; hwaddr 02:51:73:d1:33:0b<br=
>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet 192.168.55.10 netmask 0=
xffffff00 broadcast
      192.168.55.255<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet6 fe80::ae16:2dff:febd:=
b734%epair0b prefixlen 64
      scopeid 0x2<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; groups: epair<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; media: Ethernet 10Gbase-T (=
10Gbase-T &lt;full-duplex&gt;)<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; status: active<br>
      &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nd6 options=3D21&lt;PERFORM=
NUD,AUTO_LINKLOCAL&gt;<br>
      JAIL # ping 192.168.55.1<br>
      PING 192.168.55.1 (192.168.55.1): 56 data bytes<br>
      ^C<br>
      --- 192.168.55.1 ping statistics ---<br>
      1 packets transmitted, 0 packets received, 100.0% packet loss<br>
      JAIL # arp -an<br>
      ? (192.168.55.10) at ac:16:2d:bd:b7:34 on epair0b permanent
      [ethernet]<br>
      ? (192.168.55.1) at (incomplete) on epair0b expired [ethernet]<br>
      <br>
    </p>
    <p><br>
    </p>
    <p>I conclude that there must be some mac address filtering going on
      in the data path, whether its on ixl or the bridge.</p>
    <p>In dmesg I also see:</p>
    <p>&gt;&gt; bridge0: can't disable some capabilities on ixl3.15:
      0x400</p>
    <p>but as of /usr/src/sys/net/if.h:233 this maps to IFCAP_LRO which
      afaik should not have any influence on L2 filtering.<br>
    </p>
    <p><br>
    </p>
    <p>Have to say, I'm out of ideas again. Never had something like
      this. So far just 'throwing interfaces on a bridge' worked in the
      past. Any ideas where to look next?</p>
    <p><br>
    </p>
    <p>Thanks a lot &amp; best</p>
    <p><br>
    </p>
    <p>Daniel<br>
    </p>
    <p><br>
    </p>
    <div class=3D"moz-cite-prefix">On 1/25/24 08:22, Zhenlei Huang wrote:<br=
>
    </div>
    <blockquote type=3D"cite" cite=3D"mid:40DB5F45-6507-4274-BF28-6B9A5F45CA=
E9@FreeBSD.org"><br class=3D"">
      <div><br class=3D"">
        <blockquote type=3D"cite" class=3D"">
          <div class=3D"">On Jan 23, 2024, at 11:03 PM, Daniel &lt;<a href=3D=
"mailto:freebsd-net@c0decafe.de" class=3D"moz-txt-link-freetext" moz-do-not-=
send=3D"true">freebsd-net@c0decafe.de</a>&gt;
            wrote:</div>
          <br class=3D"Apple-interchange-newline">
          <div class=3D"">
            <div class=3D"">
              <p class=3D"">Hi List, <br class=3D"">
                <br class=3D"">
                <br class=3D"">
                just recently I discovered a problem with the ixl(4)
                driver. Hopefully someone here can help me. my setup is
                as follows: <br class=3D"">
                <br class=3D"">
                <br class=3D"">
                Network ----- ixl3 interface ----- ixl3.15 vlan
                interface ----- bridge0 ----- vnet0.1 to jail <br class=3D""=
>
                <br class=3D"">
                <br class=3D"">
                the problem now is that the jail can send data out (arp
                requests), i do see the responses on the ixl3 interface
                of the host, but they never make their way up to the
                ixl3.15 vlan interface (even though they are tagged
                correctly). To rule out that my config or the network is
                the cruel pit i did test the same setup with a cheap
                usb-ethernet adapter and there everything works as
                expected. I'm on FreeBSD 13.2-RELEASE-p8 and I did test
                both, the in kernel driver and the driver from ports
                intel-ixl-kmod-1.13.4_1. <br class=3D"">
              </p>
            </div>
          </div>
        </blockquote>
        <div>I would encourage you to do plain VLAN tests, i.e. plug
          ixl3.15 out from bridge0</div>
        <div><br class=3D"">
        </div>
        <div>```</div>
        <div># ifconfig bridge0 deletem ixl3.15</div>
        <div># ifconfig bridge0 inet 192.168.55.20/24 delete ### to
          prevent confusion</div>
        <div># ifconfig ixl3.15 inet 192.168.55.x/24</div>
        <div># ping -c1&nbsp;<span class=3D"">192.168.55.1</span></div>
        <div>```&nbsp;</div>
        <br class=3D"">
        <blockquote type=3D"cite" class=3D"">
          <div class=3D"">
            <div class=3D"">
              <p class=3D""> <br class=3D"">
                Here is a bit of information on my environment: <br class=3D=
"">
                <br class=3D"">
                # uname -a <br class=3D"">
                FreeBSD mimir 13.2-RELEASE-p8 FreeBSD 13.2-RELEASE-p8
                GENERIC amd64 <br class=3D"">
                <br class=3D"">
                # pciconf -lBbcevV pci0:25:0:3 <br class=3D"">
                ixl3@pci0:25:0:3:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; class=3D=
0x020000 rev=3D0x09 hdr=3D0x00
                vendor=3D0x8086 device=3D0x37d3 subvendor=3D0x8086
                subdevice=3D0x35d5 <br class=3D"">
                &nbsp;&nbsp;&nbsp; vendor&nbsp;&nbsp;&nbsp;&nbsp; =3D 'Intel=
 Corporation' <br class=3D"">
                &nbsp;&nbsp;&nbsp; device&nbsp;&nbsp;&nbsp;&nbsp; =3D 'Ether=
net Connection X722 for 10GbE
                SFP+' <br class=3D"">
                &nbsp;&nbsp;&nbsp; class&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =3D n=
etwork <br class=3D"">
                &nbsp;&nbsp;&nbsp; subclass&nbsp;&nbsp; =3D ethernet <br cla=
ss=3D"">
                &nbsp;&nbsp;&nbsp; bar&nbsp;&nbsp; [10] =3D type Prefetchabl=
e Memory, range 64,
                base 0xb0000000, size 16777216, enabled <br class=3D"">
                &nbsp;&nbsp;&nbsp; bar&nbsp;&nbsp; [1c] =3D type Prefetchabl=
e Memory, range 64,
                base 0xb5000000, size 32768, enabled <br class=3D"">
                &nbsp;&nbsp;&nbsp; cap 01[40] =3D powerspec 3&nbsp; supports=
 D0 D3&nbsp; current D0
                <br class=3D"">
                &nbsp;&nbsp;&nbsp; cap 05[50] =3D MSI supports 1 message, 64=
 bit, vector
                masks <br class=3D"">
                &nbsp;&nbsp;&nbsp; cap 11[70] =3D MSI-X supports 129 message=
s, enabled <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Table in map 0x1c[0x0], PBA in map
                0x1c[0x1000] <br class=3D"">
                &nbsp;&nbsp;&nbsp; cap 10[a0] =3D PCI-Express 2 endpoint max=
 data
                256(512) FLR RO <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; max read 512 <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; link x1(x1) speed 2.5(2.5) ASPM
                disabled(L0s/L1) <br class=3D"">
                &nbsp;&nbsp;&nbsp; cap 03[e0] =3D VPD <br class=3D"">
                &nbsp;&nbsp;&nbsp; ecap 0001[100] =3D AER 2 0 fatal 0 non-fa=
tal 1
                corrected <br class=3D"">
                &nbsp;&nbsp;&nbsp; ecap 0003[140] =3D Serial 1 9aef76ffff01b=
fa4 <br class=3D"">
                &nbsp;&nbsp;&nbsp; ecap 000e[150] =3D ARI 1 <br class=3D"">
                &nbsp;&nbsp;&nbsp; ecap 0010[160] =3D SR-IOV 1 IOV disabled,=
 Memory Space
                disabled, ARI disabled <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 0 VFs configure=
d out of 32
                supported <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; First VF RID Of=
fset 0x006d, VF RID
                Stride 0x0001 <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; VF Device ID 0x=
37cd <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Page Sizes: 409=
6 (enabled), 8192,
                65536, 262144, 1048576, 4194304 <br class=3D"">
                &nbsp;&nbsp;&nbsp; ecap 0017[1a0] =3D TPH Requester 1 <br cl=
ass=3D"">
                &nbsp;&nbsp;&nbsp; ecap 000d[1b0] =3D ACS 1 Source Validatio=
n
                unavailable, Translation Blocking unavailable <br class=3D""=
>
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; P2P Req Redirec=
t unavailable, P2P
                Cmpl Redirect unavailable <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; P2P Upstream Fo=
rwarding
                unavailable, P2P Egress Control unavailable <br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; P2P Direct Tran=
slated unavailable,
                Enhanced Capability unavailable <br class=3D"">
                &nbsp; PCI-e errors =3D Correctable Error Detected <br class=
=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Unsupported Request Detected <br class=3D=
"">
                &nbsp;&nbsp;&nbsp;&nbsp; Corrected =3D Advisory Non-Fatal Er=
ror <br class=3D"">
                &nbsp;&nbsp;&nbsp; VPD ident&nbsp; =3D 'Example VPD' <br cla=
ss=3D"">
              </p>
              <p class=3D""># ifconfig<br class=3D"">
                [...]<br class=3D"">
                ixl3:
                flags=3D8963&lt;UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICA=
ST&gt;
                metric 0 mtu 1500<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
options=3D4a500b9&lt;RXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VL=
AN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,NOMAP&gt;<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ether a4:bf:01:76=
:ef:9d<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; media: Ethernet a=
utoselect (10Gbase-SR
                &lt;full-duplex&gt;)<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; status: active<br=
 class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nd6
                options=3D29&lt;PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL&gt;<br c=
lass=3D"">
                ixl3.15:
                flags=3D8942&lt;BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST&=
gt;
                metric 0 mtu 1500<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; options=3D4200001=
&lt;RXCSUM,RXCSUM_IPV6,NOMAP&gt;<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ether a4:bf:01:76=
:ef:9d<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; groups: vlan<br c=
lass=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; vlan: 15 vlanprot=
o: 802.1q vlanpcp: 0 parent
                interface: ixl3<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; media: Ethernet a=
utoselect (10Gbase-SR
                &lt;full-duplex&gt;)<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; status: active<br=
 class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nd6
                options=3D29&lt;PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL&gt;<br c=
lass=3D"">
                bridge0:
                flags=3D8843&lt;UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST&gt;
                metric 0 mtu 1500<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ether 58:9c:fc:10=
:dd:05<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; inet 192.168.55.2=
0 netmask 0xffffff00 broadcast
                192.168.55.255<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; id 00:00:00:00:00=
:00 priority 32768 hellotime 2
                fwddelay 15<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; maxage 20 holdcnt=
 6 proto rstp maxaddr 2000
                timeout 1200<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; root id 00:00:00:=
00:00:00 priority 32768 ifcost
                0 port 0<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; member: vnet0.1
                flags=3D143&lt;LEARNING,DISCOVER,AUTOEDGE,AUTOPTP&gt;<br cla=
ss=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ifmaxaddr 0 port 9 priority 128 path
                cost 2000<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; member: ixl3.15
                flags=3D143&lt;LEARNING,DISCOVER,AUTOEDGE,AUTOPTP&gt;<br cla=
ss=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; ifmaxaddr 0 port 8 priority 128 path
                cost 55<br class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; groups: bridge<br=
 class=3D"">
                &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; nd6 options=3D9&l=
t;PERFORMNUD,IFDISABLED&gt;<br class=3D"">
                [...] </p>
              <p class=3D""><br class=3D"">
              </p>
              <p class=3D""> <br class=3D"">
                # cat /etc/rc.conf <br class=3D"">
                [...] <br class=3D"">
                ifconfig_ixl3=3D"up" <br class=3D"">
                vlans_ixl3=3D"15" <br class=3D"">
                cloned_interfaces=3D"bridge0" <br class=3D"">
                ifconfig_bridge0=3D"addm ixl3.15 up" <br class=3D"">
                [...]<br class=3D"">
                <br class=3D"">
                <br class=3D"">
                <br class=3D"">
                # dmesg | grep ixl <br class=3D"">
                ixl0: &lt;Intel(R) Ethernet Connection X722 for
                10GBASE-T - 2.3.3-k&gt; mem
                0xb3000000-0xb3ffffff,0xb5018000-0xb501ffff at device
                0.0 numa-domain 0 on pci6 <br class=3D"">
                ixl0: fw 3.1.55727 api 1.5 nvm 3.31 etid 80000d32 oem
                1.262.0 <br class=3D"">
                ixl0: PF-ID[0]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384,
                MDIO shared <br class=3D"">
                ixl0: Using 1024 TX descriptors and 1024 RX descriptors
                <br class=3D"">
                ixl0: Using 12 RX queues 12 TX queues <br class=3D"">
                ixl0: Using MSI-X interrupts with 13 vectors <br class=3D"">=

                ixl0: Ethernet address: a4:bf:01:76:ef:9a <br class=3D"">
                ixl0: Allocating 16 queues for PF LAN VSI; 12 queues
                active <br class=3D"">
                ixl0: SR-IOV ready <br class=3D"">
                ixl0: netmap queues/slots: TX 12/1024, RX 12/1024 <br class=3D=
"">
                ixl1: &lt;Intel(R) Ethernet Connection X722 for
                10GBASE-T - 2.3.3-k&gt; mem
                0xb2000000-0xb2ffffff,0xb5010000-0xb5017fff at device
                0.1 numa-domain 0 on pci6 <br class=3D"">
                ixl1: fw 3.1.55727 api 1.5 nvm 3.31 etid 80000d32 oem
                1.262.0 <br class=3D"">
                ixl1: PF-ID[1]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384,
                MDIO shared <br class=3D"">
                ixl1: Using 1024 TX descriptors and 1024 RX descriptors
                <br class=3D"">
                ixl1: Using 12 RX queues 12 TX queues <br class=3D"">
                ixl1: Using MSI-X interrupts with 13 vectors <br class=3D"">=

                ixl1: Ethernet address: a4:bf:01:76:ef:9b <br class=3D"">
                ixl1: Allocating 16 queues for PF LAN VSI; 12 queues
                active <br class=3D"">
                ixl1: SR-IOV ready <br class=3D"">
                ixl1: netmap queues/slots: TX 12/1024, RX 12/1024 <br class=3D=
"">
                ixl2: &lt;Intel(R) Ethernet Connection X722 for 10GbE
                SFP+ - 2.3.3-k&gt; mem
                0xb1000000-0xb1ffffff,0xb5008000-0xb500ffff at device
                0.2 numa-domain 0 on pci6 <br class=3D"">
                ixl2: fw 3.1.55727 api 1.5 nvm 3.31 etid 80000d32 oem
                1.262.0 <br class=3D"">
                ixl2: PF-ID[2]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384,
                I2C <br class=3D"">
                ixl2: Using 1024 TX descriptors and 1024 RX descriptors
                <br class=3D"">
                ixl2: Using 12 RX queues 12 TX queues <br class=3D"">
                ixl2: Using MSI-X interrupts with 13 vectors <br class=3D"">=

                ixl2: Ethernet address: a4:bf:01:76:ef:9c <br class=3D"">
                ixl2: Allocating 16 queues for PF LAN VSI; 12 queues
                active <br class=3D"">
                ixl2: ixl_set_link: Error getting phy capabilities -7,
                aq error: 5 <br class=3D"">
                ixl2: SR-IOV ready <br class=3D"">
                ixl2: netmap queues/slots: TX 12/1024, RX 12/1024 <br class=3D=
"">
                ixl3: &lt;Intel(R) Ethernet Connection X722 for 10GbE
                SFP+ - 2.3.3-k&gt; mem
                0xb0000000-0xb0ffffff,0xb5000000-0xb5007fff at device
                0.3 numa-domain 0 on pci6 <br class=3D"">
                ixl3: fw 3.1.55727 api 1.5 nvm 3.31 etid 80000d32 oem
                1.262.0 <br class=3D"">
                ixl3: PF-ID[3]: VFs 32, MSI-X 129, VF MSI-X 5, QPs 384,
                I2C <br class=3D"">
                ixl3: Using 1024 TX descriptors and 1024 RX descriptors
                <br class=3D"">
                ixl3: Using 12 RX queues 12 TX queues <br class=3D"">
                ixl3: Using MSI-X interrupts with 13 vectors <br class=3D"">=

                ixl3: Ethernet address: a4:bf:01:76:ef:9d <br class=3D"">
                ixl3: Allocating 16 queues for PF LAN VSI; 12 queues
                active <br class=3D"">
                ixl3: ixl_set_link: Error getting phy capabilities -7,
                aq error: 5 <br class=3D"">
                ixl3: SR-IOV ready <br class=3D"">
                ixl3: netmap queues/slots: TX 12/1024, RX 12/1024 <br class=3D=
"">
                ixl2: Link is up, 10 Gbps Full Duplex, Requested FEC:
                None, Negotiated FEC: None, Autoneg: False, Flow
                Control: None <br class=3D"">
                ixl2: link state changed to UP <br class=3D"">
                ixl3: Link is up, 10 Gbps Full Duplex, Requested FEC:
                None, Negotiated FEC: None, Autoneg: False, Flow
                Control: None <br class=3D"">
                ixl3: link state changed to UP <br class=3D"">
                bridge0: can't disable some capabilities on ixl3.15:
                0x400 <br class=3D"">
                ixl3: promiscuous mode enabled <br class=3D"">
                ixl3.15: promiscuous mode enabled <br class=3D"">
                <br class=3D"">
                <br class=3D"">
                from my packet traces: <br class=3D"">
                <br class=3D"">
                # tcpdump -vvv -i ixl3 <br class=3D"">
              </p>
            </div>
          </div>
        </blockquote>
        <div>May you please add the option -e to tcpdump, so that the
          link-level header can be printed out.</div>
        <div><br class=3D"">
        </div>
        <div>```</div>
        <div>#&nbsp;tcpdump -nvei ixl3</div>
        <div>```</div>
        <br class=3D"">
        <blockquote type=3D"cite" class=3D"">
          <div class=3D"">
            <div class=3D"">
              <p class=3D""> tcpdump: listening on ixl3, link-type EN10MB
                (Ethernet), capture size 262144 bytes <br class=3D"">
                [...] <br class=3D"">
                13:36:20.155843 ARP, Ethernet (len 6), IPv4 (len 4),
                Request who-has 192.168.55.1 tell 192.168.55.10, length
                28 <br class=3D"">
                13:36:20.156285 ARP, Ethernet (len 6), IPv4 (len 4),
                Reply 192.168.55.1 is-at b8:27:eb:47:8f:43 (oui
                Unknown), length 46 <br class=3D"">
                13:36:21.169003 ARP, Ethernet (len 6), IPv4 (len 4),
                Request who-has 192.168.55.1 tell 192.168.55.10, length
                28 <br class=3D"">
                13:36:21.169538 ARP, Ethernet (len 6), IPv4 (len 4),
                Reply 192.168.55.1 is-at b8:27:eb:47:8f:43 (oui
                Unknown), length 46 <br class=3D"">
                <br class=3D"">
                Here the answer can be see, its tagged with 802.1q tag
                15 <br class=3D"">
                <br class=3D"">
                <br class=3D"">
                # tcpdump -vvv -i ixl3.15 <br class=3D"">
                tcpdump: listening on ixl3.15, link-type EN10MB
                (Ethernet), capture size 262144 bytes <br class=3D"">
                14:14:37.255429 ARP, Ethernet (len 6), IPv4 (len 4),
                Request who-has 192.168.55.1 tell 192.168.55.10, length
                28 <br class=3D"">
                14:14:42.263475 ARP, Ethernet (len 6), IPv4 (len 4),
                Request who-has 192.168.55.1 tell 192.168.55.10, length
                28 <br class=3D"">
                14:15:02.556311 ARP, Ethernet (len 6), IPv4 (len 4),
                Request who-has 192.168.55.1 tell 192.168.55.10, length
                28 <br class=3D"">
                14:15:07.557644 ARP, Ethernet (len 6), IPv4 (len 4),
                Request who-has 192.168.55.1 tell 192.168.55.10, length
                28 <br class=3D"">
                <br class=3D"">
                The answer cannot be seen on the VLAN interface ): <br class=
=3D"">
                <br class=3D"">
                <br class=3D"">
                I hope the list can help me out here, as I am lost.<br class=
=3D"">
                <br class=3D"">
                <br class=3D"">
                Thanks &amp; best</p>
              <p class=3D""><br class=3D"">
              </p>
              <p class=3D"">Daniel<br class=3D"">
              </p>
            </div>
          </div>
        </blockquote>
      </div>
      <br class=3D"">
      <div class=3D"">
        <div>Best regards,</div>
        <div>Zhenlei</div>
      </div>
      <br class=3D"">
    </blockquote>
 =20

</div></blockquote></body></html>=

--Apple-Mail-63F0A263-997C-4872-BFBB-3F96575D20C1--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?063A269F-B479-4A43-8E3B-B044C2E779F0>