Date: Wed, 10 Aug 2022 15:09:03 -0400 From: mike tancsa <mike@sentex.net> To: "Pieper, Jeffrey E" <jeffrey.e.pieper@intel.com>, Jim King <jim@jimking.net>, "stable@freebsd.org" <stable@freebsd.org>, "kbowling@FreeBSD.org" <kbowling@FreeBSD.org> Subject: Re: igc problems with heavy traffic Message-ID: <415bed72-33b4-84ac-111c-f576d7a5fc47@sentex.net> In-Reply-To: <ac26113a-b24b-d8bc-e9f4-75d29e7e211c@sentex.net> References: <fc256428-3ff1-68ba-cfcc-a00ca427e85b@jimking.net> <59b9cec0-d8c2-ce72-b5e9-99d1a1e807f8@sentex.net> <e714cd76-0aaa-3ea0-3c31-5e61badffa18@sentex.net> <86995d10-af63-d053-972e-dd233029f3bf@jimking.net> <3d874f65-8ce2-8f06-f19a-14cd550166e3@sentex.net> <a8192d60-2970-edb5-ce1a-c17ea875bf07@jimking.net> <fd1e825b-c306-64b1-f9ef-fec0344a9c95@sentex.net> <a4ddc96a-3dd5-4fee-8003-05f228d10858@jimking.net> <MW4PR11MB5890493674ADD1757BB47075D0659@MW4PR11MB5890.namprd11.prod.outlook.com> <ac26113a-b24b-d8bc-e9f4-75d29e7e211c@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On 8/10/2022 2:14 PM, mike tancsa wrote: > On 8/10/2022 1:47 PM, Pieper, Jeffrey E wrote: >> >> You could try disabling EEE (Energy Efficient Ethernet). Something >> like: sysctl dev.igc.0.eee_control=0. > > > Adding > > hw.igc.eee_setting=0 > > in /boot/loader.conf seems to take ok and the NIC works on bootup. I > will run some stress tests with it set. Thanks! > I tried with just that setting and not adjusting the FC and still got the link bounce fairly quickly on the 2.5G xover connection. I was using cat 5 but changed the cable to cat 6 to see if that makes a difference. Re-running the test now with cat 6 I setup 4 servers A----B----C----D A and D are just 2 random servers. B & C are the 2 machines with the 4 igc NICs. B &C and linked on igc1 via xover and A & D were on xover cable to igc2 of B &C 192.168.20.2 ---------- 192.168.20.1 192.168.21.1--------------192.168.21.2 10.1.255.209 -----10.1.255.168 Other odd thing I noticed was when I rebooted and set the eee settings to 0 I lost the link between 21.1 and 21.2 on igc2. Whats odd however is that if I change it so that they both go through a switch instead of xover cable, there does not seem to be a problem with the link. Same cable to the switch seems fine so not sure if something else is going on at the link layer. Only the link between the 2 igc nics is 2.5 G and thats still on xover. I am running iperf3 between 192.168.20.2 and 192.168.21.2. ---Mike
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?415bed72-33b4-84ac-111c-f576d7a5fc47>