Date: Thu, 07 Jul 2016 19:17:07 +0000 From: bugzilla-noreply@freebsd.org To: freebsd-amd64@FreeBSD.org Subject: [Bug 210901] em0 stores packets somewhere and lets them out slowly under load. Message-ID: <bug-210901-6@https.bugs.freebsd.org/bugzilla/>
next in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D210901 Bug ID: 210901 Summary: em0 stores packets somewhere and lets them out slowly under load. Product: Base System Version: 10.3-RELEASE Hardware: amd64 OS: Any Status: New Severity: Affects Only Me Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: dgilbert@eicat.ca CC: freebsd-amd64@FreeBSD.org CC: freebsd-amd64@FreeBSD.org I fully realize that this is going to be a bear to track down. The machine= in question is my home server ... so it runs a bit of everything. The trigger= for the behavior seems to be more than 1000 torrents running. Stats on that la= ter. The kicker is: replace em0 (pcie) with rl0 (motherboard) and it goes away. I have the em0 in the machine because I believe it's a better card. Sigh. SO WHAT HAPPENS? When em0 is misbehaving, the "mild" symptoms are local LAN lag from 500ms to 5000 ms. (this is why I jokingly accuse em0 of storing the packets.) Beyo= nd about 5000ms, it seems the packets are dropped. This can be observed by pinging out from the console of the box or pinging from another box to it. I often first notice the box is having trouble when the UPS monitor looses network connectivity with the UPS. Salient details I can think of? The answer to "netstat -an | grep tcp4 | g= rep -v LISTEN | wc" is 320. 1000 torrents configured doesn't mean that that ma= ny streams happen. It is possible that the behavior is related to the number = of torrent streams in progress... or the number of TCP streams with small tran= smit queues. In among that is some mildly fast SMB service for various media devices around the house. The em0 behavior is 100% related to the large number of torrents (running u= sing rtorrent). Stopping rtorrent makes the host good again, starting rtorrent hoses it. So the machine is: FreeBSD virtual.xxx.xxx 10.3-RELEASE-p5 FreeBSD 10.3-RELEASE-p5 #4 r301872:= Mon Jun 13 14:35:24 EDT 2016 root@virtual.xxx.xxx:/usr/obj/usr/src/sys/GENE= RIC=20 amd64 CPU: AMD FX(tm)-9590 Eight-Core Processor (4716.02-MHz K8-class = CPU) Origin=3D"AuthenticAMD" Id=3D0x600f20 Family=3D0x15 Model=3D0x2 Stepp= ing=3D0 =20 Features=3D0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,= MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> =20 Features2=3D0x3e98320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,POPC= NT,AESNI,XSAVE,OSXSAVE,AVX,F16C> AMD Features=3D0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM> AMD Features2=3D0x1ebbfff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,= IBS,XOP,SKINIT,WDT,LWP,FMA4,TCE,NodeId,TBM,Topology,PCXC,PNXC> Structured Extended Features=3D0x8<BMI1> SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=3D65536 TSC: P-state invariant, performance statistics real memory =3D 34359738368 (32768 MB) avail memory =3D 33186353152 (31648 MB) The ethernet cards are: em0: <Intel(R) PRO/1000 Network Connection 7.6.1-k> port 0x8000-0x801f mem 0xfe340000-0xfe35ffff,0xfe320000-0xfe33ffff irq 20 at device 0.0 on pci9 em0: Using an MSI interrupt em0: Ethernet address: 00:15:17:0d:04:a8 em0@pci0:9:0:0: class=3D0x020000 card=3D0x10838086 chip=3D0x10b98086 rev=3D= 0x06 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D '82572EI Gigabit Ethernet Controller (Copper)' re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0x7000-0x70ff mem 0xd2104000-0xd2104fff,0xd2100000-0xd2103fff irq 21 at dev= ice 0.0 on pci10 re0: Using 1 MSI-X message re0: Chip rev. 0x48000000 re0: MAC rev. 0x00000000 miibus0: <MII bus> on re0 rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Using defaults for TSO: 65518/35/2048 re0: Ethernet address: 10:c3:7b:9d:8b:6d re0@pci0:10:0:0: class=3D0x020000 card=3D0x85051043 chip=3D0x816810e= c rev=3D0x09 hdr=3D0x00 vendor =3D 'Realtek Semiconductor Co., Ltd.' device =3D 'RTL8111/8168B PCI Express Gigabit Ethernet controller' --=20 You are receiving this mail because: You are on the CC list for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-210901-6>