From owner-freebsd-net@freebsd.org Fri Jan 18 10:18:08 2019 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 437E01497043 for ; Fri, 18 Jan 2019 10:18:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id D0E71883F2 for ; Fri, 18 Jan 2019 10:18:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.ysv.freebsd.org (Postfix) id 8C2741497042; Fri, 18 Jan 2019 10:18:07 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 67EEF1497041 for ; Fri, 18 Jan 2019 10:18:07 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EF00F883F0 for ; Fri, 18 Jan 2019 10:18:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 2094F1E507 for ; Fri, 18 Jan 2019 10:18:06 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id x0IAI5pw034011 for ; Fri, 18 Jan 2019 10:18:05 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id x0IAI5dd034009 for net@FreeBSD.org; Fri, 18 Jan 2019 10:18:05 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 235031] [em] em0: poor NFS performance, strange behavior Date: Fri, 18 Jan 2019 10:18:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.0-RELEASE X-Bugzilla-Keywords: IntelNetworking, regression X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: d8zNeCFG@aon.at X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 18 Jan 2019 10:18:08 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D235031 --- Comment #6 from Martin Birgmeier --- Hi Eugene, Thank you for looking into this. I have always been using ntp on all (physical, not VMs) machines. But I am = not using a drift file because in my experience, the machines do not run long enough to arrive at stable values in the drift file, leading to bad ntp sta= rtup behavior (drifting) on the next boot (I have my own config files; maybe I should restart using drift files because my experience is from very long ag= o ~ 15 years :-)). Here is the output of ntpq -p: [0]# ntpq -p remote refid st t when poll reach delay offset jit= ter =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D *gandalf.xyzzy 192.53.103.103 2 u 11 64 377 0.187 -18.657 0.= 447 +hal.xyzzy 193.204.114.233 2 u 23 64 377 0.180 -2.254 0.= 096 [0]#=20 I am syncing two machines to stratum-1 servers; they in turn are references= for all the other machines (including the laptop with the em0). [0]# sysctl kern.timecounter=20 kern.timecounter.tsc_shift: 1 kern.timecounter.smp_tsc_adjust: 0 kern.timecounter.smp_tsc: 1 kern.timecounter.invariant_tsc: 1 kern.timecounter.fast_gettime: 1 kern.timecounter.tick: 1 kern.timecounter.choice: TSC(1000) ACPI-fast(900) HPET(950) i8254(0) dummy(-1000000) kern.timecounter.hardware: ACPI-fast kern.timecounter.alloweddeviation: 5 kern.timecounter.stepwarnings: 0 kern.timecounter.tc.TSC.quality: 1000 kern.timecounter.tc.TSC.frequency: 1993570808 kern.timecounter.tc.TSC.counter: 3362030552 kern.timecounter.tc.TSC.mask: 4294967295 kern.timecounter.tc.ACPI-fast.quality: 900 kern.timecounter.tc.ACPI-fast.frequency: 3579545 kern.timecounter.tc.ACPI-fast.counter: 11926669 kern.timecounter.tc.ACPI-fast.mask: 16777215 kern.timecounter.tc.HPET.quality: 950 kern.timecounter.tc.HPET.frequency: 14318180 kern.timecounter.tc.HPET.counter: 114481493 kern.timecounter.tc.HPET.mask: 4294967295 kern.timecounter.tc.i8254.quality: 0 kern.timecounter.tc.i8254.frequency: 1193182 kern.timecounter.tc.i8254.counter: 14744 kern.timecounter.tc.i8254.mask: 65535 [0]# sysctl kern.eventtimer=20 kern.eventtimer.periodic: 0 kern.eventtimer.timer: LAPIC kern.eventtimer.idletick: 0 kern.eventtimer.singlemul: 2 kern.eventtimer.choice: LAPIC(600) HPET(550) i8254(100) RTC(0) kern.eventtimer.et.RTC.quality: 0 kern.eventtimer.et.RTC.frequency: 32768 kern.eventtimer.et.RTC.flags: 17 kern.eventtimer.et.HPET.quality: 550 kern.eventtimer.et.HPET.frequency: 14318180 kern.eventtimer.et.HPET.flags: 7 kern.eventtimer.et.i8254.quality: 100 kern.eventtimer.et.i8254.frequency: 1193182 kern.eventtimer.et.i8254.flags: 1 kern.eventtimer.et.LAPIC.quality: 600 kern.eventtimer.et.LAPIC.frequency: 1993570808 kern.eventtimer.et.LAPIC.flags: 7 [0]#=20 [0]# sysctl kern.eventtimer.periodic=3D1=20 [0]#=20 This does not improve the situation. Again, additionally running iperf betw= een the laptop and the 3rd machine still improves it. [0]# grep irq /var/run/dmesg.boot ioapic0 irqs 0-23 on motherboard attimer0: port 0x40-0x43 irq 0 on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 pcib1: irq 16 at device 1.0 on pci0 vgapci0: port 0x5000-0x507f mem 0xd2000000-0xd2ffffff,0xc0000000-0xcfffffff,0xd0000000-0xd1ffffff irq 16 at device 0.0 on pci1 hdac0: mem 0xd3000000-0xd3003fff irq 17 at de= vice 0.1 on pci1 em0: port 0x6040-0x605f mem 0xd5300000-0xd531ffff,0xd532b000-0xd532bfff irq 20 at device 25.0 on pci0 ehci0: mem 0xd532a000-0xd532a3ff ir= q 16 at device 26.0 on pci0 hdac1: mem 0xd5320000-0xd5323fff irq 22= at device 27.0 on pci0 pcib2: irq 16 at device 28.0 on pci0 pcib3: irq 17 at device 28.1 on pci0 iwn0: mem 0xd5200000-0xd5201fff irq 17 at device 0.0 on pci3 pcib4: irq 19 at device 28.3 on pci0 pcib5: irq 16 at device 28.4 on pci0 sdhci_pci0: mem 0xd4201000-0xd42010ff irq 16 at device 0= .0 on pci4 fwohci0: <1394 Open Host Controller Interface> mem 0xd4200000-0xd42007ff ir= q 19 at device 0.3 on pci4 pcib6: irq 18 at device 28.6 on pci0 xhci0: mem 0xd4100000-0xd4101fff irq 18 = at device 0.0 on pci5 ehci1: mem 0xd5329000-0xd53293ff ir= q 23 at device 29.0 on pci0 ahci0: port 0x6068-0x606f,0x607c-0x607f,0x6060-0x6067,0x6078-0x607b,0x6020-0x603f mem 0xd5328000-0xd53287ff irq 19 at device 31.2 on pci0 ichsmb0: port 0xefa0-0xefbf mem 0xd5324000-0xd53240ff irq 18 at device 31.3 on pci0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 psm0: irq 12 on atkbdc0 [0]#=20 [0]# cd /z/backup/rsync/mizar/ROOT/.zfs/snapshot/backup.2018-12-24.21:03:49 [0]# egrep -i 'FreeBSD|irq' var/run/dmesg.boot=20=20=20=20=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 Copyright (c) 1992-2018 The FreeBSD Project. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-RELEASE-p5 #4 r341248M: Thu Nov 29 19:30:14 CET 2018 root@v904.xyzzy:/.../hal/z/OBJ/FreeBSD/amd64/releng/11.2/sys/XYZZY_SMP amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads ioapic0 irqs 0-23 on motherboard attimer0: port 0x40-0x43 irq 0 on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 pcib1: irq 16 at device 1.0 on pci0 vgapci0: port 0x5000-0x507f mem 0xd2000000-0xd2ffffff,0xc0000000-0xcfffffff,0xd0000000-0xd1ffffff irq 16 at device 0.0 on pci1 hdac0: mem 0xd3000000-0xd3003fff irq 17 at de= vice 0.1 on pci1 em0: port 0x6040-0x605f mem 0xd5300000-0xd531ffff,0xd532b000-0xd532bfff irq 20 at device 25.0 on pci0 ehci0: mem 0xd532a000-0xd532a3ff ir= q 16 at device 26.0 on pci0 hdac1: mem 0xd5320000-0xd5323fff irq 22= at device 27.0 on pci0 pcib2: irq 16 at device 28.0 on pci0 pcib3: irq 17 at device 28.1 on pci0 iwn0: mem 0xd5200000-0xd5201fff irq 17 at device 0.0 on pci3 pcib4: irq 19 at device 28.3 on pci0 pcib5: irq 16 at device 28.4 on pci0 sdhci_pci0: mem 0xd4201000-0xd42010ff irq 16 at device 0= .0 on pci4 fwohci0: <1394 Open Host Controller Interface> mem 0xd4200000-0xd42007ff ir= q 19 at device 0.3 on pci4 pcib6: irq 18 at device 28.6 on pci0 xhci0: mem 0xd4100000-0xd4101fff irq 18 = at device 0.0 on pci5 ehci1: mem 0xd5329000-0xd53293ff ir= q 23 at device 29.0 on pci0 ahci0: port 0x6068-0x606f,0x607c-0x607f,0x6060-0x6067,0x6078-0x607b,0x6020-0x603f mem 0xd5328000-0xd53287ff irq 19 at device 31.2 on pci0 ichsmb0: port 0xefa0-0xefbf mem 0xd5324000-0xd53240ff irq 18 at device 31.3 on pci0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 psm0: irq 12 on atkbdc0 fuse-freebsd: version 0.4.4, FUSE ABI 7.8 [0]# --=20 You are receiving this mail because: You are the assignee for the bug.=