From owner-freebsd-stable@FreeBSD.ORG Sun Mar 15 13:28:48 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A224D26E for ; Sun, 15 Mar 2015 13:28:48 +0000 (UTC) Received: from mail-yk0-f170.google.com (mail-yk0-f170.google.com [209.85.160.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 65901D0 for ; Sun, 15 Mar 2015 13:28:48 +0000 (UTC) Received: by ykfc206 with SMTP id c206so2954682ykf.1 for ; Sun, 15 Mar 2015 06:28:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=j+jNLdZFaNI76XaYqvDf8KFPVEamx/FuezCZL9JFi7g=; b=KqCoKqsxSm5Q9pqtKKMlHfWAhuDBYD7PwksvUiyU3obkIZachI/vpoY18aQCo9twIc 5RSmSzqYLO2yJT0dx05zRTlto4oncYzn10oLbhLL6kLwJFAtr8CG/mwGBOKunl99auh5 qsRYWGUIYkUz/bsGMx00Crf2+5X5vB47/3zOMtncV8Lhy4h4AuKmrGLTTiEJ6AFQYScG 7pMsOKWE9ez0pkt1bxzFv9qYFzv3Dywva7F2SufBkguCf1N4k5Sd6Fsb5+kSc2P/mo0m y34R3Gm5fQG/0TV7EXuiQ6MjlL2WeQxPJ4iKBVmgPYukfrpf5LSRbRUYn4FE8BvNsdwB E4wg== X-Gm-Message-State: ALoCoQmQsHnyQpyN9Sobge+D1iNo5rb+K8mzB/pYV8DRrOeze/te3e/jvxFV6eoWTLNZXwo5qeyp MIME-Version: 1.0 X-Received: by 10.170.47.71 with SMTP id 68mr7438316ykp.61.1426426121473; Sun, 15 Mar 2015 06:28:41 -0700 (PDT) Received: by 10.170.104.86 with HTTP; Sun, 15 Mar 2015 06:28:41 -0700 (PDT) In-Reply-To: References: Date: Sun, 15 Mar 2015 14:28:41 +0100 Message-ID: Subject: Re: HP EliteBook EFI boot failure From: Oliver Pinter To: Greg Rivers Content-Type: text/plain; charset=UTF-8 Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Mar 2015 13:28:48 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194063 On 3/14/15, Greg Rivers wrote: > I'm unable to boot the memstick EFI images on a HP EliteBook 850 G1 (SKU > F2Q24UT#ABA). The BIOS is up to date and set to the default "UEFI Native > (Without CSM)" setting. > > I tried the most recent 10.1-STABLE and 11.0-CURRENT snapshots with the > following results (hand transcribed from the screen): > > FreeBSD-10.1-STABLE-amd64-20150309-r279796-uefi-memstick.img.xz: > -------------------------------------------------------------------------------- >>> FreeBSD EFI boot block > Loader path: /boot/loader.efi > Consoles: EFI console > Image base: 0x9fb5e000 > EFI version 2.10 > EFI Firmware: HPQ (rev 4096.01) > > FreeBSD/amd64 EFI loader, Revision 1.1 > (root@releng1.nyi.freebsd.org, Mon Mar 9 16:10:08 UTC 2015) > Loading /boot/defaults/loader.conf > /boot/kernel/kernel text=0xf9d8c8 data=0x125ce8 > syms=[0x8+0x141318+0x8+0x15be03] > > Hit [Enter] to boot immediately, or any other key for command prompt. > Booting [/boot/kernel/kernel]... > Start @ 0xffffffff802dbc90 ... > -------------------------------------------------------------------------------- > > FreeBSD-11.0-CURRENT-amd64-20150309-r279813-memstick.img.xz: > -------------------------------------------------------------------------------- >>> FreeBSD EFI boot block > Loader path: /boot/loader.efi > Consoles: EFI console > Image base: 0x9fa06000 > EFI version 2.10 > EFI Firmware: HPQ (rev 4096.01) > > FreeBSD/amd64 EFI loader, Revision 1.1 > (root@releng2.nyi.freebsd.org, Mon Mar 9 16:24:01 UTC 2015) > Loading /boot/defaults/loader.conf > /boot/kernel/kernel text=0x103a3c0 data=0x3faef0 > syms=[0x8+0x148f38+0x8+0x164ae7] > > Hit [Enter] to boot immediately, or any other key for command prompt. > Booting [/boot/kernel/kernel]... > Start @ 0xffffffff802e4000 ... > EFI framebuffer information: > addr, size 0xc0000000, 0x7e9000 > dimensions 1920 x 1080 > stride 1920 > masks 0x0ff0000, 0x000000ff, 0xff000000 > -------------------------------------------------------------------------------- > > In both cases the system simply hangs. How can I help debug this? > > -- > Greg Rivers > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 00:34:30 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E3876545 for ; Mon, 16 Mar 2015 00:34:30 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id AC79BE2A for ; Mon, 16 Mar 2015 00:34:30 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2G0YTKR012896 for ; Sun, 15 Mar 2015 20:34:29 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <5506250A.2000506@sentex.net> Date: Sun, 15 Mar 2015 20:34:18 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: FreeBSD-STABLE Mailing List Subject: 35-40% performance drop releng9 vs releng10 openvpn Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 00:34:31 -0000 As part of moving from a RELENG8 based image to a RELENG9 or 10, I was doing some simple performance testing and found RELENG_9 to be quite a bit faster when generating traffic through a pcengines APU (dual core, AMD64, 2G of RAM). Both are using generic kernels blasting across an aes-128cbc tunnel, on releng9 I get # dd if=/dev/zero | nc 10.3.24.25 500 326002688 bytes transferred in 37.188139 secs (8766308 bytes/sec) vs # dd if=/dev/zero | nc 10.3.24.25 500 146982400 bytes transferred in 27.750440 secs (5296579 bytes/sec) on releng10. Both have identical pf rules, but disabling pf does not make much of a difference in speed. I havent started checking any of the default tunables. The box will be functioning as a VPN router and I was hoping to get at least 50Mb/s out of it, and I can do that on RELENG9, but not 10. Any ideas what to do with RELENG10 to get comparable performance out of it ? ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 05:10:02 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8338197A for ; Mon, 16 Mar 2015 05:10:02 +0000 (UTC) Received: from masa.qt7.net (masa.qt7.net [104.140.67.88]) by mx1.freebsd.org (Postfix) with ESMTP id 421FA7B for ; Mon, 16 Mar 2015 05:10:02 +0000 (UTC) To: freebsd-stable@freebsd.org Subject: wish to introduce our fleece blankets and bathrobes factory Message-ID: Date: Mon, 16 Mar 2015 06:06:17 +0100 From: "James" Reply-To: wanshancon@tom.com MIME-Version: 1.0 X-Mailer-LID: 26 X-Mailer-RecptId: 20219500 X-Mailer-SID: 118 X-Mailer-Sent-By: 1 Content-Type: text/plain; format=flowed; charset="UTF-8" Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 05:10:02 -0000 We wish to introduce our fleece blankets and bathrobes factory Our factory based in China has been engaged in the manufacture and sales of fleece products for many years. Over the past years, we have got much professional experience in this industry. We produce below: polar fleece blankets micro coral fleece blankets picnic blankets cushions/cushion covers baby blankets embroidered blankets bathrobes voile curtains sauna quits fleece clothing washmachine covers Our products have been exported to North Amercia, Europe, Japan and so on. We are looking forward to start business with you soon. Best regards: James Contact: rightmm@tom.com From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 09:43:42 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 71BAAF2A for ; Mon, 16 Mar 2015 09:43:42 +0000 (UTC) Received: from smtp.free.de (smtp.free.de [91.204.6.103]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E0C0DFDC for ; Mon, 16 Mar 2015 09:43:41 +0000 (UTC) Received: (qmail 38071 invoked from network); 16 Mar 2015 10:36:56 +0100 Received: from smtp.free.de (HELO [91.204.7.30]) (k@free.de@[91.204.4.103]) (envelope-sender ) by smtp.free.de (qmail-ldap-1.03) with AES128-SHA encrypted SMTP for ; 16 Mar 2015 10:36:56 +0100 Message-ID: <5506A436.9060503@free.de> Date: Mon, 16 Mar 2015 10:36:54 +0100 From: Kai Gallasch Organization: FREE! User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: FreeBSD-STABLE Mailing List Subject: FreeBSD 10.1-RELENG - No serial console on Intel J1900 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="cOQJDfeN1qmiugBGS1EUXahUrqtXTs5gi" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 09:43:42 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --cOQJDfeN1qmiugBGS1EUXahUrqtXTs5gi Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi list. For some time I have been struggling to get the serial console operational on an ASRock Q1900B-ITX mainboard (Intel J1900) I have "-Dh" in /boot.config and tried enabling ttyu0 and ttyu1 in /etc/ttys. Serial cable was connected to the onboads serial ports of the mainboard. What I also tried was connecting the serial console cable to a USB to serial converter (using ttyU0 device in /etc/ttys), but also no luck. When I press return on an active console session the cursor on the console does a carriage return to the next line, but the screen shows no output at all. This can be seen on the USB to serial converter cable connection and also on the connection to the serial ports on the mainboard. I also made a test with kern.vty=3Dvt console=3D"comconsole vidconsole" comconsole_speed=3D"9600" boot_multicons=3D"YES" in /boot/loader.conf - but no solution. Is this ACPI related? Any hint appreciated. Regards, K. --- pciconf -lv --- % pciconf -lv hostb0@pci0:0:0:0: class=3D0x060000 card=3D0x0f311849 chip=3D0x0f008086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView SSA-CUnit' class =3D bridge subclass =3D HOST-PCI vgapci0@pci0:0:2:0: class=3D0x030000 card=3D0x0f311849 chip=3D0x0f318086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView Gen7' class =3D display subclass =3D VGA ahci0@pci0:0:19:0: class=3D0x010601 card=3D0x0f231849 chip=3D0x0f238086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView 6-Port SATA AHCI Controller' class =3D mass storage subclass =3D SATA xhci0@pci0:0:20:0: class=3D0x0c0330 card=3D0x0f351849 chip=3D0x0f358086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView USB xHCI Host Controller' class =3D serial bus subclass =3D USB none0@pci0:0:26:0: class=3D0x108000 card=3D0x0f181849 chip=3D0x0f188086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView SEC' class =3D encrypt/decrypt pcib1@pci0:0:28:0: class=3D0x060400 card=3D0x0f481849 chip=3D0x0f488086 rev=3D0x0c hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'ValleyView PCI Express Root Port' class =3D bridge subclass =3D PCI-PCI pcib2@pci0:0:28:1: class=3D0x060400 card=3D0x0f4a1849 chip=3D0x0f4a8086 rev=3D0x0c hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'ValleyView PCI Express Root Port' class =3D bridge subclass =3D PCI-PCI pcib3@pci0:0:28:2: class=3D0x060400 card=3D0x0f4c1849 chip=3D0x0f4c8086 rev=3D0x0c hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'ValleyView PCI Express Root Port' class =3D bridge subclass =3D PCI-PCI pcib4@pci0:0:28:3: class=3D0x060400 card=3D0x0f4e1849 chip=3D0x0f4e8086 rev=3D0x0c hdr=3D0x01 vendor =3D 'Intel Corporation' device =3D 'ValleyView PCI Express Root Port' class =3D bridge subclass =3D PCI-PCI ehci0@pci0:0:29:0: class=3D0x0c0320 card=3D0x0f341849 chip=3D0x0f348086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView USB Enhanced Host Controller' class =3D serial bus subclass =3D USB isab0@pci0:0:31:0: class=3D0x060100 card=3D0x0f1c1849 chip=3D0x0f1c8086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView Power Control Unit' class =3D bridge subclass =3D PCI-ISA none1@pci0:0:31:3: class=3D0x0c0500 card=3D0x0f121849 chip=3D0x0f128086 rev=3D0x0c hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'ValleyView SMBus Controller' class =3D serial bus subclass =3D SMBus re0@pci0:2:0:0: class=3D0x020000 card=3D0x81681849 chip=3D0x816810ec rev=3D= 0x11 hdr=3D0x00 vendor =3D 'Realtek Semiconductor Co., Ltd.' device =3D 'RTL8111/8168B PCI Express Gigabit Ethernet controller= ' class =3D network subclass =3D ethernet --- dmesg.out --- Copyright (c) 1992-2014 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.1-RELEASE-p6 #0: Tue Feb 24 19:00:21 UTC 2015 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64= FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512 VT: running with driver "vga". CPU: Intel(R) Celeron(R) CPU J1900 @ 1.99GHz (2000.05-MHz K8-class CPU)= Origin =3D "GenuineIntel" Id =3D 0x30673 Family =3D 0x6 Model =3D 0x= 37 Stepping =3D 3 Features=3D0xbfebfbff Features2=3D0x41d8e3bf AMD Features=3D0x28100800 AMD Features2=3D0x101 Structured Extended Features=3D0x2282 VT-x: (disabled in BIOS) PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory =3D 4294967296 (4096 MB) avail memory =3D 3790082048 (3614 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 cpu2 (AP): APIC ID: 4 cpu3 (AP): APIC ID: 6 WARNING: Bogus Interrupt Polarity. Assume CONFORMS ioapic0 irqs 0-86 on motherboard random: initialized module_register_init: MOD_LOAD (vesa, 0xffffffff80d942d0, 0) error 19 kbd1 at kbdmux0 cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) unknown: I/O range not supported cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 atrtc0: port 0x70-0x77 on acpi0 atrtc0: Warning: Couldn't map I/O. Event timer "RTC" frequency 32768 Hz quality 0 hpet0: iomem 0xfed00000-0xfed003ff irq 8 on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 450 Event timer "HPET1" frequency 14318180 Hz quality 440 Event timer "HPET2" frequency 14318180 Hz quality 440 attimer0: port 0x40-0x43,0x50-0x53 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pcib0: Length mismatch for 3 range: 10716fff vs 10717000 pci0: on pcib0 vgapci0: port 0xf080-0xf087 mem 0xd0000000-0xd03fffff,0xc0000000-0xcfffffff irq 16 at device 2.0 on pci0 vgapci0: Boot video device ahci0: port 0xf070-0xf077,0xf060-0xf063,0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xd0716000-0xd07167ff irq 19 at device 19.0 on pci0 ahci0: AHCI v1.30 with 2 3Gbps ports, Port Multiplier not supported ahcich0: at channel 0 on ahci0 ahcich1: at channel 1 on ahci0 xhci0: mem 0xd0700000-0xd070ffff irq 20 at device 20.0 on pci0 xhci0: 32 byte context size. usbus0 on xhci0 pci0: at device 26.0 (no driver attached) pcib1: irq 16 at device 28.0 on pci0 pci1: on pcib1 pcib2: irq 17 at device 28.1 on pci0 pci2: on pcib2 re0: port 0xe000-0xe0ff mem 0xd0604000-0xd0604fff,0xd0600000-0xd0603fff irq 17 at device 0.0 on pci2 re0: Using 1 MSI-X message re0: Chip rev. 0x4c000000 re0: MAC rev. 0x00000000 miibus0: on re0 rgephy0: PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: d0:50:99:2c:fb:d1 pcib3: irq 18 at device 28.2 on pci0 pci3: on pcib3 pcib4: irq 19 at device 28.3 on pci0 pci4: on pcib4 ehci0: mem 0xd0715000-0xd07153ff irq 23 at device 29.0 on pci0 usbus1: EHCI version 1.0 usbus1 on ehci0 isab0: at device 31.0 on pci0 isa0: on isab0 acpi_button0: on acpi0 acpi_button1: on acpi0 acpi_tz0: on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 uart0: console (9600,n,8,1) uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0 atkbdc0: at port 0x60,0x64 on isa0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] fdc0: at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0 ppc0: cannot reserve I/O port range est0: on cpu0 p4tcc0: on cpu0 est1: on cpu1 p4tcc1: on cpu1 est2: on cpu2 p4tcc2: on cpu2 est3: on cpu3 p4tcc3: on cpu3 random: unblocking device. usbus0: 5.0Gbps Super Speed USB v3.0 ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present; to enable, add "vfs.zfs.prefetch_disable=3D0" to /boot/loader.conf. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec usbus1: 480Mbps High Speed USB v2.0 ugen0.1: <0x8086> at usbus0 uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0= ugen1.1: at usbus1 uhub1: on usbus1 uhub0: 7 ports with 7 removable, self powered ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: ATA-9 SATA 3.x device ada0: Serial Number WD-WX91E7439T2T ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad4 ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: ATA-9 SATA 3.x device ada1: Serial Number WD-WXK1E644844Z ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad6 lapic6: Forcing LINT1 to edge trigger SMP: AP CPU #3 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! Timecounter "TSC" frequency 2000047056 Hz quality 1000 uhub1: 8 ports with 8 removable, self powered Enter passphrase for ada0p4: ugen1.2: at usbus1 uhub2: on usbus1 uhub2: 4 ports with 4 removable, self powered ugen1.3: at usbus1 uhub3: on usbus1 GEOM_MIRROR: Force device swap start due to timeout. uhub3: 3 ports with 3 removable, self powered ugen1.4: at usbus1 uhub4: on usbus1 uhub4: 4 ports with 4 removable, self powered ugen1.5: at usbus1 ukbd0: on usbus1 kbd2 at ukbd0 ugen1.6: at usbus1 GEOM_ELI: Encryption: AES-XTS 256 GEOM_ELI: Crypto: software GEOM_MIRROR: Device mirror/swap launched (1/2). GEOM_ELI: Device ada1p4.eli created. GEOM_ELI: Encryption: AES-XTS 256 GEOM_ELI: Crypto: software Trying to mount root from zfs:zroot/ROOT/default []... GEOM_ELI: Device mirror/swap.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: software ums0: on usbus1 ums0: 5 buttons and [XYZ] coordinates ID=3D1 uftdi0: on usbus1 --=20 PGP-KeyID =3D 0x70654D7C4FB1F588 I am not a robot. --cOQJDfeN1qmiugBGS1EUXahUrqtXTs5gi Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBCgAGBQJVBqQ3AAoJEHBlTXxPsfWI3vsP/i5Wn399atuBm+oICHAcyVbG mC08RWyNZik0Q2JmUJxhR63LccDAVR1ofUqiFV3Gw4IGcIUJSv3DMvdzu9olCe4k dK2wNhVNWZYvfl5NrOCD7550xV6hjqYScyRc234jVY1X0R+lEjBoA1Es6aQ/BZS9 Jn44iweGZjbfufloi8wePDWrdI2NvE+kEhSVWUIDyo+AkT6ZlvP892TSj6t5HjDs nJtoGnBxHOAZqHfb508BXo4vK+d5FUWAKJSpkZ6PGUrPg745Aq6kmqPmbBrw3fe5 Fm0/XVTBhoetCwEeGEYiXiTCcaVeJabR57TgoK2FuWhEV5Kv0LGwWyLxIwE8kel4 mHtNLXoAA56WwTg8U8f5GKSmG3kRfpUUrRtFr7xO3RIofdkLqzuZ8GQBd0J6zTz2 Vs4OyktiPp1B79H7YkvzTNrjAzREC8eCrDNvvpvn8VO9RTy325If4qCgYaJkYVvA VibetnNKg94fExauzohTQ1iKQ8tLyMVY+VULj2RlyA80UdGHptGRYE93j1oIRqbv 4pFLCxCwQSeOvsoi029XVWOQzU2IFD8Njfl99olsdiVFnjs8Rc98l8ajhpdhPAMS NcdAJWGxm8/ySn8ynjkT7Ctk3Efd5frpEzFASvhnlsk9c+lpVlupvsplAq9mvJSP cz8WUU0EIgk0ZGbTlyVx =g162 -----END PGP SIGNATURE----- --cOQJDfeN1qmiugBGS1EUXahUrqtXTs5gi-- From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 13:21:02 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 92F93398 for ; Mon, 16 Mar 2015 13:21:02 +0000 (UTC) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "gold.funkthat.com", Issuer "gold.funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 53C28E5C for ; Mon, 16 Mar 2015 13:21:02 +0000 (UTC) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.14.5/8.14.5) with ESMTP id t2GDKtm0019066 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 16 Mar 2015 06:20:56 -0700 (PDT) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.14.5/8.14.5/Submit) id t2GDKtG6019065; Mon, 16 Mar 2015 06:20:55 -0700 (PDT) (envelope-from jmg) Date: Mon, 16 Mar 2015 06:20:55 -0700 From: John-Mark Gurney To: Mike Tancsa Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn Message-ID: <20150316132055.GQ32288@funkthat.com> References: <5506250A.2000506@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5506250A.2000506@sentex.net> X-Operating-System: FreeBSD 9.1-PRERELEASE amd64 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (gold.funkthat.com [127.0.0.1]); Mon, 16 Mar 2015 06:20:56 -0700 (PDT) Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 13:21:02 -0000 Mike Tancsa wrote this message on Sun, Mar 15, 2015 at 20:34 -0400: > As part of moving from a RELENG8 based image to a RELENG9 or 10, I was > doing some simple performance testing and found RELENG_9 to be quite a > bit faster when generating traffic through a pcengines APU (dual core, > AMD64, 2G of RAM). Both are using generic kernels > > blasting across an aes-128cbc tunnel, on releng9 I get > > > # dd if=/dev/zero | nc 10.3.24.25 500 > > 326002688 bytes transferred in 37.188139 secs (8766308 bytes/sec) > > > vs > > # dd if=/dev/zero | nc 10.3.24.25 500 > 146982400 bytes transferred in 27.750440 secs (5296579 bytes/sec) > on releng10. > > Both have identical pf rules, but disabling pf does not make much of a > difference in speed. > > I havent started checking any of the default tunables. The box will be > functioning as a VPN router and I was hoping to get at least 50Mb/s out > of it, and I can do that on RELENG9, but not 10. > Any ideas what to do with RELENG10 to get comparable performance out of it ? Since you have at test framework ready, you could generate some flame graphs[1] using dtrace to help see where things might be having an impact... These are very easy to generate, and posting them would be useful... [1] http://www.brendangregg.com/FlameGraphs/cpuflamegraphs.html -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 13:40:57 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 45A3A794 for ; Mon, 16 Mar 2015 13:40:57 +0000 (UTC) Received: from mail-qg0-x22f.google.com (mail-qg0-x22f.google.com [IPv6:2607:f8b0:400d:c04::22f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F412AEB for ; Mon, 16 Mar 2015 13:40:56 +0000 (UTC) Received: by qgfa8 with SMTP id a8so39808553qgf.0 for ; Mon, 16 Mar 2015 06:40:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=JrJX8aIBrwbcHdsYHuxymKhH/hi0JsPTuNOzh7gnHXM=; b=HKsxHotCa5ICeISFTQmNZileF4Qi2/nNjbtlBWBeklPUzSYwjFo4OnEIMHVkvU6job wt9vvD1bTtFsEH+BN9YlhucL6cjPDpUyMU4Cp/OF/dBABpBg8RgDufoZPKX6fSatOBa5 jhlR9Y8kSTdZgeUBdE46vY5zAbGFRLoHS21w1wmnyKm/qoPUUS01kogGhIRuLkcIloK2 Lt5osoj36eW3wy7LlTgp94q2KKv83wnIFfOr7kjfpaHqQf+LEUjEO+nHyCdFNi6+VwYh DLF5v8VT9TAWeK+j52hjwxW+TH0YxjG3wRIszEU2ODoy2Hdy03038V+PcOcjHqGLJw5w zVBg== MIME-Version: 1.0 X-Received: by 10.140.148.20 with SMTP id 20mr75621489qhu.67.1426513256126; Mon, 16 Mar 2015 06:40:56 -0700 (PDT) Received: by 10.229.118.2 with HTTP; Mon, 16 Mar 2015 06:40:56 -0700 (PDT) Date: Mon, 16 Mar 2015 16:40:56 +0300 Message-ID: Subject: savecore problem From: Michael BlackHeart To: freebsd-stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 13:40:57 -0000 Hello there. I've got a problem. Recently my personal server issued a kernel panic. Then there's a dump and so on. But there's no dump information after reboot. I do not know what was really the panic cause but assume that savecore failed because of RAID. Problem - minidump was done (I saw it was) but was not recovered by savecore after reboot into /var/vrash Filesystem is UFS FreeBSD diablo.miekoff.local 10.1-STABLE FreeBSD 10.1-STABLE #0 r277169: Thu Jan 15 10:22:34 MSK 2015 amd_miek@diablo.miekoff.local:/usr/obj/usr/src/sys/DIABLO64 amd64 rc.conf configuration dumpdev="AUTO" dumpdir="/var/crash/" RAID 1 via graid configuration (JMicron based) graid list Geom name: JMicron-6e1c79e State: OPTIMAL Metadata: JMicron Providers: 1. Name: raid/r0 Mediasize: 120024203264 (112G) Sectorsize: 512 Mode: r6w6e16 Subdisks: ada0 (ACTIVE), ada1 (ACTIVE) Dirty: No State: OPTIMAL Strip: 1024 Components: 2 Transformation: RAID1 RAIDLevel: RAID1 Label: SYSMIRROR descr: JMicron RAID1 volume Consumers: 1. Name: ada0 Mediasize: 120034123776 (112G) Sectorsize: 512 Mode: r1w1e1 ReadErrors: 0 Subdisks: r0(SYSMIRROR):0@0 State: ACTIVE (ACTIVE) 2. Name: ada1 Mediasize: 120034123776 (112G) Sectorsize: 512 Mode: r1w1e1 ReadErrors: 0 Subdisks: r0(SYSMIRROR):1@0 State: ACTIVE (ACTIVE) /etc/fstab # Device Mountpoint FStype Options Dump Pass# /dev/ufs/rootfs / ufs rw,noatime 1 1 /dev/raid/r0p3 none swap sw 0 0 /dev/ufs/varfs /var ufs rw,noatime 2 2 /dev/ufs/tmpfs /tmp ufs rw,noatime 2 2 /dev/ufs/usrfs /usr ufs rw,noatime 2 2 /dev/ufs/configfs /config ufs rw,noatime 2 2 tmpfs /usr/tmpfs tmpfs rw 0 0 proc /proc procfs rw 0 0 fdesc /dev/fd fdescfs rw 0 0 In kernel configuration DEBUG -g is disabled. -- amd_miek Think different. Just superior. From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 14:17:56 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 31027D9E for ; Mon, 16 Mar 2015 14:17:56 +0000 (UTC) Received: from mail-pd0-x229.google.com (mail-pd0-x229.google.com [IPv6:2607:f8b0:400e:c02::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F157577F for ; Mon, 16 Mar 2015 14:17:55 +0000 (UTC) Received: by pdnc3 with SMTP id c3so59587105pdn.0 for ; Mon, 16 Mar 2015 07:17:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=CrteB+oHOZVyK8tcbWTvmgDUUCRjBI6ZiH/5K6FSs7c=; b=muXJLImbjcUVyZc6ZYzhnYbD+932YVcYvDZ2Hv+/FM2tmb3dGOZ6RPRhaZ+/fpMTVZ K93jl6jk1gH26enQYpPlT16vTevSkXW/+2lONwWs/16r6i/FiVZhhwI27luIQyRLM5tG rNF+gUe2Fg/O7Oovsoywh8MXmsv5g8LbHxbZ9HxifAG63+TuRkk8//4xubIRQvowIoEW GUXl5tvg3Gtel9d5RXQ2zhGqnjoh0gnCjvR78TXf7EgE6iNyYgCFHDYIzuve+GG8vrbR y2LaBllZi1b56vl9GKZ+WroMOigbxZB6j4JHCcwsrygj5QP0U1L2ojewaerXzsj64GDF t/MQ== MIME-Version: 1.0 X-Received: by 10.70.103.230 with SMTP id fz6mr98845876pdb.45.1426515474797; Mon, 16 Mar 2015 07:17:54 -0700 (PDT) Received: by 10.70.124.201 with HTTP; Mon, 16 Mar 2015 07:17:54 -0700 (PDT) In-Reply-To: References: Date: Mon, 16 Mar 2015 10:17:54 -0400 Message-ID: Subject: Re: savecore problem From: Brandon Allbery To: Michael BlackHeart Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-stable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 14:17:56 -0000 On Mon, Mar 16, 2015 at 9:40 AM, Michael BlackHeart wrote: > Hello there. I've got a problem. Recently my personal server issued a > kernel panic. Then there's a dump and so on. But there's no dump > information after reboot. I do not know what was really the panic cause but > assume that savecore failed because of RAID. > > Problem - minidump was done (I saw it was) but was not recovered by > savecore after reboot into /var/vrash > (...) > /dev/ufs/varfs /var ufs rw,noatime > 2 2 > Last I checked, savecore had to happen very early --- before filesystems other than / are mounted. -- brandon s allbery kf8nh sine nomine associates allbery.b@gmail.com ballbery@sinenomine.net unix, openafs, kerberos, infrastructure, xmonad http://sinenomine.net From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 15:23:21 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 064B55BA for ; Mon, 16 Mar 2015 15:23:21 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D192D123 for ; Mon, 16 Mar 2015 15:23:20 +0000 (UTC) Received: from ralph.baldwin.cx (pool-173-54-116-245.nwrknj.fios.verizon.net [173.54.116.245]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 2E30DB941; Mon, 16 Mar 2015 11:23:18 -0400 (EDT) From: John Baldwin To: freebsd-stable@freebsd.org Subject: Re: savecore problem Date: Mon, 16 Mar 2015 11:23:07 -0400 Message-ID: <2959054.c91S7azMUP@ralph.baldwin.cx> User-Agent: KMail/4.14.2 (FreeBSD/10.1-STABLE; KDE/4.14.2; amd64; ; ) In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 16 Mar 2015 11:23:18 -0400 (EDT) Cc: Brandon Allbery , Michael BlackHeart X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 15:23:21 -0000 On Monday, March 16, 2015 10:17:54 AM Brandon Allbery wrote: > On Mon, Mar 16, 2015 at 9:40 AM, Michael BlackHeart > wrote: > > > Hello there. I've got a problem. Recently my personal server issued a > > kernel panic. Then there's a dump and so on. But there's no dump > > information after reboot. I do not know what was really the panic cause but > > assume that savecore failed because of RAID. > > > > Problem - minidump was done (I saw it was) but was not recovered by > > savecore after reboot into /var/vrash > > > (...) > > > /dev/ufs/varfs /var ufs rw,noatime > > 2 2 > > > > Last I checked, savecore had to happen very early --- before filesystems > other than / are mounted. No, it can happen after that. What really has to happen is that you don't use swap (if you are dumping to your swap partition) before savecore runs. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 15:23:21 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6EB485BC for ; Mon, 16 Mar 2015 15:23:21 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46073124 for ; Mon, 16 Mar 2015 15:23:21 +0000 (UTC) Received: from ralph.baldwin.cx (pool-173-54-116-245.nwrknj.fios.verizon.net [173.54.116.245]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 0662EB96B; Mon, 16 Mar 2015 11:23:20 -0400 (EDT) From: John Baldwin To: freebsd-stable@freebsd.org Subject: Re: HP EliteBook EFI boot failure Date: Mon, 16 Mar 2015 11:21:22 -0400 Message-ID: <4578914.pupgQQ80ch@ralph.baldwin.cx> User-Agent: KMail/4.14.2 (FreeBSD/10.1-STABLE; KDE/4.14.2; amd64; ; ) In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 16 Mar 2015 11:23:20 -0400 (EDT) Cc: Greg Rivers , Oliver Pinter X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 15:23:21 -0000 On Sunday, March 15, 2015 02:28:41 PM Oliver Pinter wrote: > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194063 I am curious if the redzone fix I committed to the EFI loader last week might help. It was noticed because gzipped kernels were corrupted when loaded from disk, but it might generate other random corruption even in the non-gzip case. I think the chance that it helps is low, but it isn't quite zero. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 15:33:52 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AFF74F64 for ; Mon, 16 Mar 2015 15:33:52 +0000 (UTC) Received: from mail-ig0-x22c.google.com (mail-ig0-x22c.google.com [IPv6:2607:f8b0:4001:c05::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7700E356 for ; Mon, 16 Mar 2015 15:33:52 +0000 (UTC) Received: by igbue6 with SMTP id ue6so45355886igb.1 for ; Mon, 16 Mar 2015 08:33:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-type; bh=dhBwnfRicKPi072OkcmdgSEYQeEMqzRb3c56sFIqTNk=; b=prtvtBkKkktmKWlqpvTPDr6VedE/9xMhAlYY1KzpxoucRkboJhP+8+0gvJ9/Mw8JQ4 JwuIUd6hdwskwjfQXMc6vIbqj9vqcncnHHqvaM+CddJIukPvAp2pb1ONjbSsmycSpix3 KiQBcObViPhLJzWcx9wUk/gkR8qKrYg6Sl8I5nBl6B+76FqKnGA/hWOXozA+V3daSvVs GqfpnU5n0K+uJ067zlZtPJRNBx6lEAe7xnTN0c/eHRz6bhplPRQ6utrcXUg2QbpExlzt RAkIjRA3NhwMd2eKcOiGT2Uk/KgKfmZW1jy7x4oOONuevbBKdbnDM3k+ffX98Y6fAi6I tk4A== X-Received: by 10.50.82.68 with SMTP id g4mr136160150igy.26.1426520031813; Mon, 16 Mar 2015 08:33:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.36.71.72 with HTTP; Mon, 16 Mar 2015 08:33:31 -0700 (PDT) In-Reply-To: References: From: Konstantin Kulikov Date: Mon, 16 Mar 2015 18:33:31 +0300 Message-ID: Subject: Re: savecore problem To: Michael BlackHeart Content-Type: text/plain; charset=UTF-8 Cc: freebsd-stable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 15:33:52 -0000 Hello, have you tried to run savecore manually, like savecore -vvf /var/crash /dev/raid/r0p3 Also check that your dump device is working (dumpon -l) On Mon, Mar 16, 2015 at 4:40 PM, Michael BlackHeart wrote: > Hello there. I've got a problem. Recently my personal server issued a > kernel panic. Then there's a dump and so on. But there's no dump > information after reboot. I do not know what was really the panic cause but > assume that savecore failed because of RAID. > > Problem - minidump was done (I saw it was) but was not recovered by > savecore after reboot into /var/vrash > > Filesystem is UFS > > FreeBSD diablo.miekoff.local 10.1-STABLE FreeBSD 10.1-STABLE #0 r277169: > Thu Jan 15 10:22:34 MSK 2015 > amd_miek@diablo.miekoff.local:/usr/obj/usr/src/sys/DIABLO64 > amd64 > > rc.conf configuration > > dumpdev="AUTO" > dumpdir="/var/crash/" > > > > RAID 1 via graid configuration (JMicron based) > > graid list > Geom name: JMicron-6e1c79e > State: OPTIMAL > Metadata: JMicron > Providers: > 1. Name: raid/r0 > Mediasize: 120024203264 (112G) > Sectorsize: 512 > Mode: r6w6e16 > Subdisks: ada0 (ACTIVE), ada1 (ACTIVE) > Dirty: No > State: OPTIMAL > Strip: 1024 > Components: 2 > Transformation: RAID1 > RAIDLevel: RAID1 > Label: SYSMIRROR > descr: JMicron RAID1 volume > Consumers: > 1. Name: ada0 > Mediasize: 120034123776 (112G) > Sectorsize: 512 > Mode: r1w1e1 > ReadErrors: 0 > Subdisks: r0(SYSMIRROR):0@0 > State: ACTIVE (ACTIVE) > 2. Name: ada1 > Mediasize: 120034123776 (112G) > Sectorsize: 512 > Mode: r1w1e1 > ReadErrors: 0 > Subdisks: r0(SYSMIRROR):1@0 > State: ACTIVE (ACTIVE) > > /etc/fstab > > # Device Mountpoint FStype Options > Dump Pass# > /dev/ufs/rootfs / ufs rw,noatime > 1 1 > /dev/raid/r0p3 none swap sw > 0 0 > /dev/ufs/varfs /var ufs rw,noatime > 2 2 > /dev/ufs/tmpfs /tmp ufs rw,noatime > 2 2 > /dev/ufs/usrfs /usr ufs rw,noatime > 2 2 > /dev/ufs/configfs /config ufs rw,noatime > 2 2 > tmpfs /usr/tmpfs tmpfs rw > 0 0 > proc /proc procfs rw > 0 0 > fdesc /dev/fd fdescfs rw > 0 0 > > In kernel configuration DEBUG -g is disabled. > > -- > amd_miek > Think different. > Just superior. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 16:10:40 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 74A69F5F; Mon, 16 Mar 2015 16:10:40 +0000 (UTC) Received: from mx2.paymentallianceintl.com (mx2.paymentallianceintl.com [216.26.158.171]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx2.paymentallianceintl.com", Issuer "Go Daddy Secure Certification Authority" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 30A38AD4; Mon, 16 Mar 2015 16:10:39 +0000 (UTC) Received: from firewall.mikej.com (162-230-214-65.lightspeed.lsvlky.sbcglobal.net [162.230.214.65]) by mx2.paymentallianceintl.com (8.15.1/8.15.1) with ESMTPS id t2GFsr2f014147 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Mon, 16 Mar 2015 11:54:54 -0400 (EDT) (envelope-from mikej@mikej.com) X-Authentication-Warning: mx2.paymentallianceintl.com: Host 162-230-214-65.lightspeed.lsvlky.sbcglobal.net [162.230.214.65] claimed to be firewall.mikej.com Received: from mail.mikej.com (firewall [192.168.6.63]) by firewall.mikej.com (8.15.1/8.14.9) with ESMTP id t2GFsqr8089598; Mon, 16 Mar 2015 11:54:52 -0400 (EDT) (envelope-from mikej@mikej.com) X-Authentication-Warning: firewall.mikej.com: Host firewall [192.168.6.63] claimed to be mail.mikej.com MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Mon, 16 Mar 2015 11:54:52 -0400 From: Michael Jung To: John Baldwin Subject: Re: savecore problem In-Reply-To: <2959054.c91S7azMUP@ralph.baldwin.cx> References: <2959054.c91S7azMUP@ralph.baldwin.cx> Message-ID: <2142548d6fac1894597a45a042966c7a@mail.mikej.com> X-Sender: mikej@mikej.com User-Agent: Roundcube Webmail/1.0.4 Cc: owner-freebsd-stable@freebsd.org, freebsd-stable@freebsd.org, Brandon Allbery , Michael BlackHeart X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 16:10:40 -0000 On 2015-03-16 11:23, John Baldwin wrote: > On Monday, March 16, 2015 10:17:54 AM Brandon Allbery wrote: >> On Mon, Mar 16, 2015 at 9:40 AM, Michael BlackHeart >> >> wrote: >> >> > Hello there. I've got a problem. Recently my personal server issued a >> > kernel panic. Then there's a dump and so on. But there's no dump >> > information after reboot. I do not know what was really the panic cause but >> > assume that savecore failed because of RAID. >> > >> > Problem - minidump was done (I saw it was) but was not recovered by >> > savecore after reboot into /var/vrash >> > >> (...) >> >> > /dev/ufs/varfs /var ufs rw,noatime >> > 2 2 >> > >> >> Last I checked, savecore had to happen very early --- before >> filesystems >> other than / are mounted. > > No, it can happen after that. What really has to happen is that you > don't > use swap (if you are dumping to your swap partition) before savecore > runs. Can someone elaborate on not using swap as a dump device a little more? I have had instances in the past were I had issues with getting a core dump and resorted to a dedicated dump device but didn't investigate further nor have I read this as a requirement. A second question - Can a USB devices be used reliably for a dump device for ZFS on boot systems? Regards, Michael Jung From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 17:25:15 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4A5EA443 for ; Mon, 16 Mar 2015 17:25:15 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 213305F8 for ; Mon, 16 Mar 2015 17:25:15 +0000 (UTC) Received: from ralph.baldwin.cx (pool-173-54-116-245.nwrknj.fios.verizon.net [173.54.116.245]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 1EBADB941; Mon, 16 Mar 2015 13:25:13 -0400 (EDT) From: John Baldwin To: Michael Jung Subject: Re: savecore problem Date: Mon, 16 Mar 2015 13:25:04 -0400 Message-ID: <7133006.rnVJT8O1gz@ralph.baldwin.cx> User-Agent: KMail/4.14.2 (FreeBSD/10.1-STABLE; KDE/4.14.2; amd64; ; ) In-Reply-To: <2142548d6fac1894597a45a042966c7a@mail.mikej.com> References: <2959054.c91S7azMUP@ralph.baldwin.cx> <2142548d6fac1894597a45a042966c7a@mail.mikej.com> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Mon, 16 Mar 2015 13:25:13 -0400 (EDT) Cc: freebsd-stable@freebsd.org, Brandon Allbery , Michael BlackHeart X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 17:25:15 -0000 On Monday, March 16, 2015 11:54:52 AM Michael Jung wrote: > On 2015-03-16 11:23, John Baldwin wrote: > > On Monday, March 16, 2015 10:17:54 AM Brandon Allbery wrote: > >> On Mon, Mar 16, 2015 at 9:40 AM, Michael BlackHeart > >> > >> wrote: > >> > >> > Hello there. I've got a problem. Recently my personal server issued a > >> > kernel panic. Then there's a dump and so on. But there's no dump > >> > information after reboot. I do not know what was really the panic cause but > >> > assume that savecore failed because of RAID. > >> > > >> > Problem - minidump was done (I saw it was) but was not recovered by > >> > savecore after reboot into /var/vrash > >> > > >> (...) > >> > >> > /dev/ufs/varfs /var ufs rw,noatime > >> > 2 2 > >> > > >> > >> Last I checked, savecore had to happen very early --- before > >> filesystems > >> other than / are mounted. > > > > No, it can happen after that. What really has to happen is that you > > don't > > use swap (if you are dumping to your swap partition) before savecore > > runs. > > Can someone elaborate on not using swap as a dump device a little more? > I have > had instances in the past were I had issues with getting a core dump > and resorted to a dedicated dump device but didn't investigate further > nor have > I read this as a requirement. Typically the first swap partition is used as the dump partition. If the system writes anything out to swap before savecore runs, then it can potentially overwrite part of the core. (Note that the running kernel doesn't "know" that there is a core on the swap partition to try to preserve, it just sees that there is an available swap partition.) To try to minimize the chances of this happening, the dump is written at the end of the swap partition instead of the start, but that is not foolproof. Usually you don't run too many things during early boot before savecore that would cause swapping, though a fsck of a large filesystem might use quite a bit of RAM which could result in swapping. > A second question - Can a USB devices be used reliably for a dump device > for > ZFS on boot systems? I'm not sure if USB devices will work as a dump device or not. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 18:06:21 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 86A3314A for ; Mon, 16 Mar 2015 18:06:21 +0000 (UTC) Received: from mail-qg0-x235.google.com (mail-qg0-x235.google.com [IPv6:2607:f8b0:400d:c04::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 39993AD2 for ; Mon, 16 Mar 2015 18:06:21 +0000 (UTC) Received: by qgh62 with SMTP id 62so47474668qgh.1 for ; Mon, 16 Mar 2015 11:06:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=DG3IIvtP9JhqGez+Q1gI8EWzNiXNK4ciD6TKGEzdisk=; b=Vj6nhU3w7csXm9sPukewcuSmsI5SEt98wSChpRWOETW0lXBFGyc26sdQaqrPY36clT Q0Henu2gqAhXZE81OYW0fEp1+ELyk/nYyJzGLZS/6sj/E9ZRbL8+4DPrI7goZP/rndRj 01mdnXpGHMGX2dEcfbDEFQRpLyFAfDpf3Y4HLDx9NplJxWts0hrovhAesU5L3jxo4C3n UjqdOLGp5ZyHsq9g2pjNB1vSDZ1tLwXjyc3rDmV+T4rIHeDAzgVRq9xWJHvWHnEho8xF M8/mJmvhVRdFp5n+rV5z0OF7wbX/lp/EWkqRlgpzq1ETN+ZZ5r8BH++sir2OdGl2FEqu oesw== MIME-Version: 1.0 X-Received: by 10.140.34.204 with SMTP id l70mr75649793qgl.55.1426529180264; Mon, 16 Mar 2015 11:06:20 -0700 (PDT) Received: by 10.229.118.2 with HTTP; Mon, 16 Mar 2015 11:06:20 -0700 (PDT) In-Reply-To: References: Date: Mon, 16 Mar 2015 21:06:20 +0300 Message-ID: Subject: Re: savecore problem From: Michael BlackHeart To: Konstantin Kulikov Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-stable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 18:06:21 -0000 I've tried to run manually savecore. I tried before RAID get OPTIMAL and after that. dumpmon says: dumpon -l raid/r0p3 savecore -vvf /var/crash /dev/raid/r0p3 worked now but... It extracted another dump from october 2014. On my box swap used just a little so I blieve that there might be that dump but where's dump from march,15 2015? I'd like to figure out what happend with savecore and kernel dumps. Is there a safe way to test this functional? Some test kernel panics? 2015-03-16 18:33 GMT+03:00 Konstantin Kulikov : > Hello, > > have you tried to run savecore manually, like > savecore -vvf /var/crash /dev/raid/r0p3 > > Also check that your dump device is working (dumpon -l) > > On Mon, Mar 16, 2015 at 4:40 PM, Michael BlackHeart > wrote: > > Hello there. I've got a problem. Recently my personal server issued a > > kernel panic. Then there's a dump and so on. But there's no dump > > information after reboot. I do not know what was really the panic cause > but > > assume that savecore failed because of RAID. > > > > Problem - minidump was done (I saw it was) but was not recovered by > > savecore after reboot into /var/vrash > > > > Filesystem is UFS > > > > FreeBSD diablo.miekoff.local 10.1-STABLE FreeBSD 10.1-STABLE #0 r277169: > > Thu Jan 15 10:22:34 MSK 2015 > > amd_miek@diablo.miekoff.local:/usr/obj/usr/src/sys/DIABLO64 > > amd64 > > > > rc.conf configuration > > > > dumpdev="AUTO" > > dumpdir="/var/crash/" > > > > > > > > RAID 1 via graid configuration (JMicron based) > > > > graid list > > Geom name: JMicron-6e1c79e > > State: OPTIMAL > > Metadata: JMicron > > Providers: > > 1. Name: raid/r0 > > Mediasize: 120024203264 (112G) > > Sectorsize: 512 > > Mode: r6w6e16 > > Subdisks: ada0 (ACTIVE), ada1 (ACTIVE) > > Dirty: No > > State: OPTIMAL > > Strip: 1024 > > Components: 2 > > Transformation: RAID1 > > RAIDLevel: RAID1 > > Label: SYSMIRROR > > descr: JMicron RAID1 volume > > Consumers: > > 1. Name: ada0 > > Mediasize: 120034123776 (112G) > > Sectorsize: 512 > > Mode: r1w1e1 > > ReadErrors: 0 > > Subdisks: r0(SYSMIRROR):0@0 > > State: ACTIVE (ACTIVE) > > 2. Name: ada1 > > Mediasize: 120034123776 (112G) > > Sectorsize: 512 > > Mode: r1w1e1 > > ReadErrors: 0 > > Subdisks: r0(SYSMIRROR):1@0 > > State: ACTIVE (ACTIVE) > > > > /etc/fstab > > > > # Device Mountpoint FStype Options > > Dump Pass# > > /dev/ufs/rootfs / ufs rw,noatime > > 1 1 > > /dev/raid/r0p3 none swap sw > > 0 0 > > /dev/ufs/varfs /var ufs rw,noatime > > 2 2 > > /dev/ufs/tmpfs /tmp ufs rw,noatime > > 2 2 > > /dev/ufs/usrfs /usr ufs rw,noatime > > 2 2 > > /dev/ufs/configfs /config ufs rw,noatime > > 2 2 > > tmpfs /usr/tmpfs tmpfs rw > > 0 0 > > proc /proc procfs rw > > 0 0 > > fdesc /dev/fd fdescfs rw > > 0 0 > > > > In kernel configuration DEBUG -g is disabled. > > > > -- > > amd_miek > > Think different. > > Just superior. > > _______________________________________________ > > freebsd-stable@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org > " > -- amd_miek Think different. Just superior. From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 22:59:34 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2DEA98CF for ; Mon, 16 Mar 2015 22:59:34 +0000 (UTC) Received: from mail-ie0-x22b.google.com (mail-ie0-x22b.google.com [IPv6:2607:f8b0:4001:c03::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E9A613B8 for ; Mon, 16 Mar 2015 22:59:33 +0000 (UTC) Received: by ieclw3 with SMTP id lw3so184779309iec.2 for ; Mon, 16 Mar 2015 15:59:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=DUraItg9ujHWhwiD55J79m+L3tFs3VSa0KBP6BqJE4M=; b=uge6bRkuLbdhtbcmOnIzojdAbaEymbGOLp6OPCqwUNeaaxlOUF02KpAViAvONeVLuR GS9VmFSmpkfFsHCak0uwAlbnxbewBd3LfAuO9qsS6meAG19K4RHm9mvniosbjHSHqVYE Cu21QeApz/Xg1omXog4pHm5Bw/VspjmoCK0EPVOXdrcrrlHj0NLC4p1QtJJI3wGGPZ2x CLBn4rt4QuZkN8lWbiq+Uduvo0FHhPLcbQfABHadTOajagfDbyc4SuDcdpAa21UXrkjo C4At30OqmsMkbKtoTrtfnu+V3FpKRVb36VKasmyG7SwhUoPmSMyI2sXa3Q3c5IKsyBF8 tE2A== MIME-Version: 1.0 X-Received: by 10.107.8.215 with SMTP id h84mr88026331ioi.89.1426546773464; Mon, 16 Mar 2015 15:59:33 -0700 (PDT) Sender: jdavidlists@gmail.com Received: by 10.36.67.139 with HTTP; Mon, 16 Mar 2015 15:59:33 -0700 (PDT) Date: Mon, 16 Mar 2015 18:59:33 -0400 X-Google-Sender-Auth: _eCVGr_f5F4VNKbzofYO_4zjkII Message-ID: Subject: Significant memory leak in 9.3p10? From: J David To: freebsd-stable Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 22:59:34 -0000 Recently we have seen a large-scale memory leak on amd64 machines running FreeBSD 9.3-RELEASE-p10. This was first observed on 9.3p2 but has since shown up all the way through p10. Here's what the header of top shows: last pid: 32329; load averages: 0.00, 0.01, 0.21 up 3+15:37:29 22:34:04 25 processes: 2 running, 22 sleeping, 1 waiting CPU: % user, % nice, % system, % interrupt, % idle Mem: 4072M Active, 895M Inact, 1284M Wired, 125M Cache, 826M Buf, 1521M Free Swap: 1024M Total, 874M Used, 149M Free, 85% Inuse About 4G actively being used, another 895M inactive, and another 874M in swap. So it seems like this is a user-space leak, rather than a kernel-space leak. At the time of measurement, this machine was not doing anything and every possible process had been killed trying to find a culprit. The entire output of "ps axlww" is: UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 0 0 0 -52 0 0 224 - DLs ?? 0:00.82 [kernel] 0 1 0 0 20 0 6280 556 wait SLs ?? 0:00.57 /sbin/init -- 0 2 0 0 -16 0 0 16 pftm DL ?? 0:00.85 [pfpurge] 0 3 0 0 -16 0 0 16 waiting_ DL ?? 0:00.00 [sctp_iterator] 0 4 0 0 -16 0 0 16 - DL ?? 0:00.00 [xpt_thrd] 0 5 0 0 -16 0 0 16 psleep DL ?? 0:28.85 [pagedaemon] 0 6 0 0 -16 0 0 16 psleep DL ?? 0:45.03 [vmdaemon] 0 7 0 0 -16 0 0 16 pollid DL ?? 0:00.23 [idlepoll] 0 8 0 0 155 0 0 16 pgzero DL ?? 0:00.00 [pagezero] 0 9 0 0 -16 0 0 16 psleep DL ?? 0:00.83 [bufdaemon] 0 10 0 0 -16 0 0 16 audit_wo DL ?? 0:00.00 [audit] 0 11 0 0 155 0 0 32 - RL ?? 8317:13.37 [idle] 0 12 0 0 -76 0 0 240 - WL ?? 301:43.54 [intr] 0 13 0 0 -8 0 0 48 - DL ?? 0:09.89 [geom] 0 14 0 0 -16 0 0 16 - DL ?? 2:58.88 [yarrow] 0 15 0 0 -68 0 0 64 - DL ?? 0:02.32 [usb] 0 16 0 0 -16 0 0 16 vlruwt DL ?? 0:06.35 [vnlru] 0 17 0 0 16 0 0 16 syncer DL ?? 5:28.89 [syncer] 0 18 0 0 -16 0 0 16 sdflush DL ?? 0:10.27 [softdepflush] 0 19 0 0 -16 0 0 16 - DL ?? 0:55.09 [racctd] 0 830 1 0 20 0 45348 2396 wait Is u0 0:00.07 login [pam] (login) 500 32269 830 0 20 0 14556 2428 wait S u0 0:00.09 -sh (sh) 500 32340 32269 0 20 0 16296 1908 - R+ u0 0:00.00 ps axlww Since the issue doesn't seem related to kernel memory usage, vmstat -m and -z have been skipped, but nothing jumps out as using gigs of RAM; they do appear consistent with 1284M of wired memory, which is not unreasonable for the affected machines' tuning and workload. The only user-space processes running are login, sh, and ps. So where did 5.5G of userspace RAM go? The only other potentially useful information is that when this happens, shutting down the system will hang for about ten minutes. $ sudo halt -p Waiting (max 60 seconds) for system process `vnlru' to stop...done Waiting (max 60 seconds) for system process `bufdaemon' to stop...done Waiting (max 60 seconds) for system process `syncer' to stop... Syncing disks, vnodes remaining...0 0 0 0 0 0 0 0 0 done All buffers synced. <----- 10 MINUTE HANG AFTER PRINTING THIS Uptime: 3d15h56m32s usbus0: Controller shutdown uhub0: at usbus0, port 1, addr 1 (disconnected) usbus0: controller did not stop usbus0: Controller shutdown complete acpi0: Powering system off Connection closed by foreign host. So it seems like somewhere after "All buffers synced" and printing the uptime, it's very slowly unwinding whatever is using up all that RAM and swap. Does anyone have any idea what might be causing this or how to fix/prevent it? Thanks in advance for any advice! From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 23:24:10 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D760BD17 for ; Mon, 16 Mar 2015 23:24:10 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 785A88A2 for ; Mon, 16 Mar 2015 23:24:10 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.9/8.14.9) with ESMTP id t2GNO5Lb067344 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 17 Mar 2015 01:24:05 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.9.2 kib.kiev.ua t2GNO5Lb067344 Received: (from kostik@localhost) by tom.home (8.14.9/8.14.9/Submit) id t2GNO5op067343; Tue, 17 Mar 2015 01:24:05 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 17 Mar 2015 01:24:04 +0200 From: Konstantin Belousov To: J David Subject: Re: Significant memory leak in 9.3p10? Message-ID: <20150316232404.GM2379@kib.kiev.ua> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: freebsd-stable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 23:24:10 -0000 On Mon, Mar 16, 2015 at 06:59:33PM -0400, J David wrote: > Recently we have seen a large-scale memory leak on amd64 machines > running FreeBSD 9.3-RELEASE-p10. > > This was first observed on 9.3p2 but has since shown up all the way through p10. > > Here's what the header of top shows: > > last pid: 32329; load averages: 0.00, 0.01, 0.21 up 3+15:37:29 22:34:04 > 25 processes: 2 running, 22 sleeping, 1 waiting > CPU: % user, % nice, % system, % interrupt, % idle > Mem: 4072M Active, 895M Inact, 1284M Wired, 125M Cache, 826M Buf, 1521M Free > Swap: 1024M Total, 874M Used, 149M Free, 85% Inuse > > About 4G actively being used, another 895M inactive, and another 874M > in swap. So it seems like this is a user-space leak, rather than a > kernel-space leak. > > At the time of measurement, this machine was not doing anything and > every possible process had been killed trying to find a culprit. The > entire output of "ps axlww" is: > > UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND > 0 0 0 0 -52 0 0 224 - DLs ?? 0:00.82 [kernel] > 0 1 0 0 20 0 6280 556 wait SLs ?? 0:00.57 /sbin/init -- > 0 2 0 0 -16 0 0 16 pftm DL ?? 0:00.85 [pfpurge] > 0 3 0 0 -16 0 0 16 waiting_ DL ?? 0:00.00 > [sctp_iterator] > 0 4 0 0 -16 0 0 16 - DL ?? 0:00.00 [xpt_thrd] > 0 5 0 0 -16 0 0 16 psleep DL ?? 0:28.85 [pagedaemon] > 0 6 0 0 -16 0 0 16 psleep DL ?? 0:45.03 [vmdaemon] > 0 7 0 0 -16 0 0 16 pollid DL ?? 0:00.23 [idlepoll] > 0 8 0 0 155 0 0 16 pgzero DL ?? 0:00.00 [pagezero] > 0 9 0 0 -16 0 0 16 psleep DL ?? 0:00.83 [bufdaemon] > 0 10 0 0 -16 0 0 16 audit_wo DL ?? 0:00.00 [audit] > 0 11 0 0 155 0 0 32 - RL ?? 8317:13.37 [idle] > 0 12 0 0 -76 0 0 240 - WL ?? 301:43.54 [intr] > 0 13 0 0 -8 0 0 48 - DL ?? 0:09.89 [geom] > 0 14 0 0 -16 0 0 16 - DL ?? 2:58.88 [yarrow] > 0 15 0 0 -68 0 0 64 - DL ?? 0:02.32 [usb] > 0 16 0 0 -16 0 0 16 vlruwt DL ?? 0:06.35 [vnlru] > 0 17 0 0 16 0 0 16 syncer DL ?? 5:28.89 [syncer] > 0 18 0 0 -16 0 0 16 sdflush DL ?? 0:10.27 > [softdepflush] > 0 19 0 0 -16 0 0 16 - DL ?? 0:55.09 [racctd] > 0 830 1 0 20 0 45348 2396 wait Is u0 0:00.07 > login [pam] (login) > 500 32269 830 0 20 0 14556 2428 wait S u0 0:00.09 -sh (sh) > 500 32340 32269 0 20 0 16296 1908 - R+ u0 0:00.00 ps axlww > > Since the issue doesn't seem related to kernel memory usage, vmstat -m > and -z have been skipped, but nothing jumps out as using gigs of RAM; > they do appear consistent with 1284M of wired memory, which is not > unreasonable for the affected machines' tuning and workload. > > The only user-space processes running are login, sh, and ps. So where > did 5.5G of userspace RAM go? > > The only other potentially useful information is that when this > happens, shutting down the system will hang for about ten minutes. > > $ sudo halt -p > Waiting (max 60 seconds) for system process `vnlru' to stop...done > Waiting (max 60 seconds) for system process `bufdaemon' to stop...done > Waiting (max 60 seconds) for system process `syncer' to stop... > Syncing disks, vnodes remaining...0 0 0 0 0 0 0 0 0 done > All buffers synced. <----- 10 MINUTE HANG AFTER PRINTING THIS > Uptime: 3d15h56m32s > usbus0: Controller shutdown > uhub0: at usbus0, port 1, addr 1 (disconnected) > usbus0: controller did not stop > usbus0: Controller shutdown complete > acpi0: Powering system off > Connection closed by foreign host. > > So it seems like somewhere after "All buffers synced" and printing the > uptime, it's very slowly unwinding whatever is using up all that RAM > and swap. > > Does anyone have any idea what might be causing this or how to fix/prevent it? There are a lot of possibilities to create persistent anonymous shared memory objects. Not complete list is tmpfs mounts, swap-backed md disks, sysv shared memory, possibly posix shared memory (I do not remember which implementation is used in stable/9). I quite possible missed some object types. Also note that active/inactive can be explained by cached file pages, and only swap usage suggests that it might be something persisent from the list above. From owner-freebsd-stable@FreeBSD.ORG Mon Mar 16 23:52:11 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 669852C2 for ; Mon, 16 Mar 2015 23:52:11 +0000 (UTC) Received: from mail-ig0-x231.google.com (mail-ig0-x231.google.com [IPv6:2607:f8b0:4001:c05::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2B9AABE9 for ; Mon, 16 Mar 2015 23:52:11 +0000 (UTC) Received: by igbue6 with SMTP id ue6so58260775igb.1 for ; Mon, 16 Mar 2015 16:52:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=B0ajGRYIGiSekWkomJ8TD4cBLmTLFsHKCKIi/bQugO8=; b=WJIP3S6HhLOK77eiWIuCinb/EQ5sV80LWdSK8+wgWfgxgIq4ih05NcRiaXYgv0C4wH rCZJaTHvspdDQDW3gMwg/PCZ1XAluHS9qnlKb5ngXoBp5N0WOshuwtExe1tqIDWx4map EB6Y8WQl0ZPEqb/nn7BoefJkShJVWgKehovM/FcWvlKudWt/TfeiU6GLQXAMlnj2T+Ou FD4sC1G4/p5cVst5Ja3WyawqaXgmkL2HtU3/aHT4SRnZX4vKg+vC5O/s2UaPNymxa/v2 4TuXm6oI7IWLijGHiMQbc6pwSnqqALlhlcozdhFWddbtbmUaBFOcR5D0DHMPDAPTOCns U/PA== MIME-Version: 1.0 X-Received: by 10.42.52.209 with SMTP id k17mr9320170icg.11.1426549930504; Mon, 16 Mar 2015 16:52:10 -0700 (PDT) Sender: jdavidlists@gmail.com Received: by 10.36.67.139 with HTTP; Mon, 16 Mar 2015 16:52:10 -0700 (PDT) In-Reply-To: <20150316232404.GM2379@kib.kiev.ua> References: <20150316232404.GM2379@kib.kiev.ua> Date: Mon, 16 Mar 2015 19:52:10 -0400 X-Google-Sender-Auth: kxLvi8IdOi5Z7xxuOoPlx-UI3vU Message-ID: Subject: Re: Significant memory leak in 9.3p10? From: J David To: Konstantin Belousov Content-Type: text/plain; charset=UTF-8 Cc: freebsd-stable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Mar 2015 23:52:11 -0000 On Mon, Mar 16, 2015 at 7:24 PM, Konstantin Belousov wrote: > There are a lot of possibilities to create persistent anonymous shared > memory objects. Not complete list is tmpfs mounts, swap-backed md disks, > sysv shared memory, possibly posix shared memory (I do not remember which > implementation is used in stable/9). If that's the explanation, how could it be detected/measured/investigated/resolved/prevented? Under ordinary circumstances, machines will go run like this for days/weeks: Mem: 549M Active, 3623M Inact, 567M Wired, 3484K Cache, 827M Buf, 3156M Free Swap: 1024M Total, 1024M Free Then, when this happens, it rapidly degrades from that to so bad that processes start getting killed for being out of swap space. Thanks! From owner-freebsd-stable@FreeBSD.ORG Tue Mar 17 14:58:29 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EFFF2B01 for ; Tue, 17 Mar 2015 14:58:29 +0000 (UTC) Received: from mail-oi0-x22e.google.com (mail-oi0-x22e.google.com [IPv6:2607:f8b0:4003:c06::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AE4D095C for ; Tue, 17 Mar 2015 14:58:29 +0000 (UTC) Received: by oigv203 with SMTP id v203so10354941oig.3 for ; Tue, 17 Mar 2015 07:58:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=ENBR6skdrQpM8HwsBq6UYWW933X9f6BGlOw/BxEGV1c=; b=dbq+kfBdJc0AKTxbLWA4BXnX8TnCY2OtwhFj6fRTy+fnrNg4ABLHpQBPVDtFRgfEjP 6nb+i64oiKrSN39KTcOmO9SIGf4ZjtJWqn2GGXgawWFyXKf+RM5/5P917cCc4H5zgfY2 HngZGBPYbvqNbwR7+VVff96Or91Y+Vl4kzU21iLnhwc96TLiQMZ/a6kUCI2RxOMDFUWT vnDOJ1DMoXX6X9srkU0BRZP5U31luCdw3K4alR5JGI3BxPxTb2sbF7VmI3MP7w1SfJnc yjat2FKF8zks5yDkrdELsNBtEC6IAdph0OblEB25hSE63/+NCdyRs7TdjZsNf+4rFDnx IlSQ== MIME-Version: 1.0 X-Received: by 10.182.121.225 with SMTP id ln1mr53112367obb.65.1426604308768; Tue, 17 Mar 2015 07:58:28 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.202.215.7 with HTTP; Tue, 17 Mar 2015 07:58:28 -0700 (PDT) In-Reply-To: References: Date: Tue, 17 Mar 2015 08:58:28 -0600 X-Google-Sender-Auth: H_lD5rWrOmdULEN8JfMMQQOJseo Message-ID: Subject: Re: savecore problem From: Alan Somers To: Michael BlackHeart Content-Type: text/plain; charset=UTF-8 Cc: Konstantin Kulikov , freebsd-stable X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Mar 2015 14:58:30 -0000 On Mon, Mar 16, 2015 at 12:06 PM, Michael BlackHeart wrote: > I've tried to run manually savecore. I tried before RAID get OPTIMAL and > after that. > > dumpmon says: > > dumpon -l > raid/r0p3 > > savecore -vvf /var/crash /dev/raid/r0p3 worked now but... It extracted > another dump from october 2014. > > On my box swap used just a little so I blieve that there might be that dump > but where's dump from march,15 2015? > > I'd like to figure out what happend with savecore and kernel dumps. Is > there a safe way to test this functional? Some test kernel panics? "sysctl debug.kdb.panic=1" will force an immediate panic. Also, how much space do you have on /dev/raid/r0p3? It's possible that the core is in your swap partition but savecore won't save it because you don't have enough space. savecore tries to calculate the space required, but it overestimates. You can check whether a core exists, without trying to save it, by "savecore -C" -Alan > > > 2015-03-16 18:33 GMT+03:00 Konstantin Kulikov : > >> Hello, >> >> have you tried to run savecore manually, like >> savecore -vvf /var/crash /dev/raid/r0p3 >> >> Also check that your dump device is working (dumpon -l) >> >> On Mon, Mar 16, 2015 at 4:40 PM, Michael BlackHeart >> wrote: >> > Hello there. I've got a problem. Recently my personal server issued a >> > kernel panic. Then there's a dump and so on. But there's no dump >> > information after reboot. I do not know what was really the panic cause >> but >> > assume that savecore failed because of RAID. >> > >> > Problem - minidump was done (I saw it was) but was not recovered by >> > savecore after reboot into /var/vrash >> > >> > Filesystem is UFS >> > >> > FreeBSD diablo.miekoff.local 10.1-STABLE FreeBSD 10.1-STABLE #0 r277169: >> > Thu Jan 15 10:22:34 MSK 2015 >> > amd_miek@diablo.miekoff.local:/usr/obj/usr/src/sys/DIABLO64 >> > amd64 >> > >> > rc.conf configuration >> > >> > dumpdev="AUTO" >> > dumpdir="/var/crash/" >> > >> > >> > >> > RAID 1 via graid configuration (JMicron based) >> > >> > graid list >> > Geom name: JMicron-6e1c79e >> > State: OPTIMAL >> > Metadata: JMicron >> > Providers: >> > 1. Name: raid/r0 >> > Mediasize: 120024203264 (112G) >> > Sectorsize: 512 >> > Mode: r6w6e16 >> > Subdisks: ada0 (ACTIVE), ada1 (ACTIVE) >> > Dirty: No >> > State: OPTIMAL >> > Strip: 1024 >> > Components: 2 >> > Transformation: RAID1 >> > RAIDLevel: RAID1 >> > Label: SYSMIRROR >> > descr: JMicron RAID1 volume >> > Consumers: >> > 1. Name: ada0 >> > Mediasize: 120034123776 (112G) >> > Sectorsize: 512 >> > Mode: r1w1e1 >> > ReadErrors: 0 >> > Subdisks: r0(SYSMIRROR):0@0 >> > State: ACTIVE (ACTIVE) >> > 2. Name: ada1 >> > Mediasize: 120034123776 (112G) >> > Sectorsize: 512 >> > Mode: r1w1e1 >> > ReadErrors: 0 >> > Subdisks: r0(SYSMIRROR):1@0 >> > State: ACTIVE (ACTIVE) >> > >> > /etc/fstab >> > >> > # Device Mountpoint FStype Options >> > Dump Pass# >> > /dev/ufs/rootfs / ufs rw,noatime >> > 1 1 >> > /dev/raid/r0p3 none swap sw >> > 0 0 >> > /dev/ufs/varfs /var ufs rw,noatime >> > 2 2 >> > /dev/ufs/tmpfs /tmp ufs rw,noatime >> > 2 2 >> > /dev/ufs/usrfs /usr ufs rw,noatime >> > 2 2 >> > /dev/ufs/configfs /config ufs rw,noatime >> > 2 2 >> > tmpfs /usr/tmpfs tmpfs rw >> > 0 0 >> > proc /proc procfs rw >> > 0 0 >> > fdesc /dev/fd fdescfs rw >> > 0 0 >> > >> > In kernel configuration DEBUG -g is disabled. >> > >> > -- >> > amd_miek >> > Think different. >> > Just superior. >> > _______________________________________________ >> > freebsd-stable@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-stable >> > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org >> " >> > > > > -- > amd_miek > Think different. > Just superior. > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 19:49:45 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id EEEE6BAD for ; Wed, 18 Mar 2015 19:49:45 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id B48F3FAD for ; Wed, 18 Mar 2015 19:49:45 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2IJnh5O090492; Wed, 18 Mar 2015 15:49:43 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <5509D6C6.4050204@sentex.net> Date: Wed, 18 Mar 2015 15:49:26 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John-Mark Gurney Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> In-Reply-To: <20150316132055.GQ32288@funkthat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 19:49:46 -0000 On 3/16/2015 9:20 AM, John-Mark Gurney wrote: > > Since you have at test framework ready, you could generate some flame > graphs[1] using dtrace to help see where things might be having an > impact... > > These are very easy to generate, and posting them would be useful... > > [1] http://www.brendangregg.com/FlameGraphs/cpuflamegraphs.html Hi, I went through the steps to generate one. What args should I use for dtrace to generate the information that is helpful / useful ? For my setup, I have server1---------apu-------------server2 server1 has an openvpn tunnel to the apu I route server2's IP address across the VPN tunnel, so if I ping from server1 to server2's IP, it goes via the tunnel on the dtrace -x ustackframes=100 -n 'profile-99 /execname == "openvpn" && arg1/ { @[ustack()] = count(); } tick-30s { exit(0); }' -o 10.stacks which generated http://tancsa.com/10.svg ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 21:09:50 2015 Return-Path: Delivered-To: stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3B1216D0 for ; Wed, 18 Mar 2015 21:09:50 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 20FECBAE for ; Wed, 18 Mar 2015 21:09:50 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t2IL9nQx052337 for ; Wed, 18 Mar 2015 21:09:49 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 198549] FreeBSD -STABLE r279935 world fail to build. Date: Wed, 18 Mar 2015 21:09:50 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: 10.1-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: sasamotikomi@gmail.com X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 21:09:50 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=198549 --- Comment #1 from sasamotikomi@gmail.com --- Problem still not fixed for me. Also strange allergy to "" in argument: /etc/make.conf CPUTYPE?=athlon-xp ok CPUTYPE?="athlon-xp" --- buildworld --- make[1]: "/usr/src/Makefile.inc1" line 169: CPUTYPE global should be set with ?=. *** [buildworld] Error code 1 make: stopped in /usr/src 1 error make: stopped in /usr/src and NO_PROFILE=true is required in make.conf or need only WITHOUT_PROFILE=true in src.conf? And my src.conf: WITHOUT_PROFILE=true WITHOUT_GAMES=true WITHOUT_HTML=true WITHOUT_HYPERV=true WITHOUT_OPENSSH=true WITHOUT_OPENSSL=true WITHOUT_KVM=true WITHOUT_MAIL=true -- You are receiving this mail because: You are on the CC list for the bug. From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 21:14:58 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ECD7C8AB for ; Wed, 18 Mar 2015 21:14:58 +0000 (UTC) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "gold.funkthat.com", Issuer "gold.funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A6428C76 for ; Wed, 18 Mar 2015 21:14:58 +0000 (UTC) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.14.5/8.14.5) with ESMTP id t2ILEv7B053833 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 18 Mar 2015 14:14:57 -0700 (PDT) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.14.5/8.14.5/Submit) id t2ILEv5L053832; Wed, 18 Mar 2015 14:14:57 -0700 (PDT) (envelope-from jmg) Date: Wed, 18 Mar 2015 14:14:57 -0700 From: John-Mark Gurney To: Mike Tancsa Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn Message-ID: <20150318211457.GL51048@funkthat.com> References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5509D6C6.4050204@sentex.net> X-Operating-System: FreeBSD 9.1-PRERELEASE amd64 X-PGP-Fingerprint: 54BA 873B 6515 3F10 9E88 9322 9CB1 8F74 6D3F A396 X-Files: The truth is out there X-URL: http://resnet.uoregon.edu/~gurney_j/ X-Resume: http://resnet.uoregon.edu/~gurney_j/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.5.21 (2010-09-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (gold.funkthat.com [127.0.0.1]); Wed, 18 Mar 2015 14:14:57 -0700 (PDT) Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 21:14:59 -0000 Mike Tancsa wrote this message on Wed, Mar 18, 2015 at 15:49 -0400: > On 3/16/2015 9:20 AM, John-Mark Gurney wrote: > > > > Since you have at test framework ready, you could generate some flame > > graphs[1] using dtrace to help see where things might be having an > > impact... > > > > These are very easy to generate, and posting them would be useful... > > > > [1] http://www.brendangregg.com/FlameGraphs/cpuflamegraphs.html > > > Hi, > I went through the steps to generate one. What args should I use for > dtrace to generate the information that is helpful / useful ? For my > setup, I have > > server1---------apu-------------server2 > > server1 has an openvpn tunnel to the apu > I route server2's IP address across the VPN tunnel, so if I ping from > server1 to server2's IP, it goes via the tunnel > > on the > > dtrace -x ustackframes=100 -n 'profile-99 /execname == "openvpn" && > arg1/ { @[ustack()] = count(); } tick-30s { exit(0); }' -o 10.stacks > > which generated > http://tancsa.com/10.svg So, I would first identify the machine w/ the cpu limited load.. I assume that is apu... Then I would look at where most of the cpu time is being spent, be it openvpn itself, or in the kernel... Most likely it is the kernel, so getting stacks from the kernel would be more useful than the one you generated... Use the command: # dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }' -o out.kern_stacks Also, another thing you can do is to compare the two using differential flame graphs: http://www.brendangregg.com/blog/2014-11-09/differential-flame-graphs.html Which will highlight where the performances differ... As I've never used OpenVPN before and their docs don't go into saying what it's using.. Is OpenVPN a kernel or userland VPN? Do they use IPSec in the kernel? or are they just using UDP or TCP for their connections? -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 21:41:46 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BF448E3 for ; Wed, 18 Mar 2015 21:41:46 +0000 (UTC) Received: from mail-in7.apple.com (mail-out7.apple.com [17.151.62.29]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 90204F6C for ; Wed, 18 Mar 2015 21:41:46 +0000 (UTC) Received: from relay7.apple.com (relay7.apple.com [17.128.113.101]) by mail-in7.apple.com (Apple Secure Mail Relay) with SMTP id 90.1D.03354.411F9055; Wed, 18 Mar 2015 14:41:40 -0700 (PDT) X-AuditID: 11973e16-f79b66d000000d1a-2a-5509f114f01e Received: from [17.149.238.142] (Unknown_Domain [17.149.238.142]) (using TLS with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by relay7.apple.com (Apple SCV relay) with SMTP id 58.25.12765.BE0F9055; Wed, 18 Mar 2015 14:40:59 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2070.6\)) Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn From: Charles Swiger In-Reply-To: <20150318211457.GL51048@funkthat.com> Date: Wed, 18 Mar 2015 14:41:40 -0700 Content-Transfer-Encoding: 7bit Message-Id: References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> To: John-Mark Gurney X-Mailer: Apple Mail (2.2070.6) X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFtrBLMWRmVeSWpSXmKPExsUi2FCYqivykTPUYG+bjMXhZiGL+11PmCw2 zZrF7sDsMePTfBaPy6c2M3scvvWfLYA5issmJTUnsyy1SN8ugStj+bmtzAVfmCt+7DzH2sDY w9zFyMkhIWAicfL6PHYIW0ziwr31bF2MXBxCAvsYJd5/Ow9XdHzmUxaIxHQmiaOzW1hAEswC WhI3/r1kArF5BQwk5p76AmYLCzhI3Nr3HGgSBwebgJrEhIk8IGFOASOJ50f3gs1kEVCV6J/f yQoxJlbiwqvJjBC2vMT2t3OYIUZaSTS3bGKH2DuZUeLB3FNgRSIC6hIv1/WAzZcAaujZlA5S IyHwl1XiW8Nn5gmMQrOQnDcLyXmzkOxYwMi8ilEoNzEzRzczz1wvsaAgJ1UvOT93EyMoqKfb ie1gfLjK6hCjAAejEg+vxFWOUCHWxLLiytxDjNIcLErivI//AoUE0hNLUrNTUwtSi+KLSnNS iw8xMnFwSjUwnrokmCiX5dG4p2tdxKNi56Qnf2RfbFR59lT0uM1rdu/1c4SjdulvE+ZctSv6 jdPLY6ZuCuu/e8yze7Zjmud8Mw4fvY95X85XLU3inr145kuz7zx+Sjfylny+ue7crsn6a7hE NFdYv/kTPa8ilHX+t+5A1mVbwlqnXPVctLN75RzzHYafF3mefqrEUpyRaKjFXFScCADj/ask SwIAAA== X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFlrNLMWRmVeSWpSXmKPExsUiOPVdn+7rD5yhBpcmqlkcbhayuN/1hMli 06xZ7A7MHjM+zWfxuHxqM7PH4Vv/2QKYo7hsUlJzMstSi/TtErgylp/bylzwhbnix85zrA2M PcxdjJwcEgImEsdnPmWBsMUkLtxbz9bFyMUhJDCdSeLo7BawBLOAlsSNfy+ZQGxeAQOJuae+ gNnCAg4St/Y9B2rg4GATUJOYMJEHJMwpYCTx/OhesPksAqoS/fM7WSHGxEpceDWZEcKWl9j+ dg4zxEgrieaWTewQeyczSjyYewqsSERAXeLluh6w+RJADT2b0icw8s9CctEsJBfNQjJ2ASPz KkaBotScxEpzvcSCgpxUveT83E2MoCBsKEzdwdi43OoQowAHoxIPr8RVjlAh1sSy4srcQ4wS HMxKIrxlJzhDhXhTEiurUovy44tKc1KLDzFKc7AoifNa/AWqFkhPLEnNTk0tSC2CyTJxcEo1 MNpU/3oQ2Ny08um0SepalXUH0m/XfZD7Kyvzd+fxtkMfu5xvpf/m1Vz1jmnf1ymn8lQ6NLex tvCcKA+aKTD/a+Uj3an8rKc+qB+QfzfDddKZWfWRWy8EXFs0pXO/n6X30zKzvUEKPfYv5iT9 s9lZPa97ptwmlkmz/Woz0iYv4nTnFlDwep14r1CJpTgj0VCLuag4EQCWUU+OPgIAAA== Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 21:41:46 -0000 On Mar 18, 2015, at 2:14 PM, John-Mark Gurney wrote: > As I've never used OpenVPN before and their docs don't go into saying > what it's using.. Is OpenVPN a kernel or userland VPN? Do they use > IPSec in the kernel? or are they just using UDP or TCP for their > connections? OpenVPN runs in userland; it uses OpenSSL to create either a layer-2 or layer-3 tunnel via either UDP or TCP. http://en.wikipedia.org/wiki/OpenVPN has more details. Regards, -- -Chuck From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 22:28:59 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E5D3AFCF for ; Wed, 18 Mar 2015 22:28:59 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id AABA067F for ; Wed, 18 Mar 2015 22:28:59 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2IMSwNu009762; Wed, 18 Mar 2015 18:28:58 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <5509FC19.2020201@sentex.net> Date: Wed, 18 Mar 2015 18:28:41 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John-Mark Gurney Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> In-Reply-To: <20150318211457.GL51048@funkthat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 22:29:00 -0000 On 3/18/2015 5:14 PM, John-Mark Gurney wrote: > > So, I would first identify the machine w/ the cpu limited load.. I > assume that is apu... Yup, the APU. The machines on either side are significantly faster > Then I would look at where most of the cpu time > is being spent, be it openvpn itself, or in the kernel... Most likely > it is the kernel, so getting stacks from the kernel would be more useful > than the one you generated... Use the command: > # dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }' -o out.kern_stacks > > Also, another thing you can do is to compare the two using differential > flame graphs: > http://www.brendangregg.com/blog/2014-11-09/differential-flame-graphs.html > > Which will highlight where the performances differ... > Will do, I will work on those. > As I've never used OpenVPN before and their docs don't go into saying > what it's using.. Is OpenVPN a kernel or userland VPN? Do they use > IPSec in the kernel? or are they just using UDP or TCP for their > connections? All in userland. I use UDP for the transport, and it uses OpenSSL in the base for the crypto. In this case, AES-128-CBC. There is no hardware assist on the APU either to offload the AES. ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 22:31:23 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 91738185 for ; Wed, 18 Mar 2015 22:31:23 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 577C8788 for ; Wed, 18 Mar 2015 22:31:23 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2IMVMXu009926; Wed, 18 Mar 2015 18:31:22 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <5509FCA9.1040502@sentex.net> Date: Wed, 18 Mar 2015 18:31:05 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John-Mark Gurney Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <5509FC19.2020201@sentex.net> In-Reply-To: <5509FC19.2020201@sentex.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 22:31:23 -0000 On 3/18/2015 6:28 PM, Mike Tancsa wrote: > Will do, I will work on those. Here is the kernel one for now http://tancsa.com/10-kern.svg ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 22:39:03 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A495F380 for ; Wed, 18 Mar 2015 22:39:03 +0000 (UTC) Received: from mail-ig0-x22d.google.com (mail-ig0-x22d.google.com [IPv6:2607:f8b0:4001:c05::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 70FE67DE for ; Wed, 18 Mar 2015 22:39:03 +0000 (UTC) Received: by igbqf9 with SMTP id qf9so7207087igb.1 for ; Wed, 18 Mar 2015 15:39:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=fbE2wwoLm2CacxtdcOozC9/OmY2L90tMQBgMq4yEbFw=; b=IdSxzltvyRBYwychnFtj3wKFO82GpFlgm9pLYqdD7Ei2TSuXFmOIP2tUeL9nP/xSjE M7IvCP0TO/fNhKvvkRv+SRT7mtlmt+s8Y+mFhL+4lgArhtJCxEgE9JvEJztqQGcoWT72 KasTT4UdG90Ie9w8pu0SXo+pZK7NI2Me1cliwPsrXV/k8bmHetnISS7ZZYSt77UJsd80 zixddJLCcoTKK3aIYR8Gye95i/oRXVACyBnbtaYTZVnYSYPkAldnFcU/NltDdmL3jbIL OqXDnQE1H6jygdb0mZtOpjBfxxEkJjgiDHeohcfcslsoH6yB26S5cnWlTWukVvw2qimv twLQ== MIME-Version: 1.0 X-Received: by 10.42.93.83 with SMTP id w19mr97911613icm.37.1426718342675; Wed, 18 Mar 2015 15:39:02 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.36.17.194 with HTTP; Wed, 18 Mar 2015 15:39:02 -0700 (PDT) In-Reply-To: <5509FCA9.1040502@sentex.net> References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <5509FC19.2020201@sentex.net> <5509FCA9.1040502@sentex.net> Date: Wed, 18 Mar 2015 15:39:02 -0700 X-Google-Sender-Auth: 2IZEKHzuSvcbMpReK-L_YYnzwt8 Message-ID: Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn From: Adrian Chadd To: Mike Tancsa Content-Type: text/plain; charset=UTF-8 Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 22:39:03 -0000 .. ipfw showed up? -a From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 22:40:39 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4695E489 for ; Wed, 18 Mar 2015 22:40:39 +0000 (UTC) Received: from mail.xtaz.uk (tao.xtaz.uk [IPv6:2001:8b0:202::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 085287FA for ; Wed, 18 Mar 2015 22:40:38 +0000 (UTC) Received: by mail.xtaz.uk (Postfix, from userid 1001) id 230B2209AF1D; Wed, 18 Mar 2015 22:40:34 +0000 (GMT) Date: Wed, 18 Mar 2015 22:40:34 +0000 From: Matt Smith To: Mike Tancsa Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn Message-ID: <20150318224034.GG1271@xtaz.uk> Mail-Followup-To: Matt Smith , Mike Tancsa , John-Mark Gurney , FreeBSD-STABLE Mailing List References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <5509FC19.2020201@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <5509FC19.2020201@sentex.net> User-Agent: Mutt/1.5.23 (2014-03-12) Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 22:40:39 -0000 On Mar 18 18:28, Mike Tancsa wrote: >On 3/18/2015 5:14 PM, John-Mark Gurney wrote: >>As I've never used OpenVPN before and their docs don't go into saying >>what it's using.. Is OpenVPN a kernel or userland VPN? Do they use >>IPSec in the kernel? or are they just using UDP or TCP for their >>connections? > >All in userland. I use UDP for the transport, and it uses OpenSSL in >the base for the crypto. In this case, AES-128-CBC. There is no >hardware assist on the APU either to offload the AES. > Isn't OpenSSL in the base on releng9 the 0.9.8 version whereas in releng10 it's the 1.0.1 version? This could make a significant difference. I've heard rumours before that the newer version is a lot slower but I've never had cause to believe it. It could be worth installing OpenSSL from the ports system on the releng9 box and reinstalling OpenVPN so that it links against it. Then they will both be on 1.0.1. Could be an interesting test? -- Matt From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 23:02:06 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C8B3B7FA for ; Wed, 18 Mar 2015 23:02:06 +0000 (UTC) Received: from alogis.com (firewall.alogis.com [212.184.102.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 585A1A94 for ; Wed, 18 Mar 2015 23:02:05 +0000 (UTC) Received: from msx3.exchange.alogis.com (msx3.exchange.alogis.com [10.1.1.26]) by alogis.com (8.13.4/8.13.1) with ESMTP id t2IMvvG0090410; Wed, 18 Mar 2015 23:57:57 +0100 (CET) (envelope-from Holger.Kipp@alogis.com) Received: from MSXCN2.exchange.alogis.com ([fe80::11b6:f5c4:b8ee:4a89]) by msx3.exchange.alogis.com ([fe80::1d83:c3db:ce3c:c06c%14]) with mapi id 14.03.0210.002; Wed, 18 Mar 2015 23:57:56 +0100 From: Holger Kipp To: Matt Smith Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn Thread-Topic: 35-40% performance drop releng9 vs releng10 openvpn Thread-Index: AQHQX4EpoI3TBx1o7ECUKHQZurQGdZ0fCEqAgAORNwCAABfkgIAAFJqAgAADUgCAABWeOA== Date: Wed, 18 Mar 2015 22:57:55 +0000 Message-ID: <1002A954-F846-4B69-8326-5448B3BAB089@alogis.com> References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <5509FC19.2020201@sentex.net>,<20150318224034.GG1271@xtaz.uk> In-Reply-To: <20150318224034.GG1271@xtaz.uk> Accept-Language: de-DE, en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 23:02:06 -0000 Dear all, > On 18.03.2015, at 23:41, "Matt Smith" wrote: > >> On Mar 18 18:28, Mike Tancsa wrote: >>> On 3/18/2015 5:14 PM, John-Mark Gurney wrote: >>> As I've never used OpenVPN before and their docs don't go into saying >>> what it's using.. Is OpenVPN a kernel or userland VPN? Do they use >>> IPSec in the kernel? or are they just using UDP or TCP for their >>> connections? >> >> All in userland. I use UDP for the transport, and it uses OpenSSL in th= e base for the crypto. In this case, AES-128-CBC. There is no hardware as= sist on the APU either to offload the AES. > > Isn't OpenSSL in the base on releng9 the 0.9.8 version whereas in releng1= 0 it's the 1.0.1 version? This could make a significant difference. I've he= ard rumours before that the newer version is a lot slower but I've never ha= d cause to believe it. Quick search brought up https://www.stunnel.org/pipermail/stunnel-users/2013-April/004176.html so I'd second using same program versions and only change OS or vice versa = (so we aren't comparing apples to minced meat ;-) Best regards, Holger __________________________________________________________ Holger Kipp Diplom-Mathematiker Senior Consultant Tel. : +49 30 436 58 114 Fax. : +49 30 436 58 214 Mobil: +49 178 36 58 114 Email: holger.kipp@alogis.com alogis AG Alt-Moabit 90b D-10559 Berlin http://www.alogis.com __________________________________________________________ alogis AG Sitz/Registergericht: Berlin/AG Charlottenburg, HRB 71484 Vorstand: Arne Friedrichs, Joern Samuelson Aufsichtsratsvorsitzender: Reinhard Mielke From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 23:45:28 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 42995645; Wed, 18 Mar 2015 23:45:28 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 07A8AF1A; Wed, 18 Mar 2015 23:45:27 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2INjMIf016586; Wed, 18 Mar 2015 19:45:22 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550A0E01.1000309@sentex.net> Date: Wed, 18 Mar 2015 19:45:05 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Adrian Chadd Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <5509FC19.2020201@sentex.net> <5509FCA9.1040502@sentex.net> In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 23:45:28 -0000 On 3/18/2015 6:39 PM, Adrian Chadd wrote: > .. ipfw showed up? > I can take it out for both. If anything, I want to test with pf ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Wed Mar 18 23:58:21 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2FCB7B7A for ; Wed, 18 Mar 2015 23:58:21 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 028E3AB for ; Wed, 18 Mar 2015 23:58:20 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2INwJdL017898; Wed, 18 Mar 2015 19:58:19 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550A110A.6070301@sentex.net> Date: Wed, 18 Mar 2015 19:58:02 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Matt Smith , John-Mark Gurney , FreeBSD-STABLE Mailing List Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <5509FC19.2020201@sentex.net> <20150318224034.GG1271@xtaz.uk> In-Reply-To: <20150318224034.GG1271@xtaz.uk> Content-Type: multipart/mixed; boundary="------------000105020404090403030804" X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2015 23:58:21 -0000 This is a multi-part message in MIME format. --------------000105020404090403030804 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 3/18/2015 6:40 PM, Matt Smith wrote: > Isn't OpenSSL in the base on releng9 the 0.9.8 version whereas in > releng10 it's the 1.0.1 version? This could make a significant > difference. I've heard rumours before that the newer version is a lot > slower but I've never had cause to believe it. > openssl speed aes-128-cbc 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes 20245.49k 21646.52k 22179.87k 55431.85k 55981.40k R10 34178.77k 35559.29k 36305.70k 36481.34k 36495.49k R9 R9 OpenSSL 0.9.8zd-freebsd 8 Jan 2015 R10 OpenSSL 1.0.1l-freebsd 15 Jan 2015 Interesting, its mixed based on size ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ --------------000105020404090403030804 Content-Type: text/plain; charset=windows-1252; name="openssl.txt" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="openssl.txt" RELENG_10 0(alix_APU1c4)# openssl speed aes-128-cbc Doing aes-128 cbc for 3s on 16 size blocks: 3884998 aes-128 cbc's in 3.07s Doing aes-128 cbc for 3s on 64 size blocks: 1064886 aes-128 cbc's in 3.15s Doing aes-128 cbc for 3s on 256 size blocks: 261951 aes-128 cbc's in 3.02s Doing aes-128 cbc for 3s on 1024 size blocks: 162398 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 8192 size blocks: 20501 aes-128 cbc's in 3.00s OpenSSL 1.0.1l-freebsd 15 Jan 2015 built on: date not available options:bn(64,64) rc4(8x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) compiler: clang The 'numbers' are in 1000s of bytes per second processed. type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes aes-128 cbc 20245.49k 21646.52k 22179.87k 55431.85k 55981.40k 0(alix_APU1c4)# RELENG9 1{alix_APU1c4}# openssl speed aes-128-cbc To get the most accurate results, try to run this program when this computer is idle. Doing aes-128 cbc for 3s on 16 size blocks: 6396101 aes-128 cbc's in 2.99s Doing aes-128 cbc for 3s on 64 size blocks: 1666730 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 256 size blocks: 425420 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 1024 size blocks: 106883 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 8192 size blocks: 13367 aes-128 cbc's in 3.00s OpenSSL 0.9.8zd-freebsd 8 Jan 2015 built on: date not available options:bn(64,64) md2(int) rc4(ptr,int) des(idx,cisc,16,int) aes(partial) blowfish(idx) compiler: cc available timing options: USE_TOD HZ=128 [sysconf value] timing function used: getrusage The 'numbers' are in 1000s of bytes per second processed. type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes aes-128 cbc 34178.77k 35559.29k 36305.70k 36481.34k 36495.49k 0{alix_APU1c4}# --------------000105020404090403030804-- From owner-freebsd-stable@FreeBSD.ORG Thu Mar 19 01:36:31 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E5DE9221 for ; Thu, 19 Mar 2015 01:36:31 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6C16FD30 for ; Thu, 19 Mar 2015 01:36:31 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2J1aTEU028351; Wed, 18 Mar 2015 21:36:29 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550A280B.5030107@sentex.net> Date: Wed, 18 Mar 2015 21:36:11 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Matt Smith , John-Mark Gurney , FreeBSD-STABLE Mailing List Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <5509FC19.2020201@sentex.net> <20150318224034.GG1271@xtaz.uk> <550A110A.6070301@sentex.net> In-Reply-To: <550A110A.6070301@sentex.net> Content-Type: multipart/mixed; boundary="------------020102090000090903010509" X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Mar 2015 01:36:32 -0000 This is a multi-part message in MIME format. --------------020102090000090903010509 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit And compiling 1.0.1l on RELENG_9 shows the same performance profile on RELENG_10. Smaller packets are slower, larger are faster 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes 20245.49k 21646.52k 22179.87k 55431.85k 55981.40k R10 34178.77k 35559.29k 36305.70k 36481.34k 36495.49k R9 20278.40k 21642.28k 22170.71k 56873.98k 57387.69k R9Port But for my application, I still get better speeds on RELENG_9, even when using the same version of openssl across RELENGs. I do the test with the 3 FreeBSD boxes server1 ---- apu ---- server2 server1 is connected to the apu with openvpn. I then usr /usr/src/tools/tools/netrate/netblast to send across the openvpn tunnel to server2 on RELENG9 I get 83-85Mb/s on RELENG10 61Mb/s Using polarSSL does not make much of a difference either way. Its perhaps 1Mb slower on both, so 82-83 vs 83-85 on R9 and 59-60Mbs vs 61-20Mb/s on RELENG10. But, on RELENG_9, if I install openssl from the ports, and compile openvpn and link against it, I get 85-87Mb/s of throughput on RELENG_9. So while there are speed differences between the versions of openssl, it doesnt seem to matter in the OpenVPN case, as its the base OS that makes the difference since both versions of OpenSSL on RELENG9 give similar performance in my openvpn test On RELENG_9, the dtrace command I use on 10 does not seem to work 0{alix_APU1c4}# dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }' -o out.kern_stacks9 dtrace: invalid probe specifier profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }: "/usr/lib/dtrace/regs_x86.d", line 2: type redeclared: struct devinfo 1{alix_APU1c4}# ---Mike On 3/18/2015 7:58 PM, Mike Tancsa wrote: > On 3/18/2015 6:40 PM, Matt Smith wrote: >> Isn't OpenSSL in the base on releng9 the 0.9.8 version whereas in >> releng10 it's the 1.0.1 version? This could make a significant >> difference. I've heard rumours before that the newer version is a lot >> slower but I've never had cause to believe it. >> > > openssl speed aes-128-cbc > > 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes > 20245.49k 21646.52k 22179.87k 55431.85k 55981.40k R10 > 34178.77k 35559.29k 36305.70k 36481.34k 36495.49k R9 > > R9 OpenSSL 0.9.8zd-freebsd 8 Jan 2015 > R10 OpenSSL 1.0.1l-freebsd 15 Jan 2015 > > Interesting, its mixed based on size > > ---Mike > > > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ --------------020102090000090903010509 Content-Type: text/plain; charset=windows-1252; name="openssl.txt" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="openssl.txt" RELENG_10 0(alix_APU1c4)# openssl speed aes-128-cbc Doing aes-128 cbc for 3s on 16 size blocks: 3884998 aes-128 cbc's in 3.07s Doing aes-128 cbc for 3s on 64 size blocks: 1064886 aes-128 cbc's in 3.15s Doing aes-128 cbc for 3s on 256 size blocks: 261951 aes-128 cbc's in 3.02s Doing aes-128 cbc for 3s on 1024 size blocks: 162398 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 8192 size blocks: 20501 aes-128 cbc's in 3.00s OpenSSL 1.0.1l-freebsd 15 Jan 2015 built on: date not available options:bn(64,64) rc4(8x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) compiler: clang The 'numbers' are in 1000s of bytes per second processed. type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes aes-128 cbc 20245.49k 21646.52k 22179.87k 55431.85k 55981.40k 0(alix_APU1c4)# RELENG9 1{alix_APU1c4}# openssl speed aes-128-cbc To get the most accurate results, try to run this program when this computer is idle. Doing aes-128 cbc for 3s on 16 size blocks: 6396101 aes-128 cbc's in 2.99s Doing aes-128 cbc for 3s on 64 size blocks: 1666730 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 256 size blocks: 425420 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 1024 size blocks: 106883 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 8192 size blocks: 13367 aes-128 cbc's in 3.00s OpenSSL 0.9.8zd-freebsd 8 Jan 2015 built on: date not available options:bn(64,64) md2(int) rc4(ptr,int) des(idx,cisc,16,int) aes(partial) blowfish(idx) compiler: cc available timing options: USE_TOD HZ=128 [sysconf value] timing function used: getrusage The 'numbers' are in 1000s of bytes per second processed. type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes aes-128 cbc 34178.77k 35559.29k 36305.70k 36481.34k 36495.49k 0{alix_APU1c4}# RELENG9 from the ports 0{alix_APU1c4}# /usr/local/bin/openssl speed aes-128-cbc WARNING: can't open config file: /usr/local/openssl/openssl.cnf Doing aes-128 cbc for 3s on 16 size blocks: 3792299 aes-128 cbc's in 2.99s Doing aes-128 cbc for 3s on 64 size blocks: 1014482 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 256 size blocks: 259813 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 1024 size blocks: 166623 aes-128 cbc's in 3.00s Doing aes-128 cbc for 3s on 8192 size blocks: 21016 aes-128 cbc's in 3.00s OpenSSL 1.0.1l 15 Jan 2015 built on: Thu Mar 19 00:11:03 2015 options:bn(64,64) md2(int) rc4(8x,int) des(idx,cisc,16,int) aes(partial) idea(int) blowfish(idx) compiler: cc -I. -I.. -I../include -fPIC -DOPENSSL_PIC -DZLIB_SHARED -DZLIB -DOPENSSL_THREADS -pthread -D_REENTRANT -DDSO_DLFCN -DHAVE_DLFCN_H -Wa,--noexecstack -DL_ENDIAN -DTERMIOS -O3 -Wall -O2 -pipe -fstack-protector -fno-strict-aliasing -DOPENSSL_IA32_SSE2 -DOPENSSL_BN_ASM_MONT -DOPENSSL_BN_ASM_MONT5 -DOPENSSL_BN_ASM_GF2m -DSHA1_ASM -DSH A256_ASM -DSHA512_ASM -DMD5_ASM -DAES_ASM -DVPAES_ASM -DBSAES_ASM -DWHIRLPOOL_ASM -DGHASH_ASM The 'numbers' are in 1000s of bytes per second processed. type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes aes-128 cbc 20278.40k 21642.28k 22170.71k 56873.98k 57387.69k 0{alix_APU1c4}# /usr/local/bin/openssl version WARNING: can't open config file: /usr/local/openssl/openssl.cnf OpenSSL 1.0.1l 15 Jan 2015 --------------020102090000090903010509-- From owner-freebsd-stable@FreeBSD.ORG Thu Mar 19 19:35:56 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 19D84AF5 for ; Thu, 19 Mar 2015 19:35:56 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D72DDC3C for ; Thu, 19 Mar 2015 19:35:55 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2JJZspb056013 for ; Thu, 19 Mar 2015 15:35:54 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550B2508.2040908@sentex.net> Date: Thu, 19 Mar 2015 15:35:36 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: FreeBSD-STABLE Mailing List Subject: dtrace on RELENG9 possible ? Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Mar 2015 19:35:56 -0000 Anyone know how to get dtrace working on RELENG9 ? When I go to load the klds, I get the error # kldload dtraceall kldload: an error occurred while loading the module. Please check dmesg(8) for more details. # dmesg | tail -5 linker_load_file: Unsupported file type KLD profile.ko: depends on cyclic - not available or version mismatch linker_load_file: Unsupported file type KLD dtraceall.ko: depends on profile - not available or version mismatch linker_load_file: Unsupported file type if I try and load profile, or cyclic, I get KLD profile.ko: depends on cyclic - not available or version mismatch linker_load_file: Unsupported file type link_elf_obj: symbol cyclic_clock_func undefined linker_load_file: Unsupported file type link_elf_obj: symbol cyclic_clock_func undefined linker_load_file: Unsupported file type Googling around this seems to be a known problem going back some time and there are various patches posted, but I am not sure what the best way to proceed is ? This is only for a test box so I can try and better understand why RELENG9 is so much faster than RELENG10 for my particular applications. This is releng9 from today after a fresh buildworld/kernel ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 00:27:18 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ADD03E93 for ; Fri, 20 Mar 2015 00:27:18 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 72F2C89 for ; Fri, 20 Mar 2015 00:27:18 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2K0RGYc096579; Thu, 19 Mar 2015 20:27:16 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550B6950.8060806@sentex.net> Date: Thu, 19 Mar 2015 20:26:56 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John-Mark Gurney Subject: Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> In-Reply-To: <20150318211457.GL51048@funkthat.com> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 00:27:18 -0000 On 3/18/2015 5:14 PM, John-Mark Gurney wrote: > # dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = count(); } tick-60s { exit(0); }' -o out.kern_stacks > > Also, another thing you can do is to compare the two using differential > flame graphs: > http://www.brendangregg.com/blog/2014-11-09/differential-flame-graphs.html > > Which will highlight where the performances differ... OK, some more data points. It seems a performance regression happened in RELENG_10 somewhere between r277684 (late January 2015) and now. Using r277684 on RELENG_10, I can get about 75Mb/s of throughput on OpenVPN. Still not as good as the 83-85Mb on RELENG_9, but much better than the 61Mb using RELENG_10 from the start of this week, For the differential graph, see http://tancsa.com/diffgraph.svg and http://tancsa.com/10-r277684.svg http://tancsa.com/10-r277684-kern.svg ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 00:31:33 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C469AEA for ; Fri, 20 Mar 2015 00:31:33 +0000 (UTC) Received: from mail-ie0-x22b.google.com (mail-ie0-x22b.google.com [IPv6:2607:f8b0:4001:c03::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8B891198 for ; Fri, 20 Mar 2015 00:31:33 +0000 (UTC) Received: by ieclw3 with SMTP id lw3so80450689iec.2 for ; Thu, 19 Mar 2015 17:31:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=lGV8CdcV/91rZOl1itWhqi4WpMuCYgPQ/x0dN8pzceM=; b=imfUVaMfsE9SM56lg/ohfCxOvsIEZ1e/mVFiYq8ou7IDQFTsaxcxcWAZPZfdhBGpG+ ZN2JIZEiruUxf0qKr9pAhx9g5Hq6SxCondIJGJgXZ5ragtS3cBgdZ+tic/eVgkh0l5yJ toq9LWw6UMDLTQGrVvH/g4KhqcnYMeVCQUxhTgXV8k6oW66EOToFFpg7jAuQ0vwDqxcO 9qqM8lBRRpxErSIZBrSttYkvc0QMYw+JCtSQdPUV4A36B7MIY/uVOhe/JDKDdfDPdskX nf600pOoyco8Tc209kQq2LyDLLQKAtPYDcQZMbiETOkp5ykTlK/sd1bAdo64hC4n1WT3 x3zg== MIME-Version: 1.0 X-Received: by 10.107.7.18 with SMTP id 18mr119477526ioh.69.1426811492481; Thu, 19 Mar 2015 17:31:32 -0700 (PDT) Received: by 10.36.23.196 with HTTP; Thu, 19 Mar 2015 17:31:32 -0700 (PDT) Date: Fri, 20 Mar 2015 11:31:32 +1100 Message-ID: Subject: rc.conf: select fib for dhclient From: Brendan Inglese To: freebsd-stable@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 00:31:33 -0000 Hi, I need some configuration settings for setting up multiple public network interfaces. Question one ( Using pf ) How would I set this up using pf on 2 public interfaces and a loopback? Question two ( Using fibs ) I want to select a particular fib for dhclient to use in rc.conf. I want it to create a whole new routing table If I do: ifconfig_if1="DHCP fib 1" It will run dhclient but not create a default route in the second table. If I pop: setfib 1 dhclient if1 Into rc.local, on reboot it does exactly what I want it to do. Thanks! Brendan. From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 01:24:13 2015 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 201D4902; Fri, 20 Mar 2015 01:24:13 +0000 (UTC) Received: from anubis.delphij.net (anubis.delphij.net [IPv6:2001:470:1:117::25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "anubis.delphij.net", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 018DA89C; Fri, 20 Mar 2015 01:24:13 +0000 (UTC) Received: from zeta.ixsystems.com (unknown [12.229.62.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id BF61E125D9; Thu, 19 Mar 2015 18:24:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphij.net; s=anubis; t=1426814652; x=1426829052; bh=/JXovibgxcm1MWi6snrMP8Sl7NcAGpdHDN6cpXvXyo4=; h=Date:From:Reply-To:To:Subject; b=qBS1Cz0rHUqbPxWOW3aq9WkuyDquFD0peMbGQehCH7nZCHmdijiUkLuyel4IbVug+ s4i2NjuboO/t1DXlyxWNhNNW82Yp5E2nNTEnuZmGCzmWsc7ljBu8/OXOUAabvXxCah yltUZcSS6t4NzMftGIdWWU0SChMCn0Kbu1/Xq3HE= Message-ID: <550B76BC.4010605@delphij.net> Date: Thu, 19 Mar 2015 18:24:12 -0700 From: Xin Li Reply-To: d@delphij.net Organization: The FreeBSD Project MIME-Version: 1.0 To: freebsd-security@FreeBSD.ORG, FreeBSD Stable Mailing List Subject: HEADSUP -- issues with SA-15:06.openssl Content-Type: multipart/mixed; boundary="------------010900000507010806080301" X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 01:24:13 -0000 This is a multi-part message in MIME format. --------------010900000507010806080301 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, Please be advised that we have noticed some issues with SA-15:06.openssl and are actively working on validating the fix. A copy of draft errata patches is attached. My apologies for this mess. Revised advisories would be announced once we have made sure that everything is correct. Cheers, -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.1.2 (FreeBSD) iQIcBAEBCgAGBQJVC3a5AAoJEJW2GBstM+ns+s4P/A+M1xdhycNvo0qsSTfLcah1 uAvZnWLo7gobBM8CxlrgtrXkRsYwGp7Q6bzW63PA+8qE4FIht7/fgMpXNHufK8bz 1b/h0KrnPs7rEBe3K13RJEI5ufVb/Xj1mOVY59GCJ76QuekN9nEGbYRE2Fbg8yhE iOWLpNWKsQBPdDhMfqmayUZmuZf8pPhgIEwzEsSefnZhe1XrN5kX8s4T00aWieSz MbEkLRfOlVn+qeXlZOp6R96vEoNYaGeTnX7AN16wKg+0Sipk9AJBDFUODjPQgzIr 4BbL8TpW3DvC0cOOpJnYb4KVy7o+54QMFoDr0Gt0R/HZQj3lzdtOBbTFfNs82KDl wWPZB3G4CY5l2d1CYQjUQtXmuRnro3JrslBbx00RcLAs9deDtIoJVqHQv0wiLSlZ jv1lWZbyUhVw/9cY4A8c1QRs01YWGGPZV4cuO0RN56zs6ipIK/0XkzYrY+b2yWku U5slMwqhuREZ1ypLcfUwQHgnyX094wTXkuJQ2l+4dMiO8wV6gW5x3C2lOe/0OHYP L0Atb84aYvMG9RlFCTF6CB2226tRjqxuFhI+x2d0choVJpMt5SJ2cfBi5E3e9Ooy roPVTlOwB1tsYVi3fjYjwJZ5TiPDq3ekcByTmIrasrsFB5+9tBDBnRC5nERNITM4 o69NYExg60dSJ8p5RTeE =wG30 -----END PGP SIGNATURE----- --------------010900000507010806080301 Content-Type: text/plain; charset=UTF-8; name="openssl-1.0.1-errata.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="openssl-1.0.1-errata.patch" SW5kZXg6IGNyeXB0by9vcGVuc3NsL2NyeXB0by9hc24xL3Rhc25fZGVjLmMKPT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PQotLS0gY3J5cHRvL29wZW5zc2wvY3J5cHRvL2FzbjEvdGFzbl9kZWMuYwkocmV2aXNp b24gMjgwMjcyKQorKysgY3J5cHRvL29wZW5zc2wvY3J5cHRvL2FzbjEvdGFzbl9kZWMuYwko d29ya2luZyBjb3B5KQpAQCAtMTI3LDIyICsxMjcsMTYgQEAgdW5zaWduZWQgbG9uZyBBU04x X3RhZzJiaXQoaW50IHRhZykKIAogQVNOMV9WQUxVRSAqQVNOMV9pdGVtX2QyaShBU04xX1ZB TFVFICoqcHZhbCwKIAkJY29uc3QgdW5zaWduZWQgY2hhciAqKmluLCBsb25nIGxlbiwgY29u c3QgQVNOMV9JVEVNICppdCkKLXsKKwl7CiAJQVNOMV9UTEMgYzsKIAlBU04xX1ZBTFVFICpw dG1wdmFsID0gTlVMTDsKKwlpZiAoIXB2YWwpCisJCXB2YWwgPSAmcHRtcHZhbDsKIAlhc24x X3RsY19jbGVhcl9uYygmYyk7Ci0JaWYgKHB2YWwgJiYgKnB2YWwgJiYgaXQtPml0eXBlID09 IEFTTjFfSVRZUEVfUFJJTUlUSVZFKQotCQlwdG1wdmFsID0gKnB2YWw7Ci0JaWYgKEFTTjFf aXRlbV9leF9kMmkoJnB0bXB2YWwsIGluLCBsZW4sIGl0LCAtMSwgMCwgMCwgJmMpID4gMCkg ewotCQlpZiAocHZhbCAmJiBpdC0+aXR5cGUgIT0gQVNOMV9JVFlQRV9QUklNSVRJVkUpIHsK LQkJCWlmICgqcHZhbCkKLQkJCQlBU04xX2l0ZW1fZnJlZSgqcHZhbCwgaXQpOwotCQkJKnB2 YWwgPSBwdG1wdmFsOwotCQl9Ci0JCXJldHVybiBwdG1wdmFsOworCWlmIChBU04xX2l0ZW1f ZXhfZDJpKHB2YWwsIGluLCBsZW4sIGl0LCAtMSwgMCwgMCwgJmMpID4gMCkgCisJCXJldHVy biAqcHZhbDsKKwlyZXR1cm4gTlVMTDsKIAl9Ci0JcmV0dXJuIE5VTEw7Ci19CiAKIGludCBB U04xX3RlbXBsYXRlX2QyaShBU04xX1ZBTFVFICoqcHZhbCwKIAkJY29uc3QgdW5zaWduZWQg Y2hhciAqKmluLCBsb25nIGxlbiwgY29uc3QgQVNOMV9URU1QTEFURSAqdHQpCkluZGV4OiBj cnlwdG8vb3BlbnNzbC9jcnlwdG8vZWMvZWNfYXNuMS5jCj09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIGNy eXB0by9vcGVuc3NsL2NyeXB0by9lYy9lY19hc24xLmMJKHJldmlzaW9uIDI4MDI3MikKKysr IGNyeXB0by9vcGVuc3NsL2NyeXB0by9lYy9lY19hc24xLmMJKHdvcmtpbmcgY29weSkKQEAg LTExNDIsOCArMTE0Miw2IEBAIEVDX0tFWSAqZDJpX0VDUHJpdmF0ZUtleShFQ19LRVkgKiph LCBjb25zdCB1bnNpZ25lCiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBFUlJf Ul9NQUxMT0NfRkFJTFVSRSk7CiAJCQlnb3RvIGVycjsKIAkJCX0KLQkJaWYgKGEpCi0JCQkq YSA9IHJldDsKIAkJfQogCWVsc2UKIAkJcmV0ID0gKmE7CkBAIC0xMjI1LDExICsxMjIzLDEz IEBAIEVDX0tFWSAqZDJpX0VDUHJpdmF0ZUtleShFQ19LRVkgKiphLCBjb25zdCB1bnNpZ25l CiAJCXJldC0+ZW5jX2ZsYWcgfD0gRUNfUEtFWV9OT19QVUJLRVk7CiAJCX0KIAorCWlmIChh KQorCQkqYSA9IHJldDsKIAlvayA9IDE7CiBlcnI6CiAJaWYgKCFvaykKIAkJewotCQlpZiAo cmV0KQorCQlpZiAocmV0ICYmIChhID09IE5VTEwgfHwgKmEgIT0gcmV0KSkKIAkJCUVDX0tF WV9mcmVlKHJldCk7CiAJCXJldCA9IE5VTEw7CiAJCX0KSW5kZXg6IGNyeXB0by9vcGVuc3Ns L2NyeXB0by94NTA5L3g1MDlfcmVxLmMKPT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gY3J5cHRvL29wZW5z c2wvY3J5cHRvL3g1MDkveDUwOV9yZXEuYwkocmV2aXNpb24gMjgwMjcyKQorKysgY3J5cHRv L29wZW5zc2wvY3J5cHRvL3g1MDkveDUwOV9yZXEuYwkod29ya2luZyBjb3B5KQpAQCAtOTIs NiArOTIsOCBAQCBYNTA5X1JFUSAqWDUwOV90b19YNTA5X1JFUShYNTA5ICp4LCBFVlBfUEtF WSAqcGtleQogCQlnb3RvIGVycjsKIAogCXBrdG1wID0gWDUwOV9nZXRfcHVia2V5KHgpOwor CWlmIChwa3RtcCA9PSBOVUxMKQorCQlnb3RvIGVycjsKIAlpPVg1MDlfUkVRX3NldF9wdWJr ZXkocmV0LHBrdG1wKTsKIAlFVlBfUEtFWV9mcmVlKHBrdG1wKTsKIAlpZiAoIWkpIGdvdG8g ZXJyOwo= --------------010900000507010806080301 Content-Type: text/plain; charset=UTF-8; name="openssl-0.9.8-errata.patch" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="openssl-0.9.8-errata.patch" SW5kZXg6IGNyeXB0by9vcGVuc3NsL2NyeXB0by9hc24xL3Rhc25fZGVjLmMKPT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PQotLS0gY3J5cHRvL29wZW5zc2wvY3J5cHRvL2FzbjEvdGFzbl9kZWMuYwkocmV2aXNp b24gMjgwMjcyKQorKysgY3J5cHRvL29wZW5zc2wvY3J5cHRvL2FzbjEvdGFzbl9kZWMuYwko d29ya2luZyBjb3B5KQpAQCAtMTI1LDIzICsxMjUsMTYgQEAgdW5zaWduZWQgbG9uZyBBU04x X3RhZzJiaXQoaW50IHRhZykKIAogQVNOMV9WQUxVRSAqQVNOMV9pdGVtX2QyaShBU04xX1ZB TFVFICoqcHZhbCwKIAkJY29uc3QgdW5zaWduZWQgY2hhciAqKmluLCBsb25nIGxlbiwgY29u c3QgQVNOMV9JVEVNICppdCkKLXsKKwl7CiAJQVNOMV9UTEMgYzsKIAlBU04xX1ZBTFVFICpw dG1wdmFsID0gTlVMTDsKKwlpZiAoIXB2YWwpCisJCXB2YWwgPSAmcHRtcHZhbDsKIAljLnZh bGlkID0gMDsKLQlpZiAocHZhbCAmJiAqcHZhbCAmJiBpdC0+aXR5cGUgPT0gQVNOMV9JVFlQ RV9QUklNSVRJVkUpCi0JCXB0bXB2YWwgPSAqcHZhbDsKLQotCWlmIChBU04xX2l0ZW1fZXhf ZDJpKCZwdG1wdmFsLCBpbiwgbGVuLCBpdCwgLTEsIDAsIDAsICZjKSA+IDApIHsKLQkJaWYg KHB2YWwgJiYgaXQtPml0eXBlICE9IEFTTjFfSVRZUEVfUFJJTUlUSVZFKSB7Ci0JCQlpZiAo KnB2YWwpCi0JCQkJQVNOMV9pdGVtX2ZyZWUoKnB2YWwsIGl0KTsKLQkJCSpwdmFsID0gcHRt cHZhbDsKLQkJfQotCQlyZXR1cm4gcHRtcHZhbDsKKwlpZiAoQVNOMV9pdGVtX2V4X2QyaShw dmFsLCBpbiwgbGVuLCBpdCwgLTEsIDAsIDAsICZjKSA+IDApIAorCQlyZXR1cm4gKnB2YWw7 CisJcmV0dXJuIE5VTEw7CiAJfQotCXJldHVybiBOVUxMOwotfQogCiBpbnQgQVNOMV90ZW1w bGF0ZV9kMmkoQVNOMV9WQUxVRSAqKnB2YWwsCiAJCWNvbnN0IHVuc2lnbmVkIGNoYXIgKipp biwgbG9uZyBsZW4sIGNvbnN0IEFTTjFfVEVNUExBVEUgKnR0KQpJbmRleDogY3J5cHRvL29w ZW5zc2wvY3J5cHRvL2VjL2VjX2FzbjEuYwo9PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09Ci0tLSBjcnlwdG8vb3Bl bnNzbC9jcnlwdG8vZWMvZWNfYXNuMS5jCShyZXZpc2lvbiAyODAyNzIpCisrKyBjcnlwdG8v b3BlbnNzbC9jcnlwdG8vZWMvZWNfYXNuMS5jCSh3b3JraW5nIGNvcHkpCkBAIC0xMTI2LDgg KzExMjYsNiBAQCBFQ19LRVkgKmQyaV9FQ1ByaXZhdGVLZXkoRUNfS0VZICoqYSwgY29uc3Qg dW5zaWduZQogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgRVJSX1JfTUFMTE9D X0ZBSUxVUkUpOwogCQkJZ290byBlcnI7CiAJCQl9Ci0JCWlmIChhKQotCQkJKmEgPSByZXQ7 CiAJCX0KIAllbHNlCiAJCXJldCA9ICphOwpAQCAtMTE5MiwxMSArMTE5MCwxMyBAQCBFQ19L RVkgKmQyaV9FQ1ByaXZhdGVLZXkoRUNfS0VZICoqYSwgY29uc3QgdW5zaWduZQogCQkJfQog CQl9CiAKKwlpZiAoYSkKKwkJKmEgPSByZXQ7CiAJb2sgPSAxOwogZXJyOgogCWlmICghb2sp CiAJCXsKLQkJaWYgKHJldCkKKwkJaWYgKHJldCAmJiAoYSA9PSBOVUxMIHx8ICphICE9IHJl dCkpCiAJCQlFQ19LRVlfZnJlZShyZXQpOwogCQlyZXQgPSBOVUxMOwogCQl9CkluZGV4OiBj cnlwdG8vb3BlbnNzbC9jcnlwdG8veDUwOS94NTA5X3JlcS5jCj09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0t IGNyeXB0by9vcGVuc3NsL2NyeXB0by94NTA5L3g1MDlfcmVxLmMJKHJldmlzaW9uIDI4MDI3 MikKKysrIGNyeXB0by9vcGVuc3NsL2NyeXB0by94NTA5L3g1MDlfcmVxLmMJKHdvcmtpbmcg Y29weSkKQEAgLTkxLDYgKzkxLDggQEAgWDUwOV9SRVEgKlg1MDlfdG9fWDUwOV9SRVEoWDUw OSAqeCwgRVZQX1BLRVkgKnBrZXkKIAkJZ290byBlcnI7CiAKIAlwa3RtcCA9IFg1MDlfZ2V0 X3B1YmtleSh4KTsKKwlpZiAocGt0bXAgPT0gTlVMTCkKKwkJZ290byBlcnI7CiAJaT1YNTA5 X1JFUV9zZXRfcHVia2V5KHJldCxwa3RtcCk7CiAJRVZQX1BLRVlfZnJlZShwa3RtcCk7CiAJ aWYgKCFpKSBnb3RvIGVycjsK --------------010900000507010806080301-- From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 02:47:19 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 78FD4F01; Fri, 20 Mar 2015 02:47:19 +0000 (UTC) Received: from jenkins-9.freebsd.org (jenkins-9.freebsd.org [8.8.178.209]) by mx1.freebsd.org (Postfix) with ESMTP id 68D4762; Fri, 20 Mar 2015 02:47:19 +0000 (UTC) Received: from jenkins-9.freebsd.org (localhost [127.0.0.1]) by jenkins-9.freebsd.org (Postfix) with ESMTP id 67310116; Fri, 20 Mar 2015 02:47:19 +0000 (UTC) Date: Fri, 20 Mar 2015 02:47:16 +0000 (GMT) From: jenkins-admin@freebsd.org To: jenkins-admin@FreeBSD.org, freebsd-stable@freebsd.org, markj@FreeBSD.org, delphij@FreeBSD.org Message-ID: <1863131790.1.1426819639245.JavaMail.jenkins@jenkins-9.freebsd.org> Subject: Jenkins build is back to normal : FreeBSD_stable_9 #709 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Jenkins-Job: FreeBSD_stable_9 X-Jenkins-Result: SUCCESS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 02:47:19 -0000 See From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 04:49:25 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C63D0AA0 for ; Fri, 20 Mar 2015 04:49:25 +0000 (UTC) Received: from mail-pa0-x22d.google.com (mail-pa0-x22d.google.com [IPv6:2607:f8b0:400e:c03::22d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 90F3ED90 for ; Fri, 20 Mar 2015 04:49:25 +0000 (UTC) Received: by pagj4 with SMTP id j4so5788216pag.2 for ; Thu, 19 Mar 2015 21:49:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=T05d2aefIUmy24ZQMpvNT7mOfnZNHxtAHCahGj2KTik=; b=d6sTRytLYKJqqUdqVq3vYOdP4WhTUDXa4oYQ5tNn5ivkFZJyfUPYkshNcsSi76UlI3 64sGg2kTEYf/ftRqa3/BvbyalNS4vQvszllJxtDUANvf9nwUI3GCe90tk6DmOg7n59rn BJp9DcazLS3mVxK8s2v+A9scwY8gW9HtHjqCdGiWZBFmCvNnbZTpEUjsE6PuGkoUHWg7 sjs16CTwtaN/uVUaRm7QzSlYVmtAy0xdDBdAJbckcajrsqK8H1q8x2S/HTQiNAgg6sIk Jc8nghhj5oHyJv0+BrB2+nKEXibNSMYWf8j66MBl91ONRQUG0fiOdFq3XY6WVQo48gKj OJtg== X-Received: by 10.70.3.162 with SMTP id d2mr70598898pdd.5.1426826965075; Thu, 19 Mar 2015 21:49:25 -0700 (PDT) Received: from raichu (216-243-33-91.users.condointernet.net. [216.243.33.91]) by mx.google.com with ESMTPSA id n10sm5698958pdp.18.2015.03.19.21.49.23 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 19 Mar 2015 21:49:23 -0700 (PDT) Sender: Mark Johnston Date: Thu, 19 Mar 2015 21:49:17 -0700 From: Mark Johnston To: Mike Tancsa Subject: Re: dtrace on RELENG9 possible ? Message-ID: <20150320044917.GA9090@raichu> References: <550B2508.2040908@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <550B2508.2040908@sentex.net> User-Agent: Mutt/1.5.23 (2014-03-12) Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 04:49:25 -0000 On Thu, Mar 19, 2015 at 03:35:36PM -0400, Mike Tancsa wrote: > Anyone know how to get dtrace working on RELENG9 ? When I go to load the > klds, I get the error > > # kldload dtraceall > kldload: an error occurred while loading the module. Please check > dmesg(8) for more details. > > # dmesg | tail -5 > linker_load_file: Unsupported file type > KLD profile.ko: depends on cyclic - not available or version mismatch > linker_load_file: Unsupported file type > KLD dtraceall.ko: depends on profile - not available or version mismatch > linker_load_file: Unsupported file type > > if I try and load profile, or cyclic, I get > > KLD profile.ko: depends on cyclic - not available or version mismatch > linker_load_file: Unsupported file type > link_elf_obj: symbol cyclic_clock_func undefined > linker_load_file: Unsupported file type > link_elf_obj: symbol cyclic_clock_func undefined > linker_load_file: Unsupported file type > > Googling around this seems to be a known problem going back some time > and there are various patches posted, but I am not sure what the best > way to proceed is ? This is only for a test box so I can try and better > understand why RELENG9 is so much faster than RELENG10 for my particular > applications. Could you point me to one of these threads? There are several that refer to cyclic_clock_func, but they have to do with build failures, which isn't what you're seeing. > This is releng9 from today after a fresh buildworld/kernel I'm not quite sure what you mean by releng9. Is it 9.0? 9.3? Does your kernel configuration file contain "options KDTRACE_HOOKS"? Thanks, -Mark From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 05:01:07 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 524CFDD2 for ; Fri, 20 Mar 2015 05:01:07 +0000 (UTC) Received: from shanghai.880288.net (shanghai.880288.net [5.255.87.147]) by mx1.freebsd.org (Postfix) with ESMTP id D2553F36 for ; Fri, 20 Mar 2015 05:01:05 +0000 (UTC) To: freebsd-stable@freebsd.org Subject: need photo clipping path and retouching? Message-ID: Date: Fri, 20 Mar 2015 05:55:18 +0100 From: "David" Reply-To: yanggepai@sina.com MIME-Version: 1.0 X-Mailer-LID: 9 X-Mailer-RecptId: 8812770 X-Mailer-SID: 228 X-Mailer-Sent-By: 1 Content-Type: text/plain; format=flowed; charset="UTF-8" Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 05:01:07 -0000 Hope this email finds you well! We are willing to introduce our photo retouching services today. We mainly specialize in below services: photoshop photos editing/retouching jewellery photos editing ecommerce products photo editing photo cutting out/clipping path beauty/skin retouching, wedding photos editing, and photo background manipulation. You may choose to send us a photo for free testing to check our quality Looking forward to receive your soonest response. Best regards, David Email: editexpert@tom.com From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 12:30:46 2015 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AB1104E3; Fri, 20 Mar 2015 12:30:46 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 71DC238D; Fri, 20 Mar 2015 12:30:46 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2KCUibN053602; Fri, 20 Mar 2015 08:30:44 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550C12DF.6010300@sentex.net> Date: Fri, 20 Mar 2015 08:30:23 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Mark Johnston Subject: Re: dtrace on RELENG9 possible ? References: <550B2508.2040908@sentex.net> <20150320044917.GA9090@raichu> In-Reply-To: <20150320044917.GA9090@raichu> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 12:30:46 -0000 On 3/20/2015 12:49 AM, Mark Johnston wrote: >> This is releng9 from today after a fresh buildworld/kernel > > I'm not quite sure what you mean by releng9. Is it 9.0? 9.3? Does your > kernel configuration file contain "options KDTRACE_HOOKS"? Hi, By RELENG9, I mean checkout svn://svn.freebsd.org/base/stable/9 I am using a stock GENERIC kernel which seems to have those options. I am building RELENG_9 on a RELENG8 machine, I wonder if this has something to do with it, but I use the same machine to build RELENG_10 images and dtrace works fine on it. options KDTRACE_FRAME # Ensure frames are compiled in options KDTRACE_HOOKS # Kernel DTrace hooks options INCLUDE_CONFIG_FILE # Include this file in kernel options KDB # Kernel debugger related code options KDB_TRACE # Print a stack trace for a panic options DDB_CTF # kernel ELF linker loads CTF data -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 17:37:10 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E756797C for ; Fri, 20 Mar 2015 17:37:10 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9368FCEE for ; Fri, 20 Mar 2015 17:37:10 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2KHb8C5004066; Fri, 20 Mar 2015 13:37:08 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550C5AAF.9060502@sentex.net> Date: Fri, 20 Mar 2015 13:36:47 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John-Mark Gurney Subject: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> In-Reply-To: <550B6950.8060806@sentex.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 17:37:11 -0000 OK, just to refocus, I had been tracking down what I thought was a regression between RELENG9 and RELENG10, but looks more like an issue that cropped up somewhere between the beginning of March and now. For RELENG9, I was actually using a kernel from sources back on Jan 29th by accident. If I bring RELENG9 upto today, I get a similar performance loss. Again, I am testing a simple VPN router setup server1 --- apu --- server2 where server1 connections to the apu via an OpenVPN tunnel and server1 sends packets via netblast across the tunnel to server2. I get the following throughput using netblast through the tunnel on 10 Using # netblast 1.1.2.2 500 1200 15 (server1 to server2) on 10.x Kernel Mb/s rev r277684 76.7563 r279978 59.3233 All good at r278533, r278534, r279467 But at r279978 its quite a bit slower. So somewhere between r279467 and r279978. I will keep trying to narrow it down... ---Mike On 3/19/2015 8:26 PM, Mike Tancsa wrote: > On 3/18/2015 5:14 PM, John-Mark Gurney wrote: >> # dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = >> count(); } tick-60s { exit(0); }' -o out.kern_stacks >> >> Also, another thing you can do is to compare the two using differential >> flame graphs: >> http://www.brendangregg.com/blog/2014-11-09/differential-flame-graphs.html >> >> >> Which will highlight where the performances differ... > > OK, some more data points. It seems a performance regression happened > in RELENG_10 somewhere between r277684 (late January 2015) and now. > Using r277684 on RELENG_10, I can get about 75Mb/s of throughput on > OpenVPN. Still not as good as the 83-85Mb on RELENG_9, but much better > than the 61Mb using RELENG_10 from the start of this week, > > For the differential graph, see > > http://tancsa.com/diffgraph.svg > > and > > http://tancsa.com/10-r277684.svg > http://tancsa.com/10-r277684-kern.svg > > ---Mike > > > > -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 18:23:16 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6F2B3107 for ; Fri, 20 Mar 2015 18:23:16 +0000 (UTC) Received: from mail.mahoroba.org (ent.mahoroba.org [IPv6:2001:2f0:104:8010::1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "asuka.mahoroba.org", Issuer "ca.mahoroba.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 738FE2EF for ; Fri, 20 Mar 2015 18:23:15 +0000 (UTC) Received: from yuga.mahoroba.org (ume@yuga.mahoroba.org [IPv6:2001:2f0:104:8010:7258:12ff:fe22:d94b]) (user=ume mech=DIGEST-MD5 bits=0) by mail.mahoroba.org (8.14.9/8.14.9) with ESMTP/inet6 id t2KIN6qG011219 (version=TLSv1/SSLv3 cipher=AES128-GCM-SHA256 bits=128 verify=NO); Sat, 21 Mar 2015 03:23:07 +0900 (JST) (envelope-from ume@mahoroba.org) Date: Sat, 21 Mar 2015 03:23:02 +0900 Message-ID: From: Hajimu UMEMOTO To: Brendan Inglese Subject: Re: rc.conf: select fib for dhclient In-Reply-To: References: User-Agent: xcite1.60> Wanderlust/2.15.9 (Almost Unreal) Emacs/24.4 Mule/6.0 (HANACHIRUSATO) X-Operating-System: FreeBSD 10.1-STABLE X-PGP-Key: http://www.mahoroba.org/~ume/publickey.asc X-PGP-Fingerprint: 1F00 0B9E 2164 70FC 6DC5 BF5F 04E9 F086 BF90 71FE MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka") Content-Type: text/plain; charset=US-ASCII X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.4.3 (mail.mahoroba.org [IPv6:2001:2f0:104:8010::1]); Sat, 21 Mar 2015 03:23:07 +0900 (JST) X-Virus-Scanned: clamav-milter 0.98.6 at asuka.mahoroba.org X-Virus-Status: Clean X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,T_RP_MATCHES_RCVD autolearn=ham autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on asuka.mahoroba.org Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 18:23:16 -0000 Hi, >>>>> On Fri, 20 Mar 2015 11:31:32 +1100 >>>>> Brendan Inglese said: brendan> I want to select a particular fib for dhclient to use in rc.conf. I want it brendan> to create a whole new routing table brendan> If I do: brendan> ifconfig_if1="DHCP fib 1" brendan> It will run dhclient but not create a default route in the second table. brendan> If I pop: brendan> setfib 1 dhclient if1 brendan> Into rc.local, on reboot it does exactly what I want it to do. Perhaps, following works for you: ifconfig_if1="DHCP" dhclient_fib="1" Sincerely, -- Hajimu UMEMOTO ume@mahoroba.org ume@{,jp.}FreeBSD.org http://www.mahoroba.org/~ume/ From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 20:30:31 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3A149D23; Fri, 20 Mar 2015 20:30:31 +0000 (UTC) Received: from mail-ie0-x22b.google.com (mail-ie0-x22b.google.com [IPv6:2607:f8b0:4001:c03::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id F36D5828; Fri, 20 Mar 2015 20:30:30 +0000 (UTC) Received: by iedfl3 with SMTP id fl3so13273044ied.1; Fri, 20 Mar 2015 13:30:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=s3xOfRFrkvWzwPHCtEtVOJ2mb+YFVJUU1qC34faQ0xg=; b=oKCkNv40MhGDcNPweTytdVypKBQnFt7hRptD8UcdWILPUGJPX9DPEhEUeV895egkC6 qHDOSlYWMOEBkrmLcJkSQG0Ty4c9vsCcg8lOrqU3tEVnrFedUqKh6fkY11hKHOzTW4mp 74rd6wxfEWd8AUJpwS4t20kuw375Itr/lYcRrHuLKP2ZRxmpBbZy/zv8MPol5eteZwax 3B/u9up/bKRdta2CgKDkuowPJGVSOmfyTcRGyGhtYmlaxKZZGoLHuY8tBllCIt42QarG C3eYC6ZX8kEuFfbIcQWmCmKycVPPQYbZTQxKKMqAojmPEzMlDjwe4QDLYdpOoX9OSggT QUAQ== MIME-Version: 1.0 X-Received: by 10.50.126.6 with SMTP id mu6mr28833225igb.4.1426883430400; Fri, 20 Mar 2015 13:30:30 -0700 (PDT) Received: by 10.36.23.196 with HTTP; Fri, 20 Mar 2015 13:30:30 -0700 (PDT) In-Reply-To: References: Date: Sat, 21 Mar 2015 07:30:30 +1100 Message-ID: Subject: Re: rc.conf: select fib for dhclient From: Brendan Inglese To: Hajimu UMEMOTO Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 20:30:31 -0000 Hi, I've tried that actually and it seemed to run dhclient on fib 1 for all interfaces. I gave up on the fib option I've recently just found a solution using pf. Cheers, Brendan. On Sat, Mar 21, 2015 at 5:23 AM, Hajimu UMEMOTO wrote: > Hi, > > >>>>> On Fri, 20 Mar 2015 11:31:32 +1100 > >>>>> Brendan Inglese said: > > brendan> I want to select a particular fib for dhclient to use in rc.conf. > I want it > brendan> to create a whole new routing table > > brendan> If I do: > > brendan> ifconfig_if1="DHCP fib 1" > > brendan> It will run dhclient but not create a default route in the second > table. > > brendan> If I pop: > > brendan> setfib 1 dhclient if1 > > brendan> Into rc.local, on reboot it does exactly what I want it to do. > > Perhaps, following works for you: > > ifconfig_if1="DHCP" > dhclient_fib="1" > > Sincerely, > > -- > Hajimu UMEMOTO > ume@mahoroba.org ume@{,jp.}FreeBSD.org > http://www.mahoroba.org/~ume/ > From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 20:34:23 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0D4EEE58; Fri, 20 Mar 2015 20:34:23 +0000 (UTC) Received: from mail-oi0-x229.google.com (mail-oi0-x229.google.com [IPv6:2607:f8b0:4003:c06::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C1DC4854; Fri, 20 Mar 2015 20:34:22 +0000 (UTC) Received: by oigv203 with SMTP id v203so100770326oig.3; Fri, 20 Mar 2015 13:34:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=om3HNUifwZ87jMlinfRGG/zctUZsmdok6/NfgIuQo+E=; b=o1lYKUdbkv3a8mOnRdZup1kaEFf1413ORZBMHw9yY2bLzN21czl1MU0XwDsnBmedMa Xc6yMmcxjlLs7yLX8Dgvi7quGXnbKuOH5KZqdmjc4TtQRecp2AORsIrK7lVAqp/AhFWV J9HWxVqqj9uzHytVgZ/EiRtqPAJ5yKSI/2i82Ay7VXzNmXH63JKDLAWH8JZ7xhRgpdJQ rvTiXJzOfpWc8M43NOF9ZEst6VHV/DeHQP3bBKEomR10fWeEdku1PC5WR+rW+JxWGO4C gct2mR8eiGJuFbSVAdD1pvj4Mb/kaDH/MOktQTG3aHOdx4lDRdekC2rxhaThkW2hcIjE CBtg== MIME-Version: 1.0 X-Received: by 10.202.215.131 with SMTP id o125mr10056636oig.109.1426883662142; Fri, 20 Mar 2015 13:34:22 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.202.215.7 with HTTP; Fri, 20 Mar 2015 13:34:22 -0700 (PDT) In-Reply-To: References: Date: Fri, 20 Mar 2015 14:34:22 -0600 X-Google-Sender-Auth: BozMv2ThOS0VgeEpVv6T2rnf4kc Message-ID: Subject: Re: rc.conf: select fib for dhclient From: Alan Somers To: Brendan Inglese Content-Type: text/plain; charset=UTF-8 Cc: FreeBSD , Hajimu UMEMOTO X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 20:34:23 -0000 I do this: ifconfig_em0="SYNCDHCP fib 0" ifconfig_ix0="SYNCDHCP fib 1" -Alan On Fri, Mar 20, 2015 at 2:30 PM, Brendan Inglese wrote: > Hi, > > I've tried that actually and it seemed to run dhclient on fib 1 for all > interfaces. > > I gave up on the fib option I've recently just found a solution using pf. > > Cheers, > Brendan. > > On Sat, Mar 21, 2015 at 5:23 AM, Hajimu UMEMOTO wrote: > >> Hi, >> >> >>>>> On Fri, 20 Mar 2015 11:31:32 +1100 >> >>>>> Brendan Inglese said: >> >> brendan> I want to select a particular fib for dhclient to use in rc.conf. >> I want it >> brendan> to create a whole new routing table >> >> brendan> If I do: >> >> brendan> ifconfig_if1="DHCP fib 1" >> >> brendan> It will run dhclient but not create a default route in the second >> table. >> >> brendan> If I pop: >> >> brendan> setfib 1 dhclient if1 >> >> brendan> Into rc.local, on reboot it does exactly what I want it to do. >> >> Perhaps, following works for you: >> >> ifconfig_if1="DHCP" >> dhclient_fib="1" >> >> Sincerely, >> >> -- >> Hajimu UMEMOTO >> ume@mahoroba.org ume@{,jp.}FreeBSD.org >> http://www.mahoroba.org/~ume/ >> > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 21:03:02 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8AA40AE9; Fri, 20 Mar 2015 21:03:02 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 3E31DBD3; Fri, 20 Mar 2015 21:03:02 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2KL2xVa033434; Fri, 20 Mar 2015 17:03:00 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550C8AEE.4090408@sentex.net> Date: Fri, 20 Mar 2015 17:02:38 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John-Mark Gurney Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> In-Reply-To: <550C5AAF.9060502@sentex.net> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List , John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 21:03:02 -0000 OK, I think I found where the RELENG_10 performance loss happened. It seems https://lists.freebsd.org/pipermail/svn-src-stable-10/2015-March/004778.html is the issue. Testing with a kernel from r279796 I get 76-77Mb of throughput. With r279848 it drops to about 60Mb ---Mike On 3/20/2015 1:36 PM, Mike Tancsa wrote: > OK, just to refocus, > > I had been tracking down what I thought was a regression between RELENG9 > and RELENG10, but looks more like an issue that cropped up somewhere > between the beginning of March and now. For RELENG9, I was actually > using a kernel from sources back on Jan 29th by accident. If I bring > RELENG9 upto today, I get a similar performance loss. > > Again, I am testing a simple VPN router setup > > server1 --- apu --- server2 > > where server1 connections to the apu via an OpenVPN tunnel and server1 > sends packets via netblast across the tunnel to server2. > > I get the following throughput using netblast through the tunnel on 10 > > Using > # netblast 1.1.2.2 500 1200 15 (server1 to server2) on 10.x > > Kernel Mb/s > rev > r277684 76.7563 > r279978 59.3233 > > All good at r278533, r278534, r279467 > > But at r279978 its quite a bit slower. So somewhere between r279467 and > r279978. I will keep trying to narrow it down... > > > ---Mike > > > > > > On 3/19/2015 8:26 PM, Mike Tancsa wrote: >> On 3/18/2015 5:14 PM, John-Mark Gurney wrote: >>> # dtrace -x stackframes=100 -n 'profile-997 /arg0/ { @[stack()] = >>> count(); } tick-60s { exit(0); }' -o out.kern_stacks >>> >>> Also, another thing you can do is to compare the two using differential >>> flame graphs: >>> http://www.brendangregg.com/blog/2014-11-09/differential-flame-graphs.html >>> >>> >>> >>> Which will highlight where the performances differ... >> >> OK, some more data points. It seems a performance regression happened >> in RELENG_10 somewhere between r277684 (late January 2015) and now. >> Using r277684 on RELENG_10, I can get about 75Mb/s of throughput on >> OpenVPN. Still not as good as the 83-85Mb on RELENG_9, but much better >> than the 61Mb using RELENG_10 from the start of this week, >> >> For the differential graph, see >> >> http://tancsa.com/diffgraph.svg >> >> and >> >> http://tancsa.com/10-r277684.svg >> http://tancsa.com/10-r277684-kern.svg >> >> ---Mike >> >> >> >> > > -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 23:12:44 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 94EEB7CD; Fri, 20 Mar 2015 23:12:44 +0000 (UTC) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4AA45B8E; Fri, 20 Mar 2015 23:12:42 +0000 (UTC) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 361172842F; Sat, 21 Mar 2015 00:06:26 +0100 (CET) Received: from illbsd.quip.test (ip-89-177-50-74.net.upcbroadband.cz [89.177.50.74]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 0DE1A2842B; Sat, 21 Mar 2015 00:06:24 +0100 (CET) Message-ID: <550CA812.8070509@quip.cz> Date: Sat, 21 Mar 2015 00:06:58 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:35.0) Gecko/20100101 Firefox/35.0 SeaMonkey/2.32 MIME-Version: 1.0 To: Mike Tancsa , John-Mark Gurney Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> In-Reply-To: <550C8AEE.4090408@sentex.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD-STABLE Mailing List , John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 23:12:44 -0000 Mike Tancsa wrote on 03/20/2015 22:02: > OK, I think I found where the RELENG_10 performance loss happened. It seems > https://lists.freebsd.org/pipermail/svn-src-stable-10/2015-March/004778.html > > is the issue. > > Testing with a kernel from r279796 I get 76-77Mb of throughput. With > r279848 it drops to about 60Mb I am surprised by this huge performance drop. If it is really caused by this change (VFS timestamp precision from seconds to microseconds), wasn't this change tested before commit? Miroslav Lachman From owner-freebsd-stable@FreeBSD.ORG Fri Mar 20 23:53:43 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7263B1BF; Fri, 20 Mar 2015 23:53:43 +0000 (UTC) Received: from anubis.delphij.net (anubis.delphij.net [IPv6:2001:470:1:117::25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "anubis.delphij.net", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 536D0F34; Fri, 20 Mar 2015 23:53:43 +0000 (UTC) Received: from zeta.ixsystems.com (unknown [12.229.62.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id 6D978EAB1; Fri, 20 Mar 2015 16:53:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphij.net; s=anubis; t=1426895622; x=1426910022; bh=vINHaNFrwDsaH2rl0ITQNEygkJ2+UgliKVH/7pTfhTw=; h=Date:From:Reply-To:To:CC:Subject:References:In-Reply-To; b=ehE7Ff2+PSHRXnDBjrhd6NrR3NdXthKqvwf1Kl07zWXhd6wy7t4hvDrfDZF3XdYzd nZPrXmoza4ifhg2Qc49+nCLgWsPG2Ae2QSNbYOfL2UZmG/3seFyxufCa44fxJbFE+h deoiHJdaspR4zKHZh3zfXDZ7LY8e4tdxh4YPgTes= Message-ID: <550CB306.7030405@delphij.net> Date: Fri, 20 Mar 2015 16:53:42 -0700 From: Xin Li Reply-To: d@delphij.net Organization: The FreeBSD Project MIME-Version: 1.0 To: Mike Tancsa , John-Mark Gurney Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> In-Reply-To: <550C8AEE.4090408@sentex.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit Cc: FreeBSD-STABLE Mailing List , John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Mar 2015 23:53:43 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 On 03/20/15 14:02, Mike Tancsa wrote: > OK, I think I found where the RELENG_10 performance loss happened. > It seems > https://lists.freebsd.org/pipermail/svn-src-stable-10/2015-March/004778.html > > is the issue. > > Testing with a kernel from r279796 I get 76-77Mb of throughput. > With r279848 it drops to about 60Mb Hrm, looking at 'diffgraph.svg', it suggest that writing through devfs have incurred a tax on writev(2), which is basically this codepath, if my reading is correct, in sys/fs/devfs/devfs.c: 1676 static int 1677 devfs_write_f(struct file *fp, struct uio *uio, struct ucred *cred, 1678 int flags, struct thread *td) 1679 { ... 1703 if (uio->uio_resid != resid || (error == 0 && resid != 0)) { 1704 vfs_timestamp(&dev->si_ctime); 1705 dev->si_mtime = dev->si_ctime; 1706 } Further looking at the code, in devfs vfs_timestamp() is also called when reading from a device node. When the setting was 0, the code would return time_second directly instead of attempting to read the timestamp. For the purpose of devfs, does it make sense to bump timestamps like normal filesystems for each read/write operation? Looks like Mac OS X will bump timestamps for each operation but Debian don't. Cheers, > ---Mike > > > > On 3/20/2015 1:36 PM, Mike Tancsa wrote: >> OK, just to refocus, >> >> I had been tracking down what I thought was a regression between >> RELENG9 and RELENG10, but looks more like an issue that cropped >> up somewhere between the beginning of March and now. For >> RELENG9, I was actually using a kernel from sources back on Jan >> 29th by accident. If I bring RELENG9 upto today, I get a similar >> performance loss. >> >> Again, I am testing a simple VPN router setup >> >> server1 --- apu --- server2 >> >> where server1 connections to the apu via an OpenVPN tunnel and >> server1 sends packets via netblast across the tunnel to server2. >> >> I get the following throughput using netblast through the tunnel >> on 10 >> >> Using # netblast 1.1.2.2 500 1200 15 (server1 to server2) on >> 10.x >> >> Kernel Mb/s rev r277684 76.7563 r279978 59.3233 >> >> All good at r278533, r278534, r279467 >> >> But at r279978 its quite a bit slower. So somewhere between >> r279467 and r279978. I will keep trying to narrow it down... >> >> >> ---Mike >> >> >> >> >> >> On 3/19/2015 8:26 PM, Mike Tancsa wrote: >>> On 3/18/2015 5:14 PM, John-Mark Gurney wrote: >>>> # dtrace -x stackframes=100 -n 'profile-997 /arg0/ { >>>> @[stack()] = count(); } tick-60s { exit(0); }' -o >>>> out.kern_stacks >>>> >>>> Also, another thing you can do is to compare the two using >>>> differential flame graphs: >>>> http://www.brendangregg.com/blog/2014-11-09/differential-flame-graphs.html >>>> >>>> >>>> >>>> >>>> >>>> Which will highlight where the performances differ... >>> >>> OK, some more data points. It seems a performance regression >>> happened in RELENG_10 somewhere between r277684 (late January >>> 2015) and now. Using r277684 on RELENG_10, I can get about >>> 75Mb/s of throughput on OpenVPN. Still not as good as the >>> 83-85Mb on RELENG_9, but much better than the 61Mb using >>> RELENG_10 from the start of this week, >>> >>> For the differential graph, see >>> >>> http://tancsa.com/diffgraph.svg >>> >>> and >>> >>> http://tancsa.com/10-r277684.svg >>> http://tancsa.com/10-r277684-kern.svg >>> >>> ---Mike >>> >>> >>> >>> >> >> > > - -- Xin LI https://www.delphij.net/ FreeBSD - The Power to Serve! Live free or die -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.1.2 (FreeBSD) iQIcBAEBCgAGBQJVDLMDAAoJEJW2GBstM+nsmjgQAKGNdw70A2lfrVn8ngLympDM HeJKVCRtjaZselJpVnkyy8igBU6TX0Ae66R4IPNBpi9aLcGb/xscDgYKNh2dZc4H LjfyiXW62JwggXt+PCUjrLF3sbrlCI8ySTNLnILTs/CRFwdJXALFHWXDEtuMg+AT Mto3HxKlRZlEbWHaKbWmR4uysks6KNYJXSCnw/VtSFvlVUSwpyNz+soygrajZPKC PPOpjDqx2rvVxQwFaHF+ysTzKhvQSuJg+C5M9iKu4wgHd5QNuJ8IliAocVvPig9u gushcc2MxGPyzG24Telc3Vc5T+pbCexiP3hRtFY0/okADG4O47tuoJOY09gp28Tq 5X3eXCXkBGfCtriv6aPf//jAQ6duDrGTDmYcI+FGIDp3/FG71adNTqZ6fcqFAL/+ JHO39qpytOruVVjFyjEvQBslYEKWUZJBGZ82q6kuE+811TZxdMGVLh3PICxiJw0l SJcTR52UEYNp1kX+KhFXpz6cvV0Za5bJh/qHnC/1uzHvLYE7MDTinwDPb7LyK01G fg+Kls6YCAv6rh4mDzWJCg8aTaWmbtfn2+ETwx74if6Z8LjTB1VdmZ4y336YRY2f mFhV6eYAvvziIIMUvTQjAwyIcCtc65dvseOpgDdnWPFq/N+K4Jfg9Ast6mSHBYF2 FjvUzNg8OYvyfq5/TdPB =djPp -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 00:16:14 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D50D7820; Sat, 21 Mar 2015 00:16:14 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4175E1B7; Sat, 21 Mar 2015 00:16:14 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.9/8.14.9) with ESMTP id t2L0Fx0Q086042 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 21 Mar 2015 02:15:59 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.9.2 kib.kiev.ua t2L0Fx0Q086042 Received: (from kostik@localhost) by tom.home (8.14.9/8.14.9/Submit) id t2L0Fxsa086040; Sat, 21 Mar 2015 02:15:59 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 21 Mar 2015 02:15:59 +0200 From: Konstantin Belousov To: d@delphij.net Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn Message-ID: <20150321001559.GB2379@kib.kiev.ua> References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <550CB306.7030405@delphij.net> User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List , John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 00:16:14 -0000 On Fri, Mar 20, 2015 at 04:53:42PM -0700, Xin Li wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA512 > > On 03/20/15 14:02, Mike Tancsa wrote: > > OK, I think I found where the RELENG_10 performance loss happened. > > It seems > > https://lists.freebsd.org/pipermail/svn-src-stable-10/2015-March/004778.html > > > > is the issue. > > > > Testing with a kernel from r279796 I get 76-77Mb of throughput. > > With r279848 it drops to about 60Mb > > Hrm, looking at 'diffgraph.svg', it suggest that writing through devfs > have incurred a tax on writev(2), which is basically this codepath, if > my reading is correct, in sys/fs/devfs/devfs.c: > > 1676 static int > 1677 devfs_write_f(struct file *fp, struct uio *uio, struct ucred > *cred, > 1678 int flags, struct thread *td) > 1679 { > ... > 1703 if (uio->uio_resid != resid || (error == 0 && resid != > 0)) { > 1704 vfs_timestamp(&dev->si_ctime); > 1705 dev->si_mtime = dev->si_ctime; > 1706 } > > Further looking at the code, in devfs vfs_timestamp() is also called > when reading from a device node. When the setting was 0, the code > would return time_second directly instead of attempting to read the > timestamp. > > For the purpose of devfs, does it make sense to bump timestamps like > normal filesystems for each read/write operation? Looks like Mac OS X > will bump timestamps for each operation but Debian don't. First question is, what timecounter hardware is used. I would accept some slowdown from hardware like HPET, but it is indeed surprising if caused by TSC. From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 00:28:16 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6B289B2D; Sat, 21 Mar 2015 00:28:16 +0000 (UTC) Received: from anubis.delphij.net (anubis.delphij.net [IPv6:2001:470:1:117::25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "anubis.delphij.net", Issuer "StartCom Class 1 Primary Intermediate Server CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4A64D2DD; Sat, 21 Mar 2015 00:28:16 +0000 (UTC) Received: from zeta.ixsystems.com (unknown [12.229.62.2]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by anubis.delphij.net (Postfix) with ESMTPSA id E147FEC22; Fri, 20 Mar 2015 17:28:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=delphij.net; s=anubis; t=1426897695; x=1426912095; bh=o6TeM+geLGy/epHhr732ZlOcdO8yHX+TsbCIp2aTAwk=; h=Date:From:Reply-To:To:CC:Subject:References:In-Reply-To; b=H+f13EP4Vq1+/8ZUXQRcJP4C+woZ5Mg3Y0Nk76owzt0djjYsXh80mSwcl0x4f1DRC hql2D1KKJLUdERVUj401Gxk4ndW2FBKTk4ucFZYLTouK//K12HdamGNBv/TkcysyGb D43waDH/IBt3pjCPTxn2sOHFytY18tjxrU0Q0WPY= Message-ID: <550CBB1F.8010601@delphij.net> Date: Fri, 20 Mar 2015 17:28:15 -0700 From: Xin Li Reply-To: d@delphij.net Organization: The FreeBSD Project MIME-Version: 1.0 To: Konstantin Belousov , d@delphij.net Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> In-Reply-To: <20150321001559.GB2379@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List , John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 00:28:16 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 On 03/20/15 17:15, Konstantin Belousov wrote: >> For the purpose of devfs, does it make sense to bump timestamps >> like normal filesystems for each read/write operation? Looks >> like Mac OS X will bump timestamps for each operation but Debian >> don't. > > First question is, what timecounter hardware is used. I would > accept some slowdown from hardware like HPET, but it is indeed > surprising if caused by TSC. It was HPET (see earlier discussion where a FlameGraph is posted). I've done a survey on a few other operating systems, including OpenIndiana, Debian and OS X. Neither OpenIndiana nor Debian update timestamp for read/write events so I'd propose this change to make it a runtime configurable behavior and disable by default: https://reviews.freebsd.org/D2104 Cheers, - -- Xin LI https://www.delphij.net/ FreeBSD - The Power to Serve! Live free or die -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.1.2 (FreeBSD) iQIcBAEBCgAGBQJVDLscAAoJEJW2GBstM+nsGtMQAKyh3kW6VWPnCd353KELqeoE 3n295iHqVjAF6vszt71cfiAqlz0oSH+5i2SfR1LKVXH4cb2gMbXYbMeJVQiV7L93 8xEsBNtPF4Z/fxwyEBfFb3WcXHo+TGjvaCEbsuJIFKhqa4GPY230/7JELN/LXuNd HJlP7YECNPgeVWyYuCdZkLu/BMOPjL44/wcC/YuXSQP65TK54kx59KLg671o9Z2R ffpljAmJSqpNjas41qyVN+SNxr9ga8oQA0LTf8lbn3r4o2mx+te8yzNcyIn/gCU8 jawDGfGNiEvCTr76ST6rvELy4jFbmZyNFrbu+TA6VDT2/CCh1x5qhDceXTnZKPtX iJFpDKsl87R5aXdRQjwCZKkTdaJ7AuRAG0lrmumxIlblgDmaDsVbmaqR1CU0JzWI rvGblL6iwm/4pL+O9Igkr6oN6+yd1/9KM2yCB5BZDokLnoj6INWOft4z6jGyOUWh T3oNVfB48g/j5NKRyU/vFvJIUix2mbE5ziem+RyLU6x/UOdYQJsKRIlN6xPiIx73 /G7kpT1JbsoS47fyere5jeUV2UOurRuH5UfBHjJCJ0X44tzrsMhTm3Vs2cOzJP7K 6SNbyxyCbX3uJN1Aq9nhg2scIVieV1/BRLoeI6LEVVZKTTig4LA8ekzb0P6e1Fwg f9rvXNwpdeZPmsDwdpff =Uxnt -----END PGP SIGNATURE----- From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 00:35:19 2015 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 96016D3C for ; Sat, 21 Mar 2015 00:35:19 +0000 (UTC) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5205E3EA for ; Sat, 21 Mar 2015 00:35:18 +0000 (UTC) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 5996D2842B for ; Sat, 21 Mar 2015 01:35:15 +0100 (CET) Received: from illbsd.quip.test (ip-89-177-50-74.net.upcbroadband.cz [89.177.50.74]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id B5A6D28422 for ; Sat, 21 Mar 2015 01:35:13 +0100 (CET) Message-ID: <550CBCE3.6040908@quip.cz> Date: Sat, 21 Mar 2015 01:35:47 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:35.0) Gecko/20100101 Firefox/35.0 SeaMonkey/2.32 MIME-Version: 1.0 To: freebsd-stable Stable Subject: rctl logs swapuse even if swap is empty Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 00:35:19 -0000 I tried RCTL for the first time, so maybe it is error on my side. I have system with 2 jail with the following rctl.conf jail:fox:swapuse:log=32M jail:fox:swapuse:deny=512M jail:fox:memoryuse:log=3G jail:fox:memoryuse:deny=4096M jail:olymp:swapuse:log=32M jail:olymp:swapuse:deny=512M jail:olymp:memoryuse:log=2G jail:olymp:memoryuse:deny=3072M Both jails are small webservers with PHP + Apache. They do not use much memory and they really do not user any swap space. (according to top and swapinfo) # swapinfo -h Device 1K-blocks Used Avail Capacity /dev/mirror/gm0s1b 16777216 0B 16G 0% # rctl -hu jail:fox | grep swap swapuse=0 Processes in both jails are logged as using more than 32MB of swap: Mar 21 01:18:55 neon kernel: rctl: rule "jail:fox:swapuse:log=33554432" matched by pid 20783 (httpd), uid 80, jail fox Mar 21 01:18:55 neon kernel: rctl: rule "jail:fox:swapuse:log=33554432" matched by pid 20787 (httpd), uid 80, jail fox Mar 21 01:18:58 neon kernel: rctl: rule "jail:fox:swapuse:log=33554432" matched by pid 19207 (httpd), uid 80, jail fox Mar 21 01:18:58 neon kernel: rctl: rule "jail:fox:swapuse:log=33554432" matched by pid 20790 (sh), uid 0, jail fox Mar 21 01:18:58 neon kernel: rctl: rule "jail:fox:swapuse:log=33554432" matched by pid 20792 (sh), uid 0, jail fox Mar 21 01:18:58 neon kernel: rctl: rule "jail:olymp:swapuse:log=33554432" matched by pid 20793 (sh), uid 0, jail olymp Mar 21 01:18:58 neon kernel: rctl: rule "jail:olymp:swapuse:log=33554432" matched by pid 20795 (sh), uid 0, jail olymp Is it expected? I do not think so. Or am I doing something wrong with rctl? # uname -srmi FreeBSD 10.1-RELEASE-p8 amd64 GEN_RCTL Kernel is GENERIC + RCTL options Miroslav Lachman From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 00:47:26 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A4269F58; Sat, 21 Mar 2015 00:47:26 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 632556D6; Sat, 21 Mar 2015 00:47:26 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2L0lIEw053988; Fri, 20 Mar 2015 20:47:18 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550CBF80.6030809@sentex.net> Date: Fri, 20 Mar 2015 20:46:56 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Konstantin Belousov , d@delphij.net Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> In-Reply-To: <20150321001559.GB2379@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List , John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 00:47:26 -0000 On 3/20/2015 8:15 PM, Konstantin Belousov wrote: >> >> For the purpose of devfs, does it make sense to bump timestamps like >> normal filesystems for each read/write operation? Looks like Mac OS X >> will bump timestamps for each operation but Debian don't. > > First question is, what timecounter hardware is used. I would accept > some slowdown from hardware like HPET, but it is indeed surprising > if caused by TSC. > > David Wolfskill suggested trying the problem commit with vfs.timestamp_precision=0 and it does indeed restore performance to what it was. The raw dtrace files are available and FlameGraphs can all be found at http://tancsa.com/time/ ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 15:52:38 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CFE7840D for ; Sat, 21 Mar 2015 15:52:38 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A25D86BE for ; Sat, 21 Mar 2015 15:52:38 +0000 (UTC) Received: from John-Baldwins-MacBook-Pro.local (d-69-161-105-82.cpe.metrocast.net [69.161.105.82]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 90D12B915; Sat, 21 Mar 2015 11:52:37 -0400 (EDT) Message-ID: <550D93C7.9080709@FreeBSD.org> Date: Sat, 21 Mar 2015 11:52:39 -0400 From: John Baldwin User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Mike Tancsa , Konstantin Belousov , d@delphij.net Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> <550CBF80.6030809@sentex.net> In-Reply-To: <550CBF80.6030809@sentex.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Sat, 21 Mar 2015 11:52:37 -0400 (EDT) Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 15:52:38 -0000 On 3/20/15 8:46 PM, Mike Tancsa wrote: > On 3/20/2015 8:15 PM, Konstantin Belousov wrote: >>> >>> For the purpose of devfs, does it make sense to bump timestamps like >>> normal filesystems for each read/write operation? Looks like Mac OS X >>> will bump timestamps for each operation but Debian don't. >> >> First question is, what timecounter hardware is used. I would accept >> some slowdown from hardware like HPET, but it is indeed surprising >> if caused by TSC. >> >> > > David Wolfskill suggested trying the problem commit with > > vfs.timestamp_precision=0 > > and it does indeed restore performance to what it was. The raw dtrace > files are available and FlameGraphs can all be found at > > http://tancsa.com/time/ Do you know why you are using the HPET instead of TSC for timestamping? Using the TSC can make a non-trivial performance difference since userland can calculate timestamps without using system calls when it is used. (That is not related to this case, but switching to the TSC in general is preferable.) There are a few generations of Intel CPUs where you can't mix deeper sleep states with the TSC as timecounter, but those CPUs are getting to be a bit older at this point. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 16:31:03 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4F95CEF5; Sat, 21 Mar 2015 16:31:03 +0000 (UTC) Received: from mail-ig0-x229.google.com (mail-ig0-x229.google.com [IPv6:2607:f8b0:4001:c05::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0FFD9A04; Sat, 21 Mar 2015 16:31:03 +0000 (UTC) Received: by igcau2 with SMTP id au2so8922680igc.1; Sat, 21 Mar 2015 09:31:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=3vU1JoKMYvmyO1BmF35Cs7X8C706tdq90b4AJ8cz7JQ=; b=u7AEDLLqPXVF6rUY9MoobrA2IKzMVZD7AtgYEgaEvFgf1Z2y4jTa2yUJE4kzEwwQYf T7MrdxLQjRz3byM/iu6M6zdx/zzvWDbzMKBIMaRePRX8//kY1nC0K1u6wkr+beTNxxr4 f5gaiDHyUh08xvPYGiNJPs1m48C6gHmcoU6IJz9ZM36Ash4DVAZdYI4wWkHcB6jS2bWQ 1ge4AcRfXjSn92Au74qh61CPYHdX68oNOcGjtfMfr7PyVWn4s3X2ioxC6EHdO6q+n2dO QZfaGULSfNv8qnkpZ3JHAhBuBkx+wy/NVZJdzP3HoZLtRXtezLubbzwUzz/Uy8USAgB8 IJow== MIME-Version: 1.0 X-Received: by 10.107.155.13 with SMTP id d13mr153297730ioe.29.1426955462556; Sat, 21 Mar 2015 09:31:02 -0700 (PDT) Sender: adrian.chadd@gmail.com Received: by 10.36.17.194 with HTTP; Sat, 21 Mar 2015 09:31:02 -0700 (PDT) In-Reply-To: <550D93C7.9080709@FreeBSD.org> References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> <550CBF80.6030809@sentex.net> <550D93C7.9080709@FreeBSD.org> Date: Sat, 21 Mar 2015 09:31:02 -0700 X-Google-Sender-Auth: zVC5a-wFhjQX1Z9iYPYInF1enwA Message-ID: Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn From: Adrian Chadd To: John Baldwin Content-Type: text/plain; charset=UTF-8 Cc: Konstantin Belousov , FreeBSD-STABLE Mailing List , John-Mark Gurney , Xin LI X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 16:31:03 -0000 On 21 March 2015 at 08:52, John Baldwin wrote: > On 3/20/15 8:46 PM, Mike Tancsa wrote: >> On 3/20/2015 8:15 PM, Konstantin Belousov wrote: >>>> >>>> For the purpose of devfs, does it make sense to bump timestamps like >>>> normal filesystems for each read/write operation? Looks like Mac OS X >>>> will bump timestamps for each operation but Debian don't. >>> >>> First question is, what timecounter hardware is used. I would accept >>> some slowdown from hardware like HPET, but it is indeed surprising >>> if caused by TSC. >>> >>> >> >> David Wolfskill suggested trying the problem commit with >> >> vfs.timestamp_precision=0 >> >> and it does indeed restore performance to what it was. The raw dtrace >> files are available and FlameGraphs can all be found at >> >> http://tancsa.com/time/ > > Do you know why you are using the HPET instead of TSC for timestamping? > Using the TSC can make a non-trivial performance difference since userland > can calculate timestamps without using system calls when it is used. > (That is not related to this case, but switching to the TSC in general is > preferable.) > > There are a few generations of Intel CPUs where you can't mix deeper sleep > states with the TSC as timecounter, but those CPUs are getting to be a bit > older at this point. What about various VMs? -adrian From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 17:21:57 2015 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A4703A79; Sat, 21 Mar 2015 17:21:57 +0000 (UTC) Received: from bigwig.baldwin.cx (bigwig.baldwin.cx [IPv6:2001:470:1f11:75::1]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 752FCFC8; Sat, 21 Mar 2015 17:21:57 +0000 (UTC) Received: from John-Baldwins-MacBook-Pro.local (d-69-161-105-82.cpe.metrocast.net [69.161.105.82]) by bigwig.baldwin.cx (Postfix) with ESMTPSA id 5962CB93C; Sat, 21 Mar 2015 13:21:56 -0400 (EDT) Message-ID: <550DA8B3.8080803@FreeBSD.org> Date: Sat, 21 Mar 2015 13:21:55 -0400 From: John Baldwin User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Adrian Chadd Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> <550CBF80.6030809@sentex.net> <550D93C7.9080709@FreeBSD.org> In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7 (bigwig.baldwin.cx); Sat, 21 Mar 2015 13:21:56 -0400 (EDT) Cc: Konstantin Belousov , FreeBSD-STABLE Mailing List , John-Mark Gurney , Xin LI X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 17:21:57 -0000 On 3/21/15 12:31 PM, Adrian Chadd wrote: > On 21 March 2015 at 08:52, John Baldwin wrote: >> On 3/20/15 8:46 PM, Mike Tancsa wrote: >>> On 3/20/2015 8:15 PM, Konstantin Belousov wrote: >>>>> >>>>> For the purpose of devfs, does it make sense to bump timestamps like >>>>> normal filesystems for each read/write operation? Looks like Mac OS X >>>>> will bump timestamps for each operation but Debian don't. >>>> >>>> First question is, what timecounter hardware is used. I would accept >>>> some slowdown from hardware like HPET, but it is indeed surprising >>>> if caused by TSC. >>>> >>>> >>> >>> David Wolfskill suggested trying the problem commit with >>> >>> vfs.timestamp_precision=0 >>> >>> and it does indeed restore performance to what it was. The raw dtrace >>> files are available and FlameGraphs can all be found at >>> >>> http://tancsa.com/time/ >> >> Do you know why you are using the HPET instead of TSC for timestamping? >> Using the TSC can make a non-trivial performance difference since userland >> can calculate timestamps without using system calls when it is used. >> (That is not related to this case, but switching to the TSC in general is >> preferable.) >> >> There are a few generations of Intel CPUs where you can't mix deeper sleep >> states with the TSC as timecounter, but those CPUs are getting to be a bit >> older at this point. > > What about various VMs? It depends on the hypervisor. bryanv@ is working on bits to allow us to use very cheap timecounters under KVM for example (if that isn't already in the tree). I think bhyve permits guests to use the TSC already. I think when we talked about this on arch@ before the change was made folks felt that even many embedded systems would have some sort of relatively cheap cycle counter, especially going forward. It may be that we end up picking a different default for guests as we do for 'hz' (though that has its downsides. Luigi has noted that one of the things he has to do to fix network performance in VMs is undo that and raise hz back to 1000). However, for bare metal I'd like to figure out why folks aren't using the TSC and fix those if possible. -- John Baldwin From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 18:13:40 2015 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 60ADF6B4; Sat, 21 Mar 2015 18:13:40 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 05584755; Sat, 21 Mar 2015 18:13:39 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2LIDUMC043926; Sat, 21 Mar 2015 14:13:30 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550DB4B2.7080603@sentex.net> Date: Sat, 21 Mar 2015 14:13:06 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: John Baldwin , Konstantin Belousov , d@delphij.net Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5506250A.2000506@sentex.net> <20150316132055.GQ32288@funkthat.com> <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> <550CBF80.6030809@sentex.net> <550D93C7.9080709@FreeBSD.org> In-Reply-To: <550D93C7.9080709@FreeBSD.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: John-Mark Gurney , FreeBSD-STABLE Mailing List X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 18:13:40 -0000 On 3/21/2015 11:52 AM, John Baldwin wrote: >> http://tancsa.com/time/ > > Do you know why you are using the HPET instead of TSC for timestamping? Hi, I am not consciously making any time keep decisions. kern.eventtimer.choice: HPET(550) HPET1(450) LAPIC(400) i8254(100) RTC(0) kern.timecounter.choice: TSC(800) HPET(950) ACPI-fast(900) i8254(0) dummy(-1000000) (The full hardware info is at the above url) > Using the TSC can make a non-trivial performance difference since userland > can calculate timestamps without using system calls when it is used. > (That is not related to this case, but switching to the TSC in general is > preferable.) > > There are a few generations of Intel CPUs where you can't mix deeper sleep > states with the TSC as timecounter, but those CPUs are getting to be a bit > older at this point. > This one is an AMD CPU: AMD G-T40E Processor (1000.02-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x500f20 Family=0x14 Model=0x2 Stepping=0 Features=0x178bfbff Features2=0x802209 AMD Features=0x2e500800 AMD Features2=0x35ff SVM: NP,NRIP,NAsids=8 TSC: P-state invariant, performance statistics real memory = 2115297280 (2017 MB) avail memory = 2018639872 (1925 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0 irqs 0-23 on motherboard random: initialized module_register_init: MOD_LOAD (vesa, 0xffffffff80d9ddf0, 0) error 19 kbd0 at kbdmux0 acpi0: on motherboard acpi0: Power Button (fixed) cpu0: on acpi0 cpu1: on acpi0 -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 18:42:55 2015 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 90791E21; Sat, 21 Mar 2015 18:42:55 +0000 (UTC) Received: from kib.kiev.ua (kib.kiev.ua [IPv6:2001:470:d5e7:1::1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 32D6F9FA; Sat, 21 Mar 2015 18:42:55 +0000 (UTC) Received: from tom.home (kostik@localhost [127.0.0.1]) by kib.kiev.ua (8.14.9/8.14.9) with ESMTP id t2LIgcHV091718 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Sat, 21 Mar 2015 20:42:39 +0200 (EET) (envelope-from kostikbel@gmail.com) DKIM-Filter: OpenDKIM Filter v2.9.2 kib.kiev.ua t2LIgcHV091718 Received: (from kostik@localhost) by tom.home (8.14.9/8.14.9/Submit) id t2LIgcus091717; Sat, 21 Mar 2015 20:42:38 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: tom.home: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 21 Mar 2015 20:42:38 +0200 From: Konstantin Belousov To: Mike Tancsa Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn Message-ID: <20150321184238.GO2379@kib.kiev.ua> References: <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> <550CBF80.6030809@sentex.net> <550D93C7.9080709@FreeBSD.org> <550DB4B2.7080603@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <550DB4B2.7080603@sentex.net> User-Agent: Mutt/1.5.23 (2014-03-12) X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,BAYES_00, DKIM_ADSP_CUSTOM_MED,FREEMAIL_FROM,NML_ADSP_CUSTOM_MED autolearn=no autolearn_force=no version=3.4.0 X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on tom.home Cc: FreeBSD-STABLE Mailing List , John-Mark Gurney , d@delphij.net, jkim@freebsd.org, John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 18:42:55 -0000 On Sat, Mar 21, 2015 at 02:13:06PM -0400, Mike Tancsa wrote: > On 3/21/2015 11:52 AM, John Baldwin wrote: > > >> http://tancsa.com/time/ > > > > Do you know why you are using the HPET instead of TSC for timestamping? > > Hi, > > I am not consciously making any time keep decisions. > > kern.eventtimer.choice: HPET(550) HPET1(450) LAPIC(400) i8254(100) RTC(0) > kern.timecounter.choice: TSC(800) HPET(950) ACPI-fast(900) i8254(0) > dummy(-1000000) > > (The full hardware info is at the above url) > > > > Using the TSC can make a non-trivial performance difference since userland > > can calculate timestamps without using system calls when it is used. > > (That is not related to this case, but switching to the TSC in general is > > preferable.) > > > > There are a few generations of Intel CPUs where you can't mix deeper sleep > > states with the TSC as timecounter, but those CPUs are getting to be a bit > > older at this point. > > > > This one is an AMD > CPU: AMD G-T40E Processor (1000.02-MHz K8-class CPU) > Origin="AuthenticAMD" Id=0x500f20 Family=0x14 Model=0x2 Stepping=0 > > Features=0x178bfbff > Features2=0x802209 > AMD Features=0x2e500800 > AMD > Features2=0x35ff > SVM: NP,NRIP,NAsids=8 > TSC: P-state invariant, performance statistics It seems to be a consequnce of the code from r222869. The test_tsc() does not trust the P-state invariant report and explicitely check for the family. Your CPU family is 0x14, while code only bumps TSC priority for family 0x15+. Currently, tsc_is_invariant is set when CPU reports AMDPM_TSC_INVARIANT, or for some models. Should we bump TSC timecounter priority is smp test passed and AMDPM_TSC_INVARIANT is set ? For now, you could just set TSC as timecounter. From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 20:37:17 2015 Return-Path: Delivered-To: freebsd-stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 59A93D3C; Sat, 21 Mar 2015 20:37:17 +0000 (UTC) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client CN "smarthost.sentex.ca", Issuer "smarthost.sentex.ca" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 1AA06881; Sat, 21 Mar 2015 20:37:17 +0000 (UTC) Received: from [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a] (saphire3.sentex.ca [IPv6:2607:f3e0:0:4:f025:8813:7603:7e4a]) by smarthost1.sentex.ca (8.14.9/8.14.9) with ESMTP id t2LKbBrc056474; Sat, 21 Mar 2015 16:37:11 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <550DD660.7030203@sentex.net> Date: Sat, 21 Mar 2015 16:36:48 -0400 From: Mike Tancsa Organization: Sentex Communications User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.5.0 MIME-Version: 1.0 To: Konstantin Belousov Subject: Re: RELENG_10 performance regression (was Re: 35-40% performance drop releng9 vs releng10 openvpn References: <5509D6C6.4050204@sentex.net> <20150318211457.GL51048@funkthat.com> <550B6950.8060806@sentex.net> <550C5AAF.9060502@sentex.net> <550C8AEE.4090408@sentex.net> <550CB306.7030405@delphij.net> <20150321001559.GB2379@kib.kiev.ua> <550CBF80.6030809@sentex.net> <550D93C7.9080709@FreeBSD.org> <550DB4B2.7080603@sentex.net> <20150321184238.GO2379@kib.kiev.ua> In-Reply-To: <20150321184238.GO2379@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.75 Cc: FreeBSD-STABLE Mailing List , John-Mark Gurney , d@delphij.net, jkim@freebsd.org, John Baldwin X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 20:37:17 -0000 On 3/21/2015 2:42 PM, Konstantin Belousov wrote: > > It seems to be a consequnce of the code from r222869. The test_tsc() > does not trust the P-state invariant report and explicitely check for > the family. Your CPU family is 0x14, while code only bumps TSC priority > for family 0x15+. > > Currently, tsc_is_invariant is set when CPU reports AMDPM_TSC_INVARIANT, > or for some models. Should we bump TSC timecounter priority is smp > test passed and AMDPM_TSC_INVARIANT is set ? > > For now, you could just set TSC as timecounter. > > Thanks, changing to kern.timecounter.hardware=TSC also brings back performance to where it was ---Mike -- ------------------- Mike Tancsa, tel +1 519 651 3400 Sentex Communications, mike@sentex.net Providing Internet services since 1994 www.sentex.net Cambridge, Ontario Canada http://www.tancsa.com/ From owner-freebsd-stable@FreeBSD.ORG Sat Mar 21 21:59:00 2015 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 647EB6C8 for ; Sat, 21 Mar 2015 21:59:00 +0000 (UTC) Received: from mail-la0-x22a.google.com (mail-la0-x22a.google.com [IPv6:2a00:1450:4010:c03::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D9D08FD3 for ; Sat, 21 Mar 2015 21:58:59 +0000 (UTC) Received: by labon10 with SMTP id on10so9286507lab.2 for ; Sat, 21 Mar 2015 14:58:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version; bh=eBkhf7XgEduQUZf580srMRplbLWyBgbMj4pZwwkoDas=; b=g8W91tdNVnQXG5lIme1yBgCZN8JGRYWplml9+WKOhNOQzoiSOuP7l0DtbzKnl7svDU sLq8aGnPS05v6WggX7YXegOIUo0P9j/FcimcUeBtIzX8gc8TTno3EQtEFSXl+t4OCmQE LZNm0nUq3Rte8FhkVEE2SwYveFUkzpBe8Pee7H1zUBP7coeskS+5fdh5QUDiDcYDQGV7 dUQ97jPNmYDo9RuPsbKA+DXRRuyCXJLkjSoEdsn5HHqQCeRs3R2Rj9dOp6rPhKVvFagp +4l1u0wn2bkude2TeCrbRzrydvqYTE3QOj6N1LdwGNFmSAdyp1LD+ybfRYm3BNw1d3SA YLBA== X-Received: by 10.152.5.170 with SMTP id t10mr77431585lat.43.1426975137965; Sat, 21 Mar 2015 14:58:57 -0700 (PDT) Received: from [10.0.1.7] (broadband-5-228-253-252.nationalcablenetworks.ru. [5.228.253.252]) by mx.google.com with ESMTPSA id j9sm1706541lbp.7.2015.03.21.14.58.56 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 21 Mar 2015 14:58:56 -0700 (PDT) From: Dmitry Sivachenko Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: dev.cpu.0.freq disapeared Message-Id: Date: Sun, 22 Mar 2015 00:58:55 +0300 To: stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2070.6\)) X-Mailer: Apple Mail (2.2070.6) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Mar 2015 21:59:00 -0000 Hello! I have a machine with the following processor: CPU: Intel(R) Xeon(R) CPU E5620 @ 2.40GHz (2400.14-MHz = K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x206c2 Family=3D0x6 Model=3D0x2c = Stepping=3D2 When running 10.1-STABLE #5 r276908 I have: % sysctl dev.cpu.0.freq dev.cpu.0.freq: 2400 % After I upgraded to 10.1-STABLE #0 r279956, this sysctl disapeared. % sysctl dev.cpu.0.freq sysctl: unknown oid 'dev.cpu.0.freq': No such file or directory % I did not change kernel config file. What can be the cause of this problem? Thanks.=