Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 4 Jul 2013 10:16:37 -0700
From:      Jeremy Chadwick <jdc@koitsu.org>
To:        mxb <mxb@alumni.chalmers.se>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: Slow resilvering with mirrored ZIL
Message-ID:  <20130704171637.GA94539@icarus.home.lan>
In-Reply-To: <C8C696C0-2963-4868-8BB8-6987B47C3460@alumni.chalmers.se>
References:  <CABBFC07-68C2-4F43-9AFC-920D8C34282E@unixconn.com> <51D42107.1050107@digsys.bg> <2EF46A8C-6908-4160-BF99-EC610B3EA771@alumni.chalmers.se> <51D437E2.4060101@digsys.bg> <E5CCC8F551CA4627A3C7376AD63A83CC@multiplay.co.uk> <CBCA1716-A3EC-4E3B-AE0A-3C8028F6AACF@alumni.chalmers.se> <20130704000405.GA75529@icarus.home.lan> <C8C696C0-2963-4868-8BB8-6987B47C3460@alumni.chalmers.se>

next in thread | previous in thread | raw e-mail | index | archive | help
On Thu, Jul 04, 2013 at 06:57:09PM +0200, mxb wrote:
> 
> Well, I'v got a lot of errors in dmesg regarding one of four disks, which is not currently replaced.
> After resilvering dropped to 2MB/s ( :O ), it stuck. I had to reboot system.
> It came up and now continues resilvering process at 9/s (9 what??? bytes? )
> 
> Here comes requested info:
> 
> dmesg(plan was to re-new disks and then lift this sys up to STABLE):
> 
> Copyright (c) 1992-2012 The FreeBSD Project.
> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
> 	The Regents of the University of California. All rights reserved.
> FreeBSD is a registered trademark of The FreeBSD Foundation.
> FreeBSD 9.1-RELEASE-p1 #2: Fri Mar  8 10:30:38 CET 2013
>     root@nas.home.unixconn.com:/usr/obj/usr/src/sys/GENERIC amd64
> module_register: module pci/em already exists!
> Module pci/em failed to register: 17
> module_register: module pci/lem already exists!
> Module pci/lem failed to register: 17
> CPU: Intel(R) Xeon(R) CPU           X5460  @ 3.16GHz (3166.74-MHz K8-class CPU)
>   Origin = "GenuineIntel"  Id = 0x10676  Family = 6  Model = 17  Stepping = 6
>   Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
>   Features2=0xce3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1>
>   AMD Features=0x20100800<SYSCALL,NX,LM>
>   AMD Features2=0x1<LAHF>
>   TSC: P-state invariant, performance statistics
> real memory  = 34359738368 (32768 MB)
> avail memory = 33095909376 (31562 MB)
> Event timer "LAPIC" quality 400
> ACPI APIC Table: <PTLTD  	 APIC  >
> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
> FreeBSD/SMP: 1 package(s) x 4 core(s)
>  cpu0 (BSP): APIC ID:  0
>  cpu1 (AP): APIC ID:  1
>  cpu2 (AP): APIC ID:  2
>  cpu3 (AP): APIC ID:  3
> ioapic0 <Version 2.0> irqs 0-23 on motherboard
> ioapic1 <Version 2.0> irqs 24-47 on motherboard
> kbd1 at kbdmux0
> ctl: CAM Target Layer loaded
> acpi0: <PTLTD   RSDT> on motherboard
> acpi0: Power Button (fixed)
> cpu0: <ACPI CPU> on acpi0
> cpu1: <ACPI CPU> on acpi0
> cpu2: <ACPI CPU> on acpi0
> cpu3: <ACPI CPU> on acpi0
> atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
> Event timer "RTC" frequency 32768 Hz quality 0
> attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
> Timecounter "i8254" frequency 1193182 Hz quality 0
> Event timer "i8254" frequency 1193182 Hz quality 100
> Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
> pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
> pci0: <ACPI PCI bus> on pcib0
> pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
> pci1: <ACPI PCI bus> on pcib1
> pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
> pci2: <ACPI PCI bus> on pcib2
> pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
> pci3: <ACPI PCI bus> on pcib3
> pcib4: <ACPI PCI-PCI bridge> at device 0.0 on pci3
> pci4: <ACPI PCI bus> on pcib4
> pcib5: <ACPI PCI-PCI bridge> at device 0.2 on pci3
> pci5: <ACPI PCI bus> on pcib5
> pcib6: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci2
> pci6: <ACPI PCI bus> on pcib6
> em0: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0x2000-0x201f mem 0xdc000000-0xdc01ffff irq 18 at device 0.0 on pci6
> em0: Using an MSI interrupt
> em0: Ethernet address: 00:30:48:34:46:36
> em1: <Intel(R) PRO/1000 Network Connection 7.3.2> port 0x2020-0x203f mem 0xdc020000-0xdc03ffff irq 19 at device 0.1 on pci6
> em1: Using an MSI interrupt
> em1: Ethernet address: 00:30:48:34:46:37
> pcib7: <ACPI PCI-PCI bridge> at device 0.3 on pci1
> pci7: <ACPI PCI bus> on pcib7
> pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
> pci8: <ACPI PCI bus> on pcib8
> pcib9: <PCI-PCI bridge> at device 0.0 on pci8
> pci9: <PCI bus> on pcib9
> bce0: <HP NC380T PCIe DP Multifunc Gig Server Adapter (A2)> mem 0xd8000000-0xd9ffffff irq 16 at device 4.0 on pci9
> miibus0: <MII bus> on bce0
> brgphy0: <BCM5706 1000BASE-T/SX media interface> PHY 1 on miibus0
> brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
> bce0: Ethernet address: 00:1b:78:38:2f:28
> bce0: ASIC (0x57060020); Rev (A2); Bus (PCI-X, 64-bit, 100MHz); B/C (1.9.6); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI)
> Coal (RX:6,6,18,18; TX:20,20,80,80)
> pcib10: <PCI-PCI bridge> at device 0.2 on pci8
> pci10: <PCI bus> on pcib10
> bce1: <HP NC380T PCIe DP Multifunc Gig Server Adapter (A2)> mem 0xda000000-0xdbffffff irq 17 at device 5.0 on pci10
> miibus1: <MII bus> on bce1
> brgphy1: <BCM5706 1000BASE-T/SX media interface> PHY 1 on miibus1
> brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
> bce1: Ethernet address: 00:1b:78:38:2f:2a
> bce1: ASIC (0x57060020); Rev (A2); Bus (PCI-X, 64-bit, 100MHz); B/C (1.9.6); Bufs (RX:2;TX:2;PG:8); Flags (SPLT|MSI)
> Coal (RX:6,6,18,18; TX:20,20,80,80)
> pcib11: <ACPI PCI-PCI bridge> at device 6.0 on pci0
> pci11: <ACPI PCI bus> on pcib11
> pci0: <base peripheral> at device 8.0 (no driver attached)
> pcib12: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
> pci12: <ACPI PCI bus> on pcib12
> uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x1800-0x181f irq 17 at device 29.0 on pci0
> usbus0 on uhci0
> uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x1820-0x183f irq 19 at device 29.1 on pci0
> usbus1 on uhci1
> uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x1840-0x185f irq 18 at device 29.2 on pci0
> usbus2 on uhci2
> ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xdc500000-0xdc5003ff irq 17 at device 29.7 on pci0
> usbus3: EHCI version 1.0
> usbus3 on ehci0
> pcib13: <ACPI PCI-PCI bridge> at device 30.0 on pci0
> pci13: <ACPI PCI bus> on pcib13
> vgapci0: <VGA-compatible display> port 0x3000-0x30ff mem 0xd0000000-0xd7ffffff,0xdc200000-0xdc20ffff irq 18 at device 1.0 on pci13
> isab0: <PCI-ISA bridge> at device 31.0 on pci0
> isa0: <ISA bus> on isab0
> ahci0: <Intel ESB2 AHCI SATA controller> port 0x1890-0x1897,0x1884-0x1887,0x1888-0x188f,0x1880-0x1883,0x1860-0x187f mem 0xdc500400-0xdc5007ff irq 19 at device 31.2 on pci0
> ahci0: AHCI v1.10 with 6 3Gbps ports, Port Multiplier supported
> ahcich0: <AHCI channel> at channel 0 on ahci0
> ahcich1: <AHCI channel> at channel 1 on ahci0
> ahcich2: <AHCI channel> at channel 2 on ahci0
> ahcich3: <AHCI channel> at channel 3 on ahci0
> ahcich4: <AHCI channel> at channel 4 on ahci0
> ahcich5: <AHCI channel> at channel 5 on ahci0
> pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
> acpi_button0: <Power Button> on acpi0
> atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
> atkbd0: <AT Keyboard> irq 1 on atkbdc0
> kbd0 at atkbd0
> atkbd0: [GIANT-LOCKED]
> uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
> uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
> fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
> fdc0: does not respond
> device_attach: fdc0 attach returned 6
> ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on acpi0
> ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode
> ppc0: FIFO with 16/16/9 bytes threshold
> ppbus0: <Parallel port bus> on ppc0
> plip0: <PLIP network interface> on ppbus0
> lpt0: <Printer> on ppbus0
> lpt0: Interrupt-driven port
> ppi0: <Parallel I/O> on ppbus0
> orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xcb000-0xccfff,0xcd000-0xce7ff,0xce800-0xcffff on isa0
> sc0: <System console> at flags 0x100 on isa0
> sc0: VGA <16 virtual consoles, flags=0x300>
> vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
> fdc0: No FDOUT register!
> est0: <Enhanced SpeedStep Frequency Control> on cpu0
> est: CPU supports Enhanced Speedstep, but is not recognized.
> est: cpu_vendor GenuineIntel, msr 4921492106004921
> device_attach: est0 attach returned 6
> p4tcc0: <CPU Frequency Thermal Control> on cpu0
> est1: <Enhanced SpeedStep Frequency Control> on cpu1
> est: CPU supports Enhanced Speedstep, but is not recognized.
> est: cpu_vendor GenuineIntel, msr 4921492106004921
> device_attach: est1 attach returned 6
> p4tcc1: <CPU Frequency Thermal Control> on cpu1
> est2: <Enhanced SpeedStep Frequency Control> on cpu2
> est: CPU supports Enhanced Speedstep, but is not recognized.
> est: cpu_vendor GenuineIntel, msr 4921492106004921
> device_attach: est2 attach returned 6
> p4tcc2: <CPU Frequency Thermal Control> on cpu2
> est3: <Enhanced SpeedStep Frequency Control> on cpu3
> est: CPU supports Enhanced Speedstep, but is not recognized.
> est: cpu_vendor GenuineIntel, msr 4921492106004921
> device_attach: est3 attach returned 6
> p4tcc3: <CPU Frequency Thermal Control> on cpu3
> ZFS filesystem version 5
> ZFS storage pool version 28
> Timecounters tick every 1.000 msec
> usbus0: 12Mbps Full Speed USB v1.0
> usbus1: 12Mbps Full Speed USB v1.0
> usbus2: 12Mbps Full Speed USB v1.0
> usbus3: 480Mbps High Speed USB v2.0
> ugen0.1: <Intel> at usbus0
> uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
> ugen1.1: <Intel> at usbus1
> uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
> ugen2.1: <Intel> at usbus2
> uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
> ugen3.1: <Intel> at usbus3
> uhub3: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
> uhub0: 2 ports with 2 removable, self powered
> uhub1: 2 ports with 2 removable, self powered
> uhub2: 2 ports with 2 removable, self powered
> bce0: bce_pulse(): Warning: bootcode thinks driver is absent! (bc_state = 0x00000004)
> bce1: bce_pulse(): Warning: bootcode thinks driver is absent! (bc_state = 0x00000004)
> uhub3: 6 ports with 6 removable, self powered
> ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
> ada0: <ST32000645NS 0004> ATA-8 SATA 3.x device
> ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
> ada0: Command Queueing enabled
> ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
> ada0: Previously was known as ad4
> ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
> ada1: <WDC WD10EARS-00Z5B1 80.00A80> ATA-8 SATA 2.x device
> ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
> ada1: Command Queueing enabled
> ada1: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
> ada1: Previously was known as ad6
> ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
> ada2: <WDC WD10EARS-00Z5B1 80.00A80> ATA-8 SATA 2.x device
> ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
> ada2: Command Queueing enabled
> ada2: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
> ada2: Previously was known as ad8
> ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
> ada3: <ST32000645NS 0004> ATA-8 SATA 3.x device
> ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
> ada3: Command Queueing enabled
> ada3: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
> ada3: Previously was known as ad10
> ada4 at ahcich4 bus 0 scbus4 target 0 lun 0
> ada4: <INTEL SSDSA2VP020G2 2CV102M5> ATA-7 SATA 2.x device
> ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
> ada4: Command Queueing enabled
> ada4: 19087MB (39091248 512 byte sectors: 16H 63S/T 16383C)
> ada4: Previously was known as ad12
> ada5 at ahcich5 bus 0 scbus5 target 0 lun 0
> ada5: <OCZ-AGILITY3 2.15> ATA-8 SATA 3.x device
> ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
> ada5: Command Queueing enabled
> ada5: 57241MB (117231408 512 byte sectors: 16H 63S/T 16383C)
> ada5: Previously was known as ad14
> SMP: AP CPU #3 Launched!
> SMP: AP CPU #1 Launched!
> SMP: AP CPU #2 Launched!
> Timecounter "TSC-low" frequency 12370070 Hz quality 1000
> Root mount waiting for: usbus3
> ugen0.2: <Hewlett-Packard Company> at usbus0
> ukbd0: <Hewlett-Packard Company HP USB Smart Card Keyboard, class 0/0, rev 2.00/5.35, addr 2> on usbus0
> kbd2 at ukbd0
> Root mount waiting for: usbus3
> ugen3.2: <Generic> at usbus3
> umass0: <Generic USB Storage, class 0/0, rev 2.00/2.50, addr 2> on usbus3
> umass0:  SCSI over Bulk-Only; quirks = 0x4100
> umass0:7:0:-1: Attached to scbus7
> Trying to mount root from zfs:NAS/system/root [rw]...
> da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
> da0: <Generic STORAGE DEVICE 0250> Removable Direct Access SCSI-0 device
> da0: 40.000MB/s transfers
> da0: 7580MB (15523840 512 byte sectors: 255H 63S/T 966C)
> GEOM_PART: integrity check failed (label/zfs_boot, BSD)
> GEOM_PART: integrity check failed (label/zfs_boot, BSD)
> bce0: Gigabit link up!
> bce1: Gigabit link up!
> 
> zpool status:
>   pool: NAS
>  state: DEGRADED
> status: One or more devices is currently being resilvered.  The pool will
> 	continue to function, possibly in a degraded state.
> action: Wait for the resilver to complete.
>   scan: resilver in progress since Tue Jul  2 07:31:29 2013
>         483G scanned out of 3.49T at 10/s, (scan is slow, no estimated time)
>         121G resilvered, 13.52% done
> config:
> 
> 	NAME                       STATE     READ WRITE CKSUM
> 	NAS                        DEGRADED     0     0     0
> 	  raidz1-0                 DEGRADED     0     0     0
> 	    replacing-0            DEGRADED     0     0     0
> 	      1160414651350745057  UNAVAIL      0     0     0  was /dev/ada0/old
> 	      ada0                 ONLINE       0     0     0  (resilvering)
> 	    ada3                   ONLINE       0     0     0
> 	    ada1                   ONLINE       0     0     0
> 	    ada2                   ONLINE       0     0     0
> 	logs
> 	  mirror-1                 ONLINE       0     0     0
> 	    ada4s1                 ONLINE       0     0     0
> 	    ada5s1                 ONLINE       0     0     0
> 	cache
> 	  ada5s2                   ONLINE       0     0     0
> 
> errors: No known data errors
> 
> zpool get all:
> NAME  PROPERTY       VALUE       SOURCE
> NAS   size           3.64T       -
> NAS   capacity       95%         -
> NAS   altroot        -           default
> NAS   health         DEGRADED    -
> NAS   guid           3808946822857359331  default
> NAS   version        28          default
> NAS   bootfs         -           default
> NAS   delegation     on          default
> NAS   autoreplace    off         default
> NAS   cachefile      -           default
> NAS   failmode       wait        default
> NAS   listsnapshots  off         default
> NAS   autoexpand     off         default
> NAS   dedupditto     0           default
> NAS   dedupratio     1.00x       -
> NAS   free           154G        -
> NAS   allocated      3.49T       -
> NAS   readonly       off         -
> NAS   comment        -           default
> NAS   expandsize     0           -
> 
> zfs get all:
> NAME               PROPERTY              VALUE                   SOURCE
> NAS                type                  filesystem              -
> NAS                creation              Tue Aug  3 20:10 2010   -
> NAS                used                  2.61T                   -
> NAS                available             72.0G                   -
> NAS                referenced            62.8K                   -
> NAS                compressratio         1.00x                   -
> NAS                mounted               yes                     -
> NAS                quota                 none                    default
> NAS                reservation           none                    default
> NAS                recordsize            128K                    default
> NAS                mountpoint            /mnt/NAS                local
> NAS                sharenfs              off                     default
> NAS                checksum              on                      default
> NAS                compression           off                     default
> NAS                atime                 off                     local
> NAS                devices               on                      default
> NAS                exec                  on                      default
> NAS                setuid                on                      default
> NAS                readonly              off                     default
> NAS                jailed                off                     default
> NAS                snapdir               hidden                  default
> NAS                aclmode               discard                 default
> NAS                aclinherit            restricted              default
> NAS                canmount              on                      default
> NAS                xattr                 off                     temporary
> NAS                copies                1                       default
> NAS                version               5                       -
> NAS                utf8only              off                     -
> NAS                normalization         none                    -
> NAS                casesensitivity       sensitive               -
> NAS                vscan                 off                     default
> NAS                nbmand                off                     default
> NAS                sharesmb              off                     default
> NAS                refquota              none                    default
> NAS                refreservation        none                    default
> NAS                primarycache          all                     default
> NAS                secondarycache        all                     default
> NAS                usedbysnapshots       0                       -
> NAS                usedbydataset         0                       -
> NAS                usedbychildren        0                       -
> NAS                usedbyrefreservation  0                       -
> NAS                logbias               latency                 default
> NAS                dedup                 off                     default
> NAS                mlslabel                                      -
> NAS                sync                  standard                local
> NAS                refcompressratio      1.00x                   -
> NAS                written               62.8K                   -
> 
> the rest of created - defaults. no changes or inherited from this one.
> 
> part show -p:
> nas# gpart show -p ada0
> gpart: No such geom: ada0.
> nas# gpart show -p ada1
> gpart: No such geom: ada1.
> nas# gpart show -p ada2
> gpart: No such geom: ada2.
> nas# gpart show -p ada3
> gpart: No such geom: ada3.
> nas# gpart show -p ada4
> =>      63  39091185    ada4  MBR  (18G)
>         63  20971503  ada4s1  freebsd  (10G)
>   20971566  18119682  ada4s2  freebsd  (8.7G)
> 
> nas# gpart show -p ada5
> =>       63  117231345    ada5  MBR  (55G)
>          63   20971503  ada5s1  freebsd  (10G)
>    20971566   96259842  ada5s2  freebsd  (45G)
> 
> ada4/ada5 are ZIL/L2ARC/swap
> 
> cat /etc/sysct.conf:
> 
> nas# cat /etc/sysctl.conf
> # $FreeBSD: src/etc/sysctl.conf,v 1.8.34.1.6.1 2010/12/21 17:09:25 kensmith Exp $
> #
> #  This file is read when going to multi-user and its contents piped thru
> #  ``sysctl'' to adjust kernel values.  ``man 5 sysctl.conf'' for details.
> #
> 
> # Uncomment this to prevent users from seeing information about processes that
> # are being run under another UID.
> security.bsd.see_other_uids=0
> 
> # Disable power button
> hw.acpi.power_button_state=NONE
> # Disable core dump
> kern.coredump=0
> 
> kern.ipc.maxsockbuf=2097152
> kern.ipc.nmbclusters=32768
> kern.ipc.somaxconn=8192
> kern.maxfiles=65536
> kern.maxfilesperproc=32768
> kern.ipc.nmbjumbo9=12800
> 
> # ZFS tuning
> kern.maxvnodes=400000
> kern.maxfilesperproc=200000
> kern.ipc.maxsockets=204800
> 
> #http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#File-Level_Prefetching
> vfs.zfs.l2arc_noprefetch=0
> vfs.zfs.l2arc_write_max=209715200       ## in bytes. 200MB/s
> vfs.zfs.l2arc_write_boost=314572800     ## in bytes. 300MB/s
> 
> #net.inet.icmp.icmplim=300
> #net.inet.icmp.icmplim_output=1
> #net.inet.ip.fastforwarding=1
> #net.inet.ip.forwarding=1
> #net.inet.tcp.delayed_ack=0
> #net.inet.tcp.inflight.enable=0
> #net.inet.tcp.path_mtu_discovery=0
> #net.inet.tcp.recvspace=262144
> #net.inet.tcp.rfc1323=1
> #net.inet.tcp.sendspace=262144
> #net.inet.udp.maxdgram=57344
> #net.inet.udp.recvspace=65536
> #net.local.stream.recvspace=65536
> #net.local.stream.sendspace=65536
> 
> 
> # Increase max command-line length showed in `ps` (e.g for Tomcat/Java)
> # Default is PAGE_SIZE / 16 or 256 on x86
> # For more info see: http://www.freebsd.org/cgi/query-pr.cgi?pr=120749
> kern.ps_arg_cache_limit=4096
> 
> net.inet.tcp.sendspace=65535
> net.inet.tcp.recvspace=131072
> net.inet.tcp.mssdflt=1452
> net.inet.tcp.sendbuf_max=16777216
> net.inet.tcp.sendbuf_inc=524288
> net.inet.tcp.recvbuf_max=16777216
> net.inet.tcp.recvbuf_inc=524288
> net.inet.udp.recvspace=65535
> net.inet.udp.maxdgram=65535
> net.local.stream.recvspace=65535
> net.local.stream.sendspace=65535
> net.inet.tcp.delayed_ack=0
> 
> cat /boot/loader.conf:
> 
> nas# cat /boot/loader.conf
> zfs_load="YES"
> kern.maxfiles="20480"
> 
> vfs.root.mountfrom="zfs:NAS/system/root"
> vfs.root.mountfrom.options="rw"
> 
> #I have 8G of Ram
> #vfs.zfs.prefetch_disable=0
> vfs.zfs.write_limit_override=53687091200
> 
> #If Ram = 4GB, set the value to 512M
> #If Ram = 8GB, set the value to 1024M
> #vfs.zfs.arc_min="4096M"
> 
> #Ram x 0.5 - 512 MB
> #vfs.zfs.arc_max="15488"
> 
> #Ram x 2
> #vm.kmem_size_max="64G"
> 
> #Ram x 1.5
> #vm.kmem_size="48G"
> 
> ahci_load="YES"
> aio_load="YES"
> if_em_load="YES"
> if_lagg_load="YES"
> 
> THIS IS ROOT ON ZFS SYS.

Thanks for the info.  Given the above, I need even more:

- Output from: zdb -C

- Output from: smartctl -a ada{0,5}

And yes, "9/s" or "10/s" in resilvering means bytes per second.  I have
a couple feelings about what's going on (meaning right now I have 3
separate theories), but I need to see the above first.

Also, I swore I remember some Intel ESB2 thing that got committed to
stable/9 recently, not sure what I'm remembering or if I'm remembering
it right though, will go look it up later.  I should be clear however: I
do not believe at this time the problem you're experiencing is with the
ESB2 southbridge or anything along those lines.  If there were issues
with that on FreeBSD I'd expect them to be widespread given the
popularity of the chipset in the server realm.

-- 
| Jeremy Chadwick                                   jdc@koitsu.org |
| UNIX Systems Administrator                http://jdc.koitsu.org/ |
| Making life hard for others since 1977.             PGP 4BD6C0CB |




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20130704171637.GA94539>