From owner-freebsd-fs@FreeBSD.ORG Sat Jan 21 01:31:27 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DD52C106564A for ; Sat, 21 Jan 2012 01:31:27 +0000 (UTC) (envelope-from claudius_herder@ambtec.de) Received: from server.ambtec.de (server.ambtec.de [IPv6:2a01:4f8:131:1381::2]) by mx1.freebsd.org (Postfix) with ESMTP id 74F5C8FC13 for ; Sat, 21 Jan 2012 01:31:26 +0000 (UTC) Received: from server.ambtec.de (localhost [127.0.0.1]) by server.ambtec.de (Postfix) with ESMTP id 92BAEE9F3 for ; Sat, 21 Jan 2012 02:31:25 +0100 (CET) X-Virus-Scanned: by amavisd-new using ClamAV at ambtec.de Received: from server.ambtec.de ([127.0.0.1]) by server.ambtec.de (server.ambtec.de [127.0.0.1]) (amavisd-new, port 10024) with LMTP id DdnctPLG8I1W for ; Sat, 21 Jan 2012 02:31:15 +0100 (CET) Received: from [192.168.0.101] (e176004018.adsl.alicedsl.de [85.176.4.18]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by server.ambtec.de (Postfix) with ESMTPSA id 4B1E5E9E7 for ; Sat, 21 Jan 2012 02:31:15 +0100 (CET) Message-ID: <4F1A1564.4080003@ambtec.de> Date: Sat, 21 Jan 2012 02:31:16 +0100 From: Claudius Herder User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:9.0) Gecko/20120114 Thunderbird/9.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org X-Enigmail-Version: 1.3.4 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig06918E1878A4A49BFC2E5262" Subject: zfs arc eating up all memory X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jan 2012 01:31:27 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig06918E1878A4A49BFC2E5262 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi all, I kind of accidentialy did 'du -sh' on my homedir and forgot that I had set snapdir=3Dvisible. After some minutes wired memory growed from 2g to 7.5g, active memory dropped from 700m to 20m and heavy swapping occured. I was not able to reproduce this behavior in my test vm (i386 vbox) and testing on the server is difficult, because I have only ssh access and if I do not kill 'du' in time, I can only hard reset the system. If I set snapdir=3Dhidden there is no problem, even if i run 'du -sh /' Reducing vfs.zfs.arc_max to 2048m did not solve the issue. Any ideas/hints to solve or workaround this problem? -- Claudius There is not much data in my home, most of it is email. #find /usr/home/claudius/.zfs |wc -l 4280597 #zfs list -t snapshot -H |grep claudius |wc -l 99 # zfs list -o space zpool/usr/home/claudius NAME AVAIL USED USEDSNAP USEDDS USEDREFRESERV USEDCHILD zpool/usr/home/claudius 655G 1.43G 203M 1.23G 0 0 zfs-stats -a ------------------------------------------------------------------------ ZFS Subsystem Report Sat Jan 21 01:00:30 2012 ------------------------------------------------------------------------ System Information: Kernel Version: 900044 (osreldate) Hardware Platform: amd64 Processor Architecture: amd64 ZFS Storage pool Version: 28 ZFS Filesystem Version: 5 FreeBSD 9.0-RELEASE #1: Fri Jan 20 22:23:20 CET 2012 claudius 1:00AM up 2:35, 4 users, load averages: 0.67, 0.46, 0.31 ------------------------------------------------------------------------ System Memory: 0.69% 54.34 MiB Active, 2.79% 220.35 MiB Inact 93.68% 7.23 GiB Wired, 1.72% 135.54 MiB Cache 1.11% 88.04 MiB Free, 0.01% 1.10 MiB Gap Real Installed: 8.00 GiB Real Available: 99.76% 7.98 GiB Real Managed: 96.69% 7.72 GiB Logical Total: 8.00 GiB Logical Used: 94.58% 7.57 GiB Logical Free: 5.42% 443.92 MiB Kernel Memory: 3.81 GiB Data: 99.72% 3.80 GiB Text: 0.28% 10.77 MiB Kernel Memory Map: 7.69 GiB Size: 27.57% 2.12 GiB Free: 72.43% 5.57 GiB ------------------------------------------------------------------------ ARC Summary: (HEALTHY) Memory Throttle Count: 0 ARC Misc: Deleted: 132.60k Recycle Misses: 564.40k Mutex Misses: 84 Evict Skips: 84 ARC Size: 262.61% 5.25 GiB Target Size: (Adaptive) 12.50% 256.00 MiB Min Size (Hard Limit): 12.50% 256.00 MiB Max Size (High Water): 8:1 2.00 GiB ARC Size Breakdown: Recently Used Cache Size: 0.30% 16.03 MiB Frequently Used Cache Size: 99.70% 5.24 GiB ARC Hash Breakdown: Elements Max: 46.85k Elements Current: 39.41% 18.46k Collisions: 58.11k Chain Max: 6 Chains: 1.16k ------------------------------------------------------------------------ ARC Efficiency: 12.26m Cache Hit Ratio: 94.04% 11.52m Cache Miss Ratio: 5.96% 730.73k Actual Hit Ratio: 91.06% 11.16m Data Demand Efficiency: 98.42% 3.12m Data Prefetch Efficiency: 25.99% 17.37k CACHE HITS BY CACHE LIST: Most Recently Used: 2.63% 302.61k Most Frequently Used: 94.21% 10.86m Most Recently Used Ghost: 2.33% 268.62k Most Frequently Used Ghost: 3.59% 414.20k CACHE HITS BY DATA TYPE: Demand Data: 26.65% 3.07m Prefetch Data: 0.04% 4.51k Demand Metadata: 70.16% 8.09m Prefetch Metadata: 3.15% 362.82k CACHE MISSES BY DATA TYPE: Demand Data: 6.73% 49.20k Prefetch Data: 1.76% 12.86k Demand Metadata: 56.37% 411.90k Prefetch Metadata: 35.14% 256.77k ------------------------------------------------------------------------ L2ARC is disabled ------------------------------------------------------------------------ File-Level Prefetch: (HEALTHY) DMU Efficiency: 19.90m Hit Ratio: 61.43% 12.23m Miss Ratio: 38.57% 7.68m Colinear: 7.68m Hit Ratio: 0.02% 1.71k Miss Ratio: 99.98% 7.67m Stride: 12.06m Hit Ratio: 99.88% 12.05m Miss Ratio: 0.12% 14.05k DMU Misc: Reclaim: 7.67m Successes: 0.38% 28.93k Failures: 99.62% 7.65m Streams: 175.13k +Resets: 0.21% 376 -Resets: 99.79% 174.76k Bogus: 0 ------------------------------------------------------------------------ VDEV cache is disabled ------------------------------------------------------------------------ ZFS Tunables (sysctl): kern.maxusers 384 vm.kmem_size 8285048832 vm.kmem_size_scale 1 vm.kmem_size_min 0 vm.kmem_size_max 329853485875 vfs.zfs.l2c_only_size 0 vfs.zfs.mfu_ghost_data_lsize 1726464 vfs.zfs.mfu_ghost_metadata_lsize 34827776 vfs.zfs.mfu_ghost_size 36554240 vfs.zfs.mfu_data_lsize 18432 vfs.zfs.mfu_metadata_lsize 93696 vfs.zfs.mfu_size 2208450048 vfs.zfs.mru_ghost_data_lsize 78406144 vfs.zfs.mru_ghost_metadata_lsize 152711168 vfs.zfs.mru_ghost_size 231117312 vfs.zfs.mru_data_lsize 262144 vfs.zfs.mru_metadata_lsize 606208 vfs.zfs.mru_size 33792000 vfs.zfs.anon_data_lsize 0 vfs.zfs.anon_metadata_lsize 0 vfs.zfs.anon_size 1862144 vfs.zfs.l2arc_norw 1 vfs.zfs.l2arc_feed_again 1 vfs.zfs.l2arc_noprefetch 1 vfs.zfs.l2arc_feed_min_ms 200 vfs.zfs.l2arc_feed_secs 1 vfs.zfs.l2arc_headroom 2 vfs.zfs.l2arc_write_boost 8388608 vfs.zfs.l2arc_write_max 8388608 vfs.zfs.arc_meta_limit 536870912 vfs.zfs.arc_meta_used 5638610032 vfs.zfs.arc_min 268435456 vfs.zfs.arc_max 2147483648 vfs.zfs.dedup.prefetch 1 vfs.zfs.mdcomp_disable 0 vfs.zfs.write_limit_override 0 vfs.zfs.write_limit_inflated 25707245568 vfs.zfs.write_limit_max 1071135232 vfs.zfs.write_limit_min 33554432 vfs.zfs.write_limit_shift 3 vfs.zfs.no_write_throttle 0 vfs.zfs.zfetch.array_rd_sz 1048576 vfs.zfs.zfetch.block_cap 256 vfs.zfs.zfetch.min_sec_reap 2 vfs.zfs.zfetch.max_streams 8 vfs.zfs.prefetch_disable 0 vfs.zfs.mg_alloc_failures 12 vfs.zfs.check_hostid 1 vfs.zfs.recover 0 vfs.zfs.txg.synctime_ms 1000 vfs.zfs.txg.timeout 5 vfs.zfs.scrub_limit 10 vfs.zfs.vdev.cache.bshift 16 vfs.zfs.vdev.cache.size 0 vfs.zfs.vdev.cache.max 16384 vfs.zfs.vdev.write_gap_limit 4096 vfs.zfs.vdev.read_gap_limit 32768 vfs.zfs.vdev.aggregation_limit 131072 vfs.zfs.vdev.ramp_rate 2 vfs.zfs.vdev.time_shift 6 vfs.zfs.vdev.min_pending 4 vfs.zfs.vdev.max_pending 10 vfs.zfs.vdev.bio_flush_disable 0 vfs.zfs.cache_flush_disable 0 vfs.zfs.zil_replay_disable 0 vfs.zfs.zio.use_uma 0 vfs.zfs.version.zpl 5 vfs.zfs.version.spa 28 vfs.zfs.version.acl 1 vfs.zfs.debug 0 vfs.zfs.super_owner 0 ------------------------------------------------------------------------ /boot/loader.conf zfs_load=3D"YES" hw.usb.no_boot_wait=3D1 hw.usb.no_pf=3D1 vfs.zfs.arc_max=3D"2048M" Type InUse MemUse HighUse Requests Size(s) cred 576 90K - 899306 64,256 uidinfo 20 5K - 3909 128,2048 plimit 58 15K - 8019 256 acpidev 48 3K - 48 64 GEOM 134 23K - 792 16,32,64,128,256,512,1024,40= 96 sysctltmp 0 0K - 7422 16,32,64,128,256 sysctloid 5542 273K - 5696 16,32,64,128 sysctl 0 0K - 67333 16,32,64 tidhash 1 16K - 1 callout 7 3584K - 7 umtx 2340 293K - 2340 128 p1003.1b 1 1K - 1 16 SWAP 2 549K - 2 64 bus-sc 125 367K - 1014 16,32,128,256,512,2048 bus 731 78K - 4254 16,32,64,128,256,1024,2048 devstat 10 21K - 10 32,4096 eventhandler 74 6K - 74 64,128 acpica 4988 537K - 63439 16,32,64,128,256,512,1024,20= 48 acpitask 1 2K - 1 2048 kobj 81 324K - 139 4096 Per-cpu 1 1K - 1 32 entropy 1024 64K - 1024 64 pci_link 16 2K - 16 16,64,128 rman 224 26K - 630 16,32,128 acpi_perf 8 2K - 8 256 sbuf 1 1K - 1778 16,32,64,128,256,512,1024,2048,4096 CAM dev queue 7 1K - 7 128 acpisem 17 3K - 17 128 stack 0 0K - 4 256 taskqueue 81 8K - 111 16,32,64,128,1024 Unitno 9 1K - 146303 32,64 iov 0 0K - 106876 16,64,128,256,512 select 375 47K - 375 128 ioctlops 0 0K - 241721 16,32,64,128,256,512,1024,2048,4096 msg 4 30K - 4 2048,4096 sem 4 70K - 4 2048,4096 shm 27 72K - 2893 2048 tty 21 21K - 25 1024,2048 pts 4 1K - 4 256 accf 2 1K - 2 64 mbuf_tag 0 0K - 1078495 32,64,128 shmfd 1 8K - 1 CAM queue 25 1K - 87 16,32 pcb 55 158K - 3756 16,32,128,1024,2048,4096 soname 80 10K - 140021 16,32,128 acl 0 0K - 5468 4096 vfscache 1 2048K - 1 vfs_hash 1 1024K - 1 vnodes 4 1K - 4 64,256 USBdev 32 10K - 32 64,128,1024 vnodemarker 0 0K - 11404 512 mount 591 22K - 1634 16,32,64,128,256 BPF 8 1026K - 10 16,128,512 ether_multi 48 3K - 54 16,32,64 ifaddr 66 19K - 66 32,64,128,256,512,2048,4096 ifnet 5 9K - 5 128,2048 USB 56 19K - 56 16,32,128,2048 clone 6 24K - 6 4096 arpcom 1 1K - 1 16 lltable 17 7K - 17 256,512 CAM SIM 7 2K - 7 256 tun 1 1K - 1 256 mirror_data 3 1K - 27 64,128,512 isadev 7 1K - 7 128 routetbl 55 8K - 54541 32,64,128,256,512 igmp 4 1K - 4 256 DEVFS1 108 54K - 114 512 DEVFS3 130 33K - 133 256 cdev 8 2K - 8 256 in_multi 3 1K - 3 256 sctp_iter 0 0K - 5 256 sctp_ifn 3 1K - 3 128 sctp_ifa 7 1K - 7 128 sctp_vrf 1 1K - 1 64 sctp_a_it 0 0K - 5 16 hostcache 1 28K - 1 syncache 1 96K - 1 in6_multi 33 4K - 33 32,256 sigio 1 1K - 1 64 mld 4 1K - 4 128 crypto 18 10K - 139772 64,256,512,1024 xform 0 0K - 6696 16,32 audit_evclass 179 6K - 218 32 vm_pgdata 2 129K - 2 128 UMAHash 2 2K - 3 512,1024 filedesc 309 287K - 56100 16,32,64,128,512,1024,2048,4= 096 kenv 111 13K - 125 16,32,64,128 kqueue 114 129K - 5846 256,512,2048 proc-args 128 8K - 38829 16,32,64,128,256 hhook 2 1K - 2 128 DEVFS 25 1K - 26 16,128 ithread 88 14K - 88 32,128,256 memdesc 1 4K - 1 4096 DEVFSP 1 1K - 1 64 atkbddev 2 1K - 2 64 KTRACE 100 13K - 100 128 kbdmux 6 18K - 6 16,512,1024,2048 linker 61 7K - 71 16,32,64,128,512 lockf 212 19K - 157298 64,128,256 loginclass 3 1K - 485 64 ip6ndp 8 1K - 11 64,128 apmdev 1 1K - 1 128 ip6opt 0 0K - 3 32 temp 56 12K - 1456852 16,32,64,128,256,512,1024,2048,4096 devbuf 6995 19874K - 7014 16,32,64,128,256,512,1024,2048,4096 CAM periph 6 2K - 18 16,32,64,256 module 149 19K - 149 128 CAM XPT 52 33K - 584 32,64,128,1024,2048 qpidrv 1 1K - 1 16 mtx_pool 2 16K - 2 io_apic 1 2K - 1 2048 eli data 10 2K - 19288 64,256,512,1024,2048,4096 osd 20 1K - 236 16,64 acpiintr 1 1K - 1 64 MCA 9 2K - 9 64,128 msi 1 1K - 1 128 nexusdev 5 1K - 5 16 subproc 575 886K - 42983 512,4096 proc 2 16K - 2 session 61 8K - 6412 128 pgrp 75 10K - 17626 128 solaris 2696947 3948549K - 31910129 16,32,64,128,256,512,1024,2048,4096 kstat_data 4 1K - 4 64 dmesg: Copyright (c) 1992-2012 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 9.0-RELEASE #1: Fri Jan 20 22:23:20 CET 2012 claudius@server.ambtec.de:/usr/obj/usr/src/sys/CUSTOM amd64 CPU: Intel(R) Core(TM) i7 CPU 920 @ 2.67GHz (2673.35-MHz K8-class CPU) Origin =3D "GenuineIntel" Id =3D 0x106a5 Family =3D 6 Model =3D 1a Stepping =3D 5 Features=3D0xbfebfbff Features2=3D0x98e3bd AMD Features=3D0x28100800 AMD Features2=3D0x1 TSC: P-state invariant, performance statistics real memory =3D 8589934592 (8192 MB) avail memory =3D 8230801408 (7849 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: <7522MS A7522800> FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 cpu4 (AP): APIC ID: 4 cpu5 (AP): APIC ID: 5 cpu6 (AP): APIC ID: 6 cpu7 (AP): APIC ID: 7 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 cryptosoft0: on motherboard acpi0: <7522MS A7522800> on motherboard acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, bff00000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 ACPI Warning: Incorrect checksum in table [OEMB] - 0xBB, should be 0xBA (20110527/tbutils-282) cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 cpu4: on acpi0 cpu5: on acpi0 cpu6: on acpi0 cpu7: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pcib2: at device 3.0 on pci0 pci2: on pcib2 vgapci0: port 0xcc00-0xcc7f mem 0xfa000000-0xfaffffff,0xd0000000-0xdfffffff,0xf8000000-0xf9ffffff irq 16 at device 0.0 on pci2 pcib3: at device 7.0 on pci0 pci3: on pcib3 pci0: at device 20.0 (no driver attached) pci0: at device 20.1 (no driver attached) pci0: at device 20.2 (no driver attached) pci0: at device 20.3 (no driver attached) uhci0: port 0xbc00-0xbc1f irq 16 at device 26.0 on pci0 usbus0: on uhci0 uhci1: port 0xb880-0xb89f irq 21 at device 26.1 on pci0 usbus1: on uhci1 uhci2: port 0xb800-0xb81f irq 19 at device 26.2 on pci0 usbus2: on uhci2 ehci0: mem 0xf7ffe000-0xf7ffe3ff irq 18 at device 26.7 on pci0 usbus3: EHCI version 1.0 usbus3: on ehci0 pcib4: irq 17 at device 28.0 on pci0 pci4: on pcib4 pcib5: irq 17 at device 28.4 on pci0 pci6: on pcib5 re0: port 0xe800-0xe8ff mem 0xfbeff000-0xfbefffff,0xf6ff0000-0xf6ffffff irq 16 at device 0.0 on pci6 re0: Using 1 MSI-X message re0: Chip rev. 0x3c000000 re0: MAC rev. 0x00400000 miibus0: on re0 rgephy0: PHY 1 on miibus= 0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Ethernet address: 40:61:86:2b:86:aa uhci3: port 0xb480-0xb49f irq 23 at device 29.0 on pci0 usbus4: on uhci3 uhci4: port 0xb400-0xb41f irq 19 at device 29.1 on pci0 usbus5: on uhci4 uhci5: port 0xb080-0xb09f irq 18 at device 29.2 on pci0 usbus6: on uhci5 ehci1: mem 0xf7ffc000-0xf7ffc3ff irq 23 at device 29.7 on pci0 usbus7: EHCI version 1.0 usbus7: on ehci1 pcib6: at device 30.0 on pci0 pci7: on pcib6 isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0xb000-0xb007,0xac00-0xac03,0xa880-0xa887,0xa800-0xa803,0xa480-0xa49f mem 0xf7ffa000-0xf7ffa7ff irq 19 at device 31.2 on pci0 atapci0: AHCI v1.20 controller with 6 3Gbps ports, PM not supported ata2: on atapci0 ata3: on atapci0 ata4: on atapci0 ata5: on atapci0 ata6: on atapci0 ata7: on atapci0 pci0: at device 31.3 (no driver attached) acpi_button0: on acpi0 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 450 Event timer "HPET1" frequency 14318180 Hz quality 440 Event timer "HPET2" frequency 14318180 Hz quality 440 Event timer "HPET3" frequency 14318180 Hz quality 440 qpi0: on motherboard pcib7: pcibus 255 on qpi0 pci255: on pcib7 orm0: at iomem 0xce800-0xcf7ff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=3D0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0= coretemp0: on cpu0 est0: on cpu0 p4tcc0: on cpu0 coretemp1: on cpu1 est1: on cpu1 p4tcc1: on cpu1 coretemp2: on cpu2 est2: on cpu2 p4tcc2: on cpu2 coretemp3: on cpu3 est3: on cpu3 p4tcc3: on cpu3 coretemp4: on cpu4 est4: on cpu4 p4tcc4: on cpu4 coretemp5: on cpu5 est5: on cpu5 p4tcc5: on cpu5 coretemp6: on cpu6 est6: on cpu6 p4tcc6: on cpu6 coretemp7: on cpu7 est7: on cpu7 p4tcc7: on cpu7 ZFS filesystem version 5 ZFS storage pool version 28 Timecounters tick every 1.000 msec usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 12Mbps Full Speed USB v1.0 usbus3: 480Mbps High Speed USB v2.0 usbus4: 12Mbps Full Speed USB v1.0 usbus5: 12Mbps Full Speed USB v1.0 usbus6: 12Mbps Full Speed USB v1.0 usbus7: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 ugen3.1: at usbus3 uhub3: on usbus3 ugen4.1: at usbus4 uhub4: on usbus4 ugen5.1: at usbus5 uhub5: on usbus5 ugen6.1: at usbus6 uhub6: on usbus6 ugen7.1: at usbus7 uhub7: on usbus7 uhub0: 2 ports with 2 removable, self powered uhub1: 2 ports with 2 removable, self powered uhub2: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered uhub5: 2 ports with 2 removable, self powered uhub6: 2 ports with 2 removable, self powered ada0 at ata2 bus 0 scbus0 target 0 lun 0 ada0: ATA-7 SATA 2.x device ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada0: 715404MB (1465149168 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad0 ada1 at ata3 bus 0 scbus1 target 0 lun 0 ada1: ATA-7 SATA 2.x device ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes) ada1: 715404MB (1465149168 512 byte sectors: 16H 63S/T 16383C) ada1: Previously was known as ad1 SMP: AP CPU #1 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #3 Launched! SMP: AP CPU #4 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #6 Launched! uhub3: 6 ports with 6 removable, self powered uhub7: 6 ports with 6 removable, self powered GEOM_MIRROR: Device mirror/swap launched (2/2). Trying to mount root from zfs:zpool/rootfs [rw,noatime]... GEOM_ELI: Device mirror/swap.eli created. GEOM_ELI: Encryption: AES-XTS 256 GEOM_ELI: Crypto: software --------------enig06918E1878A4A49BFC2E5262 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk8aFWQACgkQum7BwTrPFfEpVwCbBTdEypIRJMQs2gL+MXn+xyY9 Y80AoMABd41pv9kLgJlBvSkGabU1aGmH =QEhj -----END PGP SIGNATURE----- --------------enig06918E1878A4A49BFC2E5262--