From owner-freebsd-current@FreeBSD.ORG Thu Dec 19 04:52:57 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D2076E7F for ; Thu, 19 Dec 2013 04:52:57 +0000 (UTC) Received: from hydra.pix.net (hydra.pix.net [IPv6:2001:470:e254::3c]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id B197D1877 for ; Thu, 19 Dec 2013 04:52:56 +0000 (UTC) Received: from torb.pix.net (torb.pix.net [IPv6:2001:470:e254:10:12dd:b1ff:febf:eca9]) (authenticated bits=0) by hydra.pix.net (8.14.5/8.14.5) with ESMTP id rBJ4qss3001739; Wed, 18 Dec 2013 23:52:54 -0500 (EST) (envelope-from lidl@pix.net) X-Virus-Status: Clean X-Virus-Scanned: clamav-milter 0.98 at mail.pix.net Message-ID: <52B27BA6.5020500@pix.net> Date: Wed, 18 Dec 2013 23:52:54 -0500 From: Kurt Lidl User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.8; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: FreeBSD-Current Subject: panic with deactivated geom mirror (both 9.2 and 10.0-RC2) Content-Type: multipart/mixed; boundary="------------010909060205050007050701" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Dec 2013 04:52:57 -0000 This is a multi-part message in MIME format. --------------010909060205050007050701 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Greetings all - I've got a completely reproducible panic when issuing a 'gmirror status' command on a recently deactivated gmirror. NOTE: This only happens on a machine with more than 1 CPU. I filed a bug report on it: http://www.freebsd.org/cgi/query-pr.cgi?pr=184985 Script to reproduce the panic: (assumes /dev/ada0p3 is a scratch partition) while : do gmirror label -v scratch /dev/ada0p3 newfs /dev/mirror/scratch mount /dev/mirror/scratch /mnt umount -f /mnt gmirror deactivate scratch /dev/ada0p3 gmirror status scratch done I've attached the core.txt.0 file from the crash under 10.0-RC2. Probably stripped by the mailing list. A copy is at http://www.pix.net/staff/lidl/freebsd/core.txt.0 -Kurt --------------010909060205050007050701 Content-Type: text/plain; charset=UTF-8; x-mac-type="0"; x-mac-creator="0"; name="core.txt.0" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="core.txt.0" b524-fbsd10rc2.pix.net dumped core - see /var/crash/vmcore.0 Wed Dec 18 23:23:12 UTC 2013 FreeBSD b524-fbsd10rc2.pix.net 10.0-RC2 FreeBSD 10.0-RC2 #0 r259404: Sun Dec 15 08:18:20 UTC 2013 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 panic: page fault GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: GEOM_MIRROR: Device scratch: provider ada0p3 disconnected. GEOM_MIRROR: Device scratch: provider mirror/scratch destroyed. GEOM_MIRROR: Device scratch destroyed. Fatal trap 12: page fault while in kernel mode cpuid = 1; apic id = 01 fault virtual address = 0x378 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff808b78c6 stack pointer = 0x28:0xfffffe001ddfea10 frame pointer = 0x28:0xfffffe001ddfeab0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13 (g_event) trap number = 12 panic: page fault cpuid = 1 KDB: stack backtrace: #0 0xffffffff808e7d60 at kdb_backtrace+0x60 #1 0xffffffff808af845 at panic+0x155 #2 0xffffffff80c8e612 at trap_fatal+0x3a2 #3 0xffffffff80c8e8e9 at trap_pfault+0x2c9 #4 0xffffffff80c8e076 at trap+0x5e6 #5 0xffffffff80c75312 at calltrap+0x8 #6 0xffffffff808b7442 at _sx_xlock+0x62 #7 0xffffffff81a371bf at g_mirror_dumpconf+0x12f #8 0xffffffff8081a35c at g_conf_specific+0x14c #9 0xffffffff8081acd6 at g_run_events+0x166 #10 0xffffffff8088191a at fork_exit+0x9a #11 0xffffffff80c7584e at fork_trampoline+0xe Uptime: 33s Dumping 78 out of 487 MB:..21%..41%..61%..82% Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done. Loaded symbols for /boot/kernel/geom_mirror.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:219 #1 0xffffffff808af4c0 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:447 #2 0xffffffff808af884 in panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:754 #3 0xffffffff80c8e612 in trap_fatal (frame=, eva=) at /usr/src/sys/amd64/amd64/trap.c:882 #4 0xffffffff80c8e8e9 in trap_pfault (frame=0xfffffe001ddfe960, usermode=0) at /usr/src/sys/amd64/amd64/trap.c:699 #5 0xffffffff80c8e076 in trap (frame=0xfffffe001ddfe960) at /usr/src/sys/amd64/amd64/trap.c:463 #6 0xffffffff80c75312 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:232 #7 0xffffffff808b78c6 in _sx_xlock_hard (sx=0xfffff80018321240, tid=18446735277652013056, opts=, file=0x2beff0
, line=0) at /usr/src/sys/kern/kern_sx.c:556 #8 0xffffffff808b7442 in _sx_xlock (sx=0x2beff0, opts=0, file=, line=2879472) at sx.h:152 #9 0xffffffff81a371bf in g_mirror_dumpconf (sb=0xfffff80018310540, indent=0xffffffff80ea9f7d "\t", gp=, cp=, pp=) at /usr/src/sys/modules/geom/geom_mirror/../../../geom/mirror/g_mirror.c:3202 #10 0xffffffff8081a35c in g_conf_specific (sb=0xfffff80018310540, mp=0x0, gp=0x0, pp=0x0, cp=0x0) at /usr/src/sys/geom/geom_dump.c:238 #11 0xffffffff8081acd6 in g_run_events () at /usr/src/sys/geom/geom_event.c:257 #12 0xffffffff8088191a in fork_exit ( callout=0xffffffff8081c8e0 , arg=0x0, frame=0xfffffe001ddfec00) at /usr/src/sys/kern/kern_fork.c:995 #13 0xffffffff80c7584e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:606 #14 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) ------------------------------------------------------------------------ ps -axl UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND ------------------------------------------------------------------------ vmstat -s 34704 cpu context switches 2842 device interrupts 833 software interrupts 61253 traps 77805 system calls 21 kernel threads created 679 fork() calls 155 vfork() calls 0 rfork() calls 0 swap pager pageins 0 swap pager pages paged in 0 swap pager pageouts 0 swap pager pages paged out 506 vnode pager pageins 3207 vnode pager pages paged in 0 vnode pager pageouts 0 vnode pager pages paged out 0 page daemon wakeups 0 pages examined by the page daemon 0 pages reactivated 24864 copy-on-write faults 157 copy-on-write optimized faults 24508 zero fill pages zeroed 0 zero fill pages prezeroed 0 intransit blocking page faults 57256 total VM faults taken 395 page faults requiring I/O 0 pages affected by kernel thread creation 24950 pages affected by fork() 5664 pages affected by vfork() 0 pages affected by rfork() 0 pages cached 82645 pages freed 0 pages freed by daemon 0 pages freed by exiting processes 4212 pages active 3427 pages inactive 0 pages in VM cache 13004 pages wired down 100503 pages free 4096 bytes per page 23482 total name lookups cache hits (82% pos + 11% neg) system 0% per-directory deletions 0%, falsehits 0%, toolong 0% ------------------------------------------------------------------------ vmstat -m Type InUse MemUse HighUse Requests Size(s) cdev 8 2K - 8 256 entropy 1026 65K - 1028 32,64,4096 CAM SIM 3 1K - 3 256 filedesc 47 93K - 858 16,2048,4096 sigio 1 1K - 1 64 filecaps 1 1K - 5 16,64 kdtrace 268 59K - 1218 64,256 kenv 74 11K - 83 16,32,64,128 kqueue 0 0K - 54 256,2048 proc-args 28 2K - 295 16,32,64,128,256 kbdmux 6 18K - 6 16,512,1024,2048 hhook 2 1K - 2 256 ithread 61 11K - 61 32,128,256 LED 2 1K - 2 16,128 KTRACE 100 13K - 100 128 CAM XPT 22 2K - 112 32,64,128,256,1024 scsi_cd 0 0K - 12 16 linker 163 14K - 174 16,32,64,128,512 lockf 20 3K - 64 64,128 loginclass 3 1K - 13 64 devbuf 336 1249K - 394 16,32,64,128,256,512,1024,2048,4096 temp 12 17K - 793 16,32,64,128,256,1024,2048 ip6ndp 3 1K - 3 64,128 module 481 61K - 481 128 mtx_pool 2 16K - 2 osd 5 1K - 13 16,32,64 pmchooks 1 1K - 1 128 pgrp 24 3K - 33 128 session 21 3K - 23 128 proc 2 8K - 2 4096 subproc 98 210K - 909 512,4096 cred 64 10K - 3016 64,256 plimit 14 4K - 171 256 uidinfo 5 2K - 9 128,1024 ac97 2 1K - 2 16,512 md_disk 1 2K - 1 2048 CAM DEV 5 10K - 10 2048 pci_link 8 1K - 8 16,128 sysctl 0 0K - 196 16,32,64 sysctloid 2273 113K - 2306 16,32,64,128 sysctltmp 0 0K - 101 16,32,64,128 tidhash 1 8K - 1 callout 3 1672K - 3 umtx 450 57K - 450 128 p1003.1b 1 1K - 1 16 SWAP 2 277K - 2 64 bus 949 78K - 2745 16,32,64,128,256,1024 bus-sc 30 32K - 1250 16,32,64,128,256,512,1024,2048,4096 devstat 8 17K - 8 32,4096 eventhandler 95 8K - 95 64,128 kobj 329 1316K - 790 4096 Per-cpu 1 1K - 1 32 DEVFS3 108 27K - 153 256 DEVFS1 82 41K - 103 512 rman 90 11K - 476 32,128 sbuf 2 1K - 2437 16,32,64,128,256,512,1024,2048,4096 DEVFS 15 1K - 16 16,32,128 DEVFSP 2 1K - 2 64 taskqueue 57 10K - 87 16,32,64,256,1024 Unitno 20 2K - 202 32,64 vmem 3 13K - 3 256,4096 ioctlops 0 0K - 732 16,32,64,128,256,512,1024 select 13 2K - 13 128 iov 0 0K - 231 16,64,128,256,512 msg 4 30K - 4 2048,4096 sem 4 106K - 4 2048,4096 shm 1 20K - 1 tty 18 18K - 18 1024 pts 1 1K - 1 256 mbuf_tag 0 0K - 21 32 shmfd 1 8K - 1 soname 3 1K - 5090 16,32,128 pcb 16 213K - 77 16,32,128,1024,2048 vfscache 1 512K - 1 vfs_hash 1 256K - 1 vnodes 1 1K - 1 256 mount 71 3K - 227 16,32,64,128,256 vnodemarker 0 0K - 53 512 BPF 10 18K - 10 128,512,4096 ifnet 3 5K - 3 128,2048 ifaddr 34 13K - 35 32,64,128,256,512,2048,4096 ether_multi 17 1K - 24 16,32,64 clone 7 1K - 7 128 arpcom 1 1K - 1 16 lltable 10 4K - 10 256,512 routetbl 38 6K - 127 32,64,128,256,512 igmp 2 1K - 2 256 in_multi 2 1K - 3 256 sctp_a_it 0 0K - 3 16 sctp_vrf 1 1K - 1 64 sctp_ifa 4 1K - 4 128 sctp_ifn 2 1K - 2 128 sctp_iter 0 0K - 3 256 hostcache 1 28K - 1 syncache 1 64K - 1 in6_multi 15 2K - 15 32,256 mld 2 1K - 2 128 NFS FHA 1 2K - 1 2048 rpc 2 1K - 2 256 audit_evclass 187 6K - 228 32 pagedep 6 34K - 7 256 inodedep 5 258K - 11 512 bmsafemap 1 8K - 10 256 newblk 5 513K - 7 256 freeblks 0 0K - 2 256 freefile 0 0K - 5 64 diradd 4 1K - 9 128 mkdir 4 1K - 10 128 dirrem 0 0K - 5 128 newdirblk 4 1K - 5 64 freework 1 1K - 3 32,128 savedino 0 0K - 5 256 ufs_quota 1 256K - 1 ufs_mount 3 13K - 12 512,4096 vm_pgdata 2 65K - 2 128 pfs_nodes 21 6K - 21 256 GEOM 127 21K - 1889 16,32,64,128,256,512,1024,2048,4096 feeder 12 1K - 14 32,128 atkbddev 2 1K - 2 64 CAM CCB 2 4K - 10 2048 mixer 1 4K - 1 4096 raid_data 0 0K - 282 32,128,256 acpiintr 1 1K - 1 64 md_nvidia_data 0 0K - 45 512 acpica 2076 233K - 21299 16,32,64,128,256,1024,4096 md_sii_data 0 0K - 45 512 CAM path 7 1K - 29 32 CAM periph 6 2K - 20 16,32,64,128,256 acpitask 1 8K - 1 apmdev 1 1K - 1 128 madt_table 0 0K - 1 4096 ata_pci 1 1K - 1 64 acpisem 17 3K - 17 128 CAM queue 11 3K - 38 16,32,512 acpidev 25 2K - 25 64 CAM dev queue 3 1K - 3 32 io_apic 1 2K - 1 2048 MCA 2 1K - 2 128 nexusdev 3 1K - 3 16 isadev 9 2K - 9 128 solaris 8487 23671K - 88924 16,32,64,128,256,512,1024,2048,4096 kstat_data 6 1K - 6 64 mirror_data 2 1K - 38 64,128,512 ------------------------------------------------------------------------ vmstat -z ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP UMA Kegs: 384, 0, 106, 4, 106, 0, 0 UMA Zones: 896, 0, 106, 2, 106, 0, 0 UMA Slabs: 80, 0, 1741, 59, 3427, 0, 0 UMA RCntSlabs: 88, 0, 253, 17, 253, 0, 0 UMA Hash: 256, 0, 9, 6, 9, 0, 0 4 Bucket: 32, 0, 10, 365, 2157, 0, 0 8 Bucket: 64, 0, 13, 297, 269, 0, 0 16 Bucket: 128, 0, 49, 230, 378, 36, 0 32 Bucket: 256, 0, 26, 109, 118, 100, 0 64 Bucket: 512, 0, 49, 39, 212, 98, 0 128 Bucket: 1024, 0, 84, 36, 344, 10, 0 vmem btag: 56, 0, 1207, 142, 1313, 19, 0 VM OBJECT: 256, 0, 1128, 102, 9866, 0, 0 RADIX NODE: 144, 0, 1866, 159, 22909, 49, 0 MAP: 240, 0, 3, 61, 3, 0, 0 KMAP ENTRY: 128, 0, 4, 151, 4, 0, 0 MAP ENTRY: 128, 0, 818, 329, 22636, 0, 0 VMSPACE: 448, 0, 28, 62, 836, 0, 0 fakepg: 104, 0, 0, 0, 0, 0, 0 mt_zone: 4112, 0, 346, 0, 346, 0, 0 16: 16, 0, 1872, 136, 30293, 0, 0 32: 32, 0, 1724, 276, 8894, 0, 0 64: 64, 0, 6240, 332, 30144, 0, 0 128: 128, 0, 5338, 304, 35069, 0, 0 256: 256, 0, 1268, 322, 8020, 0, 0 512: 512, 0, 951, 65, 15920, 0, 0 1024: 1024, 0, 123, 53, 5590, 0, 0 2048: 2048, 0, 150, 16, 1255, 0, 0 4096: 4096, 0, 558, 14, 3722, 0, 0 SLEEPQUEUE: 80, 0, 226, 177, 226, 0, 0 uint64 pcpu: 8, 0, 1332, 76, 1332, 0, 0 Files: 80, 0, 69, 181, 4703, 0, 0 TURNSTILE: 136, 0, 226, 94, 226, 0, 0 rl_entry: 40, 0, 19, 281, 19, 0, 0 umtx pi: 96, 0, 0, 0, 0, 0, 0 MAC labels: 40, 0, 0, 0, 0, 0, 0 PROC: 1208, 0, 45, 6, 855, 0, 0 THREAD: 1168, 0, 221, 4, 361, 0, 0 cpuset: 72, 0, 191, 194, 334, 0, 0 audit_record: 1248, 0, 0, 0, 0, 0, 0 mbuf_packet: 256, 194025, 256, 253, 630, 0, 0 mbuf: 256, 194025, 1, 264, 888, 6, 0 mbuf_cluster: 2048, 30314, 500, 0, 500, 0, 0 mbuf_jumbo_page: 4096, 15157, 0, 3, 7, 0, 0 mbuf_jumbo_9k: 9216, 13473, 0, 0, 0, 0, 0 mbuf_jumbo_16k: 16384, 10104, 0, 0, 0, 0, 0 mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0 g_bio: 248, 0, 0, 192, 9723, 0, 0 ttyinq: 160, 0, 135, 65, 270, 0, 0 ttyoutq: 256, 0, 72, 63, 144, 0, 0 ata_request: 336, 0, 1, 87, 5529, 0, 0 vtnet_tx_hdr: 24, 0, 0, 0, 0, 0, 0 FPU_save_area: 512, 0, 0, 0, 0, 0, 0 taskq_zone: 48, 0, 0, 166, 24, 0, 0 VNODE: 472, 0, 546, 38, 584, 0, 0 VNODEPOLL: 112, 0, 0, 0, 0, 0, 0 BUF TRIE: 144, 0, 5, 3802, 32, 0, 0 NAMEI: 1024, 0, 0, 40, 10575, 0, 0 S VFS Cache: 108, 0, 509, 121, 1167, 0, 0 STS VFS Cache: 148, 0, 0, 0, 0, 0, 0 L VFS Cache: 328, 0, 0, 0, 0, 0, 0 LTS VFS Cache: 368, 0, 0, 0, 0, 0, 0 NCLNODE: 528, 0, 0, 0, 0, 0, 0 DIRHASH: 1024, 0, 0, 0, 0, 0, 0 space_seg_cache: 64, 0, 209, 349, 1416, 0, 0 zio_cache: 944, 0, 1, 275, 23322, 0, 0 zio_link_cache: 48, 0, 0, 581, 8108, 0, 0 sa_cache: 80, 0, 494, 156, 518, 0, 0 dnode_t: 864, 0, 672, 20, 969, 0, 0 dmu_buf_impl_t: 224, 0, 1330, 13, 1440, 0, 0 arc_buf_hdr_t: 216, 0, 802, 62, 869, 0, 0 arc_buf_t: 72, 0, 775, 105, 901, 0, 0 zil_lwb_cache: 192, 0, 8, 132, 19, 0, 0 zfs_znode_cache: 368, 0, 494, 36, 518, 0, 0 Mountpoints: 816, 0, 7, 23, 10, 0, 0 pipe: 744, 0, 3, 27, 446, 0, 0 procdesc: 128, 0, 0, 0, 0, 0, 0 ksiginfo: 112, 0, 42, 1008, 43, 0, 0 itimer: 352, 0, 0, 33, 1, 0, 0 KNOTE: 128, 0, 0, 279, 54, 0, 0 socket: 696, 15585, 16, 24, 983, 0, 0 ipq: 56, 994, 0, 0, 0, 0, 0 udp_inpcb: 392, 15590, 2, 58, 146, 0, 0 udpcb: 16, 15813, 2, 249, 146, 0, 0 tcp_inpcb: 392, 15590, 4, 56, 11, 0, 0 tcpcb: 1024, 15588, 4, 24, 11, 0, 0 tcptw: 88, 3150, 0, 0, 0, 0, 0 syncache: 160, 15375, 0, 75, 1, 0, 0 hostcache: 136, 15370, 0, 0, 0, 0, 0 tcpreass: 40, 1900, 0, 0, 0, 0, 0 sackhole: 32, 0, 0, 0, 0, 0, 0 sctp_ep: 1408, 15586, 0, 0, 0, 0, 0 sctp_asoc: 2352, 40000, 0, 0, 0, 0, 0 sctp_laddr: 48, 80012, 0, 332, 3, 0, 0 sctp_raddr: 728, 80000, 0, 0, 0, 0, 0 sctp_chunk: 136, 400026, 0, 0, 0, 0, 0 sctp_readq: 104, 400026, 0, 0, 0, 0, 0 sctp_stream_msg_out: 104, 400026, 0, 0, 0, 0, 0 sctp_asconf: 40, 400000, 0, 0, 0, 0, 0 sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0 ripcb: 392, 15590, 1, 29, 1, 0, 0 unpcb: 240, 15600, 8, 120, 812, 0, 0 rtentry: 200, 0, 17, 123, 18, 0, 0 selfd: 56, 0, 28, 256, 2254, 0, 0 SWAPMETA: 288, 60632, 0, 0, 0, 0, 0 FFS inode: 168, 0, 5, 133, 13, 0, 0 FFS1 dinode: 128, 0, 0, 0, 0, 0, 0 FFS2 dinode: 256, 0, 5, 130, 13, 0, 0 ------------------------------------------------------------------------ vmstat -i interrupt total rate irq1: atkbd0 7 0 irq14: ata0 2310 210 irq15: ata1 69 6 irq19: em0 456 41 cpu0:timer 1509 137 cpu1:timer 573 52 Total 4924 447 ------------------------------------------------------------------------ pstat -T 69/15585 files 0M/2047M swap space ------------------------------------------------------------------------ pstat -s Device 512-blocks Used Avail Capacity /dev/mirror/gswap 4194040 0 4194040 0% ------------------------------------------------------------------------ iostat iostat: kvm_read(_tk_nin): invalid address (0x0) iostat: disabling TTY statistics md0 ada0 cd0 cpu KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id 0.00 10 0.00 19.18 199 3.73 0.00 2 0.00 1 0 4 0 95 ------------------------------------------------------------------------ ipcs -a Message Queues: T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME Shared Memory: T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME Semaphores: T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME ------------------------------------------------------------------------ ipcs -T msginfo: msgmax: 16384 (max characters in a message) msgmni: 40 (# of message queues) msgmnb: 2048 (max characters in a message queue) msgtql: 40 (max # of messages in system) msgssz: 8 (size of a message segment) msgseg: 2048 (# of message segments in system) shminfo: shmmax: 536870912 (max shared memory segment size) shmmin: 1 (min shared memory segment size) shmmni: 192 (max number of shared memory identifiers) shmseg: 128 (max shared memory segments per process) shmall: 131072 (max amount of shared memory in pages) seminfo: semmni: 50 (# of semaphore identifiers) semmns: 340 (# of semaphores in system) semmnu: 150 (# of undo structures in system) semmsl: 340 (max # of semaphores per id) semopm: 100 (max # of operations per semop call) semume: 50 (max # of undo entries per process) semusz: 632 (size in bytes of undo structure) semvmx: 32767 (semaphore maximum value) semaem: 16384 (adjust on exit max value) ------------------------------------------------------------------------ nfsstat Client Info: Rpc Counts: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Rpc Info: TimedOut Invalid X Replies Retries Requests 0 0 0 0 0 Cache Info: Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits Misses 0 0 0 0 0 0 0 0 BioRLHits Misses BioD Hits Misses DirE Hits Misses Accs Hits Misses 0 0 0 0 0 0 0 0 Server Info: Getattr Setattr Lookup Readlink Read Write Create Remove 0 0 0 0 0 0 0 0 Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access 0 0 0 0 0 0 0 0 Mknod Fsstat Fsinfo PathConf Commit 0 0 0 0 0 Server Ret-Failed 0 Server Faults 0 Server Cache Stats: Inprog Idem Non-idem Misses 0 0 0 0 Server Write Gathering: WriteOps WriteRPC Opsaved 0 0 0 ------------------------------------------------------------------------ netstat -s tcp: 149 packets sent 144 data packets (12383 bytes) 0 data packets (0 bytes) retransmitted 0 data packets unnecessarily retransmitted 0 resends initiated by MTU discovery 5 ack-only packets (4 delayed) 0 URG only packets 0 window probe packets 0 window update packets 0 control packets 224 packets received 145 acks (for 12384 bytes) 0 duplicate acks 0 acks for unsent data 79 packets (5717 bytes) received in-sequence 0 completely duplicate packets (0 bytes) 0 old duplicate packets 0 packets with some dup. data (0 bytes duped) 0 out-of-order packets (0 bytes) 0 packets (0 bytes) of data after window 0 window probes 0 window update packets 0 packets received after close 0 discarded for bad checksums 0 discarded for bad header offset fields 0 discarded because packet too short 0 discarded due to memory problems 0 connection requests 1 connection accept 0 bad connection attempts 0 listen queue overflows 0 ignored RSTs in the windows 1 connection established (including accepts) 7 connections closed (including 0 drops) 0 connections updated cached RTT on close 0 connections updated cached RTT variance on close 0 connections updated cached ssthresh on close 0 embryonic connections dropped 145 segments updated rtt (of 133 attempts) 0 retransmit timeouts 0 connections dropped by rexmit timeout 0 persist timeouts 0 connections dropped by persist timeout 0 Connections (fin_wait_2) dropped because of timeout 0 keepalive timeouts 0 keepalive probes sent 0 connections dropped by keepalive 15 correct ACK header predictions 3 correct data packet header predictions 1 syncache entry added 0 retransmitted 0 dupsyn 0 dropped 1 completed 0 bucket overflow 0 cache overflow 0 reset 0 stale 0 aborted 0 badack 0 unreach 0 zone failures 1 cookie sent 0 cookies received 0 hostcache entries added 0 bucket overflow 0 SACK recovery episodes 0 segment rexmits in SACK recovery episodes 0 byte rexmits in SACK recovery episodes 0 SACK options (SACK blocks) received 0 SACK options (SACK blocks) sent 0 SACK scoreboard overflow 0 packets with ECN CE bit set 0 packets with ECN ECT(0) bit set 0 packets with ECN ECT(1) bit set 0 successful ECN handshakes 0 times ECN reduced the congestion window udp: 43 datagrams received 0 with incomplete header 0 with bad data length field 0 with bad checksum 0 with no checksum 1 dropped due to no socket 3 broadcast/multicast datagrams undelivered 0 dropped due to full socket buffers 0 not for hashed pcb 39 delivered 40 datagrams output 0 times multicast source filter matched ip: 292 total packets received 0 bad header checksums 0 with size smaller than minimum 0 with data size < data length 0 with ip length > max ip packet size 0 with header length < data size 0 with data length < header length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 packets reassembled ok 267 packets for this host 9 packets for unknown/unsupported protocol 0 packets forwarded (0 packets fast forwarded) 16 packets not forwardable 0 packets received for unknown multicast group 0 redirects sent 190 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 0 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 tunneling packets that can't find gif 0 datagrams with bad address in header icmp: 1 call to icmp_error 0 errors not generated in response to an icmp message Output histogram: destination unreachable: 1 0 messages with bad code fields 0 messages less than the minimum length 0 messages with bad checksum 0 messages with bad length 0 multicast echo requests ignored 0 multicast timestamp requests ignored 0 message responses generated 0 invalid return addresses 0 no return routes igmp: 0 messages received 0 messages received with too few bytes 0 messages received with wrong TTL 0 messages received with bad checksum 0 V1/V2 membership queries received 0 V3 membership queries received 0 membership queries received with invalid field(s) 0 general queries received 0 group queries received 0 group-source queries received 0 group-source queries dropped 0 membership reports received 0 membership reports received with invalid field(s) 0 membership reports received for groups to which we belong 0 V3 reports received without Router Alert 0 membership reports sent arp: 4 ARP requests sent 0 ARP replies sent 0 ARP requests received 3 ARP replies received 7 ARP packets received 0 total packets dropped due to no ARP entry 0 ARP entrys timed out 0 Duplicate IPs seen ip6: 0 total packets received 0 with size smaller than minimum 0 with data size < data length 0 with bad options 0 with incorrect version number 0 fragments received 0 fragments dropped (dup or out of space) 0 fragments dropped after timeout 0 fragments that exceeded limit 0 packets reassembled ok 0 packets for this host 0 packets forwarded 0 packets not forwardable 0 redirects sent 0 packets sent from this host 0 packets sent with fabricated ip header 0 output packets dropped due to no bufs, etc. 7 output packets discarded due to no route 0 output datagrams fragmented 0 fragments created 0 datagrams that can't be fragmented 0 packets that violated scope rules 0 multicast packets which we don't join Mbuf statistics: 0 one mbuf 0 one ext mbuf 0 two or more ext mbuf 0 packets whose headers are not contiguous 0 tunneling packets that can't find gif 0 packets discarded because of too many headers 0 failures of source address selection Source addresses selection rule applied: icmp6: 0 calls to icmp6_error 0 errors not generated in response to an icmp6 message 0 errors not generated because of rate limitation 0 messages with bad code fields 0 messages < minimum length 0 bad checksums 0 messages with bad length Histogram of error messages to be generated: 0 no route 0 administratively prohibited 0 beyond scope 0 address unreachable 0 port unreachable 0 packet too big 0 time exceed transit 0 time exceed reassembly 0 erroneous header field 0 unrecognized next header 0 unrecognized option 0 redirect 0 unknown 0 message responses generated 0 messages with too many ND options 0 messages with bad ND options 0 bad neighbor solicitation messages 0 bad neighbor advertisement messages 0 bad router solicitation messages 0 bad router advertisement messages 0 bad redirect messages 0 path MTU changes rip6: 0 messages received 0 checksum calculations on inbound 0 messages with bad checksum 0 messages dropped due to no socket 0 multicast messages dropped due to no socket 0 messages dropped due to full socket buffers 0 delivered 0 datagrams output ------------------------------------------------------------------------ netstat -m 257/517/774 mbufs in use (current/cache/total) 247/253/500/30314 mbuf clusters in use (current/cache/total/max) 256/253 mbuf+clusters out of packet secondary zone in use (current/cache) 0/3/3/15157 4k (page size) jumbo clusters in use (current/cache/total/max) 0/0/0/13473 9k jumbo clusters in use (current/cache/total/max) 0/0/0/10104 16k jumbo clusters in use (current/cache/total/max) 558K/647K/1205K bytes allocated to network (current/cache/total) 6/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile ------------------------------------------------------------------------ netstat -idW Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll Drop em0 1500 08:00:27:6d:55:34 299 0 0 195 0 0 0 em0 1500 192.168.16.0 dhcp213 274 - - 190 - - - lo0 16384 0 0 0 0 0 0 0 lo0 16384 localhost ::1 0 - - 0 - - - lo0 16384 fe80::1%lo0 fe80::1 0 - - 0 - - - lo0 16384 your-net localhost 0 - - 0 - - - ------------------------------------------------------------------------ netstat -anr Routing tables Internet: Destination Gateway Flags Refs Use Netif Expire default 192.168.16.1 UGS 0 14 em0 71.178.232.3/32 192.168.16.3 UGS 0 0 em0 71.178.232.4/32 192.168.16.4 UGS 0 0 em0 71.178.232.5/32 192.168.16.5 UGS 0 0 em0 71.178.232.6/32 192.168.16.6 UGS 0 0 em0 127.0.0.1 link#2 UH 0 0 lo0 192.168.16.0/24 link#1 U 0 176 em0 192.168.16.213 link#1 UHS 0 0 lo0 Internet6: Destination Gateway Flags Netif Expire ::/96 ::1 UGRS lo0 ::1 link#2 UH lo0 ::ffff:0.0.0.0/96 ::1 UGRS lo0 fe80::/10 ::1 UGRS lo0 fe80::%lo0/64 link#2 U lo0 fe80::1%lo0 link#2 UHS lo0 ff01::%lo0/32 ::1 U lo0 ff02::/16 ::1 UGRS lo0 ff02::%lo0/32 ::1 U lo0 ------------------------------------------------------------------------ netstat -anA Active Internet connections (including servers) Tcpcb Proto Recv-Q Send-Q Local Address Foreign Address (state) fffff80002f5c400 tcp4 0 0 192.168.16.213.22 192.168.16.32.5736 ESTABLISHED fffff80002f5c800 tcp4 0 0 127.0.0.1.25 *.* LISTEN fffff80002f5cc00 tcp4 0 0 *.22 *.* LISTEN fffff80002f5d000 tcp6 0 0 *.22 *.* LISTEN fffff80002d7bab8 udp4 0 0 *.514 *.* fffff80002d7bc40 udp6 0 0 *.514 *.* Active UNIX domain sockets Address Type Recv-Q Send-Q Inode Conn Refs Nextref Addr fffff80002ec1960 stream 0 0 0 fffff80002ec1780 0 0 fffff80002ec1780 stream 0 0 0 fffff80002ec1960 0 0 fffff80002ed5870 stream 0 0 fffff80002cbdb10 0 0 0 /var/run/devd.pipe fffff80002ec1870 dgram 0 0 0 fffff80002ed5690 0 fffff80002ed55a0 fffff80002ed54b0 dgram 0 0 0 fffff80002ed5780 0 0 fffff80002ed55a0 dgram 0 0 0 fffff80002ed5690 0 0 fffff80002ed5690 dgram 0 0 fffff80002d13b10 0 fffff80002ec1870 0 /var/run/logpriv fffff80002ed5780 dgram 0 0 fffff80002d13ce8 0 fffff80002ed54b0 0 /var/run/log ------------------------------------------------------------------------ netstat -aL Current listen queue sizes (qlen/incqlen/maxqlen) Proto Listen Local Address tcp4 0/0/10 localhost.smtp tcp4 0/0/128 *.ssh tcp6 0/0/128 *.ssh unix 0/0/4 /var/run/devd.pipe ------------------------------------------------------------------------ fstat fstat: procstat_getprocs() ------------------------------------------------------------------------ dmesg Copyright (c) 1992-2013 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 10.0-RC2 #0 r259404: Sun Dec 15 08:18:20 UTC 2013 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.3 (tags/RELEASE_33/final 183502) 20130610 CPU: Intel(R) Core(TM) i7-3720QM CPU @ 2.60GHz (2607.01-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x306a9 Family = 0x6 Model = 0x3a Stepping = 9 Features=0x1783fbff Features2=0x201 AMD Features=0x28100800 AMD Features2=0x1 real memory = 536805376 (511 MB) avail memory = 489537536 (466 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0 irqs 0-23 on motherboard random: initialized kbd1 at kbdmux0 acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) cpu0: on acpi0 cpu1: on acpi0 attimer0: port 0x40-0x43,0x50-0x53 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd000-0xd00f at device 1.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 vgapci0: mem 0xe0000000-0xe0ffffff irq 18 at device 2.0 on pci0 em0: port 0xd010-0xd017 mem 0xf0000000-0xf001ffff irq 19 at device 3.0 on pci0 em0: Ethernet address: 08:00:27:6d:55:34 pci0: at device 4.0 (no driver attached) pcm0: port 0xd100-0xd1ff,0xd200-0xd23f irq 21 at device 5.0 on pci0 pcm0: pci0: at device 7.0 (no driver attached) acpi_acad0: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 orm0: at iomem 0xc0000-0xc7fff,0xe2000-0xe2fff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 atrtc0: at port 0x70 irq 8 on isa0 Event timer "RTC" frequency 32768 Hz quality 0 ppc0: cannot reserve I/O port range ZFS WARNING: Recommended minimum kmem_size is 512MB; expect unstable behavior. Consider tuning vm.kmem_size and vm.kmem_size_max in /boot/loader.conf. ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 10.000 msec pcm0: measured ac97 link rate at 3650 Hz ada0 at ata0 bus 0 scbus0 target 0 lun 0 ada0: ATA-6 device ada0: Serial Number VB46b61230-76124886 ada0: 33.300MB/s transfers (UDMA2, PIO 65536bytes) ada0: 8192MB (16777216 512 byte sectors: 16H 63S/T 16383C) ada0: Previously was known as ad0 cd0 at ata1 bus 0 scbus1 target 0 lun 0 cd0: Removable CD-ROM SCSI-0 device cd0: Serial Number VB2-01700376 cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present GEOM_MIRROR: Cancelling unmapped because of ada0p2. GEOM_MIRROR: Device mirror/gswap launched (1/1). GEOM_MIRROR: Cancelling unmapped because of ada0p3. GEOM_MIRROR: Device mirror/scratch launched (1/1). random: unblocking device. Netvsc initializing... SMP: AP CPU #1 Launched! Trying to mount root from zfs:sys/ROOT/default []... Setting hostuuid: 98941db9-6954-4fcd-94c6-f4c535887bb8. Setting hostid: 0xad0583af. Entropy harvesting: interrupts ethernet point_to_point swi. Starting file system checks: Mounting local file systems:. Writing entropy file:. Setting hostname: b524-fbsd10rc2.pix.net. Starting Network: lo0 em0. lo0: flags=8049 metric 0 mtu 16384 options=600003 inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 inet 127.0.0.1 netmask 0xff000000 nd6 options=21 em0: flags=8843 metric 0 mtu 1500 options=9b ether 08:00:27:6d:55:34 nd6 options=29 media: Ethernet autoselect (1000baseT ) status: active Starting devd. Starting dhclient. DHCPREQUEST on em0 to 255.255.255.255 port 67 DHCPACK from 192.168.16.1 bound to 192.168.16.213 -- renewal in 43200 seconds. add net fe80::: gateway ::1 add net ff02::: gateway ::1 add net ::ffff:0.0.0.0: gateway ::1 add net ::0.0.0.0: gateway ::1 Creating and/or trimming log files. Starting syslogd. No core dumps found. ELF ldconfig path: /lib /usr/lib /usr/lib/compat 32-bit compatibility ldconfig path: /usr/lib32 Clearing /tmp (X related). Updating motd:. Mounting late file systems:. Starting ntpd. Configuring syscons: blanktime. Performing sanity check on sshd configuration. Starting sshd. Starting sendmail_submit. Starting sendmail_msp_queue. Starting cron. Starting background file system checks in 60 seconds. Wed Dec 18 23:21:59 UTC 2013 Dec 18 23:22:07 b524-fbsd10rc2 su: lidl to root on /dev/pts/0 Dec 18 23:22:08 b524-fbsd10rc2 ntpd[734]: time correction of 18002 seconds exceeds sanity limit (1000); set clock manually to the correct UTC time. GEOM_MIRROR: Device scratch: provider ada0p3 disconnected. GEOM_MIRROR: Device scratch: provider mirror/scratch destroyed. GEOM_MIRROR: Device scratch destroyed. GEOM_MIRROR: Device scratch: provider gpt/scratch marked as inactive, skipping. GEOM_MIRROR: Device scratch: provider gptid/dd2aaf21-6838-11e3-b869-0800276d5534 marked as inactive, skipping. GEOM_MIRROR: Cancelling unmapped because of ada0p3. GEOM_MIRROR: Device mirror/scratch launched (1/1). GEOM_MIRROR: Device scratch: provider ada0p3 disconnected. GEOM_MIRROR: Device scratch: provider mirror/scratch destroyed. GEOM_MIRROR: Device scratch destroyed. GEOM_MIRROR: Device scratch: provider gpt/scratch marked as inactive, skipping. GEOM_MIRROR: Device scratch: provider gptid/dd2aaf21-6838-11e3-b869-0800276d5534 marked as inactive, skipping. GEOM_MIRROR: Cancelling unmapped because of ada0p3. GEOM_MIRROR: Device mirror/scratch launched (1/1). GEOM_MIRROR: Device scratch: provider ada0p3 disconnected. GEOM_MIRROR: Device scratch: provider mirror/scratch destroyed. GEOM_MIRROR: Device scratch destroyed. Fatal trap 12: page fault while in kernel mode cpuid = 1; apic id = 01 fault virtual address = 0x378 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff808b78c6 stack pointer = 0x28:0xfffffe001ddfea10 frame pointer = 0x28:0xfffffe001ddfeab0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 13 (g_event) trap number = 12 panic: page fault cpuid = 1 KDB: stack backtrace: #0 0xffffffff808e7d60 at kdb_backtrace+0x60 #1 0xffffffff808af845 at panic+0x155 #2 0xffffffff80c8e612 at trap_fatal+0x3a2 #3 0xffffffff80c8e8e9 at trap_pfault+0x2c9 #4 0xffffffff80c8e076 at trap+0x5e6 #5 0xffffffff80c75312 at calltrap+0x8 #6 0xffffffff808b7442 at _sx_xlock+0x62 #7 0xffffffff81a371bf at g_mirror_dumpconf+0x12f #8 0xffffffff8081a35c at g_conf_specific+0x14c #9 0xffffffff8081acd6 at g_run_events+0x166 #10 0xffffffff8088191a at fork_exit+0x9a #11 0xffffffff80c7584e at fork_trampoline+0xe Uptime: 33s Dumping 78 out of 487 MB:..21%..41%..61%..82% ------------------------------------------------------------------------ kernel config options CONFIG_AUTOGENERATED ident GENERIC machine amd64 cpu HAMMER makeoptions WITH_CTF=1 makeoptions DEBUG=-g options XENHVM options USB_DEBUG options ATH_ENABLE_11N options AH_AR5416_INTERRUPT_MITIGATION options AH_SUPPORT_AR5416 options IEEE80211_SUPPORT_MESH options IEEE80211_AMPDU_AGE options IEEE80211_DEBUG options SC_PIXEL_MODE options VESA options AHD_REG_PRETTY_PRINT options AHC_REG_PRETTY_PRINT options ATA_STATIC_ID options SMP options KDB_TRACE options KDB options INCLUDE_CONFIG_FILE options DDB_CTF options KDTRACE_HOOKS options KDTRACE_FRAME options MAC options PROCDESC options CAPABILITIES options CAPABILITY_MODE options AUDIT options HWPMC_HOOKS options KBD_INSTALL_CDEV options PRINTF_BUFR_SIZE=128 options _KPOSIX_PRIORITY_SCHEDULING options SYSVSEM options SYSVMSG options SYSVSHM options STACK options KTRACE options SCSI_DELAY=5000 options COMPAT_FREEBSD7 options COMPAT_FREEBSD6 options COMPAT_FREEBSD5 options COMPAT_FREEBSD4 options COMPAT_FREEBSD32 options GEOM_LABEL options GEOM_RAID options GEOM_PART_GPT options PSEUDOFS options PROCFS options CD9660 options MSDOSFS options NFS_ROOT options NFSLOCKD options NFSD options NFSCL options MD_ROOT options QUOTA options UFS_GJOURNAL options UFS_DIRHASH options UFS_ACL options SOFTUPDATES options FFS options SCTP options TCP_OFFLOAD options INET6 options INET options PREEMPTION options SCHED_ULE options NEW_PCIB options GEOM_PART_MBR options GEOM_PART_EBR_COMPAT options GEOM_PART_EBR options GEOM_PART_BSD device isa device mem device io device uart_ns8250 device cpufreq device acpi device pci device fdc device ahci device ata device mvs device siis device ahc device ahd device esp device hptiop device isp device mpt device mps device sym device trm device adv device adw device aic device bt device isci device scbus device ch device da device sa device cd device pass device ses device amr device arcmsr device ciss device dpt device hptmv device hptnr device hptrr device hpt27xx device iir device ips device mly device twa device tws device aac device aacp device aacraid device ida device mfi device mlx device twe device atkbdc device atkbd device psm device kbdmux device vga device splash device sc device agp device cbb device pccard device cardbus device uart device ppc device ppbus device lpt device ppi device puc device bxe device de device em device igb device ixgbe device le device ti device txp device vx device miibus device ae device age device alc device ale device bce device bfe device bge device cas device dc device et device fxp device gem device hme device jme device lge device msk device nfe device nge device pcn device re device rl device sf device sge device sis device sk device ste device stge device tl device tx device vge device vr device wb device xl device cs device ed device ex device ep device fe device sn device xe device wlan device wlan_wep device wlan_ccmp device wlan_tkip device wlan_amrr device an device ath device ath_pci device ath_hal device ath_rate_sample device ipw device iwi device iwn device malo device mwl device ral device wi device wpi device loop device random device padlock_rng device rdrand_rng device ether device vlan device tun device md device gif device faith device firmware device bpf device uhci device ohci device ehci device xhci device usb device ukbd device umass device sound device snd_cmi device snd_csa device snd_emu10kx device snd_es137x device snd_hda device snd_ich device snd_via8233 device mmc device mmcsd device sdhci device virtio device virtio_pci device vtnet device virtio_blk device virtio_scsi device virtio_balloon device hyperv device xenpci device vmx ------------------------------------------------------------------------ ddb capture buffer ddb: ddb_capture: kvm_nlist --------------010909060205050007050701--