Date: Tue, 5 Apr 2016 08:30:46 +0000 From: Steven Crangle <Steven@stream-technologies.com> To: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org> Subject: Netmap seems to randomly cause Kernel panic on shutdown Message-ID: <DB5PR07MB1685FAFB88A66DDF942874FF9B9E0@DB5PR07MB1685.eurprd07.prod.outlook.com>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
Hi,
I'm looking for a bit of help to track down the reason behind this kernel panic, it seems like netmap works fine for the majority of the time, but occasionally it will cause the box to kernel panic.
The machine is running FreeBSD Current from a few weeks ago (Rev 296937)
And it has a Chelsio T520-SO network card in it.
We've been developing with netmap for a while now, and while the kernel panic doesn't seem to be 100% reproducible, it's happening regularly enough to cause alarm!
Thanks for any help!
Steven
[-- Attachment #2 --]
jj.gla.uk.iotx dumped core - see /var/crash/vmcore.0
Mon Jan 25 14:27:06 UTC 2016
FreeBSD jj.gla.uk.iotx 10.2-RELEASE-p10 FreeBSD 10.2-RELEASE-p10 #1 r294714M: Mon Jan 25 12:45:48 UTC 2016 joe@jj.gla.uk.iotx:/usr/obj/usr/src/sys/GENERIC amd64
panic: page fault
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...
Unread portion of the kernel message buffer:
Fatal trap 12: page fault while in kernel mode
cpuid = 4; apic id = 08
fault virtual address = 0x6
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff804d2269
stack pointer = 0x28:0xfffffe0467ce0420
frame pointer = 0x28:0xfffffe0467ce04f0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 59932 (PingTest)
trap number = 12
panic: page fault
cpuid = 4
KDB: stack backtrace:
#0 0xffffffff809c5590 at kdb_backtrace+0x60
#1 0xffffffff80989146 at vpanic+0x126
#2 0xffffffff80989013 at panic+0x43
#3 0xffffffff80d8b16b at trap_fatal+0x36b
#4 0xffffffff80d8b46d at trap_pfault+0x2ed
#5 0xffffffff80d8ab0a at trap+0x47a
#6 0xffffffff80d70e82 at calltrap+0x8
#7 0xffffffff806a9ba9 at netmap_do_unregif+0x89
#8 0xffffffff806ab4e1 at netmap_do_regif+0x1a1
#9 0xffffffff806abcb5 at netmap_ioctl+0x755
#10 0xffffffff808706b9 at devfs_ioctl_f+0x139
#11 0xffffffff809dd485 at kern_ioctl+0x255
#12 0xffffffff809dd180 at sys_ioctl+0x140
#13 0xffffffff80d8ba87 at amd64_syscall+0x357
#14 0xffffffff80d7116b at Xfast_syscall+0xfb
Uptime: 39m8s
Dumping 1710 out of 16342 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%
Reading symbols from /boot/kernel/zfs.ko.symbols...done.
Loaded symbols for /boot/kernel/zfs.ko.symbols
Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
Loaded symbols for /boot/kernel/opensolaris.ko.symbols
Reading symbols from /boot/kernel/ums.ko.symbols...done.
Loaded symbols for /boot/kernel/ums.ko.symbols
#0 doadump (textdump=<value optimized out>) at pcpu.h:219
219 pcpu.h: No such file or directory.
in pcpu.h
(kgdb) #0 doadump (textdump=<value optimized out>) at pcpu.h:219
#1 0xffffffff80988da2 in kern_reboot (howto=260)
at /usr/src/sys/kern/kern_shutdown.c:451
#2 0xffffffff80989185 in vpanic (fmt=<value optimized out>,
ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:758
#3 0xffffffff80989013 in panic (fmt=0x0)
at /usr/src/sys/kern/kern_shutdown.c:687
#4 0xffffffff80d8b16b in trap_fatal (frame=<value optimized out>,
eva=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:851
#5 0xffffffff80d8b46d in trap_pfault (frame=0xfffffe0467ce0370,
usermode=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:674
#6 0xffffffff80d8ab0a in trap (frame=0xfffffe0467ce0370)
at /usr/src/sys/amd64/amd64/trap.c:440
#7 0xffffffff80d70e82 in calltrap ()
at /usr/src/sys/amd64/amd64/exception.S:236
#8 0xffffffff804d2269 in cxgbe_netmap_reg (na=<value optimized out>,
on=<value optimized out>) at endian.h:95
#9 0xffffffff806a9ba9 in netmap_do_unregif (priv=<value optimized out>,
nifp=0xfffffe0467dc2000) at /usr/src/sys/dev/netmap/netmap.c:1011
#10 0xffffffff806ab4e1 in netmap_do_regif (priv=0xfffff8034cd99600,
na=<value optimized out>, ringid=<value optimized out>,
flags=<value optimized out>, err=0xfffffe0467ce08e4)
at /usr/src/sys/dev/netmap/netmap.c:1973
#11 0xffffffff806abcb5 in netmap_ioctl (dev=<value optimized out>,
cmd=<value optimized out>, data=0xfffffe0467ce0a20 "ncxl0",
fflag=<value optimized out>, td=0xfffff800181e1000)
at /usr/src/sys/dev/netmap/netmap.c:2124
#12 0xffffffff808706b9 in devfs_ioctl_f (fp=0xfffff80018adc640,
com=3225184658, data=0xfffffe0467ce0a20, cred=<value optimized out>,
td=0xfffff800181e1000) at /usr/src/sys/fs/devfs/devfs_vnops.c:785
#13 0xffffffff809dd485 in kern_ioctl (td=0xfffff800181e1000,
fd=<value optimized out>, com=18446735278021152768) at file.h:320
#14 0xffffffff809dd180 in sys_ioctl (td=0xfffff800181e1000,
uap=0xfffffe0467ce0b80) at /usr/src/sys/kern/sys_generic.c:718
#15 0xffffffff80d8ba87 in amd64_syscall (td=0xfffff800181e1000, traced=0)
at subr_syscall.c:134
#16 0xffffffff80d7116b in Xfast_syscall ()
at /usr/src/sys/amd64/amd64/exception.S:396
#17 0x0000000801d8efda in ?? ()
Previous frame inner to this frame (corrupt stack?)
Current language: auto; currently minimal
(kgdb)
------------------------------------------------------------------------
ps -axlww
UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
0 0 0 0 -8 0 0 18005602445714496 - DLs - 0:00.24 [kernel]
0 1 0 0 20 0 9476 17979215789071360 wait DLs - 0:00.09 [init]
0 2 0 0 -16 0 0 18005602445714496 - DL - 0:00.00 [cam]
0 3 0 0 -8 0 0 18005602445714496 tx->tx_s DL - 0:00.01 [zfskern]
0 4 0 0 -16 0 0 18005602445714496 waiting_ DL - 0:00.00 [sctp_iterator]
0 5 0 0 -16 0 0 18005602445714496 umarcl DL - 0:00.00 [pagedaemon]
0 6 0 0 -16 0 0 18005602445714496 psleep DL - 0:00.00 [vmdaemon]
0 7 0 0 155 0 0 18005602445714496 pgzero DL - 0:00.00 [pagezero]
0 8 0 0 -16 0 0 18005602445714496 psleep DL - 0:00.00 [bufdaemon]
0 9 0 0 16 0 0 18005602445714496 syncer DL - 0:00.00 [syncer]
0 10 0 0 -16 0 0 18005602445714496 audit_wo DL - 0:00.00 [audit]
0 11 0 0 155 0 0 18005602445714496 - RL - 1:53.38 [idle]
0 12 0 0 -84 0 0 18005602445714496 - WL - 0:00.12 [intr]
0 13 0 0 -8 0 0 18005602445714496 - DL - 0:00.01 [geom]
0 14 0 0 -16 0 0 18005602445714496 - DL - 0:00.01 [rand_harvestq]
0 15 0 0 -68 0 0 18005602445714496 - DL - 0:00.04 [usb]
0 16 0 0 -16 0 0 18005602445714496 - RL - 0:00.00 [vnlru]
0 1146 1 0 52 0 16728 17979215789043968 select Ds - 0:00.00 [moused]
0 1163 1 0 20 0 13624 17979215807998464 select Ds - 0:00.00 [devd]
0 1326 1 0 20 0 14512 17979215789053184 select Ds - 0:00.02 [syslogd]
0 1458 1 0 20 0 61224 17979215800481792 select Ds - 0:00.00 [sshd]
0 1462 1 0 20 0 16612 17979215791803904 nanslp Ds - 0:00.00 [cron]
0 1509 1 0 52 0 14508 17979215810882048 ttyin Ds+ - 0:00.00 [getty]
0 1510 1 0 52 0 14508 17979215789040384 ttyin Ds+ - 0:00.00 [getty]
0 1511 1 0 52 0 14508 17979215793232896 ttyin Ds+ - 0:00.00 [getty]
0 1512 1 0 52 0 14508 17979215809296384 ttyin Ds+ - 0:00.00 [getty]
0 1513 1 0 52 0 14508 17979215810767360 ttyin Ds+ - 0:00.00 [getty]
0 1514 1 0 52 0 14508 0 ttyin Ds+ - 0:00.00 [getty]
0 1515 1 0 52 0 14508 17979215799724544 ttyin Ds+ - 0:00.00 [getty]
0 1516 1 0 52 0 14508 17979215811466496 ttyin Ds+ - 0:00.00 [getty]
0 1534 1458 0 21 0 86492 17979214623182336 select Ds - 0:00.00 [sshd]
1002 1537 1534 0 20 0 86492 17979215803392768 select D - 0:00.00 [sshd]
1002 1538 1537 0 20 0 17088 17979214623193088 wait Ds - 0:00.00 [sh]
0 1540 1538 0 20 0 47728 17979215803385600 wait D - 0:00.00 [su]
0 1541 1540 0 20 0 23592 17979215793152768 pause D - 0:00.01 [csh]
0 59932 1541 0 33 0 135952 17979215810326784 nanslp D+ - 0:00.00 [PingTest]
------------------------------------------------------------------------
vmstat -s
2422120 cpu context switches
223681 device interrupts
71352 software interrupts
14341394 traps
21324016 system calls
16 kernel threads created
80415 fork() calls
79382 vfork() calls
0 rfork() calls
0 swap pager pageins
0 swap pager pages paged in
0 swap pager pageouts
0 swap pager pages paged out
4346 vnode pager pageins
26278 vnode pager pages paged in
0 vnode pager pageouts
0 vnode pager pages paged out
0 page daemon wakeups
0 pages examined by the page daemon
631 pages reactivated
4145359 copy-on-write faults
252 copy-on-write optimized faults
9320823 zero fill pages zeroed
0 zero fill pages prezeroed
17 intransit blocking page faults
13709213 total VM faults taken
4141 page faults requiring I/O
0 pages affected by kernel thread creation
2822123 pages affected by fork()
2789623 pages affected by vfork()
0 pages affected by rfork()
0 pages cached
17946274 pages freed
0 pages freed by daemon
0 pages freed by exiting processes
29267 pages active
21500 pages inactive
552 pages in VM cache
723821 pages wired down
3288262 pages free
4096 bytes per page
8376854 total name lookups
cache hits (85% pos + 5% neg) system 0% per-directory
deletions 3%, falsehits 0%, toolong 0%
------------------------------------------------------------------------
vmstat -m
Type InUse MemUse HighUse Requests Size(s)
isadev 7 1K - 7 128
entropy 1027 65K - 1041 32,64,4096
cdev 4 1K - 4 256
filedesc 36 72K - 159814 2048
sigio 1 1K - 1 64
filecaps 0 0K - 2 64
kdtrace 472 112K - 160423 64,256
kenv 86 12K - 97 16,32,64,128,8192
kqueue 0 0K - 119 256,2048
proc-args 20 1K - 132741 16,32,64,128,256
hhook 2 1K - 2 256
ithread 268 39K - 268 32,128,256
acpiintr 1 1K - 1 64
KTRACE 100 13K - 100 128
linker 183 35K - 225 16,32,64,128,256,512,1024,2048,4096,8192
lockf 14 2K - 172018 64,128
loginclass 3 1K - 25 64
devbuf 18517 41054K - 18859 16,32,64,128,256,512,1024,2048,4096,8192,32768,65536
temp 71 18K - 266848 16,32,64,128,256,512,1024,2048,16384
ip6ndp 10 1K - 10 64,128
module 496 62K - 497 128
mtx_pool 2 16K - 2 8192
osd 5 1K - 18 16,32,64
acpica 2216 225K - 57097 16,32,64,128,256,512,1024,2048,4096
pmchooks 1 1K - 1 128
CAM path 11 1K - 75 32
pgrp 19 3K - 73 128
session 16 2K - 30 128
proc 2 64K - 2 32768
subproc 163 208K - 159942 512,4096
cred 64 10K - 1170462 64,256
cxgbe 13 525K - 16 128,256,512,1024,2048,8192,16384
plimit 12 3K - 27 256
uidinfo 3 9K - 18 128,8192
feeder 7 1K - 7 32
sysctl 0 0K - 681 16,32,64
sysctloid 8014 403K - 8111 16,32,64,128
sysctltmp 0 0K - 393 16,32,64,128,256
tidhash 1 64K - 1 65536
callout 9 3208K - 9
umtx 936 117K - 936 128
p1003.1b 1 1K - 1 16
SWAP 4 553K - 4 64
bus 1365 117K - 6708 16,32,64,128,256,1024
bus-sc 86 254K - 4250 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
devstat 10 21K - 10 32,4096
eventhandler 100 8K - 100 64,128
kobj 334 1336K - 587 4096
Per-cpu 1 1K - 1 32
rman 342 41K - 777 16,32,128
sbuf 0 0K - 1051 16,32,64,128,256,512,1024,2048,4096,8192,16384
DEVFS3 139 35K - 155 256
DEVFS1 119 60K - 131 512
taskqueue 153 22K - 209 16,32,64,128,256
Unitno 22 2K - 104896 32,64
vmem 2 640K - 6 16384,65536
ioctlops 0 0K - 235 256,512,1024
select 20 3K - 20 128
iov 0 0K - 576 16,64,128,256,512
msg 4 30K - 4 2048,4096,8192,16384
sem 4 106K - 4 2048,4096
shm 1 32K - 1 32768
tty 20 20K - 20 1024
pts 1 1K - 1 256
mbuf_tag 0 0K - 9 32
shmfd 1 8K - 1 8192
soname 4 1K - 14831 16,32,128
pcb 16 2199K - 123 16,32,128,1024,2048,8192
DEVFS_RULE 55 26K - 55 64,512
acl 0 0K - 3014 4096
vfscache 1 4096K - 1
vfs_hash 1 2048K - 1
vnodes 1 1K - 1 256
DEVFS 25 1K - 26 16,128
DEVFSP 2 1K - 2 64
mount 116 4K - 311 16,32,64,128,256
vnodemarker 0 0K - 1619 512
BPF 9 2K - 9 128
ifnet 10 19K - 10 128,2048
ifaddr 101 23K - 101 32,64,128,256,512,2048,4096
ether_multi 17 1K - 18 16,32,64
clone 8 1K - 8 128
arpcom 8 1K - 8 16
lltable 23 11K - 23 256,512
NFSD V4client 1 1K - 1 256
NFSD lckfile 1 1K - 1 256
routetbl 32 6K - 300 32,64,128,256,512
igmp 9 3K - 9 256
in_multi 2 1K - 2 256
sctp_a_it 0 0K - 3 16
sctp_vrf 1 1K - 1 64
sctp_ifa 4 1K - 4 128
sctp_ifn 2 1K - 2 128
sctp_iter 0 0K - 3 256
hostcache 1 32K - 1 32768
syncache 1 64K - 1 65536
in6_multi 15 2K - 15 32,256
mld 9 2K - 9 128
rpc 2 16K - 2 8192
audit_evclass 187 6K - 229 32
ufs_quota 1 2048K - 1
vm_pgdata 3 2049K - 3 128
UMAHash 40 956K - 164 512,1024,2048,4096,8192,16384,32768,65536
memdesc 1 4K - 1 4096
NFSD session 1 1K - 1 1024
atkbddev 2 1K - 2 64
acpitask 1 16K - 1 16384
pfs_nodes 21 6K - 21 256
GEOM 92 17K - 983 16,32,64,128,256,512,1024,2048,8192,16384
acpisem 41 6K - 41 128
CAM periph 6 2K - 22 16,32,64,128,256
acpidev 36 3K - 36 64
CAM queue 16 5K - 51 16,32,512
UART 6 5K - 6 16,1024
raid_data 0 0K - 132 32,128,256
netmap 82151 337579K - 82151 16,32,2048,4096,32768
CAM dev queue 7 1K - 7 64
CAM SIM 7 2K - 7 256
CAM XPT 32 3K - 131 16,32,64,128,256,512,1024,2048,65536
pci_link 16 2K - 16 32,128
acpi_perf 8 4K - 8 512
apmdev 1 1K - 1 128
madt_table 0 0K - 1 4096
CAM DEV 9 18K - 20 2048
USB 47 71K - 56 16,128,256,512,1024,2048,4096
io_apic 1 2K - 1 2048
USBdev 36 9K - 36 32,64,128,256,512,4096
MCA 8 1K - 8 128
kbdmux 7 22K - 7 16,512,1024,2048,16384
LED 8 1K - 8 16,128
msi 64 8K - 64 128
nexusdev 3 1K - 3 16
CAM CCB 0 0K - 28917 2048
solaris 664256 129403K - 16300367 16,32,64,128,256,512,1024,2048,4096,8192,16384,32768,65536
kstat_data 6 1K - 6 64
------------------------------------------------------------------------
vmstat -z
ITEM SIZE LIMIT USED FREE REQ FAIL SLEEP
UMA Kegs: 384, 0, 226, 4, 226, 0, 0
UMA Zones: 1664, 0, 226, 0, 226, 0, 0
UMA Slabs: 80, 0, 104341, 9, 104742, 0, 0
UMA RCntSlabs: 88, 0, 5716, 44, 5716, 0, 0
UMA Hash: 256, 0, 64, 41, 104, 0, 0
4 Bucket: 32, 0, 726, 2899, 65040, 0, 0
6 Bucket: 48, 0, 533, 2289, 9187, 0, 0
8 Bucket: 64, 0, 76, 3272, 12234, 11, 0
12 Bucket: 96, 0, 101, 1293, 11338, 0, 0
16 Bucket: 128, 0, 154, 993, 24386, 0, 0
32 Bucket: 256, 0, 1438, 467, 36740, 52, 0
64 Bucket: 512, 0, 613, 1171, 26691, 626, 0
128 Bucket: 1024, 0, 634, 74, 17838, 0, 0
256 Bucket: 2048, 0, 379, 65, 9119, 13, 0
vmem btag: 56, 0, 137269, 968, 137391, 975, 0
VM OBJECT: 256, 0, 71126, 8359, 2406383, 0, 0
RADIX NODE: 144, 0, 35700, 561, 3225847, 0, 0
MAP: 240, 0, 3, 61, 3, 0, 0
KMAP ENTRY: 128, 0, 6, 273, 6, 0, 0
MAP ENTRY: 128, 0, 688, 1575, 6098698, 0, 0
VMSPACE: 448, 0, 20, 394, 159796, 0, 0
fakepg: 104, 0, 0, 0, 0, 0, 0
mt_zone: 4112, 0, 366, 0, 366, 0, 0
16: 16, 0, 224543, 1357, 987328, 0, 0
32: 32, 0, 89913, 10587, 4623127, 0, 0
64: 64, 0, 239484, 11244, 3948497, 0, 0
128: 128, 0, 37079, 1423, 3303055, 0, 0
256: 256, 0, 89619, 44766, 3163869, 0, 0
512: 512, 0, 486, 242, 2227568, 0, 0
1024: 1024, 0, 2796, 584, 150015, 0, 0
2048: 2048, 0, 99, 131, 189207, 0, 0
4096: 4096, 0, 8157, 8, 179060, 0, 0
8192: 8192, 0, 26, 8, 634, 0, 0
16384: 16384, 0, 14, 5, 638, 0, 0
32768: 32768, 0, 82, 1, 384, 0, 0
65536: 65536, 0, 37, 5, 197, 0, 0
SLEEPQUEUE: 80, 0, 469, 802, 469, 0, 0
64 pcpu: 8, 0, 2092, 1236, 2092, 0, 0
Files: 80, 0, 50, 1350, 1087281, 0, 0
TURNSTILE: 136, 0, 469, 331, 469, 0, 0
rl_entry: 40, 0, 63, 2037, 63, 0, 0
umtx pi: 96, 0, 0, 0, 0, 0, 0
MAC labels: 40, 0, 0, 0, 0, 0, 0
PROC: 1256, 0, 35, 91, 159813, 0, 0
THREAD: 1176, 0, 435, 33, 608, 0, 0
cpuset: 72, 0, 325, 555, 525, 0, 0
audit_record: 1248, 0, 0, 0, 0, 0, 0
mbuf_packet: 256, 6501450, 8184, 3202, 126976, 0, 0
mbuf: 256, 6501450, 1, 2024, 105697, 0, 0
mbuf_cluster: 2048, 1015850, 11385, 11, 11385, 0, 0
mbuf_jumbo_page: 4096, 507925, 0, 18, 97, 0, 0
mbuf_jumbo_9k: 9216, 451488, 0, 0, 0, 0, 0
mbuf_jumbo_16k: 16384, 338616, 0, 0, 0, 0, 0
mbuf_ext_refcnt: 4, 0, 0, 0, 0, 0, 0
ttyinq: 160, 0, 180, 320, 540, 0, 0
ttyoutq: 256, 0, 95, 400, 287, 0, 0
g_bio: 248, 0, 0, 1056, 92469, 0, 0
DMAR_MAP_ENTRY: 120, 0, 0, 0, 0, 0, 0
nvme_request: 128, 0, 0, 0, 0, 0, 0
ata_request: 336, 0, 0, 0, 0, 0, 0
vtnet_tx_hdr: 24, 0, 0, 0, 0, 0, 0
FPU_save_area: 512, 0, 0, 0, 0, 0, 0
taskq_zone: 48, 0, 0, 3071, 16157, 0, 0
VNODE: 472, 0, 92684, 4588, 256320, 0, 0
VNODEPOLL: 112, 0, 0, 0, 0, 0, 0
BUF TRIE: 144, 0, 0, 105273, 0, 0, 0
S VFS Cache: 108, 0, 28430, 5450, 342012, 0, 0
STS VFS Cache: 148, 0, 0, 0, 0, 0, 0
L VFS Cache: 328, 0, 6901, 22391, 108820, 0, 0
LTS VFS Cache: 368, 0, 0, 0, 0, 0, 0
NAMEI: 1024, 0, 0, 144, 3399112, 0, 0
DIRHASH: 1024, 0, 0, 0, 0, 0, 0
NCLNODE: 528, 0, 0, 0, 0, 0, 0
Mountpoints: 816, 0, 12, 18, 12, 0, 0
pipe: 744, 0, 1, 144, 53151, 0, 0
procdesc: 128, 0, 0, 0, 0, 0, 0
range_seg_cache: 64, 0, 1347, 1691, 12798, 0, 0
zio_cache: 920, 0, 8, 16984, 2100989, 0, 0
zio_link_cache: 48, 0, 0, 18509, 1012129, 0, 0
zio_buf_512: 512, 0, 247408, 488, 660543, 0, 0
zio_data_buf_512: 512, 0, 67640, 336, 406851, 0, 0
zio_buf_1024: 1024, 0, 1198, 50, 44769, 0, 0
zio_data_buf_1024: 1024, 0, 41452, 32, 41842, 0, 0
zio_buf_1536: 1536, 0, 399, 43, 17558, 0, 0
zio_data_buf_1536: 1536, 0, 16426, 44, 16710, 0, 0
zio_buf_2048: 2048, 0, 140, 40, 8803, 0, 0
zio_data_buf_2048: 2048, 0, 7555, 21, 7807, 0, 0
zio_buf_2560: 2560, 0, 71, 19, 5336, 0, 0
zio_data_buf_2560: 2560, 0, 5025, 15, 5251, 0, 0
zio_buf_3072: 3072, 0, 63, 21, 3861, 0, 0
zio_data_buf_3072: 3072, 0, 3564, 12, 3768, 0, 0
zio_buf_3584: 3584, 0, 34, 11, 3558, 0, 0
zio_data_buf_3584: 3584, 0, 3356, 0, 3526, 0, 0
zio_buf_4096: 4096, 0, 45, 7272, 186898, 0, 0
zio_data_buf_4096: 4096, 0, 3274, 2, 3506, 0, 0
zio_buf_5120: 5120, 0, 41, 161, 5126, 0, 0
zio_data_buf_5120: 5120, 0, 4883, 0, 5162, 0, 0
zio_buf_6144: 6144, 0, 31, 118, 3462, 0, 0
zio_data_buf_6144: 6144, 0, 3247, 0, 3471, 0, 0
zio_buf_7168: 7168, 0, 15, 90, 2633, 0, 0
zio_data_buf_7168: 7168, 0, 2473, 1, 2638, 0, 0
zio_buf_8192: 8192, 0, 14, 453, 4939, 0, 0
zio_data_buf_8192: 8192, 0, 1660, 2, 1823, 0, 0
zio_buf_10240: 10240, 0, 19, 174, 2697, 0, 0
zio_data_buf_10240: 10240, 0, 2455, 2, 2734, 0, 0
zio_buf_12288: 12288, 0, 22, 102, 3321, 0, 0
zio_data_buf_12288: 12288, 0, 1746, 2, 1972, 0, 0
zio_buf_14336: 14336, 0, 8, 114, 1437, 0, 0
zio_data_buf_14336: 14336, 0, 1287, 2, 1435, 0, 0
zio_buf_16384: 16384, 0, 13288, 288, 29096, 0, 0
zio_data_buf_16384: 16384, 0, 890, 2, 1052, 0, 0
zio_buf_20480: 20480, 0, 15, 67, 1941, 0, 0
zio_data_buf_20480: 20480, 0, 1233, 1, 1518, 0, 0
zio_buf_24576: 24576, 0, 6, 49, 1394, 0, 0
zio_data_buf_24576: 24576, 0, 883, 1, 1100, 0, 0
zio_buf_28672: 28672, 0, 1, 50, 953, 0, 0
zio_data_buf_28672: 28672, 0, 557, 2, 732, 0, 0
zio_buf_32768: 32768, 0, 4, 33, 799, 0, 0
zio_data_buf_32768: 32768, 0, 436, 1, 606, 0, 0
zio_buf_40960: 40960, 0, 4, 49, 1233, 0, 0
zio_data_buf_40960: 40960, 0, 710, 2, 979, 0, 0
zio_buf_49152: 49152, 0, 7, 38, 931, 0, 0
zio_data_buf_49152: 49152, 0, 398, 2, 646, 0, 0
zio_buf_57344: 57344, 0, 2, 33, 673, 0, 0
zio_data_buf_57344: 57344, 0, 249, 2, 532, 0, 0
zio_buf_65536: 65536, 0, 1, 20, 538, 0, 0
zio_data_buf_65536: 65536, 0, 198, 2, 598, 0, 0
zio_buf_81920: 81920, 0, 4, 40, 1099, 0, 0
zio_data_buf_81920: 81920, 0, 284, 3, 481, 0, 0
zio_buf_98304: 98304, 0, 1, 15, 877, 0, 0
zio_data_buf_98304: 98304, 0, 178, 3, 341, 0, 0
zio_buf_114688: 114688, 0, 3, 15, 634, 0, 0
zio_data_buf_114688: 114688, 0, 128, 5, 291, 0, 0
zio_buf_131072: 131072, 0, 4, 129, 12606, 0, 0
zio_data_buf_131072: 131072, 0, 5172, 2, 9526, 0, 0
zio_buf_163840: 163840, 0, 0, 0, 0, 0, 0
zio_data_buf_163840: 163840, 0, 0, 0, 0, 0, 0
zio_buf_196608: 196608, 0, 0, 0, 0, 0, 0
zio_data_buf_196608: 196608, 0, 0, 0, 0, 0, 0
zio_buf_229376: 229376, 0, 0, 0, 0, 0, 0
zio_data_buf_229376: 229376, 0, 0, 0, 0, 0, 0
zio_buf_262144: 262144, 0, 0, 0, 0, 0, 0
zio_data_buf_262144: 262144, 0, 0, 0, 0, 0, 0
zio_buf_327680: 327680, 0, 0, 0, 0, 0, 0
zio_data_buf_327680: 327680, 0, 0, 0, 0, 0, 0
zio_buf_393216: 393216, 0, 0, 0, 0, 0, 0
zio_data_buf_393216: 393216, 0, 0, 0, 0, 0, 0
zio_buf_458752: 458752, 0, 0, 0, 0, 0, 0
zio_data_buf_458752: 458752, 0, 0, 0, 0, 0, 0
zio_buf_524288: 524288, 0, 0, 0, 0, 0, 0
zio_data_buf_524288: 524288, 0, 0, 0, 0, 0, 0
zio_buf_655360: 655360, 0, 0, 0, 0, 0, 0
zio_data_buf_655360: 655360, 0, 0, 0, 0, 0, 0
zio_buf_786432: 786432, 0, 0, 0, 0, 0, 0
zio_data_buf_786432: 786432, 0, 0, 0, 0, 0, 0
zio_buf_917504: 917504, 0, 0, 0, 0, 0, 0
zio_data_buf_917504: 917504, 0, 0, 0, 0, 0, 0
zio_buf_1048576: 1048576, 0, 0, 0, 0, 0, 0
zio_data_buf_1048576: 1048576, 0, 0, 0, 0, 0, 0
zio_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0
zio_data_buf_1310720: 1310720, 0, 0, 0, 0, 0, 0
zio_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0
zio_data_buf_1572864: 1572864, 0, 0, 0, 0, 0, 0
zio_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0
zio_data_buf_1835008: 1835008, 0, 0, 0, 0, 0, 0
zio_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0
zio_data_buf_2097152: 2097152, 0, 0, 0, 0, 0, 0
zio_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0
zio_data_buf_2621440: 2621440, 0, 0, 0, 0, 0, 0
zio_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0
zio_data_buf_3145728: 3145728, 0, 0, 0, 0, 0, 0
zio_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0
zio_data_buf_3670016: 3670016, 0, 0, 0, 0, 0, 0
zio_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0
zio_data_buf_4194304: 4194304, 0, 0, 0, 0, 0, 0
zio_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0
zio_data_buf_5242880: 5242880, 0, 0, 0, 0, 0, 0
zio_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0
zio_data_buf_6291456: 6291456, 0, 0, 0, 0, 0, 0
zio_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0
zio_data_buf_7340032: 7340032, 0, 0, 0, 0, 0, 0
zio_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0
zio_data_buf_8388608: 8388608, 0, 0, 0, 0, 0, 0
zio_buf_10485760: 10485760, 0, 0, 0, 0, 0, 0
zio_data_buf_10485760: 10485760, 0, 0, 0, 0, 0, 0
zio_buf_12582912: 12582912, 0, 0, 0, 0, 0, 0
zio_data_buf_12582912: 12582912, 0, 0, 0, 0, 0, 0
zio_buf_14680064: 14680064, 0, 0, 0, 0, 0, 0
zio_data_buf_14680064: 14680064, 0, 0, 0, 0, 0, 0
zio_buf_16777216: 16777216, 0, 0, 0, 0, 0, 0
zio_data_buf_16777216: 16777216, 0, 0, 0, 0, 0, 0
lz4_ctx: 16384, 0, 0, 16, 240204, 0, 0
sa_cache: 80, 0, 92636, 5264, 256181, 0, 0
dnode_t: 752, 0, 236272, 58, 237409, 0, 0
dmu_buf_impl_t: 224, 0, 436781, 595, 997313, 0, 0
arc_buf_hdr_t: 216, 0, 204419, 619, 596058, 0, 0
arc_buf_t: 72, 0, 204419, 1116, 596064, 0, 0
zil_lwb_cache: 192, 0, 5, 495, 391, 0, 0
zfs_znode_cache: 368, 0, 92636, 4514, 256181, 0, 0
ksiginfo: 112, 0, 117, 933, 202, 0, 0
itimer: 352, 0, 0, 33, 1, 0, 0
KNOTE: 128, 0, 0, 651, 118, 0, 0
socket: 696, 522950, 11, 94, 2956, 0, 0
ipq: 56, 31808, 0, 0, 0, 0, 0
udp_inpcb: 392, 522950, 2, 238, 395, 0, 0
udpcb: 24, 523044, 2, 2169, 395, 0, 0
tcp_inpcb: 392, 522950, 2, 208, 33, 0, 0
tcpcb: 1032, 522951, 2, 52, 33, 0, 0
tcptw: 88, 27810, 0, 270, 2, 0, 0
syncache: 160, 15375, 0, 75, 1, 0, 0
hostcache: 136, 15370, 3, 200, 3, 0, 0
sackhole: 32, 0, 0, 0, 0, 0, 0
tcpreass: 40, 63500, 0, 1600, 5246, 0, 0
sctp_ep: 1424, 522950, 0, 0, 0, 0, 0
sctp_asoc: 2416, 40000, 0, 0, 0, 0, 0
sctp_laddr: 48, 80012, 0, 830, 3, 0, 0
sctp_raddr: 728, 80000, 0, 0, 0, 0, 0
sctp_chunk: 136, 400026, 0, 0, 0, 0, 0
sctp_readq: 104, 400026, 0, 0, 0, 0, 0
sctp_stream_msg_out: 104, 400026, 0, 0, 0, 0, 0
sctp_asconf: 40, 400000, 0, 0, 0, 0, 0
sctp_asconf_ack: 48, 400060, 0, 0, 0, 0, 0
udplite_inpcb: 392, 522950, 0, 0, 0, 0, 0
ripcb: 392, 522950, 0, 0, 0, 0, 0
unpcb: 240, 522960, 7, 489, 2523, 0, 0
rtentry: 200, 0, 13, 367, 13, 0, 0
selfd: 56, 0, 34, 2025, 213191, 0, 0
SWAPMETA: 288, 2031705, 0, 0, 0, 0, 0
------------------------------------------------------------------------
vmstat -i
interrupt total rate
irq23: ehci0 8940 262
cpu0:timer 164378 4834
irq282: igb0:que 0 66374 1952
irq283: igb0:que 1 72735 2139
irq284: igb0:que 2 2556 75
irq285: igb0:que 3 5221 153
irq286: igb0:que 4 3334 98
irq287: igb0:que 5 4889 143
irq288: igb0:que 6 25523 750
irq289: igb0:que 7 2921 85
irq290: igb0:link 2 0
irq319: ahci1 31186 917
cpu1:timer 93730 2756
cpu5:timer 71948 2116
cpu2:timer 76360 2245
cpu6:timer 80255 2360
cpu4:timer 83108 2444
cpu7:timer 72318 2127
cpu3:timer 71680 2108
Total 937458 27572
------------------------------------------------------------------------
pstat -T
50/522948 files
0M/4095M swap space
------------------------------------------------------------------------
pstat -s
Device 512-blocks Used Avail Capacity
/dev/ada0p2 4194048 0 4194048 0%
/dev/ada1p2 4194048 0 4194048 0%
Total 8388096 0 8388096 0%
------------------------------------------------------------------------
iostat
iostat: kvm_read(_tk_nin): invalid address (0x0)
iostat: disabling TTY statistics
ada0 ada1 pass0 cpu
KB/t tps MB/s KB/t tps MB/s KB/t tps MB/s us ni sy in id
53.56 444 23.20 54.27 436 23.10 0.00 0 0.00 1 0 2 0 97
------------------------------------------------------------------------
ipcs -a
Message Queues:
T ID KEY MODE OWNER GROUP CREATOR CGROUP CBYTES QNUM QBYTES LSPID LRPID STIME RTIME CTIME
Shared Memory:
T ID KEY MODE OWNER GROUP CREATOR CGROUP NATTCH SEGSZ CPID LPID ATIME DTIME CTIME
Semaphores:
T ID KEY MODE OWNER GROUP CREATOR CGROUP NSEMS OTIME CTIME
------------------------------------------------------------------------
ipcs -T
msginfo:
msgmax: 16384 (max characters in a message)
msgmni: 40 (# of message queues)
msgmnb: 2048 (max characters in a message queue)
msgtql: 40 (max # of messages in system)
msgssz: 8 (size of a message segment)
msgseg: 2048 (# of message segments in system)
shminfo:
shmmax: 536870912 (max shared memory segment size)
shmmin: 1 (min shared memory segment size)
shmmni: 192 (max number of shared memory identifiers)
shmseg: 128 (max shared memory segments per process)
shmall: 131072 (max amount of shared memory in pages)
seminfo:
semmni: 50 (# of semaphore identifiers)
semmns: 340 (# of semaphores in system)
semmnu: 150 (# of undo structures in system)
semmsl: 340 (max # of semaphores per id)
semopm: 100 (max # of operations per semop call)
semume: 50 (max # of undo entries per process)
semusz: 632 (size in bytes of undo structure)
semvmx: 32767 (semaphore maximum value)
semaem: 16384 (adjust on exit max value)
------------------------------------------------------------------------
nfsstat
Client Info:
Rpc Counts:
Getattr Setattr Lookup Readlink Read Write Create Remove
0 0 0 0 0 0 0 0
Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access
0 0 0 0 0 0 0 0
Mknod Fsstat Fsinfo PathConf Commit
0 0 0 0 0
Rpc Info:
TimedOut Invalid X Replies Retries Requests
0 0 0 0 0
Cache Info:
Attr Hits Misses Lkup Hits Misses BioR Hits Misses BioW Hits Misses
0 0 0 0 0 0 0 0
BioRLHits Misses BioD Hits Misses DirE Hits Misses Accs Hits Misses
0 0 0 0 0 0 0 0
Server Info:
Getattr Setattr Lookup Readlink Read Write Create Remove
0 0 0 0 0 0 0 0
Rename Link Symlink Mkdir Rmdir Readdir RdirPlus Access
0 0 0 0 0 0 0 0
Mknod Fsstat Fsinfo PathConf Commit
0 0 0 0 0
Server Ret-Failed
0
Server Faults
0
Server Cache Stats:
Inprog Idem Non-idem Misses
0 0 0 0
Server Write Gathering:
WriteOps WriteRPC Opsaved
0 0 0
------------------------------------------------------------------------
netstat -s
tcp:
76265 packets sent
28741 data packets (2150624 bytes)
0 data packets (0 bytes) retransmitted
0 data packets unnecessarily retransmitted
0 resends initiated by MTU discovery
47220 ack-only packets (15 delayed)
0 URG only packets
0 window probe packets
248 window update packets
56 control packets
106646 packets received
16487 acks (for 2150621 bytes)
14 duplicate acks
0 acks for unsent data
84963 packets (120930850 bytes) received in-sequence
0 completely duplicate packets (0 bytes)
0 old duplicate packets
0 packets with some dup. data (0 bytes duped)
5246 out-of-order packets (7563709 bytes)
0 packets (0 bytes) of data after window
0 window probes
14 window update packets
0 packets received after close
0 discarded for bad checksums
0 discarded for bad header offset fields
0 discarded because packet too short
1 discarded due to memory problems
28 connection requests
1 connection accept
0 bad connection attempts
0 listen queue overflows
0 ignored RSTs in the windows
29 connections established (including accepts)
31 connections closed (including 0 drops)
5 connections updated cached RTT on close
5 connections updated cached RTT variance on close
0 connections updated cached ssthresh on close
0 embryonic connections dropped
16487 segments updated rtt (of 16062 attempts)
0 retransmit timeouts
0 connections dropped by rexmit timeout
0 persist timeouts
0 connections dropped by persist timeout
0 Connections (fin_wait_2) dropped because of timeout
0 keepalive timeouts
0 keepalive probes sent
0 connections dropped by keepalive
16274 correct ACK header predictions
84869 correct data packet header predictions
1 syncache entry added
0 retransmitted
0 dupsyn
0 dropped
1 completed
0 bucket overflow
0 cache overflow
0 reset
0 stale
0 aborted
0 badack
0 unreach
0 zone failures
1 cookie sent
0 cookies received
3 hostcache entries added
0 bucket overflow
0 SACK recovery episodes
0 segment rexmits in SACK recovery episodes
0 byte rexmits in SACK recovery episodes
0 SACK options (SACK blocks) received
5139 SACK options (SACK blocks) sent
0 SACK scoreboard overflow
0 packets with ECN CE bit set
0 packets with ECN ECT(0) bit set
0 packets with ECN ECT(1) bit set
0 successful ECN handshakes
0 times ECN reduced the congestion window
0 packets with valid tcp-md5 signature received
0 packets with invalid tcp-md5 signature received
0 packets with tcp-md5 signature mismatch
0 packets with unexpected tcp-md5 signature received
0 packets without expected tcp-md5 signature received
udp:
7804 datagrams received
0 with incomplete header
0 with bad data length field
0 with bad checksum
0 with no checksum
0 dropped due to no socket
7744 broadcast/multicast datagrams undelivered
0 dropped due to full socket buffers
0 not for hashed pcb
60 delivered
60 datagrams output
0 times multicast source filter matched
ip:
114450 total packets received
0 bad header checksums
0 with size smaller than minimum
0 with data size < data length
0 with ip length > max ip packet size
0 with header length < data size
0 with data length < header length
0 with bad options
0 with incorrect version number
0 fragments received
0 fragments dropped (dup or out of space)
0 fragments dropped after timeout
0 packets reassembled ok
114450 packets for this host
0 packets for unknown/unsupported protocol
0 packets forwarded (0 packets fast forwarded)
0 packets not forwardable
0 packets received for unknown multicast group
0 redirects sent
76325 packets sent from this host
0 packets sent with fabricated ip header
0 output packets dropped due to no bufs, etc.
0 output packets discarded due to no route
0 output datagrams fragmented
0 fragments created
0 datagrams that can't be fragmented
0 tunneling packets that can't find gif
0 datagrams with bad address in header
icmp:
0 calls to icmp_error
0 errors not generated in response to an icmp message
0 messages with bad code fields
0 messages less than the minimum length
0 messages with bad checksum
0 messages with bad length
0 multicast echo requests ignored
0 multicast timestamp requests ignored
0 message responses generated
0 invalid return addresses
0 no return routes
igmp:
0 messages received
0 messages received with too few bytes
0 messages received with wrong TTL
0 messages received with bad checksum
0 V1/V2 membership queries received
0 V3 membership queries received
0 membership queries received with invalid field(s)
0 general queries received
0 group queries received
0 group-source queries received
0 group-source queries dropped
0 membership reports received
0 membership reports received with invalid field(s)
0 membership reports received for groups to which we belong
0 V3 reports received without Router Alert
0 membership reports sent
arp:
5 ARP requests sent
9 ARP replies sent
3823 ARP requests received
176 ARP replies received
3999 ARP packets received
0 total packets dropped due to no ARP entry
0 ARP entrys timed out
0 Duplicate IPs seen
ip6:
0 total packets received
0 with size smaller than minimum
0 with data size < data length
0 with bad options
0 with incorrect version number
0 fragments received
0 fragments dropped (dup or out of space)
0 fragments dropped after timeout
0 fragments that exceeded limit
0 packets reassembled ok
0 packets for this host
0 packets forwarded
0 packets not forwardable
0 redirects sent
0 packets sent from this host
0 packets sent with fabricated ip header
0 output packets dropped due to no bufs, etc.
14 output packets discarded due to no route
0 output datagrams fragmented
0 fragments created
0 datagrams that can't be fragmented
0 packets that violated scope rules
0 multicast packets which we don't join
Mbuf statistics:
0 one mbuf
2 one ext mbuf
0 two or more ext mbuf
0 packets whose headers are not contiguous
0 tunneling packets that can't find gif
0 packets discarded because of too many headers
0 failures of source address selection
Source addresses selection rule applied:
icmp6:
0 calls to icmp6_error
0 errors not generated in response to an icmp6 message
0 errors not generated because of rate limitation
0 messages with bad code fields
0 messages < minimum length
0 bad checksums
0 messages with bad length
Histogram of error messages to be generated:
0 no route
0 administratively prohibited
0 beyond scope
0 address unreachable
0 port unreachable
0 packet too big
0 time exceed transit
0 time exceed reassembly
0 erroneous header field
0 unrecognized next header
0 unrecognized option
0 redirect
0 unknown
0 message responses generated
0 messages with too many ND options
0 messages with bad ND options
0 bad neighbor solicitation messages
0 bad neighbor advertisement messages
0 bad router solicitation messages
0 bad router advertisement messages
0 bad redirect messages
0 path MTU changes
rip6:
0 messages received
0 checksum calculations on inbound
0 messages with bad checksum
0 messages dropped due to no socket
0 multicast messages dropped due to no socket
0 messages dropped due to full socket buffers
0 delivered
0 datagrams output
------------------------------------------------------------------------
netstat -m
netstat: invalid address (0x0)
8185/5226/13411 mbufs in use (current/cache/total)
8183/3213/11396/1015850 mbuf clusters in use (current/cache/total/max)
8184/3202 mbuf+clusters out of packet secondary zone in use (current/cache)
0/18/18/507925 4k (page size) jumbo clusters in use (current/cache/total/max)
0/0/0/451488 9k jumbo clusters in use (current/cache/total/max)
0/0/0/338616 16k jumbo clusters in use (current/cache/total/max)
18412K/7804K/26216K bytes allocated to network (current/cache/total)
0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters)
0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters)
0/0/0 requests for jumbo clusters delayed (4k/9k/16k)
0/0/0 requests for jumbo clusters denied (4k/9k/16k)
------------------------------------------------------------------------
netstat -anr
Routing tables
Internet:
Destination Gateway Flags Netif Expire
default 192.168.6.254 UGS igb0
127.0.0.1 link#9 UH lo0
192.168.6.0/24 link#5 U igb0
192.168.6.248 link#5 UHS lo0
Internet6:
Destination Gateway Flags Netif Expire
::/96 ::1 UGRS lo0
::1 link#9 UH lo0
::ffff:0.0.0.0/96 ::1 UGRS lo0
fe80::/10 ::1 UGRS lo0
fe80::%lo0/64 link#9 U lo0
fe80::1%lo0 link#9 UHS lo0
ff01::%lo0/32 ::1 U lo0
ff02::/16 ::1 UGRS lo0
ff02::%lo0/32 ::1 U lo0
------------------------------------------------------------------------
netstat -anA
Active Internet connections (including servers)
Tcpcb Proto Recv-Q Send-Q Local Address Foreign Address (state)
fffff800365d8810 tcp4 0 0 192.168.6.248.22 192.168.6.21.50240 ESTABLISHED
fffff8003665f810 tcp4 0 0 192.168.6.248.22 *.* LISTEN
fffff8003620b310 udp4 0 0 *.514 *.*
fffff8003620b498 udp6 0 0 *.514 *.*
Active UNIX domain sockets
Address Type Recv-Q Send-Q Inode Conn Refs Nextref Addr
fffff80036231960 stream 0 0 0 fffff8003621ae10 0 0
fffff8003621ae10 stream 0 0 0 fffff80036231960 0 0
fffff80036236c30 stream 0 0 fffff8003625d1d8 0 0 0 /var/run/devd.pipe
fffff800362fc960 dgram 0 0 0 fffff8003622d4b0 0 0
fffff8003622d4b0 dgram 0 0 fffff800365cab10 0 fffff800362fc960 0 /var/run/logpriv
fffff8003622d5a0 dgram 0 0 fffff800365cace8 0 0 0 /var/run/log
fffff80036236b40 seqpac 0 0 fffff8003625d000 0 0 0 /var/run/devd.seqpacket.pipe
------------------------------------------------------------------------
netstat -aL
Current listen queue sizes (qlen/incqlen/maxqlen)
Proto Listen Local Address
tcp4 0/0/128 192.168.6.248.ssh
unix 0/0/4 /var/run/devd.pipe
unix 0/0/4 /var/run/devd.seqpacket.pipe
------------------------------------------------------------------------
fstat
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 5 at 0x14000000000
fstat: can't read file 11 at 0x9800000000
fstat: can't read file 17 at 0x9600000000
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0xa00000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read file 8 at 0x4000000001fffff
fstat: can't read file 10 at 0x780000ffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x800000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read file 8 at 0x4000000001fffff
fstat: can't read file 10 at 0x780000ffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0xe00000000
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x400000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read file 8 at 0x4000000001fffff
fstat: can't read file 10 at 0x780000ffff
fstat: can't read file 11 at 0x400000000
fstat: can't read file 13 at 0x200007fffffffff
fstat: can't read file 14 at 0x4000000001fffff
fstat: can't read file 16 at 0x780000ffff
fstat: can't read file 17 at 0x400000000
fstat: can't read file 19 at 0x200007fffffffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x800000000
fstat: can't read file 7 at 0x200007fffffffff
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read file 1 at 0x200007fffffffff
fstat: can't read file 2 at 0x4000000001fffff
fstat: can't read file 4 at 0x780000ffff
fstat: can't read file 5 at 0x800000000
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
fstat: can't read znode_phys at 0x1
USER CMD PID FD MOUNT INUM MODE SZ|DV R/W
root PingTest 59932 root - - error -
root PingTest 59932 wd - - error -
root PingTest 59932 text - - error -
root PingTest 59932 ctty /dev 99 crw--w---- pts/0 rw
root PingTest 59932 0 /dev 99 crw--w---- pts/0 rw
root csh 1541 root - - error -
root csh 1541 wd - - error -
root csh 1541 text - - error -
root csh 1541 ctty /dev 99 crw--w---- pts/0 rw
root su 1540 root - - error -
root su 1540 wd - - error -
root su 1540 text - - error -
root su 1540 ctty /dev 99 crw--w---- pts/0 rw
root su 1540 0 /dev 99 crw--w---- pts/0 rw
joe sh 1538 root - - error -
joe sh 1538 wd - - error -
joe sh 1538 text - - error -
joe sh 1538 ctty /dev 99 crw--w---- pts/0 rw
joe sh 1538 0 /dev 99 crw--w---- pts/0 rw
joe sh 1538 6 /dev 99 crw--w---- pts/0 rw
joe sshd 1537 root - - error -
joe sshd 1537 wd - - error -
joe sshd 1537 text - - error -
joe sshd 1537 0 /dev 8 crw-rw-rw- null rw
joe sshd 1537 6 /dev 8 crw-rw-rw- null rw
root sshd 1534 root - - error -
root sshd 1534 wd - - error -
root sshd 1534 text - - error -
root sshd 1534 0 /dev 8 crw-rw-rw- null r
root getty 1516 root - - error -
root getty 1516 wd - - error -
root getty 1516 text - - error -
root getty 1516 ctty /dev 61 crw------- ttyv7 rw
root getty 1516 0 /dev 61 crw------- ttyv7 rw
root getty 1515 root - - error -
root getty 1515 wd - - error -
root getty 1515 text - - error -
root getty 1515 ctty /dev 60 crw------- ttyv6 rw
root getty 1515 0 /dev 60 crw------- ttyv6 rw
root getty 1514 root - - error -
root getty 1514 wd - - error -
root getty 1514 text - - error -
root getty 1514 ctty /dev 59 crw------- ttyv5 rw
root getty 1514 0 /dev 59 crw------- ttyv5 rw
root getty 1513 root - - error -
root getty 1513 wd - - error -
root getty 1513 text - - error -
root getty 1513 ctty /dev 58 crw------- ttyv4 rw
root getty 1513 0 /dev 58 crw------- ttyv4 rw
root getty 1512 root - - error -
root getty 1512 wd - - error -
root getty 1512 text - - error -
root getty 1512 ctty /dev 57 crw------- ttyv3 rw
root getty 1512 0 /dev 57 crw------- ttyv3 rw
root getty 1511 root - - error -
root getty 1511 wd - - error -
root getty 1511 text - - error -
root getty 1511 ctty /dev 56 crw------- ttyv2 rw
root getty 1511 0 /dev 56 crw------- ttyv2 rw
root getty 1510 root - - error -
root getty 1510 wd - - error -
root getty 1510 text - - error -
root getty 1510 ctty /dev 55 crw------- ttyv1 rw
root getty 1510 0 /dev 55 crw------- ttyv1 rw
root getty 1509 root - - error -
root getty 1509 wd - - error -
root getty 1509 text - - error -
root getty 1509 ctty /dev 54 crw------- ttyv0 rw
root getty 1509 0 /dev 54 crw------- ttyv0 rw
root cron 1462 root - - error -
root cron 1462 wd - - error -
root cron 1462 text - - error -
root cron 1462 0 /dev 8 crw-rw-rw- null rw
root sshd 1458 root - - error -
root sshd 1458 wd - - error -
root sshd 1458 text - - error -
root sshd 1458 0 /dev 8 crw-rw-rw- null rw
root syslogd 1326 root - - error -
root syslogd 1326 wd - - error -
root syslogd 1326 text - - error -
root syslogd 1326 0 /dev 8 crw-rw-rw- null rw
root syslogd 1326 6 /dev 8 crw-rw-rw- null rw
root syslogd 1326 12 /dev 8 crw-rw-rw- null rw
root syslogd 1326 18 - - error -
root devd 1163 root - - error -
root devd 1163 wd - - error -
root devd 1163 text - - error -
root devd 1163 0 /dev 8 crw-rw-rw- null rw
root devd 1163 6 /dev 8 crw-rw-rw- null rw
root moused 1146 root - - error -
root moused 1146 wd - - error -
root moused 1146 text - - error -
root moused 1146 0 /dev 8 crw-rw-rw- null rw
root zfskern 3 root - - error -
root zfskern 3 wd - - error -
root init 1 root - - error -
root init 1 wd - - error -
root init 1 text - - error -
root kernel 0 root - - error -
root kernel 0 wd - - error -
------------------------------------------------------------------------
dmesg
Copyright (c) 1992-2015 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.2-RELEASE-p10 #1 r294714M: Mon Jan 25 12:45:48 UTC 2016
joe@jj.gla.uk.iotx:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Atom(TM) CPU C2750 @ 2.40GHz (2400.06-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x406d8 Family=0x6 Model=0x4d Stepping=8
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x43d8e3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,SSE4.1,SSE4.2,MOVBE,POPCNT,TSCDLT,AESNI,RDRAND>
AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
AMD Features2=0x101<LAHF,Prefetch>
Structured Extended Features=0x2282<TSCADJ,SMEP,ERMS,NFPUSG>
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
TSC: P-state invariant, performance statistics
real memory = 17179869184 (16384 MB)
avail memory = 16539582464 (15773 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INTEL TIANO >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s)
cpu0 (BSP): APIC ID: 0
cpu1 (AP): APIC ID: 2
cpu2 (AP): APIC ID: 4
cpu3 (AP): APIC ID: 6
cpu4 (AP): APIC ID: 8
cpu5 (AP): APIC ID: 10
cpu6 (AP): APIC ID: 12
cpu7 (AP): APIC ID: 14
ioapic0 <Version 2.0> irqs 0-23 on motherboard
netmap: loaded module
random: <Software, Yarrow> initialized
module_register_init: MOD_LOAD (vesa, 0xffffffff80df9540, 0) error 19
kbd1 at kbdmux0
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 350
Event timer "HPET1" frequency 14318180 Hz quality 340
Event timer "HPET2" frequency 14318180 Hz quality 340
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> mem 0xdd9c0000-0xdd9dffff irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
vgapci0: <VGA-compatible display> port 0xd000-0xd07f mem 0xde000000-0xdeffffff,0xdf000000-0xdf01ffff irq 16 at device 0.0 on pci2
vgapci0: Boot video device
pcib3: <ACPI PCI-PCI bridge> mem 0xdd9a0000-0xdd9bffff irq 16 at device 2.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> mem 0xdd980000-0xdd99ffff irq 20 at device 3.0 on pci0
pci4: <ACPI PCI bus> on pcib4
pci4: <network, ethernet> at device 0.0 (no driver attached)
pci4: <network, ethernet> at device 0.1 (no driver attached)
pci4: <network, ethernet> at device 0.2 (no driver attached)
pci4: <network, ethernet> at device 0.3 (no driver attached)
t5nex0: <Chelsio T520-SO> mem 0xdd300000-0xdd37ffff,0xdc000000-0xdcffffff,0xdd884000-0xdd885fff irq 22 at device 0.4 on pci4
cxl0: <port 0> on t5nex0
cxl0: Ethernet address: 00:07:43:33:89:f0
cxl0: 8 txq, 8 rxq (NIC); 8 txq, 2 rxq (TOE); 2 txq, 2 rxq (netmap)
ncxl0: Ethernet address: 00:07:43:33:89:f1
ncxl0: netmap queues/slots: TX 2/1023, RX 2/1024
cxl1: <port 1> on t5nex0
cxl1: Ethernet address: 00:07:43:33:89:f8
cxl1: 8 txq, 8 rxq (NIC); 8 txq, 2 rxq (TOE); 2 txq, 2 rxq (netmap)
ncxl1: Ethernet address: 00:07:43:33:89:f9
ncxl1: netmap queues/slots: TX 2/1023, RX 2/1024
t5nex0: PCIe gen2 x8, 2 ports, 26 MSI-X interrupts, 63 eq, 25 iq
pci4: <mass storage, SCSI> at device 0.5 (no driver attached)
pci4: <serial bus, Fibre Channel> at device 0.6 (no driver attached)
pci0: <base peripheral, IOMMU> at device 15.0 (no driver attached)
igb0: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe0c0-0xe0df mem 0xdd960000-0xdd97ffff,0xdd9ec000-0xdd9effff irq 20 at device 20.0 on pci0
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 0c:c4:7a:7c:58:30
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb0: netmap queues/slots: TX 8/1024, RX 8/1024
igb1: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe0a0-0xe0bf mem 0xdd940000-0xdd95ffff,0xdd9e8000-0xdd9ebfff irq 21 at device 20.1 on pci0
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 0c:c4:7a:7c:58:31
igb1: Bound queue 0 to cpu 0
igb1: Bound queue 1 to cpu 1
igb1: Bound queue 2 to cpu 2
igb1: Bound queue 3 to cpu 3
igb1: Bound queue 4 to cpu 4
igb1: Bound queue 5 to cpu 5
igb1: Bound queue 6 to cpu 6
igb1: Bound queue 7 to cpu 7
igb1: netmap queues/slots: TX 8/1024, RX 8/1024
igb2: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe080-0xe09f mem 0xdd920000-0xdd93ffff,0xdd9e4000-0xdd9e7fff irq 22 at device 20.2 on pci0
igb2: Using MSIX interrupts with 9 vectors
igb2: Ethernet address: 0c:c4:7a:7c:58:32
igb2: Bound queue 0 to cpu 0
igb2: Bound queue 1 to cpu 1
igb2: Bound queue 2 to cpu 2
igb2: Bound queue 3 to cpu 3
igb2: Bound queue 4 to cpu 4
igb2: Bound queue 5 to cpu 5
igb2: Bound queue 6 to cpu 6
igb2: Bound queue 7 to cpu 7
igb2: netmap queues/slots: TX 8/1024, RX 8/1024
igb3: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0xe060-0xe07f mem 0xdd900000-0xdd91ffff,0xdd9e0000-0xdd9e3fff irq 23 at device 20.3 on pci0
igb3: Using MSIX interrupts with 9 vectors
igb3: Ethernet address: 0c:c4:7a:7c:58:33
igb3: Bound queue 0 to cpu 0
igb3: Bound queue 1 to cpu 1
igb3: Bound queue 2 to cpu 2
igb3: Bound queue 3 to cpu 3
igb3: Bound queue 4 to cpu 4
igb3: Bound queue 5 to cpu 5
igb3: Bound queue 6 to cpu 6
igb3: Bound queue 7 to cpu 7
igb3: netmap queues/slots: TX 8/1024, RX 8/1024
ehci0: <Intel Avoton USB 2.0 controller> mem 0xdd9f3000-0xdd9f33ff irq 23 at device 22.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
ahci0: <Intel Avoton AHCI SATA controller> port 0xe150-0xe157,0xe140-0xe143,0xe130-0xe137,0xe120-0xe123,0xe040-0xe05f mem 0xdd9f2000-0xdd9f27ff irq 19 at device 23.0 on pci0
ahci0: AHCI v1.30 with 4 3Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahci1: <Intel Avoton AHCI SATA controller> port 0xe110-0xe117,0xe100-0xe103,0xe0f0-0xe0f7,0xe0e0-0xe0e3,0xe020-0xe03f mem 0xdd9f1000-0xdd9f17ff irq 19 at device 24.0 on pci0
ahci1: AHCI v1.30 with 2 6Gbps ports, Port Multiplier not supported
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff,0xc9000-0xc9fff,0xca000-0xcafff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: CGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3d0-0x3db iomem 0xb8000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est2: <Enhanced SpeedStep Frequency Control> on cpu2
est3: <Enhanced SpeedStep Frequency Control> on cpu3
est4: <Enhanced SpeedStep Frequency Control> on cpu4
est5: <Enhanced SpeedStep Frequency Control> on cpu5
est6: <Enhanced SpeedStep Frequency Control> on cpu6
est7: <Enhanced SpeedStep Frequency Control> on cpu7
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
random: unblocking device.
usbus0: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ada0 at ahcich4 bus 0 scbus4 target 0 lun 0
ada0: <SAMSUNG MZ7KM240HAGR-0E005 GXM1003Q> ACS-2 ATA SATA 3.x device
ada0: Serial Number S2NHNXAG900346Y
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 228936MB (468862128 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad12
ada1 at ahcich5 bus 0 scbus5 target 0 lun 0
ada1: <SAMSUNG MZ7KM240HAGR-0E005 GXM1003Q> ACS-2 ATA SATA 3.x device
ada1: Serial Number S2NHNXAG900330L
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 228936MB (468862128 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad14
SMP: AP CPU #1 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #3 Launched!
Timecounter "TSC-low" frequency 1200028824 Hz quality 1000
Root mount waiting for: usbus0
Root mount waiting for: usbus0
Root mount waiting for: usbus0
Root mount waiting for: usbus0
uhub0: 8 ports with 8 removable, self powered
Root mount waiting for: usbus0
ugen0.2: <vendor 0x8087> at usbus0
uhub1: <vendor 0x8087 product 0x07db, class 9/0, rev 2.00/0.02, addr 2> on usbus0
uhub1: 4 ports with 4 removable, self powered
Root mount waiting for: usbus0
ugen0.3: <vendor 0x0409> at usbus0
uhub2: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr 3> on usbus0
uhub2: 4 ports with 4 removable, self powered
ugen0.4: <vendor 0x0409> at usbus0
uhub3: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr 4> on usbus0
Root mount waiting for: usbus0
uhub3: 3 ports with 3 removable, self powered
ugen0.5: <vendor 0x0557> at usbus0
uhub4: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 5> on usbus0
Root mount waiting for: usbus0
uhub4: 4 ports with 3 removable, self powered
ugen0.6: <vendor 0x0557> at usbus0
ukbd0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 6> on usbus0
kbd2 at ukbd0
Trying to mount root from zfs:zroot/ROOT/default []...
Setting hostuuid: 00000000-0000-0000-0000-0cc47a7c5830.
Setting hostid: 0x824b79f8.
Entropy harvesting: interrupts ethernet point_to_point swi.
Starting file system checks:
Mounting local file systems:.
Writing entropy file:.
Setting hostname: jj.gla.uk.iotx.
Starting Network: lo0 cxl0 ncxl0 cxl1 ncxl1 igb0 igb1 igb2 igb3.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x9
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
cxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:07:43:33:89:f0
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
ncxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 00:07:43:33:89:f1
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
cxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:07:43:33:89:f8
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
ncxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 00:07:43:33:89:f9
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
igb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether 0c:c4:7a:7c:58:30
inet 192.168.6.248 netmask 0xffffff00 broadcast 192.168.6.255
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether 0c:c4:7a:7c:58:31
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
igb2: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether 0c:c4:7a:7c:58:32
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
igb3: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether 0c:c4:7a:7c:58:33
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
Starting devd.
Starting Network: cxl0.
cxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:07:43:33:89:f0
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
Starting Network: ncxl0.
ncxl0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 00:07:43:33:89:f1
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
Starting Network: cxl1.
cxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:07:43:33:89:f8
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
Starting Network: ncxl1.
ncxl1: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 00:07:43:33:89:f9
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet 10Gbase-Twinax <full-duplex>
status: no carrier
Starting Network: igb1.
igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether 0c:c4:7a:7c:58:31
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
Starting Network: igb2.
igb2: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether 0c:c4:7a:7c:58:32
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
Starting Network: igb3.
igb3: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO>
ether 0c:c4:7a:7c:58:33
nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
media: Ethernet autoselect
status: no carrier
Configuring syscons: keymap.
ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 6> on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
Starting ums0 moused.
eval: ${route_route_mngmt,...}: Bad substitution
/etc/rc: WARNING: route_route_mngmt, not found.
/etc/rc: WARNING: route_route_old not found.
add net default: gateway 192.168.6.254
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
Creating and/or trimming log files.
Starting syslogd.
No core dumps found.
ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/llvm37/lib
32-bit compatibility ldconfig path: /usr/lib32
Clearing /tmp (X related).
Updating motd:.
Mounting late file systems:.
Configuring syscons: keymap blanktime.
Performing sanity check on sshd configuration.
Starting sshd.
Starting cron.
Raising kernel security level:
kern.securelevel: -1 -> 1
Starting background file system checks in 60 seconds.
Mon Jan 25 13:39:43 UTC 2016
Jan 25 13:55:37 jj su: joe to root on /dev/pts/0
516.216275 [1233] netmap_mem_global_config reconfiguring
Fatal trap 12: page fault while in kernel mode
cpuid = 4; apic id = 08
fault virtual address = 0x6
fault code = supervisor read data, page not present
instruction pointer = 0x20:0xffffffff804d2269
stack pointer = 0x28:0xfffffe0467ce0420
frame pointer = 0x28:0xfffffe0467ce04f0
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 59932 (PingTest)
trap number = 12
panic: page fault
cpuid = 4
KDB: stack backtrace:
#0 0xffffffff809c5590 at kdb_backtrace+0x60
#1 0xffffffff80989146 at vpanic+0x126
#2 0xffffffff80989013 at panic+0x43
#3 0xffffffff80d8b16b at trap_fatal+0x36b
#4 0xffffffff80d8b46d at trap_pfault+0x2ed
#5 0xffffffff80d8ab0a at trap+0x47a
#6 0xffffffff80d70e82 at calltrap+0x8
#7 0xffffffff806a9ba9 at netmap_do_unregif+0x89
#8 0xffffffff806ab4e1 at netmap_do_regif+0x1a1
#9 0xffffffff806abcb5 at netmap_ioctl+0x755
#10 0xffffffff808706b9 at devfs_ioctl_f+0x139
#11 0xffffffff809dd485 at kern_ioctl+0x255
#12 0xffffffff809dd180 at sys_ioctl+0x140
#13 0xffffffff80d8ba87 at amd64_syscall+0x357
#14 0xffffffff80d7116b at Xfast_syscall+0xfb
Uptime: 39m8s
Dumping 1710 out of 16342 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91%
------------------------------------------------------------------------
kernel config
options CONFIG_AUTOGENERATED
ident GENERIC
machine amd64
cpu HAMMER
makeoptions WITH_CTF=1
makeoptions DEBUG=-g
options XENHVM
options HYPERV
options USB_DEBUG
options ATH_ENABLE_11N
options AH_AR5416_INTERRUPT_MITIGATION
options AH_SUPPORT_AR5416
options IEEE80211_SUPPORT_MESH
options IEEE80211_AMPDU_AGE
options IEEE80211_DEBUG
options SC_PIXEL_MODE
options VESA
options AHD_REG_PRETTY_PRINT
options AHC_REG_PRETTY_PRINT
options ATA_STATIC_ID
options ACPI_DMAR
options SMP
options KDB_TRACE
options KDB
options RCTL
options RACCT_DEFAULT_TO_DISABLED
options RACCT
options INCLUDE_CONFIG_FILE
options DDB_CTF
options KDTRACE_HOOKS
options KDTRACE_FRAME
options MAC
options PROCDESC
options CAPABILITIES
options CAPABILITY_MODE
options AUDIT
options HWPMC_HOOKS
options KBD_INSTALL_CDEV
options PRINTF_BUFR_SIZE=128
options _KPOSIX_PRIORITY_SCHEDULING
options SYSVSEM
options SYSVMSG
options SYSVSHM
options STACK
options KTRACE
options SCSI_DELAY=5000
options COMPAT_FREEBSD7
options COMPAT_FREEBSD6
options COMPAT_FREEBSD5
options COMPAT_FREEBSD4
options COMPAT_FREEBSD32
options GEOM_LABEL
options GEOM_RAID
options GEOM_PART_GPT
options PSEUDOFS
options PROCFS
options CD9660
options MSDOSFS
options NFS_ROOT
options NFSLOCKD
options NFSD
options NFSCL
options MD_ROOT
options QUOTA
options UFS_GJOURNAL
options UFS_DIRHASH
options UFS_ACL
options SOFTUPDATES
options FFS
options SCTP
options TCP_OFFLOAD
options INET6
options INET
options PREEMPTION
options SCHED_ULE
options NEW_PCIB
options GEOM_PART_MBR
options GEOM_PART_EBR_COMPAT
options GEOM_PART_EBR
options GEOM_PART_BSD
device isa
device mem
device io
device uart_ns8250
device cpufreq
device acpi
device pci
device fdc
device ahci
device ata
device mvs
device siis
device ahc
device ahd
device esp
device hptiop
device isp
device mpt
device mps
device mpr
device sym
device trm
device adv
device adw
device aic
device bt
device isci
device scbus
device ch
device da
device sa
device cd
device pass
device ses
device amr
device arcmsr
device ciss
device dpt
device hptmv
device hptnr
device hptrr
device hpt27xx
device iir
device ips
device mly
device twa
device tws
device aac
device aacp
device aacraid
device ida
device mfi
device mlx
device mrsas
device twe
device nvme
device nvd
device atkbdc
device atkbd
device psm
device kbdmux
device vga
device splash
device sc
device vt
device vt_vga
device vt_efifb
device agp
device cbb
device pccard
device cardbus
device uart
device ppc
device ppbus
device lpt
device ppi
device puc
device bxe
device de
device em
device igb
device ix
device ixv
device ixl
device ixlv
device le
device ti
device txp
device vx
device miibus
device ae
device age
device alc
device ale
device bce
device bfe
device bge
device cas
device dc
device et
device fxp
device gem
device hme
device jme
device lge
device msk
device nfe
device nge
device pcn
device re
device rl
device sf
device sge
device sis
device sk
device ste
device stge
device tl
device tx
device vge
device vr
device wb
device xl
device cs
device ed
device ex
device ep
device fe
device sn
device xe
device wlan
device wlan_wep
device wlan_ccmp
device wlan_tkip
device wlan_amrr
device an
device ath
device ath_pci
device ath_hal
device ath_rate_sample
device ipw
device iwi
device iwn
device malo
device mwl
device ral
device wi
device wpi
device loop
device random
device padlock_rng
device rdrand_rng
device ether
device vlan
device tun
device md
device gif
device faith
device firmware
device bpf
device uhci
device ohci
device ehci
device xhci
device usb
device ukbd
device umass
device sound
device snd_cmi
device snd_csa
device snd_emu10kx
device snd_es137x
device snd_hda
device snd_ich
device snd_via8233
device mmc
device mmcsd
device sdhci
device virtio
device virtio_pci
device vtnet
device virtio_blk
device virtio_scsi
device virtio_balloon
device hyperv
device xenpci
device vmx
device netmap
device cxgbe
------------------------------------------------------------------------
ddb capture buffer
ddb: ddb_capture: kvm_nlist
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?DB5PR07MB1685FAFB88A66DDF942874FF9B9E0>
