Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 2 Apr 2009 18:14:37 +0800
From:      =?GB2312?B?tN7R0mNjdWl5eWFuQHNpbmEuY29t?= <ccuiyyan@gmail.com>
To:        freebsd-current@freebsd.org
Subject:   dup() scales badly on multicore platform
Message-ID:  <4451ccf20904020314r7591a546l89573aa76a44143a@mail.gmail.com>

index | next in thread | raw e-mail

[-- Attachment #1 --]
Dear all;

       i benchchmark the dup() system call on 32 cores machine in
FreeBSD-current8.0.

       The results are bad. The phenomenon is easy to come out. Each
process(not thread) on the core

       dup() its private file, and close() in a tight loop. The time
completing the parallel workload

       is considered as performance. At first,  i think there are some
locks. However, lock profiling

       in FreeBSD is strange and interesting. I attach the graph and lock
profiling. Any ideas?



      Best Wishes!


            Yan

[-- Attachment #2 --]
debug.lock.prof.stats: 
     max  wait_max       total  wait_total       count    avg wait_avg cnt_hold cnt_lock name
     639         0        6447           0          46    140      0  0      0 /usr/src/sys/kern/kern_exit.c:399 (sleep mutex:process lock)
    8777         0      521597           0         143   3647      0  0      0 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:em0)
     156         0         638           0           7     91      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:socket)
    1778         0       31496           0          99    318      0  0      0 /usr/src/sys/kern/kern_descrip.c:1445 (sx:filedesc structure)
     756         0        1889           0           7    269      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:512)
     779         0       25097           0          76    330      0  0      0 /usr/src/sys/kern/vfs_lookup.c:716 (lockmgr:crossmp)
    1190         0        8320           0          35    237      0  0      0 /usr/src/sys/dev/usb2/controller/usb2_controller.c:226 (sleep mutex:ehci0)
     458         0        4568           0          38    120      0  0      0 /usr/src/sys/kern/vfs_vnops.c:1037 (sleep mutex:struct mount mtx)
    5654         0      146694           0          46   3189      0  0      0 /usr/src/sys/kern/kern_exit.c:453 (sleep mutex:process lock)
     996         0       15645           0          46    340      0  0      0 /usr/src/sys/kern/kern_descrip.c:1474 (sx:filedesc structure)
     987      1021        8532        1238          29    294     42  0      2 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:vm page queue free mutex)
    1255      2995      201160       41056        1615    124     25  0    194 /usr/src/sys/vm/vm_fault.c:336 (sleep mutex:vm page queue mutex)
     626         0       22135           0         168    131      0  0      0 /usr/src/sys/kern/vfs_mount.c:443 (sleep mutex:struct mount mtx)
    2954         0      572495           0        2189    261      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1294 (sleep mutex:vnode interlock)
     567         0        1399           0           7    199      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:hostcache)
     669         0        2486           0          50     49      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:16)
     950       604       19430         604         147    132      4  0      1 /usr/src/sys/kern/vfs_vnops.c:1074 (sleep mutex:struct mount mtx)
    4461         0      114875           0          46   2497      0  0      0 /usr/src/sys/kern/kern_exit.c:496 (sleep mutex:process lock)
     888         0       11146           0          30    371      0  0      0 /usr/src/sys/kern/vfs_subr.c:1686 (sleep mutex:vnode interlock)
    2804         0       14854           0          22    675      0  0      0 /usr/src/sys/dev/e1000/if_em.c:1031 (sleep mutex:em0)
     449         0        3851           0          38    101      0  0      0 /usr/src/sys/kern/vfs_vnops.c:1096 (sleep mutex:struct mount mtx)
   31220     20331   466506511      223166     1600017    291      0  0    353 /usr/src/sys/kern/kern_descrip.c:710 (sleep mutex:process lock)
     475         0        2971           0          26    114      0  0      0 /usr/src/sys/kern/kern_exec.c:1001 (sleep mutex:process_exec)
     553         0        1482           0          13    114      0  0      0 /usr/src/sys/kern/kern_descrip.c:1547 (sx:filedesc structure)
     186        87         459          87           7     65     12  0      1 /usr/src/sys/kern/kern_sysctl.c:1421 (sleep mutex:Giant)
    8737     15271     4299801      338888       25016    171     13  0    769 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:g_bio)
     724         0        1255           0           7    179      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ttyoutq)
     446         0        2655           0          46     57      0  0      0 /usr/src/sys/kern/kern_descrip.c:1574 (sx:filedesc structure)
     582         0        1374           0           7    196      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:KNOTE)
   17068     15023    24074540      916282       98813    243      9  0   1414 /usr/src/sys/geom/geom_io.c:68 (sleep mutex:bio queue)
     939        25       54938          25         444    123      0  0      1 /usr/src/sys/kern/kern_sig.c:981 (sleep mutex:process lock)
     446         0        3544           0          46     77      0  0      0 /usr/src/sys/kern/kern_descrip.c:1598 (sx:filedesc structure)
      97         0          97           0           1     97      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:4071 (sleep mutex:Softdep Lock)
     451         0        2888           0          46     62      0  0      0 /usr/src/sys/kern/kern_descrip.c:1603 (sx:filedesc structure)
     735         0        5237           0          25    209      0  0      0 /usr/src/sys/kern/vfs_bio.c:3183 (sleep mutex:vm object)
     129         0         647           0           7     92      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_stream_msg_out)
    3736         0       64537           0          60   1075      0  0      0 /usr/src/sys/vm/vm_map.c:1676 (sx:user map)
   30700       945     4921946        3421       15864    310      0  0      7 /usr/src/sys/kern/vfs_bio.c:2429 (sleep mutex:bufobj interlock)
    6503         0       63665           0         399    159      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:g_bio)
      38         0          77           0           4     19      0  0      0 /usr/src/sys/kern/kern_proc.c:319 (sleep mutex:process group)
  165169         0      902463           0          14  64461      0  0      0 /usr/src/sys/vm/vm_glue.c:687 (sx:allproc)
    1106         0       41637           0         143    291      0  0      0 /usr/src/sys/kern/vfs_bio.c:2077 (sleep mutex:buffer daemon lock)
    5576         0      104498           0          67   1559      0  0      0 /usr/src/sys/kern/imgact_elf.c:323 (sx:user map)
     741       936        3761         936          18    208     52  0      1 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:g_bio)
    1171         0       12603           0          18    700      0  0      0 /usr/src/sys/kern/vfs_subr.c:3420 (sleep mutex:bufobj interlock)
    2838         0      396115           0         360   1100      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1535 (sleep mutex:ohci0)
     902         0        2465           0           7    352      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:128)
     635         0        8666           0          46    188      0  0      0 /usr/src/sys/kern/kern_descrip.c:1702 (sx:filedesc structure)
     740         0        7048           0          46    153      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:VMSPACE)
    3129         0       86013           0         195    441      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:2470 (sleep mutex:vm page queue mutex)
     445         0         774           0           5    154      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:SLEEPQUEUE)
     949         0       58109           0         305    190      0  0      0 /usr/src/sys/kern/kern_descrip.c:1711 (sx:filedesc structure)
      36         0          52           0           2     26      0  0      0 /usr/src/sys/kern/kern_proc.c:377 (sleep mutex:process group)
    1123         0       21286           0          46    462      0  0      0 /usr/src/sys/kern/kern_descrip.c:1718 (sx:filedesc structure)
     714         0        1682           0          13    129      0  0      0 /usr/src/sys/kern/kern_exec.c:358 (sleep mutex:process lock)
     897         0        1427           0           3    475      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:964 (lockmgr:devfs)
    7402      1950     1425244       32506        1190   1197     27  0     35 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:process lock)
   10558         0      770046           0         360   2139      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1589 (sleep mutex:ohci0)
    8326         0      429997           0         256   1679      0  0      0 /usr/src/sys/kern/vfs_lookup.c:442 (lockmgr:ufs)
    1058      8065       30427       99710         323     94    308  0     31 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:selfd)
     866         0       49702           0         284    175      0  0      0 /usr/src/sys/netinet6/frag6.c:723 (sleep mutex:ip6qlock)
    9261         0      493619           0        3116    158      0  0      0 /usr/src/sys/kern/vfs_bio.c:1965 (sleep mutex:system map)
     954      3703      227715        4946        1915    118      2  0      6 /usr/src/sys/amd64/amd64/trap.c:647 (sleep mutex:process lock)
     476         0        1519           0          18     84      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:MAP ENTRY)
    1674       797      232378         797        1915    121      0  0      1 /usr/src/sys/amd64/amd64/trap.c:656 (sleep mutex:process lock)
     431         0         775           0           3    258      0  0      0 /usr/src/sys/kern/kern_proc.c:449 (sleep mutex:process group)
     258         0         401           0           3    133      0  0      0 /usr/src/sys/kern/kern_proc.c:450 (sleep mutex:process group)
   47708       542     1697205         542        3116    544      0  0      1 /usr/src/sys/kern/vfs_bio.c:2590 (sleep mutex:bufobj interlock)
    1655         0       15946           0          25    637      0  0      0 /usr/src/sys/kern/vfs_bio.c:3396 (sleep mutex:vm object)
     752         0       24084           0         143    168      0  0      0 /usr/src/sys/dev/e1000/if_em.c:1332 (sleep mutex:em0)
     846         0       10145           0          36    281      0  0      0 /usr/src/sys/dev/usb2/controller/ohci2.c:2825 (sleep mutex:ohci0)
     611         0        2073           0          15    138      0  0      0 /usr/src/sys/kern/kern_descrip.c:1833 (sx:filedesc structure)
    1263         0       10085           0          35    288      0  0      0 /usr/src/sys/dev/usb2/controller/ehci2.c:3929 (sleep mutex:ehci0)
     392         0         693           0           2    346      0  0      0 /usr/src/sys/kern/kern_prot.c:391 (sx:proctree)
     452         0        1755           0          13    135      0  0      0 /usr/src/sys/kern/kern_descrip.c:1857 (sx:filedesc structure)
    1611      1100      133423       45420         720    185     63  0    125 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1703 (sleep mutex:ohci0)
      25         0          79           0           4     19      0  0      0 /usr/src/sys/kern/kern_proc.c:527 (sleep mutex:process group)
    3083      2857       82367        7488          71   1160    105  0      9 /usr/src/sys/dev/usb2/controller/usb2_controller.c:211 (sleep mutex:Giant)
     127         0         208           0          10     20      0  0      0 /usr/src/sys/kern/kern_descrip.c:1882 (sx:filedesc structure)
    6675         0      130067           0          70   1858      0  0      0 /usr/src/sys/kern/vfs_vnops.c:293 (lockmgr:ufs)
    1723         0       41879           0         106    395      0  0      0 /usr/src/sys/kern/vfs_bio.c:3468 (sleep mutex:vm object)
    1927         0      155909           0         227    686      0  0      0 /usr/src/sys/net/bpf.c:1641 (sleep mutex:bpf interface lock)
    2895         0      387818           0         350   1108      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1535 (sleep mutex:ehci0)
     721         0        9703           0          34    285      0  0      0 /usr/src/sys/kern/vfs_subr.c:2090 (sleep mutex:vnode interlock)
     637         0        1458           0           7    208      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:mt_zone)
    1535         0       10014           0          13    770      0  0      0 /usr/src/sys/kern/kern_exec.c:572 (sleep mutex:process lock)
     729         0       99681           0         645    154      0  0      0 /usr/src/sys/kern/vfs_subr.c:2100 (sleep mutex:vnode interlock)
     870       543       40142        4054         456     88      8  0     31 /usr/src/sys/vm/vm_object.c:1238 (sleep mutex:vm object)
   12233         0       55269           0          20   2763      0  0      0 /usr/src/sys/kern/uipc_sockbuf.c:148 (sx:so_snd_sx)
     179         0         657           0           7     93      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:32)
     586         0        3695           0          29    127      0  0      0 /usr/src/sys/vm/vm_map.c:3257 (sleep mutex:system map)
     986       278       60908        2456         216    281     11  0     32 /usr/src/sys/amd64/amd64/pmap.c:2717 (sleep mutex:vm page queue mutex)
     452         0        1634           0          14    116      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:512)
     718         0        4278           0          18    237      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1276 (sleep mutex:struct mount mtx)
    1585      7417      221595       25912        1680    131     15  0     48 /usr/src/sys/kern/vfs_subr.c:2127 (sleep mutex:vnode interlock)
     936         0        4648           0          18    258      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1285 (sleep mutex:struct mount mtx)
    1041         0      159553           0         687    232      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1810 (sleep mutex:ohci0)
     188         0         406           0           4    101      0  0      0 /usr/src/sys/kern/tty.c:1515 (sleep mutex:ttymtx)
     920      1116       38707        4755         432     89     11  0     23 /usr/src/sys/vm/vm_object.c:1271 (sleep mutex:vm object)
     766         0        2060           0          13    158      0  0      0 /usr/src/sys/vm/vm_map.c:2871 (sleep mutex:process lock)
    7743         0      819170           0         350   2340      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1589 (sleep mutex:ehci0)
     113         0         570           0           7     81      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:SWAPMETA)
     968       652      208093        4791        1355    153      3  0     14 /usr/src/sys/kern/vfs_subr.c:2166 (sleep mutex:vnode interlock)
     619         0       22548           0         181    124      0  0      0 /usr/src/sys/vm/uma_core.c:2464 (sleep mutex:UMA Slabs)
     653         0        2806           0          50     56      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:16)
     607         0        2511           0          26     96      0  0      0 /usr/src/sys/vm/vm_glue.c:270 (sleep mutex:vm page queue mutex)
     468         0        4879           0          45    108      0  0      0 /usr/src/sys/kern/kern_sig.c:656 (sleep mutex:sigacts)
     533         0         988           0           2    494      0  0      0 /usr/src/sys/netinet6/in6_rmx.c:384 (rw:radix node head)
     490         0        3323           0          25    132      0  0      0 /usr/src/sys/kern/vfs_subr.c:2198 (sleep mutex:vnode interlock)
   54489         0     5307152           0        3115   1703      0  0      0 /usr/src/sys/kern/vfs_bio.c:3611 (sleep mutex:vm object)
     723         0        1710           0           7    244      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:64)
    8387         0     2624414           0        9287    282      0  0      0 /usr/src/sys/kern/kern_descrip.c:2052 (sx:filedesc structure)
     461         0        3902           0          26    150      0  0      0 /usr/src/sys/vm/vm_glue.c:306 (sleep mutex:vm page queue mutex)
     603         0        1074           0           7    153      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:FFS inode)
     983         0      212970           0        1004    212      0  0      0 /usr/src/sys/kern/vfs_subr.c:2227 (sleep mutex:vnode interlock)
     874         0        2480           0           7    354      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:mbuf_cluster)
     750         0        1588           0           7    226      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:16 Bucket)
     156         0         627           0           7     89      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ata_request)
     957      2841      225442       37882        1944    115     19  0    185 /usr/src/sys/vm/vm_fault.c:935 (sleep mutex:vm page queue mutex)
    1625      1228      137440       48705         700    196     69  0    129 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1703 (sleep mutex:ehci0)
     818         0       53657           0         405    132      0  0      0 /usr/src/sys/kern/vfs_subr.c:2256 (sleep mutex:vnode interlock)
     131         0         602           0           7     86      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:VNODE)
    1939      1731      336235       28937         720    466     40  0     33 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1942 (sleep mutex:ohci0)
     590         0        1127           0           7    161      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ksiginfo)
    6409         0      474699           0        3132    151      0  0      0 /usr/src/sys/kern/vfs_subr.c:2279 (sleep mutex:vnode interlock)
    5788         0      193836           0          96   2019      0  0      0 /usr/src/sys/kern/vfs_vnops.c:531 (lockmgr:ufs)
    4049         0       10626           0          13    817      0  0      0 /usr/src/sys/vm/vm_kern.c:432 (sx:user map)
     201         0         891           0          35     25      0  0      0 /usr/src/sys/kern/sys_pipe.c:578 (sleep mutex:pipe mutex)
     633         0        9897           0          66    149      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:256)
     607         0        6293           0          45    139      0  0      0 /usr/src/sys/kern/vfs_subr.c:2302 (sleep mutex:vnode interlock)
   10590         0       99954           0          36   2776      0  0      0 /usr/src/sys/dev/usb2/core/usb2_hub.c:1351 (sleep mutex:ohci0)
    4844         0       39147           0          13   3011      0  0      0 /usr/src/sys/vm/vm_kern.c:463 (sx:user map)
     850         0        1315           0           7    187      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:rtentry)
     579         0       24641           0         121    203      0  0      0 /usr/src/sys/kern/vfs_hash.c:71 (sleep mutex:vfs hash)
   69732      1792   467706570      149826     1600109    292      0  0    276 /usr/src/sys/kern/kern_descrip.c:1342 (sleep mutex:process lock)
     450         0         989           0          33     29      0  0      0 /usr/src/sys/kern/sys_pipe.c:615 (sleep mutex:pipe mutex)
    2058       779      785397       12775        2099    374      6  0     77 /usr/src/sys/vm/vm_fault.c:1029 (sleep mutex:vm page queue mutex)
    1849         0      158098           0         491    321      0  0      0 /usr/src/sys/kern/vfs_subr.c:2351 (sleep mutex:vnode interlock)
    1693         0      147638           0         646    228      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1810 (sleep mutex:ehci0)
    2305      1664      585153       26311        1944    301     13  0    141 /usr/src/sys/amd64/amd64/pmap.c:2964 (sleep mutex:vm page queue mutex)
      93         0         295           0           5     59      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:pipe)
     519         0        1014           0           7    144      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_asconf)
     170         0         733           0           7    104      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:TURNSTILE)
      98         0         564           0           7     80      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:MAP)
     143         0         602           0           7     86      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:NAMEI)
     472         0        2534           0          46     55      0  0      0 /usr/src/sys/kern/kern_event.c:1731 (sleep mutex:process lock)
     455         0        2762           0          27    102      0  0      0 /usr/src/sys/kern/kern_exec.c:952 (sleep mutex:vm page queue mutex)
   11038         0       30125           0          17   1772      0  0      0 /usr/src/sys/kern/uipc_sockbuf.c:148 (sx:so_rcv_sx)
     889         0        1931           0          20     96      0  0      0 /usr/src/sys/kern/uipc_socket.c:1141 (sleep mutex:so_snd)
     685         0        7848           0          20    392      0  0      0 /usr/src/sys/kern/vfs_vnops.c:676 (lockmgr:ufs)
     608         0        6433           0          46    139      0  0      0 /usr/src/sys/kern/kern_exit.c:497 (sleep mutex:sigacts)
     854         0        4266           0          27    158      0  0      0 /usr/src/sys/kern/kern_exec.c:974 (sleep mutex:vm page queue mutex)
    1047         0        4872           0          22    221      0  0      0 /usr/src/sys/net/route.c:291 (rw:radix node head)
     534         0         995           0           7    142      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:VNODEPOLL)
     396         0        1040           0           7    148      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:VM OBJECT)
     612         0        3872           0          46     84      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:PROC)
     557         0        2275           0          13    175      0  0      0 /usr/src/sys/kern/kern_sig.c:939 (sleep mutex:sigacts)
     893         0        5992           0          36    166      0  0      0 /usr/src/sys/dev/usb2/core/usb2_hub.c:1518 (sleep mutex:ohci0)
    1978      2070      324218       54795         700    463     78  0     54 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1942 (sleep mutex:ehci0)
     128         0         739           0          10     73      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:PROC)
     658         0        3084           0          16    192      0  0      0 /usr/src/sys/kern/kern_resource.c:1198 (rw:uidinfo hash)
   21075       276      186423         789         341    546      2  0      7 /usr/src/sys/vm/vm_object.c:1662 (sleep mutex:vm object)
     540         0        1807           0           7    258      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sackhole)
    6239         0       88163           0          35   2518      0  0      0 /usr/src/sys/dev/usb2/core/usb2_hub.c:1351 (sleep mutex:ehci0)
     520         0        1376           0           7    196      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:FFS1 dinode)
     465         0       13892           0         115    120      0  0      0 /usr/src/sys/vm/vm_mmap.c:1373 (sleep mutex:process lock)
     436         0         912           0           7    130      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:32 Bucket)
     920      6694       12838        8610         160     80     53  0     11 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:sellck)
     753         0        2269           0           7    324      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:tcpcb)
      95         0         189           0           2     94      0  0      0 /usr/src/sys/kern/vfs_syscalls.c:1169 (lockmgr:devfs)
    9186         0       14190           0           3   4730      0  0      0 /usr/src/sys/kern/tty.c:1192 (sleep mutex:process group)
    8555         0       13115           0           3   4371      0  0      0 /usr/src/sys/kern/kern_sig.c:1805 (sleep mutex:process lock)
    5272         0      110465           0          49   2254      0  0      0 /usr/src/sys/vm/vm_mmap.c:576 (sx:user map)
     705         0        1733           0          13    133      0  0      0 /usr/src/sys/vm/vm_object.c:1738 (sleep mutex:vm object)
     131         0         593           0           7     84      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ata_composite)
     844         0        8037           0          65    123      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:4918 (sleep mutex:Softdep Lock)
    5961     22422      490335      780349        3116    157    250  0    945 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:sleep mtxpool)
    1656         0     2278189           0        7974    285      0  0      0 /usr/src/sys/kern/sys_generic.c:781 (sx:filedesc structure)
     643         0        8694           0          75    115      0  0      0 /usr/src/sys/vm/vm_map.c:1075 (sleep mutex:vm object)
    1054        37       51871          37         248    209      0  0      1 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:mbuf)
     197         0         922           0          30     30      0  0      0 /usr/src/sys/vm/vm_object.c:1799 (sleep mutex:vm object)
    7974     52578      298977      276284        1212    246    227  0    176 /usr/src/sys/vm/vm_glue.c:689 (sleep mutex:process lock)
   20867         0      360798           0          61   5914      0  0      0 /usr/src/sys/vm/vm_map.c:2556 (sx:user map)
     930         0        6592           0          35    188      0  0      0 /usr/src/sys/dev/usb2/core/usb2_hub.c:1518 (sleep mutex:ehci0)
   36862         0    10452056           0        6254   1671      0  0      0 /usr/src/sys/geom/geom_disk.c:199 (sleep mutex:g_disk_done)
     455         0        1892           0          34     55      0  0      0 /usr/src/sys/kern/sys_pipe.c:982 (sleep mutex:pipe mutex)
    1575         0      105369           0         256    411      0  0      0 /usr/src/sys/kern/vfs_lookup.c:188 (sx:filedesc structure)
     573         0        1032           0           7    147      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:1024)
     137         0         602           0           7     86      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_asconf_ack)
    1068         0       78059           0         360    216      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:2455 (sleep mutex:ohci0)
      88         0          88           0           1     88      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:993 (sleep mutex:Softdep Lock)
     174         0         733           0           7    104      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ripcb)
    1644         0       21019           0          46    456      0  0      0 /usr/src/sys/kern/kern_fork.c:320 (sx:allproc)
     502         0        5652           0          49    115      0  0      0 /usr/src/sys/vm/vm_object.c:1958 (sleep mutex:vm object)
     514         0        7160           0          59    121      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:256)
   12052         0      120409           0          94   1280      0  0      0 /usr/src/sys/kern/sys_generic.c:974 (sx:filedesc structure)
     869         0        3797           0           6    632      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:351 (sleep mutex:vnode interlock)
   67089         0      822984           0          43  19139      0  0      0 /usr/src/sys/vm/vm_map.c:2730 (sx:user map)
     110         0         560           0           7     80      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:64 Bucket)
    5586         0        7168           0          34    210      0  0      0 /usr/src/sys/kern/sys_pipe.c:1138 (sleep mutex:pipe mutex)
     341         0        1226           0          32     38      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:cpuset)
  105698         0    29262696           0        7974   3669      0  0      0 /usr/src/sys/kern/sys_generic.c:1016 (sx:filedesc structure)
     909         0       10026           0          48    208      0  0      0 /usr/src/sys/kern/vfs_subr.c:1633 (sleep mutex:Syncer mtx)
      92         0         462           0           6     77      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:TURNSTILE)
     938         0        1705           0           3    568      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:837 (sleep mutex:vm object)
     124         0         629           0           7     89      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:FFS2 dinode)
    3934       724      252170       14744         638    395     23  0    120 /usr/src/sys/amd64/amd64/pmap.c:3522 (sleep mutex:vm page queue mutex)
     657         0        1370           0          17     80      0  0      0 /usr/src/sys/kern/uipc_socket.c:1423 (sleep mutex:so_rcv)
    1709         0        4482           0          22    203      0  0      0 /usr/src/sys/net/route.c:299 (sleep mutex:rtentry)
     639         0        1140           0          19     60      0  0      0 /usr/src/sys/kern/uipc_sockbuf.c:536 (sleep mutex:so_snd)
     605         0       12444           0         108    115      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:SLEEPQUEUE)
     295        15        1785          15          27     66      0  0      1 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:VM OBJECT)
   10552         0       40101           0          30   1336      0  0      0 /usr/src/sys/kern/vfs_subr.c:1718 (sleep mutex:Syncer mtx)
     731         0        1801           0           7    257      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:umtx pi)
    1106         0        6185           0          13    475      0  0      0 /usr/src/sys/vm/vm_map.c:2875 (sx:user map)
     453         0        1512           0           8    189      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:SLEEPQUEUE)
    5982         0      531271           0        3140    169      0  0      0 /usr/src/sys/kern/vfs_bio.c:329 (sleep mutex:runningbufspace lock)
   14271         0      288777           0          32   9024      0  0      0 /usr/src/sys/kern/sys_generic.c:1140 (sx:filedesc structure)
    1024         0       68414           0         350    195      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:2455 (sleep mutex:ehci0)
     436         0         923           0           7    131      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:mbuf_jumbo_page)
     960         0       95161           0         921    103      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:MAP ENTRY)
     922         0       19734           0         128    154      0  0      0 /usr/src/sys/vm/vm_glue.c:179 (sx:user map)
      93         0         583           0           7     83      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:itimer)
    7023         0      486422           0        3112    156      0  0      0 /usr/src/sys/kern/vfs_bio.c:381 (sleep mutex:runningbufspace lock)
     487         0        2477           0          19    130      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:MAP ENTRY)
     898         0        8508           0          46    184      0  0      0 /usr/src/sys/kern/kern_fork.c:311 (sx:proctree)
    8088       186       30756         333         132    233      2  0      4 /usr/src/sys/kern/sys_pipe.c:1350 (sleep mutex:pipe mutex)
     711         0        1195           0           7    170      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:audit_record)
    2790      2240      453750      217852         710    639    306  0    334 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:USB device mutex)
     675       187       52092         254         588     88      0  0      3 /usr/src/sys/vm/vm_object.c:236 (sleep mutex:vm object_list)
    3141         0       76893           0          75   1025      0  0      0 /usr/src/sys/vm/vm_map.c:1583 (sleep mutex:vm object)
     106         0         557           0           7     79      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:128 Bucket)
    1709         0        6218           0          17    365      0  0      0 /usr/src/sys/kern/uipc_socket.c:1669 (sleep mutex:so_rcv)
   18098         0     3511188           0         710   4945      0  0      0 /usr/src/sys/dev/usb2/core/usb2_request.c:319 (sleep mutex:USB device mutex)
    7469         0      533410           0        3138    169      0  0      0 /usr/src/sys/kern/vfs_bio.c:3815 (sleep mutex:bufobj interlock)
    1644         0      564190           0        2189    257      0  0      0 /usr/src/sys/kern/vfs_subr.c:3188 (sleep mutex:vnode interlock)
    1044         0       56621           0         248    228      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:mbuf)
    1700     26673      529134      118955        3139    168     37  0     13 /usr/src/sys/kern/vfs_bio.c:3825 (sleep mutex:bufobj interlock)
     518         0         966           0           2    483      0  0      0 /usr/src/sys/vm/vnode_pager.c:935 (sleep mutex:vm page queue mutex)
     760         0        2237           0           7    319      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:2048)
    1055         0       25667           0         185    138      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:512)
     522         0        1347           0           7    192      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:unpcb)
     698         0        2509           0          14    179      0  0      0 /usr/src/sys/kern/vfs_subr.c:1964 (sleep mutex:Syncer mtx)
   14939      2797      257416        2797          56   4596     49  0      1 /usr/src/sys/amd64/amd64/pmap.c:3822 (sleep mutex:vm page queue mutex)
     903        58       35066          58         200    175      0  0      1 /usr/src/sys/vm/vm_page.c:546 (sleep mutex:vm page queue mutex)
      97         0         401           0           6     66      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:512)
   16652         0     5237902           0       10239    511      0  0      0 /usr/src/sys/netinet/tcp_subr.c:1549 (sleep mutex:isn_mtx)
    6593      1682      441774        8070         465    950     17  0     12 /usr/src/sys/vm/vm_object.c:671 (sleep mutex:vm page queue mutex)
  224208         0     1805471           0          36  50151      0  0      0 /usr/src/sys/kern/vfs_mount.c:2055 (sleep mutex:struct mount mtx)
     980         0       23579           0         138    170      0  0      0 /usr/src/sys/kern/kern_exit.c:238 (sleep mutex:process_exit)
    1032         0        9015           0          36    250      0  0      0 /usr/src/sys/kern/vfs_mount.c:2090 (sleep mutex:struct mount mtx)
    3459         0      220793           0         504    438      0  0      0 /usr/src/sys/kern/vfs_cache.c:480 (sleep mutex:vnode interlock)
     131         0         789           0          17     46      0  0      0 /usr/src/sys/kern/uipc_socket.c:1825 (sleep mutex:so_rcv)
    1801         0       27470           0          46    597      0  0      0 /usr/src/sys/kern/kern_fork.c:600 (sx:proctree)
     753         0        3660           0          19    192      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:64 Bucket)
     733         0        2352           0           7    336      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:Files)
     862         0        1925           0           3    641      0  0      0 /usr/src/sys/fs/devfs/devfs_vfsops.c:157 (sx:devfsmount)
  369166         0    12516404           0        2155   5808      0  0      0 /usr/src/sys/vm/vm_map.c:3257 (sx:user map)
     119         0         541           0           6     90      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3765 (sleep mutex:process lock)
     148         0         631           0           7     90      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ipq)
     452         0        3326           0          19    175      0  0      0 /usr/src/sys/kern/kern_prot.c:1210 (sleep mutex:process lock)
     700         0        1473           0           6    245      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:355 (sx:devfsmount)
     762         0       16261           0         154    105      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:128)
     100         0         554           0           7     79      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:tcpreass)
     444         0         909           0           6    151      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3838 (sleep mutex:process lock)
    3990         0       66694           0          35   1905      0  0      0 /usr/src/sys/kern/kern_time.c:674 (sleep mutex:process lock)
     745        77       69715          77         465    149      0  0      1 /usr/src/sys/vm/vm_object.c:607 (sleep mutex:vm object_list)
     666         0        6613           0          36    183      0  0      0 /usr/src/sys/kern/vfs_subr.c:3226 (sleep mutex:vnode_free_list)
    5745        15       17168          15          22    780      0  0      1 /usr/src/sys/kern/tty_ttydisc.c:467 (sleep mutex:ttymtx)
     724         0        1745           0           7    249      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:mbuf_jumbo_9k)
     892      1758        8029        2376          28    286     84  0      2 /usr/src/sys/vm/vm_pageout.c:1454 (sleep mutex:vm page queue free mutex)
   16187         0      132196           0          13  10168      0  0      0 /usr/src/sys/kern/imgact_elf.c:675 (lockmgr:ufs)
     922         0       12487           0          84    148      0  0      0 /usr/src/sys/kern/kern_sig.c:2007 (sleep mutex:sigacts)
    1088         0       36545           0          87    420      0  0      0 /usr/src/sys/kern/vfs_hash.c:79 (sleep mutex:vnode interlock)
      31         0          31           0           1     31      0  0      0 /usr/src/sys/libkern/arc4random.c:61 (sleep mutex:arc4_mtx)
     911       965      142271        2925         921    154      3  0      6 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:MAP ENTRY)
   25011      8919     2420099      112094       15891    152      7  0    275 /usr/src/sys/vm/vm_page.c:1049 (sleep mutex:vm page queue free mutex)
     647       326        1674         554          19     88     29  0      3 /usr/src/sys/kern/tty_pts.c:116 (sleep mutex:ttymtx)
     897         0       14832           0          93    159      0  0      0 /usr/src/sys/kern/kern_proc.c:291 (sx:allproc)
     828         0        4760           0          24    198      0  0      0 /usr/src/sys/kern/vfs_bio.c:283 (sleep mutex:needsbuffer lock)
   26701      6469     8909508      188203        6740   1321     27  0    236 /usr/src/sys/dev/ata/ata-queue.c:194 (sleep mutex:ATA state lock)
     496         0        2201           0          13    169      0  0      0 /usr/src/sys/libkern/arc4random.c:138 (sleep mutex:arc4_mtx)
    9271      1040     2458626        6616       15750    156      0  0     13 /usr/src/sys/kern/vfs_bio.c:310 (sleep mutex:needsbuffer lock)
    1211         0        4826           0          14    344      0  0      0 /usr/src/sys/kern/tty_pts.c:196 (sleep mutex:ttymtx)
   11942     21239     2477214       94743       15823    156      5  0     38 /usr/src/sys/kern/vfs_bio.c:1438 (sleep mutex:buf queue lock)
     125         0         607           0           7     86      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:4096)
   10439     19035     2466867      183866       15724    156     11  0     79 /usr/src/sys/kern/vfs_bio.c:352 (sleep mutex:needsbuffer lock)
    1602         0        5481           0          18    304      0  0      0 /usr/src/sys/kern/vfs_subr.c:3186 (sleep mutex:struct mount mtx)
    2384         0        7950           0          13    611      0  0      0 /usr/src/sys/kern/imgact_elf.c:820 (lockmgr:ufs)
    1652         0      292301           0         987    296      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:32)
      88         0         176           0           2     88      0  0      0 /usr/src/sys/vm/vm_pager.c:413 (sleep mutex:pbuf mutex)
     723         0        1223           0           7    174      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:g_bio)
    3899         0      110381           0         140    788      0  0      0 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:Syncer mtx)
    1017         0       61069           0         286    213      0  0      0 /usr/src/sys/kern/kern_kthread.c:201 (sleep mutex:process lock)
     746         0        6139           0          25    245      0  0      0 /usr/src/sys/kern/vfs_bio.c:3407 (sleep mutex:vm page queue mutex)
     753         0        1870           0           7    267      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:DP fakepg)
     742        85       15589          85          95    164      0  0      1 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:512)
    1315         0        6512           0          28    232      0  0      0 /usr/src/sys/vm/vm_pageout.c:1486 (sleep mutex:vm page queue mutex)
   90118         0     2196631           0         639   3437      0  0      0 /usr/src/sys/kern/vfs_subr.c:2092 (lockmgr:ufs)
     708         0        1622           0           7    231      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:THREAD)
     667       125        1135         393          12     94     32  0      7 /usr/src/sys/kern/tty_pts.c:317 (sleep mutex:ttymtx)
    7536      2401    18573163       41253       65598    283      0  0     61 /usr/src/sys/kern/kern_conf.c:71 (sleep mutex:cdev)
     663       774       10858        4028         106    102     38  0     21 /usr/src/sys/kern/vfs_bio.c:3469 (sleep mutex:vm page queue mutex)
     901         0       12432           0          46    270      0  0      0 /usr/src/sys/kern/kern_fork.c:442 (sleep mutex:process lock)
     709         0        5909           0          46    128      0  0      0 /usr/src/sys/kern/kern_fork.c:443 (sleep mutex:process lock)
     717         0       13885           0         100    138      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:64)
    1475         0      163429           0         603    271      0  0      0 /usr/src/sys/kern/vfs_cache.c:338 (rw:Name Cache)
     472         0        2500           0          37     67      0  0      0 /usr/src/sys/kern/subr_unit.c:623 (sleep mutex:TID lock)
   16847       847      954568       20811        6254    152      3  0     65 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:ata_request)
    1024         0       48942           0         227    215      0  0      0 /usr/src/sys/net/bpf.c:1645 (sleep mutex:bpf)
    9365         0       15795           0           3   5265      0  0      0 /usr/src/sys/kern/tty_pts.c:385 (sleep mutex:ttymtx)
    3900      1262       19598        4874          99    197     49  0     17 /usr/src/sys/kern/tty_pts.c:400 (sleep mutex:ttymtx)
     865         0        2115           0          22     96      0  0      0 /usr/src/sys/net/if.c:2885 (sleep mutex:em0)
    1678     18926     2260649     3208378        7872    287    407  0    725 /usr/src/sys/kern/kern_conf.c:422 (sleep mutex:Giant)
     650         0        2733           0          37     73      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:ksiginfo)
    5024         0       67315           0          25   2692      0  0      0 /usr/src/sys/kern/vfs_subr.c:2197 (lockmgr:ufs)
     708         0        1653           0           7    236      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:VMSPACE)
    1127         0       15500           0          46    336      0  0      0 /usr/src/sys/kern/kern_fork.c:512 (sleep mutex:process lock)
     917         0       46494           0         284    163      0  0      0 /usr/src/sys/netinet/tcp_timer.c:136 (rw:tcp)
     870         0        9297           0          46    202      0  0      0 /usr/src/sys/kern/kern_fork.c:513 (sleep mutex:process lock)
    1683    101889     2267373     3829747        7937    285    482  0    784 /usr/src/sys/kern/kern_conf.c:454 (sleep mutex:Giant)
     181         0         537           0           3    179      0  0      0 /usr/src/sys/netinet/tcp_timer.c:168 (rw:tcp)
     473         0        1373           0           8    171      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:ksiginfo)
    1079         0       38656           0         142    272      0  0      0 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:fdc lock)
     440         0         934           0           7    133      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:selfd)
     871         0        2436           0           7    348      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:UMA Zones)
   20974       501     1079346         701        3117    346      0  0      3 /usr/src/sys/kern/vfs_bio.c:1708 (sleep mutex:buf queue lock)
    1321      5045      313127       22317        2131    146     10  0     34 /usr/src/sys/vm/vm_page.c:1416 (sleep mutex:vm page queue free mutex)
     903         0        4810           0          18    267      0  0      0 /usr/src/sys/kern/vfs_subr.c:3437 (sleep mutex:struct mount mtx)
     141         0         609           0           7     87      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:mbuf_jumbo_16k)
    1501         0       25645           0          46    557      0  0      0 /usr/src/sys/kern/kern_fork.c:602 (sleep mutex:process lock)
    1094         0       17606           0          46    382      0  0      0 /usr/src/sys/kern/kern_fork.c:603 (sleep mutex:process lock)
     762         0        1816           0           3    605      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:869 (sx:devfsmount)
     143         0         631           0           7     90      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_ep)
    3587         0       87127           0         195    446      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:2471 (sleep mutex:pmap)
   10120         0       82593           0         126    655      0  0      0 /usr/src/sys/kern/uipc_socket.c:2666 (sleep mutex:so_snd)
    6977      1719      959712       17333        6254    153      2  0     44 /usr/src/sys/dev/ata/ata-queue.c:86 (sleep mutex:ATA queue lock)
     710         0        4076           0          18    226      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:6282 (sleep mutex:Softdep Lock)
     607         0       12331           0         108    114      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:TURNSTILE)
    9545    367923     1187075     2814977        2155    550   1306  0    238 /usr/src/sys/vm/vm_fault.c:297 (sleep mutex:vm object)
     814         0       33676           0         256    131      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:NAMEI)
   36425         0    10828972           0         710  15252      0  0      0 /usr/src/sys/dev/usb2/core/usb2_request.c:306 (sx:0123456789ABCDEF - USB device SX lock)
    3913         0      200627           0         908    220      0  0      0 /usr/src/sys/vm/vm_map.c:2434 (sleep mutex:vm object)
     108         0         606           0           8     75      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:TURNSTILE)
    7064         0       17723           0           3   5907      0  0      0 /usr/src/sys/netinet/tcp_timer.c:183 (rw:tcpinp)
    2918       472       52793        1758         578     91      3  0     14 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:VM OBJECT)
   75021         0      122462           0           2  61231      0  0      0 /usr/src/sys/vm/vm_pager.c:313 (lockmgr:bufwait)
    1809    219449      129038     2286857         211    611  10838  0    209 /usr/src/sys/vm/vm_fault.c:375 (sleep mutex:vm object)
   30603      9639    12304039      538138       12508    983     43  0    419 /usr/src/sys/dev/ata/ata-queue.c:177 (sleep mutex:ATA queue lock)
     843         0       14689           0          46    319      0  0      0 /usr/src/sys/kern/subr_eventhandler.c:215 (sleep mutex:process_exit)
   12364       433     4196132         872       25016    167      0  0      4 /usr/src/sys/kern/vfs_bio.c:2972 (sleep mutex:sleep mtxpool)
     469        65        2163          65          28     77      2  0      1 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:VM OBJECT)
     472         0        3475           0          46     75      0  0      0 /usr/src/sys/kern/kern_fork.c:740 (sleep mutex:process lock)
     668       499        4541         499          46     98     10  0      1 /usr/src/sys/kern/kern_fork.c:755 (sleep mutex:process lock)
      91         0         417           0           6     69      0  0      0 /usr/src/sys/vm/vm_unix.c:82 (sleep mutex:process lock)
     867         0       47872           0         284    168      0  0      0 /usr/src/sys/netinet/igmp.c:465 (sleep mutex:igmp_mtx)
     950         0       27058           0          64    422      0  0      0 /usr/src/sys/vm/vm_object.c:1578 (sleep mutex:vm page queue mutex)
     920         0        2555           0          22    116      0  0      0 /usr/src/sys/dev/e1000/if_em.c:1003 (sleep mutex:em0)
     625         0       19430           0         167    116      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:4096)
     815         0        1930           0           7    275      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:16)
    3430         0       42519           0         126    337      0  0      0 /usr/src/sys/kern/uipc_socket.c:2667 (sleep mutex:so_rcv)
    1382         0       49259           0         317    155      0  0      0 /usr/src/sys/vm/vm_object.c:1605 (sleep mutex:vm page queue mutex)
     268         0         785           0           7    112      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_asoc)
    1178         0       56024           0         216    259      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:2718 (sleep mutex:pmap)
     933         0       12296           0          48    256      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:g_bio)
     924    164275       36963     2554204         200    184  12771  0    198 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:vm object)
    6387         0       13718           0          35    391      0  0      0 /usr/src/sys/dev/random/yarrow.c:191 (sleep mutex:random reseed)
     907       614      132911        3149         638    208      4  0     23 /usr/src/sys/vm/vm_map.c:2644 (sleep mutex:vm object)
     717         0        1254           0           7    179      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:UMA Slabs)
    1630         0      284822           0         987    288      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:32)
   33888         0      149821           0          10  14982      0  0      0 /usr/src/sys/kern/vfs_subr.c:1702 (lockmgr:devfs)
     655         0       12849           0          93    138      0  0      0 /usr/src/sys/ufs/ufs/ufs_vnops.c:175 (sleep mutex:vnode interlock)
    1632         0       15311           0          30    510      0  0      0 /usr/src/sys/kern/vfs_subr.c:1706 (sleep mutex:bufobj interlock)
     452         0        3280           0          37     88      0  0      0 /usr/src/sys/vm/vm_map.c:1299 (sleep mutex:system map)
     451         0        2240           0          27     82      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:THREAD)
     876         0       16712           0         127    131      0  0      0 /usr/src/sys/kern/vfs_bio.c:418 (sleep mutex:buffer daemon lock)
     662         0        1888           0           6    314      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:348 (sleep mutex:devfs interlock)
    3194         0       24499           0          13   1884      0  0      0 /usr/src/sys/kern/kern_exec.c:561 (lockmgr:ufs)
     516         0         539           0           2    269      0  0      0 /usr/src/sys/dev/random/yarrow.c:278 (sleep mutex:random reseed)
   11210      8250     7074779      126742       12880    549      9  0     49 /usr/src/sys/dev/ata/ata-all.c:328 (sleep mutex:ATA state lock)
   45616         0      216555           0           7  30936      0  0      0 /usr/src/sys/vm/uma_core.c:1563 (sleep mutex:UMA lock)
    1013         0       15472           0          93    166      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:64)
     691         0        1549           0           7    221      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:NFSNODE)
   10496      1134     1065607       29281        6254    170      4  0     91 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:ata_request)
     763         0       15001           0          84    178      0  0      0 /usr/src/sys/ufs/ufs/ufs_vnops.c:293 (sleep mutex:vnode interlock)
     483         0        1023           0           8    127      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:VMSPACE)
     762         0        6472           0          35    184      0  0      0 /usr/src/sys/vm/vm_fault.c:688 (sleep mutex:vm object)
    4785       787      681259        9670         924    737     10  0     49 /usr/src/sys/vm/vm_fault.c:706 (sleep mutex:vm object)
    1014         0        3930           0          45     87      0  0      0 /usr/src/sys/kern/tty.c:364 (sleep mutex:process lock)
     723         0        2107           0           7    301      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:mbuf_ext_refcnt)
     875         0       21479           0         152    141      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:ata_request)
    1152         0       21187           0          93    227      0  0      0 /usr/src/sys/kern/kern_proc.c:298 (sleep mutex:process lock)
    2308         0      580572           0        1944    298      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:2965 (sleep mutex:pmap)
    3739         0       54056           0          51   1059      0  0      0 /usr/src/sys/vm/vm_object.c:1872 (sleep mutex:vm page queue mutex)
    1040         0       15713           0          45    349      0  0      0 /usr/src/sys/kern/vfs_subr.c:1936 (sleep mutex:bufobj interlock)
     669         0       22574           0         185    122      0  0      0 /usr/src/sys/ufs/ufs/ufs_vnops.c:422 (sleep mutex:vnode interlock)
     666         0        3844           0          17    226      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:ata_request)
    1002         0       97520           0         889    109      0  0      0 /usr/src/sys/vm/vm_fault.c:809 (sleep mutex:vm object)
     542         0        1061           0           7    151      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_laddr)
      86         0         169           0           2     84      0  0      0 /usr/src/sys/vm/vm_pager.c:500 (sleep mutex:bufobj interlock)
     831         0       36560           0         256    142      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:NAMEI)
     752         0        1715           0           7    245      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:UMA RCntSlabs)
     925         0       10491           0          26    403      0  0      0 /usr/src/sys/vm/vm_glue.c:253 (sleep mutex:vm object)
    8014     13019      792214     1146370        1119    707   1024  0    698 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:ohci0)
    1199         0        9329           0          18    518      0  0      0 /usr/src/sys/kern/vfs_subr.c:3428 (sleep mutex:mountlist)
    1141         0       88803           0         517    171      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:VM OBJECT)
    1747         0       13636           0          13   1048      0  0      0 /usr/src/sys/kern/kern_exec.c:839 (lockmgr:ufs)
      87         0         119           0           3     39      0  0      0 /usr/src/sys/kern/kern_proc.c:451 (sleep mutex:process lock)
     456         0        1758           0          17    103      0  0      0 /usr/src/sys/vm/vm_mmap.c:400 (sx:pmc-sx)
     453         0         972           0           7    138      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:DIRHASH)
    5644      2922      798475       14325        1944    410      7  0     13 /usr/src/sys/vm/vm_fault.c:934 (sleep mutex:vm object)
    5202         0       21908           0           6   3651      0  0      0 /usr/src/sys/kern/vfs_subr.c:2092 (lockmgr:devfs)
      92         0          92           0           1     92      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:841 (sleep mutex:vm page queue mutex)
     698         0        7460           0          52    143      0  0      0 /usr/src/sys/vm/vm_object.c:1763 (sleep mutex:vm object_list)
    1783         0       28157           0          37    761      0  0      0 /usr/src/sys/vm/vm_glue.c:364 (sleep mutex:vm object)
     120         0         585           0           7     83      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:NFSMOUNT)
    2168         0       40070           0          62    646      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3207 (sleep mutex:pmap)
     474         0        2805           0          46     60      0  0      0 /usr/src/sys/kern/kern_sig.c:3159 (sleep mutex:sigacts)
    6956     18191     1511441      402382        3169    476    126  0    228 /usr/src/sys/vm/vm_fault.c:1007 (sleep mutex:vm object)
    1323         0        5756           0          22    261      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1810 (sleep mutex:bufobj interlock)
    1573       859      126520        6966         575    220     12  0     23 /usr/src/sys/vm/vm_fault.c:1014 (sleep mutex:vm object)
     459         0        1408           0          13    108      0  0      0 /usr/src/sys/kern/kern_sig.c:3169 (sleep mutex:sigacts)
     458         0        1874           0          13    144      0  0      0 /usr/src/sys/kern/kern_descrip.c:443 (sx:filedesc structure)
     987         0      272793           0        2099    129      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3236 (sleep mutex:pmap)
     737      7758       25709      132010         323     79    408  0     33 /usr/src/sys/kern/sys_generic.c:1310 (sleep mutex:sleep mtxpool)
     490         0        3422           0          26    131      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:UMA Slabs)
     631         0        6471           0          47    137      0  0      0 /usr/src/sys/ufs/ufs/ufs_vnops.c:668 (sleep mutex:vnode interlock)
     756         0         756           0           1    756      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1854 (sleep mutex:bufobj interlock)
     631         0       12705           0         127    100      0  0      0 /usr/src/sys/vm/vnode_pager.c:110 (sleep mutex:vm object)
       5         0           9           0           2      4      0  0      0 /usr/src/sys/kern/kern_proc.c:605 (sleep mutex:process lock)
    2209         0       13208           0          27    489      0  0      0 /usr/src/sys/kern/kern_exec.c:912 (sleep mutex:vm object)
    2797       162       39151         162         127    308      1  0      1 /usr/src/sys/kern/sys_generic.c:1411 (sleep mutex:sellck)
     945         0        1958           0           7    279      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:udpcb)
    8733     10715     3109705     1229676        1333   2332    922  0    342 /usr/src/sys/dev/usb2/core/usb2_transfer.c:1809 (sleep mutex:USB device mutex)
     934        39       31755          39         320     99      0  0      1 /usr/src/sys/kern/sys_generic.c:1355 (sleep mutex:sleep mtxpool)
    5210      8052      753070     1191131        1066    706   1117  0    712 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:ehci0)
    1780         0       46694           0         159    293      0  0      0 /usr/src/sys/kern/sys_generic.c:1445 (sleep mutex:sellck)
   10237         0       10237           0           1  10237      0  0      0 /usr/src/sys/kern/vfs_default.c:478 (lockmgr:bufwait)
    5558       371      347560         398        1342    258      0  0      2 /usr/src/sys/kern/sys_generic.c:1402 (sleep mutex:sleep mtxpool)
     626         0        1447           0           7    206      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:256)
     624         0        6200           0          46    134      0  0      0 /usr/src/sys/kern/kern_exit.c:409 (sx:allproc)
     620         0        4459           0          34    131      0  0      0 /usr/src/sys/vm/vnode_pager.c:207 (sleep mutex:vm object)
     109         0         598           0           7     85      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_raddr)
   13865         0     2768617           0        3116    888      0  0      0 /usr/src/sys/kern/vfs_bio.c:3762 (sleep mutex:sleep mtxpool)
    1578       652      669274         938        3116    214      0  0      2 /usr/src/sys/kern/vfs_bio.c:3774 (sleep mutex:sleep mtxpool)
    2363       265       18445         683          81    227      8  0      4 /usr/src/sys/kern/tty.c:158 (sleep mutex:ttymtx)
     490         0       11432           0          96    119      0  0      0 /usr/src/sys/kern/vfs_vnops.c:523 (sleep mutex:sleep mtxpool)
     692         0        1181           0           7    168      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:pipe)
     849         0       26655           0         129    206      0  0      0 /usr/src/sys/vm/uma_core.c:2464 (sleep mutex:64 Bucket)
     433         0         908           0           7    129      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:tcptw)
     507         0       13724           0          96    142      0  0      0 /usr/src/sys/kern/vfs_vnops.c:545 (sleep mutex:sleep mtxpool)
    2106         0        2106           0           1   2106      0  0      0 /usr/src/sys/vm/vm_map.c:1640 (sleep mutex:vm page queue mutex)
     161         0         298           0           4     74      0  0      0 /usr/src/sys/kern/tty.c:1506 (sx:proctree)
    1754         0       20069           0          95    211      0  0      0 /usr/src/sys/kern/vfs_subr.c:346 (sleep mutex:struct mount mtx)
     478         0        9277           0          99     93      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:Files)
    2343         0       54186           0          61    888      0  0      0 /usr/src/sys/vm/vm_map.c:1650 (sleep mutex:vm page queue mutex)
     721         0        1208           0           7    172      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:UMA Hash)
     456         0         974           0           7    139      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ACL UMA zone)
     670         0       15663           0          95    164      0  0      0 /usr/src/sys/kern/vfs_subr.c:382 (sleep mutex:struct mount mtx)
     928         0        4675           0          17    275      0  0      0 /usr/src/sys/netinet/tcp_usrreq.c:721 (rw:tcpinp)
 1370858         0  1442805591           0     1600017    901      0  0      0 /usr/src/sys/kern/kern_descrip.c:716 (sx:filedesc structure)
     546         0        1057           0           7    151      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:PROC)
     126         0         564           0           7     80      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:S VFS Cache)
     940         0       13621           0         106    128      0  0      0 /usr/src/sys/kern/vfs_bio.c:2295 (sleep mutex:vm object)
     814      4482        7583        4482          46    164     97  0      1 /usr/src/sys/kern/kern_exit.c:301 (sx:proctree)
    1001         0        4258           0           6    709      0  0      0 /usr/src/sys/vm/vm_unix.c:90 (sx:user map)
    1993         0       75686           0         202    374      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3524 (sleep mutex:pmap)
    1820         0       51137           0         202    253      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3525 (sleep mutex:pmap)
    3925         0      187827           0         436    430      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3527 (sleep mutex:pmap)
     119         0         610           0           7     87      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:Mountpoints)
    3927         0      188386           0         436    432      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3528 (sleep mutex:pmap)
     713         0        5790           0          37    156      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:609 (sleep mutex:vnode interlock)
   10802       812       43459         812          19   2287     42  0      1 /usr/src/sys/netinet/tcp_usrreq.c:772 (rw:tcpinp)
     474         0        2733           0          46     59      0  0      0 /usr/src/sys/kern/kern_fork.c:611 (sleep mutex:session)
     791         0       44191           0         284    155      0  0      0 /usr/src/sys/netinet/ip_input.c:1145 (sleep mutex:ipqlock)
     848         0        2422           0          22    110      0  0      0 /usr/src/sys/netinet/in.c:1166 (rw:lle)
     886         0        4073           0          10    407      0  0      0 /usr/src/sys/kern/vfs_default.c:460 (sleep mutex:bufobj interlock)
    1191         0        6082           0          20    304      0  0      0 /usr/src/sys/kern/vfs_default.c:492 (sleep mutex:bufobj interlock)
    2761      4427       55967        4427          46   1216     96  0      1 /usr/src/sys/kern/kern_exit.c:428 (sx:proctree)
    7395         0      129633           0         143    906      0  0      0 /usr/src/sys/kern/vfs_subr.c:778 (sleep mutex:vnode_free_list)
     907         0        3673           0          14    262      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:mbuf)
     478         0        4872           0          46    105      0  0      0 /usr/src/sys/kern/kern_exit.c:220 (sleep mutex:p_peers)
     607         0        1912           0           7    273      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_chunk)
   38417      7562    13164154      469326        5766   2283     81  0    689 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:Giant)
     463         0        2654           0          46     57      0  0      0 /usr/src/sys/kern/kern_fork.c:629 (sleep mutex:ktrace)
      92         0        2084           0          47     44      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:4096)
     726         0        1715           0           7    245      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:UMA Kegs)
     544         0        5324           0          46    115      0  0      0 /usr/src/sys/kern/kern_exit.c:289 (sleep mutex:p_peers)
     938         0        3863           0          19    203      0  0      0 /usr/src/sys/kern/tty_outq.c:255 (sleep mutex:ttymtx)
     578         0        1067           0           7    152      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:inpcb)
   15498     13395     3934241      343776       25016    157     13  0    779 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:g_bio)
     492         0        1347           0          10    134      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:4096)
   14886         0      257125           0          56   4591      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3823 (sleep mutex:pmap)
    1043         0        1895           0           3    631      0  0      0 /usr/src/sys/vm/vnode_pager.c:673 (sleep mutex:vm object)
   16224         0     2152111           0        1339   1607      0  0      0 /usr/src/sys/geom/geom_event.c:185 (sx:GEOM topology)
    1080       133       56558         429         424    133      1  0      4 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:g_bio)
    1532         0       55843           0         169    330      0  0      0 /usr/src/sys/vm/vm_object.c:369 (sleep mutex:vm object)
   80331         0   469647533           0     1600074    293      0  0      0 /usr/src/sys/kern/kern_descrip.c:1076 (sx:filedesc structure)
     439         0        2675           0          37     72      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:THREAD)
     631         0        1138           0           7    162      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:L VFS Cache)
    6671         0      301434           0        1339    225      0  0      0 /usr/src/sys/geom/geom_event.c:233 (sx:GEOM topology)
     790         0        2814           0          22    127      0  0      0 /usr/src/sys/netinet/if_ether.c:274 (rw:if_afdata)
    5660         0       34352           0         143    240      0  0      0 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:buffer daemon lock)
     846         0        1307           0           7    186      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:cpuset)
     436         0        1352           0          10    135      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:THREAD)
     941         0        6434           0          51    126      0  0      0 /usr/src/sys/netinet/tcp_output.c:282 (sleep mutex:so_snd)
    8652         0      310594           0        1339    231      0  0      0 /usr/src/sys/geom/geom_event.c:187 (sleep mutex:GEOM orphanage)
    1357         0       13770           0          46    299      0  0      0 /usr/src/sys/kern/kern_fork.c:601 (sleep mutex:process group)
     936         0        7587           0          29    261      0  0      0 /usr/src/sys/kern/kern_proc.c:1263 (sleep mutex:process lock)
    6763     89799     1123998      804901        3482    322    231  0    122 /usr/src/sys/vm/vm_object.c:447 (sleep mutex:vm object)
   15174         0      883743           0        1339    660      0  0      0 /usr/src/sys/geom/geom_event.c:201 (sleep mutex:GEOM orphanage)
    1671         0       24344           0          46    529      0  0      0 /usr/src/sys/kern/kern_exit.c:144 (sleep mutex:process lock)
     565         0        3764           0          46     81      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:VMSPACE)
   15102         0    11419341           0       20478    557      0  0      0 /usr/src/sys/dev/dcons/dcons_os.c:232 (sleep mutex:ttymtx)
     642         0        6947           0          46    151      0  0      0 /usr/src/sys/kern/kern_descrip.c:1517 (sleep mutex:fdesc)
    2332     13892      147200      302482         710    207    426  0    136 /usr/src/sys/dev/usb2/core/usb2_request.c:474 (sleep mutex:Giant)
   22187         0      219335           0          52   4217      0  0      0 /usr/src/sys/vm/vm_object.c:506 (sleep mutex:vm object)
     700         0        1601           0           7    228      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:SLEEPQUEUE)
     808         0       61211           0         478    128      0  0      0 /usr/src/sys/kern/subr_eventhandler.c:212 (sleep mutex:eventhandler)
    1604         0      838572           0        6893    121      0  0      0 /usr/src/sys/amd64/amd64/pmap.c:3994 (sleep mutex:pmap)
     858       599       17451         599          99    176      6  0      1 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:Files)
     558         0        2835           0          13    218      0  0      0 /usr/src/sys/kern/subr_eventhandler.c:215 (sleep mutex:process_exec)
     741         0       27911           0         351     79      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:selfd)
     451         0        1029           0           8    128      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:VMSPACE)
     772         0        8216           0          46    178      0  0      0 /usr/src/sys/kern/sysv_sem.c:1276 (sleep mutex:semu)
     447         0        2744           0          30     91      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:PROC)
     541         0        1350           0           7    192      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:syncache)
    7766         0       82436           0          30   2747      0  0      0 /usr/src/sys/vm/vm_map.c:1270 (sx:user map)
     716         0        8497           0          36    236      0  0      0 /usr/src/sys/dev/usb2/controller/usb2_controller.c:226 (sleep mutex:ohci0)
     752         0        1258           0           7    179      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:KMAP ENTRY)
    1711         0      151358           0         710    213      0  0      0 /usr/src/sys/dev/usb2/core/usb2_transfer.c:2550 (sleep mutex:USB device mutex)
    1932         0       48261           0          90    536      0  0      0 /usr/src/sys/vm/vm_map.c:1299 (sx:user map)
     452         0        1375           0          13    105      0  0      0 /usr/src/sys/kern/imgact_elf.c:771 (sleep mutex:process lock)
     625       865        6389         865          46    138     18  0      1 /usr/src/sys/kern/kern_exit.c:244 (sleep mutex:process lock)
     727         0        1662           0          22     75      0  0      0 /usr/src/sys/netinet/ip_output.c:640 (sleep mutex:rtentry)
     594         0        1547           0           7    221      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:MAP ENTRY)
     545         0        1444           0           7    206      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:sctp_readq)
     865         0       13797           0          45    306      0  0      0 /usr/src/sys/kern/kern_sig.c:654 (sleep mutex:process lock)
     848         0       56334           0         349    161      0  0      0 /usr/src/sys/vm/vm_object.c:576 (sleep mutex:vm object)
     945      1005       97144       17679         889    109     19  0    114 /usr/src/sys/vm/vm_fault.c:141 (sleep mutex:vm page queue mutex)
     600         0       10634           0          85    125      0  0      0 /usr/src/sys/vm/vm_mmap.c:284 (sleep mutex:process lock)
     642         0        1153           0           6    192      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3767 (sleep mutex:Softdep Lock)
     789         0        1499           0           2    749      0  0      0 /usr/src/sys/vm/vnode_pager.c:934 (sleep mutex:vm object)
   48141         0    19114531           0       12746   1499      0  0      0 /usr/src/sys/kern/vfs_bio.c:2443 (lockmgr:bufwait)
     734         0        2231           0           7    318      0  0      0 /usr/src/sys/vm/uma_core.c:410 (sleep mutex:ttyinq)
     862         0        7098           0          46    154      0  0      0 /usr/src/sys/kern/kern_descrip.c:1721 (sleep mutex:fdesc)
   10254         0       97791           0         122    801      0  0      0 /usr/src/sys/kern/kern_sysctl.c:1510 (sx:sysctl lock)
     847         0       18627           0         147    126      0  0      0 /usr/src/sys/kern/vfs_vnops.c:969 (sleep mutex:struct mount mtx)
     203       282        4957         859          27    183     31  0      7 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 9)
      93       198         546         198           6     91     33  0      1 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 9)
     147       225         973         558           9    108     62  0      3 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 27)
     115         0       12608           0         152     82      0  0      0 /usr/src/sys/kern/sched_ule.c:793 (spin mutex:sched lock 0)
     719         0       28379           0         131    216      0  0      0 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 0)
     776       672       50318       17448         223    225     78  0    103 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 0)
     130         0         516           0           8     64      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 0)
      82       144         789         303          28     28     10  0      3 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 18)
     189         0         377           0           2    188      0  0      0 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 23)
      91         0         180           0           2     90      0  0      0 /usr/src/sys/kern/kern_sig.c:593 (spin mutex:sched lock 0)
     177       169       22389        1355         206    108      6  0     12 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 9)
   11387         0       47316           0          72    657      0  0      0 /usr/src/sys/amd64/amd64/mp_machdep.c:858 (spin mutex:smp rendezvous)
       9         0           9           0           1      9      0  0      0 /usr/src/sys/kern/sched_ule.c:2062 (spin mutex:sched lock 8)
    1968      1325      103141        1397         506    203      2  0      3 /usr/src/sys/amd64/amd64/mp_machdep.c:895 (spin mutex:smp rendezvous)
     175       100         175         100           1    175    100  0      1 /usr/src/sys/kern/kern_sig.c:2251 (spin mutex:sched lock 12)
     189       241        1262         241           7    180     34  0      1 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 14)
     486       180        2974         403           8    371     50  0      3 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 14)
     184       571     1933104       30273       21582     89      1  0    198 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 0)
     190       750      355321       95088        3781     93     25  0    653 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 0)
    2360         0      828176           0         678   1221      0  0      0 /usr/src/sys/kern/subr_turnstile.c:556 (spin mutex:turnstile lock)
    2306       433      664941        2938         605   1099      4  0     12 /usr/src/sys/kern/subr_turnstile.c:594 (spin mutex:turnstile lock)
     181         0         535           0           3    178      0  0      0 /usr/src/sys/kern/kern_sig.c:2251 (spin mutex:sched lock 3)
     229       178        6938         555          37    187     15  0      5 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 5)
     686       257        2672         778           6    445    129  0      4 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 5)
      96         0       11149           0         126     88      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 0)
    1066         0       33486           0          46    727      0  0      0 /usr/src/sys/kern/kern_exit.c:548 (spin mutex:process slock)
      89         0         265           0           3     88      0  0      0 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:turnstile lock)
     155       221         916         221           8    114     27  0      1 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 23)
   16193         0     8853452           0        3195   2771      0  0      0 /usr/src/sys/dev/syscons/syscons.c:1784 (spin mutex:syscons video lock)
    4458     17933    26800701     1520828       93790    285     16  0   3149 /usr/src/sys/kern/subr_sleepqueue.c:236 (spin mutex:sleepq chain)
     516         0       49640           0         187    265      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 0)
     173       441      571025      134241        7808     73     17  0   1223 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 14)
     157       268       10662        3853          95    112     40  0     24 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 14)
     227       246       14854        4074          84    176     48  0     28 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 19)
     189       431       41279       16105         449     91     35  0    138 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 5)
     195       426       41879       17447         444     94     39  0    116 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 5)
     134      1080      457203        4158        5159     88      0  0     14 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 0)
     120       533        1766         774          19     92     40  0      3 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 1)
     188       288        4070        1558          23    176     67  0      8 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 10)
    2492      1719      810412        4738         605   1339      7  0      5 /usr/src/sys/kern/subr_turnstile.c:537 (spin mutex:turnstile chain)
    1165     12708      470365      387472         713    659    543  0     76 /usr/src/sys/kern/subr_turnstile.c:547 (spin mutex:turnstile chain)
     189       367        2830         757          21    134     36  0      4 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 28)
     152       265        3822        1418          48     79     29  0      8 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 28)
     590       459        5893         459          16    368     28  0      1 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 1)
     189       534        9476        1994          53    178     37  0     12 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 1)
     710       530        1237         704           4    309    176  0      3 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 1)
     187       510       10282        2060          75    137     27  0     11 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 1)
     172       111        2335         610          25     93     24  0      6 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 19)
     161       156        1976         482          19    104     25  0      4 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 19)
     263        87         614          87           3    204     29  0      1 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 24)
     239       608      416269        1133        2828    147      0  0      3 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 0)
     543         0     1544241           0       15823     97      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 0)
      65        67         314          67           7     44      9  0      1 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 10)
     139       431      198210         797        2702     73      0  0      3 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 0)
     249      1940      361884       85734        3336    108     25  0    164 /usr/src/sys/kern/subr_sleepqueue.c:830 (spin mutex:sleepq chain)
      91         0        1421           0          29     49      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 0)
     188        99        1250         274           7    178     39  0      3 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 15)
     113       454        2694        3018          29     92    104  0     14 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 15)
     254       916      844616      388616        8279    102     46  0   2864 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 1)
     198       771      547228      185187        5619     97     32  0   1195 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 1)
     138       326      206429      136897        2771     74     49  0   1791 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 0)
     189         0         550           0           3    183      0  0      0 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 6)
     202       247        4544         921          25    181     36  0      7 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 6)
     100       495        1381        2347          15     92    156  0     10 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 6)
     119     17159       28977       17159         364     79     47  0      1 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 0)
     205       358       16637        6341         138    120     45  0     40 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 24)
     124         0       51648           0         607     85      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 0)
     266         0        4277           0          31    137      0  0      0 /usr/src/sys/kern/kern_sig.c:2251 (spin mutex:sleepq chain)
     167       408       13717        7999         116    118     68  0     38 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 24)
     131         0      145048           0        2066     70      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 0)
     175       235       72494         438         605    119      0  0      3 /usr/src/sys/kern/subr_turnstile.c:709 (spin mutex:td_contested)
     180       236      276411        1186        3344     82      0  0      8 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 15)
     250       608   569869085     1706686     4774453    119      0  0  12389 /usr/src/sys/kern/kern_timeout.c:246 (spin mutex:callout)
     148       119       66275         691         512    129      1  0      7 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 15)
     212      1750     5995122     1452339       69777     85     20  0   8658 /usr/src/sys/kern/kern_timeout.c:272 (spin mutex:callout)
     214       726        1528        2251           8    191    281  0      5 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 20)
     182      4983     2243023      672841       25374     88     26  0   3584 /usr/src/sys/kern/kern_timeout.c:325 (spin mutex:callout)
     165       148       71342         596         605    117      0  0      5 /usr/src/sys/kern/subr_turnstile.c:830 (spin mutex:td_contested)
     168       152       79284         152         644    123      0  0      1 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 6)
     161       246       71065         819         605    117      1  0      5 /usr/src/sys/kern/subr_turnstile.c:890 (spin mutex:td_contested)
     147       349    11767970       78180      143502     82      0  0    461 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 0)
     195      9941     2829970      616121       32150     88     19  0   3494 /usr/src/sys/kern/kern_timeout.c:436 (spin mutex:callout)
     132       446        2669         964          29     92     33  0      4 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 2)
     190       273        3888         798          22    176     36  0      4 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 11)
     159       258        1423         875          13    109     67  0      6 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 29)
     171       981      419217       90374        4774     87     18  0    614 /usr/src/sys/kern/kern_timeout.c:506 (spin mutex:callout)
     530         0        8902           0          41    217      0  0      0 /usr/src/sys/kern/kern_sig.c:2250 (spin mutex:process slock)
      53         0         643           0          32     20      0  0      0 /usr/src/sys/kern/kern_cpuset.c:562 (spin mutex:sleepq chain)
      50         0         645           0          32     20      0  0      0 /usr/src/sys/kern/kern_cpuset.c:266 (spin mutex:cpuset)
      85      2982         495        4248          17     29    249  0     12 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 0)
     128         0        2059           0          32     64      0  0      0 /usr/src/sys/kern/kern_cpuset.c:592 (spin mutex:sleepq chain)
     824       251        5839         431          14    417     30  0      2 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 2)
     183         0         364           0           2    182      0  0      0 /usr/src/sys/kern/kern_sig.c:2251 (spin mutex:sched lock 0)
     194       447        7336        1467          41    178     35  0     10 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 2)
     216       453        9741         453          65    149      6  0      1 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 2)
     148      1223      538969       11660        6053     89      1  0     27 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 0)
     129         0         458           0           6     76      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 0)
     262      1041       73338       25780         596    123     43  0    172 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 20)
     185       718       75583       33449         960     78     34  0    208 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 20)
     144       323     1585069        9818       19086     83      0  0     70 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 0)
     130      3626       68470        3626         806     84      4  0      1 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 0)
     131      3729       70173        3729         805     87      4  0      1 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 0)
     176        88         176          88           1    176     88  0      1 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 25)
      12         0          12           0           1     12      0  0      0 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 11)
     401         0       15534           0          59    263      0  0      0 /usr/src/sys/kern/kern_umtx.c:3354 (spin mutex:umtx lock)
     454       462       29230       10204         132    221     77  0     55 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 16)
     529       276       22239        2484          66    336     37  0     16 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 16)
     155       152       98982         152        1144     86      0  0      1 /usr/src/sys/kern/kern_resource.c:626 (spin mutex:sleepq chain)
     196       897      770095      170930        7894     97     21  0   1089 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 2)
     188       810      471849      198470        4548    103     43  0   1324 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 2)
     208       201        5729         702          31    184     22  0      5 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 7)
     117       138         438         203           5     87     40  0      2 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 25)
     198       610       23146       11762         206    112     57  0     56 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 16)
     166       531       39358       15281         699     56     21  0     97 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 16)
     201         0         757           0           4    189      0  0      0 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 21)
     582         0      296807           0        1144    259      0  0      0 /usr/src/sys/kern/kern_resource.c:624 (spin mutex:process slock)
     155       189       30870        2025        1103     27      1  0     30 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 7)
     183       253       55296       15665         805     68     19  0    132 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 7)
      88         0        1025           0          33     31      0  0      0 /usr/src/sys/kern/kern_fork.c:435 (spin mutex:sched lock 0)
     133       677        1640         677          17     96     39  0      1 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 3)
     431       248        4591        1992          21    218     94  0     11 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 12)
     726       186        3929         602          11    357     54  0      5 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 12)
     137       259        5682        1901          61     93     31  0     14 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 30)
     166       284        3013        1082          24    125     45  0      5 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 30)
     217       291        8016        1521          45    178     33  0     13 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 3)
     236       276       12256         367          84    145      4  0      2 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 3)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/kern_sig.c:593 (spin mutex:sched lock 12)
     181       474       22796       10217         206    110     49  0     56 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 21)
     183       441       29170       10663         259    112     41  0     67 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 21)
      97         0        1882           0          46     40      0  0      0 /usr/src/sys/kern/kern_fork.c:722 (spin mutex:process slock)
     174         0         174           0           1    174      0  0      0 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 26)
      91        99         269          99           3     89     33  0      1 /usr/src/sys/kern/kern_sig.c:593 (spin mutex:sched lock 3)
     127         0        1310           0          33     39      0  0      0 /usr/src/sys/kern/kern_fork.c:731 (spin mutex:sched lock 0)
     208       666       79821       27650         701    113     39  0    158 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 12)
     192       757      176029       61532        2203     79     27  0    388 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 12)
     200       153       10670         830          66    161     12  0      6 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 8)
     432       270       21059        7407          94    224     78  0     36 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 17)
     259       276       10283        2962          57    180     51  0     21 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 17)
     158       266        6151        4395          66     93     66  0     32 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 17)
     217       961      690322      154660        7327     94     21  0   1014 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 3)
     202       886      374568      153862        3708    101     41  0   1047 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 3)
     163       477        3648        3176          38     96     83  0     15 /usr/src/sys/kern/sched_ule.c:2062 (spin mutex:sched lock 2)
     462       617       13753        6552          64    214    102  0     29 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 8)
     476       265        2087         736           7    298    105  0      4 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 8)
      88       142         617         142           8     77     17  0      1 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 26)
     162       246        2897        1575          25    115     63  0     10 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 26)
     106       168        1562         701          19     82     36  0      7 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 17)
     165       380        1183         943          14     84     67  0      5 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 17)
     190         0         380           0           2    190      0  0      0 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 22)
     206       665      121695       53731        1060    114     50  0    278 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 8)
     184       473      148032       67784        1492     99     45  0    395 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 8)
     114         0         135           0           2     67      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 0)
     223       593       14228        1366         107    132     12  0      6 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 4)
     191       150        1279         285           7    182     40  0      2 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 13)
     734       207        4081         815          10    408     81  0      5 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 13)
     129       257        1371         878          15     91     58  0      6 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 31)
     159       379        1819         860          15    121     57  0      3 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 31)
     420       248       18773        6157          90    208     68  0     36 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 4)
     765       217        4286         693          11    389     63  0      5 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 4)
     170       341       14972        5415         143    104     37  0     33 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 22)
     175         0         175           0           1    175      0  0      0 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 27)
     173       546       12952        6890         118    109     58  0     41 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 13)
     134       580        2519         580          31     81     18  0      1 /usr/src/sys/kern/kern_sig.c:593 (spin mutex:sleepq chain)
     285      1894     1447397       56007       11774    122      4  0    199 /usr/src/sys/amd64/amd64/io_apic.c:212 (spin mutex:icu)
     174       760      142519        4131        1354    105      3  0     20 /usr/src/sys/dev/random/randomdev_soft.c:250 (spin mutex:entropy harvest mutex)
     162       731      140107        4052        1353    103      2  0     15 /usr/src/sys/dev/random/randomdev_soft.c:270 (spin mutex:entropy harvest mutex)
      96        89          96          89           1     96     89  0      1 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 9)
     232       265       15218        2902          85    179     34  0     19 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 18)
     210       651      145763       51360        1395    104     36  0    289 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 4)
     261       667      287702      126320        2731    105     46  0    742 /usr/src/sys/kern/sched_ule.c:1118 (spin mutex:sched lock 4)
     197       353       24434        6322         220    111     28  0     40 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 0)
     455       237        2410         658           8    301     82  0      3 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 9)
    1025         0       31076           0         101    307      0  0      0 /usr/src/sys/netinet/if_ether.c:587 (rw:if_afdata)
      91         0         253           0           3     84      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:THREAD)
     124         0         465           0           5     93      0  0      0 /usr/src/sys/kern/vfs_syscalls.c:4176 (sx:filedesc structure)
     472         0        5296           0          47    112      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:4096)
      92         0         273           0           3     91      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:VMSPACE)
     119         0         550           0           7     78      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:selfd)
      91         0         531           0           6     88      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:4096)
     452         0         617           0           3    205      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:4096)
      95         0         276           0           3     92      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:481 (sx:proctree)
     455         0         455           0           1    455      0  0      0 /usr/src/sys/kern/kern_proc.c:363 (sleep mutex:process group)
     541         0         541           0           1    541      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:1153 (sleep mutex:unp_mtx)
    4032     10889      358380      209356         909    394    230  0    373 /usr/src/sys/kern/kern_exit.c:714 (sleep mutex:process lock)
     480         0        5877           0          46    127      0  0      0 /usr/src/sys/kern/kern_exit.c:762 (sleep mutex:process lock)
    1693         0        1693           0           1   1693      0  0      0 /usr/src/sys/kern/kern_prot.c:332 (sx:proctree)
     923         0        8992           0          54    166      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:VMSPACE)
    5148         0        9310           0           6   1551      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:4268 (sleep mutex:Softdep Lock)
     773         0       15760           0          46    342      0  0      0 /usr/src/sys/kern/kern_proc.c:473 (sleep mutex:process group)
     530         0        6525           0          46    141      0  0      0 /usr/src/sys/kern/kern_exit.c:800 (sleep mutex:process lock)
     504         0        4933           0          46    107      0  0      0 /usr/src/sys/kern/kern_exit.c:803 (sleep mutex:process lock)
      79      8028        2380       28345          54     44    524  0     39 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:selfd)
    1978         0        1978           0           1   1978      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:1269 (sleep mutex:unp_mtx)
    1431         0        1431           0           1   1431      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:1270 (sleep mutex:unp_mtx)
     675         0        4436           0          26    170      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:VMSPACE)
     105         0         105           0           1    105      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:1288 (sleep mutex:unp_mtx)
      82      1147        1236        7533          26     47    289  0     21 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:selfd)
    1031         0       13081           0          41    319      0  0      0 /usr/src/sys/kern/kern_exit.c:889 (sleep mutex:process lock)
     118         0         206           0           2    103      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:socket)
     726         0        2721           0          11    247      0  0      0 /usr/src/sys/amd64/amd64/machdep.c:363 (sleep mutex:sigacts)
  154034         0      510715           0          14  36479      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1318 (sleep mutex:struct mount mtx)
     851         0        2567           0           4    641      0  0      0 /usr/src/sys/vm/vm_object.c:1326 (sleep mutex:vm object)
     674         0        1823           0           4    455      0  0      0 /usr/src/sys/vm/vm_object.c:1327 (sleep mutex:vm object)
      87         0          87           0           1     87      0  0      0 /usr/src/sys/kern/uipc_socket.c:691 (sleep mutex:so_rcv)
     791         0        1253           0           2    626      0  0      0 /usr/src/sys/kern/vfs_cache.c:771 (sx:filedesc structure)
     750         0       75700           0         512    147      0  0      0 /usr/src/sys/netinet/tcp_hostcache.c:648 (sleep mutex:tcp_hc_entry)
     121         0         405           0           4    101      0  0      0 /usr/src/sys/vm/vm_object.c:1405 (sleep mutex:vm object)
      89         0         176           0           2     88      0  0      0 /usr/src/sys/kern/kern_prot.c:116 (sleep mutex:process lock)
    8480         0       49716           0           6   8286      0  0      0 /usr/src/sys/kern/vfs_lookup.c:866 (lockmgr:ufs)
      98         0         925           0          10     92      0  0      0 /usr/src/sys/kern/kern_prot.c:135 (sleep mutex:process lock)
    1623       539       45575         539         186    245      2  0      1 /usr/src/sys/dev/e1000/if_em.c:1705 (sleep mutex:em0)
     323         0        1610           0          34     47      0  0      0 /usr/src/sys/kern/vfs_hash.c:114 (sleep mutex:vfs hash)
      95         0         359           0           4     89      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:pipe)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/vfs_syscalls.c:841 (sx:filedesc structure)
     624         0        3844           0          25    153      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:645 (sleep mutex:Softdep Lock)
     447         0        3239           0          44     73      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:S VFS Cache)
    1078         0        1078           0           1   1078      0  0      0 /usr/src/sys/ufs/ufs/ufs_dirhash.c:225 (sx:dirhash)
      87         0         173           0           2     86      0  0      0 /usr/src/sys/kern/uipc_sockbuf.c:296 (sleep mutex:process lock)
     937         0       79496           0         409    194      0  0      0 /usr/src/sys/vm/uma_core.c:2464 (sleep mutex:UMA RCntSlabs)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:372 (rw:unp_global_rwlock)
      91         0         650           0          10     65      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:S VFS Cache)
     470         0         470           0           1    470      0  0      0 /usr/src/sys/kern/kern_resource.c:1203 (rw:uidinfo hash)
      93         0        1307           0          34     38      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:4876 (sleep mutex:Softdep Lock)
     179         0         179           0           1    179      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:506 (rw:unp_global_rwlock)
     960         0         960           0           1    960      0  0      0 /usr/src/sys/kern/uipc_sockbuf.c:235 (sleep mutex:so_snd)
     779         0         779           0           1    779      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:520 (rw:unp_global_rwlock)
     175         0         175           0           1    175      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:563 (rw:unp_global_rwlock)
     637         0        1942           0          11    176      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:mbuf)
    5049         0       26325           0           6   4387      0  0      0 /usr/src/sys/ufs/ufs/ufs_vnops.c:1079 (lockmgr:ufs)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/kern/kern_prot.c:488 (sleep mutex:process lock)
     433         0        1258           0          10    125      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:FFS inode)
     936         0       78672           0         409    192      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:mbuf_cluster)
     968       448       13550         448          68    199      6  0      1 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:ata_request)
      93         0          93           0           1     93      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:pipe)
     968         0         968           0           1    968      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:628 (rw:unp_global_rwlock)
     467         0        2954           0          26    113      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:VNODE)
     350         0         350           0           1    350      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:234 (lockmgr:bufwait)
     610         0         610           0           1    610      0  0      0 /usr/src/sys/kern/uipc_socket.c:690 (sleep mutex:accept)
      85         0         166           0           2     83      0  0      0 /usr/src/sys/kern/kern_prot.c:600 (sleep mutex:process lock)
     495         0         709           0           3    236      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:PROC)
      92         0         303           0           4     75      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:S VFS Cache)
     438         0         438           0           1    438      0  0      0 /usr/src/sys/kern/uipc_sockbuf.c:236 (sleep mutex:so_rcv)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/kern_prot.c:653 (sleep mutex:process lock)
    2053         0        2053           0           1   2053      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:773 (rw:unp_global_rwlock)
    3225         0        8220           0           3   2740      0  0      0 /usr/src/sys/kern/vfs_vnops.c:293 (lockmgr:devfs)
      86         0         167           0           2     83      0  0      0 /usr/src/sys/kern/kern_prot.c:752 (sleep mutex:process lock)
     620         0        1145           0           3    381      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:507 (sleep mutex:vnode interlock)
     634         0        2773           0          15    184      0  0      0 /usr/src/sys/kern/sys_pipe.c:1275 (sleep mutex:pipe mutex)
     671         0        6965           0          46    151      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:PROC)
     630         0        2910           0          15    194      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:S VFS Cache)
      85         0          85           0           1     85      0  0      0 /usr/src/sys/kern/kern_prot.c:814 (sleep mutex:process lock)
     140         0         414           0           4    103      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:32 Bucket)
     628         0        3100           0          16    193      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:216 (sleep mutex:bufobj interlock)
     614         0        1403           0           6    233      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:PROC)
      95         0         535           0           6     89      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:S VFS Cache)
     560         0         980           0           5    196      0  0      0 /usr/src/sys/vm/uma_core.c:2424 (sleep mutex:mbuf)
     612         0         700           0           2    350      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:242 (sleep mutex:bufobj interlock)
     462         0        1668           0           8    208      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1302 (sleep mutex:Softdep Lock)
      93         0         267           0           3     89      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:PROC)
      93         0         258           0           3     86      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:S VFS Cache)
     477         0         767           0           4    191      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:291 (sleep mutex:bufobj interlock)
    1875         0        8199           0          11    745      0  0      0 /usr/src/sys/kern/subr_trap.c:223 (sleep mutex:process lock)
      87         0          87           0           1     87      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:socket)
      95         0          95           0           1     95      0  0      0 /usr/src/sys/kern/vfs_bio.c:2894 (sleep mutex:vm page queue mutex)
     491         0         578           0           2    289      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:socket)
     648         0        2884           0          12    240      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:mbuf)
     433         0         433           0           1    433      0  0      0 /usr/src/sys/kern/uipc_syscalls.c:567 (sleep mutex:so_rcv)
  457740         0     2601573           0          18 144531      0  0      0 /usr/src/sys/kern/vfs_subr.c:1702 (lockmgr:syncer)
      92         0          92           0           1     92      0  0      0 /usr/src/sys/ufs/ufs/ufs_dirhash.c:553 (sleep mutex:dirhash list)
     276         0         276           0           1    276      0  0      0 /usr/src/sys/kern/kern_resource.c:188 (sleep mutex:process lock)
      98         0         272           0           3     90      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:SLEEPQUEUE)
     700         0        1187           0           6    197      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:mbuf)
    2731         0        2731           0           1   2731      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:1197 (rw:unp_global_rwlock)
     436         0        1236           0          10    123      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:FFS2 dinode)
     284         0         284           0           1    284      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:1287 (rw:unp_global_rwlock)
     471         0        2446           0          39     62      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:5747 (sleep mutex:Softdep Lock)
   64307         0      145605           0          34   4282      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1462 (lockmgr:ufs)
     620         0        1288           0           5    257      0  0      0 /usr/src/sys/kern/vfs_subr.c:3255 (sleep mutex:vnode_free_list)
     611       489        6064         957          66     91     14  0      5 /usr/src/sys/kern/vfs_bio.c:1323 (sleep mutex:buf queue lock)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:socket)
     640         0        5059           0          37    136      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:128 Bucket)
     635         0        2501           0          10    250      0  0      0 /usr/src/sys/kern/kern_fork.c:337 (sleep mutex:process lock)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/uipc_socket.c:284 (sleep mutex:so_glabel)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:unpcb)
      88         0          88           0           1     88      0  0      0 /usr/src/sys/ufs/ufs/ufs_dirhash.c:212 (sleep mutex:vnode interlock)
     443         0         443           0           1    443      0  0      0 /usr/src/sys/kern/uipc_socket.c:303 (sleep mutex:so_glabel)
      87         0          87           0           1     87      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:socket)
      78         0          78           0           1     78      0  0      0 /usr/src/sys/ufs/ufs/ufs_dirhash.c:228 (sleep mutex:vnode interlock)
     439         0         614           0           3    204      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:6068 (sleep mutex:Softdep Lock)
     444         0        1417           0          12    118      0  0      0 /usr/src/sys/kern/kern_resource.c:671 (sleep mutex:process lock)
      89         0         175           0           2     87      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:socket)
      93         0        1313           0          34     38      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:FFS inode)
     906         0      122746           0         640    191      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:mbuf_cluster)
     451         0        1932           0          34     56      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:VNODE)
     493         0        2188           0          10    218      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:FFS inode)
     857         0        6299           0          28    224      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:mbuf_cluster)
      85         0          85           0           1     85      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:socket)
     927         0       26240           0         177    148      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:ata_request)
     496         0        1685           0          12    140      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:VNODE)
     615         0        2839           0          12    236      0  0      0 /usr/src/sys/kern/kern_resource.c:788 (sleep mutex:process lock)
     998         0        2596           0          11    236      0  0      0 /usr/src/sys/kern/subr_trap.c:224 (sleep mutex:sigacts)
     988         0       16223           0          66    245      0  0      0 /usr/src/sys/netinet/udp_usrreq.c:396 (rw:udp)
     457         0        6056           0          65     93      0  0      0 /usr/src/sys/kern/vfs_bio.c:1250 (sleep mutex:vm object)
     742         0        4881           0          18    271      0  0      0 /usr/src/sys/kern/vfs_subr.c:3443 (sleep mutex:struct mount mtx)
     130         0         388           0           4     97      0  0      0 /usr/src/sys/vm/vm_object.c:1358 (sleep mutex:vm page queue mutex)
     479         0        1625           0          15    108      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:128)
    1370         0        4484           0          44    101      0  0      0 /usr/src/sys/kern/vfs_cache.c:569 (rw:Name Cache)
     439         0        1134           0           7    162      0  0      0 /usr/src/sys/kern/kern_prot.c:1909 (sleep mutex:process lock)
     119         0         327           0           4     81      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:FFS inode)
     445         0        1162           0           5    232      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:mbuf_cluster)
     658         0         658           0           1    658      0  0      0 /usr/src/sys/kern/kern_prot.c:1967 (sleep mutex:process lock)
      91         0         296           0           4     74      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:VNODE)
      98         0         276           0           3     92      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:ksiginfo)
     669         0        4314           0          18    239      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1338 (sleep mutex:bufobj interlock)
     410         0         773           0           5    154      0  0      0 /usr/src/sys/vm/uma_core.c:2464 (sleep mutex:16 Bucket)
      95         0         189           0           2     94      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:1024)
      95         0         267           0           3     89      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:TURNSTILE)
      88         0          88           0           1     88      0  0      0 /usr/src/sys/kern/uipc_socket.c:3062 (sleep mutex:so_snd)
      94         0          94           0           1     94      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:1024)
    1333         0        1333           0           1   1333      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:812 (sleep mutex:so_rcv)
      95         0         187           0           2     93      0  0      0 /usr/src/sys/kern/vfs_cache.c:925 (rw:Name Cache)
     474         0        1457           0           8    182      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:selfd)
     452         0        1084           0          11     98      0  0      0 /usr/src/sys/kern/kern_descrip.c:833 (sleep mutex:sigio lock)
      92         0        1222           0          34     35      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:FFS2 dinode)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/kern_proc.c:360 (sleep mutex:process lock)
     116         0         625           0           8     78      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:FFS2 dinode)
      93         0          93           0           1     93      0  0      0 /usr/src/sys/kern/uipc_socket.c:3030 (sleep mutex:so_rcv)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/uipc_socket.c:3061 (sleep mutex:so_rcv)
     648         0        9718           0          56    173      0  0      0 /usr/src/sys/vm/uma_core.c:2464 (sleep mutex:32 Bucket)
     595         0        5401           0          46    117      0  0      0 /usr/src/sys/kern/kern_proc.c:474 (sleep mutex:process lock)
     926         0       12765           0          77    165      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:VM OBJECT)
     651       272        5084         272          23    221     11  0      1 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:VM OBJECT)
     455         0        4353           0          31    140      0  0      0 /usr/src/sys/vm/uma_core.c:2703 (sleep mutex:VM OBJECT)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/vm/uma_core.c:1990 (sleep mutex:unpcb)
     488         0        1059           0           7    151      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3027 (sleep mutex:Softdep Lock)
     452         0         542           0           2    271      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:unpcb)
     427         0         514           0           2    257      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:1024)
     463         0        1029           0           4    257      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:FFS2 dinode)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:1351 (sleep mutex:so_rcv)
      88         0         176           0           2     88      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:1024)
   81117         0      103574           0           4  25893      0  0      0 /usr/src/sys/kern/vfs_bio.c:1783 (lockmgr:bufwait)
      87         0          87           0           1     87      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:1024)
     726         0        9732           0          59    164      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:UMA RCntSlabs)
  263058         0      954067           0         186   5129      0  0      0 /usr/src/sys/dev/e1000/if_em.c:4386 (sleep mutex:em0)
     443         0         529           0           2    264      0  0      0 /usr/src/sys/kern/vfs_bio.c:1620 (sleep mutex:bufobj interlock)
      94         0         638           0           7     91      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3311 (sleep mutex:Softdep Lock)
     457         0        1345           0           7    192      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3323 (sleep mutex:Softdep Lock)
     305         0         305           0           1    305      0  0      0 /usr/src/sys/kern/uipc_socket.c:3029 (sleep mutex:accept)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:unpcb)
    4463     16718     3315242     1725846        5334    621    323  0    771 /usr/src/sys/kern/kern_intr.c:1133 (sleep mutex:Giant)
    1948         0       71725           0         205    349      0  0      0 /usr/src/sys/dev/e1000/if_em.c:4541 (sleep mutex:em0)
     957       428       22509        1344         154    146      8  0      9 /usr/src/sys/vm/uma_core.c:2464 (sleep mutex:128 Bucket)
     469         0        5993           0          46    130      0  0      0 /usr/src/sys/kern/kern_exit.c:788 (sx:allproc)
     477         0        5171           0          46    112      0  0      0 /usr/src/sys/kern/kern_exit.c:840 (sx:allproc)
      93         0          93           0           1     93      0  0      0 /usr/src/sys/kern/kern_prot.c:1968 (sleep mutex:session)
     279         0        1543           0          34     45      0  0      0 /usr/src/sys/kern/vfs_subr.c:938 (sleep mutex:vnode_free_list)
     120         0        1311           0          14     93      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:3512 (sleep mutex:Softdep Lock)
      95         0          95           0           1     95      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:unpcb)
     606         0         606           0           1    606      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:521 (sleep mutex:unp_mtx)
   35869         0      737811           0          91   8107      0  0      0 /usr/src/sys/kern/kern_exit.c:712 (sx:proctree)
      92         0         182           0           2     91      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:unpcb)
      89         0         435           0           5     87      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:pipe)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:unpcb)
     795         0         795           0           1    795      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:629 (sleep mutex:unp_mtx)
     621         0         621           0           1    621      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:632 (sleep mutex:unp_mtx)
     438         0         918           0           8    114      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:S VFS Cache)
    1168         0        6180           0          11    561      0  0      0 /usr/src/sys/amd64/amd64/machdep.c:362 (sleep mutex:process lock)
     612         0        1599           0          14    114      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:selfd)
     794         0        1055           0           2    527      0  0      0 /usr/src/sys/kern/vfs_bio.c:2846 (sleep mutex:vm object)
     670         0        2094           0          11    190      0  0      0 /usr/src/sys/amd64/amd64/machdep.c:438 (sleep mutex:process lock)
      97         0         278           0           3     92      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:4096)
    1883         0        1883           0           1   1883      0  0      0 /usr/src/sys/kern/uipc_usrreq.c:806 (sleep mutex:unp_mtx)
      91         0        1306           0          34     38      0  0      0 /usr/src/sys/kern/vfs_subr.c:1076 (sleep mutex:struct mount mtx)
      88         0         261           0           3     87      0  0      0 /usr/src/sys/kern/uipc_syscalls.c:127 (sx:filedesc structure)
     685         0        7917           0          43    184      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:mbuf)
     182         0         889           0           5    177      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 1)
     110         0         478           0           5     95      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 1)
     125       111       73266         215         909     80      0  0      4 /usr/src/sys/kern/kern_exit.c:740 (spin mutex:process slock)
      93         0         802           0           9     89      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 1)
      95         0        1157           0          13     89      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 1)
     300       134        3590         134          13    276     10  0      1 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 1)
     169       623      352759        7533        3885     90      1  0     45 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 1)
     233       280      551129        5512        3642    151      1  0     27 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 1)
     606         0     1577411           0       14693    107      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 1)
     145       219      274753        6983        3634     75      1  0     53 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 1)
      87         0          87           0           1     87      0  0      0 /usr/src/sys/kern/sched_ule.c:1903 (spin mutex:sched lock 1)
     121         0         489           0           5     97      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 1)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/sched_ule.c:2062 (spin mutex:sched lock 1)
     164       419      581799      553747        6732     86     82  0   5672 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 1)
      99       801       15982         801         185     86      4  0      1 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 1)
     183        98       90733          98        1011     89      0  0      1 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 1)
     129       290      184808        5905        2618     70      2  0     42 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 1)
     149       408    12180876      213508      146766     82      1  0   1322 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 1)
    1612       462      179309         900         372    482      2  0      3 /usr/src/sys/kern/subr_taskqueue.c:73 (spin mutex:fast_taskqueue)
     136    130565       28795      433914         332     86   1306  0    302 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 1)
     123       172       14130         480         158     89      3  0      3 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 1)
      91         0         442           0           5     88      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 1)
     143       519     1626148       55634       19520     83      2  0    455 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 1)
     119         0       56024           0         633     88      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 1)
     116         0       55808           0         632     88      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 1)
     180       523         913        1935           9    101    215  0      7 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 8)
     157         0       17926           0         186     96      0  0      0 /usr/src/sys/kern/kern_synch.c:321 (spin mutex:fast_taskqueue)
     128         0         218           0           2    109      0  0      0 /usr/src/sys/kern/kern_fork.c:435 (spin mutex:sched lock 1)
     179       658        2781        3866          28     99    138  0     17 /usr/src/sys/kern/sched_ule.c:804 (spin mutex:sched lock 4)
      99         0         194           0           2     97      0  0      0 /usr/src/sys/kern/kern_fork.c:731 (spin mutex:sched lock 1)
     184       800      801409        7904        7629    105      1  0     46 /usr/src/sys/dev/random/randomdev_soft.c:316 (spin mutex:entropy harvest mutex)
     436         0         903           0           4    225      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:16)
      89         0         101           0           3     33      0  0      0 /usr/src/sys/kern/kern_proc.c:504 (sleep mutex:process group)
      98         0         194           0           2     97      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:16)
      92         0         360           0           4     90      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:16)
      91         0         181           0           2     90      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:16)
      86         0         172           0           2     86      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:256)
   12183         0       15569           0           2   7784      0  0      0 /usr/src/sys/kern/vfs_vnops.c:594 (lockmgr:ufs)
     432         0        1472           0           9    163      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:128)
      80         0          80           0           1     80      0  0      0 /usr/src/sys/kern/kern_resource.c:1262 (rw:uidinfo hash)
      88         0          88           0           1     88      0  0      0 /usr/src/sys/kern/kern_exit.c:307 (sleep mutex:session)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/kern/kern_exit.c:346 (sleep mutex:session)
     445         0         445           0           1    445      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:256)
      92         0         183           0           2     91      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:64)
     598         0        2612           0          14    186      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:NAMEI)
     619         0         887           0           4    221      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:256)
      89         0         346           0           5     69      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:pipe)
      89         0         176           0           2     88      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:256)
      89         0         352           0           4     88      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:pipe)
     447         0         447           0           1    447      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1222 (sleep mutex:Softdep Lock)
     453         0         829           0           4    207      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:mbuf)
      87         0         171           0           2     85      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:pipe)
     286         0        1514           0          34     44      0  0      0 /usr/src/sys/vm/vnode_pager.c:226 (sleep mutex:vnode interlock)
     802         0        2358           0          10    235      0  0      0 /usr/src/sys/kern/sys_pipe.c:1487 (sleep mutex:pipe mutex)
      96         0         659           0          10     65      0  0      0 /usr/src/sys/kern/sys_pipe.c:1527 (sleep mutex:pipe mutex)
      92         0         105           0           2     52      0  0      0 /usr/src/sys/kern/vfs_vnops.c:676 (lockmgr:devfs)
   10316         0       13788           0           2   6894      0  0      0 /usr/src/sys/kern/vfs_subr.c:1702 (lockmgr:ufs)
     317         0         408           0           2    204      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:MAP ENTRY)
     369         0        3147           0          32     98      0  0      0 /usr/src/sys/vm/uma_core.c:2524 (sleep mutex:cpuset)
     264         0         264           0           1    264      0  0      0 /usr/src/sys/kern/uipc_socket.c:1889 (sleep mutex:so_rcv)
    1990         0        4523           0           9    502      0  0      0 /usr/src/sys/kern/kern_time.c:628 (sleep mutex:process lock)
     431         0         690           0           4    172      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:cpuset)
      94         0         359           0           4     89      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:128)
      85         0         171           0           2     85      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:cpuset)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:512)
     901         0         993           0           2    496      0  0      0 /usr/src/sys/vm/vm_pager.c:336 (sleep mutex:pbuf mutex)
     600         0        6344           0          42    151      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:MAP ENTRY)
      91         0         180           0           2     90      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:128)
     657         0        7390           0          46    160      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:512)
      86         0         172           0           2     86      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:64)
     454         0         631           0           3    210      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:Files)
    1012         0        4392           0          23    190      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:512)
     433         0         979           0           6    163      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:NAMEI)
      93         0         361           0           4     90      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:128)
      89         0         175           0           2     87      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:128)
     432         0         432           0           1    432      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:64)
     653         0        1402           0           7    200      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:ata_request)
     132         0         347           0           3    115      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:NAMEI)
     455         0        2139           0          12    178      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:VM OBJECT)
      93         0         358           0           4     89      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:64)
     455         0         903           0           2    451      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:64)
      94         0         186           0           2     93      0  0      0 /usr/src/sys/ufs/ffs/ffs_vnops.c:687 (sleep mutex:process lock)
     883         0        1395           0           6    232      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:NAMEI)
     107         0         282           0           3     94      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:NAMEI)
      93         0          93           0           1     93      0  0      0 /usr/src/sys/kern/kern_descrip.c:456 (sx:filedesc structure)
     453         0        2044           0          34     60      0  0      0 /usr/src/sys/vm/vnode_pager.c:136 (sleep mutex:vm object)
      93         0         358           0           4     89      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:Files)
      94         0         186           0           2     93      0  0      0 /usr/src/sys/vm/vnode_pager.c:369 (sleep mutex:vm object)
      88         0         175           0           2     87      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:Files)
     436         0         703           0           4    175      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:256)
     126         0         223           0           2    111      0  0      0 /usr/src/sys/vm/vnode_pager.c:768 (sleep mutex:vm object)
     648         0        7026           0          42    167      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:Files)
      91         0         267           0           3     89      0  0      0 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:pipe mutex)
     592         0        3790           0          21    180      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:Files)
      71       203          71         203           1     71    203  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 28)
      84         0          84           0           1     84      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 19)
      87       490          87         490           1     87    490  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 10)
     124         0         586           0           6     97      0  0      0 /usr/src/sys/kern/kern_fork.c:435 (spin mutex:sched lock 2)
      43         0          43           0           1     43      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 24)
     103        69         103          69           1    103     69  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 15)
     132         0         626           0           6    104      0  0      0 /usr/src/sys/kern/kern_fork.c:731 (spin mutex:sched lock 2)
      86       658          86         658           1     86    658  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 6)
      60         0          60           0           1     60      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 29)
      77       212          77         212           1     77    212  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 20)
      92       134          92         134           1     92    134  0      1 /usr/src/sys/kern/kern_sig.c:593 (spin mutex:sched lock 1)
      85       370          85         370           1     85    370  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 11)
     180         0         926           0           6    154      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 2)
      95       427         455         585           6     75     97  0      2 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 6)
      94         0         454           0           6     75      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 2)
      72         0          72           0           1     72      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 25)
      10         0          10           0           1     10      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 16)
     101         0        2245           0          32     70      0  0      0 /usr/src/sys/kern/kern_cpuset.c:166 (spin mutex:cpuset)
      58         0          58           0           1     58      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 30)
      93         0         539           0           7     77      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 2)
      90         0          90           0           1     90      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 21)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 12)
      93         0         438           0           5     87      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 3)
      95        88        2658          88          30     88      2  0      1 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 2)
      82         0          82           0           1     82      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 26)
      20         0          20           0           1     20      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 17)
     282        93        4492         179          17    264     10  0      2 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 2)
      23         0          23           0           1     23      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 8)
     138       612      271602       10124        2981     91      3  0     36 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 2)
      54         0          54           0           1     54      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 31)
     176         0         176           0           1    176      0  0      0 /usr/src/sys/kern/kern_sig.c:2251 (spin mutex:sched lock 1)
      88         0          88           0           1     88      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 22)
     253       260      534373        2935        3025    176      0  0     15 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 2)
      83         0          83           0           1     83      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 13)
     540         0     1396856           0       11747    118      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 2)
     136       252      265291        4838        2996     88      1  0     33 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 2)
     112         0        3689           0          47     78      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 2)
      73         0          73           0           1     73      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 4)
     176       446      494854      464029        5375     92     86  0   4487 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 2)
      53         0          53           0           1     53      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 27)
     105         0       14028           0         167     84      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 2)
     172       238       73934         347         843     87      0  0      2 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 2)
     132       212      187284        2387        2106     88      1  0     20 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 2)
      91       336          91         336           1     91    336  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 18)
      75       108          75         108           1     75    108  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 9)
     153       601    12195293      258655      146277     83      1  0   2039 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 2)
      53         0          61           0           2     30      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 0)
     128     15817       23069      181939         257     89    707  0    218 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 2)
     105       483         105         483           1    105    483  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 23)
     127         0       12552           0         139     90      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 2)
      92         0         183           0           2     91      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 2)
     143       377     1624500       51913       19455     83      2  0    422 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 2)
     114         0       54681           0         621     88      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 2)
     129         0       54702           0         619     88      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 2)
      82       478          82         478           1     82    478  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 14)
     173       626       21022       17184         225     93     76  0    102 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 13)
      11         0          11           0           1     11      0  0      0 /usr/src/sys/kern/sched_ule.c:2062 (spin mutex:sched lock 12)
     110         0         110           0           1    110      0  0      0 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 5)
      87         0          87           0           1     87      0  0      0 /usr/src/sys/kern/vfs_mount.c:453 (sleep mutex:struct mount mtx)
     139         0         139           0           1    139      0  0      0 /usr/src/sys/kern/vfs_bio.c:3549 (sleep mutex:vm object)
   17501      2180       17501        2180           1  17501   2180  0      1 /usr/src/sys/kern/vfs_bio.c:3650 (sleep mutex:vm object)
     662         0        1135           0           6    189      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:32)
      88         0          88           0           1     88      0  0      0 /usr/src/sys/ufs/ffs/ffs_alloc.c:942 (sleep mutex:FFS)
      92         0          92           0           1     92      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1379 (sleep mutex:Softdep Lock)
      83         0          83           0           1     83      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1544 (sleep mutex:Softdep Lock)
      94         0          94           0           1     94      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1576 (sleep mutex:Softdep Lock)
      79         0          79           0           1     79      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1611 (sleep mutex:Softdep Lock)
     647         0         647           0           1    647      0  0      0 /usr/src/sys/ufs/ffs/ffs_softdep.c:1679 (sleep mutex:Softdep Lock)
      98         0          98           0           1     98      0  0      0 /usr/src/sys/ufs/ffs/ffs_alloc.c:1494 (sleep mutex:FFS)
     721         0        1629           0          10    162      0  0      0 /usr/src/sys/vm/uma_core.c:2034 (sleep mutex:32)
      75         0          75           0           1     75      0  0      0 /usr/src/sys/ufs/ffs/ffs_alloc.c:1793 (sleep mutex:FFS)
     604         0        1412           0           4    353      0  0      0 /usr/src/sys/kern/vfs_bio.c:3662 (sleep mutex:vm page queue mutex)
     157         0         552           0           5    110      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:32)
      88         0          88           0           1     88      0  0      0 /usr/src/sys/kern/vfs_subr.c:1604 (sleep mutex:bufobj interlock)
     706         0        2011           0          10    201      0  0      0 /usr/src/sys/vm/uma_core.c:2602 (sleep mutex:32)
     612         0        1016           0           5    203      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:32)
     436         0        1235           0          10    123      0  0      0 /usr/src/sys/vm/uma_core.c:2464 (sleep mutex:VM OBJECT)
      94         0          94           0           1     94      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1737 (sleep mutex:bufobj interlock)
      87         0          87           0           1     87      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1759 (sleep mutex:bufobj interlock)
      91         0          91           0           1     91      0  0      0 /usr/src/sys/vm/uma_core.c:914 (sleep mutex:16)
      92         0          92           0           1     92      0  0      0 /usr/src/sys/ufs/ffs/ffs_vfsops.c:1217 (sleep mutex:FFS)
      96         0          96           0           1     96      0  0      0 /usr/src/sys/ufs/ffs/ffs_balloc.c:708 (sleep mutex:FFS)
    1050         0        1050           0           1   1050      0  0      0 /usr/src/sys/fs/devfs/devfs_vnops.c:525 (lockmgr:devfs)
     103         0       15419           0         178     86      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 3)
     121        95       59700          95         679     87      0  0      1 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 3)
     135       232      173288        1013        1932     89      0  0      9 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 3)
     151       395    12208207      268080      146745     83      1  0   2165 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 3)
     133     25083       21368      162100         233     91    695  0    207 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 3)
     153         0       10551           0         116     90      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 3)
      91         0         266           0           3     88      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 3)
     139       267     1630012       36250       19517     83      1  0    316 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 3)
     113         0       54379           0         616     88      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 3)
     127         0       54523           0         616     88      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 3)
      88         0         260           0           3     86      0  0      0 /usr/src/sys/kern/kern_fork.c:435 (spin mutex:sched lock 3)
     101         0         283           0           3     94      0  0      0 /usr/src/sys/kern/kern_fork.c:731 (spin mutex:sched lock 3)
      88       203          88         203           1     88    203  0      1 /usr/src/sys/kern/kern_thread.c:437 (spin mutex:sched lock 7)
     179       218         533         218           3    177     72  0      1 /usr/src/sys/kern/sched_ule.c:806 (spin mutex:sched lock 2)
     205         0         903           0           5    180      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 3)
     666         0        6044           0          15    402      0  0      0 /usr/src/sys/kern/sched_ule.c:803 (spin mutex:sched lock 3)
      92         0         617           0           7     88      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 3)
      95         0        2130           0          24     88      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 3)
     276         0        2942           0          11    267      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 3)
     137       569      224897        3592        2495     90      1  0     16 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 3)
     247       262      471593        1986        2644    178      0  0     10 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 3)
     634         0     1230489           0       10055    122      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 3)
     134       216      233865        3040        2620     89      1  0     25 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 3)
      99         0         802           0           9     89      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 3)
     125         0         469           0           5     93      0  0      0 /usr/src/sys/kern/sched_ule.c:2062 (spin mutex:sched lock 3)
     162       356      419733      356862        4579     91     77  0   3547 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 3)
    1573         0       30173           0          32    942      0  0      0 /usr/src/sys/kern/vfs_syscalls.c:1169 (lockmgr:ufs)
    1293      8252        4269        8607          19    224    453  0      4 /usr/src/sys/kern/kern_mutex.c:137 (sleep mutex:ttymtx)
    1637         0      285234           0         984    289      0  0      0 /usr/src/sys/dev/syscons/sysmouse.c:191 (sleep mutex:ttymtx)
     754         0       12328           0          32    385      0  0      0 /usr/src/sys/kern/sys_generic.c:1180 (sx:filedesc structure)
    2887     14400     1441832       93513         984   1465     95  0     65 /usr/src/sys/kern/tty.c:158 (sleep mutex:Giant)
    1649         0        3899           0          14    278      0  0      0 /usr/src/sys/kern/tty_inq.c:233 (sleep mutex:ttymtx)
     140       139       20388         403         155    131      2  0      3 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 4)
     572       141       51729         409         131    394      3  0      3 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 4)
     154       172       69899         517         600    116      0  0      4 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 4)
    1517       830       10460        4375          35    298    125  0     15 /usr/src/sys/kern/subr_turnstile.c:550 (spin mutex:turnstile lock)
     312       229      559874         754        2403    232      0  0      4 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 4)
     133         0         133           0           1    133      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:830 (spin mutex:sched lock 8)
     690         0      903544           0        5780    156      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 4)
     181       158      259797         698        2248    115      0  0      5 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 4)
     138         0        2030           0          33     61      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 4)
     231       396      261998      169972        2274    115     74  0   1545 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 4)
     158      7507       23964       13859         207    115     66  0      2 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 4)
     163         0       79791           0         642    124      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 4)
     166         0      179337           0        1573    114      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 4)
     179       553    16964892       78249      145948    116      0  0    439 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 4)
      59        56         649         588          29     22     20  0     27 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 4)
     171      1875      173782        3727        1316    132      2  0     10 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 4)
     126         0         580           0          16     36      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 4)
     183       250     2270596       10285       19411    116      0  0     73 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 4)
     158         0      125329           0        1039    120      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 4)
     139       488        4454         621          33    134     18  0      2 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 20)
     168     20864      127322       36843        1037    122     35  0      5 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 4)
     198       590        3613         590          22    164     26  0      1 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 16)
     147         0         147           0           1    147      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 4)
      45         0          45           0           1     45      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 4)
     193       134       12717        1518         155     82      9  0     16 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 9)
     267         0         391           0           2    195      0  0      0 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 5)
     131         0         131           0           1    131      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 5)
     134         0         134           0           1    134      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 5)
     151         0       12447           0         111    112      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 5)
     302       173       78698         173         425    185      0  0      1 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 5)
     556         0      149334           0        1063    140      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 5)
     161         0       39746           0         424     93      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 5)
     174       322       57864       41241         541    106     76  0    391 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 5)
     164         0       45827           0         364    125      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 5)
     131         0        4910           0          48    102      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 5)
     153         0       34593           0         376     92      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 5)
     219       522    17637939       11932      149927    117      0  0     76 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 5)
     133     12760        2095       26933          20    104   1346  0     19 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 5)
     133         0         398           0           3    132      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 5)
     170       187     2360952        2166       19940    118      0  0     18 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 5)
     165         0      156105           0        1205    129      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 5)
     177       989      156638        1174        1205    129      0  0      2 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 5)
     265         0         265           0           1    265      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 5)
     664         0        3525           0          20    176      0  0      0 /usr/src/sys/vm/uma_core.c:2661 (sleep mutex:MAP ENTRY)
     217         0         217           0           1    217      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 6)
      86         0          86           0           1     86      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 6)
     220         0      540242           0        4405    122      0  0      0 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 6)
     131         0         131           0           1    131      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 6)
     390         0        1614           0           5    322      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 6)
     186       129      489466         129        4022    121      0  0      1 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 6)
     265         0         543           0           4    135      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 6)
     180         0      966148           0        8051    120      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 6)
      56         0         154           0           3     51      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 6)
     138       203        3444        3291          29    118    113  0     25 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 6)
     143         0       23831           0         190    125      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 6)
      41         0         113           0           3     37      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 6)
     217       394    17371081        2579      147875    117      0  0     12 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 6)
     174         0      487425           0        4022    121      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 6)
     185       129     2317241         129       19667    117      0  0      1 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 6)
     163         0      146551           0        1155    126      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 6)
     189         0      148089           0        1155    128      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 6)
     260       326     1689597       31393       11811    143      2  0    196 /usr/src/sys/amd64/amd64/io_apic.c:229 (spin mutex:icu)
      89         0          89           0           1     89      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 7)
     222       226     2346549        2177       19951    117      0  0     22 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 7)
     160         0      155821           0        1206    129      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 7)
     175         0      156581           0        1206    129      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 7)
     268         0         268           0           1    268      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 7)
     120         0         120           0           1    120      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 7)
     136         0       21398           0        1048     20      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 7)
     314         0      115549           0         797    144      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 7)
     286         0      157206           0        3686     42      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 7)
     158         0       56875           0         797     71      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 7)
     179       251       87192       69543        1796     48     38  0   1610 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 7)
     153         0       59349           0         465    127      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 7)
     166         0       56766           0         784     72      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 7)
     134         0        1299           0          13     99      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 7)
     219       280    17495483        8092      150010    116      0  0     68 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 7)
     148     28434        4963      177376          90     55   1970  0     79 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 7)
      90         0         124           0           2     62      0  0      0 /usr/src/sys/kern/kern_sig.c:1450 (sleep mutex:process lock)
    1033       809        3140        1144          20    157     57  0      5 /usr/src/sys/kern/tty_inq.c:251 (sleep mutex:ttymtx)
       6         0          12           0           2      6      0  0      0 /usr/src/sys/kern/kern_proc.c:512 (sleep mutex:ttymtx)
     322       293      297237        2067        1324    224      1  0     11 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 8)
     806         0      500073           0        3279    152      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 8)
     165       267      138503         731        1254    110      0  0      4 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 8)
     149         0        1731           0          25     69      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 8)
     189       383      149929       80169        1248    120     64  0    791 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 8)
     157      8689       43190        8689         337    128     25  0      1 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 8)
     168         0       42265           0         311    135      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 8)
     167         0       94930           0         918    103      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 8)
     238       458    18247719       46710      147524    123      0  0    252 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 8)
     101     34308         590       34810          15     39   2320  0     15 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 8)
     187       957      105701        3059         703    150      4  0     10 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 8)
      51         0         390           0          12     32      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 8)
     178       379     2435040        4611       19621    124      0  0     29 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 8)
     160     44526      155739       44526        1221    127     36  0      1 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 8)
     175         0      162664           0        1216    133      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 8)
     150         0         150           0           1    150      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:830 (spin mutex:sched lock 4)
      29         0          29           0           1     29      0  0      0 /usr/src/sys/kern/kern_fork.c:435 (spin mutex:sched lock 8)
      41         0          41           0           1     41      0  0      0 /usr/src/sys/kern/kern_fork.c:731 (spin mutex:sched lock 8)
      65         0          65           0           1     65      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 8)
      44         0          44           0           1     44      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 8)
     151       146        9921         146          70    141      2  0      1 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 8)
     519       158       38739         313          90    430      3  0      2 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 8)
     182         0       47583           0         322    147      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 8)
     148         0         583           0           7     83      0  0      0 /usr/src/sys/netinet/tcp_input.c:1366 (sleep mutex:so_snd)
    3965         0       21643           0          17   1273      0  0      0 /usr/src/sys/netinet/tcp_input.c:1467 (sleep mutex:so_rcv)
    1886         0        4510           0           7    644      0  0      0 /usr/src/sys/kern/uipc_sockbuf.c:908 (sleep mutex:so_snd)
     320         0        1252           0          12    104      0  0      0 /usr/src/sys/netinet/tcp_input.c:2359 (sleep mutex:so_snd)
    2219         0       22477           0          36    624      0  0      0 /usr/src/sys/netinet/tcp_input.c:504 (rw:tcp)
    7017         0       66481           0          36   1846      0  0      0 /usr/src/sys/netinet/tcp_input.c:596 (rw:tcpinp)
    2079         0        3232           0           2   1616      0  0      0 /usr/src/sys/netinet/in.c:1164 (rw:lle)
      94         0          94           0           1     94      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 9)
     144         0         201           0           2    100      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 9)
     165         0       10584           0         135     78      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 9)
     319         0       36956           0         196    188      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 9)
     452         0       73902           0         723    102      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 9)
     157         0       19485           0         216     90      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 9)
     157       198       17539       13404         209     83     64  0    166 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 9)
     166         0       37007           0         275    134      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 9)
     300         0       14940           0         147    101      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 9)
     151         0        5701           0          69     82      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 9)
     148         0        1263           0          22     57      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:772 (spin mutex:sched lock 9)
     114         0         816           0          11     74      0  0      0 /usr/src/sys/kern/subr_turnstile.c:717 (spin mutex:td_contested)
     241       617    18573174        4579      149994    123      0  0     26 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 9)
     139     11668        1337       15157          15     89   1010  0     14 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 9)
     163         0       16297           0         137    118      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 9)
     176       165     2488260         549       19950    124      0  0      4 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 9)
     163         0      180222           0        1348    133      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 9)
     176         0      187710           0        1348    139      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 9)
     144       140         642         140           5    128     28  0      1 /usr/src/sys/kern/subr_sleepqueue.c:772 (spin mutex:sched lock 1)
     100       107         100         107           1    100    107  0      1 /usr/src/sys/kern/subr_sleepqueue.c:772 (spin mutex:sched lock 20)
     161         0         161           0           1    161      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 9)
     138         0         138           0           1    138      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:772 (spin mutex:sched lock 2)
      87         0         530           0           8     66      0  0      0 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:turnstile lock)
     169         0         169           0           1    169      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 10)
      53         0          53           0           1     53      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 10)
      78         0          78           0           1     78      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 10)
     117         0         584           0           6     97      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 10)
     109         0         759           0          14     54      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 10)
      57         0         243           0           5     48      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 10)
     148       189        3432        2519          29    118     86  0     20 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 10)
     159         0       44757           0         340    131      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 10)
      57         0         251           0           5     50      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 10)
     250       259    18666171         476      150492    124      0  0      2 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 10)
     239         0     2487824           0       20016    124      0  0      0 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 10)
     170         0      181029           0        1345    134      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 10)
     188         0      189449           0        1345    140      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 10)
     213         0         213           0           1    213      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 11)
      98         0          98           0           1     98      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 11)
     124         0         177           0           2     88      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 11)
     154       179        3117        2525          23    135    109  0     17 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 11)
     157         0       24165           0         186    129      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 11)
     247       246    18745576         486      150491    124      0  0      2 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 11)
     191         0     2502075           0       20016    125      0  0      0 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 11)
     160         0      180732           0        1346    134      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 11)
     181         0      190522           0        1346    141      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 11)
     197       520    17757778       33685      148369    119      0  0    205 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 12)
     151     34362        7124      148953         101     70   1474  0     81 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 12)
     164       784       77010        1187         581    132      2  0      4 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 12)
      91         0         262           0           4     65      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 12)
     182       648     2364490        6703       19733    119      0  0     43 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 12)
     158         0      155038           0        1206    128      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 12)
     185         0      156392           0        1204    129      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 12)
      12         0          12           0           1     12      0  0      0 /usr/src/sys/kern/kern_fork.c:435 (spin mutex:sched lock 12)
      40         0          40           0           1     40      0  0      0 /usr/src/sys/kern/kern_fork.c:731 (spin mutex:sched lock 12)
     214         0         214           0           1    214      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 12)
     157       136       10592         269          79    134      3  0      2 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 12)
     129         0         129           0           1    129      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 12)
     137       157       10818         426          83    130      5  0      3 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 12)
     535         0       33365           0          84    397      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 12)
     138       155       37979         155         293    129      0  0      1 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 12)
     300       261      321588        1344        2055    156      0  0      8 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 12)
     720         0      536914           0        4628    116      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 12)
     168       164      150149         411        1972     76      0  0      3 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 12)
     133         0        1087           0          20     54      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 12)
     172       367      159625      111353        1927     82     57  0   1509 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 12)
     169       100       55526         100         431    128      0  0      1 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 12)
     155         0       45673           0         362    126      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 12)
     147         0      102633           0        1590     64      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 12)
     172         0       15040           0         124    121      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 13)
     298         0       24329           0         103    236      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 13)
     518         0       70320           0         451    155      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 13)
     165         0       12158           0         102    119      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 13)
     166       346       28076       16795         230    122     73  0    133 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 13)
     160         0       48078           0         373    128      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 13)
     151         0        2307           0          20    115      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 13)
     145         0        9655           0          82    117      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 13)
     197       372    17939269        6059      150298    119      0  0     39 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 13)
     123     15447        1043       16343           9    115   1815  0      8 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 13)
     195       210     2393923        1558       19989    119      0  0     11 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 13)
     157         0      159081           0        1223    130      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 13)
     183         0      160248           0        1223    131      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 13)
     265         0         265           0           1    265      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 13)
     133         0         133           0           1    133      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 13)
      65         0          65           0           1     65      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 13)
     208       117         542         117           3    180     39  0      1 /usr/src/sys/kern/kern_sig.c:2251 (spin mutex:sched lock 7)
     129         0         129           0           1    129      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 14)
      79         0         152           0           2     76      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 14)
     189       127      158402         127        2016     78      0  0      1 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 14)
     293         0       19853           0          87    228      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 14)
     594         0      327945           0        4190     78      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 14)
     171         0       10350           0          85    121      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 14)
     185       262      157944      110325        1983     79     55  0   1631 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 14)
     154         0       65816           0         507    129      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 14)
     112         0        1172           0          13     90      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 14)
     162         0        8714           0          72    121      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 14)
     216       331    17798102       31600      148159    120      0  0    258 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 14)
     193     23502       14996      154297         147    102   1049  0    109 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 14)
     100         0         100           0           1    100      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 14)
     182       216     2362530       15674       19705    119      0  0    129 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 14)
     169         0      159746           0        1227    130      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 14)
     173         0      161416           0        1227    131      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 14)
     142       574         326         574           3    108    191  0      1 /usr/src/sys/kern/kern_sig.c:593 (spin mutex:sched lock 7)
     219         0         219           0           1    219      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 14)
     599         0        1102           0           5    220      0  0      0 /usr/src/sys/vm/uma_core.c:2355 (sleep mutex:g_bio)
     257         0         257           0           1    257      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 15)
      94         0          94           0           1     94      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 15)
     137         0        4670           0          36    129      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 15)
     176       262         531         393           4    132     98  0      2 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 29)
     173       174      280664         296        3289     85      0  0      2 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 15)
     275         0       11397           0          47    242      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 15)
     326         0      554595           0        6670     83      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 15)
     118         0         990           0          11     90      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 15)
     134       165        3161        2270          28    112     81  0     20 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 15)
     162         0       43190           0         340    127      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 15)
     121         0         913           0          10     91      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 15)
      77         0          77           0           1     77      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 15)
     221       235    17483247        2367      147097    118      0  0     15 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 15)
     115       115         115         115           1    115    115  0      1 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 15)
     173         0      275348           0        3313     83      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 15)
     115         0         115           0           1    115      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 15)
     190       133     2331960         264       19564    119      0  0      2 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 15)
     187         0      153531           0        1202    127      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 15)
     177         0      155764           0        1202    129      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 15)
     147         0         386           0           3    128      0  0      0 /usr/src/sys/kern/kern_intr.c:800 (spin mutex:sched lock 22)
      34         0          34           0           1     34      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 16)
      12         0          12           0           1     12      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 16)
     150         0        2783           0          20    139      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 16)
     441         0       11049           0          26    424      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 16)
     178         0        9738           0          67    145      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 16)
     307         0       72120           0         658    109      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 16)
     751         0      205580           0        1994    103      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 16)
     159         0       33453           0         638     52      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 16)
     142         0         687           0          29     23      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 16)
     191       314       48281       31817         705     68     45  0    576 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 16)
     175      1176       54780        1176         438    125      2  0      1 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 16)
     156         0        7463           0          72    103      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 16)
     165        43       25851          43         537     48      0  0      1 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 16)
     195       447    19168570       27791      149832    127      0  0    143 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 16)
      95      4675         787        8915          20     39    445  0      8 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 16)
     181       150       21282         150         141    150      1  0      1 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 16)
      14         0          14           0           1     14      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 16)
     185       296     2532109        3986       19927    127      0  0     25 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 16)
     165      7071      184586        7071        1410    130      5  0      1 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 16)
     175       471      191780         471        1409    136      0  0      1 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 16)
     284         0        1859           0          11    169      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 17)
     422         0       95623           0         709    134      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 17)
     145         0         843           0           9     93      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 17)
     183       213        8819        7032          69    127    101  0     51 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 17)
     178         0       55569           0         415    133      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 17)
     144         0         640           0           7     91      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 17)
     142         0         174           0           2     87      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 17)
     242       421    19110246       12913      150358    127      0  0     57 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 17)
     163         0         600           0           4    150      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 17)
     113         0         113           0           1    113      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 17)
     174       271     2537745        1144       19998    126      0  0      5 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 17)
     165      1009      190000        1009        1447    131      0  0      1 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 17)
     180         0      198139           0        1447    136      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 17)
      66         0          66           0           1     66      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 17)
      33         0          33           0           1     33      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 17)
      80         0         129           0           2     64      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 17)
     114         0         489           0           5     97      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 17)
      37       231          72         318           2     36    159  0      2 /usr/src/sys/vm/uma_core.c:2703 (sleep mutex:selfd)
      60         0          60           0           1     60      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 18)
     168         0        1582           0          28     56      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 18)
     108         0        1926           0          58     33      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 18)
     103         0         821           0          27     30      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 18)
      41         0         417           0          22     18      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 18)
     166       204       12231        9778         109    112     89  0     80 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 18)
     160         0       58138           0         471    123      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 18)
      92         0         303           0           4     75      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 18)
      80         0          80           0           1     80      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 18)
     232       269    19121479        3274      150477    127      0  0     16 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 18)
      41        30         117          96           4     29     24  0      4 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 18)
     188       148     2555247         338       20014    127      0  0      3 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 18)
     174         0      189386           0        1412    134      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 18)
     179         0      199334           0        1412    141      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 18)
     231         0         231           0           1    231      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 18)
      84         0          84           0           1     84      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 18)
     200         0         200           0           1    200      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 19)
     106         0         106           0           1    106      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 19)
     145         0         628           0           5    125      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 19)
     243         0        2928           0          15    195      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 19)
     148         0        4096           0          39    105      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 19)
     123         0        1499           0          15     99      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 19)
     151       192       13026       10296         101    128    101  0     72 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 19)
     155         0       36639           0         263    139      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 19)
     119         0        1242           0          13     95      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 19)
     117         0         234           0           2    117      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 19)
     242       256    19190018        2079      150446    127      0  0     11 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 19)
      96     19686          96       19686           1     96  19686  0      1 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 19)
     148         0         272           0           2    136      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 19)
     116         0         116           0           1    116      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 19)
     184       248     2550616         778       20010    127      0  0      4 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 19)
     166      1138      186970        1138        1384    135      0  0      1 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 19)
     184         0      198078           0        1384    143      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 19)
     232         0         232           0           1    232      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 20)
     276         0        1059           0           4    264      0  0      0 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 20)
     138         0         138           0           1    138      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 20)
     137         0        4481           0          34    131      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 20)
     406         0       11866           0          30    395      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 20)
     217         0       54830           0         430    127      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 20)
     332       282      132505         282         825    160      0  0      1 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 20)
     768         0      259170           0        2513    103      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 20)
     178       133       60856         133         792     76      0  0      1 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 20)
     131         0         361           0           5     72      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 20)
     192       346       99689       65355        1079     92     60  0    793 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 20)
     180      6620       53718        6620         414    129     15  0      1 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 20)
     243         0       28855           0         507     56      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 20)
     173       170       33337         270         280    119      0  0      2 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 20)
     234       548    18227157       27874      149479    121      0  0    167 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 20)
     181     12013        4696       71176          55     85   1294  0     43 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 20)
     152       781       34534        1085         261    132      4  0      3 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 20)
     126         0         126           0           1    126      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 20)
     200       230     2429158        4608       19880    122      0  0     35 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 20)
     188         0      162222           0        1243    130      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 20)
     187         0      163634           0        1243    131      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 20)
     218       303    18360192       10884      150103    122      0  0     66 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 21)
     150     17826        2812       28299          26    108   1088  0     24 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 21)
     172         0        1658           0          13    127      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 21)
     122         0         122           0           1    122      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 21)
     200       210     2439847        2228       19964    122      0  0     16 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 21)
     166         0      163680           0        1248    131      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 21)
     198         0      164894           0        1248    132      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 21)
     239         0         239           0           1    239      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 21)
     131         0         131           0           1    131      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 21)
     400         0         400           0           1    400      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 21)
     208       129       16245         129         145    112      0  0      1 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 21)
     316         0       51747           0         221    234      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 21)
     671         0      123030           0         727    169      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 21)
     170       102       25794         102         221    116      0  0      1 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 21)
     106         0         106           0           1    106      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 21)
     217       395       39448       24498         328    120     74  0    211 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 21)
     162         0       53858           0         410    131      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 21)
     174         0        4444           0          43    103      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 21)
     188       116       21421         116         177    121      0  0      1 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 21)
     133         0         369           0           3    123      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 22)
     329         0       33134           0         141    234      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 22)
     604         0       52680           0         286    184      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 22)
     167         0       16178           0         140    115      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 22)
     197       181       16982        9952         135    125     73  0     86 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 22)
     166         0       49064           0         374    131      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 22)
     200         0        6818           0          62    109      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 22)
     198         0        9943           0          78    127      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 22)
     235       235    18313061        4756      150288    121      0  0     28 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 22)
     178     19450        1195       36602           9    132   4066  0      8 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 22)
     147         0         282           0           2    141      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 22)
     133         0         133           0           1    133      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 22)
     191       130     2435428         130       19988    121      0  0      1 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 22)
     170         0      163012           0        1247    130      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 22)
     195         0      164561           0        1247    131      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 22)
     127         0         127           0           1    127      0  0      0 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 21)
     271         0         271           0           1    271      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 22)
     247         0         247           0           1    247      0  0      0 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 22)
     122         0         122           0           1    122      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 22)
     148         0         148           0           1    148      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 22)
     405         0         405           0           1    405      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 22)
     250         0         250           0           1    250      0  0      0 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 23)
     126         0         126           0           1    126      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 23)
     291         0        2045           0           8    255      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 23)
     161         0        2022           0          17    118      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 23)
     134         0         936           0           8    117      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 23)
     128         0         128           0           1    128      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 23)
     138       134         900         610           8    112     76  0      6 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 23)
     182         0       65665           0         503    130      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 23)
     139         0         873           0           7    124      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 23)
     221       239    18360837         400      150486    122      0  0      2 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 23)
     200         0     2432614           0       20014    121      0  0      0 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 23)
     164         0      163321           0        1250    130      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 23)
     178         0      164761           0        1250    131      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 23)
     277         0         277           0           1    277      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 23)
     156         0         156           0           1    156      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 24)
     197         0        1280           0           7    182      0  0      0 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 24)
      67         0          67           0           1     67      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 24)
     150         0        1112           0           8    139      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 24)
     441         0        3033           0           7    433      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 24)
     170         0        6380           0          43    148      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 24)
     317         0       26153           0          97    269      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 24)
     593         0       41358           0         279    148      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 24)
     156         0       11976           0          89    134      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 24)
     148         0         275           0           2    137      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:393 (spin mutex:sched lock 24)
     182       206       13815        8090          96    143     84  0     60 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 24)
     161         0       31372           0         226    138      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 24)
     158         0        5526           0          40    138      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 24)
     153         0        6163           0          47    131      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 24)
     222       367    19444596        5872      150222    129      0  0     32 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 24)
     157       139         233         139           2    116     69  0      1 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 24)
     174         0        9791           0          65    150      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 24)
     196       207     2578234         958       19980    129      0  0      6 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 24)
     171         0      189467           0        1403    135      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 24)
     187         0      195888           0        1403    139      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 24)
     195         0         195           0           1    195      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 25)
     123         0         123           0           1    123      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 25)
     265         0         929           0           4    232      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 25)
     352         0        1129           0           9    125      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 25)
     101         0         370           0           4     92      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 25)
     143       121         537         215           5    107     43  0      2 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 25)
     156         0       34359           0         251    136      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 25)
     102         0         301           0           3    100      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 25)
     103         0         103           0           1    103      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 25)
     235       103    19343520         103      150486    128      0  0      1 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 25)
     183         0     2585637           0       20015    129      0  0      0 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 25)
     169         0      190949           0        1407    135      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 25)
     201         0      200265           0        1407    142      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 25)
     165       140        2338        1300          20    116     65  0     12 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 26)
     159         0       32441           0         250    129      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 26)
     144         0        1352           0          12    112      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 26)
     147         0        1082           0           8    135      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 26)
     236       276    19565131        1551      150462    130      0  0      8 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 26)
     166     94806         246       94949           2    123  47474  0      2 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 26)
     130         0         130           0           1    130      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 26)
     193         0     2605687           0       20012    130      0  0      0 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 26)
     172         0      191338           0        1405    136      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 26)
     194         0      202172           0        1405    143      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 26)
     180         0         180           0           1    180      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 26)
     286         0         286           0           1    286      0  0      0 /usr/src/sys/kern/sched_ule.c:807 (spin mutex:sched lock 26)
      98         0          98           0           1     98      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 26)
     134         0         134           0           1    134      0  0      0 /usr/src/sys/kern/subr_turnstile.c:203 (spin mutex:sched lock 22)
     144         0         199           0           2     99      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 26)
     153         0         359           0           4     89      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 26)
     286         0        5237           0          22    238      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 26)
     411         0        7052           0          49    143      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 26)
     153         0        2419           0          20    120      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 26)
     156         0         156           0           1    156      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 27)
     289         0        1848           0           8    231      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 27)
     157         0        2027           0          18    112      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 27)
     147         0         867           0           7    123      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 27)
     168       127        1168         685          10    116     68  0      7 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 27)
     161         0       42236           0         322    131      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 27)
     122         0         787           0           7    112      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 27)
     235       209    19565151         209      150481    130      0  0      1 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 27)
     191        97     2601059          97       20014    129      0  0      1 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 27)
     179         0      191553           0        1409    135      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 27)
     204         0      202803           0        1409    143      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 27)
     219         0         219           0           1    219      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 27)
     116         0         116           0           1    116      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 27)
      56         0          56           0           1     56      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 28)
     460         0         919           0           2    459      0  0      0 /usr/src/sys/kern/subr_turnstile.c:889 (spin mutex:sched lock 28)
     167         0        1190           0           8    148      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 28)
     299         0        6991           0          43    162      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 28)
     486         0        9474           0         101     93      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 28)
     154         0        3563           0          43     82      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 28)
     179       158        3892        2322          44     88     52  0     33 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 28)
     180         0       60086           0         454    132      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 28)
     243         0        2959           0          37     79      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 28)
     149         0         852           0           6    142      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 28)
     204       257    19441142         656      150448    129      0  0      4 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 28)
      43        40          76          40           2     38     20  0      1 /usr/src/sys/kern/sched_ule.c:2569 (spin mutex:sched lock 28)
     175         0        2051           0          13    157      0  0      0 /usr/src/sys/kern/kern_switch.c:188 (spin mutex:sched lock 28)
     141         0         141           0           1    141      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 28)
     201         0     2613714           0       20010    130      0  0      0 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 28)
     163         0      191238           0        1414    135      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 28)
     195         0      198847           0        1414    140      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 28)
     220         0         220           0           1    220      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 28)
     208         0         208           0           1    208      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 29)
     108         0         108           0           1    108      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 29)
      66         0          66           0           1     66      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 29)
     141         0         376           0           3    125      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 29)
     287         0        2179           0          10    217      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 29)
     310         0        3209           0          26    123      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 29)
     131         0         980           0           9    108      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 29)
     153       148        1511         836          13    116     64  0      8 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 29)
     181         0       53204           0         386    137      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 29)
     131         0         888           0           8    111      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 29)
     122         0         122           0           1    122      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 29)
     231       228    19380181         809      150480    128      0  0      5 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 29)
     125         0         125           0           1    125      0  0      0 /usr/src/sys/kern/sched_ule.c:2627 (spin mutex:sched lock 29)
     193         0     2596839           0       20013    129      0  0      0 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 29)
     169         0      192037           0        1413    135      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 29)
     186         0      201853           0        1413    142      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 29)
     201       167     2599885         816       20010    129      0  0      6 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 30)
     176         0      191774           0        1411    135      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 30)
     197         0      203859           0        1411    144      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 30)
     195         0         195           0           1    195      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 30)
      58         0          58           0           1     58      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 30)
     165         0         823           0           6    137      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 30)
     297         0        4598           0          18    255      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 30)
     657         0        7138           0          44    162      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 30)
     153       134        2348         134          18    130      7  0      1 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 30)
     178       339        2576        1799          19    135     94  0     13 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 30)
     177         0       54758           0         398    137      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 30)
     159         0        1663           0          13    127      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 30)
     142         0         680           0           5    136      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:618 (spin mutex:sched lock 30)
     227       262    19491568        1406      150454    129      0  0      8 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 30)
     290         0        2986           0          12    248      0  0      0 /usr/src/sys/kern/sched_ule.c:1835 (spin mutex:sched lock 31)
     163         0        3729           0          30    124      0  0      0 /usr/src/sys/kern/sched_ule.c:1876 (spin mutex:sched lock 31)
     137         0        1365           0          11    124      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:335 (spin mutex:sched lock 31)
     163       147        1767        1163          14    126     83  0     10 /usr/src/sys/kern/sched_ule.c:2074 (spin mutex:sched lock 31)
     173         0       42066           0         306    137      0  0      0 /usr/src/sys/kern/sched_ule.c:2111 (spin mutex:sched lock 31)
     157         0        1418           0          11    128      0  0      0 /usr/src/sys/kern/subr_sleepqueue.c:583 (spin mutex:sched lock 31)
     240       270    19506265         993      150479    129      0  0      5 /usr/src/sys/kern/kern_clock.c:286 (spin mutex:sched lock 31)
     188       171     2597613         171       20014    129      0  0      1 /usr/src/sys/kern/kern_clock.c:503 (spin mutex:sched lock 31)
     168         0      191443           0        1409    135      0  0      0 /usr/src/sys/kern/subr_trap.c:167 (spin mutex:sched lock 31)
     199         0      201251           0        1409    142      0  0      0 /usr/src/sys/kern/subr_trap.c:213 (spin mutex:sched lock 31)
     251         0         251           0           1    251      0  0      0 /usr/src/sys/kern/kern_thread.c:410 (spin mutex:sched lock 31)
     109         0         109           0           1    109      0  0      0 /usr/src/sys/kern/kern_umtx.c:3360 (spin mutex:sched lock 31)
     149         0         149           0           1    149      0  0      0 /usr/src/sys/kern/subr_turnstile.c:727 (spin mutex:sched lock 31)
     148         0         423           0           3    141      0  0      0 /usr/src/sys/kern/kern_intr.c:1239 (spin mutex:sched lock 31)

help

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4451ccf20904020314r7591a546l89573aa76a44143a>