Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 02 Jun 2013 22:35:23 +0200
From:      Palle Girgensohn <girgen@FreeBSD.org>
To:        Kirk McKusick <mckusick@mckusick.com>
Cc:        freebsd-fs@FreeBSD.org, Dan Thomas <godders@gmail.com>, Jeff Roberson <jroberson@jroberson.net>, Julian Akehurst <julian@pingpong.se>
Subject:   Re: leaking lots of unreferenced inodes (pg_xlog files?) 
Message-ID:  <69D8CE6E8C429368C08781FD@Spelvik.local>
In-Reply-To: <201305311825.r4VIPeFV077457@chez.mckusick.com>
References:  <201305311825.r4VIPeFV077457@chez.mckusick.com>

next in thread | previous in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]


--On 31 maj 2013 11.25.40 -0700 Kirk McKusick <mckusick@mckusick.com> wrote:

>> Date: Thu, 30 May 2013 12:56:54 +0200
>> From: Palle Girgensohn <girgen@FreeBSD.org>
>> To: Kirk McKusick <mckusick@mckusick.com>
>> CC: freebsd-fs@FreeBSD.org, Jeff Roberson <jroberson@jroberson.net>,
>>         Dan Thomas <godders@gmail.com>, Julian Akehurst
>>         <julian@pingpong.se> Subject: Re: leaking lots of unreferenced
>> inodes (pg_xlog files?)
>>
>> Hello again!
>>
>> I have now remounted the postgresql filesystem on a test server that
>> experiences the same problem. The production server is not remounted
>> yet, we're planning that in a weeks time approximately, but I though I
>> could gain som time by running the suggested procedure on the test box.
>>
>> The base problem was this:
>>
>> # df -h /pgsql ; du -hxs /pgsql
>> Filesystem     Size    Used   Avail Capacity  Mounted on
>> /dev/da2s1d    128G    101G     17G    86%    /pgsql
>>  82G	/pgsql
>>
>> df says 101 GB used, but du only finds 82 GB, and fstat cannot find any
>> open files that are unreferenced in the file system. Stopping postgresql
>> does not help. It seems the OS is leaking inode references.
>>
>> FreeBSD 9.1, postgresql 9.2.3 from port.
>>
>> I ran the suggested commans (in attached diskspacecheck) before stopping
>> postgresql (before.log), after stopping postgresql but before unmount
>> /pgsql (before2.log), and then i unmounted /pgsql (had to run umount -f
>> /pgsql, and it took about 20 seconds). I did not enter single-user mode,
>> since I really did not have to this time (On the production server, the
>> disk is /usr, so that will require more shutting down...)
>>
>> I've attach the logs here. Hope it helps!
>>
>> The commands run in diskspaccheck are
>> # ! /bin/sh
>> df -ih /pgsql
>> vmstat -z
>> vmstat -m
>> sysctl debug
>> fstat -f /pgsql
>>
>> as suggested by Kirk.
>
> Your results are very enlightening. Especially the fact that you have
> to do a forcible unmount of the filesystem. What that tells me is that
> somehow we are getting vnodes that have phantom references. That is
> there is some system call where we get a reference on a vnode (vref,
> vget, or similar) that does not ultimately have a corresponding drop
> of the reference (vrele, vput, or similar). The net effect is that
> the file is held open despite the fact that there are no longer any
> connections to it. When you do the forcible unmount, the kernel walks
> the list of vnodes associated with the filesystem and does a vgone on
> each of them. That causes each to be inactivated which then triggers
> the release of their associated disk space. The reason that the unmount
> takes 20 seconds is to process all the releasing of the space. My guess
> is that there is an error path in some system call that is missing the
> vrele or vput.
>
> Assuming that you are able to run some more tests on your test machine,
> the next step in narrowing down the set of code to look at is to try
> running your system with soft updates disabled. The idea is to find out
> whether the miss-matched references are in the soft updates code or are
> in one of the filesystem system calls themselves. To disable soft updates
> run the command `tunefs -n disable /pgsql' on the unmounted /pgsql
> filesystem. If the system then runs without the problem, I will know
> to search the soft updates code. If the problem persists, then I'll
> know to look in the system calls themselves. You may want to do some
> preliminary tests to see how quickly the problem manifests itself.
> You can do this by running it for a short time (10 minutes say) and
> then checking to see if you need to do a forcible unmount of the
> filesystem. Once you establish how long you have to run before you
> reliably have to do a forcible unmount, you will know how long to
> run the test with soft updates turned off. If you find that running
> with soft updates turned off makes your application run too slowly
> you can mount your filesystem asynchronously. Note however, that you
> should not run asynchronously if the data on the filesystem is critical
> as you may end up with an unrecoverable filesystem after a power failure
> or system crash. So only run asynchronously if you can afford to lose
> your filesystem.
>
> Finally, it would be helpful if you could add two more commands to
> your diskspacecheck.sh script:
>
> 	sysctl -a | egrep vnode
> 	mount -v
>
> The first shows the vnode usage and the second shows the operational
> state of your filesystems.
>
> 	Kirk McKusick


OK, I have now turned off soft updates. This is on the test server. It is 
not as busy as the production machine, but I'll keep an eye on it and will 
mail new results as soon as I see any evidence of either that soft updates 
is the culprit or that it is not.

FWIW, I attach the script from this remount process as well, which includes 
sysctl -a | grep vnode ; mount -v. Note that it is all in one script file 
this time.

Cheers,
Palle

[-- Attachment #2 --]
Script started on Sun Jun  2 22:23:30 2013

# ./dissh -x dssiskspacecheck.sh 
+ df -ih /pgsql
Filesystem     Size    Used   Avail Capacity iused ifree %iused  Mounted on
/dev/da2s1d    128G     82G     36G    70%     23k   17M    0%   /pgsql
+ vmstat -z
ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               208,      0,      86,      16,      86,   0,   0
UMA Zones:             1408,      0,      86,       0,      86,   0,   0
UMA Slabs:              568,      0,    6814,     501,  628393,   0,   0
UMA RCntSlabs:          568,      0,    4591,     575,  392869,   0,   0
UMA Hash:               256,      0,       0,       0,       3,   0,   0
16 Bucket:              152,      0,      27,      73,     211,   0,   0
32 Bucket:              280,      0,      47,     149,     339,   6,   0
64 Bucket:              536,      0,      78,      76,     752,  90,   0
128 Bucket:            1048,      0,    1029,       0, 1556449,15347101,   0
VM OBJECT:              232,      0,  175801,   10231,141942241,   0,   0
MAP:                    232,      0,       7,      25,       7,   0,   0
KMAP ENTRY:             120, 1128710,   13078,   38134,1793769193,   0,   0
MAP ENTRY:              120,      0,    2816,    2950,301949020,   0,   0
fakepg:                 120,      0,       0,       0,       0,   0,   0
mt_zone:               4112,      0,     326,       1,     326,   0,   0
16:                      16,      0,    2335,    2033,15180912,   0,   0
32:                      32,      0,    2777,    1667,50199230,   0,   0
64:                      64,      0,    5358,    4274,83081944,   0,   0
128:                    128,      0,    9928,    4659,689513925,   0,   0
256:                    256,      0,    1375,   32675,2920247995,   0,   0
512:                    512,      0,    2796,    2335,18129940,   0,   0
1024:                  1024,      0,      78,    1314, 2200164,   0,   0
2048:                  2048,      0,    5674,    1228, 4135166,   0,   0
4096:                  4096,      0,     465,    1135, 5327115,   0,   0
Files:                   80,      0,    1440,    9765,199211698,   0,   0
TURNSTILE:              136,      0,    1939,     121,    1948,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1184,      0,      82,    1403, 4546417,   0,   0
THREAD:                1128,      0,    1549,     389,    1963,   0,   0
SLEEPQUEUE:              80,      0,    1939,     265,    1948,   0,   0
VMSPACE:                392,      0,      63,    1527, 4546400,   0,   0
cpuset:                  72,      0,      85,      65,      85,   0,   0
audit_record:           960,      0,       0,       0,       0,   0,   0
mbuf_packet:            256,      0,    4080,    1680,697803690,   0,   0
mbuf:                   256,      0,    1024,    1721,1962823303,   0,   0
mbuf_cluster:          2048,  25600,    5760,    1254, 1708544,   0,   0
mbuf_jumbo_page:       4096,  12800,       0,    1084,83505285,   0,   0
mbuf_jumbo_9k:         9216,   6400,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384,   3200,       0,       0,       0,   0,   0
mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0
g_bio:                  232,      0,       0,    1584,2977841032,   0,   0
ttyinq:                 160,      0,     150,     474,    2625,   0,   0
ttyoutq:                256,      0,      80,     340,    1400,   0,   0
ata_request:            328,      0,       0,      84,      32,   0,   0
ata_composite:          336,      0,       0,       0,       0,   0,   0
VNODE:                  480,      0,  189957,   75443,158977776,   0,   0
VNODEPOLL:              112,      0,       0,     132,       6,   0,   0
NAMEI:                 1024,      0,       0,    1212,432374508,   0,   0
S VFS Cache:            108,      0,  191219,   86608,163308355,   0,   0
STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
L VFS Cache:            328,      0,   12711,    4005, 7622822,   0,   0
LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
NCLNODE:                568,      0,       0,       0,       0,   0,   0
DIRHASH:               1024,      0,      95,     953, 3085295,   0,   0
Mountpoints:            792,      0,       8,      32,       9,   0,   0
pipe:                   728,      0,      36,    1294, 3975670,   0,   0
ksiginfo:               112,      0,    1474,    1430,10113975,   0,   0
itimer:                 344,      0,       1,      21,       1,   0,   0
KNOTE:                  128,      0,       0,    1711, 1114947,   0,   0
socket:                 680, 100002,      64,    1394, 9634169,   0,   0
ipq:                     56,    819,       0,       0,       0,   0,   0
udp_inpcb:              392, 100000,      13,    1547, 7561634,   0,   0
udpcb:                   16, 100128,      13,    1835, 7561634,   0,   0
tcp_inpcb:              392, 100000,      36,    1724,  663410,   0,   0
tcpcb:                  976, 100000,      36,    1736,  663410,   0,   0
tcptw:                   72,  20000,       0,     550,    3284,   0,   0
syncache:               152,  15375,       0,     625,  514658,   0,   0
hostcache:              136,  15372,       5,     499,    1879,   0,   0
tcpreass:                40,   1680,       0,    1596,   21748,   0,   0
sackhole:                32,      0,       0,     909,     885,   0,   0
sctp_ep:               1376, 100000,       0,       0,       0,   0,   0
sctp_asoc:             2288,  40000,       0,       0,       0,   0,   0
sctp_laddr:              48,  80064,       0,     288,       6,   0,   0
sctp_raddr:             704,  80000,       0,       0,       0,   0,   0
sctp_chunk:             136, 400008,       0,       0,       0,   0,   0
sctp_readq:             104, 400032,       0,       0,       0,   0,   0
sctp_stream_msg_out:    112, 400026,       0,       0,       0,   0,   0
sctp_asconf:             40, 400008,       0,       0,       0,   0,   0
sctp_asconf_ack:         48, 400032,       0,       0,       0,   0,   0
ripcb:                  392, 100000,       0,     100,     126,   0,   0
unpcb:                  240, 100000,      14,    1314, 1408993,   0,   0
rtentry:                200,      0,      23,      91,      23,   0,   0
selfd:                   56,      0,    2006,    1333,309376572,   0,   0
SWAPMETA:               288, 116519,      56,     542, 1072105,   0,   0
FFS inode:              168,      0,  185754,   77718,158975446,   0,   0
FFS1 dinode:            128,      0,       0,       0,       0,   0,   0
FFS2 dinode:            256,      0,  185754,   77541,158975440,   0,   0

+ vmstat -m
         Type InUse MemUse HighUse Requests  Size(s)
CAM dev queue     4     1K       -        4  128
  md_sii_data     0     0K       -       42  512
      CAM XPT   571  1045K       -      948  16,32,64,128,256,1024,2048
       isadev     8     1K       -        8  128
         UART     6     4K       -        6  16,512,1024
     acpiintr     1     1K       -        1  64
         cdev     7     2K       -        7  256
       acpica  1451   139K       -  6526724  16,32,64,128,256,512,1024
        sigio     1     1K       -        1  64
     filedesc   149   165K       -  5053270  16,32,64,128,256,512,1024,2048,4096
         kenv    78    11K       -       89  16,32,64,128
       kqueue     0     0K       -  1073811  256,512,2048
    proc-args    63     4K       -  7185653  16,32,64,128,256
        hhook     2     1K       -        2  128
     acpitask     1     2K       -        1  2048
      ithread    99    16K       -       99  32,128,256
    CAM queue    19     7K       -      407  16,32,64,128,256,512,2048
       KTRACE   100    13K       -      100  128
       linker   158    11K       -      160  16,32,64,512
        lockf    20     3K       -    24836  64,128
   loginclass     2     1K       -    61051  64
       ip6ndp    12     1K       -       14  64,128
         temp    51     2K       -  8400962  16,32,64,128,256,512,1024,2048,4096
       devbuf  8648 41889K       -    10143  16,32,64,128,256,512,1024,2048,4096
       module   477    60K       -      477  128
    ciss_data    15    14K       -     6749  16,128,256,512,1024,2048,4096
     mtx_pool     2    16K       -        2  
       USBdev    34     8K       -       44  64,128,512,4096
          USB    52    31K       -       66  16,32,64,128,256,2048,4096
     pmchooks     1     1K       -        1  128
      subproc  1570  1076K       -  4547906  512,4096
         proc     2    16K       -        2  
      session    56     7K       -  3670239  128
         pgrp    61     8K       -  3674920  128
         cred    52     9K       - 33563550  64,256
      uidinfo     6     3K       -   190684  128,2048
       plimit    16     4K       -   796682  256
      ata_pci     1     1K       -        1  64
      scsi_cd     0     0K       -       10  16
    sysctltmp     0     0K       -    15070  16,32,64,128,4096
    sysctloid  4978   251K       -     5360  16,32,64,128
       sysctl     0     0K       -  8223671  16,32,64
      tidhash     1    16K       -        1  
      callout     7 14336K       -        7  
         umtx  3876   485K       -     3894  128
     p1003.1b     1     1K       -        1  16
         SWAP     2   549K       -        2  64
       bus-sc   113   781K       -     5234  16,32,64,128,256,512,1024,2048,4096
          bus  1282   109K       -     9676  16,32,64,128,256,1024
      devstat    12    25K       -       12  32,4096
 eventhandler    77     6K       -       77  64,128
      acpisem    19     3K       -       19  128
         kobj   330  1320K       -      650  4096
      CAM SIM     5     2K       -        5  256
      Per-cpu     1     1K       -        1  32
   CAM periph    10     3K       -       54  16,32,64,128,256
         rman   248    26K       -      613  16,32,128
         sbuf     1     1K       -     2826  16,32,64,128,256,512,1024,2048,4096
      entropy  1024    64K       -     1024  64
       ctlmem  5062 10113K       -     5062  128,2048
        stack     0     0K       -        6  256
    taskqueue    15     2K       -       15  16,32,128
       Unitno    14     1K       -   611182  32,64
          iov     0     0K       -  1610172  16,32,64,128,256,512
       select  1456   182K       -     1456  128
     ioctlops     0     0K       -  8775886  16,32,64,128,256,512,1024,2048,4096
          msg     4    30K       -        4  2048,4096
          sem     4   196K       -        4  
          shm    34    86K       -  3464837  2048
          tty    23    23K       -      161  1024,2048
          pts     2     1K       -      134  256
     mbuf_tag     0     0K       - 44528928  32,128
        shmfd     1     8K       -        1  
          pcb    23   157K       -   638814  16,32,128,1024,2048,4096
       soname     5     1K       - 53579079  16,32,128
          acl     0     0K       -   146609  4096
       biobuf     1     2K       -    14692  2048
     vfscache     1  8192K       -        1  
   cl_savebuf     0     0K       - 105002039  64,128
     vfs_hash     1  4096K       -        1  
       DEVFS1   115    58K       -      271  512
       vnodes     2     1K       -        4  64,256
       DEVFS3   131    33K       -      318  256
        mount   106     5K       -      191  16,32,64,128,256
  vnodemarker     0     0K       -  5212564  512
          BPF     9     2K       -        9  128
  ether_multi    56     3K       -       66  16,32,64
       ifaddr    87    22K       -       87  32,64,128,256,512,4096
        ifnet    10    19K       -       10  128,2048
        clone     6    24K       -        6  4096
       arpcom     2     1K       -        2  16
      lltable    32    13K       -    59317  256,512
        DEVFS    17     1K       -       20  16,128
       DEVFSP     1     1K       -        2  64
     routetbl    44     6K       -  1514358  32,64,128,256,512
         igmp     9     3K       -        9  256
     in_multi     3     1K       -        3  256
    sctp_iter     0     0K       -        4  256
     sctp_ifn     3     1K       -        3  128
     sctp_ifa     7     1K       -        7  128
     sctp_vrf     1     1K       -        1  64
    sctp_a_it     0     0K       -        4  16
    hostcache     1    28K       -        1  
     syncache     1    96K       -        1  
    in6_multi    28     4K       -       28  32,256
          mld     9     2K       -        9  128
          rpc     2     1K       -        2  256
audit_evclass   179     6K       -      218  32
     savedino     0     0K       -  3114582  256
     freework    14     2K       - 83512110  16,128
    newdirblk     0     0K       -    18403  64
       dirrem     1     1K       - 13541528  128
        mkdir     0     0K       -    29456  128
       diradd     1     1K       - 13549080  128
     freefile     3     1K       -  6948452  64
     freeblks     1     1K       -  6844927  128
     freefrag     0     0K       - 441465027  128
     indirdep     2     1K       -  6476259  128
       newblk   810   715K       - 2886471065  256
    bmsafemap     6    10K       -  9208911  256
     inodedep     8  4100K       -  8097709  512
      pagedep     2   513K       -   142104  256
  ufs_dirhash   707   346K       -   413781  16,32,64,128,256,512,1024
    ufs_mount    18    69K       -       21  512,2048,4096
    vm_pgdata     2   129K       -        2  128
      UMAHash     3    22K       -       13  512,1024,2048,4096
      memdesc     1     4K       -        1  4096
     atkbddev     2     1K       -        2  64
    pfs_nodes    21     6K       -       21  256
  pfs_vncache     0     0K       -      268  64
       ctlblk   200  1600K       -      200  
         GEOM   127    40K       -     1441  16,32,64,128,256,512,1024,2048
      ramdisk     1  4096K       -        1  
      acpidev    30     2K       -       30  64
      ctlpool   532   142K       -      532  32,512
       kbdmux     7    18K       -        8  16,512,1024,2048
       apmdev     1     1K       -        1  128
   madt_table     0     0K       -        1  4096
       feeder     7     1K       -        7  32
      scsi_da     0     0K       -      297  16
     pci_link    16     2K       -       16  16,128
    raid_data     0     0K       -      258  32,128,256
      io_apic     1     2K       -        1  2048
          MCA     8     1K       -        8  128
          msi     3     1K       -        3  128
     nexusdev     3     1K       -        3  16
md_nvidia_data     0     0K       -       42  512
+ sysctl debug
debug.acpi.suspend_bounce: 0
debug.acpi.reset_clock: 1
debug.acpi.interpreter_slack: 1
debug.acpi.enable_debug_objects: 0
debug.acpi.acpi_ca_version: 20110527
debug.acpi.cpu_unordered: 0
debug.acpi.ec.timeout: 750
debug.acpi.ec.polled: 0
debug.acpi.ec.burst: 0
debug.acpi.batt.batt_sleep_ms: 0
debug.acpi.resume_beep: 0
debug.firewire_debug: 0
debug.fwmem_debug: 0
debug.if_fwe_debug: 0
debug.if_fwip_debug: 0
debug.ipw: 0
debug.iwi: 0
debug.mddebug: 0
debug.wpi: 0
debug.elf64_legacy_coredump: 0
debug.bootverbose: 0
debug.boothowto: 0
debug.cpufreq.verbose: 0
debug.cpufreq.lowest: 0
debug.fail_point.sysctl_running: off
debug.fail_point.buf_pressure: off
debug.fail_point.nlm_deny_grant: off
debug.adaptive_machine_arch: 1
debug.sizeof.cdev_priv: 376
debug.sizeof.cdev: 288
debug.sizeof.g_bioq: 56
debug.sizeof.g_consumer: 96
debug.sizeof.g_provider: 136
debug.sizeof.g_geom: 160
debug.sizeof.g_class: 160
debug.sizeof.kinfo_proc: 1088
debug.sizeof.buf: 608
debug.sizeof.bio: 232
debug.sizeof.proc: 1184
debug.sizeof.vnode: 480
debug.sizeof.devstat: 288
debug.sizeof.namecache: 72
debug.osd: 0
debug.trace_on_panic: 1
debug.debugger_on_panic: 1
debug.ncores: 5
debug.to_avg_mpcalls: 743
debug.to_avg_lockcalls: 261
debug.to_avg_gcalls: 493
debug.to_avg_depth: 1758
debug.umtx.umtx_pi_allocated: 0
debug.clocktime: 0
debug.kdb.alt_break_to_debugger: 0
debug.kdb.break_to_debugger: 0
debug.kdb.trap_code: 0
debug.kdb.trap: 0
debug.kdb.panic: 0
debug.kdb.enter: 0
debug.kdb.current: 
debug.rman_debug: 0
debug.iosize_max_clamp: 1
debug.disablefullpath: 0
debug.disablecwd: 0
debug.vfscache: 1
debug.numcachehv: 28711
debug.numcache: 203930
debug.numneg: 12745
debug.nchash: 1048575
debug.vnlru_nowhere: 0
debug.rush_requests: 370281
debug.if_tun_debug: 0
debug.nlm_debug: 0
debug.fsckcmds: 0
debug.collectsnapstats: 0
debug.snapdebug: 0
debug.dopersistence: 0
debug.softdep.cleanup_failures: 369634
debug.softdep.cleanup_retries: 826
debug.softdep.cleanup_high_delay: 14
debug.softdep.cleanup_inorequests: 0
debug.softdep.cleanup_blkrequests: 369690
debug.softdep.jwait_newblk: 0
debug.softdep.jwait_inode: 0
debug.softdep.jwait_freeblks: 0
debug.softdep.jwait_filepage: 0
debug.softdep.journal_wait: 0
debug.softdep.journal_min: 0
debug.softdep.journal_low: 0
debug.softdep.jnewblk_rollback: 0
debug.softdep.jaddref_rollback: 0
debug.softdep.dir_entry: 202032
debug.softdep.direct_blk_ptrs: 342651
debug.softdep.inode_bitmap: 2528274
debug.softdep.indir_blk_ptrs: 26937
debug.softdep.sync_limit_hit: 591
debug.softdep.ino_limit_hit: 0
debug.softdep.blk_limit_hit: 369220
debug.softdep.ino_limit_push: 0
debug.softdep.blk_limit_push: 369690
debug.softdep.worklist_push: 2156
debug.softdep.maxindirdeps: 50
debug.softdep.tickdelay: 2
debug.softdep.max_softdeps: 2352308
debug.softdep.write.jfsync: 0
debug.softdep.write.jtrunc: 0
debug.softdep.write.sbdep: 0
debug.softdep.write.jsegdep: 0
debug.softdep.write.jseg: 0
debug.softdep.write.jfreefrag: 0
debug.softdep.write.jfreeblk: 0
debug.softdep.write.jnewblk: 0
debug.softdep.write.jmvref: 0
debug.softdep.write.jremref: 0
debug.softdep.write.jaddref: 0
debug.softdep.write.freedep: 0
debug.softdep.write.freework: 0
debug.softdep.write.newdirblk: 0
debug.softdep.write.dirrem: 0
debug.softdep.write.mkdir: 0
debug.softdep.write.diradd: 0
debug.softdep.write.freefile: 0
debug.softdep.write.freeblks: 690940
debug.softdep.write.freefrag: 0
debug.softdep.write.allocindir: 2334536656
debug.softdep.write.indirdep: 117349
debug.softdep.write.allocdirect: 76940081
debug.softdep.write.newblk: 0
debug.softdep.write.bmsafemap: 2437845
debug.softdep.write.inodedep: 6917133
debug.softdep.write.pagedep: 329659
debug.softdep.current.jfsync: 0
debug.softdep.current.jtrunc: 0
debug.softdep.current.sbdep: 0
debug.softdep.current.jsegdep: 0
debug.softdep.current.jseg: 0
debug.softdep.current.jfreefrag: 0
debug.softdep.current.jfreeblk: 0
debug.softdep.current.jnewblk: 0
debug.softdep.current.jmvref: 0
debug.softdep.current.jremref: 0
debug.softdep.current.jaddref: 0
debug.softdep.current.freedep: 0
debug.softdep.current.freework: 13
debug.softdep.current.newdirblk: 0
debug.softdep.current.dirrem: 1
debug.softdep.current.mkdir: 0
debug.softdep.current.diradd: 1
debug.softdep.current.freefile: 3
debug.softdep.current.freeblks: 1
debug.softdep.current.freefrag: 0
debug.softdep.current.allocindir: 0
debug.softdep.current.indirdep: 2
debug.softdep.current.allocdirect: 0
debug.softdep.current.newblk: 809
debug.softdep.current.bmsafemap: 5
debug.softdep.current.inodedep: 7
debug.softdep.current.pagedep: 1
debug.softdep.total.jfsync: 0
debug.softdep.total.jtrunc: 0
debug.softdep.total.sbdep: 0
debug.softdep.total.jsegdep: 0
debug.softdep.total.jseg: 0
debug.softdep.total.jfreefrag: 0
debug.softdep.total.jfreeblk: 0
debug.softdep.total.jnewblk: 0
debug.softdep.total.jmvref: 0
debug.softdep.total.jremref: 0
debug.softdep.total.jaddref: 0
debug.softdep.total.freedep: 0
debug.softdep.total.freework: 83512109
debug.softdep.total.newdirblk: 18403
debug.softdep.total.dirrem: 13541528
debug.softdep.total.mkdir: 29456
debug.softdep.total.diradd: 13549080
debug.softdep.total.freefile: 6948452
debug.softdep.total.freeblks: 6844927
debug.softdep.total.freefrag: 441465027
debug.softdep.total.allocindir: 0
debug.softdep.total.indirdep: 6449322
debug.softdep.total.allocdirect: 0
debug.softdep.total.newblk: 2886471064
debug.softdep.total.bmsafemap: 9208910
debug.softdep.total.inodedep: 8097708
debug.softdep.total.pagedep: 142103
debug.dobkgrdwrite: 1
debug.bigcgs: 0
debug.dircheck: 0
debug.psm.pkterrthresh: 2
debug.psm.usecs: 500000
debug.psm.secs: 0
debug.psm.errusecs: 0
debug.psm.errsecs: 2
debug.psm.hz: 20
debug.psm.loglevel: 0
debug.vesa.shadow_rom: 0
debug.fdc.settle: 0
debug.fdc.spec2: 16
debug.fdc.spec1: 175
debug.fdc.retries: 10
debug.fdc.debugflags: 0
debug.fdc.fifo: 8
debug.elf32_legacy_coredump: 0
debug.x86bios.int: 0
debug.x86bios.call: 0
debug.hwpstate_verbose: 0
debug.minidump: 1
+ fstat -f /pgsql
USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
pgsql    postgres   52372   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52372    6 /pgsql   11046014 -rw-------    8192 rw
pgsql    postgres   52348   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52348    6 /pgsql   12671024 -rw-------    8192 rw
pgsql    postgres   52344   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52344    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52344   44 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52343   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52343    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52343   20 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52342   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52342    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52341   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52341    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52340   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52340    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52310   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52310    6 /pgsql   11046014 -rw-------    8192 rw
pgsql    postgres   52310   49 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52283   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52283    6 /pgsql   15780331 -rw-------    8192 rw
pgsql    postgres   52252   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52252    6 /pgsql   11046014 -rw-------    8192 rw
pgsql    postgres   52252   49 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52228   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52228    6 /pgsql   12671024 -rw-------    8192 rw
pgsql    postgres   52224   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52224    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52224   44 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52223   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52223    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52223   64 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52222   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52222    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52222   21 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52221   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52221    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52220   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52220    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52219   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52219    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52122   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52122    6 /pgsql   11046014 -rw-------    8192 rw
pgsql    postgres   52122   49 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52098   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52098    6 /pgsql   12671024 -rw-------    8192 rw
pgsql    postgres   52093   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52093    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52093   44 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52091   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52091    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52091   21 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52030   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52030    6 /pgsql   15780331 -rw-------    8192 rw
pgsql    postgres   51923   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   51923    6 /pgsql   11046014 -rw-------    8192 rw
pgsql    postgres   51923   49 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   51766   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   51766    6 /pgsql   15780331 -rw-------    8192 rw
pgsql    postgres   69881   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   69881    6 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   69881   12 /pgsql   11053182 -rw-------  16777216 rw
pgsql    postgres   69881   13 /pgsql   11048966 -rw-------  761856 rw
pgsql    postgres   69881   14 /pgsql   11048994 -rw-------  114688 rw
pgsql    postgres   69881   15 /pgsql   11049020 -rw-------  294912 rw
pgsql    postgres   69881   16 /pgsql   11048976 -rw-------    8192 rw
pgsql    postgres   69881   17 /pgsql   11049049 -rw-------   16384 rw
pgsql    postgres   69881   18 /pgsql   11049050 -rw-------   16384 rw
pgsql    postgres   69881   19 /pgsql   11046110 -rw-------    8192 rw
pgsql    postgres   69881   20 /pgsql   11046156 -rw-------   16384 rw
pgsql    postgres   69881   21 /pgsql   11046248 -rw-------   16384 rw
pgsql    postgres   13018   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   13018   12 /pgsql   15780331 -rw-------    8192 rw
pgsql    postgres   13018   13 /pgsql   15780329 -rw-------   16384 rw
pgsql    postgres   13018   14 /pgsql   15780349 -rw-------   24576 rw
pgsql    postgres   13018   15 /pgsql   15780397 -rw-------   16384 rw
pgsql    postgres   13018   16 /pgsql   15780293 -rw-------   32768 rw
pgsql    postgres   13018   17 /pgsql   15780356 -rw-------  155648 rw
pgsql    postgres   13018   18 /pgsql   15780378 -rw-------  901120 rw
pgsql    postgres   13018   19 /pgsql   15780395 -rw-------   81920 rw
pgsql    postgres   13018   23 /pgsql   15780295 -rw-------   16384 rw
pgsql    postgres   13018   24 /pgsql   15780348 -rw-------    8192 rw
pgsql    postgres   13018   25 /pgsql   15780401 -rw-------   16384 rw
pgsql    postgres   13018   26 /pgsql   15780372 -rw-------  286720 rw
pgsql    postgres   13018   28 /pgsql   15780353 -rw-------  131072 rw
pgsql    postgres   13018   29 /pgsql   15780381 -rw-------  270336 rw
pgsql    postgres   13018   31 /pgsql   15780380 -rw-------   81920 rw
pgsql    postgres   13018   32 /pgsql   15780394 -rw-------   90112 rw
pgsql    postgres   13018   34 /pgsql   15780365 -rw-------  1712128 rw
pgsql    postgres   13018   37 /pgsql   15780415 -rw-------  1425408 rw
pgsql    postgres   13018   39 -        11053304 -rw-------  16777216 rw
pgsql    postgres   13018   40 /pgsql   15780382 -rw-------  368640 rw
pgsql    postgres   13018   41 /pgsql   15780405 -rw-------   16384 rw
pgsql    postgres   13018   42 /pgsql   15780351 -rw-------  131072 rw
pgsql    postgres   13018   43 /pgsql   15780403 -rw-------   16384 rw
pgsql    postgres   13018   44 /pgsql   15780296 -rw-------  458752 rw
pgsql    postgres   13018   45 /pgsql   15780396 -rw-------   40960 rw
pgsql    postgres   13018   46 /pgsql   15780337 -rw-------  114688 rw
pgsql    postgres   13018   47 /pgsql   15780307 -rw-------   32768 rw
pgsql    postgres   13018   48 /pgsql   11046110 -rw-------    8192 rw
pgsql    postgres   13018   49 /pgsql   11046156 -rw-------   16384 rw
pgsql    postgres   13018   50 /pgsql   11046248 -rw-------   16384 rw
pgsql    postgres   13018   51 /pgsql   15780399 -rw-------   32768 rw
pgsql    postgres   13018   52 /pgsql   15780350 -rw-------   32768 rw
pgsql    postgres   13018   53 /pgsql   15780376 -rw-------  229376 rw
pgsql    postgres   13018   55 /pgsql   15780292 -rw-------   32768 rw
pgsql    postgres   13018   56 /pgsql   15780371 -rw-------   16384 rw
pgsql    postgres   13018   57 /pgsql   15780339 -rw-------   16384 rw
pgsql    postgres   13016   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   13016    6 /pgsql   11046116 -rw-------   16384 rw
pgsql    postgres   13016   10 /pgsql   11046198 -rw-------   16384 rw
pgsql    postgres   13016   11 /pgsql   11046615 -rw-------   16384 rw
pgsql    postgres   13016   12 /pgsql   11046011 -rw-------  794624 rw
pgsql    postgres   13016   13 /pgsql   11045999 -rw-------  4186112 rw
pgsql    postgres   13016   14 /pgsql   11046019 -rw-------  393216 rw
pgsql    postgres   13016   15 /pgsql   11046014 -rw-------    8192 rw
pgsql    postgres   13016   16 /pgsql   11046012 -rw-------   16384 rw
pgsql    postgres   13016   17 /pgsql   11046032 -rw-------   24576 rw
pgsql    postgres   13016   18 /pgsql   11046078 -rw-------   16384 rw
pgsql    postgres   13016   19 /pgsql   11045944 -rw-------   32768 rw
pgsql    postgres   13016   20 /pgsql   11046039 -rw-------  131072 rw
pgsql    postgres   13016   21 /pgsql   11046059 -rw-------  720896 rw
pgsql    postgres   13016   22 /pgsql   11046076 -rw-------   65536 rw
pgsql    postgres   13016   23 /pgsql   11046092 -rw-------   16384 rw
pgsql    postgres   13016   24 /pgsql   11046021 -rw-------   24576 rw
pgsql    postgres   13016   25 /pgsql   11046093 -rw-------   16384 rw
pgsql    postgres   13016   26 /pgsql   11045968 -rw-------   16384 rw
pgsql    postgres   13016   27 /pgsql   11046031 -rw-------    8192 rw
pgsql    postgres   13016   28 /pgsql   11046082 -rw-------   16384 rw
pgsql    postgres   13016   29 /pgsql   11046053 -rw-------  270336 rw
pgsql    postgres   13016   30 /pgsql   11046009 -rw-------  647168 rw
pgsql    postgres   13016   31 /pgsql   11046036 -rw-------  106496 rw
pgsql    postgres   13016   32 /pgsql   11046062 -rw-------  270336 rw
pgsql    postgres   13016   34 /pgsql   11046061 -rw-------   81920 rw
pgsql    postgres   13016   35 /pgsql   11046075 -rw-------   81920 rw
pgsql    postgres   13016   37 /pgsql   11046048 -rw-------  1433600 rw
pgsql    postgres   13016   40 /pgsql   11046096 -rw-------  1179648 rw
pgsql    postgres   13016   42 -        11053304 -rw-------  16777216 rw
pgsql    postgres   13016   43 /pgsql   11046063 -rw-------  335872 rw
pgsql    postgres   13016   44 /pgsql   11046086 -rw-------   16384 rw
pgsql    postgres   13016   45 /pgsql   11046034 -rw-------  131072 rw
pgsql    postgres   13016   46 /pgsql   11046084 -rw-------   16384 rw
pgsql    postgres   13016   47 /pgsql   11045974 -rw-------  458752 rw
pgsql    postgres   13016   48 /pgsql   11046077 -rw-------   40960 rw
pgsql    postgres   13016   49 /pgsql   11046020 -rw-------  114688 rw
pgsql    postgres   13016   50 /pgsql   11045990 -rw-------   32768 rw
pgsql    postgres   13016   51 /pgsql   11046110 -rw-------    8192 rw
pgsql    postgres   13016   52 /pgsql   11046156 -rw-------   16384 rw
pgsql    postgres   13016   53 /pgsql   11046248 -rw-------   16384 rw
pgsql    postgres   13016   54 /pgsql   11046080 -rw-------   32768 rw
pgsql    postgres   13016   55 /pgsql   11046033 -rw-------   32768 rw
pgsql    postgres   13016   56 /pgsql   11046057 -rw-------  221184 rw
pgsql    postgres   13016   58 /pgsql   11045939 -rw-------   32768 rw
pgsql    postgres   13016   59 /pgsql   11046052 -rw-------   16384 rw
pgsql    postgres   13016   60 /pgsql   11046022 -rw-------   16384 rw
pgsql    postgres   13014   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   13013   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   13013    8 /pgsql   11046614 -rw-------    8192 rw
pgsql    postgres   13012   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   13012    6 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   13011   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   13010   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   13010    9 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   13006   wd /pgsql   11045888 drwx------     512  r
+ sysctl -a
+ egrep vnode
kern.maxvnodes: 588077
kern.minvnodes: 147019
vm.stats.vm.v_vnodepgsout: 0
vm.stats.vm.v_vnodepgsin: 52180
vm.stats.vm.v_vnodeout: 0
vm.stats.vm.v_vnodein: 21913
vfs.freevnodes: 146822
vfs.wantfreevnodes: 147019
vfs.numvnodes: 189957
debug.sizeof.vnode: 480
+ mount -v
/dev/da0s1a on / (ufs, local, writes: sync 388 async 161, reads: sync 29658 async 2096, fsid 6ca1714b67a0e2e6)
devfs on /dev (devfs, local, multilabel, fsid 00ff007171000000)
/dev/da1s1 on /opt (ufs, local, soft-updates, writes: sync 420418 async 15114895, reads: sync 176874826 async 144200474, fsid 30318550f5679e86)
/dev/da0s1e on /tmp (ufs, local, soft-updates, writes: sync 42 async 15450, reads: sync 5280 async 0, fsid 6ca1714b011cfe1c)
/dev/da0s1f on /usr (ufs, local, soft-updates, writes: sync 1544 async 2144469, reads: sync 13529610 async 7411, fsid 6ca1714b7a5cb615)
/dev/da0s1d on /var (ufs, local, soft-updates, writes: sync 10629 async 1331788, reads: sync 271416 async 24881, fsid 6da1714be9133bfa)
procfs on /proc (procfs, local, fsid 01ff000202000000)
/dev/da2s1d on /pgsql (ufs, local, soft-updates, writes: sync 94424 async 11704826, reads: sync 2119501 async 1767729, fsid 6ca1714bbe0b8c4d)
# service postgresql stop
# umount /pgsql
umount: unmount of /pgsql failed: Device busy
# fstat | gre p pgsql
# umount -a /pgsql f 
# tunefs -n disable /pgsql
tunefs: soft updates cleared
# mount /pgsqtunefs -n disable /pgsqlumount -ffstat | grep umount -f /tunefs -n disablesh -x diskspacecheck.sh 
+ df -ih /pgsql
Filesystem     Size    Used   Avail Capacity iused ifree %iused  Mounted on
/dev/da0s1a    495M    354M    101M    78%    2.0k   63k    3%   /
+ vmstat -z
ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               208,      0,      86,      16,      86,   0,   0
UMA Zones:             1408,      0,      86,       0,      86,   0,   0
UMA Slabs:              568,      0,    6809,     506,  628445,   0,   0
UMA RCntSlabs:          568,      0,    4591,     575,  392869,   0,   0
UMA Hash:               256,      0,       0,       0,       3,   0,   0
16 Bucket:              152,      0,      27,      73,     211,   0,   0
32 Bucket:              280,      0,      47,     149,     339,   6,   0
64 Bucket:              536,      0,      78,      76,     752,  90,   0
128 Bucket:            1048,      0,    1804,       2, 1557224,15349969,   0
VM OBJECT:              232,      0,  154923,   31109,141943310,   0,   0
MAP:                    232,      0,       7,      25,       7,   0,   0
KMAP ENTRY:             120, 1128710,   13062,   38150,1793769332,   0,   0
MAP ENTRY:              120,      0,     846,    4920,301950981,   0,   0
fakepg:                 120,      0,       0,       0,       0,   0,   0
mt_zone:               4112,      0,     326,       1,     326,   0,   0
16:                      16,      0,    2318,    2050,15182618,   0,   0
32:                      32,      0,    2774,    1670,50199795,   0,   0
64:                      64,      0,    5315,    4317,83083479,   0,   0
128:                    128,      0,    9841,    4746,689514966,   0,   0
256:                    256,      0,     562,   33488,2920250859,   0,   0
512:                    512,      0,    2737,    2394,18130161,   0,   0
1024:                  1024,      0,      54,    1338, 2204548,   0,   0
2048:                  2048,      0,    5628,    1274, 4135483,   0,   0
4096:                  4096,      0,     428,    1172, 5327203,   0,   0
Files:                   80,      0,      94,   11111,199212335,   0,   0
TURNSTILE:              136,      0,    1939,     121,    1948,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1184,      0,      49,    1436, 4546449,   0,   0
THREAD:                1128,      0,    1549,     389,    1963,   0,   0
SLEEPQUEUE:              80,      0,    1939,     265,    1948,   0,   0
VMSPACE:                392,      0,      30,    1560, 4546432,   0,   0
cpuset:                  72,      0,      85,      65,      85,   0,   0
audit_record:           960,      0,       0,       0,       0,   0,   0
mbuf_packet:            256,      0,    4081,    1679,697803824,   0,   0
mbuf:                   256,      0,    1022,    1723,1962824978,   0,   0
mbuf_cluster:          2048,  25600,    5760,    1254, 1708544,   0,   0
mbuf_jumbo_page:       4096,  12800,       0,    1084,83505289,   0,   0
mbuf_jumbo_9k:         9216,   6400,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384,   3200,       0,       0,       0,   0,   0
mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0
g_bio:                  232,      0,       0,    1584,2977843447,   0,   0
ttyinq:                 160,      0,     150,     474,    2625,   0,   0
ttyoutq:                256,      0,      80,     340,    1400,   0,   0
ata_request:            328,      0,       0,      84,      32,   0,   0
ata_composite:          336,      0,       0,       0,       0,   0,   0
VNODE:                  480,      0,  169520,   95880,158977785,   0,   0
VNODEPOLL:              112,      0,       0,     132,       6,   0,   0
NAMEI:                 1024,      0,       0,    1212,432377472,   0,   0
S VFS Cache:            108,      0,  170432,  107395,163308366,   0,   0
STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
L VFS Cache:            328,      0,   12506,    4210, 7622822,   0,   0
LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
NCLNODE:                568,      0,       0,       0,       0,   0,   0
DIRHASH:               1024,      0,      90,     958, 3085295,   0,   0
Mountpoints:            792,      0,       7,      33,       9,   0,   0
pipe:                   728,      0,       3,    1327, 3975687,   0,   0
ksiginfo:               112,      0,    1474,    1430,10114048,   0,   0
itimer:                 344,      0,       1,      21,       1,   0,   0
KNOTE:                  128,      0,       0,    1711, 1114947,   0,   0
socket:                 680, 100002,      31,    1427, 9634243,   0,   0
ipq:                     56,    819,       0,       0,       0,   0,   0
udp_inpcb:              392, 100000,      12,    1548, 7561702,   0,   0
udpcb:                   16, 100128,      12,    1836, 7561702,   0,   0
tcp_inpcb:              392, 100000,       8,    1752,  663415,   0,   0
tcpcb:                  976, 100000,       8,    1764,  663415,   0,   0
tcptw:                   72,  20000,       0,     550,    3287,   0,   0
syncache:               152,  15375,       0,     625,  514663,   0,   0
hostcache:              136,  15372,       5,     499,    1879,   0,   0
tcpreass:                40,   1680,       0,    1596,   21762,   0,   0
sackhole:                32,      0,       0,     909,     885,   0,   0
sctp_ep:               1376, 100000,       0,       0,       0,   0,   0
sctp_asoc:             2288,  40000,       0,       0,       0,   0,   0
sctp_laddr:              48,  80064,       0,     288,       6,   0,   0
sctp_raddr:             704,  80000,       0,       0,       0,   0,   0
sctp_chunk:             136, 400008,       0,       0,       0,   0,   0
sctp_readq:             104, 400032,       0,       0,       0,   0,   0
sctp_stream_msg_out:    112, 400026,       0,       0,       0,   0,   0
sctp_asconf:             40, 400008,       0,       0,       0,   0,   0
sctp_asconf_ack:         48, 400032,       0,       0,       0,   0,   0
ripcb:                  392, 100000,       0,     100,     126,   0,   0
unpcb:                  240, 100000,      10,    1318, 1408994,   0,   0
rtentry:                200,      0,      23,      91,      23,   0,   0
selfd:                   56,      0,    1993,    1346,309385408,   0,   0
SWAPMETA:               288, 116519,      40,     558, 1072120,   0,   0
FFS inode:              168,      0,  165315,   98157,158975454,   0,   0
FFS1 dinode:            128,      0,       0,       0,       0,   0,   0
FFS2 dinode:            256,      0,  165315,   97980,158975447,   0,   0

+ vmstat -m
         Type InUse MemUse HighUse Requests  Size(s)
CAM dev queue     4     1K       -        4  128
  md_sii_data     0     0K       -       50  512
      CAM XPT   571  1045K       -      958  16,32,64,128,256,1024,2048
       isadev     8     1K       -        8  128
         UART     6     4K       -        6  16,512,1024
     acpiintr     1     1K       -        1  64
         cdev     7     2K       -        7  256
       acpica  1451   139K       -  6528438  16,32,64,128,256,512,1024
        sigio     1     1K       -        1  64
     filedesc    60    44K       -  5053303  16,32,64,128,256,512,1024,2048,4096
         kenv    78    11K       -       89  16,32,64,128
       kqueue     0     0K       -  1073811  256,512,2048
    proc-args    30     2K       -  7185706  16,32,64,128,256
        hhook     2     1K       -        2  128
     acpitask     1     2K       -        1  2048
      ithread    99    16K       -       99  32,128,256
    CAM queue    19     7K       -      407  16,32,64,128,256,512,2048
       KTRACE   100    13K       -      100  128
       linker   158    11K       -      160  16,32,64,512
        lockf    20     3K       -    24836  64,128
   loginclass     2     1K       -    61053  64
       ip6ndp    12     1K       -       14  64,128
         temp    51     2K       -  8405195  16,32,64,128,256,512,1024,2048,4096
       devbuf  8648 41889K       -    10143  16,32,64,128,256,512,1024,2048,4096
       module   477    60K       -      477  128
    ciss_data    15    14K       -     6749  16,128,256,512,1024,2048,4096
     mtx_pool     2    16K       -        2  
       USBdev    34     8K       -       44  64,128,512,4096
          USB    52    31K       -       66  16,32,64,128,256,2048,4096
     pmchooks     1     1K       -        1  128
      subproc  1537   944K       -  4547938  512,4096
         proc     2    16K       -        2  
      session    23     3K       -  3670247  128
         pgrp    28     4K       -  3674943  128
         cred    48     8K       - 33564148  64,256
      uidinfo     5     3K       -   190685  128,2048
       plimit    15     4K       -   796708  256
      ata_pci     1     1K       -        1  64
      scsi_cd     0     0K       -       10  16
    sysctltmp     0     0K       -    15252  16,32,64,128,4096
    sysctloid  4978   251K       -     5360  16,32,64,128
       sysctl     0     0K       -  8223996  16,32,64
      tidhash     1    16K       -        1  
      callout     7 14336K       -        7  
         umtx  3876   485K       -     3894  128
     p1003.1b     1     1K       -        1  16
         SWAP     2   549K       -        2  64
       bus-sc   113   781K       -     5234  16,32,64,128,256,512,1024,2048,4096
          bus  1282   109K       -    10186  16,32,64,128,256,1024
      devstat    12    25K       -       12  32,4096
 eventhandler    77     6K       -       77  64,128
      acpisem    19     3K       -       19  128
         kobj   330  1320K       -      698  4096
      CAM SIM     5     2K       -        5  256
      Per-cpu     1     1K       -        1  32
   CAM periph    10     3K       -       54  16,32,64,128,256
         rman   248    26K       -      613  16,32,128
         sbuf     1     1K       -     3236  16,32,64,128,256,512,1024,2048,4096
      entropy  1024    64K       -     1024  64
       ctlmem  5062 10113K       -     5062  128,2048
        stack     0     0K       -        8  256
    taskqueue    15     2K       -       15  16,32,128
       Unitno    14     1K       -   611202  32,64
          iov     0     0K       -  1610261  16,32,64,128,256,512
       select  1456   182K       -     1456  128
     ioctlops     0     0K       -  8776161  16,32,64,128,256,512,1024,2048,4096
          msg     4    30K       -        4  2048,4096
          sem     4   196K       -        4  
          shm     1    20K       -  3464844  2048
          tty    23    23K       -      163  1024,2048
          pts     2     1K       -      134  256
     mbuf_tag     0     0K       - 44528987  32,128
        shmfd     1     8K       -        1  
          pcb    21   157K       -   638815  16,32,128,1024,2048,4096
       soname     4     1K       - 53579803  16,32,128
          acl     0     0K       -   146609  4096
       biobuf     1     2K       -    14692  2048
     vfscache     1  8192K       -        1  
   cl_savebuf     0     0K       - 105002114  64,128
     vfs_hash     1  4096K       -        1  
       DEVFS1   116    58K       -      273  512
       vnodes     2     1K       -        4  64,256
       DEVFS3   135    34K       -      326  256
        mount    91     5K       -      191  16,32,64,128,256
  vnodemarker     0     0K       -  5212621  512
          BPF     9     2K       -        9  128
  ether_multi    56     3K       -       66  16,32,64
       ifaddr    87    22K       -       87  32,64,128,256,512,4096
        ifnet    10    19K       -       10  128,2048
        clone     6    24K       -        6  4096
       arpcom     2     1K       -        2  16
      lltable    32    13K       -    59317  256,512
        DEVFS    17     1K       -       20  16,128
       DEVFSP     1     1K       -        2  64
     routetbl    44     6K       -  1514374  32,64,128,256,512
         igmp     9     3K       -        9  256
     in_multi     3     1K       -        3  256
    sctp_iter     0     0K       -        4  256
     sctp_ifn     3     1K       -        3  128
     sctp_ifa     7     1K       -        7  128
     sctp_vrf     1     1K       -        1  64
    sctp_a_it     0     0K       -        4  16
    hostcache     1    28K       -        1  
     syncache     1    96K       -        1  
    in6_multi    28     4K       -       28  32,256
          mld     9     2K       -        9  128
          rpc     2     1K       -        2  256
audit_evclass   179     6K       -      218  32
     savedino     0     0K       -  3114583  256
     freework     1     1K       - 83512229  16,128
    newdirblk     0     0K       -    18403  64
       dirrem     0     0K       - 13541541  128
        mkdir     0     0K       -    29456  128
       diradd     0     0K       - 13549090  128
     freefile     0     0K       -  6948465  64
     freeblks     0     0K       -  6844938  128
     freefrag     0     0K       - 441465352  128
     indirdep     0     0K       -  6476264  128
       newblk     1   512K       - 2886473412  256
    bmsafemap     1     8K       -  9208922  256
     inodedep     1  4096K       -  8097728  512
      pagedep     1   512K       -   142107  256
  ufs_dirhash   686   336K       -   413781  16,32,64,128,256,512,1024
    ufs_mount    15    51K       -       21  512,2048,4096
    vm_pgdata     2   129K       -        2  128
      UMAHash     3    22K       -       13  512,1024,2048,4096
      memdesc     1     4K       -        1  4096
     atkbddev     2     1K       -        2  64
    pfs_nodes    21     6K       -       21  256
  pfs_vncache     0     0K       -      268  64
       ctlblk   200  1600K       -      200  
         GEOM   133    41K       -     1666  16,32,64,128,256,512,1024,2048
      ramdisk     1  4096K       -        1  
      acpidev    30     2K       -       30  64
      ctlpool   532   142K       -      532  32,512
       kbdmux     7    18K       -        8  16,512,1024,2048
       apmdev     1     1K       -        1  128
   madt_table     0     0K       -        1  4096
       feeder     7     1K       -        7  32
      scsi_da     0     0K       -      359  16
     pci_link    16     2K       -       16  16,128
    raid_data     0     0K       -      306  32,128,256
      io_apic     1     2K       -        1  2048
          MCA     8     1K       -        8  128
          msi     3     1K       -        3  128
     nexusdev     3     1K       -        3  16
md_nvidia_data     0     0K       -       50  512
+ sysctl debug
debug.acpi.suspend_bounce: 0
debug.acpi.reset_clock: 1
debug.acpi.interpreter_slack: 1
debug.acpi.enable_debug_objects: 0
debug.acpi.acpi_ca_version: 20110527
debug.acpi.cpu_unordered: 0
debug.acpi.ec.timeout: 750
debug.acpi.ec.polled: 0
debug.acpi.ec.burst: 0
debug.acpi.batt.batt_sleep_ms: 0
debug.acpi.resume_beep: 0
debug.firewire_debug: 0
debug.fwmem_debug: 0
debug.if_fwe_debug: 0
debug.if_fwip_debug: 0
debug.ipw: 0
debug.iwi: 0
debug.mddebug: 0
debug.wpi: 0
debug.elf64_legacy_coredump: 0
debug.bootverbose: 0
debug.boothowto: 0
debug.cpufreq.verbose: 0
debug.cpufreq.lowest: 0
debug.fail_point.sysctl_running: off
debug.fail_point.buf_pressure: off
debug.fail_point.nlm_deny_grant: off
debug.adaptive_machine_arch: 1
debug.sizeof.cdev_priv: 376
debug.sizeof.cdev: 288
debug.sizeof.g_bioq: 56
debug.sizeof.g_consumer: 96
debug.sizeof.g_provider: 136
debug.sizeof.g_geom: 160
debug.sizeof.g_class: 160
debug.sizeof.kinfo_proc: 1088
debug.sizeof.buf: 608
debug.sizeof.bio: 232
debug.sizeof.proc: 1184
debug.sizeof.vnode: 480
debug.sizeof.devstat: 288
debug.sizeof.namecache: 72
debug.osd: 0
debug.trace_on_panic: 1
debug.debugger_on_panic: 1
debug.ncores: 5
debug.to_avg_mpcalls: 745
debug.to_avg_lockcalls: 245
debug.to_avg_gcalls: 488
debug.to_avg_depth: 1738
debug.umtx.umtx_pi_allocated: 0
debug.clocktime: 0
debug.kdb.alt_break_to_debugger: 0
debug.kdb.break_to_debugger: 0
debug.kdb.trap_code: 0
debug.kdb.trap: 0
debug.kdb.panic: 0
debug.kdb.enter: 0
debug.kdb.current: 
debug.rman_debug: 0
debug.iosize_max_clamp: 1
debug.disablefullpath: 0
debug.disablecwd: 0
debug.vfscache: 1
debug.numcachehv: 28682
debug.numcache: 182938
debug.numneg: 12182
debug.nchash: 1048575
debug.vnlru_nowhere: 0
debug.rush_requests: 370281
debug.if_tun_debug: 0
debug.nlm_debug: 0
debug.fsckcmds: 0
debug.collectsnapstats: 0
debug.snapdebug: 0
debug.dopersistence: 0
debug.softdep.cleanup_failures: 369634
debug.softdep.cleanup_retries: 826
debug.softdep.cleanup_high_delay: 14
debug.softdep.cleanup_inorequests: 0
debug.softdep.cleanup_blkrequests: 369690
debug.softdep.jwait_newblk: 0
debug.softdep.jwait_inode: 0
debug.softdep.jwait_freeblks: 0
debug.softdep.jwait_filepage: 0
debug.softdep.journal_wait: 0
debug.softdep.journal_min: 0
debug.softdep.journal_low: 0
debug.softdep.jnewblk_rollback: 0
debug.softdep.jaddref_rollback: 0
debug.softdep.dir_entry: 202033
debug.softdep.direct_blk_ptrs: 342655
debug.softdep.inode_bitmap: 2528275
debug.softdep.indir_blk_ptrs: 26937
debug.softdep.sync_limit_hit: 591
debug.softdep.ino_limit_hit: 0
debug.softdep.blk_limit_hit: 369220
debug.softdep.ino_limit_push: 0
debug.softdep.blk_limit_push: 369690
debug.softdep.worklist_push: 2156
debug.softdep.maxindirdeps: 50
debug.softdep.tickdelay: 2
debug.softdep.max_softdeps: 2352308
debug.softdep.write.jfsync: 0
debug.softdep.write.jtrunc: 0
debug.softdep.write.sbdep: 0
debug.softdep.write.jsegdep: 0
debug.softdep.write.jseg: 0
debug.softdep.write.jfreefrag: 0
debug.softdep.write.jfreeblk: 0
debug.softdep.write.jnewblk: 0
debug.softdep.write.jmvref: 0
debug.softdep.write.jremref: 0
debug.softdep.write.jaddref: 0
debug.softdep.write.freedep: 0
debug.softdep.write.freework: 0
debug.softdep.write.newdirblk: 0
debug.softdep.write.dirrem: 0
debug.softdep.write.mkdir: 0
debug.softdep.write.diradd: 0
debug.softdep.write.freefile: 0
debug.softdep.write.freeblks: 690947
debug.softdep.write.freefrag: 0
debug.softdep.write.allocindir: 2334538581
debug.softdep.write.indirdep: 117350
debug.softdep.write.allocdirect: 76940143
debug.softdep.write.newblk: 0
debug.softdep.write.bmsafemap: 2437856
debug.softdep.write.inodedep: 6917157
debug.softdep.write.pagedep: 329664
debug.softdep.current.jfsync: 0
debug.softdep.current.jtrunc: 0
debug.softdep.current.sbdep: 0
debug.softdep.current.jsegdep: 0
debug.softdep.current.jseg: 0
debug.softdep.current.jfreefrag: 0
debug.softdep.current.jfreeblk: 0
debug.softdep.current.jnewblk: 0
debug.softdep.current.jmvref: 0
debug.softdep.current.jremref: 0
debug.softdep.current.jaddref: 0
debug.softdep.current.freedep: 0
debug.softdep.current.freework: 0
debug.softdep.current.newdirblk: 0
debug.softdep.current.dirrem: 0
debug.softdep.current.mkdir: 0
debug.softdep.current.diradd: 0
debug.softdep.current.freefile: 0
debug.softdep.current.freeblks: 0
debug.softdep.current.freefrag: 0
debug.softdep.current.allocindir: 0
debug.softdep.current.indirdep: 0
debug.softdep.current.allocdirect: 0
debug.softdep.current.newblk: 0
debug.softdep.current.bmsafemap: 0
debug.softdep.current.inodedep: 0
debug.softdep.current.pagedep: 0
debug.softdep.total.jfsync: 0
debug.softdep.total.jtrunc: 0
debug.softdep.total.sbdep: 0
debug.softdep.total.jsegdep: 0
debug.softdep.total.jseg: 0
debug.softdep.total.jfreefrag: 0
debug.softdep.total.jfreeblk: 0
debug.softdep.total.jnewblk: 0
debug.softdep.total.jmvref: 0
debug.softdep.total.jremref: 0
debug.softdep.total.jaddref: 0
debug.softdep.total.freedep: 0
debug.softdep.total.freework: 83512228
debug.softdep.total.newdirblk: 18403
debug.softdep.total.dirrem: 13541541
debug.softdep.total.mkdir: 29456
debug.softdep.total.diradd: 13549090
debug.softdep.total.freefile: 6948465
debug.softdep.total.freeblks: 6844938
debug.softdep.total.freefrag: 441465352
debug.softdep.total.allocindir: 0
debug.softdep.total.indirdep: 6449327
debug.softdep.total.allocdirect: 0
debug.softdep.total.newblk: 2886473411
debug.softdep.total.bmsafemap: 9208921
debug.softdep.total.inodedep: 8097727
debug.softdep.total.pagedep: 142106
debug.dobkgrdwrite: 1
debug.bigcgs: 0
debug.dircheck: 0
debug.psm.pkterrthresh: 2
debug.psm.usecs: 500000
debug.psm.secs: 0
debug.psm.errusecs: 0
debug.psm.errsecs: 2
debug.psm.hz: 20
debug.psm.loglevel: 0
debug.vesa.shadow_rom: 0
debug.fdc.settle: 0
debug.fdc.spec2: 16
debug.fdc.spec1: 175
debug.fdc.retries: 10
debug.fdc.debugflags: 0
debug.fdc.fifo: 8
debug.elf32_legacy_coredump: 0
debug.x86bios.int: 0
debug.x86bios.call: 0
debug.hwpstate_verbose: 0
debug.minidump: 1
+ fstat -f /pgsql
USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
root     fstat      52536   wd /         32902 drwxr-xr-x    1024  r
root     fstat      52536 root /             2 drwxr-xr-x     512  r
root     fstat      52536    3 /         49784 -rw-------   40960  r
root     sh         52531 text /         32956 -r-xr-xr-x  142984  r
root     sh         52531   wd /         32902 drwxr-xr-x    1024  r
root     sh         52531 root /             2 drwxr-xr-x     512  r
root     sh         52531   10 /         32981 -rwxr-xr-x     107  r
root     sh         52495 text /         32956 -r-xr-xr-x  142984  r
root     sh         52495   wd /         32902 drwxr-xr-x    1024  r
root     sh         52495 root /             2 drwxr-xr-x     512  r
root     script     52494   wd /         32902 drwxr-xr-x    1024  r
root     script     52494 root /             2 drwxr-xr-x     512  r
root     script     52494    3 -         32978 -rw-r--r--   50941  w
root     bash       52412   wd /         32902 drwxr-xr-x    1024  r
root     bash       52412 root /             2 drwxr-xr-x     512  r
root     sh         52411 text /         32956 -r-xr-xr-x  142984  r
root     sh         52411 root /             2 drwxr-xr-x     512  r
root     su         52409 root /             2 drwxr-xr-x     512  r
girgen   bash       52406 root /             2 drwxr-xr-x     512  r
girgen   sshd       52405   wd /             2 drwxr-xr-x     512  r
girgen   sshd       52405 root /             2 drwxr-xr-x     512  r
root     sshd       52402   wd /             2 drwxr-xr-x     512  r
root     sshd       52402 root /             2 drwxr-xr-x     512  r
nagios   nrpe2      73704   wd /             2 drwxr-xr-x     512  r
nagios   nrpe2      73704 root /             2 drwxr-xr-x     512  r
root     getty      13020   wd /             2 drwxr-xr-x     512  r
root     getty      13020 root /             2 drwxr-xr-x     512  r
root     moused     68974   wd /             2 drwxr-xr-x     512  r
root     moused     68974 root /             2 drwxr-xr-x     512  r
root     getty       1320   wd /             2 drwxr-xr-x     512  r
root     getty       1320 root /             2 drwxr-xr-x     512  r
root     getty       1319   wd /             2 drwxr-xr-x     512  r
root     getty       1319 root /             2 drwxr-xr-x     512  r
root     getty       1318   wd /             2 drwxr-xr-x     512  r
root     getty       1318 root /             2 drwxr-xr-x     512  r
root     getty       1317   wd /             2 drwxr-xr-x     512  r
root     getty       1317 root /             2 drwxr-xr-x     512  r
root     getty       1316   wd /             2 drwxr-xr-x     512  r
root     getty       1316 root /             2 drwxr-xr-x     512  r
root     getty       1315   wd /             2 drwxr-xr-x     512  r
root     getty       1315 root /             2 drwxr-xr-x     512  r
root     getty       1314   wd /             2 drwxr-xr-x     512  r
root     getty       1314 root /             2 drwxr-xr-x     512  r
root     cron        1275 root /             2 drwxr-xr-x     512  r
smmsp    sendmail    1271 root /             2 drwxr-xr-x     512  r
root     sendmail    1268 root /             2 drwxr-xr-x     512  r
root     sshd        1249   wd /             2 drwxr-xr-x     512  r
root     sshd        1249 root /             2 drwxr-xr-x     512  r
root     ntpd        1212   wd /             2 drwxr-xr-x     512  r
root     ntpd        1212 root /             2 drwxr-xr-x     512  r
root     snmpd       1180   wd /             2 drwxr-xr-x     512  r
root     snmpd       1180 root /             2 drwxr-xr-x     512  r
root     syslogd     1126   wd /             2 drwxr-xr-x     512  r
root     syslogd     1126 root /             2 drwxr-xr-x     512  r
root     devd        1012 text /           105 -r-xr-xr-x  454528  r
root     devd        1012   wd /             2 drwxr-xr-x     512  r
root     devd        1012 root /             2 drwxr-xr-x     512  r
root     adjkerntz    122 text /           100 -r-xr-xr-x    9264  r
root     adjkerntz    122   wd /             2 drwxr-xr-x     512  r
root     adjkerntz    122 root /             2 drwxr-xr-x     512  r
root     init           1 text /           112 -r-xr-xr-x  792128  r
root     init           1   wd /             2 drwxr-xr-x     512  r
root     init           1 root /             2 drwxr-xr-x     512  r
root     kernel         0   wd /             2 drwxr-xr-x     512  r
root     kernel         0 root /             2 drwxr-xr-x     512  r
+ sysctl -a
+ egrep vnode
kern.maxvnodes: 588077
kern.minvnodes: 147019
vm.stats.vm.v_vnodepgsout: 0
vm.stats.vm.v_vnodepgsin: 52189
vm.stats.vm.v_vnodeout: 0
vm.stats.vm.v_vnodein: 21917
vfs.freevnodes: 128849
vfs.wantfreevnodes: 147019
vfs.numvnodes: 169520
debug.sizeof.vnode: 480
+ mount -v
/dev/da0s1a on / (ufs, local, writes: sync 388 async 165, reads: sync 29663 async 2096, fsid 6ca1714b67a0e2e6)
devfs on /dev (devfs, local, multilabel, fsid 00ff007171000000)
/dev/da1s1 on /opt (ufs, local, soft-updates, writes: sync 420420 async 15114942, reads: sync 176874840 async 144200474, fsid 30318550f5679e86)
/dev/da0s1e on /tmp (ufs, local, soft-updates, writes: sync 42 async 15459, reads: sync 5280 async 0, fsid 6ca1714b011cfe1c)
/dev/da0s1f on /usr (ufs, local, soft-updates, writes: sync 1544 async 2144514, reads: sync 13529622 async 7411, fsid 6ca1714b7a5cb615)
/dev/da0s1d on /var (ufs, local, soft-updates, writes: sync 10629 async 1331802, reads: sync 271417 async 24881, fsid 6da1714be9133bfa)
procfs on /proc (procfs, local, fsid 01ff000202000000)
# mount /pgsql
# mount /pgsqlmount /pgsqlsh -x diskspacecheck.sh
+ df -ih /pgsql
Filesystem     Size    Used   Avail Capacity iused ifree %iused  Mounted on
/dev/da2s1d    128G     82G     36G    70%     23k   17M    0%   /pgsql
+ vmstat -z
ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               208,      0,      86,      16,      86,   0,   0
UMA Zones:             1408,      0,      86,       0,      86,   0,   0
UMA Slabs:              568,      0,    6810,     505,  628458,   0,   0
UMA RCntSlabs:          568,      0,    4591,     575,  392869,   0,   0
UMA Hash:               256,      0,       0,       0,       3,   0,   0
16 Bucket:              152,      0,      27,      73,     211,   0,   0
32 Bucket:              280,      0,      47,     149,     339,   6,   0
64 Bucket:              536,      0,      78,      76,     752,  90,   0
128 Bucket:            1048,      0,    1807,       2, 1557227,15349969,   0
VM OBJECT:              232,      0,  154923,   31109,141943517,   0,   0
MAP:                    232,      0,       7,      25,       7,   0,   0
KMAP ENTRY:             120, 1128710,   13061,   38151,1793769359,   0,   0
MAP ENTRY:              120,      0,     846,    4920,301951553,   0,   0
fakepg:                 120,      0,       0,       0,       0,   0,   0
mt_zone:               4112,      0,     326,       1,     326,   0,   0
16:                      16,      0,    2327,    2041,15183790,   0,   0
32:                      32,      0,    2772,    1672,50200055,   0,   0
64:                      64,      0,    5320,    4312,83084452,   0,   0
128:                    128,      0,    9840,    4747,689515142,   0,   0
256:                    256,      0,     559,   33491,2920250961,   0,   0
512:                    512,      0,    2737,    2394,18130186,   0,   0
1024:                  1024,      0,      54,    1338, 2205567,   0,   0
2048:                  2048,      0,    5629,    1273, 4135620,   0,   0
4096:                  4096,      0,     428,    1172, 5327221,   0,   0
Files:                   80,      0,      94,   11111,199212418,   0,   0
TURNSTILE:              136,      0,    1939,     121,    1948,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1184,      0,      49,    1436, 4546459,   0,   0
THREAD:                1128,      0,    1549,     389,    1963,   0,   0
SLEEPQUEUE:              80,      0,    1939,     265,    1948,   0,   0
VMSPACE:                392,      0,      30,    1560, 4546442,   0,   0
cpuset:                  72,      0,      85,      65,      85,   0,   0
audit_record:           960,      0,       0,       0,       0,   0,   0
mbuf_packet:            256,      0,    4081,    1679,697803885,   0,   0
mbuf:                   256,      0,    1022,    1723,1962825459,   0,   0
mbuf_cluster:          2048,  25600,    5760,    1254, 1708544,   0,   0
mbuf_jumbo_page:       4096,  12800,       0,    1084,83505293,   0,   0
mbuf_jumbo_9k:         9216,   6400,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384,   3200,       0,       0,       0,   0,   0
mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0
g_bio:                  232,      0,       0,    1584,2977843491,   0,   0
ttyinq:                 160,      0,     150,     474,    2625,   0,   0
ttyoutq:                256,      0,      80,     340,    1400,   0,   0
ata_request:            328,      0,       0,      84,      32,   0,   0
ata_composite:          336,      0,       0,       0,       0,   0,   0
VNODE:                  480,      0,  169522,   95878,158977788,   0,   0
VNODEPOLL:              112,      0,       0,     132,       6,   0,   0
NAMEI:                 1024,      0,       0,    1212,432377974,   0,   0
S VFS Cache:            108,      0,  170430,  107397,163308368,   0,   0
STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
L VFS Cache:            328,      0,   12506,    4210, 7622822,   0,   0
LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
NCLNODE:                568,      0,       0,       0,       0,   0,   0
DIRHASH:               1024,      0,      90,     958, 3085295,   0,   0
Mountpoints:            792,      0,       8,      32,      10,   0,   0
pipe:                   728,      0,       3,    1327, 3975688,   0,   0
ksiginfo:               112,      0,    1474,    1430,10114048,   0,   0
itimer:                 344,      0,       1,      21,       1,   0,   0
KNOTE:                  128,      0,       0,    1711, 1114947,   0,   0
socket:                 680, 100002,      31,    1427, 9634243,   0,   0
ipq:                     56,    819,       0,       0,       0,   0,   0
udp_inpcb:              392, 100000,      12,    1548, 7561702,   0,   0
udpcb:                   16, 100128,      12,    1836, 7561702,   0,   0
tcp_inpcb:              392, 100000,       8,    1752,  663415,   0,   0
tcpcb:                  976, 100000,       8,    1764,  663415,   0,   0
tcptw:                   72,  20000,       0,     550,    3287,   0,   0
syncache:               152,  15375,       0,     625,  514663,   0,   0
hostcache:              136,  15372,       5,     499,    1879,   0,   0
tcpreass:                40,   1680,       0,    1596,   21762,   0,   0
sackhole:                32,      0,       0,     909,     890,   0,   0
sctp_ep:               1376, 100000,       0,       0,       0,   0,   0
sctp_asoc:             2288,  40000,       0,       0,       0,   0,   0
sctp_laddr:              48,  80064,       0,     288,       6,   0,   0
sctp_raddr:             704,  80000,       0,       0,       0,   0,   0
sctp_chunk:             136, 400008,       0,       0,       0,   0,   0
sctp_readq:             104, 400032,       0,       0,       0,   0,   0
sctp_stream_msg_out:    112, 400026,       0,       0,       0,   0,   0
sctp_asconf:             40, 400008,       0,       0,       0,   0,   0
sctp_asconf_ack:         48, 400032,       0,       0,       0,   0,   0
ripcb:                  392, 100000,       0,     100,     126,   0,   0
unpcb:                  240, 100000,      10,    1318, 1408994,   0,   0
rtentry:                200,      0,      23,      91,      23,   0,   0
selfd:                   56,      0,    1993,    1346,309389134,   0,   0
SWAPMETA:               288, 116519,      40,     558, 1072120,   0,   0
FFS inode:              168,      0,  165316,   98156,158975456,   0,   0
FFS1 dinode:            128,      0,       0,       0,       0,   0,   0
FFS2 dinode:            256,      0,  165316,   97979,158975449,   0,   0

+ vmstat -m
         Type InUse MemUse HighUse Requests  Size(s)
CAM dev queue     4     1K       -        4  128
  md_sii_data     0     0K       -       50  512
      CAM XPT   571  1045K       -      958  16,32,64,128,256,1024,2048
       isadev     8     1K       -        8  128
         UART     6     4K       -        6  16,512,1024
     acpiintr     1     1K       -        1  64
         cdev     7     2K       -        7  256
       acpica  1451   139K       -  6530104  16,32,64,128,256,512,1024
        sigio     1     1K       -        1  64
     filedesc    60    44K       -  5053313  16,32,64,128,256,512,1024,2048,4096
         kenv    78    11K       -       89  16,32,64,128
       kqueue     0     0K       -  1073811  256,512,2048
    proc-args    30     2K       -  7185718  16,32,64,128,256
        hhook     2     1K       -        2  128
     acpitask     1     2K       -        1  2048
      ithread    99    16K       -       99  32,128,256
    CAM queue    19     7K       -      407  16,32,64,128,256,512,2048
       KTRACE   100    13K       -      100  128
       linker   158    11K       -      160  16,32,64,512
        lockf    20     3K       -    24840  64,128
   loginclass     2     1K       -    61053  64
       ip6ndp    12     1K       -       14  64,128
         temp    51     2K       -  8405844  16,32,64,128,256,512,1024,2048,4096
       devbuf  8648 41889K       -    10143  16,32,64,128,256,512,1024,2048,4096
       module   477    60K       -      477  128
    ciss_data    15    14K       -     6749  16,128,256,512,1024,2048,4096
     mtx_pool     2    16K       -        2  
       USBdev    34     8K       -       44  64,128,512,4096
          USB    52    31K       -       66  16,32,64,128,256,2048,4096
     pmchooks     1     1K       -        1  128
      subproc  1537   944K       -  4547948  512,4096
         proc     2    16K       -        2  
      session    23     3K       -  3670247  128
         pgrp    28     4K       -  3674947  128
         cred    50     8K       - 33564296  64,256
      uidinfo     5     3K       -   190685  128,2048
       plimit    15     4K       -   796708  256
      ata_pci     1     1K       -        1  64
      scsi_cd     0     0K       -       10  16
    sysctltmp     0     0K       -    15430  16,32,64,128,4096
    sysctloid  4978   251K       -     5360  16,32,64,128
       sysctl     0     0K       -  8224121  16,32,64
      tidhash     1    16K       -        1  
      callout     7 14336K       -        7  
         umtx  3876   485K       -     3894  128
     p1003.1b     1     1K       -        1  16
         SWAP     2   549K       -        2  64
       bus-sc   113   781K       -     5234  16,32,64,128,256,512,1024,2048,4096
          bus  1282   109K       -    10692  16,32,64,128,256,1024
      devstat    12    25K       -       12  32,4096
 eventhandler    77     6K       -       77  64,128
      acpisem    19     3K       -       19  128
         kobj   330  1320K       -      698  4096
      CAM SIM     5     2K       -        5  256
      Per-cpu     1     1K       -        1  32
   CAM periph    10     3K       -       54  16,32,64,128,256
         rman   248    26K       -      613  16,32,128
         sbuf     1     1K       -     3602  16,32,64,128,256,512,1024,2048,4096
      entropy  1024    64K       -     1024  64
       ctlmem  5062 10113K       -     5062  128,2048
        stack     0     0K       -       10  256
    taskqueue    15     2K       -       15  16,32,128
       Unitno    14     1K       -   611208  32,64
          iov     0     0K       -  1610262  16,32,64,128,256,512
       select  1456   182K       -     1456  128
     ioctlops     0     0K       -  8776199  16,32,64,128,256,512,1024,2048,4096
          msg     4    30K       -        4  2048,4096
          sem     4   196K       -        4  
          shm     1    20K       -  3464844  2048
          tty    23    23K       -      165  1024,2048
          pts     2     1K       -      134  256
     mbuf_tag     0     0K       - 44528987  32,128
        shmfd     1     8K       -        1  
          pcb    21   157K       -   638815  16,32,128,1024,2048,4096
       soname     4     1K       - 53579927  16,32,128
          acl     0     0K       -   146609  4096
       biobuf     1     2K       -    14692  2048
     vfscache     1  8192K       -        1  
   cl_savebuf     0     0K       - 105002115  64,128
     vfs_hash     1  4096K       -        1  
       DEVFS1   115    58K       -      273  512
       vnodes     2     1K       -        4  64,256
       DEVFS3   131    33K       -      326  256
        mount   106     5K       -      206  16,32,64,128,256
  vnodemarker     0     0K       -  5212625  512
          BPF     9     2K       -        9  128
  ether_multi    56     3K       -       66  16,32,64
       ifaddr    87    22K       -       87  32,64,128,256,512,4096
        ifnet    10    19K       -       10  128,2048
        clone     6    24K       -        6  4096
       arpcom     2     1K       -        2  16
      lltable    32    13K       -    59317  256,512
        DEVFS    17     1K       -       20  16,128
       DEVFSP     1     1K       -        2  64
     routetbl    44     6K       -  1514374  32,64,128,256,512
         igmp     9     3K       -        9  256
     in_multi     3     1K       -        3  256
    sctp_iter     0     0K       -        4  256
     sctp_ifn     3     1K       -        3  128
     sctp_ifa     7     1K       -        7  128
     sctp_vrf     1     1K       -        1  64
    sctp_a_it     0     0K       -        4  16
    hostcache     1    28K       -        1  
     syncache     1    96K       -        1  
    in6_multi    28     4K       -       28  32,256
          mld     9     2K       -        9  128
          rpc     2     1K       -        2  256
audit_evclass   179     6K       -      218  32
     savedino     0     0K       -  3114583  256
     freework     1     1K       - 83512229  16,128
    newdirblk     0     0K       -    18403  64
       dirrem     0     0K       - 13541542  128
        mkdir     0     0K       -    29456  128
       diradd     0     0K       - 13549091  128
     freefile     0     0K       -  6948466  64
     freeblks     0     0K       -  6844938  128
     freefrag     0     0K       - 441465352  128
     indirdep     0     0K       -  6476264  128
       newblk     1   512K       - 2886473412  256
    bmsafemap     1     8K       -  9208923  256
     inodedep     1  4096K       -  8097730  512
      pagedep     2   513K       -   142108  256
  ufs_dirhash   686   336K       -   413781  16,32,64,128,256,512,1024
    ufs_mount    18    69K       -       24  512,2048,4096
    vm_pgdata     2   129K       -        2  128
      UMAHash     3    22K       -       13  512,1024,2048,4096
      memdesc     1     4K       -        1  4096
     atkbddev     2     1K       -        2  64
    pfs_nodes    21     6K       -       21  256
  pfs_vncache     0     0K       -      268  64
       ctlblk   200  1600K       -      200  
         GEOM   127    40K       -     1680  16,32,64,128,256,512,1024,2048
      ramdisk     1  4096K       -        1  
      acpidev    30     2K       -       30  64
      ctlpool   532   142K       -      532  32,512
       kbdmux     7    18K       -        8  16,512,1024,2048
       apmdev     1     1K       -        1  128
   madt_table     0     0K       -        1  4096
       feeder     7     1K       -        7  32
      scsi_da     0     0K       -      360  16
     pci_link    16     2K       -       16  16,128
    raid_data     0     0K       -      306  32,128,256
      io_apic     1     2K       -        1  2048
          MCA     8     1K       -        8  128
          msi     3     1K       -        3  128
     nexusdev     3     1K       -        3  16
md_nvidia_data     0     0K       -       50  512
+ sysctl debug
debug.acpi.suspend_bounce: 0
debug.acpi.reset_clock: 1
debug.acpi.interpreter_slack: 1
debug.acpi.enable_debug_objects: 0
debug.acpi.acpi_ca_version: 20110527
debug.acpi.cpu_unordered: 0
debug.acpi.ec.timeout: 750
debug.acpi.ec.polled: 0
debug.acpi.ec.burst: 0
debug.acpi.batt.batt_sleep_ms: 0
debug.acpi.resume_beep: 0
debug.firewire_debug: 0
debug.fwmem_debug: 0
debug.if_fwe_debug: 0
debug.if_fwip_debug: 0
debug.ipw: 0
debug.iwi: 0
debug.mddebug: 0
debug.wpi: 0
debug.elf64_legacy_coredump: 0
debug.bootverbose: 0
debug.boothowto: 0
debug.cpufreq.verbose: 0
debug.cpufreq.lowest: 0
debug.fail_point.sysctl_running: off
debug.fail_point.buf_pressure: off
debug.fail_point.nlm_deny_grant: off
debug.adaptive_machine_arch: 1
debug.sizeof.cdev_priv: 376
debug.sizeof.cdev: 288
debug.sizeof.g_bioq: 56
debug.sizeof.g_consumer: 96
debug.sizeof.g_provider: 136
debug.sizeof.g_geom: 160
debug.sizeof.g_class: 160
debug.sizeof.kinfo_proc: 1088
debug.sizeof.buf: 608
debug.sizeof.bio: 232
debug.sizeof.proc: 1184
debug.sizeof.vnode: 480
debug.sizeof.devstat: 288
debug.sizeof.namecache: 72
debug.osd: 0
debug.trace_on_panic: 1
debug.debugger_on_panic: 1
debug.ncores: 5
debug.to_avg_mpcalls: 749
debug.to_avg_lockcalls: 282
debug.to_avg_gcalls: 494
debug.to_avg_depth: 1790
debug.umtx.umtx_pi_allocated: 0
debug.clocktime: 0
debug.kdb.alt_break_to_debugger: 0
debug.kdb.break_to_debugger: 0
debug.kdb.trap_code: 0
debug.kdb.trap: 0
debug.kdb.panic: 0
debug.kdb.enter: 0
debug.kdb.current: 
debug.rman_debug: 0
debug.iosize_max_clamp: 1
debug.disablefullpath: 0
debug.disablecwd: 0
debug.vfscache: 1
debug.numcachehv: 28682
debug.numcache: 182936
debug.numneg: 12180
debug.nchash: 1048575
debug.vnlru_nowhere: 0
debug.rush_requests: 370281
debug.if_tun_debug: 0
debug.nlm_debug: 0
debug.fsckcmds: 0
debug.collectsnapstats: 0
debug.snapdebug: 0
debug.dopersistence: 0
debug.softdep.cleanup_failures: 369634
debug.softdep.cleanup_retries: 826
debug.softdep.cleanup_high_delay: 14
debug.softdep.cleanup_inorequests: 0
debug.softdep.cleanup_blkrequests: 369690
debug.softdep.jwait_newblk: 0
debug.softdep.jwait_inode: 0
debug.softdep.jwait_freeblks: 0
debug.softdep.jwait_filepage: 0
debug.softdep.journal_wait: 0
debug.softdep.journal_min: 0
debug.softdep.journal_low: 0
debug.softdep.jnewblk_rollback: 0
debug.softdep.jaddref_rollback: 0
debug.softdep.dir_entry: 202033
debug.softdep.direct_blk_ptrs: 342655
debug.softdep.inode_bitmap: 2528275
debug.softdep.indir_blk_ptrs: 26937
debug.softdep.sync_limit_hit: 591
debug.softdep.ino_limit_hit: 0
debug.softdep.blk_limit_hit: 369220
debug.softdep.ino_limit_push: 0
debug.softdep.blk_limit_push: 369690
debug.softdep.worklist_push: 2156
debug.softdep.maxindirdeps: 50
debug.softdep.tickdelay: 2
debug.softdep.max_softdeps: 2352308
debug.softdep.write.jfsync: 0
debug.softdep.write.jtrunc: 0
debug.softdep.write.sbdep: 0
debug.softdep.write.jsegdep: 0
debug.softdep.write.jseg: 0
debug.softdep.write.jfreefrag: 0
debug.softdep.write.jfreeblk: 0
debug.softdep.write.jnewblk: 0
debug.softdep.write.jmvref: 0
debug.softdep.write.jremref: 0
debug.softdep.write.jaddref: 0
debug.softdep.write.freedep: 0
debug.softdep.write.freework: 0
debug.softdep.write.newdirblk: 0
debug.softdep.write.dirrem: 0
debug.softdep.write.mkdir: 0
debug.softdep.write.diradd: 0
debug.softdep.write.freefile: 0
debug.softdep.write.freeblks: 690947
debug.softdep.write.freefrag: 0
debug.softdep.write.allocindir: 2334538581
debug.softdep.write.indirdep: 117350
debug.softdep.write.allocdirect: 76940143
debug.softdep.write.newblk: 0
debug.softdep.write.bmsafemap: 2437857
debug.softdep.write.inodedep: 6917158
debug.softdep.write.pagedep: 329664
debug.softdep.current.jfsync: 0
debug.softdep.current.jtrunc: 0
debug.softdep.current.sbdep: 0
debug.softdep.current.jsegdep: 0
debug.softdep.current.jseg: 0
debug.softdep.current.jfreefrag: 0
debug.softdep.current.jfreeblk: 0
debug.softdep.current.jnewblk: 0
debug.softdep.current.jmvref: 0
debug.softdep.current.jremref: 0
debug.softdep.current.jaddref: 0
debug.softdep.current.freedep: 0
debug.softdep.current.freework: 0
debug.softdep.current.newdirblk: 0
debug.softdep.current.dirrem: 0
debug.softdep.current.mkdir: 0
debug.softdep.current.diradd: 0
debug.softdep.current.freefile: 0
debug.softdep.current.freeblks: 0
debug.softdep.current.freefrag: 0
debug.softdep.current.allocindir: 0
debug.softdep.current.indirdep: 0
debug.softdep.current.allocdirect: 0
debug.softdep.current.newblk: 0
debug.softdep.current.bmsafemap: 0
debug.softdep.current.inodedep: 0
debug.softdep.current.pagedep: 1
debug.softdep.total.jfsync: 0
debug.softdep.total.jtrunc: 0
debug.softdep.total.sbdep: 0
debug.softdep.total.jsegdep: 0
debug.softdep.total.jseg: 0
debug.softdep.total.jfreefrag: 0
debug.softdep.total.jfreeblk: 0
debug.softdep.total.jnewblk: 0
debug.softdep.total.jmvref: 0
debug.softdep.total.jremref: 0
debug.softdep.total.jaddref: 0
debug.softdep.total.freedep: 0
debug.softdep.total.freework: 83512228
debug.softdep.total.newdirblk: 18403
debug.softdep.total.dirrem: 13541542
debug.softdep.total.mkdir: 29456
debug.softdep.total.diradd: 13549091
debug.softdep.total.freefile: 6948466
debug.softdep.total.freeblks: 6844938
debug.softdep.total.freefrag: 441465352
debug.softdep.total.allocindir: 0
debug.softdep.total.indirdep: 6449327
debug.softdep.total.allocdirect: 0
debug.softdep.total.newblk: 2886473411
debug.softdep.total.bmsafemap: 9208922
debug.softdep.total.inodedep: 8097729
debug.softdep.total.pagedep: 142107
debug.dobkgrdwrite: 1
debug.bigcgs: 0
debug.dircheck: 0
debug.psm.pkterrthresh: 2
debug.psm.usecs: 500000
debug.psm.secs: 0
debug.psm.errusecs: 0
debug.psm.errsecs: 2
debug.psm.hz: 20
debug.psm.loglevel: 0
debug.vesa.shadow_rom: 0
debug.fdc.settle: 0
debug.fdc.spec2: 16
debug.fdc.spec1: 175
debug.fdc.retries: 10
debug.fdc.debugflags: 0
debug.fdc.fifo: 8
debug.elf32_legacy_coredump: 0
debug.x86bios.int: 0
debug.x86bios.call: 0
debug.hwpstate_verbose: 0
debug.minidump: 1
+ fstat -f /pgsql
USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
+ sysctl -a
+ egrep vnode
kern.maxvnodes: 588077
kern.minvnodes: 147019
vm.stats.vm.v_vnodepgsout: 0
vm.stats.vm.v_vnodepgsin: 52189
vm.stats.vm.v_vnodeout: 0
vm.stats.vm.v_vnodein: 21917
vfs.freevnodes: 128848
vfs.wantfreevnodes: 147019
vfs.numvnodes: 169522
debug.sizeof.vnode: 480
+ mount -v
/dev/da0s1a on / (ufs, local, writes: sync 388 async 165, reads: sync 29663 async 2096, fsid 6ca1714b67a0e2e6)
devfs on /dev (devfs, local, multilabel, fsid 00ff007171000000)
/dev/da1s1 on /opt (ufs, local, soft-updates, writes: sync 420420 async 15114942, reads: sync 176874840 async 144200474, fsid 30318550f5679e86)
/dev/da0s1e on /tmp (ufs, local, soft-updates, writes: sync 42 async 15459, reads: sync 5280 async 0, fsid 6ca1714b011cfe1c)
/dev/da0s1f on /usr (ufs, local, soft-updates, writes: sync 1544 async 2144514, reads: sync 13529622 async 7411, fsid 6ca1714b7a5cb615)
/dev/da0s1d on /var (ufs, local, soft-updates, writes: sync 10629 async 1331805, reads: sync 271418 async 24881, fsid 6da1714be9133bfa)
procfs on /proc (procfs, local, fsid 01ff000202000000)
/dev/da2s1d on /pgsql (ufs, local, writes: sync 2 async 0, reads: sync 1 async 0, fsid 6ca1714bbe0b8c4d)
# service postgresql start
# ^D
Script done on Sun Jun  2 22:25:33 2013
Script started on Sun Jun  2 22:25:38 2013

# sctripssh -x diskspacecheck.sh 
.bash_history     .cshrc            .history          .k5login          .lesshst          .login           
.lsof_pineapple   .profile          .psql_history     .rnd              .ssh              .vim             
.viminfo          2before           2before2          after.log         backup            backup.tar       
before.log        before2.log       cert              diskspacecheck.sh install.sh        install_gpart.sh 
installbsd.sh     ports.cvsup       src.cvsup        

# sh -x diskspacecheck.sh 
+ df -ih /pgsql
Filesystem     Size    Used   Avail Capacity iused ifree %iused  Mounted on
/dev/da2s1d    128G     82G     36G    70%     23k   17M    0%   /pgsql
+ vmstat -z
ITEM                   SIZE  LIMIT     USED     FREE      REQ FAIL SLEEP

UMA Kegs:               208,      0,      86,      16,      86,   0,   0
UMA Zones:             1408,      0,      86,       0,      86,   0,   0
UMA Slabs:              568,      0,    7004,     311,  628662,   0,   0
UMA RCntSlabs:          568,      0,    4591,     575,  392869,   0,   0
UMA Hash:               256,      0,       0,       0,       3,   0,   0
16 Bucket:              152,      0,      27,      73,     211,   0,   0
32 Bucket:              280,      0,      47,     149,     339,   6,   0
64 Bucket:              536,      0,      78,      76,     752,  90,   0
128 Bucket:            1048,      0,    1808,       1, 1557228,15349969,   0
VM OBJECT:              232,      0,  155399,   30633,141944807,   0,   0
MAP:                    232,      0,       7,      25,       7,   0,   0
KMAP ENTRY:             120, 1128710,   13091,   38121,1793772059,   0,   0
MAP ENTRY:              120,      0,    1388,    4378,301954216,   0,   0
fakepg:                 120,      0,       0,       0,       0,   0,   0
mt_zone:               4112,      0,     326,       1,     326,   0,   0
16:                      16,      0,    2330,    2038,15185034,   0,   0
32:                      32,      0,    2789,    1655,50200434,   0,   0
64:                      64,      0,    5345,    4287,83086039,   0,   0
128:                    128,      0,    9862,    4725,689515656,   0,   0
256:                    256,      0,     578,   33472,2920251426,   0,   0
512:                    512,      0,    2784,    2347,18130280,   0,   0
1024:                  1024,      0,      59,    1333, 2206623,   0,   0
2048:                  2048,      0,    5640,    1262, 4135776,   0,   0
4096:                  4096,      0,     438,    1162, 5327271,   0,   0
Files:                   80,      0,     286,   10919,199213265,   0,   0
TURNSTILE:              136,      0,    1939,     121,    1948,   0,   0
umtx pi:                 96,      0,       0,       0,       0,   0,   0
MAC labels:              40,      0,       0,       0,       0,   0,   0
PROC:                  1184,      0,      58,    1427, 4546499,   0,   0
THREAD:                1128,      0,    1549,     389,    1963,   0,   0
SLEEPQUEUE:              80,      0,    1939,     265,    1948,   0,   0
VMSPACE:                392,      0,      39,    1551, 4546482,   0,   0
cpuset:                  72,      0,      85,      65,      85,   0,   0
audit_record:           960,      0,       0,       0,       0,   0,   0
mbuf_packet:            256,      0,    4080,    1680,697804005,   0,   0
mbuf:                   256,      0,    1024,    1721,1962826480,   0,   0
mbuf_cluster:          2048,  25600,    5760,    1254, 1708544,   0,   0
mbuf_jumbo_page:       4096,  12800,       0,    1084,83505304,   0,   0
mbuf_jumbo_9k:         9216,   6400,       0,       0,       0,   0,   0
mbuf_jumbo_16k:       16384,   3200,       0,       0,       0,   0,   0
mbuf_ext_refcnt:          4,      0,       0,       0,       0,   0,   0
g_bio:                  232,      0,       0,    1584,2977850199,   0,   0
ttyinq:                 160,      0,     150,     474,    2640,   0,   0
ttyoutq:                256,      0,      80,     340,    1408,   0,   0
ata_request:            328,      0,       0,      84,      32,   0,   0
ata_composite:          336,      0,       0,       0,       0,   0,   0
VNODE:                  480,      0,  169825,   95575,158978131,   0,   0
VNODEPOLL:              112,      0,       0,     132,       6,   0,   0
NAMEI:                 1024,      0,       0,    1212,432379806,   0,   0
S VFS Cache:            108,      0,  170399,  107428,163308707,   0,   0
STS VFS Cache:          148,      0,       0,       0,       0,   0,   0
L VFS Cache:            328,      0,   12506,    4210, 7622822,   0,   0
LTS VFS Cache:          368,      0,       0,       0,       0,   0,   0
NCLNODE:                568,      0,       0,       0,       0,   0,   0
DIRHASH:               1024,      0,     778,    1038, 3085983,   0,   0
Mountpoints:            792,      0,       8,      32,      10,   0,   0
pipe:                   728,      0,      12,    1318, 3975712,   0,   0
ksiginfo:               112,      0,    1474,    1430,10114065,   0,   0
itimer:                 344,      0,       1,      21,       1,   0,   0
KNOTE:                  128,      0,       0,    1711, 1114947,   0,   0
socket:                 680, 100002,      39,    1419, 9634276,   0,   0
ipq:                     56,    819,       0,       0,       0,   0,   0
udp_inpcb:              392, 100000,      13,    1547, 7561721,   0,   0
udpcb:                   16, 100128,      13,    1835, 7561721,   0,   0
tcp_inpcb:              392, 100000,      14,    1746,  663421,   0,   0
tcpcb:                  976, 100000,      12,    1760,  663421,   0,   0
tcptw:                   72,  20000,       2,     548,    3289,   0,   0
syncache:               152,  15375,       0,     625,  514668,   0,   0
hostcache:              136,  15372,       5,     499,    1879,   0,   0
tcpreass:                40,   1680,       0,    1596,   21767,   0,   0
sackhole:                32,      0,       0,     909,     897,   0,   0
sctp_ep:               1376, 100000,       0,       0,       0,   0,   0
sctp_asoc:             2288,  40000,       0,       0,       0,   0,   0
sctp_laddr:              48,  80064,       0,     288,       6,   0,   0
sctp_raddr:             704,  80000,       0,       0,       0,   0,   0
sctp_chunk:             136, 400008,       0,       0,       0,   0,   0
sctp_readq:             104, 400032,       0,       0,       0,   0,   0
sctp_stream_msg_out:    112, 400026,       0,       0,       0,   0,   0
sctp_asconf:             40, 400008,       0,       0,       0,   0,   0
sctp_asconf_ack:         48, 400032,       0,       0,       0,   0,   0
ripcb:                  392, 100000,       0,     100,     126,   0,   0
unpcb:                  240, 100000,      13,    1315, 1409002,   0,   0
rtentry:                200,      0,      23,      91,      23,   0,   0
selfd:                   56,      0,    2002,    1337,309394869,   0,   0
SWAPMETA:               288, 116519,      40,     558, 1072120,   0,   0
FFS inode:              168,      0,  165618,   97854,158975798,   0,   0
FFS1 dinode:            128,      0,       0,       0,       0,   0,   0
FFS2 dinode:            256,      0,  165618,   97677,158975791,   0,   0

+ vmstat -m
         Type InUse MemUse HighUse Requests  Size(s)
CAM dev queue     4     1K       -        4  128
  md_sii_data     0     0K       -       50  512
      CAM XPT   571  1045K       -      958  16,32,64,128,256,1024,2048
       isadev     8     1K       -        8  128
         UART     6     4K       -        6  16,512,1024
     acpiintr     1     1K       -        1  64
         cdev     7     2K       -        7  256
       acpica  1451   139K       -  6531782  16,32,64,128,256,512,1024
        sigio     1     1K       -        1  64
     filedesc    80    80K       -  5053370  16,32,64,128,256,512,1024,2048,4096
         kenv    78    11K       -       89  16,32,64,128
       kqueue     0     0K       -  1073811  256,512,2048
    proc-args    39     3K       -  7185763  16,32,64,128,256
        hhook     2     1K       -        2  128
     acpitask     1     2K       -        1  2048
      ithread    99    16K       -       99  32,128,256
    CAM queue    19     7K       -      407  16,32,64,128,256,512,2048
       KTRACE   100    13K       -      100  128
       linker   158    11K       -      160  16,32,64,512
        lockf    20     3K       -    24840  64,128
   loginclass     2     1K       -    61054  64
       ip6ndp    12     1K       -       14  64,128
         temp    51     2K       -  8406546  16,32,64,128,256,512,1024,2048,4096
       devbuf  8648 41889K       -    10143  16,32,64,128,256,512,1024,2048,4096
       module   477    60K       -      477  128
    ciss_data    15    14K       -     6749  16,128,256,512,1024,2048,4096
     mtx_pool     2    16K       -        2  
       USBdev    34     8K       -       44  64,128,512,4096
          USB    52    31K       -       66  16,32,64,128,256,2048,4096
     pmchooks     1     1K       -        1  128
      subproc  1546   980K       -  4547988  512,4096
         proc     2    16K       -        2  
      session    32     4K       -  3670265  128
         pgrp    37     5K       -  3674974  128
         cred    52     9K       - 33565086  64,256
      uidinfo     6     3K       -   190686  128,2048
       plimit    16     4K       -   796721  256
      ata_pci     1     1K       -        1  64
      scsi_cd     0     0K       -       10  16
    sysctltmp     0     0K       -    15612  16,32,64,128,4096
    sysctloid  4978   251K       -     5360  16,32,64,128
       sysctl     0     0K       -  8224278  16,32,64
      tidhash     1    16K       -        1  
      callout     7 14336K       -        7  
         umtx  3876   485K       -     3894  128
     p1003.1b     1     1K       -        1  16
         SWAP     2   549K       -        2  64
       bus-sc   113   781K       -     5234  16,32,64,128,256,512,1024,2048,4096
          bus  1282   109K       -    11198  16,32,64,128,256,1024
      devstat    12    25K       -       12  32,4096
 eventhandler    77     6K       -       77  64,128
      acpisem    19     3K       -       19  128
         kobj   330  1320K       -      698  4096
      CAM SIM     5     2K       -        5  256
      Per-cpu     1     1K       -        1  32
   CAM periph    10     3K       -       54  16,32,64,128,256
         rman   248    26K       -      613  16,32,128
         sbuf     1     1K       -     3952  16,32,64,128,256,512,1024,2048,4096
      entropy  1024    64K       -     1024  64
       ctlmem  5062 10113K       -     5062  128,2048
        stack     0     0K       -       12  256
    taskqueue    15     2K       -       15  16,32,128
       Unitno    14     1K       -   611222  32,64
          iov     0     0K       -  1610275  16,32,64,128,256,512
       select  1456   182K       -     1456  128
     ioctlops     0     0K       -  8776365  16,32,64,128,256,512,1024,2048,4096
          msg     4    30K       -        4  2048,4096
          sem     4   196K       -        4  
          shm    10    38K       -  3464862  2048
          tty    24    24K       -      168  1024,2048
          pts     3     1K       -      135  256
     mbuf_tag     0     0K       - 44529069  32,128
        shmfd     1     8K       -        1  
          pcb    23   157K       -   638817  16,32,128,1024,2048,4096
       soname     5     1K       - 53580183  16,32,128
          acl     0     0K       -   146609  4096
       biobuf     1     2K       -    14692  2048
     vfscache     1  8192K       -        1  
   cl_savebuf     0     0K       - 105002436  64,128
     vfs_hash     1  4096K       -        1  
       DEVFS1   116    58K       -      274  512
       vnodes     2     1K       -        4  64,256
       DEVFS3   132    33K       -      327  256
        mount   106     5K       -      206  16,32,64,128,256
  vnodemarker     0     0K       -  5212632  512
          BPF     9     2K       -        9  128
  ether_multi    56     3K       -       66  16,32,64
       ifaddr    87    22K       -       87  32,64,128,256,512,4096
        ifnet    10    19K       -       10  128,2048
        clone     6    24K       -        6  4096
       arpcom     2     1K       -        2  16
      lltable    32    13K       -    59317  256,512
        DEVFS    17     1K       -       20  16,128
       DEVFSP     1     1K       -        2  64
     routetbl    44     6K       -  1514378  32,64,128,256,512
         igmp     9     3K       -        9  256
     in_multi     3     1K       -        3  256
    sctp_iter     0     0K       -        4  256
     sctp_ifn     3     1K       -        3  128
     sctp_ifa     7     1K       -        7  128
     sctp_vrf     1     1K       -        1  64
    sctp_a_it     0     0K       -        4  16
    hostcache     1    28K       -        1  
     syncache     1    96K       -        1  
    in6_multi    28     4K       -       28  32,256
          mld     9     2K       -        9  128
          rpc     2     1K       -        2  256
audit_evclass   179     6K       -      218  32
     savedino     0     0K       -  3114583  256
     freework     1     1K       - 83512229  16,128
    newdirblk     0     0K       -    18403  64
       dirrem     0     0K       - 13541542  128
        mkdir     0     0K       -    29456  128
       diradd     1     1K       - 13549093  128
     freefile     0     0K       -  6948466  64
     freeblks     0     0K       -  6844938  128
     freefrag     0     0K       - 441465352  128
     indirdep     0     0K       -  6476264  128
       newblk     1   512K       - 2886473413  256
    bmsafemap     2     9K       -  9208925  256
     inodedep     2  4097K       -  8097732  512
      pagedep     3   513K       -   142110  256
  ufs_dirhash   767   359K       -   413862  16,32,64,128,256,512,1024
    ufs_mount    18    69K       -       24  512,2048,4096
    vm_pgdata     2   129K       -        2  128
      UMAHash     3    22K       -       13  512,1024,2048,4096
      memdesc     1     4K       -        1  4096
     atkbddev     2     1K       -        2  64
    pfs_nodes    21     6K       -       21  256
  pfs_vncache     0     0K       -      268  64
       ctlblk   200  1600K       -      200  
         GEOM   127    40K       -     1688  16,32,64,128,256,512,1024,2048
      ramdisk     1  4096K       -        1  
      acpidev    30     2K       -       30  64
      ctlpool   532   142K       -      532  32,512
       kbdmux     7    18K       -        8  16,512,1024,2048
       apmdev     1     1K       -        1  128
   madt_table     0     0K       -        1  4096
       feeder     7     1K       -        7  32
      scsi_da     0     0K       -      360  16
     pci_link    16     2K       -       16  16,128
    raid_data     0     0K       -      306  32,128,256
      io_apic     1     2K       -        1  2048
          MCA     8     1K       -        8  128
          msi     3     1K       -        3  128
     nexusdev     3     1K       -        3  16
md_nvidia_data     0     0K       -       50  512
+ sysctl debug
debug.acpi.suspend_bounce: 0
debug.acpi.reset_clock: 1
debug.acpi.interpreter_slack: 1
debug.acpi.enable_debug_objects: 0
debug.acpi.acpi_ca_version: 20110527
debug.acpi.cpu_unordered: 0
debug.acpi.ec.timeout: 750
debug.acpi.ec.polled: 0
debug.acpi.ec.burst: 0
debug.acpi.batt.batt_sleep_ms: 0
debug.acpi.resume_beep: 0
debug.firewire_debug: 0
debug.fwmem_debug: 0
debug.if_fwe_debug: 0
debug.if_fwip_debug: 0
debug.ipw: 0
debug.iwi: 0
debug.mddebug: 0
debug.wpi: 0
debug.elf64_legacy_coredump: 0
debug.bootverbose: 0
debug.boothowto: 0
debug.cpufreq.verbose: 0
debug.cpufreq.lowest: 0
debug.fail_point.sysctl_running: off
debug.fail_point.buf_pressure: off
debug.fail_point.nlm_deny_grant: off
debug.adaptive_machine_arch: 1
debug.sizeof.cdev_priv: 376
debug.sizeof.cdev: 288
debug.sizeof.g_bioq: 56
debug.sizeof.g_consumer: 96
debug.sizeof.g_provider: 136
debug.sizeof.g_geom: 160
debug.sizeof.g_class: 160
debug.sizeof.kinfo_proc: 1088
debug.sizeof.buf: 608
debug.sizeof.bio: 232
debug.sizeof.proc: 1184
debug.sizeof.vnode: 480
debug.sizeof.devstat: 288
debug.sizeof.namecache: 72
debug.osd: 0
debug.trace_on_panic: 1
debug.debugger_on_panic: 1
debug.ncores: 5
debug.to_avg_mpcalls: 742
debug.to_avg_lockcalls: 232
debug.to_avg_gcalls: 482
debug.to_avg_depth: 1712
debug.umtx.umtx_pi_allocated: 0
debug.clocktime: 0
debug.kdb.alt_break_to_debugger: 0
debug.kdb.break_to_debugger: 0
debug.kdb.trap_code: 0
debug.kdb.trap: 0
debug.kdb.panic: 0
debug.kdb.enter: 0
debug.kdb.current: 
debug.rman_debug: 0
debug.iosize_max_clamp: 1
debug.disablefullpath: 0
debug.disablecwd: 0
debug.vfscache: 1
debug.numcachehv: 28704
debug.numcache: 182905
debug.numneg: 11860
debug.nchash: 1048575
debug.vnlru_nowhere: 0
debug.rush_requests: 370281
debug.if_tun_debug: 0
debug.nlm_debug: 0
debug.fsckcmds: 0
debug.collectsnapstats: 0
debug.snapdebug: 0
debug.dopersistence: 0
debug.softdep.cleanup_failures: 369634
debug.softdep.cleanup_retries: 826
debug.softdep.cleanup_high_delay: 14
debug.softdep.cleanup_inorequests: 0
debug.softdep.cleanup_blkrequests: 369690
debug.softdep.jwait_newblk: 0
debug.softdep.jwait_inode: 0
debug.softdep.jwait_freeblks: 0
debug.softdep.jwait_filepage: 0
debug.softdep.journal_wait: 0
debug.softdep.journal_min: 0
debug.softdep.journal_low: 0
debug.softdep.jnewblk_rollback: 0
debug.softdep.jaddref_rollback: 0
debug.softdep.dir_entry: 202033
debug.softdep.direct_blk_ptrs: 342655
debug.softdep.inode_bitmap: 2528275
debug.softdep.indir_blk_ptrs: 26937
debug.softdep.sync_limit_hit: 591
debug.softdep.ino_limit_hit: 0
debug.softdep.blk_limit_hit: 369220
debug.softdep.ino_limit_push: 0
debug.softdep.blk_limit_push: 369690
debug.softdep.worklist_push: 2156
debug.softdep.maxindirdeps: 50
debug.softdep.tickdelay: 2
debug.softdep.max_softdeps: 2352308
debug.softdep.write.jfsync: 0
debug.softdep.write.jtrunc: 0
debug.softdep.write.sbdep: 0
debug.softdep.write.jsegdep: 0
debug.softdep.write.jseg: 0
debug.softdep.write.jfreefrag: 0
debug.softdep.write.jfreeblk: 0
debug.softdep.write.jnewblk: 0
debug.softdep.write.jmvref: 0
debug.softdep.write.jremref: 0
debug.softdep.write.jaddref: 0
debug.softdep.write.freedep: 0
debug.softdep.write.freework: 0
debug.softdep.write.newdirblk: 0
debug.softdep.write.dirrem: 0
debug.softdep.write.mkdir: 0
debug.softdep.write.diradd: 0
debug.softdep.write.freefile: 0
debug.softdep.write.freeblks: 690947
debug.softdep.write.freefrag: 0
debug.softdep.write.allocindir: 2334538581
debug.softdep.write.indirdep: 117350
debug.softdep.write.allocdirect: 76940144
debug.softdep.write.newblk: 0
debug.softdep.write.bmsafemap: 2437858
debug.softdep.write.inodedep: 6917159
debug.softdep.write.pagedep: 329665
debug.softdep.current.jfsync: 0
debug.softdep.current.jtrunc: 0
debug.softdep.current.sbdep: 0
debug.softdep.current.jsegdep: 0
debug.softdep.current.jseg: 0
debug.softdep.current.jfreefrag: 0
debug.softdep.current.jfreeblk: 0
debug.softdep.current.jnewblk: 0
debug.softdep.current.jmvref: 0
debug.softdep.current.jremref: 0
debug.softdep.current.jaddref: 0
debug.softdep.current.freedep: 0
debug.softdep.current.freework: 0
debug.softdep.current.newdirblk: 0
debug.softdep.current.dirrem: 0
debug.softdep.current.mkdir: 0
debug.softdep.current.diradd: 1
debug.softdep.current.freefile: 0
debug.softdep.current.freeblks: 0
debug.softdep.current.freefrag: 0
debug.softdep.current.allocindir: 0
debug.softdep.current.indirdep: 0
debug.softdep.current.allocdirect: 0
debug.softdep.current.newblk: 0
debug.softdep.current.bmsafemap: 1
debug.softdep.current.inodedep: 1
debug.softdep.current.pagedep: 2
debug.softdep.total.jfsync: 0
debug.softdep.total.jtrunc: 0
debug.softdep.total.sbdep: 0
debug.softdep.total.jsegdep: 0
debug.softdep.total.jseg: 0
debug.softdep.total.jfreefrag: 0
debug.softdep.total.jfreeblk: 0
debug.softdep.total.jnewblk: 0
debug.softdep.total.jmvref: 0
debug.softdep.total.jremref: 0
debug.softdep.total.jaddref: 0
debug.softdep.total.freedep: 0
debug.softdep.total.freework: 83512228
debug.softdep.total.newdirblk: 18403
debug.softdep.total.dirrem: 13541542
debug.softdep.total.mkdir: 29456
debug.softdep.total.diradd: 13549093
debug.softdep.total.freefile: 6948466
debug.softdep.total.freeblks: 6844938
debug.softdep.total.freefrag: 441465352
debug.softdep.total.allocindir: 0
debug.softdep.total.indirdep: 6449327
debug.softdep.total.allocdirect: 0
debug.softdep.total.newblk: 2886473412
debug.softdep.total.bmsafemap: 9208924
debug.softdep.total.inodedep: 8097731
debug.softdep.total.pagedep: 142109
debug.dobkgrdwrite: 1
debug.bigcgs: 0
debug.dircheck: 0
debug.psm.pkterrthresh: 2
debug.psm.usecs: 500000
debug.psm.secs: 0
debug.psm.errusecs: 0
debug.psm.errsecs: 2
debug.psm.hz: 20
debug.psm.loglevel: 0
debug.vesa.shadow_rom: 0
debug.fdc.settle: 0
debug.fdc.spec2: 16
debug.fdc.spec1: 175
debug.fdc.retries: 10
debug.fdc.debugflags: 0
debug.fdc.fifo: 8
debug.elf32_legacy_coredump: 0
debug.x86bios.int: 0
debug.x86bios.call: 0
debug.hwpstate_verbose: 0
debug.minidump: 1
+ fstat -f /pgsql
USER     CMD          PID   FD MOUNT      INUM MODE         SZ|DV R/W
pgsql    postgres   52577   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52577    6 /pgsql   15780328 -rw-------  811008 rw
pgsql    postgres   52577   10 /pgsql   15780316 -rw-------  4210688 rw
pgsql    postgres   52577   11 /pgsql   15780336 -rw-------  376832 rw
pgsql    postgres   52577   12 /pgsql   15780331 -rw-------    8192 rw
pgsql    postgres   52577   13 /pgsql   15780329 -rw-------   16384 rw
pgsql    postgres   52577   14 /pgsql   15780349 -rw-------   24576 rw
pgsql    postgres   52577   15 /pgsql   15780397 -rw-------   16384 rw
pgsql    postgres   52577   16 /pgsql   15780293 -rw-------   32768 rw
pgsql    postgres   52577   17 /pgsql   15780356 -rw-------  155648 rw
pgsql    postgres   52577   18 /pgsql   15780378 -rw-------  901120 rw
pgsql    postgres   52577   19 /pgsql   15780395 -rw-------   81920 rw
pgsql    postgres   52577   20 /pgsql   15780411 -rw-------   16384 rw
pgsql    postgres   52577   21 /pgsql   15780338 -rw-------   16384 rw
pgsql    postgres   52577   22 /pgsql   15780412 -rw-------   16384 rw
pgsql    postgres   52577   23 /pgsql   15780295 -rw-------   16384 rw
pgsql    postgres   52577   24 /pgsql   15780348 -rw-------    8192 rw
pgsql    postgres   52577   25 /pgsql   15780401 -rw-------   16384 rw
pgsql    postgres   52577   26 /pgsql   15780372 -rw-------  286720 rw
pgsql    postgres   52577   27 /pgsql   15780326 -rw-------  688128 rw
pgsql    postgres   52577   28 /pgsql   15780353 -rw-------  131072 rw
pgsql    postgres   52577   29 /pgsql   15780381 -rw-------  270336 rw
pgsql    postgres   52577   30 /pgsql   15780346 -rw-------  712704 rw
pgsql    postgres   52577   31 /pgsql   15780380 -rw-------   81920 rw
pgsql    postgres   52577   32 /pgsql   15780394 -rw-------   90112 rw
pgsql    postgres   52577   33 /pgsql   15780454 -rw-------    8192 rw
pgsql    postgres   52577   34 /pgsql   15780365 -rw-------  1712128 rw
pgsql    postgres   52577   35 /pgsql   15780341 -rw-------  1581056 rw
pgsql    postgres   52577   36 /pgsql   15780485 -rw-------    8192 rw
pgsql    postgres   52577   37 /pgsql   15780415 -rw-------  1425408 rw
pgsql    postgres   52577   38 /pgsql   15780486 -rw-------   24576 rw
pgsql    postgres   52577   39 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52577   40 /pgsql   15780382 -rw-------  368640 rw
pgsql    postgres   52577   41 /pgsql   15780405 -rw-------   16384 rw
pgsql    postgres   52577   42 /pgsql   15780351 -rw-------  131072 rw
pgsql    postgres   52577   43 /pgsql   15780403 -rw-------   16384 rw
pgsql    postgres   52577   44 /pgsql   15780296 -rw-------  458752 rw
pgsql    postgres   52577   45 /pgsql   15780396 -rw-------   40960 rw
pgsql    postgres   52577   46 /pgsql   15780337 -rw-------  114688 rw
pgsql    postgres   52577   47 /pgsql   15780307 -rw-------   32768 rw
pgsql    postgres   52577   48 /pgsql   11046110 -rw-------    8192 rw
pgsql    postgres   52577   49 /pgsql   11046156 -rw-------   16384 rw
pgsql    postgres   52577   50 /pgsql   11046248 -rw-------   16384 rw
pgsql    postgres   52577   51 /pgsql   15780399 -rw-------   32768 rw
pgsql    postgres   52577   52 /pgsql   15780350 -rw-------   32768 rw
pgsql    postgres   52577   53 /pgsql   15780376 -rw-------  229376 rw
pgsql    postgres   52577   54 /pgsql   15780370 -rw-------  4866048 rw
pgsql    postgres   52577   55 /pgsql   15780292 -rw-------   32768 rw
pgsql    postgres   52577   56 /pgsql   15780371 -rw-------   16384 rw
pgsql    postgres   52577   57 /pgsql   15780339 -rw-------   16384 rw
pgsql    postgres   52577   60 /pgsql   15780375 -rw-------   81920 rw
pgsql    postgres   52577   61 /pgsql   15780374 -rw-------  2318336 rw
pgsql    postgres   52572   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52572    6 /pgsql   11046011 -rw-------  794624 rw
pgsql    postgres   52572   10 /pgsql   11045999 -rw-------  4186112 rw
pgsql    postgres   52572   11 /pgsql   11046019 -rw-------  393216 rw
pgsql    postgres   52572   12 /pgsql   11046014 -rw-------    8192 rw
pgsql    postgres   52572   13 /pgsql   11046012 -rw-------   16384 rw
pgsql    postgres   52572   14 /pgsql   11046032 -rw-------   24576 rw
pgsql    postgres   52572   15 /pgsql   11046078 -rw-------   16384 rw
pgsql    postgres   52572   16 /pgsql   11045944 -rw-------   32768 rw
pgsql    postgres   52572   17 /pgsql   11046039 -rw-------  131072 rw
pgsql    postgres   52572   18 /pgsql   11046059 -rw-------  720896 rw
pgsql    postgres   52572   19 /pgsql   11046076 -rw-------   65536 rw
pgsql    postgres   52572   20 /pgsql   11046092 -rw-------   16384 rw
pgsql    postgres   52572   21 /pgsql   11046021 -rw-------   24576 rw
pgsql    postgres   52572   22 /pgsql   11046093 -rw-------   16384 rw
pgsql    postgres   52572   23 /pgsql   11045968 -rw-------   16384 rw
pgsql    postgres   52572   24 /pgsql   11046031 -rw-------    8192 rw
pgsql    postgres   52572   25 /pgsql   11046082 -rw-------   16384 rw
pgsql    postgres   52572   26 /pgsql   11046053 -rw-------  270336 rw
pgsql    postgres   52572   27 /pgsql   11046009 -rw-------  647168 rw
pgsql    postgres   52572   28 /pgsql   11046036 -rw-------  106496 rw
pgsql    postgres   52572   29 /pgsql   11046062 -rw-------  270336 rw
pgsql    postgres   52572   30 /pgsql   11046029 -rw-------  712704 rw
pgsql    postgres   52572   31 /pgsql   11046061 -rw-------   81920 rw
pgsql    postgres   52572   32 /pgsql   11046075 -rw-------   81920 rw
pgsql    postgres   52572   33 /pgsql   11046851 -rw-------    8192 rw
pgsql    postgres   52572   34 /pgsql   11046048 -rw-------  1433600 rw
pgsql    postgres   52572   35 /pgsql   11046024 -rw-------  1556480 rw
pgsql    postgres   52572   36 /pgsql   11046882 -rw-------    8192 rw
pgsql    postgres   52572   37 /pgsql   11046096 -rw-------  1179648 rw
pgsql    postgres   52572   38 /pgsql   11046883 -rw-------   24576 rw
pgsql    postgres   52572   39 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52572   40 /pgsql   11046063 -rw-------  335872 rw
pgsql    postgres   52572   41 /pgsql   11046086 -rw-------   16384 rw
pgsql    postgres   52572   42 /pgsql   11046034 -rw-------  131072 rw
pgsql    postgres   52572   43 /pgsql   11046084 -rw-------   16384 rw
pgsql    postgres   52572   44 /pgsql   11045974 -rw-------  458752 rw
pgsql    postgres   52572   45 /pgsql   11046077 -rw-------   40960 rw
pgsql    postgres   52572   46 /pgsql   11046020 -rw-------  114688 rw
pgsql    postgres   52572   47 /pgsql   11045990 -rw-------   32768 rw
pgsql    postgres   52572   48 /pgsql   11046110 -rw-------    8192 rw
pgsql    postgres   52572   49 /pgsql   11046156 -rw-------   16384 rw
pgsql    postgres   52572   50 /pgsql   11046248 -rw-------   16384 rw
pgsql    postgres   52572   51 /pgsql   11046080 -rw-------   32768 rw
pgsql    postgres   52572   52 /pgsql   11046033 -rw-------   32768 rw
pgsql    postgres   52572   53 /pgsql   11046057 -rw-------  221184 rw
pgsql    postgres   52572   54 /pgsql   11046051 -rw-------  4874240 rw
pgsql    postgres   52572   55 /pgsql   11045939 -rw-------   32768 rw
pgsql    postgres   52572   56 /pgsql   11046052 -rw-------   16384 rw
pgsql    postgres   52572   57 /pgsql   11046022 -rw-------   16384 rw
pgsql    postgres   52572   60 /pgsql   11046056 -rw-------   65536 rw
pgsql    postgres   52572   61 /pgsql   11046055 -rw-------  2310144 rw
pgsql    postgres   52571   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52571    6 /pgsql   11046116 -rw-------   16384 rw
pgsql    postgres   52571   10 /pgsql   11046198 -rw-------   16384 rw
pgsql    postgres   52571   11 /pgsql   11046615 -rw-------   16384 rw
pgsql    postgres   52571   12 /pgsql   11048966 -rw-------  761856 rw
pgsql    postgres   52571   13 /pgsql   11048954 -rw-------  3399680 rw
pgsql    postgres   52571   14 /pgsql   11048974 -rw-------  319488 rw
pgsql    postgres   52571   15 /pgsql   11048969 -rw-------    8192 rw
pgsql    postgres   52571   16 /pgsql   11048967 -rw-------   16384 rw
pgsql    postgres   52571   17 /pgsql   11048987 -rw-------   24576 rw
pgsql    postgres   52571   18 /pgsql   11049035 -rw-------   16384 rw
pgsql    postgres   52571   19 /pgsql   11047866 -rw-------   32768 rw
pgsql    postgres   52571   20 /pgsql   11048994 -rw-------  114688 rw
pgsql    postgres   52571   21 /pgsql   11049016 -rw-------  524288 rw
pgsql    postgres   52571   22 /pgsql   11049033 -rw-------   57344 rw
pgsql    postgres   52571   23 /pgsql   11049049 -rw-------   16384 rw
pgsql    postgres   52571   24 /pgsql   11048976 -rw-------    8192 rw
pgsql    postgres   52571   25 /pgsql   11049050 -rw-------   16384 rw
pgsql    postgres   52571   26 /pgsql   11047868 -rw-------   16384 rw
pgsql    postgres   52571   27 /pgsql   11048986 -rw-------    8192 rw
pgsql    postgres   52571   28 /pgsql   11049039 -rw-------   16384 rw
pgsql    postgres   52571   29 /pgsql   11049010 -rw-------  221184 rw
pgsql    postgres   52571   30 /pgsql   11048964 -rw-------  565248 rw
pgsql    postgres   52571   31 /pgsql   11048991 -rw-------   81920 rw
pgsql    postgres   52571   32 /pgsql   11049019 -rw-------  270336 rw
pgsql    postgres   52571   33 /pgsql   11048984 -rw-------  720896 rw
pgsql    postgres   52571   34 /pgsql   11049018 -rw-------   81920 rw
pgsql    postgres   52571   35 /pgsql   11049032 -rw-------   73728 rw
pgsql    postgres   52571   36 /pgsql   11049092 -rw-------    8192 rw
pgsql    postgres   52571   37 /pgsql   11049003 -rw-------  1277952 rw
pgsql    postgres   52571   38 /pgsql   11048979 -rw-------  1482752 rw
pgsql    postgres   52571   39 /pgsql   11049123 -rw-------    8192 rw
pgsql    postgres   52571   40 /pgsql   11049053 -rw-------  1056768 rw
pgsql    postgres   52571   41 /pgsql   11049124 -rw-------   24576 rw
pgsql    postgres   52571   42 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52571   43 /pgsql   11049020 -rw-------  294912 rw
pgsql    postgres   52571   44 /pgsql   11049043 -rw-------   16384 rw
pgsql    postgres   52571   45 /pgsql   11048989 -rw-------  131072 rw
pgsql    postgres   52571   46 /pgsql   11049041 -rw-------   16384 rw
pgsql    postgres   52571   47 /pgsql   11047869 -rw-------  344064 rw
pgsql    postgres   52571   48 /pgsql   11049034 -rw-------   40960 rw
pgsql    postgres   52571   49 /pgsql   11048975 -rw-------  114688 rw
pgsql    postgres   52571   50 /pgsql   11048945 -rw-------   32768 rw
pgsql    postgres   52571   51 /pgsql   11046110 -rw-------    8192 rw
pgsql    postgres   52571   52 /pgsql   11046156 -rw-------   16384 rw
pgsql    postgres   52571   53 /pgsql   11046248 -rw-------   16384 rw
pgsql    postgres   52571   54 /pgsql   11049037 -rw-------   32768 rw
pgsql    postgres   52571   55 /pgsql   11048988 -rw-------   32768 rw
pgsql    postgres   52571   56 /pgsql   11049014 -rw-------  139264 rw
pgsql    postgres   52571   57 /pgsql   11049008 -rw-------  2228224 rw
pgsql    postgres   52571   58 /pgsql   11047865 -rw-------   32768 rw
pgsql    postgres   52571   59 /pgsql   11049009 -rw-------   16384 rw
pgsql    postgres   52571   60 /pgsql   11048977 -rw-------   16384 rw
pgsql    postgres   52571   63 /pgsql   11049013 -rw-------   40960 rw
pgsql    postgres   52571   64 /pgsql   11049012 -rw-------  1048576 rw
pgsql    postgres   52569   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52568   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52568    8 /pgsql   11046614 -rw-------    8192 rw
pgsql    postgres   52567   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52567    6 /pgsql   11053295 -rw-------  16777216 rw
pgsql    postgres   52566   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52565   wd /pgsql   11045888 drwx------     512  r
pgsql    postgres   52561   wd /pgsql   11045888 drwx------     512  r
+ sysctl -a
+ egrep vnode
kern.maxvnodes: 588077
kern.minvnodes: 147019
vm.stats.vm.v_vnodepgsout: 0
vm.stats.vm.v_vnodepgsin: 52262
vm.stats.vm.v_vnodeout: 0
vm.stats.vm.v_vnodein: 21936
vfs.freevnodes: 128846
vfs.wantfreevnodes: 147019
vfs.numvnodes: 169825
debug.sizeof.vnode: 480
+ mount -v
/dev/da0s1a on / (ufs, local, writes: sync 389 async 167, reads: sync 29664 async 2096, fsid 6ca1714b67a0e2e6)
devfs on /dev (devfs, local, multilabel, fsid 00ff007171000000)
/dev/da1s1 on /opt (ufs, local, soft-updates, writes: sync 420420 async 15114942, reads: sync 176874881 async 144200525, fsid 30318550f5679e86)
/dev/da0s1e on /tmp (ufs, local, soft-updates, writes: sync 44 async 15463, reads: sync 5280 async 0, fsid 6ca1714b011cfe1c)
/dev/da0s1f on /usr (ufs, local, soft-updates, writes: sync 1544 async 2144528, reads: sync 13529656 async 7411, fsid 6ca1714b7a5cb615)
/dev/da0s1d on /var (ufs, local, soft-updates, writes: sync 10629 async 1331808, reads: sync 271418 async 24881, fsid 6da1714be9133bfa)
procfs on /proc (procfs, local, fsid 01ff000202000000)
/dev/da2s1d on /pgsql (ufs, local, writes: sync 234 async 565, reads: sync 514 async 228, fsid 6ca1714bbe0b8c4d)
# ^D
Script done on Sun Jun  2 22:25:49 2013

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?69D8CE6E8C429368C08781FD>