Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 9 Feb 2011 04:50:52 +0800
From:      rozhuk.im@gmail.com
To:        <freebsd-net@freebsd.org>
Subject:   jumbo frames + geom_mirror = no net
Message-ID:  <4d51acaf.cf03d90a.514d.1989@mx.google.com>

next in thread | raw e-mail | index | archive | help
Hi!


I have 8.2 + latest updates, em + gigabit net, few HDDs in mirror.
Samba for share HDDs to win hosts.
(E5300, G33 + ICH9R, 2GB, PCI-E intel desktop GB adapter)=20

ifconfig_em0=3D"inet 172.16.0.254 netmask 255.255.255.0 mtu 9000"

Then I start copy files to mirror (trough net or using cp from others =
HDD on
host)
after some time host stop respond to net, no errors messages in logs.
(top show free mem < 10mb just before it happen)
(It started after first mirror was created)

And don=92t respond until reboot or: ifconfig em0 mtu 1500 (from =
console)


Vmstat show my failures for mbuf_jumbo_9k:
mbuf_jumbo_9k:           9216,     6400,        0,        0, 36202768,
8472897
=20
but no failures for simple 1,5k mbuf's :/




vmstat -z
ITEM                     SIZE     LIMIT      USED      FREE  REQUESTS
FAILURES

UMA Kegs:                 128,        0,       97,       23,       97,
0
UMA Zones:                888,        0,       97,        3,       97,
0
UMA Slabs:                284,        0,     1068,      514,    90680,
0
UMA RCntSlabs:            544,        0,     2649,      529, 13469257,
0
UMA Hash:                 128,        0,        1,       29,        4,
0
16 Bucket:                 76,        0,       12,       88,      122,
0
32 Bucket:                140,        0,       16,       96,      308,
0
64 Bucket:                268,        0,       43,       69,      561,
13
128 Bucket:               524,        0,      323,        6,   599692,
5140
VM OBJECT:                136,        0,    19972,    36317,  1260502,
0
MAP:                      136,        0,        7,       22,        7,
0
KMAP ENTRY:                72,    57505,     2188,     2423,  4613615,
0
MAP ENTRY:                 72,        0,     2418,      762,  4043456,
0
DP fakepg:                 72,        0,        0,        0,        0,
0
SG fakepg:                 72,        0,        0,        0,        0,
0
mt_zone:                 2056,        0,      175,      237,      175,
0
16:                        16,        0,     4239,      836, 16310509,
0
32:                        32,        0,     2514,     1780, 124403442,
0
64:                        64,        0,     5044,     3334, 402804800,
0
128:                      128,        0,      792,     1428,  7002330,
0
256:                      256,        0,      592,      593,  1093975,
0
512:                      512,        0,      165,     1035,   671161,
0
1024:                    1024,        0,       55,      181,   882578,
0
2048:                    2048,        0,      150,      250,    73957,
0
4096:                    4096,        0,      132,      243,   734964,
0
Files:                     56,        0,     5737,      628,  8850040,
0
TURNSTILE:                 72,        0,      416,       64,      451,
0
umtx pi:                   52,        0,        0,        0,        0,
0
PROC:                     680,        0,       81,      171,    38814,
0
THREAD:                   720,        0,      277,      138,    11326,
0
SLEEPQUEUE:                44,        0,      416,      115,      451,
0
VMSPACE:                  228,        0,       57,      164,    31952,
0
cpuset:                    40,        0,        2,      182,        2,
0
mbuf_packet:              256,        0,     4100,      609, 76165127,
0
mbuf:                     256,        0,      175,     1206, 398211372,
0
mbuf_cluster:            2048,    65536,     4845,      453, 30848491,
0
mbuf_jumbo_page:         4096,    12800,        0,        0,        0,
0
mbuf_jumbo_9k:           9216,     6400,        0,        0, 36202768,
8472897
mbuf_jumbo_16k:         16384,     3200,        0,        0,        0,
0
mbuf_ext_refcnt:            4,        0,        4,      402, 25681942,
0
ttyoutq:                  256,        0,       64,       41,      136,
0
g_bio:                    140,        0,        0,     1568, 205564803,
0
ttyinq:                   152,        0,      120,       62,      255,
0
ata_request:              208,        0,        0,      304, 67886293,
0
ata_composite:            180,        0,        0,        0,        0,
0
VNODE:                    268,        0,    19632,    27674,  5052284,
0
VNODEPOLL:                 60,        0,       16,      173,       21,
0
S VFS Cache:               72,        0,    12259,    51977,  1280216,
0
L VFS Cache:              292,        0,     2976,      729,    70042,
0
NAMEI:                   1024,        0,        0,      260, 153323563,
0
DIRHASH:                 1024,        0,       57,      343,    57340,
0
AIO:                      120,        0,        3,       93,       19,
0
AIOP:                      16,        0,        4,      402,       44,
0
AIOCB:                    292,        0,        0,      390,  6897050,
0
AIOL:                      64,        0,        0,        0,        0,
0
AIOLIO:                   168,        0,        0,        0,        0,
0
pipe:                     392,        0,       50,      170,    25245,
0
ksiginfo:                  80,        0,      244,      332,   509687,
0
itimer:                   220,        0,        1,       53,       15,
0
KNOTE:                     72,        0,     1901,      643, 153128799,
0
socket:                   412,   204804,     1936,      755,  4049131,
0
ipq:                       32,     2147,        0,        0,        0,
0
udp_inpcb:                220,   204804,       18,      306,   105359,
0
udpcb:                      8,   204827,       18,      388,   105359,
0
tcp_inpcb:                220,   204804,     1991,      943,  3034192,
0
tcpcb:                    632,   204804,     1859,      829,  3034192,
0
tcptw:                     52,    40968,      132,      588,   863691,
0
syncache:                 112,   102410,        2,      383,   756808,
0
hostcache:                 76,    15400,      577,     5623,   202354,
0
tcpreass:                  20,     4225,        4,      503, 16547113,
0
sackhole:                  20,        0,        2,      505,   816717,
0
ripcb:                    220,   204804,        1,       35,        2,
0
unpcb:                    172,   204815,       44,      324,   909334,
0
rtentry:                  108,        0,        6,      102,       51,
0
selfd:                     28,        0,      472,      417, 44350642,
0
SWAPMETA:                 276,   121576,        0,        0,        0,
0
Mountpoints:              644,        0,       17,       19,       18,
0
FFS inode:                116,        0,    19560,    35385,  1771335,
0
FFS1 dinode:              128,        0,        0,        0,        0,
0
FFS2 dinode:              256,        0,    19560,    24255,  1771327,
0
md1:                      512,        0,      121,       15,      121,
0
pfsrctrpl:                124,    10013,        0,       62,        6,
0
pfrulepl:                 828,        0,      145,      347,     8368,
0
pfstatepl:                284,    16394,     5564,     1842,  4902363,
0
pfaltqpl:                 224,        0,        0,        0,        0,
0
pfpooladdrpl:              68,        0,       26,      198,     1148,
0
pfrktable:               1240,     1002,       14,       46,     1086,
0
pfrkentry:                156,   200000,       46,      229,     4271,
0
pfrkentry2:               156,        0,        0,        0,        0,
0
pffrent:                   16,     5075,        0,      406,    38707,
0
pffrag:                    48,        0,        0,      312,    19255,
0
pffrcache:                 48,    10062,        0,        0,        0,
0
pffrcent:                  12,    50141,        0,        0,        0,
0
pfstatescrub:              28,        0,       56,      706,    99700,
0
pfiaddrpl:                100,        0,       73,      239,     2428,
0
pfospfen:                 108,        0,      696,      240,    54288,
0
pfosfp:                    28,        0,      407,      228,    31746,
0
NetGraph items:            36,     4130,        0,      354,   311914,
0
NetGraph data items:       36,      531,        0,      295, 217845511,
0



vmstat -m

         Type InUse MemUse HighUse Requests  Size(s)
      session    38     3K       -     8031  64
         pgrp    44     3K       -     8459  64
         cred   218    21K       -  6348824  64,128
      uidinfo     8     2K       -   645160  64,1024
       plimit    19     5K       -    68613  256
      CAM SIM    10     2K       -       10  128
    sysctltmp     0     0K       -     7474  16,32,64,128,2048
    sysctloid  2712    83K       -     2853  16,32,64
       sysctl     0     0K       -  2461365  16,32,64
      callout     1   256K       -        1 =20
         umtx   415    26K       -      450  64
     p1003.1b     1     1K       -        1  16
   CAM periph    14     2K       -       30  16,32,128
       bus-sc    52    47K       -     1208
16,32,64,128,256,512,1024,2048,4096
          bus   575    31K       -     3448  16,32,64,128,1024
      devstat    20    41K       -       20  16,4096
 eventhandler    75     4K       -       75  32,64,128
      CAM XPT    95    37K       -    13819  16,32,64,1024,2048
         kobj    84   168K       -      176  2048
      Per-cpu     1     1K       -        1  16
       isadev    10     1K       -       10  64
        gprof     1 90840K       -        3 =20
         rman   162    10K       -      572  16,32,64
      entropy  1024    64K       -     1024  64
         sbuf     0     0K       -   100620
16,32,64,128,256,512,1024,2048,4096
       DEVFS1    90    23K       -      134  256
       DEVFS3   121    16K       -      165  128,256
    taskqueue    15     1K       -       15  16,64
       Unitno    12     1K       -    22352  16,64
          iov     0     0K       - 20753624  16,64,128,256
       select   232    15K       -      232  64
     ioctlops     0     0K       -  1154325
16,32,64,128,256,512,1024,2048,4096
          tty    23    12K       -       30  512,1024
          pts     6     1K       -       11  128
         accf     5     1K       -       21  16,32
     mbuf_tag     5     1K       - 377663504  32,64
        shmfd     1     4K       -        1  4096
         cdev     7     1K       -        7  128
          pcb  1344   152K       -  2390492  16,32,512,1024
       soname    29     3K       -  9094379  16,32,128
          acl     0     0K       -    26680  4096
       biobuf     1     2K       -     4552  2048
     vfscache     1   512K       -        1 =20
   cl_savebuf     0     0K       -   162042  32,64
     vfs_hash     1   256K       -        1 =20
       vnodes     4     1K       -        4  32,128
  vnodemarker     0     0K       -   346290  512
        mount   240     8K       -      332  16,32,64,128,256
          BPF    11    74K       -       63  16,64,128,256,1024,4096
  ether_multi    11     1K       -       76  16,32,64
       ifaddr    29     8K       -      116  16,32,256,2048
        ifnet     5     5K       -       30  64,1024
        clone     1     4K       -        1  4096
       arpcom     1     1K       -        1  16
      lltable    34     5K       -     7502  128,256
        DEVFS     7     1K       -        8  16,64
        sigio     3     1K       -        5  32
     filedesc   129   132K       -    42677
16,32,64,128,256,512,1024,2048,4096
         kenv   106     8K       -      123  16,32,64,128,4096
       kqueue    18    32K       -   103730  32,128,256,1024,2048
       DEVFSP     2     1K       -        8  32
    proc-args    51     3K       -    45155  16,32,64,128,256
     routetbl    54    10K       -    44783  16,32,64,128,256
         igmp     4     1K       -       29  128
         ipid     2    24K       -        2 =20
     in_multi     4     1K       -       36  128
    hostcache     1   512K       -        1 =20
     syncache     1   144K       -        1 =20
     savedino     0     0K       -    93850  256
    newdirblk     0     0K       -      112  32
       dirrem     1     1K       -   839105  32
        mkdir     0     0K       -     9352  32
       diradd     2     1K       -   165136  64
     freefile     1     1K       -   775184  32
     freeblks     1     1K       -   784281  256
     freefrag     0     0K       -   392940  32
   allocindir   345    22K       - 59161846  64
     indirdep     3     1K       -    87473  32
  allocdirect     2     1K       -  1367113  128
    bmsafemap     5     1K       -   109568  64
       newblk     1     1K       - 60528960  64,256
     inodedep     6   257K       -   881018  128
      pagedep     4    65K       -    27393  64
  ufs_dirhash   114    57K       -    46296  16,32,64,128,256,512
    ufs_mount    24   422K       -       27  256,2048,4096
      UMAHash     3     5K       -        8  256,512,1024,2048,4096
      ithread    65     6K       -       65  16,64,128
         GEOM   260    37K       -     4447  =
16,32,64,128,256,512,1024,4096
    vm_pgdata     1    64K       -        1 =20
       linker   196   611K       -      538  =
16,32,64,128,256,1024,2048,4096
     atkbddev     1     1K       -        1  32
       cpuctl     1     1K       -        1  16
        lockf    56     4K       -  1001219  32,64
      io_apic     1     1K       -        1  1024
      memdesc     1     4K       -        1  4096
         temp    31   592K       -  2837830
16,32,64,128,256,512,1024,2048,4096
       devbuf  1201  5184K       -     1244
16,32,64,128,256,512,1024,2048,4096
       module   142     9K       -      142  64,128
          LED     1     1K       -        1  64
     mtx_pool     2     8K       -        2  4096
CAM dev queue    10     2K       -       10  128
    CAM queue    42     1K       -      124  16
      subproc   338   400K       -    39116  256,4096
         proc     2     8K       -        2  4096
          msi     3     1K       -        3  64
     nexusdev     4     1K       -        4  16
  mirror_data     6     2K       -   288108  16,32,128,512
      acpidev    83     3K       -       83  32
       acpica  2504   132K       -    78527  16,32,64,128,256,512,1024
     acpitask     1     1K       -        1  1024
      acpisem    15     2K       -       15  64,128
       apmdev     1     1K       -        1  64
     pci_link    16     2K       -       16  64,128
   md_sectors     3    12K       -        3  4096
      md_disk     5     5K       -        5  16,2048
  nullfs_node    13     1K       -  3281277  16
  nullfs_hash     1     1K       -        1  64
 nullfs_mount     8     1K       -        8  16
 netgraph_msg     0     0K       -    99588  64,128,256,512,1024
netgraph_node    22     3K       -      345  128
netgraph_hook    38     5K       -      900  128
     netgraph     8     9K       -      142  32,64,256
netgraph_sock     7     1K       -      101  64
netgraph_path     0     0K       -    50601  16,32
netgraph_mppc     2     2K       -       37  1024
netgraph_iface     2     1K       -       27  64
 netgraph_ppp     2    16K       -       27 =20
netgraph_pppoe     2     9K       -       15  64,512
netgraph_l2tp     2     2K       -       48  64,1024
netgraph_ksock     1     1K       -       22  64




=A0
--
Rozhuk Ivan
=A0=20






Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4d51acaf.cf03d90a.514d.1989>