From owner-freebsd-net@FreeBSD.ORG Sun Jul 14 16:17:14 2013 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id B195EBC5 for ; Sun, 14 Jul 2013 16:17:14 +0000 (UTC) (envelope-from barney_cordoba@yahoo.com) Received: from nm27-vm2.bullet.mail.ne1.yahoo.com (nm27-vm2.bullet.mail.ne1.yahoo.com [98.138.91.215]) by mx1.freebsd.org (Postfix) with ESMTP id 78E6A7F9 for ; Sun, 14 Jul 2013 16:17:14 +0000 (UTC) Received: from [98.138.90.52] by nm27.bullet.mail.ne1.yahoo.com with NNFMP; 14 Jul 2013 16:14:22 -0000 Received: from [98.138.226.160] by tm5.bullet.mail.ne1.yahoo.com with NNFMP; 14 Jul 2013 16:14:22 -0000 Received: from [127.0.0.1] by omp1061.mail.ne1.yahoo.com with NNFMP; 14 Jul 2013 16:14:22 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 55637.81867.bm@omp1061.mail.ne1.yahoo.com Received: (qmail 74274 invoked by uid 60001); 14 Jul 2013 16:14:22 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1373818461; bh=6AvwuNxxQ6LimiclbZ+8oK0W0EqGX/oWHsilJiJxktQ=; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=Ea4VYWCSEvaXDosMHzQlZ/uzXxEJSOkdRw/K2EHZu+eqa+gOdhOSSk/TADklac72S98Dx3pSMLqsiMZAo0wC8a/WaxlpYamjXQB9c1O2n5WxdtQKSE4Y7W1Y5zyCnM79TeEUjYwgfXagu7s3Lu2SGio3569mL9rfjC9T3auUf1U= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Rocket-MIMEInfo:X-Mailer:Message-ID:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=JDKtTt8j+gfAcbvs+APdIH2S1ySGSWZ15Nw6tKoVc+JO2gULqtE3DTCal9OnNkimSlfT0InJLoPgTlXZhxlz8/2HbQxWIu9iq17k4FdzVCDmPdthLreznifIwrrd+RUVQEtUs3Ojc0FQMlQf4nQPlH3VVWjMPC4Xh+zTw4fj4QI= ; X-YMail-OSG: qbEz.NwVM1nV5XZcmFxEViBMPDxSjdij2TjKgTjfq8Xo_uD xtS7tkUmiaTPn2kS7o.WfkZuX4Sg7uTtnaa5AEXvfCh9SSejSDsqSegsO67A 20__l28Rpe1JzTVbbg_mZ_esCmY3ivRUG5g4mFWG7BpFZHTkbQsMEJuH8WHv yYDJNP0ntYUf3gJ19q0UHbb_u4NLGhf5yqUi75ZWKixwYANb_sQ9oV_Le9FA dh2MaqdigS76UsmfWzjU7ty34Ahx3UJ61oHxJm_UF4u7j5jZ763Yhj7YS6KZ gG.us8tjsmWq6Nf7dy9VhzZ9QC6JnmuGPVQirqDOYpoz6Jovbh2rg8yrnz8J 2_IgF8uXHwNk6pMV2ZJZ9WGOh2S4C_fvzzR.5rz8jja_o6dMhk9JdKfKTjCv ZFr9YsTAjV90kwhQuxfuZ3bXsKZCq6.1D6QRZbia2qUdUG5KWfi8nZRzLM9K UM6iVWe5rgLscRrXPXvX1u_DdvlqdxTBTWOWAwDpgG9qOYgh0xDsa3ZG0ugk G_M_GhgEjKFBVgQ5tw7_zw8HNMqeNVR9NAUOK3NE36YSjGXYtWuAuddc5WyK yFfY.tYlLdNlNzbpSRmmvGTs- Received: from [98.203.118.124] by web121605.mail.ne1.yahoo.com via HTTP; Sun, 14 Jul 2013 09:14:21 PDT X-Rocket-MIMEInfo: 002.001, U28gd2h5IG5vdCBnZXQgYSByZWFsIDEwZ2IvcyBjYXJkPyBSSjQ1IDEwZ2lnIGlzIGhlcmUsIA0KYW5kIGl0IHdvcmtzIGEgbG90IGJldHRlciB0aGFuIExBR0cuDQoNCklmIHlvdSB3YW50IHRvIGdldCBtb3JlIHRoYW4gMUdiL3Mgb24gYSBzaW5nbGUgY29ubmVjdGlvbiwNCnlvdSdkIG5lZWQgdG8gdXNlIHJvdW5kcm9iaW4sIHdoaWNoIHdpbGwgYWx0ZXJuYXRlIHBhY2tldHMNCndpdGhvdXQgY29uY2VybiBmb3Igb3JkZXJpbmcuIFB1cmlzdHMgd2lsbCBhcmd1ZSBhZ2FpbnN0IGl0LA0KYnV0IGl0IGRvZXMBMAEBAQE- X-Mailer: YahooMailClassic/1000012 YahooMailWebService/0.8.148.557 Message-ID: <1373818461.35904.YahooMailBasic@web121605.mail.ne1.yahoo.com> Date: Sun, 14 Jul 2013 09:14:21 -0700 (PDT) From: Barney Cordoba Subject: Re: Re[2]: FreeBSD router problems To: isp In-Reply-To: <3798.1373566301.16193856550018220032@ffe15.ukr.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Cc: freebsd-net@freebsd.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Jul 2013 16:17:14 -0000 So why not get a real 10gb/s card? RJ45 10gig is here,=20 and it works a lot better than LAGG. If you want to get more than 1Gb/s on a single connection, you'd need to use roundrobin, which will alternate packets without concern for ordering. Purists will argue against it, but it does work and modern TCP stacks know how to deal=20 with out of order packets. ifconfig lagg0 laggproto roundrobin laggport em0 laggport em1 BC -------------------------------------------- On Thu, 7/11/13, isp wrote: Subject: Re[2]: FreeBSD router problems To: "Alan Somers" Cc: freebsd-net@freebsd.org Date: Thursday, July 11, 2013, 2:11 PM =20 =20 =20 =20 I have a real network with more than 4 000 users. In normal case, when I have two 1Gbps routers, and I split VLAN's between them total bandwidth if growing up to 1.7 Gbps. =20 --- Incoming mail --- From: "Alan Somers" Date: 11 July 2013, 21:00:41 =20 How are you benchmarking it?=C2=A0 Each TCP connection only uses one member of a lagg port.=C2=A0 So if you want to see > 1 Gbps, you'll need to benchmark with multiple TCP connections.=C2=A0 You may also need multiple systems; I don't know the full details of LACP. =20 On Thu, Jul 11, 2013 at 11:32 AM, isp <=C2=A0 mline@ukr.net=C2=A0 > wrote: > > > > Hi! I have a problem with my FreeBSD router, I can't get more than 1 Gbps > throught it, but I have 2 Gbps LAGG on it. There are only 27 IPFW rules > (NAT+Shaping). IPoE only. > lagg0 (VLAN's + shaping) - two 'igb' adapters > lagg1 (NAT, tso if off) - two 'em' adapters > > I tried to switch off dummynet, but it doesn't helps. > > # uname -a > [code]FreeBSD router 9.1-RELEASE-p3 FreeBSD 9.1-RELEASE-p3 #0: Tue Apr 30 > 20:02:00 EEST 2013=C2=A0 =C2=A0=C2=A0=C2=A0root@south:/usr/obj/usr/src/sys/ROUTER=C2=A0 amd64 > > # top -aSPHI > last pid: 91712;=C2=A0 load averages:=C2=A0 2.18,=C2=A0 2.06, > 1.97 > up 20+22:28:36=C2=A0 17:40:22 > 120 processes: 7 running, 87 sleeping, 26 waiting > CPU 0:=C2=A0 0.0% user,=C2=A0 0.0% nice,=C2=A0 1.6% system, 38.6% interrupt, 59.8% idle > CPU 1:=C2=A0 0.0% user,=C2=A0 0.0% nice,=C2=A0 7.1% system, 37.0% interrupt, 55.9% idle > CPU 2:=C2=A0 0.0% user,=C2=A0 0.0% nice,=C2=A0 3.9% system, 38.6% interrupt, 57.5% idle > CPU 3:=C2=A0 0.0% user,=C2=A0 0.0% nice, 15.7% system, 26.8% interrupt, 57.5% idle > Mem: 59M Active, 1102M Inact, 942M Wired, 800M Buf, 5529M Free > Swap: 16G Total, 16G Free > > PID USERNAME PRI NICE=C2=A0=C2=A0=C2=A0SIZE=C2=A0 =C2=A0 RES STATE=C2=A0=C2=A0=C2=A0C=C2=A0=C2=A0=C2=A0TIME=C2=A0=C2=A0=C2=A0WCPU COMMAND > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-72=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K RUN=C2=A0 =C2=A0=C2=A0=C2=A01 153:39 72.22% [intr{swi1: > netisr 0}] > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K RUN=C2=A0 =C2=A0=C2=A0=C2=A01 494.2H 65.19% [idle{idle: > cpu1}] > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K CPU2=C2=A0 =C2=A0 2 494.3H 64.65% [idle{idle: > cpu2}] > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K RUN=C2=A0 =C2=A0=C2=A0=C2=A00 493.3H 63.38% [idle{idle: > cpu0}] > 11 root=C2=A0 =C2=A0=C2=A0=C2=A0155 ki31=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0 =C2=A0 64K CPU3=C2=A0 =C2=A0 3 496.4H 62.55% [idle{idle: > cpu3}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 2=C2=A0 58:49=C2=A0 9.38% [intr{irq266: > igb0:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 2=C2=A0 59:32=C2=A0 9.03% [intr{irq271: > igb1:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K CPU1=C2=A0 =C2=A0 1=C2=A0 59:09=C2=A0 8.94% [intr{irq265: > igb0:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 3=C2=A0 57:52=C2=A0 8.01% [intr{irq272: > igb1:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 1=C2=A0 59:32=C2=A0 7.96% [intr{irq270: > igb1:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 3=C2=A0 55:47=C2=A0 7.81% [intr{irq267: > igb0:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 0=C2=A0 55:24=C2=A0 7.23% [intr{irq264: > igb0:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 0=C2=A0 56:57=C2=A0 6.69% [intr{irq269: > igb1:que}] > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 3 203:34=C2=A0 4.74% [intr{irq275: > em1:rx 0}] > 0 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 0=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0336K -=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A02 427:03=C2=A0 2.64% > [kernel{dummynet}] > 0 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 0=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0336K -=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A03 206:57=C2=A0 2.54% [kernel{em0 > que}] > 86278 root=C2=A0 =C2=A0 =C2=A0 20=C2=A0 =C2=A0 0 33348K=C2=A0 8588K select=C2=A0 0=C2=A0=C2=A0=C2=A08:35=C2=A0 0.54% > /usr/local/sbin/snmpd -p /var/run/net_snmpd.pid -r > 12 root=C2=A0 =C2=A0=C2=A0=C2=A0-92=C2=A0 =C2=A0 -=C2=A0 =C2=A0=C2=A0=C2=A00K=C2=A0=C2=A0=C2=A0448K WAIT=C2=A0 =C2=A0 2=C2=A0=C2=A0=C2=A07:56=C2=A0 0.20% [intr{irq276: > em1:tx 0}] > > # cat /etc/sysctl.conf > dev.igb.0.rx_processing_limit=3D4096 > dev.igb.1.rx_processing_limit=3D4096 > dev.em.0.rx_int_delay=3D200 > dev.em.0.tx_int_delay=3D200 > dev.em.0.rx_abs_int_delay=3D4000 > dev.em.0.tx_abs_int_delay=3D4000 > dev.em.0.rx_processing_limit=3D4096 > dev.em.1.rx_int_delay=3D200 > dev.em.1.tx_int_delay=3D200 > dev.em.1.rx_abs_int_delay=3D4000 > dev.em.1.tx_abs_int_delay=3D4000 > dev.em.1.rx_processing_limit=3D4096 > net.inet.ip.forwarding=3D1 > net.inet.ip.fastforwarding=3D1 > net.inet.tcp.blackhole=3D2 > net.inet.udp.blackhole=3D0 > net.inet.ip.redirect=3D0 > net.inet.tcp.delayed_ack=3D0 > net.inet.tcp.recvbuf_max=3D4194304 > net.inet.tcp.sendbuf_max=3D4194304 > net.inet.tcp.sack.enable=3D0 > net.inet.tcp.drop_synfin=3D1 > net.inet.tcp.nolocaltimewait=3D1 > net.inet.ip.ttl=3D255 > net.inet.ip.sourceroute=3D0 > net.inet.ip.accept_sourceroute=3D0 > net.inet.udp.recvspace=3D64080 > net.inet.ip.rtmaxcache=3D1024 > net.inet.ip.intr_queue_maxlen=3D5120 > kern.ipc.nmbclusters=3D824288 > kern.ipc.maxsockbuf=3D83886080 > kern.ipc.maxsockets=3D102400 > net.inet.tcp.recvspace=3D95536 > net.inet.tcp.sendspace=3D95536 > net.local.stream.recvspace=3D32768 > net.local.stream.sendspace=3D32768 > kern.ipc.somaxconn=3D32768 > net.inet.tcp.maxtcptw=3D65535 > net.inet.ip.fw.one_pass=3D1 > net.inet.ip.fw.dyn_max=3D65535 > net.inet.ip.fw.dyn_buckets=3D2048 > net.inet.ip.fw.dyn_syn_lifetime=3D10 > net.inet.ip.fw.dyn_ack_lifetime=3D120 > net.inet.ip.fw.verbose=3D0 > net.inet.ip.dummynet.io_fast=3D1 > net.inet.ip.dummynet.hash_size=3D65536 > net.inet.ip.dummynet.pipe_slot_limit=3D1000 > net.inet.icmp.icmplim=3D3000 > net.inet.icmp.drop_redirect=3D1 > net.inet.icmp.log_redirect=3D0 > net.inet.icmp.bmcastecho=3D0 > net.inet.icmp.maskrepl=3D0 > kern.random.sys.harvest.ethernet=3D0 > kern.random.sys.harvest.point_to_point=3D0 > kern.random.sys.harvest.interrupt=3D0 > net.inet.raw.maxdgram=3D16384 > net.inet.raw.recvspace=3D16384 > net.route.netisr_maxqlen=3D8192 > net.inet.ip.intr_queue_maxlen=3D10240 > net.isr.dispatch=3Ddeferred > > # cat /boot/loader.conf > loader_logo=3D"beastie" > autoboot_delay=3D3 > geom_mirror_load=3D"YES" > hw.igb.rxd=3D4096 > hw.igb.txd=3D4096 > hw.igb.rx_process_limit=3D4096 > hw.igb.max_interrupt_rate=3D32000 > hw.igb.num_queues=3D4 > hw.igb.fc_setting=3D0 > hw.igb.lro=3D0 > hw.em.rxd=3D4096 > hw.em.txd=3D4096 > hw.em.rx_process_limit=3D4096 > hw.em.fc_setting=3D0 > dev.em.0.rx_int_delay=3D200 > dev.em.0.tx_int_delay=3D200 > dev.em.0.rx_abs_int_delay=3D4000 > dev.em.0.tx_abs_int_delay=3D4000 > dev.em.1.rx_int_delay=3D200 > dev.em.1.tx_int_delay=3D200 > dev.em.1.rx_abs_int_delay=3D4000 > dev.em.1.tx_abs_int_delay=3D4000 > net.isr.maxthreads=3D4 > net.isr.bindthreads=3D0 > net.inet.tcp.tcbhashsize=3D32000 > net.link.ifqmaxlen=3D10240 > net.isr.defaultqlimit=3D8192 > > # vmstat -i > interrupt=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 total=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0rate > irq20: ehci1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A04171628=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 2 > irq21: atapci0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A01561194=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 > irq22: ehci0+=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 2713150=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 1 > cpu0:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A014622957598=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A08082 > irq264: igb0:que 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0515616328=C2=A0 =C2=A0 =C2=A0 =C2=A0 284 > irq265: igb0:que 1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0738456087=C2=A0 =C2=A0 =C2=A0 =C2=A0 408 > irq266: igb0:que 2=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0711371660=C2=A0 =C2=A0 =C2=A0 =C2=A0 393 > irq267: igb0:que 3=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0462738813=C2=A0 =C2=A0 =C2=A0 =C2=A0 255 > irq268: igb0:link=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 3=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 > irq269: igb1:que 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0656044816=C2=A0 =C2=A0 =C2=A0 =C2=A0 362 > irq270: igb1:que 1=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0546931002=C2=A0 =C2=A0 =C2=A0 =C2=A0 302 > irq271: igb1:que 2=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0617173223=C2=A0 =C2=A0 =C2=A0 =C2=A0 341 > irq272: igb1:que 3=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0644295672=C2=A0 =C2=A0 =C2=A0 =C2=A0 356 > irq273: igb1:link=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 4=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 > irq274: em0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 557400132=C2=A0 =C2=A0 =C2=A0 =C2=A0 308 > irq275: em1:rx 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0424252744=C2=A0 =C2=A0 =C2=A0 =C2=A0 234 > irq276: em1:tx 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0708469817=C2=A0 =C2=A0 =C2=A0 =C2=A0 391 > irq277: em1:link=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A02=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0 > cpu3:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0678408141=C2=A0 =C2=A0 =C2=A0 =C2=A0 374 > cpu1:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0674674076=C2=A0 =C2=A0 =C2=A0 =C2=A0 372 > cpu2:timer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0621495291=C2=A0 =C2=A0 =C2=A0 =C2=A0 343 > Total=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 23188731381=C2=A0 =C2=A0 =C2=A0 12816 > > # netstat -w1 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 (Total)=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0 bytes colls > 442k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0304M=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0457k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0393M=C2=A0 =C2=A0=C2=A0=C2=A00 > 449k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0308M=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0463k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0395M=C2=A0 =C2=A0=C2=A0=C2=A00 > 445k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0304M=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0461k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0393M=C2=A0 =C2=A0=C2=A0=C2=A00 > 439k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0303M=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0456k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0393M=C2=A0 =C2=A0=C2=A0=C2=A00 > 434k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0297M=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0450k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0387M=C2=A0 =C2=A0=C2=A0=C2=A00 > 440k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0301M=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0456k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0392M=C2=A0 =C2=A0=C2=A0=C2=A00 > 438k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0300M=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0455k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0391M=C2=A0 =C2=A0=C2=A0=C2=A00 > > # ifconfig lagg0=C2=A0=C2=A0=C2=A0(internal, 500 VLAN's) > lagg0: flags=3D8843 metric 0 mtu > 1500 > options=3D401bb > ether a0:36:9f:16:d0:9c > media: Ethernet autoselect > status: active > laggproto lacp lagghash l2,l3,l4 > laggport: igb1 flags=3D1c > laggport: igb0 flags=3D1c > > # ifconfig lagg1=C2=A0 =C2=A0 - (external, NAT) > lagg1: flags=3D8843 metric 0 mtu > 1500 > options=3D4209b > ether 00:1e:67:59:ea:89 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.14 netmask= 0xffffffe0 broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.31 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.70 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.70 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.71 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.71 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.72 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.72 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.73 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.73 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.74 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.74 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.75 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.75 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.76 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.76 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.77 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.77 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.78 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.78 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.79 netmask= 0xffffffff broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.79 > inet =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.33 netmask= 0xfffffff0 broadcast > =D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.=D0=A5=D0=A5=D0=A5.47 > media: Ethernet autoselect > status: active > laggproto lacp lagghash l2,l3,l4 > laggport: em1 flags=3D1c > laggport: em0 flags=3D1c > > # netstat -w1 -I em0 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (em0)=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0 bytes colls > 101k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0111M=C2=A0 =C2=A0 =C2=A0 =C2=A0 36k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0 =C2=A0=C2=A0=C2=A00 > 101k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0 =C2=A0 =C2=A0 36k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0 =C2=A0=C2=A0=C2=A00 > 100k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0 =C2=A0 =C2=A0 37k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0 =C2=A0=C2=A0=C2=A00 > > # netstat -w1 -I em1 > [code]=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 input=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 (em1)=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0 bytes colls > 100k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0111M=C2=A0 =C2=A0 =C2=A0 =C2=A0 37k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A09.1M=C2=A0 =C2=A0=C2=A0=C2=A00 > 102k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0 =C2=A0 =C2=A0 39k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 10M=C2=A0 =C2=A0=C2=A0=C2=A00 > 91k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0101M=C2=A0 =C2=A0 =C2=A0 =C2=A0 38k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A09.7M=C2=A0 =C2=A0=C2=A0=C2=A00 > > # netstat -w1 -I igb0 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0(igb0)=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0 bytes colls > 39k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A09.1M=C2=A0 =C2=A0 =C2=A0 =C2=A0 51k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 57M=C2=A0 =C2=A0=C2=A0=C2=A00 > 38k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A09.1M=C2=A0 =C2=A0 =C2=A0 =C2=A0 49k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 54M=C2=A0 =C2=A0=C2=A0=C2=A00 > 39k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A09.4M=C2=A0 =C2=A0 =C2=A0 =C2=A0 51k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 56M=C2=A0 =C2=A0=C2=A0=C2=A00 > > # netstat -w1 -I igb1 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0(igb1)=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0 bytes colls > 36k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 14M=C2=A0 =C2=A0 =C2=A0 =C2=A0 48k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 56M=C2=A0 =C2=A0=C2=A0=C2=A00 > 35k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 14M=C2=A0 =C2=A0 =C2=A0 =C2=A0 50k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 59M=C2=A0 =C2=A0=C2=A0=C2=A00 > 34k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 13M=C2=A0 =C2=A0 =C2=A0 =C2=A0 48k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 57M=C2=A0 =C2=A0=C2=A0=C2=A00 > > # netstat -w1 -I lagg0 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 (lagg0)=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0 bytes colls > 75k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 23M=C2=A0 =C2=A0 =C2=A0 =C2=A0 98k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0=C2=A0=C2=A00 > 73k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 21M=C2=A0 =C2=A0 =C2=A0 =C2=A0 98k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0=C2=A0=C2=A00 > 73k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 23M=C2=A0 =C2=A0 =C2=A0 =C2=A0 98k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0=C2=A0=C2=A00 > > # netstat -w1 -I lagg1 > input=C2=A0 =C2=A0 =C2=A0 =C2=A0 (lagg1)=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0output > packets=C2=A0 errs idrops=C2=A0 =C2=A0 =C2=A0 bytes=C2=A0 =C2=A0 packets=C2=A0 errs=C2=A0 =C2=A0 =C2=A0 bytes colls > 100k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0112M=C2=A0 =C2=A0 =C2=A0 =C2=A0 74k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 24M=C2=A0 =C2=A0=C2=A0=C2=A00 > 101k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0113M=C2=A0 =C2=A0 =C2=A0 =C2=A0 73k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 24M=C2=A0 =C2=A0=C2=A0=C2=A00 > 102k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0=C2=A0=C2=A0114M=C2=A0 =C2=A0 =C2=A0 =C2=A0 74k=C2=A0 =C2=A0=C2=A0=C2=A00=C2=A0 =C2=A0 =C2=A0 =C2=A0 24M=C2=A0 =C2=A0=C2=A0=C2=A00 > >> > _______________________________________________ >=C2=A0=C2=A0=C2=A0freebsd-net@freebsd.org=C2=A0=C2=A0=C2=A0mailing list >=C2=A0=C2=A0=C2=A0http://lists.freebsd.org/mailman/listinfo/freebsd-net= =C2=A0 > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" _______________________________________________=C2=A0 freebsd-net@freebsd.= org=C2=A0=C2=A0=C2=A0mailing list=C2=A0 http://lists.freebsd.org/mailman/listinfo/freebsd-net=C2=A0 To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" _______________________________________________ freebsd-net@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-net To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"