From owner-freebsd-performance@FreeBSD.ORG Tue Apr 3 06:55:16 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2FC7016A401 for ; Tue, 3 Apr 2007 06:55:16 +0000 (UTC) (envelope-from teklimbu@wlink.com.np) Received: from smtp5.wlink.com.np (smtp5.wlink.com.np [202.79.32.52]) by mx1.freebsd.org (Postfix) with SMTP id 9D72D13C45E for ; Tue, 3 Apr 2007 06:55:05 +0000 (UTC) (envelope-from teklimbu@wlink.com.np) Received: (qmail 86888 invoked from network); 3 Apr 2007 06:55:02 -0000 Received: from unknown (HELO smtp8.wlink.com.np) (202.79.32.38) by 0 with SMTP; 3 Apr 2007 06:55:02 -0000 Received: (qmail 64277 invoked by uid 98); 3 Apr 2007 06:55:02 -0000 Received: from 202.79.32.77 by smtp8.wlink.com.np (envelope-from , uid 1004) with qmail-scanner-1.25 (clamdscan: 0.88.4/1879. Clear:RC:1(202.79.32.77):. Processed in 0.047511 secs); 03 Apr 2007 06:55:02 -0000 X-Qmail-Scanner-Mail-From: teklimbu@wlink.com.np via smtp8.wlink.com.np X-Qmail-Scanner: 1.25 (Clear:RC:1(202.79.32.77):. Processed in 0.047511 secs) Received: from smtp2.wlink.com.np (202.79.32.77) by smtp8.wlink.com.np with SMTP; 3 Apr 2007 06:55:01 -0000 Received: (qmail 29094 invoked by uid 516); 3 Apr 2007 06:55:00 -0000 Received: from [202.79.36.216] (HELO teklimbu.wlink.com.np) by smtp2.wlink.com.np (qmail-smtpd) with SMTP; 03 Apr 2007 06:54:55 -0000 (Tue, 03 Apr 2007 12:39:55 +0545) Received: from teklimbu.wlink.com.np ([202.79.36.216]) by teklimbu.wlink.com.np with smtp (Exim 4.66) (envelope-from ) id 1HYcuk-000DjQ-KC; Tue, 03 Apr 2007 12:39:46 +0545 Date: Tue, 3 Apr 2007 12:39:41 +0545 From: Tek Bahadur Limbu To: "Alessandro" Message-Id: <20070403123941.80d9a3e9.teklimbu@wlink.com.np> In-Reply-To: <000c01c774f3$0ac90690$05010b0a@elitel> References: <000c01c774f3$0ac90690$05010b0a@elitel> Organization: Worldlink Communications Pvt. Ltd. X-Mailer: Sylpheed version 2.2.0 (GTK+ 2.8.12; i386-portbld-freebsd6.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spam-Check-By: smtp2.wlink.com.np Spam: No ; 0.2 / 7.0 X-Spam-Status-WL: No, hits=0.2 required=7.0 Cc: freebsd-performance@freebsd.org Subject: Re: FreeBSD-6.1 reboots due to high mbufs X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 03 Apr 2007 06:55:16 -0000 -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Mon, 2 Apr 2007 08:49:17 +0200 "Alessandro" wrote: > Hi, > > I think the tcp connections remain in ESTABLISHED for a long time, it can depend from satellite link (high delay) or a problem with TCP timing in 6.1. (The hardware configurations is the same of 4.x box?) The hardware configurations are different boxes. Hardware running 4.x are assembled Pentium 4 PCs having 1 GB Ram. Hardware running 6.x are more powerful Dell 420/430 servers! > > First of all you can try to set: > sysctl net.inet.tcp.inflight.enable=0 > and then: > sysctl net.isr.direct=0 > sysctl net.inet.tcp.slowstart_flightsize=4 or more I have set the above sysctl values as according but will have to wait for another 24 hours before reporting. > > > Can you upgrade FreeBSD? Well since this is a production server, I'm afraid that it might not be a possible option to upgrade to 6.2. > Can you run a "systat -vm 1" and "top"? Output: systat -vm 1: 1 users Load 0.08 0.13 0.09 Apr 3 12:31 Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER Tot Share Tot Share Free in out in out Act 353440 7068 377324 13080 97488 count All 1874660 7396 82692924 13636 pages Interrupts Proc:r p d s w Csw Trp Sys Int Sof Flt cow 5903 total 3 27 1 7711 67513149 4269 44 166792 wire 14: ata 353216 act 1770 17: bge 3.0%Sys 2.2%Intr 0.4%User 0.0%Nice 94.4%Idl 1270252 inact 118 20: ata | | | | | | | | | | 87400 cache 2004 cpu0: time =++ 10088 free 2011 cpu1: time daefr Namei Name-cache Dir-cache prcfr Calls hits % hits % react 60 46 77 pdwake zfod pdpgs Disks ad4 ozfod intrn KB/t 16.07 %slo-z 218432 buf tps 117 35 tfree 380 dirtybuf MB/s 1.84 100000 desiredvnodes % busy 16 59061 numvnodes 20049 freevnodes Output: Top: last pid: 30668; load averages: 0.09, 0.13, 0.09 up 0+17:07:43 12:32:33 32 processes: 1 running, 30 sleeping, 1 lock CPU states: 1.3% user, 0.0% nice, 0.9% system, 2.1% interrupt, 95.7% idle Mem: 345M Active, 1241M Inact, 163M Wired, 85M Cache, 213M Buf, 8716K Free Swap: 4096M Total, 4096M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 625 squid 1 96 0 319M 314M *Giant 0 19:46 4.59% squid 8171 root 1 96 0 28268K 11368K select 0 0:42 0.00% snmpd 685 squid 1 -4 0 5160K 1248K msgwai 0 0:34 0.00% diskd-daemon 686 squid 1 -4 0 5160K 1236K msgwai 0 0:31 0.00% diskd-daemon 28155 bind 1 96 0 12164K 8544K select 0 0:10 0.00% named 406 root 1 96 0 3540K 1008K select 0 0:02 0.00% syslogd 1117 tek 1 96 0 29932K 3424K select 0 0:01 0.00% sshd 1271 root 1 8 0 7812K 2152K wait 1 0:00 0.00% bash 614 root 1 8 0 3560K 1092K nanslp 0 0:00 0.00% cron 6766 root 1 8 0 7776K 2104K wait 0 0:00 0.00% bash 584 root 1 96 0 2420K 836K select 0 0:00 0.00% usbd 485 root 1 96 0 4636K 1080K select 0 0:00 0.00% rpcbind 1114 root 1 4 0 29364K 2860K sbwait 0 0:00 0.00% sshd 1118 tek 1 8 0 7756K 2064K wait 0 0:00 0.00% bash 1268 root 1 20 0 9176K 2492K pause 0 0:00 0.00% csh 6763 root 1 20 0 9220K 2540K pause 1 0:00 0.00% csh 684 squid 1 -8 0 2376K 684K piperd 0 0:00 0.00% unlinkd > If you run netstat -in no errors are report? root@server# netstat -in Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll bge0 1500 00:15:73:27:e8:07 28138850 0 26560747 0 0 bge0 1500 202.xx.xx 202.xx.xx.xx 16381694 - 26516294 - - bge0 1500 202.xxx.xxx.x 202.xxx.xxx.xx 2 - 43071 - - lo0 16384 147155 0 147155 0 0 lo0 16384 127 127.0.0.1 147155 - 147155 - - > > If there are a lot of connections a lot of nmbclusters are used, you can run > "netstat -na | grep ESTAB | wc -l". 3 CLOSE_WAIT 16 CLOSING 1498 ESTABLISHED 547 FIN_WAIT_1 571 FIN_WAIT_2 17 LAST_ACK 6 LISTEN 56 SYN_SENT 241 TIME_WAIT 1 been > The number of nmbcluster used is related with the number of connections. Yes, I understand the relation between nmbcluters and the no. of connections. Thanks alot for your feedback and suggestions. > > Let me know. > Regards > Alessandro > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > - -- With best regards and good wishes, Yours sincerely, Tek Bahadur Limbu (TAG/TDG Group) Jwl Systems Department Worldlink Communications Pvt. Ltd. Jawalakhel, Nepal http://www.wlink.com.np -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2.2 (FreeBSD) iD8DBQFGEfoxVrOl+eVhOvYRAkfAAJ9q/UW7zsNO/a5NQ7SaLjFHqcFU9QCfcVXN 5Kf0Wutt5R6G19pBy5bSNkQ= =X1c7 -----END PGP SIGNATURE-----