From owner-freebsd-performance@FreeBSD.ORG Tue Feb 13 10:21:00 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E04FB16A406 for ; Tue, 13 Feb 2007 10:21:00 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: from sed.awknet.com (sed.awknet.com [66.152.175.11]) by mx1.freebsd.org (Postfix) with ESMTP id C4B0C13C474 for ; Tue, 13 Feb 2007 10:21:00 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: by sed.awknet.com (Postfix, from userid 58) id 8F6B110BBE5B; Tue, 13 Feb 2007 02:21:00 -0800 (PST) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on sed.awknet.com X-Spam-Level: X-Spam-Status: No, score=1.0 required=5.0 tests=AWL,BAYES_50 autolearn=disabled version=3.1.3 Received: from [192.168.1.101] (cpe-76-167-105-254.socal.res.rr.com [76.167.105.254]) by sed.awknet.com (Postfix) with ESMTP id 55A4110BBD3F; Tue, 13 Feb 2007 02:20:58 -0800 (PST) Message-ID: <45D19104.5010902@sk1llz.net> Date: Tue, 13 Feb 2007 02:20:52 -0800 From: Justin Robertson User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: garcol@postino.it, freebsd-performance@freebsd.org References: <20070207120426.CDEFC16A407@hub.freebsd.org> <1170929927.45caf9080183d@www.postino.punto.it> In-Reply-To: <1170929927.45caf9080183d@www.postino.punto.it> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2007 10:21:01 -0000 Clockrate is based off of my device_polling setup, which is configured to 4000. burst_max has a hard limit, can't go higher than it already is at 1000 Could I get an explanation as to what the queue and isr sysctl values are actually doing? I'll be able to run some more basic tests tomorrow to see some results, but want to wrap my head around what's actually logically meant to be happening based on adjustments, etc. [I suspect this'll do nothing for the UDP issue, but at least I might be able to pipe some TCP traffic] garcol@postino.it wrote: > Hi, > I think you can try to check/tuning this sysctl variables and the isr > related variables: > > net.inet.ip.intr_queue_maxlen > net.inet.ip.intr_queue_drops > > net.isr.enable ... try to set > net.isr.directed > net.isr.queued > net.isr.drop > > and polling configuration: > > kern.clockrate > > kern.polling.burst_max > .... increase for high rate of small packets on GE > .... > > Alessandro > > > > > >> Date: Wed, 07 Feb 2007 01:37:00 -0800 >> From: Justin Robertson >> Subject: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues >> To: freebsd-performance@freebsd.org >> Message-ID: <45C99DBC.1050402@sk1llz.net> >> Content-Type: text/plain; charset=ISO-8859-1; format=flowed >> >> It was suggested I post this to freebsd-performance, it's already in >> questions, isp, and net. >> >> I've been running some tests with using FreeBSD to filter and rate limit >> traffic. My first thoughts were to goto the latest stable release, which >> was 6.1 at the time. I've since done the same test under 6.2 and haven't >> seen any difference. I later migrated to running 4.11 to get away from >> these issues, but have discovered others. >> >> I've tested on an AMD 3200+ system with dual Intel 1000 series NICs, an >> AMD Opteron 165 with the same, and a Xeon 2.8 with the same. I've used >> both stock and intel drivers. >> >> 6.x; >> Normal traffic isn't a problem. The second you get into the realm of >> abusive traffic, such a DoS/DDoS (over 100mbps) UDP floods the machine >> falls over. Little packets with ip lengths of 28-29 bytes seem to do the >> most damage. I've tried playing with various sysctl values and have seen >> no difference at all. By "falls over" I mean "stops sending all traffic >> in any direction". TCP syn packets have the same effect, tho not quite >> as rapidly (200~230mbps). I then tried moving filtering off to a >> transparent bridge. This improved the situation somewhat, but an extra >> 30-40mbps of UDP data and it would ultimately crumble. Overall the >> machine would be able to move between 300k-600k PPS before becoming a >> cripple, depending on packet length, protocol, and any flags. Without a >> specific pf or ipfw rule to deal with a packet the box would fall over, >> with specific block rules it would manage an extra 30-40mbps and then >> fall over. >> >> 4.11; >> Again, normal traffic isn't a problem. When routing & filtering on the >> same system some of the problems found in 6.x are still apparent, but to >> a lesser degree. Splitting the task into a transparent filtering bridge >> with a separate routing box appears to clear it up entirely. UDP floods >> are much better handled - an ipfw block rule for the packet type and the >> machine responds as if there were no flood at all (until total bandwidth >> saturation or PPS limits of the hardware, which in this case was around >> 950Mbps). TCP syn attacks are also better handled, again a block rule >> makes it seem as if there were no attack at all. The system also appears >> to be able to move 800-900k PPS of any one protocol at a time. However, >> the second you try and queue abusive traffic the machine will fall over. >> Inbound floods appear to cause ALL inbound traffic to lag horrifically >> (while rate limiting/piping), which inherently causes a lot of outbound >> loss due to broken TCP. Now, I'm not sure if this is something to do >> with dummynet being horribly inefficient, or if there's some sysctl >> value to deal with inbound that I'm missing. >> >> I suppose my concerns are two-fold. Why is 6.x collapsing under traffic >> that 4.11 could easily block and run merrily along with, and is there a >> queueing mechanism in place that doesn't tie up the box so much on >> inbound flows that it ignores all other relevant traffic? >> >> (as a note, all tests were done with device polling enabled. Without it >> systems fall over pretty quickly. I also tried tests using 3com cards >> and had the same results) >> >> >> In the event anybody is looking for basic errors, device polling is >> enabled and running at 4000 hz, which has proved to net the highest >> thruput in PPS. ADAPTIVE_GIANT is on (tests resulted in better pps >> thruput), all the other monitoring features are disabled, and here are >> my sysctl modifications related to networking (if there's something >> glaring let me know!); >> >> kern.polling.enable=1 >> kern.polling.burst_max=1000 >> kern.polling.each_burst=80 >> kern.polling.idle_poll=1 >> kern.polling.user_frac=20 >> kern.polling.reg_frac=50 >> net.inet.tcp.recvspace=262144 >> net.inet.tcp.sendspace=262144 >> kern.ipc.maxsockbuf=1048576 >> net.inet.tcp.always_keepalive=1 >> net.inet.ip.portrange.first=10000 >> kern.ipc.somaxconn=65535 >> net.inet.tcp.blackhole=2 >> net.inet.udp.blackhole=1 >> net.inet.icmp.icmplim=30 >> net.inet.ip.forwarding=1 >> net.inet.ip.portrange.randomized=0 >> net.inet.udp.checksum=0 >> net.inet.udp.recvspace=8192 (I've tried large and small, thinking >> perhaps I was fulling up buffers on udp floods and then causing it to >> drop tcp, there appears to be no difference) >> net.inet.ip.intr_queue_maxlen=512 >> net.inet.tcp.delayed_ack=0 >> net.inet.tcp.rfc1323=1 >> net.inet.tcp.newreno=0 (I'd try this, but, the biggest problem is still >> with UDP, and I'd prefer something compatible with everything for now) >> net.inet.tcp.delacktime=10 >> net.inet.tcp.msl=2500 >> net.inet.ip.rtmaxcache=1024 >> net.inet.raw.recvspace=262144 >> net.inet.ip.dummynet.hash_size=512 >> net.inet.ip.fw.dyn_ack_lifetime=30 >> net.inet.ip.fw.dyn_syn_lifetime=10 >> net.inet.ip.fw.dyn_fin_lifetime=10 >> net.inet.ip.fw.dyn_max=16192 >> net.link.ether.bridge.enable=0 (or 1 on when setup to bridge, obviously) >> net.inet.ip.fastforwarding=1 >> >> It has also been pointed out that using net.link.ether.ipfw=1 should >> negate the need for a transparent box, however the performance disparity >> between 6.x and 4.11 remains. >> >> > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > > From owner-freebsd-performance@FreeBSD.ORG Tue Feb 13 13:35:52 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9191216A402 for ; Tue, 13 Feb 2007 13:35:52 +0000 (UTC) (envelope-from radek@ceskedomeny.cz) Received: from margaret.starnet.cz (margaret.starnet.cz [62.240.182.134]) by mx1.freebsd.org (Postfix) with SMTP id AA1F313C47E for ; Tue, 13 Feb 2007 13:35:51 +0000 (UTC) (envelope-from radek@ceskedomeny.cz) Received: (qmail 80156 invoked from network); 13 Feb 2007 14:09:07 +0100 Received: from 192.168.255.2 by margaret.starnet.cz (envelope-from , uid 82) with qmail-scanner-1.25 (clamdscan: 0.86.2/1084. spamassassin: 3.1.0. Clear:RC:1(192.168.255.2):. Processed in 0.072934 secs); 13 Feb 2007 13:09:07 -0000 X-Qmail-Scanner-Mail-From: radek@ceskedomeny.cz via margaret.starnet.cz X-Qmail-Scanner: 1.25 (Clear:RC:1(192.168.255.2):. Processed in 0.072934 secs) Received: from unknown (HELO localhost) (192.168.255.2) by margaret.starnet.cz with SMTP; 13 Feb 2007 14:09:06 +0100 Date: Tue, 13 Feb 2007 14:09:01 +0100 From: "Bc. Radek Krejca" Organization: STARNET, s. r. o. X-Priority: 3 (Normal) Message-ID: <168965126.20070213140901@starnet.cz> To: freebsd-performance@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: How to increase traffic X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "Bc. Radek Krejca" List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2007 13:35:52 -0000 Hi, I have HP ProLiant DL360-G4 with one Xeon procesor. I compile new kernel based on Generic but I have big problem with perfomance. I got from my line only about 130 Mbit, then my cpu is working on 100%. I tried set up polling but without success because after polling startup I got only 90 Mbit from my line. I have following config for kernel: http://www.krejca.info/kernel.txt And this sysctl variables (but now I have polling switched off). net.inet.tcp.blackhole=3D1 net.inet.icmp.log_redirect=3D1 net.inet.icmp.drop_redirect=3D1 net.inet.ip.fastforwarding=3D1 net.inet.tcp.sendspace=3D65536 I need about 400 Mbit, this computer is a gateway with pf and nat. Network adapters are broadcom - bge. Thank you I send more info if it will be needed. Radek --=20 Regards, Bc. Radek Krejca ICQ: 65895541=20 From owner-freebsd-performance@FreeBSD.ORG Tue Feb 13 13:44:14 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 38F6216A407 for ; Tue, 13 Feb 2007 13:44:14 +0000 (UTC) (envelope-from dom@helenmarks.co.uk) Received: from mailhost.graphdata.co.uk (mailhost.graphdata.co.uk [195.12.22.194]) by mx1.freebsd.org (Postfix) with ESMTP id F165C13C46B for ; Tue, 13 Feb 2007 13:44:13 +0000 (UTC) (envelope-from dom@helenmarks.co.uk) Received: from localhost (localhost [127.0.0.1]) by mailhost.graphdata.co.uk (Postfix) with ESMTP id B4E16114023 for ; Tue, 13 Feb 2007 13:44:12 +0000 (GMT) X-Virus-Scanned: amavisd-new at graphdata.co.uk Received: from mailhost.graphdata.co.uk ([127.0.0.1]) by localhost (mailhost.graphdata.co.uk [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id ySN5ndeIr0Yp for ; Tue, 13 Feb 2007 13:44:07 +0000 (GMT) Received: from gdc083.internal.graphdata.co.uk (gdc083.internal.graphdata.co.uk [192.168.0.86]) by mailhost.graphdata.co.uk (Postfix) with SMTP id 4A24911401E for ; Tue, 13 Feb 2007 13:44:07 +0000 (GMT) Date: Tue, 13 Feb 2007 13:44:06 +0000 From: Dominic Marks To: freebsd-performance@freebsd.org Message-Id: <20070213134406.1c5ba9be.dom@helenmarks.co.uk> In-Reply-To: <168965126.20070213140901@starnet.cz> References: <168965126.20070213140901@starnet.cz> X-Mailer: Sylpheed 2.3.1 (GTK+ 2.10.6; i386-portbld-freebsd6.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: How to increase traffic X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2007 13:44:14 -0000 On Tue, 13 Feb 2007 14:09:01 +0100 "Bc. Radek Krejca" wrote: > Hi, > > I have HP ProLiant DL360-G4 with one Xeon procesor. I compile new > kernel based on Generic but I have big problem with perfomance. > > I got from my line only about 130 Mbit, then my cpu is working on > 100%. I tried set up polling but without success because after > polling startup I got only 90 Mbit from my line. What values for HZ did you try with polling? > I have following config for kernel: > http://www.krejca.info/kernel.txt > > And this sysctl variables (but now I have polling switched off). > > net.inet.tcp.blackhole=1 > net.inet.icmp.log_redirect=1 > net.inet.icmp.drop_redirect=1 > > net.inet.ip.fastforwarding=1 > net.inet.tcp.sendspace=65536 > > I need about 400 Mbit, this computer is a gateway with pf and nat. > Network adapters are broadcom - bge. > > Thank you I send more info if it will be needed. > > Radek > > -- > Regards, > Bc. Radek Krejca > ICQ: 65895541 > > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Tue Feb 13 14:49:38 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C547B16A402 for ; Tue, 13 Feb 2007 14:49:38 +0000 (UTC) (envelope-from radek@ceskedomeny.cz) Received: from margaret.starnet.cz (margaret.starnet.cz [62.240.182.134]) by mx1.freebsd.org (Postfix) with SMTP id 0C0A513C441 for ; Tue, 13 Feb 2007 14:49:37 +0000 (UTC) (envelope-from radek@ceskedomeny.cz) Received: (qmail 48208 invoked from network); 13 Feb 2007 15:49:31 +0100 Received: from 192.168.255.2 by margaret.starnet.cz (envelope-from , uid 82) with qmail-scanner-1.25 (clamdscan: 0.86.2/1084. spamassassin: 3.1.0. Clear:RC:1(192.168.255.2):. Processed in 0.168165 secs); 13 Feb 2007 14:49:31 -0000 X-Qmail-Scanner-Mail-From: radek@ceskedomeny.cz via margaret.starnet.cz X-Qmail-Scanner: 1.25 (Clear:RC:1(192.168.255.2):. Processed in 0.168165 secs) Received: from unknown (HELO localhost) (192.168.255.2) by margaret.starnet.cz with SMTP; 13 Feb 2007 15:49:29 +0100 Date: Tue, 13 Feb 2007 15:49:22 +0100 From: "Bc. Radek Krejca" Organization: STARNET, s. r. o. X-Priority: 3 (Normal) Message-ID: <11510656265.20070213154922@starnet.cz> To: freebsd-performance@freebsd.org In-Reply-To: <20070213134406.1c5ba9be.dom@helenmarks.co.uk> References: <168965126.20070213140901@starnet.cz> <20070213134406.1c5ba9be.dom@helenmarks.co.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Re[2]: How to increase traffic X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: "Bc. Radek Krejca" List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2007 14:49:38 -0000 Hi, DM> What values for HZ did you try with polling? HZ=3D1000 --=20 S pozdravem, Bc. Radek Krejca ICQ: 65895541 From owner-freebsd-performance@FreeBSD.ORG Tue Feb 13 15:45:51 2007 Return-Path: X-Original-To: freebsd-performance@FreeBSD.ORG Delivered-To: freebsd-performance@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6025816A400 for ; Tue, 13 Feb 2007 15:45:51 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (lurza.secnetix.de [83.120.8.8]) by mx1.freebsd.org (Postfix) with ESMTP id C58BC13C4AC for ; Tue, 13 Feb 2007 15:45:50 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (ajchob@localhost [127.0.0.1]) by lurza.secnetix.de (8.13.4/8.13.4) with ESMTP id l1DFNkMT083587; Tue, 13 Feb 2007 16:23:51 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.13.4/8.13.1/Submit) id l1DFNkSl083586; Tue, 13 Feb 2007 16:23:46 +0100 (CET) (envelope-from olli) Date: Tue, 13 Feb 2007 16:23:46 +0100 (CET) Message-Id: <200702131523.l1DFNkSl083586@lurza.secnetix.de> From: Oliver Fromme To: freebsd-performance@FreeBSD.ORG, "Bc. Radek Krejca" In-Reply-To: <168965126.20070213140901@starnet.cz> X-Newsgroups: list.freebsd-performance User-Agent: tin/1.8.2-20060425 ("Shillay") (UNIX) (FreeBSD/4.11-STABLE (i386)) MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Tue, 13 Feb 2007 16:23:51 +0100 (CET) Cc: Subject: Re: How to increase traffic X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: freebsd-performance@FreeBSD.ORG, "Bc. Radek Krejca" List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Feb 2007 15:45:51 -0000 Bc. Radek Krejca wrote: > I have HP ProLiant DL360-G4 with one Xeon procesor. I compile new > kernel based on Generic but I have big problem with perfomance. > > I got from my line only about 130 Mbit, then my cpu is working on > 100%. I tried set up polling but without success because after > polling startup I got only 90 Mbit from my line. Polling doesn't necessarily increase the throughput. The main purpose of polling is to improve the interactive performance under high network load. Anyway, your machine should be able to handle much more than 130 Mbit, so there seems to be something wrong. What exactly runs on that machine? Any services, or is it only a pure router or firewall? Do you have a packet filter enabled, and if so, how many rules do you have configured? You said that the CPU is at 100% when you have 130 Mbit network traffic. How do those 100% distribute across system, interrupt and user? A few lines output from the command "vmstat 5" might be helpful. > net.inet.tcp.sendspace=65536 I don't think that changing that value buys you anything. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, Geschäftsfuehrung: secnetix Verwaltungsgesellsch. mbH, Handelsregister: Registergericht Mün- chen, HRB 125758, Geschäftsführer: Maik Bachmann, Olaf Erb, Ralf Gebhart Any opinions expressed in this message are personal to the author and may not necessarily reflect the opinions of secnetix GmbH & Co KG in any way. FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "C++ is over-complicated nonsense. And Bjorn Shoestrap's book a danger to public health. I tried reading it once, I was in recovery for months." -- Cliff Sarginson From owner-freebsd-performance@FreeBSD.ORG Wed Feb 14 17:06:20 2007 Return-Path: X-Original-To: freebsd-performance@FreeBSD.ORG Delivered-To: freebsd-performance@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3059F16A406; Wed, 14 Feb 2007 17:06:20 +0000 (UTC) (envelope-from msgs_for_me@mail.ru) Received: from mx28.mail.ru (mx28.mail.ru [194.67.23.67]) by mx1.freebsd.org (Postfix) with ESMTP id C7EB213C494; Wed, 14 Feb 2007 17:06:19 +0000 (UTC) (envelope-from msgs_for_me@mail.ru) Received: from mx33.mail.ru (mx33.mail.ru [194.67.23.194]) by mx28.mail.ru (mPOP.Fallback_MX) with ESMTP id DB40B716873; Wed, 14 Feb 2007 18:36:29 +0300 (MSK) Received: from [80.244.229.35] (port=7229 helo=VLADIMIR) by mx33.mail.ru with asmtp id 1HHMBG-000DLd-00; Wed, 14 Feb 2007 18:36:27 +0300 X-Nat-Received: from [192.168.1.110]:3843 [ident-empty] by smtp-proxy.vltele.com with TPROXY id 1171467214.12688 Date: Wed, 14 Feb 2007 18:36:25 +0300 From: Vladimir Kapustin X-Mailer: The Bat! (v3.85.03) Professional Organization: vltele.com X-Priority: 3 (Normal) Message-ID: <1024498861.20070214183625@mail.ru> To: freebsd-pf@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Cc: freebsd-isp@FreeBSD.ORG, freebsd-net@freebsd.org, freebsd-performance@FreeBSD.ORG Subject: How to optimize ruleset for gateway? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Vladimir Kapustin List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2007 17:06:20 -0000 Hi, all! I have such a problem when configuring the gateway for my LAN: I want to minimize the number of rules, and for this purpose I chose PF, but, as I wrote earlyer: http://lists.freebsd.org/pipermail/freebsd-pf/2007-January/002958.html and found some mails of other people: http://lists.freebsd.org/pipermail/freebsd-pf/2006-October/002681.html if I want to configure connection speed for each user on PF, I must configure the number of queues equal to the number of users, i.e. if I configure one queue and allow the table of users go to the Internet through this queue, I see, that all of them share the bandwidth of this queue. I don't think this is a good idea, and now I choosing some other variants of optimization, such as: 1. Configure PF for major rules and SPAM filtering and IPFW+DUMMYNET for queueing. I've read somewhere, that IPFW-shaper supports tables the way I need. I'm afraid that two firewalls should significantly decrease perfomance. 2. Configure only IPFW. But this means that I have to read full documentation about it, and find the way to protect the Internet from SPAM going from my local NET. The ruleset looks like: 0. Binat for real IP. 1. Block NetBIOS 2. Pass all from table-1 3. Pass all from table-128kbps queue 1(128kbps) 4. ..................... 5. Pass all from table-1024kbps queue 4(1024kbps) 6. Some spam-protection tool (like spamd) 7. Block all Could somebody give me some advice what way to go? P.S. Now my gateway works on 2-processor Xeon router with Redhat and iptables. It has 100 Mbps Internet channel, and in the time of maximum charge it processes 10-20 kpps. From owner-freebsd-performance@FreeBSD.ORG Thu Feb 15 19:43:48 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 51E3016A409 for ; Thu, 15 Feb 2007 19:43:48 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: from sed.awknet.com (sed.awknet.com [66.152.175.11]) by mx1.freebsd.org (Postfix) with ESMTP id 391B313C4B5 for ; Thu, 15 Feb 2007 19:43:48 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: by sed.awknet.com (Postfix, from userid 58) id DF8E310BBE5B; Thu, 15 Feb 2007 11:43:47 -0800 (PST) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on sed.awknet.com X-Spam-Level: X-Spam-Status: No, score=0.9 required=5.0 tests=AWL,BAYES_50 autolearn=disabled version=3.1.3 Received: from [192.168.1.101] (cpe-76-167-105-254.socal.res.rr.com [76.167.105.254]) by sed.awknet.com (Postfix) with ESMTP id 6B0B310BBE54; Thu, 15 Feb 2007 11:43:45 -0800 (PST) Message-ID: <45D4B7F0.20901@sk1llz.net> Date: Thu, 15 Feb 2007 11:43:44 -0800 From: Justin Robertson User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: Justin Robertson References: <20070207120426.CDEFC16A407@hub.freebsd.org> <1170929927.45caf9080183d@www.postino.punto.it> <45D19104.5010902@sk1llz.net> In-Reply-To: <45D19104.5010902@sk1llz.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org, garcol@postino.it Subject: Re: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2007 19:43:48 -0000 Playing with these sysctl values made 0 difference - what's supposed to happen??? Another scary discovery - if you've got 6.2 setup to route, even with static routes, 1Mbps of TCP SYN traffic will cause it to start dropping packets in every direction. Awesome. Methinks I'll be using 4.11 for a while. ;P Justin Robertson wrote: > > Clockrate is based off of my device_polling setup, which is > configured to 4000. burst_max has a hard limit, can't go higher than > it already is at 1000 > > Could I get an explanation as to what the queue and isr sysctl values > are actually doing? I'll be able to run some more basic tests tomorrow > to see some results, but want to wrap my head around what's actually > logically meant to be happening based on adjustments, etc. [I suspect > this'll do nothing for the UDP issue, but at least I might be able to > pipe some TCP traffic] > > > garcol@postino.it wrote: >> Hi, >> I think you can try to check/tuning this sysctl variables and >> the isr related variables: >> >> net.inet.ip.intr_queue_maxlen >> net.inet.ip.intr_queue_drops >> >> net.isr.enable ... try to set >> net.isr.directed >> net.isr.queued net.isr.drop >> >> and polling configuration: >> >> kern.clockrate >> >> kern.polling.burst_max >> .... increase for high rate of small packets on GE .... >> >> Alessandro >> >> >> >> >> >>> Date: Wed, 07 Feb 2007 01:37:00 -0800 >>> From: Justin Robertson >>> Subject: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues >>> To: freebsd-performance@freebsd.org >>> Message-ID: <45C99DBC.1050402@sk1llz.net> >>> Content-Type: text/plain; charset=ISO-8859-1; format=flowed >>> >>> It was suggested I post this to freebsd-performance, it's already >>> in questions, isp, and net. >>> >>> I've been running some tests with using FreeBSD to filter and rate >>> limit traffic. My first thoughts were to goto the latest stable >>> release, which was 6.1 at the time. I've since done the same test >>> under 6.2 and haven't seen any difference. I later migrated to >>> running 4.11 to get away from these issues, but have discovered others. >>> >>> I've tested on an AMD 3200+ system with dual Intel 1000 series NICs, >>> an AMD Opteron 165 with the same, and a Xeon 2.8 with the same. I've >>> used both stock and intel drivers. >>> >>> 6.x; >>> Normal traffic isn't a problem. The second you get into the realm of >>> abusive traffic, such a DoS/DDoS (over 100mbps) UDP floods the >>> machine falls over. Little packets with ip lengths of 28-29 bytes >>> seem to do the most damage. I've tried playing with various sysctl >>> values and have seen no difference at all. By "falls over" I mean >>> "stops sending all traffic in any direction". TCP syn packets have >>> the same effect, tho not quite as rapidly (200~230mbps). I then >>> tried moving filtering off to a transparent bridge. This improved >>> the situation somewhat, but an extra 30-40mbps of UDP data and it >>> would ultimately crumble. Overall the machine would be able to move >>> between 300k-600k PPS before becoming a cripple, depending on packet >>> length, protocol, and any flags. Without a specific pf or ipfw rule >>> to deal with a packet the box would fall over, with specific block >>> rules it would manage an extra 30-40mbps and then fall over. >>> >>> 4.11; >>> Again, normal traffic isn't a problem. When routing & filtering on >>> the same system some of the problems found in 6.x are still >>> apparent, but to a lesser degree. Splitting the task into a >>> transparent filtering bridge with a separate routing box appears to >>> clear it up entirely. UDP floods are much better handled - an ipfw >>> block rule for the packet type and the machine responds as if there >>> were no flood at all (until total bandwidth saturation or PPS limits >>> of the hardware, which in this case was around 950Mbps). TCP syn >>> attacks are also better handled, again a block rule makes it seem as >>> if there were no attack at all. The system also appears to be able >>> to move 800-900k PPS of any one protocol at a time. However, the >>> second you try and queue abusive traffic the machine will fall over. >>> Inbound floods appear to cause ALL inbound traffic to lag >>> horrifically (while rate limiting/piping), which inherently causes a >>> lot of outbound loss due to broken TCP. Now, I'm not sure if this is >>> something to do with dummynet being horribly inefficient, or if >>> there's some sysctl value to deal with inbound that I'm missing. >>> >>> I suppose my concerns are two-fold. Why is 6.x collapsing under >>> traffic that 4.11 could easily block and run merrily along with, and >>> is there a queueing mechanism in place that doesn't tie up the box >>> so much on inbound flows that it ignores all other relevant traffic? >>> >>> (as a note, all tests were done with device polling enabled. Without >>> it systems fall over pretty quickly. I also tried tests using 3com >>> cards and had the same results) >>> >>> >>> In the event anybody is looking for basic errors, device polling is >>> enabled and running at 4000 hz, which has proved to net the highest >>> thruput in PPS. ADAPTIVE_GIANT is on (tests resulted in better pps >>> thruput), all the other monitoring features are disabled, and here >>> are my sysctl modifications related to networking (if there's >>> something glaring let me know!); >>> >>> kern.polling.enable=1 >>> kern.polling.burst_max=1000 >>> kern.polling.each_burst=80 >>> kern.polling.idle_poll=1 >>> kern.polling.user_frac=20 >>> kern.polling.reg_frac=50 >>> net.inet.tcp.recvspace=262144 >>> net.inet.tcp.sendspace=262144 >>> kern.ipc.maxsockbuf=1048576 >>> net.inet.tcp.always_keepalive=1 >>> net.inet.ip.portrange.first=10000 >>> kern.ipc.somaxconn=65535 >>> net.inet.tcp.blackhole=2 >>> net.inet.udp.blackhole=1 >>> net.inet.icmp.icmplim=30 >>> net.inet.ip.forwarding=1 >>> net.inet.ip.portrange.randomized=0 >>> net.inet.udp.checksum=0 >>> net.inet.udp.recvspace=8192 (I've tried large and small, thinking >>> perhaps I was fulling up buffers on udp floods and then causing it >>> to drop tcp, there appears to be no difference) >>> net.inet.ip.intr_queue_maxlen=512 >>> net.inet.tcp.delayed_ack=0 >>> net.inet.tcp.rfc1323=1 >>> net.inet.tcp.newreno=0 (I'd try this, but, the biggest problem is >>> still with UDP, and I'd prefer something compatible with everything >>> for now) >>> net.inet.tcp.delacktime=10 >>> net.inet.tcp.msl=2500 >>> net.inet.ip.rtmaxcache=1024 >>> net.inet.raw.recvspace=262144 >>> net.inet.ip.dummynet.hash_size=512 >>> net.inet.ip.fw.dyn_ack_lifetime=30 >>> net.inet.ip.fw.dyn_syn_lifetime=10 >>> net.inet.ip.fw.dyn_fin_lifetime=10 >>> net.inet.ip.fw.dyn_max=16192 >>> net.link.ether.bridge.enable=0 (or 1 on when setup to bridge, >>> obviously) >>> net.inet.ip.fastforwarding=1 >>> >>> It has also been pointed out that using net.link.ether.ipfw=1 should >>> negate the need for a transparent box, however the performance >>> disparity between 6.x and 4.11 remains. >>> >>> >> _______________________________________________ >> freebsd-performance@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> To unsubscribe, send any mail to >> "freebsd-performance-unsubscribe@freebsd.org" >> >> > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" > -- Justin From owner-freebsd-performance@FreeBSD.ORG Thu Feb 15 20:39:52 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3C89D16A400 for ; Thu, 15 Feb 2007 20:39:52 +0000 (UTC) (envelope-from fcash@ocis.net) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.freebsd.org (Postfix) with ESMTP id 1C4C013C441 for ; Thu, 15 Feb 2007 20:39:52 +0000 (UTC) (envelope-from fcash@ocis.net) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id 848B61A000B14 for ; Thu, 15 Feb 2007 12:11:56 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at smtp.sd73.bc.ca Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id D2aMP9MZ+A8D for ; Thu, 15 Feb 2007 12:11:46 -0800 (PST) Received: from coal (s10.sbo [192.168.0.10]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 19DD11A000B0F for ; Thu, 15 Feb 2007 12:11:46 -0800 (PST) From: Freddie Cash To: freebsd-performance@freebsd.org Date: Thu, 15 Feb 2007 12:11:44 -0800 User-Agent: KMail/1.9.5 References: <20070207120426.CDEFC16A407@hub.freebsd.org> <45D19104.5010902@sk1llz.net> <45D4B7F0.20901@sk1llz.net> In-Reply-To: <45D4B7F0.20901@sk1llz.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200702151211.45177.fcash@ocis.net> Subject: Re: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2007 20:39:52 -0000 On Thursday 15 February 2007 11:43 am, Justin Robertson wrote: > Playing with these sysctl values made 0 difference - what's supposed > to happen??? > > Another scary discovery - if you've got 6.2 setup to route, even with > static routes, 1Mbps of TCP SYN traffic will cause it to start dropping > packets in every direction. Awesome. Methinks I'll be using 4.11 for a > while. ;P How are you measuring that? We have a dual-Opteron 2 GHz box with 4 GB RAM that handles routing for 7 fibre-connected sites (1 Gbps fibre links but limited by the firewalls at the sites to 100 Mbps) and connects to the Internet via a 1 Gbps link. All the routing on this box is handled via static routes, and we get a sustained 10 Mbps of traffic through the box. Nobody's complained about their access (which isn't surprising since we upgraded their Internet connections from a 2 Mbps shared cable connection to a dedicated 1 Gbps fibre link). FreeBSD 6.1-p11, about 100 ipfw rules, doing NAT for 4 servers, using 2x bge(4) devices and 1x fxp(4) device. -- Freddie Cash fcash@ocis.net From owner-freebsd-performance@FreeBSD.ORG Thu Feb 15 21:30:02 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 54B3C16A402 for ; Thu, 15 Feb 2007 21:30:02 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: from sed.awknet.com (sed.awknet.com [66.152.175.11]) by mx1.freebsd.org (Postfix) with ESMTP id 224FF13C4C1 for ; Thu, 15 Feb 2007 21:29:57 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: by sed.awknet.com (Postfix, from userid 58) id 024BA10BBE61; Thu, 15 Feb 2007 13:29:57 -0800 (PST) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on sed.awknet.com X-Spam-Level: X-Spam-Status: No, score=0.9 required=5.0 tests=AWL,BAYES_50 autolearn=disabled version=3.1.3 Received: from [192.168.1.101] (cpe-76-167-105-254.socal.res.rr.com [76.167.105.254]) by sed.awknet.com (Postfix) with ESMTP id 4D6D710BBE5B for ; Thu, 15 Feb 2007 13:29:55 -0800 (PST) Message-ID: <45D4D0D1.5020902@sk1llz.net> Date: Thu, 15 Feb 2007 13:29:53 -0800 From: Justin Robertson User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <20070207120426.CDEFC16A407@hub.freebsd.org> <45D19104.5010902@sk1llz.net> <45D4B7F0.20901@sk1llz.net> <200702151211.45177.fcash@ocis.net> In-Reply-To: <200702151211.45177.fcash@ocis.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2007 21:30:02 -0000 Send a flood of 60 byte syn packets with the tcp sack option thru it and check out what happens. It's pretty weird and I can't explain why. If you block the packets on the box via ipfw it's fine, the second it has to make a routing decision everything goes out the window, it seems. There's 100% packet loss on all protocols. I'm not using NAT, there are real IPs in different C classes on the other side of the box. Freddie Cash wrote: > On Thursday 15 February 2007 11:43 am, Justin Robertson wrote: > >> Playing with these sysctl values made 0 difference - what's supposed >> to happen??? >> >> Another scary discovery - if you've got 6.2 setup to route, even with >> static routes, 1Mbps of TCP SYN traffic will cause it to start dropping >> packets in every direction. Awesome. Methinks I'll be using 4.11 for a >> while. ;P >> > > How are you measuring that? > > We have a dual-Opteron 2 GHz box with 4 GB RAM that handles routing for 7 > fibre-connected sites (1 Gbps fibre links but limited by the firewalls at > the sites to 100 Mbps) and connects to the Internet via a 1 Gbps link. > > All the routing on this box is handled via static routes, and we get a > sustained 10 Mbps of traffic through the box. Nobody's complained about > their access (which isn't surprising since we upgraded their Internet > connections from a 2 Mbps shared cable connection to a dedicated 1 Gbps > fibre link). > > FreeBSD 6.1-p11, about 100 ipfw rules, doing NAT for 4 servers, using 2x > bge(4) devices and 1x fxp(4) device. > > -- Justin From owner-freebsd-performance@FreeBSD.ORG Thu Feb 15 21:57:30 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AD47E16A401 for ; Thu, 15 Feb 2007 21:57:30 +0000 (UTC) (envelope-from fcash@ocis.net) Received: from smtp.sd73.bc.ca (smtp.sd73.bc.ca [142.24.13.140]) by mx1.freebsd.org (Postfix) with ESMTP id 907EC13C442 for ; Thu, 15 Feb 2007 21:57:30 +0000 (UTC) (envelope-from fcash@ocis.net) Received: from localhost (localhost [127.0.0.1]) by localhost.sd73.bc.ca (Postfix) with ESMTP id AC17C1A000B0C for ; Thu, 15 Feb 2007 13:57:29 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at smtp.sd73.bc.ca Received: from smtp.sd73.bc.ca ([127.0.0.1]) by localhost (smtp.sd73.bc.ca [127.0.0.1]) (amavisd-new, port 10024) with LMTP id M3bl41BFycoB for ; Thu, 15 Feb 2007 13:57:23 -0800 (PST) Received: from coal (s10.sbo [192.168.0.10]) by smtp.sd73.bc.ca (Postfix) with ESMTP id 1667E1A000B0F for ; Thu, 15 Feb 2007 13:57:23 -0800 (PST) From: Freddie Cash To: freebsd-performance@freebsd.org Date: Thu, 15 Feb 2007 13:57:21 -0800 User-Agent: KMail/1.9.5 References: <20070207120426.CDEFC16A407@hub.freebsd.org> <200702151211.45177.fcash@ocis.net> <45D4D0D1.5020902@sk1llz.net> In-Reply-To: <45D4D0D1.5020902@sk1llz.net> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200702151357.22075.fcash@ocis.net> Subject: Re: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2007 21:57:30 -0000 On Thursday 15 February 2007 01:29 pm, Justin Robertson wrote: > Send a flood of 60 byte syn packets with the tcp sack option thru > it and check out what happens. It's pretty weird and I can't explain > why. If you block the packets on the box via ipfw it's fine, the second > it has to make a routing decision everything goes out the window, it > seems. There's 100% packet loss on all protocols. I'm not using NAT, > there are real IPs in different C classes on the other side of the box. Is that something that would occur normally? Or is this a worst-case/stress-test trying to break things? How are you generating the packets? I'm not a network guru, and haven't done much in the way of network-related stress-testing, but I'm always looking for ways to do so. -- Freddie Cash fcash@ocis.net From owner-freebsd-performance@FreeBSD.ORG Thu Feb 15 23:06:27 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3E4FF16A400 for ; Thu, 15 Feb 2007 23:06:27 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: from sed.awknet.com (sed.awknet.com [66.152.175.11]) by mx1.freebsd.org (Postfix) with ESMTP id 2823213C442 for ; Thu, 15 Feb 2007 23:06:27 +0000 (UTC) (envelope-from justin@sk1llz.net) Received: by sed.awknet.com (Postfix, from userid 58) id F212B10BBE57; Thu, 15 Feb 2007 15:06:26 -0800 (PST) X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on sed.awknet.com X-Spam-Level: X-Spam-Status: No, score=0.9 required=5.0 tests=AWL,BAYES_50 autolearn=disabled version=3.1.3 Received: from [192.168.1.101] (cpe-76-167-105-254.socal.res.rr.com [76.167.105.254]) by sed.awknet.com (Postfix) with ESMTP id 812CF10BBCF9 for ; Thu, 15 Feb 2007 15:06:25 -0800 (PST) Message-ID: <45D4E76F.7040807@sk1llz.net> Date: Thu, 15 Feb 2007 15:06:23 -0800 From: Justin Robertson User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <20070207120426.CDEFC16A407@hub.freebsd.org> <200702151211.45177.fcash@ocis.net> <45D4D0D1.5020902@sk1llz.net> <200702151357.22075.fcash@ocis.net> In-Reply-To: <200702151357.22075.fcash@ocis.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: 6.x, 4.x ipfw/dummynet pf/altq - network performance issues X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Feb 2007 23:06:27 -0000 This is definitely worst-case, it's simulating a DDoS attack at the network. What is really surprising is that just 1mbps of traffic is able to kill a 6.x box doing routing. If it were, say, 600mbps that I'd understand as you're pushing over a million PPS. But 1mbps? :-\ Freddie Cash wrote: > On Thursday 15 February 2007 01:29 pm, Justin Robertson wrote: > >> Send a flood of 60 byte syn packets with the tcp sack option thru >> it and check out what happens. It's pretty weird and I can't explain >> why. If you block the packets on the box via ipfw it's fine, the second >> it has to make a routing decision everything goes out the window, it >> seems. There's 100% packet loss on all protocols. I'm not using NAT, >> there are real IPs in different C classes on the other side of the box. >> > > Is that something that would occur normally? Or is this a > worst-case/stress-test trying to break things? How are you generating > the packets? > > I'm not a network guru, and haven't done much in the way of > network-related stress-testing, but I'm always looking for ways to do so. > > -- Justin From owner-freebsd-performance@FreeBSD.ORG Sat Feb 17 00:02:32 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 65E4916A402 for ; Sat, 17 Feb 2007 00:02:32 +0000 (UTC) (envelope-from stevenb@frii.com) Received: from mail.frii.com (phobos01.frii.com [216.17.128.161]) by mx1.freebsd.org (Postfix) with ESMTP id 046B013C48D for ; Sat, 17 Feb 2007 00:02:31 +0000 (UTC) (envelope-from stevenb@frii.com) Received: from [10.10.10.81] (fw01-e3.ftc.frii.net [216.17.230.109]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.frii.com (FRII) with ESMTP id DCAF0AE82D for ; Fri, 16 Feb 2007 16:40:46 -0700 (MST) Message-ID: <45D640FE.3070805@frii.com> Date: Fri, 16 Feb 2007 16:40:46 -0700 From: "Steven H. Baeighkley" User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: freebsd-performance@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: bizarre performance issues in 6.2 release X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 17 Feb 2007 00:02:32 -0000 Greetings, First let me apologize for the length of this message, I'm just trying to provide all the information that I can. We have been having some trouble with an upgrade to 6.2-Release. The performance just seems out of whack. We concede that there could be a reporting issue, but the results we are seeing are far too strange for that to be our first inclination. Background: We have 2 identical supermicro superserver 6022c. These have dual 2.0 Xeons with hyperthreading and 2 GB of RAM. A full description of the system is avaialble here http://www.supermicro.com/products/system/2U/6022/SYS-6022C.cfm These servers are running apache, perl, proftpd and php. One server is running 4.11 and is rocking the world, load is rarely above 1 and is regularly below .5. The other server is running 6.2 and regularly has load between 2 and 6 despite serving fewer connections than the 4.11 box. We have tried the following sysctl variables in both the commented and default values. #kern.ipc.maxsockets=32768 # 12328 Maximum number of sockets avaliable #kern.ipc.somaxconn=4096 # 128 Maximum pending socket connection queue size #kern.ipc.nmbclusters=65536 # 25600 Maximum number of mbuf clusters allowed ##kern.ipc.shm_use_phys=1 # 0 disallow shared memory from swapping (saves kernel work) ##kern.maxfiles=12328 # 12328 increase maxfiles ##net.inet.tcp.sendspace=131072 # 32768 increase tcp buffers ##net.inet.tcp.recvspace=131072 # 65536 increase tcp buffers ##vm.v_cache_min=5000 # 26369 #net.inet.tcp.msl=5000 # 30000 Maximum segment lifetime We currently have these values set in /boot/loader.conf userconfig_script_load="YES" kern.ipc.nmbclusters="65536" hint.acpi.0.disabled="1" # moved to sysctl.conf #kern.ipc.maxsockets="32768" ##kern.ipc.nmbclusters="16384" we have tried apache's recommendations for freebsd tuning. We upgraded to php 5.2.1 and zend optimizer 3.2.2 yesterday which did increase the performance some, however it is still far too high. NETSTAT, VMSTAT, NFSSTAT all show very similar values between the 2 systems. We ran IOZONE through a battery of tests on the drives and found that the 6.2 box actually had better disk performance. We assume we just need to tune things correctly however we're not sure what to try at this point. Our research indicates that we really shouldn't be seeing these performance problems. The kicker is this. We kept the original 4.11 drive for the 6.2 server intact. When we put the 4.11 drive back in, the performance is the same as the other machine. We assume we are just missing something but after going through all the tuning manuals we can find, nothing has leaped out as the problem. here are dmesg from the 2 differnet versions running on the same hardware. verbose dmesg 6.2 Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-RELEASE-p1 #0: Tue Feb 13 14:55:53 MST 2007 root@fweb01.frii.com:/frii/src/obj-6.2/frii/src/FreeBSD-6.2-RELEASE/sys/PASIPHAE Preloaded elf kernel "/boot/kernel/kernel" at 0xc07de000. Preloaded elf module "/boot/kernel/acpi.ko" at 0xc07de16c. Calibrating clock(s) ... i8254 clock: 1193286 Hz CLK_USE_I8254_CALIBRATION not specified - using default frequency Timecounter "i8254" frequency 1193182 Hz quality 0 Calibrating TSC clock ... TSC clock: 1982529804 Hz CPU: Intel(R) XEON(TM) CPU 2.00GHz (1982.53-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf24 Stepping = 4 Features=0x3febfbff Logical CPUs per core: 2 real memory = 2147418112 (2047 MB) Physical memory chunk(s): 0x0000000000001000 - 0x000000000009efff, 647168 bytes (158 pages) 0x0000000000100000 - 0x00000000003fffff, 3145728 bytes (768 pages) 0x0000000000828000 - 0x000000007db9ffff, 2100789248 bytes (512888 pages) avail memory = 2100547584 (2003 MB) MP Configuration Table version 1.4 found at 0xc00f1400 Table 'FACP' at 0x7fff3040 Table 'APIC' at 0x7fff6c40 MADT: Found table at 0x7fff6c40 APIC: Using the MADT enumerator. MADT: Found CPU APIC ID 0 ACPI ID 0: enabled SMP: Added CPU 0 (AP) MADT: Found CPU APIC ID 1 ACPI ID 1: enabled SMP: Added CPU 1 (AP) MADT: Found CPU APIC ID 2 ACPI ID 2: enabled SMP: Added CPU 2 (AP) MADT: Found CPU APIC ID 3 ACPI ID 3: enabled SMP: Added CPU 3 (AP) INTR: Adding local APIC 0 as a target ACPI APIC Table: INTR: Adding local APIC 2 as a target FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 cpu2 (AP): APIC ID: 2 cpu3 (AP): APIC ID: 3 bios32: Found BIOS32 Service Directory header at 0xc00faee0 bios32: Entry = 0xfb370 (c00fb370) Rev = 0 Len = 1 pcibios: PCI BIOS entry at 0xf0000+0xb3a0 pnpbios: Found PnP BIOS data at 0xc00fbe10 pnpbios: Entry = f0000:be40 Rev = 1.0 Other BIOS signatures found: APIC: CPU 0 has ACPI ID 0 APIC: CPU 1 has ACPI ID 1 APIC: CPU 2 has ACPI ID 2 APIC: CPU 3 has ACPI ID 3 MADT: Found IO APIC ID 4, Interrupt 0 at 0xfec00000 ioapic0: Routing external 8259A's -> intpin 0 ioapic0: intpin 0 -> ExtINT (edge, high) ioapic0: intpin 1 -> ISA IRQ 1 (edge, high) ioapic0: intpin 2 -> ISA IRQ 2 (edge, high) ioapic0: intpin 3 -> ISA IRQ 3 (edge, high) ioapic0: intpin 4 -> ISA IRQ 4 (edge, high) ioapic0: intpin 5 -> ISA IRQ 5 (edge, high) ioapic0: intpin 6 -> ISA IRQ 6 (edge, high) ioapic0: intpin 7 -> ISA IRQ 7 (edge, high) ioapic0: intpin 8 -> ISA IRQ 8 (edge, high) ioapic0: intpin 9 -> ISA IRQ 9 (edge, high) ioapic0: intpin 10 -> ISA IRQ 10 (edge, high) ioapic0: intpin 11 -> ISA IRQ 11 (edge, high) ioapic0: intpin 12 -> ISA IRQ 12 (edge, high) ioapic0: intpin 13 -> ISA IRQ 13 (edge, high) ioapic0: intpin 14 -> ISA IRQ 14 (edge, high) ioapic0: intpin 15 -> ISA IRQ 15 (edge, high) ioapic0: intpin 16 -> PCI IRQ 16 (level, low) ioapic0: intpin 17 -> PCI IRQ 17 (level, low) ioapic0: intpin 18 -> PCI IRQ 18 (level, low) ioapic0: intpin 19 -> PCI IRQ 19 (level, low) ioapic0: intpin 20 -> PCI IRQ 20 (level, low) ioapic0: intpin 21 -> PCI IRQ 21 (level, low) ioapic0: intpin 22 -> PCI IRQ 22 (level, low) ioapic0: intpin 23 -> PCI IRQ 23 (level, low) MADT: Interrupt override: source 0, irq 2 ioapic0: Routing IRQ 0 -> intpin 2 ioapic0: intpin 2 trigger: edge ioapic0: intpin 2 polarity: high MADT: Interrupt override: source 9, irq 9 ioapic0: intpin 9 trigger: level ioapic0: intpin 9 polarity: high ioapic0 irqs 0-23 on motherboard cpu0 BSP: ID: 0x00000000 VER: 0x00050014 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x00010000 pcm: 0x00010000 random: io: kbd: new array size 4 kbd1 at kbdmux0 mem: Pentium Pro MTRR support enabled nfslock: pseudo-device null: npx0: INT 16 interface acpi0: on motherboard ioapic0: routing intpin 9 (ISA IRQ 9) to vector 48 acpi0: [MPSAFE] pci_open(1): mode 1 addr port (0x0cf8) is 0x80000058 pci_open(1a): mode1res=0x80000000 (0x80000000) pci_cfgcheck: device 0 [class=060000] [hdr=00] is there (id=25318086) pcibios: BIOS version 2.10 Found $PIR table, 9 entries at 0xc00fded0 PCI-Only Interrupts: 5 7 10 11 12 Location Bus Device Pin Link IRQs slot 1 0 2 A 0x62 3 4 5 7 9 10 11 12 14 15 slot 1 0 2 B 0x62 3 4 5 7 9 10 11 12 14 15 slot 1 0 2 C 0x62 3 4 5 7 9 10 11 12 14 15 slot 1 0 2 D 0x62 3 4 5 7 9 10 11 12 14 15 slot 2 4 8 A 0x68 3 4 5 7 9 10 11 12 14 15 slot 2 4 8 B 0x69 3 4 5 7 9 10 11 12 14 15 slot 2 4 8 C 0x6a 3 4 5 7 9 10 11 12 14 15 slot 2 4 8 D 0x6b 3 4 5 7 9 10 11 12 14 15 slot 3 4 7 A 0x60 3 4 5 7 9 10 11 12 14 15 slot 3 4 7 B 0x61 3 4 5 7 9 10 11 12 14 15 slot 3 4 7 C 0x62 3 4 5 7 9 10 11 12 14 15 slot 3 4 7 D 0x63 3 4 5 7 9 10 11 12 14 15 slot 4 4 1 A 0x61 3 4 5 7 9 10 11 12 14 15 slot 4 4 1 B 0x62 3 4 5 7 9 10 11 12 14 15 slot 4 4 1 C 0x63 3 4 5 7 9 10 11 12 14 15 slot 4 4 1 D 0x60 3 4 5 7 9 10 11 12 14 15 slot 5 4 2 A 0x62 3 4 5 7 9 10 11 12 14 15 slot 5 4 2 B 0x63 3 4 5 7 9 10 11 12 14 15 slot 5 4 2 C 0x60 3 4 5 7 9 10 11 12 14 15 slot 5 4 2 D 0x61 3 4 5 7 9 10 11 12 14 15 slot 6 4 3 A 0x63 3 4 5 7 9 10 11 12 14 15 slot 6 4 3 B 0x60 3 4 5 7 9 10 11 12 14 15 slot 6 4 3 C 0x61 3 4 5 7 9 10 11 12 14 15 slot 6 4 3 D 0x62 3 4 5 7 9 10 11 12 14 15 slot 7 3 4 A 0x60 3 4 5 7 9 10 11 12 14 15 slot 7 3 4 B 0x61 3 4 5 7 9 10 11 12 14 15 slot 7 3 4 C 0x62 3 4 5 7 9 10 11 12 14 15 slot 7 3 4 D 0x63 3 4 5 7 9 10 11 12 14 15 embedded 0 31 A 0x60 3 4 5 7 9 10 11 12 14 15 embedded 0 31 B 0x61 3 4 5 7 9 10 11 12 14 15 embedded 0 31 C 0x6b 3 4 5 7 9 10 11 12 14 15 embedded 0 31 D 0x63 3 4 5 7 9 10 11 12 14 15 embedded 0 1 A 0x6a 3 4 5 7 9 10 11 12 14 15 embedded 0 1 B 0x6b 3 4 5 7 9 10 11 12 14 15 embedded 0 1 C 0x60 3 4 5 7 9 10 11 12 14 15 embedded 0 1 D 0x61 3 4 5 7 9 10 11 12 14 15 AcpiOsDerivePciId: bus 0 dev 31 func 0 AcpiOsDerivePciId: bus 0 dev 31 func 0 acpi0: Power Button (fixed) acpi0: wakeup code va 0xd9f94000 pa 0x9d000 ACPI timer: 1/1 1/1 1/1 1/1 1/1 1/2 1/1 1/1 1/1 1/1 -> 10 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 pci_link0: Links after initial probe: Index IRQ Rtd Ref IRQs 0 10 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link0: Links after initial validation: Index IRQ Rtd Ref IRQs 0 10 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link0: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link1: Links after initial probe: Index IRQ Rtd Ref IRQs 0 7 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link1: Links after initial validation: Index IRQ Rtd Ref IRQs 0 7 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link1: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link2: Links after initial probe: Index IRQ Rtd Ref IRQs 0 11 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link2: Links after initial validation: Index IRQ Rtd Ref IRQs 0 11 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link2: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link3: Links after initial probe: Index IRQ Rtd Ref IRQs 0 5 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link3: Links after initial validation: Index IRQ Rtd Ref IRQs 0 5 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link3: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link4: Links after initial probe: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link4: Links after initial validation: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link4: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link5: Links after initial probe: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link5: Links after initial validation: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link5: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link6: Links after initial probe: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link6: Links after initial validation: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link6: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link7: Links after initial probe: Index IRQ Rtd Ref IRQs 0 12 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link7: Links after initial validation: Index IRQ Rtd Ref IRQs 0 12 N 0 3 4 5 6 7 9 10 11 12 14 15 pci_link7: Links after disable: Index IRQ Rtd Ref IRQs 0 255 N 0 3 4 5 6 7 9 10 11 12 14 15 cpu0: on acpi0 cpu1: on acpi0 cpu2: on acpi0 cpu3: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pci0: physical bus=0 found-> vendor=0x8086, dev=0x2531, revid=0x04 bus=0, slot=0, func=0 class=06-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0106, statreg=0xe090, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[10]: type 3, range 32, base f0000000, size 26, enabled found-> vendor=0x8086, dev=0x2532, revid=0x04 bus=0, slot=1, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0107, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x40 (1920 ns), mingnt=0x06 (1500 ns), maxlat=0x00 (0 ns) found-> vendor=0x8086, dev=0x2533, revid=0x04 bus=0, slot=2, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0107, statreg=0x00a0, cachelnsz=0 (dwords) lattimer=0x20 (960 ns), mingnt=0x06 (1500 ns), maxlat=0x00 (0 ns) found-> vendor=0x8086, dev=0x244e, revid=0x04 bus=0, slot=30, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0107, statreg=0x0080, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x0e (3500 ns), maxlat=0x00 (0 ns) found-> vendor=0x8086, dev=0x2440, revid=0x04 bus=0, slot=31, func=0 class=06-01-00, hdrtype=0x00, mfdev=1 cmdreg=0x000f, statreg=0x0280, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) found-> vendor=0x8086, dev=0x244b, revid=0x04 bus=0, slot=31, func=1 class=01-01-80, hdrtype=0x00, mfdev=0 cmdreg=0x0005, statreg=0x0280, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[20]: type 4, range 32, base 0000f000, size 4, enabled found-> vendor=0x8086, dev=0x2442, revid=0x04 bus=0, slot=31, func=2 class=0c-03-00, hdrtype=0x00, mfdev=0 cmdreg=0x0005, statreg=0x0280, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=d, irq=5 map[20]: type 4, range 32, base 0000b000, size 5, enabled pcib0: matched entry for 0.31.INTD pcib0: slot 31 INTD hardwired to IRQ 19 found-> vendor=0x8086, dev=0x2443, revid=0x04 bus=0, slot=31, func=3 class=0c-05-00, hdrtype=0x00, mfdev=0 cmdreg=0x0001, statreg=0x0280, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=b, irq=7 map[20]: type 4, range 32, base 00000500, size 4, enabled pcib0: matched entry for 0.31.INTB pcib0: slot 31 INTB hardwired to IRQ 17 found-> vendor=0x8086, dev=0x2444, revid=0x04 bus=0, slot=31, func=4 class=0c-03-00, hdrtype=0x00, mfdev=0 cmdreg=0x0005, statreg=0x0280, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) intpin=c, irq=12 map[20]: type 4, range 32, base 0000b800, size 5, enabled pcib0: matched entry for 0.31.INTC pcib0: slot 31 INTC hardwired to IRQ 23 agp0: mem 0xf0000000-0xf3ffffff at device 0.0 on pci0 agp0: Reserved 0x4000000 bytes for rid 0x10 type 3 at 0xf0000000 agp0: allocating GATT for aperture of size 64M pcib1: at device 1.0 on pci0 pcib1: secondary bus 1 pcib1: subordinate bus 1 pcib1: I/O decode 0xf000-0xfff pcib1: memory decode 0xfff00000-0xfffff pcib1: prefetched decode 0xfff00000-0xfffff pci1: on pcib1 pci1: physical bus=1 pcib2: at device 2.0 on pci0 pcib2: secondary bus 2 pcib2: subordinate bus 3 pcib2: I/O decode 0x9000-0x9fff pcib2: memory decode 0xf4000000-0xf5ffffff pcib2: prefetched decode 0xfff00000-0xfffff pcib2: could not get PCI interrupt routing table for \\_SB_.PCI0.HUBA - AE_NOT_FOUND pci2: on pcib2 pci2: physical bus=2 found-> vendor=0x8086, dev=0x1360, revid=0x03 bus=2, slot=31, func=0 class=06-04-00, hdrtype=0x01, mfdev=0 cmdreg=0x0107, statreg=0x0020, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x06 (1500 ns), maxlat=0x80 (32000 ns) pcib3: at device 31.0 on pci2 pcib3: secondary bus 3 pcib3: subordinate bus 3 pcib3: I/O decode 0x9000-0x9fff pcib3: memory decode 0xf4000000-0xf5ffffff pcib3: prefetched decode 0xfff00000-0xfffff pci3: on pcib3 pci3: physical bus=3 found-> vendor=0x8086, dev=0x1161, revid=0x01 bus=3, slot=0, func=0 class=08-00-20, hdrtype=0x00, mfdev=1 cmdreg=0x0000, statreg=0x0000, cachelnsz=0 (dwords) lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) map[10]: type 1, range 32, base f5001000, size 12, memory disabled pcib3: (null) requested memory range 0xf5001000-0xf5001fff: good pcib2: (null) requested memory range 0xf5001000-0xf5001fff: good found-> vendor=0x9005, dev=0x00cf, revid=0x01 bus=3, slot=4, func=0 class=01-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0007, statreg=0x02b0, cachelnsz=8 (dwords) lattimer=0x20 (960 ns), mingnt=0x28 (10000 ns), maxlat=0x19 (6250 ns) intpin=a, irq=11 powerspec 2 supports D0 D3 current D0 map[10]: type 4, range 32, base 00009000, size 8, enabled pcib3: (null) requested I/O range 0x9000-0x90ff: in range pcib2: (null) requested I/O range 0x9000-0x90ff: in range map[14]: type 1, range 64, base f5000000, size 12, enabled pcib3: (null) requested memory range 0xf5000000-0xf5000fff: good pcib2: (null) requested memory range 0xf5000000-0xf5000fff: good pcib3: matched entry for 3.4.INTA pcib3: slot 4 INTA hardwired to IRQ 18 found-> vendor=0x9005, dev=0x00cf, revid=0x01 bus=3, slot=4, func=1 class=01-00-00, hdrtype=0x00, mfdev=1 cmdreg=0x0007, statreg=0x02b0, cachelnsz=8 (dwords) lattimer=0x20 (960 ns), mingnt=0x28 (10000 ns), maxlat=0x19 (6250 ns) intpin=b, irq=11 powerspec 2 supports D0 D3 current D0 map[10]: type 4, range 32, base 00009400, size 8, enabled pcib3: (null) requested I/O range 0x9400-0x94ff: in range pcib2: (null) requested I/O range 0x9400-0x94ff: in range map[14]: type 1, range 64, base f5002000, size 12, enabled pcib3: (null) requested memory range 0xf5002000-0xf5002fff: good pcib2: (null) requested memory range 0xf5002000-0xf5002fff: good pcib3: matched entry for 3.4.INTB pcib3: slot 4 INTB hardwired to IRQ 18 pci3: at device 0.0 (no driver attached) ahc0: port 0x9000-0x90ff mem 0xf5000000-0xf5000fff irq 18 at device 4.0 on pci3 ahc0: Defaulting to MEMIO off ahc0: Reserved 0x100 bytes for rid 0x10 type 4 at 0x9000 ahc0: Reading SEEPROM...done. ahc0: Manual SE Termination ahc0: Manual LVD Termination ahc0: BIOS eeprom is present ahc0: Secondary High byte termination Enabled ahc0: Secondary Low byte termination Enabled ahc0: Primary Low Byte termination Enabled ahc0: Primary High Byte termination Enabled ahc0: Downloading Sequencer Program... 423 instructions downloaded ahc0: Features 0x1fef6, Bugs 0x40, Flags 0x28485560 ioapic0: routing intpin 18 (PCI IRQ 18) to vector 49 ahc0: [GIANT-LOCKED] aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs ahc1: port 0x9400-0x94ff mem 0xf5002000-0xf5002fff irq 18 at device 4.1 on pci3 ahc1: Defaulting to MEMIO off ahc1: Reserved 0x100 bytes for rid 0x10 type 4 at 0x9400 ahc1: Reading SEEPROM...done. ahc1: Manual SE Termination ahc1: Manual LVD Termination ahc1: BIOS eeprom is present ahc1: Secondary High byte termination Enabled ahc1: Secondary Low byte termination Enabled ahc1: Primary Low Byte termination Enabled ahc1: Primary High Byte termination Enabled ahc1: Downloading Sequencer Program... 423 instructions downloaded ahc1: Features 0x1fef6, Bugs 0x40, Flags 0x20485560 ahc1: [GIANT-LOCKED] aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs pcib4: at device 30.0 on pci0 pcib4: secondary bus 4 pcib4: subordinate bus 4 pcib4: I/O decode 0xa000-0xafff pcib4: memory decode 0xf6000000-0xf8ffffff pcib4: prefetched decode 0xfff00000-0xfffff pcib4: Subtractively decoded bridge. pci4: on pcib4 pci4: physical bus=4 found-> vendor=0x8086, dev=0x1076, revid=0x00 bus=4, slot=2, func=0 class=02-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x0230, cachelnsz=8 (dwords) lattimer=0x20 (960 ns), mingnt=0xff (63750 ns), maxlat=0x00 (0 ns) intpin=a, irq=11 powerspec 2 supports D0 D3 current D0 MSI supports 1 message, 64 bit map[10]: type 1, range 32, base f8120000, size 17, enabled pcib4: (null) requested memory range 0xf8120000-0xf813ffff: good map[14]: type 1, range 32, base f8100000, size 17, enabled pcib4: (null) requested memory range 0xf8100000-0xf811ffff: good map[18]: type 4, range 32, base 0000a000, size 6, enabled pcib4: (null) requested I/O range 0xa000-0xa03f: in range pcib4: matched entry for 4.2.INTA pcib4: slot 2 INTA hardwired to IRQ 18 found-> vendor=0x8086, dev=0x1229, revid=0x08 bus=4, slot=4, func=0 class=02-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0007, statreg=0x0290, cachelnsz=8 (dwords) lattimer=0x20 (960 ns), mingnt=0x08 (2000 ns), maxlat=0x38 (14000 ns) intpin=a, irq=10 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type 1, range 32, base f8140000, size 12, enabled pcib4: (null) requested memory range 0xf8140000-0xf8140fff: good map[14]: type 4, range 32, base 0000a400, size 6, enabled pcib4: (null) requested I/O range 0xa400-0xa43f: in range map[18]: type 1, range 32, base f8000000, size 20, enabled pcib4: (null) requested memory range 0xf8000000-0xf80fffff: good pcib4: matched entry for 4.4.INTA pcib4: slot 4 INTA hardwired to IRQ 16 found-> vendor=0x1002, dev=0x4752, revid=0x27 bus=4, slot=7, func=0 class=03-00-00, hdrtype=0x00, mfdev=0 cmdreg=0x0087, statreg=0x0290, cachelnsz=8 (dwords) lattimer=0x20 (960 ns), mingnt=0x08 (2000 ns), maxlat=0x00 (0 ns) intpin=a, irq=10 powerspec 2 supports D0 D1 D2 D3 current D0 map[10]: type 1, range 32, base f7000000, size 24, enabled pcib4: (null) requested memory range 0xf7000000-0xf7ffffff: good map[14]: type 4, range 32, base 0000a800, size 8, enabled pcib4: (null) requested I/O range 0xa800-0xa8ff: in range map[18]: type 1, range 32, base f8141000, size 12, enabled pcib4: (null) requested memory range 0xf8141000-0xf8141fff: good pcib4: matched entry for 4.7.INTA pcib4: slot 7 INTA hardwired to IRQ 16 em0: port 0xa000-0xa03f mem 0xf8120000-0xf813ffff,0xf8100000-0xf811ffff irq 18 at device 2.0 on pci4 em0: Reserved 0x20000 bytes for rid 0x10 type 3 at 0xf8120000 em0: Reserved 0x40 bytes for rid 0x18 type 4 at 0xa000 em0: bpf attached em0: Ethernet address: 00:0e:0c:2e:f5:6c em0: [MPSAFE] fxp0: port 0xa400-0xa43f mem 0xf8140000-0xf8140fff,0xf8000000-0xf80fffff irq 16 at device 4.0 on pci4 fxp0: Reserved 0x1000 bytes for rid 0x10 type 3 at 0xf8140000 fxp0: using memory space register mapping fxp0: PCI IDs: 8086 1229 8086 100c 0008 fxp0: Dynamic Standby mode is disabled miibus0: on fxp0 inphy0: on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto fxp0: bpf attached fxp0: Ethernet address: 00:30:48:22:6e:3e ioapic0: routing intpin 16 (PCI IRQ 16) to vector 50 fxp0: [MPSAFE] pci4: at device 7.0 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf000-0xf00f at device 31.1 on pci0 atapci0: Reserved 0x10 bytes for rid 0x20 type 4 at 0xf000 ata0: on atapci0 atapci0: Reserved 0x8 bytes for rid 0x10 type 4 at 0x1f0 atapci0: Reserved 0x1 bytes for rid 0x14 type 4 at 0x3f6 ata0: reset tp1 mask=03 ostat0=00 ostat1=00 ata0: stat0=0x01 err=0x01 lsb=0x01 msb=0x01 ata0: stat1=0x01 err=0x01 lsb=0x01 msb=0x01 ata0: reset tp2 stat0=01 stat1=01 devices=0x0 ioapic0: routing intpin 14 (ISA IRQ 14) to vector 51 ata0: [MPSAFE] ata1: on atapci0 atapci0: Reserved 0x8 bytes for rid 0x18 type 4 at 0x170 atapci0: Reserved 0x1 bytes for rid 0x1c type 4 at 0x376 ata1: reset tp1 mask=03 ostat0=50 ostat1=7f ata1: stat0=0x00 err=0x01 lsb=0x14 msb=0xeb ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: stat1=0x7f err=0x7f lsb=0x7f msb=0x7f ata1: reset tp2 stat0=00 stat1=ff devices=0x4 ioapic0: routing intpin 15 (ISA IRQ 15) to vector 52 ata1: [MPSAFE] uhci0: port 0xb000-0xb01f irq 19 at device 31.2 on pci0 uhci0: Reserved 0x20 bytes for rid 0x20 type 4 at 0xb000 ioapic0: routing intpin 19 (PCI IRQ 19) to vector 53 uhci0: [GIANT-LOCKED] usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered pci0: at device 31.3 (no driver attached) uhci1: port 0xb800-0xb81f irq 23 at device 31.4 on pci0 uhci1: Reserved 0x20 bytes for rid 0x20 type 4 at 0xb800 ioapic0: routing intpin 23 (PCI IRQ 23) to vector 54 uhci1: [GIANT-LOCKED] usb1: on uhci1 usb1: USB revision 1.0 uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered acpi_tz0: on acpi0 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: ic_type 90 part_id 80 ioapic0: routing intpin 6 (ISA IRQ 6) to vector 55 fdc0: [MPSAFE] fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 atkbd: the current kbd controller command byte 0067 atkbd: keyboard ID 0x41ab (2) kbd0 at atkbd0 kbd0: atkbd0, AT 101/102 (2), config:0x0, flags:0x3d0000 ioapic0: routing intpin 1 (ISA IRQ 1) to vector 56 atkbd0: [GIANT-LOCKED] psm0: unable to allocate IRQ ahc_isa_probe 0: ioport 0xc00 alloc failed ata: ata0 already exists; skipping it ata: ata1 already exists; skipping it atkbdc: atkbdc0 already exists; skipping it fdc: fdc0 already exists; skipping it sc: sc0 already exists; skipping it vga: vga0 already exists; skipping it pnp_identify: Trying Read_Port at 203 pnp_identify: Trying Read_Port at 243 pnp_identify: Trying Read_Port at 283 pnp_identify: Trying Read_Port at 2c3 pnp_identify: Trying Read_Port at 303 pnp_identify: Trying Read_Port at 343 pnp_identify: Trying Read_Port at 383 pnp_identify: Trying Read_Port at 3c3 PNP Identify complete isa_probe_children: disabling PnP devices isa_probe_children: probing non-PnP devices orm0: at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sc0: fb0, kbd1, terminal emulator: sc (syscons terminal) vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 adv0: not probed (disabled) aha0: not probed (disabled) aic0: not probed (disabled) bt0: not probed (disabled) cs0: not probed (disabled) ed0: not probed (disabled) fe0: not probed (disabled) ie0: not probed (disabled) lnc0: not probed (disabled) ppc0 failed to probe at irq 7 on isa0 sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: irq maps: 0x9ca1 0x9ca1 0x9ca1 0x9ca1 sio0: probe failed test(s): 0 1 2 4 6 7 9 sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0 sio0: type 8250 or not responding ioapic0: routing intpin 4 (ISA IRQ 4) to vector 57 sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled sio1: irq maps: 0x9ca1 0x9ca1 0x9ca1 0x9ca1 sio1: probe failed test(s): 0 1 2 4 6 7 9 sio1 failed to probe at port 0x2f8-0x2ff irq 3 on isa0 sio2: not probed (disabled) sio3: not probed (disabled) sn0: not probed (disabled) vt0: not probed (disabled) isa_probe_children: probing PnP devices Device configuration finished. Reducing kern.maxvnodes 134617 -> 100000 procfs registered lapic: Divisor 2, Frequency 49563070 hz Timecounter "TSC" frequency 1982529804 Hz quality -100 Timecounters tick every 1.000 msec lo0: bpf attached Waiting 5 seconds for SCSI devices to settle (noperiph:em0: Link is up 100 Mbps Half Duplex ahc0:0:-1:-1): SCSI bus reset delivered. 0 SCBs aborted. (noperiph:ahc1:0:-1:-1): SCSI bus reset delivered. 0 SCBs aborted. ata1-master: pio=PIO4 wdma=WDMA2 udma=UDMA33 cable=40 wire acd0: setting PIO4 on ICH2 chip acd0: setting UDMA33 on ICH2 chip acd0: CDROM drive at ata1 as master acd0: read 4125KB/s (4125KB/s), 128KB buffer, UDMA33 acd0: Reads: CDR, CDRW, CDDA stream, packet acd0: Writes: acd0: Audio: play, 256 volume levels acd0: Mechanism: ejectable tray, unlocked acd0: Medium: no/blank disc ahc0: Selection Timeout on A:8. 0 SCBs aborted ahc1: Selection Timeout on A:1. 0 SCBs aborted ahc0: Selection Timeout on A:0. 0 SCBs aborted ahc1: Selection Timeout on A:6. 0 SCBs aborted ahc0: Selection Timeout on A:1. 0 SCBs aborted ahc1: Selection Timeout on A:12. 0 SCBs aborted ahc0: Selection Timeout on A:2. 0 SCBs aborted ahc1: Selection Timeout on A:15. 0 SCBs aborted ahc0: Selection Timeout on A:3. 0 SCBs aborted ahc1: Selection Timeout on A:2. 0 SCBs aborted ahc0: Selection Timeout on A:4. 0 SCBs aborted ahc1: Selection Timeout on A:3. 0 SCBs aborted ahc0: Selection Timeout on A:5. 0 SCBs aborted ahc1: Selection Timeout on A:4. 0 SCBs aborted ahc0: Selection Timeout on A:6. 0 SCBs aborted ahc1: Selection Timeout on A:5. 0 SCBs aborted ahc0: Selection Timeout on A:9. 0 SCBs aborted ahc1: Selection Timeout on A:8. 0 SCBs aborted ahc0: Selection Timeout on A:10. 0 SCBs aborted ahc1: Selection Timeout on A:9. 0 SCBs aborted ahc0: Selection Timeout on A:11. 0 SCBs aborted ahc1: Selection Timeout on A:10. 0 SCBs aborted ahc0: Selection Timeout on A:12. 0 SCBs aborted ahc1: Selection Timeout on A:11. 0 SCBs aborted ahc0: Selection Timeout on A:13. 0 SCBs aborted ahc1: Selection Timeout on A:13. 0 SCBs aborted ahc0: Selection Timeout on A:14. 0 SCBs aborted ahc1: Selection Timeout on A:14. 0 SCBs aborted (probe15:ahc1:0:0:0): Retrying Command (ahc1:A:0:0): Sending PPR bus_width 1, period 9, offset 7f, ppr_options 2 (ahc1:A:0:0): Received PPR width 1, period 9, offset 3f,options 2 Filtered to width 1, period 9, offset 3f, options 2 ahc1: target 0 using 16bit transfers ahc1: target 0 synchronous at 80.0MHz DT, offset = 0x3f ahc0: Selection Timeout on A:15. 0 SCBs aborted pass0 at ahc1 bus 0 target 0 lun 0 pass0: Fixed Direct Access SCSI-3 device pass0: Serial Number 3HX0YW7G000074461N3S pass0: 160.000MB/s transfers (80.000MHz, offset 63, 16bit), Tagged Queueing Enabled da0 at ahc1 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: Serial Number 3HX0YW7G000074461N3S da0: 160.000MB/s transfers (80.000MHz, offset 63, 16bit), Tagged Queueing Enabled da0: 35003MB (71687372 512 byte sectors: 255H 63S/T 4462C) GEOM: new disk da0 SMP: AP CPU #2 Launched! cpu2 AP: ID: 0x02000000 VER: 0x00050014 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x00010000 pcm: 0x00010000 SMP: AP CPU #1 Launched! cpu1 AP: ID: 0x01000000 VER: 0x00050014 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x00010000 pcm: 0x00010000 SMP: AP CPU #3 Launched! cpu3 AP: ID: 0x03000000 VER: 0x00050014 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000200ef therm: 0x00010000 err: 0x00010000 pcm: 0x00010000 INTR: Assigning IRQ 1 to local APIC 0 ioapic0: Assigning ISA IRQ 1 to local APIC 0 INTR: Assigning IRQ 4 to local APIC 2 ioapic0: Assigning ISA IRQ 4 to local APIC 2 INTR: Assigning IRQ 6 to local APIC 0 ioapic0: Assigning ISA IRQ 6 to local APIC 0 INTR: Assigning IRQ 9 to local APIC 2 ioapic0: Assigning ISA IRQ 9 to local APIC 2 INTR: Assigning IRQ 14 to local APIC 0 ioapic0: Assigning ISA IRQ 14 to local APIC 0 INTR: Assigning IRQ 15 to local APIC 2 ioapic0: Assigning ISA IRQ 15 to local APIC 2 INTR: Assigning IRQ 16 to local APIC 0 ioapic0: Assigning PCI IRQ 16 to local APIC 0 INTR: Assigning IRQ 18 to local APIC 2 ioapic0: Assigning PCI IRQ 18 to local APIC 2 INTR: Assigning IRQ 19 to local APIC 0 ioapic0: Assigning PCI IRQ 19 to local APIC 0 INTR: Assigning IRQ 23 to local APIC 2 ioapic0: Assigning PCI IRQ 23 to local APIC 2 Trying to mount root from ufs:/dev/da0s1a start_init: trying /sbin/init Linux ELF exec handler installed linprocfs registered em0: Link is Down em0: Link is up 100 Mbps Full Duplex verbose 4.11 dmesg Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 4.11-RELEASE-p8 #0: Mon Aug 7 08:43:21 MDT 2006 root@:/usr/obj/u/frii/src/FreeBSD-4.11-RELEASE/sys/WEBFARM-TMP Calibrating clock(s) ... TSC clock: 1982700456 Hz, i8254 clock: 1193292 Hz CLK_USE_I8254_CALIBRATION not specified - using default frequency Timecounter "i8254" frequency 1193182 Hz CLK_USE_TSC_CALIBRATION not specified - using old calibration method CPU: Intel(R) XEON(TM) CPU 2.00GHz (1982.53-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf24 Stepping = 4 Features=0x3febfbff Hyperthreading: 2 logical CPUs real memory = 2147483648 (2097152K bytes) Physical memory chunk(s): 0x000001000 - 0x00009efff, 647168 bytes (158 pages) 0x00039b000 - 0x07fff7fff, 2143670272 bytes (523357 pages) avail memory = 2088013824 (2039076K bytes) Programming 24 pins in IOAPIC #0 IOAPIC #0 intpin 2 -> irq 0 SMP: CPU0 apic_initialize(): lint0: 0x00000700 lint1: 0x00010400 TPR: 0x00000000 SVR: 0x000001ff FreeBSD/SMP: Multiprocessor motherboard: 4 CPUs cpu0 (BSP): apic id: 0, version: 0x00050014, at 0xfee00000 cpu1 (AP): apic id: 1, version: 0x00050014, at 0xfee00000 cpu2 (AP): apic id: 2, version: 0x00050014, at 0xfee00000 cpu3 (AP): apic id: 3, version: 0x00050014, at 0xfee00000 io0 (APIC): apic id: 4, version: 0x00178020, at 0xfec00000 bios32: Found BIOS32 Service Directory header at 0xc00faee0 bios32: Entry = 0xfb370 (c00fb370) Rev = 0 Len = 1 pcibios: PCI BIOS entry at 0xb3a0 pnpbios: Found PnP BIOS data at 0xc00fbe10 pnpbios: Entry = f0000:be40 Rev = 1.0 Other BIOS signatures found: ACPI: 000f6be0 Preloaded elf kernel "kernel" at 0xc0371000. Warning: Pentium 4 CPU: PSE disabled Pentium Pro MTRR support enabled Creating DISK md0 md0: Malloc disk Math emulator present SMP: CPU0 bsp_apic_configure(): lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff pci_open(1): mode 1 addr port (0x0cf8) is 0x80000058 pci_open(1a): mode1res=0x80000000 (0x80000000) pci_cfgcheck: device 0 [class=060000] [hdr=00] is there (id=25318086) Using $PIR table, 9 entries at 0xc00fded0 npx0: on motherboard npx0: INT 16 interface pcib0: on motherboard found-> vendor=0x8086, dev=0x2531, revid=0x04 class=06-00-00, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 map[10]: type 1, range 32, base f0000000, size 26 found-> vendor=0x8086, dev=0x2532, revid=0x04 class=06-04-00, hdrtype=0x01, mfdev=0 subordinatebus=1 secondarybus=1 found-> vendor=0x8086, dev=0x2533, revid=0x04 class=06-04-00, hdrtype=0x01, mfdev=0 subordinatebus=3 secondarybus=2 found-> vendor=0x8086, dev=0x244e, revid=0x04 class=06-04-00, hdrtype=0x01, mfdev=0 subordinatebus=4 secondarybus=4 found-> vendor=0x8086, dev=0x2440, revid=0x04 class=06-01-00, hdrtype=0x00, mfdev=1 subordinatebus=0 secondarybus=0 found-> vendor=0x8086, dev=0x244b, revid=0x04 class=01-01-80, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 map[20]: type 1, range 32, base 0000f000, size 4 IOAPIC #0 intpin 19 -> irq 2 Freeing (NOT implemented) redirected PCI irq 5. found-> vendor=0x8086, dev=0x2442, revid=0x04 class=0c-03-00, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 intpin=d, irq=2 map[20]: type 1, range 32, base 0000b000, size 5 IOAPIC #0 intpin 17 -> irq 5 Freeing (NOT implemented) redirected PCI irq 7. found-> vendor=0x8086, dev=0x2443, revid=0x04 class=0c-05-00, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 intpin=b, irq=5 map[20]: type 1, range 32, base 00000500, size 4 IOAPIC #0 intpin 23 -> irq 7 Freeing (NOT implemented) redirected PCI irq 12. found-> vendor=0x8086, dev=0x2444, revid=0x04 class=0c-03-00, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 intpin=c, irq=7 map[20]: type 1, range 32, base 0000b800, size 5 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pcib2: at device 2.0 on pci0 found-> vendor=0x8086, dev=0x1360, revid=0x03 class=06-04-00, hdrtype=0x01, mfdev=0 subordinatebus=3 secondarybus=3 pci2: on pcib2 pcib3: at device 31.0 on pci2 found-> vendor=0x8086, dev=0x1161, revid=0x01 class=08-00-20, hdrtype=0x00, mfdev=1 subordinatebus=0 secondarybus=0 IOAPIC #0 intpin 18 -> irq 10 Freeing (NOT implemented) redirected PCI irq 11. found-> vendor=0x9005, dev=0x00cf, revid=0x01 class=01-00-00, hdrtype=0x00, mfdev=1 subordinatebus=0 secondarybus=0 intpin=a, irq=10 map[10]: type 1, range 32, base 00009000, size 8 map[14]: type 1, range 64, base f5000000, size 12 Freeing (NOT implemented) redirected PCI irq 11. found-> vendor=0x9005, dev=0x00cf, revid=0x01 class=01-00-00, hdrtype=0x00, mfdev=1 subordinatebus=0 secondarybus=0 intpin=b, irq=10 map[10]: type 1, range 32, base 00009400, size 8 map[14]: type 1, range 64, base f5002000, size 12 pci3: on pcib3 pci3: (vendor=0x8086, dev=0x1161) at 0.0 ahc0: port 0x9000-0x90ff mem 0xf5000000-0xf5000fff irq 10 at device 4.0 on pci3 ahc0: Defaulting to MEMIO off ahc0: Reading SEEPROM...done. ahc0: Manual SE Termination ahc0: Manual LVD Termination ahc0: BIOS eeprom is present ahc0: Secondary High byte termination Enabled ahc0: Secondary Low byte termination Enabled ahc0: Primary Low Byte termination Enabled ahc0: Primary High Byte termination Enabled ahc0: Downloading Sequencer Program... 423 instructions downloaded ahc0: Features 0x1fef6, Bugs 0x40, Flags 0x28485560 aic7899: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs ahc1: port 0x9400-0x94ff mem 0xf5002000-0xf5002fff irq 10 at device 4.1 on pci3 ahc1: Defaulting to MEMIO off ahc1: Reading SEEPROM...done. ahc1: Manual SE Termination ahc1: Manual LVD Termination ahc1: BIOS eeprom is present ahc1: Secondary High byte termination Enabled ahc1: Secondary Low byte termination Enabled ahc1: Primary Low Byte termination Enabled ahc1: Primary High Byte termination Enabled ahc1: Downloading Sequencer Program... 423 instructions downloaded ahc1: Features 0x1fef6, Bugs 0x40, Flags 0x20485560 using shared irq10. aic7899: Ultra160 Wide Channel B, SCSI Id=7, 32/253 SCBs pcib4: at device 30.0 on pci0 Freeing (NOT implemented) redirected PCI irq 11. found-> vendor=0x8086, dev=0x1076, revid=0x00 class=02-00-00, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 intpin=a, irq=10 map[10]: type 1, range 32, base f8120000, size 17 map[14]: type 1, range 32, base f8100000, size 17 map[18]: type 1, range 32, base 0000a000, size 6 IOAPIC #0 intpin 16 -> irq 11 Freeing (NOT implemented) redirected PCI irq 10. found-> vendor=0x8086, dev=0x1229, revid=0x08 class=02-00-00, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 intpin=a, irq=11 map[10]: type 1, range 32, base f8140000, size 12 map[14]: type 1, range 32, base 0000a400, size 6 map[18]: type 1, range 32, base f8000000, size 20 Freeing (NOT implemented) redirected PCI irq 10. found-> vendor=0x1002, dev=0x4752, revid=0x27 class=03-00-00, hdrtype=0x00, mfdev=0 subordinatebus=0 secondarybus=0 intpin=a, irq=11 map[10]: type 1, range 32, base f7000000, size 24 map[14]: type 1, range 32, base 0000a800, size 8 map[18]: type 1, range 32, base f8141000, size 12 pci4: on pcib4 em0: port 0xa000-0xa03f mem 0xf8100000-0xf811ffff,0xf8120000-0xf813ffff irq 10 at device 2.0 on pci4 bpf: em0 attached em0: Speed:N/A Duplex:N/A fxp0: port 0xa400-0xa43f mem 0xf8000000-0xf80fffff,0xf8140000-0xf8140fff irq 11 at device 4.0 on pci4 fxp0: using memory space register mapping fxp0: Ethernet address 00:30:48:22:6e:3e fxp0: PCI IDs: 8086 1229 8086 100c 0008 fxp0: Dynamic Standby mode is disabled inphy0: on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto bpf: fxp0 attached pci4: (vendor=0x1002, dev=0x4752) at 7.0 irq 11 isab0: at device 31.0 on pci0 isa0: on isab0 pci0: (vendor=0x8086, dev=0x244b) at 31.1 pci0: (vendor=0x8086, dev=0x2442) at 31.2 irq 2 pci0: (vendor=0x8086, dev=0x2443) at 31.3 irq 5 pci0: (vendor=0x8086, dev=0x2444) at 31.4 irq 7 Trying Read_Port at 203 Trying Read_Port at 243 Trying Read_Port at 283 Trying Read_Port at 2c3 Trying Read_Port at 303 Trying Read_Port at 343 Trying Read_Port at 383 Trying Read_Port at 3c3 isa_probe_children: disabling PnP devices isa_probe_children: probing non-PnP devices orm0: