From owner-freebsd-performance@FreeBSD.ORG Mon Sep 18 13:52:19 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BE27816A586; Mon, 18 Sep 2006 13:52:19 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9B4D843D7C; Mon, 18 Sep 2006 13:52:16 +0000 (GMT) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id 3A4F046CDF; Mon, 18 Sep 2006 09:52:12 -0400 (EDT) Date: Mon, 18 Sep 2006 14:52:12 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Ingo In-Reply-To: Message-ID: <20060918145122.W1253@fledge.watson.org> References: MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-1471660594-1158587532=:1253" Cc: freebsd-performance@freebsd.org, freebsd-stable@freebsd.org Subject: Re: network performance problem X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Sep 2006 13:52:19 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-1471660594-1158587532=:1253 Content-Type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE On Wed, 13 Sep 2006, Ingo wrote: > I`ve some problems with the network performance on my Soekris NET 4801.= =20 > (Freebsd 6.1 release-p3) > > When I start "netio" on the soekris and do a "netio localhost", I get abo= ut=20 > 8.4 MB/sec, and when I start with "netio 192.168.0.11"(it=B4s localhost= =20 > address) I get only ~2.3 MB/sec. That=B4s what top says when I do: What does "route get 192.168.0.11" return? What happens if you force the localhost MTU from whatever the default is (m= ost=20 likely 16k) to the same as the ethernet interface? Robert N M Watson Computer Laboratory University of Cambridge > > localhost > CPU states: 2.3% user, 0.0% nice, 72.5% system, 25.2% interrupt, 0.0% = idle > > 192.168.0.11 > CPU states: 1.2% user, 0.0% nice, 46.3% system, 52.5% interrupt, 0.0% = idle > > As you can see, the interrupt load is more than doubled when I use the Ip= =20 > address, and > I=B4ve no idea why. > > > Here are some other throughput results of the soekris: > > openbsd# ftp 192.16.8.0.20=092.0 MB/sec > openbsd# iperf localhost 1.4 Mbit/sec > openbsd# iperf 192.168.0.11(it=B4s localhost address) 1.4 Mbit/sec > openbsd# netperf localhost 70MB/sec > openbsd# netperf 192.168.0.11(it=B4s localhost address) 70MB/sec > > freebsd# ftp 192.168.0.20 2.3 MB/sec > Freebsd# iperf localhost 45 Mbit/sec > Freebsd# iperf 192.168.0.11 (it=B4s localhost address) 19 Mbit/sec > Freebsd# netperf localhost 67 Mbit/sec > Freebsd# netperf 192.168.0.11 (it=B4s localhost address) 19 Mbit/sec > > > What causes the difference between localhost and the ip address on Freebs= d? > On Openbsd there is no diffenerce at all. > > > Greetings > --=20 > Erstellt mit Operas revolution=E4rem E-Mail-Modul: http://www.opera.com/m= ail/ > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to=20 > "freebsd-performance-unsubscribe@freebsd.org" --0-1471660594-1158587532=:1253-- From owner-freebsd-performance@FreeBSD.ORG Mon Sep 18 18:46:57 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4C86A16A53F; Mon, 18 Sep 2006 18:46:57 +0000 (UTC) (envelope-from ingom-list@freenet.de) Received: from mout2.freenet.de (mout2.freenet.de [194.97.50.155]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1BEC043DF8; Mon, 18 Sep 2006 18:46:15 +0000 (GMT) (envelope-from ingom-list@freenet.de) Received: from [194.97.50.135] (helo=mx2.freenet.de) by mout2.freenet.de with esmtpa (Exim 4.62) (envelope-from ) id 1GPO7T-0005fJ-AG; Mon, 18 Sep 2006 20:45:27 +0200 Received: from p54b19737.dip0.t-ipconnect.de ([84.177.151.55] helo=medion-8800) by mx2.freenet.de with esmtpa (ID ingom-list@freenet.de) (Exim 4.62 #12) id 1GPO7S-0000TN-Vd; Mon, 18 Sep 2006 20:45:27 +0200 Date: Mon, 18 Sep 2006 20:45:23 +0200 To: "Robert Watson" From: Ingo Content-Type: text/plain; format=flowed; delsp=yes; charset=utf-8 MIME-Version: 1.0 References: <20060918145122.W1253@fledge.watson.org> Content-Transfer-Encoding: 8bit Message-ID: In-Reply-To: <20060918145122.W1253@fledge.watson.org> User-Agent: Opera Mail/9.01 (Win32) Cc: freebsd-performance@freebsd.org, freebsd-stable@freebsd.org Subject: Re: network performance problem X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Sep 2006 18:46:57 -0000 Hi, heres the output of route get 192.168.0.11: localhost# route get 192.168.0.11 route to: 192.168.0.11 destination: 192.168.0.0 mask: 255.255.255.0 interface: sis0 flags: recvpipe sendpipe ssthresh rtt,msec rttvar hopcount mtu expire 0 0 0 0 0 0 1500 -69 I set the lo0 interface as you recommended from 16384 to 1500. Now I have the same thoughput as with the IP (~2.3MB/s). Shouldn´t FreeBSD recognize, that it is it´s local address, like openbsd does? Greetings Am 18.09.2006, 15:52 Uhr, schrieb Robert Watson : > > On Wed, 13 Sep 2006, Ingo wrote: > >> I`ve some problems with the network performance on my Soekris NET 4801. >> (Freebsd 6.1 release-p3) >> >> When I start "netio" on the soekris and do a "netio localhost", I get >> about >> 8.4 MB/sec, and when I start with "netio 192.168.0.11"(it´s localhost >> address) I get only ~2.3 MB/sec. That´s what top says when I do: > > What does "route get 192.168.0.11" return? > > What happens if you force the localhost MTU from whatever the default is > (most > likely 16k) to the same as the ethernet interface? > > Robert N M Watson > Computer Laboratory > University of Cambridge > >> >> localhost >> CPU states: 2.3% user, 0.0% nice, 72.5% system, 25.2% interrupt, >> 0.0% idle >> >> 192.168.0.11 >> CPU states: 1.2% user, 0.0% nice, 46.3% system, 52.5% interrupt, >> 0.0% idle >> >> As you can see, the interrupt load is more than doubled when I use the >> Ip >> address, and >> I´ve no idea why. >> >> >> Here are some other throughput results of the soekris: >> >> openbsd# ftp 192.16.8.0.20 2.0 MB/sec >> openbsd# iperf localhost 1.4 Mbit/sec >> openbsd# iperf 192.168.0.11(it´s localhost address) 1.4 Mbit/sec >> openbsd# netperf localhost 70MB/sec >> openbsd# netperf 192.168.0.11(it´s localhost address) 70MB/sec >> >> freebsd# ftp 192.168.0.20 2.3 MB/sec >> Freebsd# iperf localhost 45 Mbit/sec >> Freebsd# iperf 192.168.0.11 (it´s localhost address) 19 Mbit/sec >> Freebsd# netperf localhost 67 Mbit/sec >> Freebsd# netperf 192.168.0.11 (it´s localhost address) 19 Mbit/sec >> >> >> What causes the difference between localhost and the ip address on >> Freebsd? >> On Openbsd there is no diffenerce at all. >> >> >> Greetings >> -- >> Erstellt mit Operas revolutionärem E-Mail-Modul: >> http://www.opera.com/mail/ >> _______________________________________________ >> freebsd-performance@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> To unsubscribe, send any mail to >> "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Mon Sep 18 18:56:51 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2E0F716A416; Mon, 18 Sep 2006 18:56:51 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [209.31.154.42]) by mx1.FreeBSD.org (Postfix) with ESMTP id A7E7B43D4C; Mon, 18 Sep 2006 18:56:47 +0000 (GMT) (envelope-from rwatson@FreeBSD.org) Received: from fledge.watson.org (fledge.watson.org [209.31.154.41]) by cyrus.watson.org (Postfix) with ESMTP id 56B3746B84; Mon, 18 Sep 2006 14:56:47 -0400 (EDT) Date: Mon, 18 Sep 2006 19:56:47 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Ingo In-Reply-To: Message-ID: <20060918195616.I25638@fledge.watson.org> References: <20060918145122.W1253@fledge.watson.org> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-871351975-1158605807=:25638" Cc: freebsd-performance@freebsd.org, freebsd-stable@freebsd.org Subject: Re: network performance problem X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Sep 2006 18:56:51 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-871351975-1158605807=:25638 Content-Type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: QUOTED-PRINTABLE On Mon, 18 Sep 2006, Ingo wrote: > heres the output of route get 192.168.0.11: > > localhost# route get 192.168.0.11 > route to: 192.168.0.11 > destination: 192.168.0.0 > mask: 255.255.255.0 > interface: sis0 > flags: > recvpipe sendpipe ssthresh rtt,msec rttvar hopcount mtu=20 > expire > 0 0 0 0 0 0 1500 = -69 > > I set the lo0 interface as you recommended from 16384 to 1500. Now I have= =20 > the same thoughput as with the IP (~2.3MB/s). > > Shouldn=B4t FreeBSD recognize, that it is it=B4s local address, like open= bsd=20 > does? What MTU does OpenBSD use on its loopback interface as compared to the=20 network interface? Robert N M Watson Computer Laboratory University of Cambridge > > > Greetings > > > Am 18.09.2006, 15:52 Uhr, schrieb Robert Watson : > >>=20 >> On Wed, 13 Sep 2006, Ingo wrote: >>=20 >>> I`ve some problems with the network performance on my Soekris NET 4801. >>> (Freebsd 6.1 release-p3) >>>=20 >>> When I start "netio" on the soekris and do a "netio localhost", I get= =20 >>> about >>> 8.4 MB/sec, and when I start with "netio 192.168.0.11"(it=B4s localhost >>> address) I get only ~2.3 MB/sec. That=B4s what top says when I do: >>=20 >> What does "route get 192.168.0.11" return? >>=20 >> What happens if you force the localhost MTU from whatever the default is= =20 >> (most >> likely 16k) to the same as the ethernet interface? >>=20 >> Robert N M Watson >> Computer Laboratory >> University of Cambridge >>=20 >>>=20 >>> localhost >>> CPU states: 2.3% user, 0.0% nice, 72.5% system, 25.2% interrupt, 0.0= %=20 >>> idle >>>=20 >>> 192.168.0.11 >>> CPU states: 1.2% user, 0.0% nice, 46.3% system, 52.5% interrupt, 0.0= %=20 >>> idle >>>=20 >>> As you can see, the interrupt load is more than doubled when I use the = Ip >>> address, and >>> I=B4ve no idea why. >>>=20 >>>=20 >>> Here are some other throughput results of the soekris: >>>=20 >>> openbsd# ftp 192.16.8.0.20=092.0 MB/sec >>> openbsd# iperf localhost 1.4 Mbit/sec >>> openbsd# iperf 192.168.0.11(it=B4s localhost address) 1.4 Mbit/sec >>> openbsd# netperf localhost 70MB/sec >>> openbsd# netperf 192.168.0.11(it=B4s localhost address) 70MB/sec >>>=20 >>> freebsd# ftp 192.168.0.20 2.3 MB/sec >>> Freebsd# iperf localhost 45 Mbit/sec >>> Freebsd# iperf 192.168.0.11 (it=B4s localhost address) 19 Mbit/sec >>> Freebsd# netperf localhost 67 Mbit/sec >>> Freebsd# netperf 192.168.0.11 (it=B4s localhost address) 19 Mbit/sec >>>=20 >>>=20 >>> What causes the difference between localhost and the ip address on=20 >>> Freebsd? >>> On Openbsd there is no diffenerce at all. >>>=20 >>>=20 >>> Greetings >>> -- >>> Erstellt mit Operas revolution=E4rem E-Mail-Modul:=20 >>> http://www.opera.com/mail/ >>> _______________________________________________ >>> freebsd-performance@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >>> To unsubscribe, send any mail to >>> "freebsd-performance-unsubscribe@freebsd.org" > > --0-871351975-1158605807=:25638-- From owner-freebsd-performance@FreeBSD.ORG Mon Sep 18 19:41:49 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4B8A916A47B; Mon, 18 Sep 2006 19:41:49 +0000 (UTC) (envelope-from ingom-list@freenet.de) Received: from mout0.freenet.de (mout0.freenet.de [194.97.50.131]) by mx1.FreeBSD.org (Postfix) with ESMTP id DA7F343D55; Mon, 18 Sep 2006 19:41:21 +0000 (GMT) (envelope-from ingom-list@freenet.de) Received: from [194.97.50.135] (helo=mx2.freenet.de) by mout0.freenet.de with esmtpa (Exim 4.62) (envelope-from ) id 1GPOzY-0003hn-0S; Mon, 18 Sep 2006 21:41:20 +0200 Received: from p54b19737.dip0.t-ipconnect.de ([84.177.151.55] helo=medion-8800) by mx2.freenet.de with esmtpa (ID ingom-list@freenet.de) (Exim 4.62 #12) id 1GPOzX-00053C-Li; Mon, 18 Sep 2006 21:41:19 +0200 Date: Mon, 18 Sep 2006 21:41:14 +0200 To: "Robert Watson" From: Ingo Content-Type: text/plain; format=flowed; delsp=yes; charset=utf-8 MIME-Version: 1.0 References: <20060918145122.W1253@fledge.watson.org> <20060918195616.I25638@fledge.watson.org> Content-Transfer-Encoding: 8bit Message-ID: In-Reply-To: <20060918195616.I25638@fledge.watson.org> User-Agent: Opera Mail/9.01 (Win32) Cc: freebsd-performance@freebsd.org, freebsd-stable@freebsd.org Subject: Re: network performance problem X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Sep 2006 19:41:49 -0000 OpenBSD uses on sis0 MTU=1500 and lo0= MTU=33224 Am 18.09.2006, 20:56 Uhr, schrieb Robert Watson : > On Mon, 18 Sep 2006, Ingo wrote: > >> heres the output of route get 192.168.0.11: >> >> localhost# route get 192.168.0.11 >> route to: 192.168.0.11 >> destination: 192.168.0.0 >> mask: 255.255.255.0 >> interface: sis0 >> flags: >> recvpipe sendpipe ssthresh rtt,msec rttvar hopcount mtu >> expire >> 0 0 0 0 0 0 >> 1500 -69 >> >> I set the lo0 interface as you recommended from 16384 to 1500. Now I >> have >> the same thoughput as with the IP (~2.3MB/s). >> >> Shouldn´t FreeBSD recognize, that it is it´s local address, like openbsd >> does? > > What MTU does OpenBSD use on its loopback interface as compared to the > network interface? > > Robert N M Watson > Computer Laboratory > University of Cambridge > >> >> >> Greetings >> >> >> Am 18.09.2006, 15:52 Uhr, schrieb Robert Watson : >> >>> >>> On Wed, 13 Sep 2006, Ingo wrote: >>> >>>> I`ve some problems with the network performance on my Soekris NET >>>> 4801. >>>> (Freebsd 6.1 release-p3) >>>> >>>> When I start "netio" on the soekris and do a "netio localhost", I get >>>> about >>>> 8.4 MB/sec, and when I start with "netio 192.168.0.11"(it´s localhost >>>> address) I get only ~2.3 MB/sec. That´s what top says when I do: >>> >>> What does "route get 192.168.0.11" return? >>> >>> What happens if you force the localhost MTU from whatever the default >>> is >>> (most >>> likely 16k) to the same as the ethernet interface? >>> >>> Robert N M Watson >>> Computer Laboratory >>> University of Cambridge >>> >>>> >>>> localhost >>>> CPU states: 2.3% user, 0.0% nice, 72.5% system, 25.2% interrupt, >>>> 0.0% >>>> idle >>>> >>>> 192.168.0.11 >>>> CPU states: 1.2% user, 0.0% nice, 46.3% system, 52.5% interrupt, >>>> 0.0% >>>> idle >>>> >>>> As you can see, the interrupt load is more than doubled when I use >>>> the Ip >>>> address, and >>>> I´ve no idea why. >>>> >>>> >>>> Here are some other throughput results of the soekris: >>>> >>>> openbsd# ftp 192.16.8.0.20 2.0 MB/sec >>>> openbsd# iperf localhost 1.4 Mbit/sec >>>> openbsd# iperf 192.168.0.11(it´s localhost address) 1.4 Mbit/sec >>>> openbsd# netperf localhost 70MB/sec >>>> openbsd# netperf 192.168.0.11(it´s localhost address) 70MB/sec >>>> >>>> freebsd# ftp 192.168.0.20 2.3 MB/sec >>>> Freebsd# iperf localhost 45 Mbit/sec >>>> Freebsd# iperf 192.168.0.11 (it´s localhost address) 19 Mbit/sec >>>> Freebsd# netperf localhost 67 Mbit/sec >>>> Freebsd# netperf 192.168.0.11 (it´s localhost address) 19 Mbit/sec >>>> >>>> >>>> What causes the difference between localhost and the ip address on >>>> Freebsd? >>>> On Openbsd there is no diffenerce at all. >>>> >>>> >>>> Greetings >>>> -- >>>> Erstellt mit Operas revolutionärem E-Mail-Modul: >>>> http://www.opera.com/mail/ >>>> _______________________________________________ >>>> freebsd-performance@freebsd.org mailing list >>>> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >>>> To unsubscribe, send any mail to >>>> "freebsd-performance-unsubscribe@freebsd.org" >>