From owner-freebsd-net@FreeBSD.ORG Thu Mar 8 06:23:57 2012 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 80CFA106566B; Thu, 8 Mar 2012 06:23:57 +0000 (UTC) (envelope-from pyunyh@gmail.com) Received: from mail-pw0-f54.google.com (mail-pw0-f54.google.com [209.85.160.54]) by mx1.freebsd.org (Postfix) with ESMTP id 3DE6A8FC0C; Thu, 8 Mar 2012 06:23:57 +0000 (UTC) Received: by pbcwz17 with SMTP id wz17so1397396pbc.13 for ; Wed, 07 Mar 2012 22:23:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:date:to:cc:subject:message-id:reply-to:references:mime-version :content-type:content-disposition:content-transfer-encoding :in-reply-to:user-agent; bh=i9ke112cSqHghvbfrOnAgi/ga4/pIEIWOAVa2j6HrTk=; b=Ozm7WUnTPzWBIqCuGeQqiLl/snpo+tH3x2+UA4buxvn5yKoRIt3nrG2XR2yUvSCCbA gATSD3FHp1x++RMXBCDLoy820gCOjuAAPKPuaX4to5g3ZnQDilIv5pWNTUJRnuJjqpHR sB80q81FNhDuFlZin4kZ9oOtA9J1U5XqslgkbOZtfLdWEcGmj2EkYYH31YN3BVkal8ED Tz4DcpfRfY/cVxh4Q7MvDNWhlgxK71B9aWvYfgXSxPOh+ooDcG8snptZq34Z1sH/TUWy jOp4/22keBi3kbkpCRmdA31oKg5wYAYk2MxCpXdOU8hgqKgL56ytB+G1Yb3bwg5hCq4g IZMg== Received: by 10.68.191.168 with SMTP id gz8mr7636119pbc.37.1331187836915; Wed, 07 Mar 2012 22:23:56 -0800 (PST) Received: from pyunyh@gmail.com ([114.111.62.249]) by mx.google.com with ESMTPS id o7sm2094893pbq.8.2012.03.07.22.23.54 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 07 Mar 2012 22:23:56 -0800 (PST) Received: by pyunyh@gmail.com (sSMTP sendmail emulation); Thu, 08 Mar 2012 15:23:46 -0800 From: YongHyeon PYUN Date: Thu, 8 Mar 2012 15:23:46 -0800 To: Eugene Grosbein Message-ID: <20120308232346.GA15604@michelle.cdnetworks.com> References: <4F5608EA.6080705@rdtc.ru> <20120307202914.GB9436@michelle.cdnetworks.com> <4F571870.3090902@rdtc.ru> <20120308034345.GD9436@michelle.cdnetworks.com> <4F578FE1.1000808@rdtc.ru> <20120308190628.GB13138@michelle.cdnetworks.com> <4F584896.5010807@rdtc.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <4F584896.5010807@rdtc.ru> User-Agent: Mutt/1.4.2.3i Cc: marius@freebsd.org, yongari@freebsd.org, "net@freebsd.org" Subject: Re: suboptimal bge(4) BCM5704 performance in RELENG_8 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: pyunyh@gmail.com List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Mar 2012 06:23:57 -0000 On Thu, Mar 08, 2012 at 12:50:14PM +0700, Eugene Grosbein wrote: > 09.03.2012 02:06, YongHyeon PYUN пишет: > > On Wed, Mar 07, 2012 at 11:42:09PM +0700, Eugene Grosbein wrote: > >> 08.03.2012 10:43, YongHyeon PYUN пишет: > >> > >>>>> Show me the output of "sysctl dev.bge.0.stats". > >>>> > >>>> # sysctl dev.bge.0.stats > >>>> dev.bge.0.stats.FramesDroppedDueToFilters: 0 > >>>> dev.bge.0.stats.DmaWriteQueueFull: 84072 > >>>> dev.bge.0.stats.DmaWriteHighPriQueueFull: 0 > >>>> dev.bge.0.stats.NoMoreRxBDs: 0 > >>>> dev.bge.0.stats.InputDiscards: 0 > >>>> dev.bge.0.stats.InputErrors: 30 > >>>> dev.bge.0.stats.RecvThresholdHit: 745400662 > >>>> dev.bge.0.stats.DmaReadQueueFull: 2020586592 > >>>> dev.bge.0.stats.DmaReadHighPriQueueFull: 0 > >>>> dev.bge.0.stats.SendDataCompQueueFull: 0 > >>>> dev.bge.0.stats.RingSetSendProdIndex: 2832885493 > >>>> dev.bge.0.stats.RingStatusUpdate: 899990835 > >>>> dev.bge.0.stats.Interrupts: 899990835 > >>>> dev.bge.0.stats.AvoidedInterrupts: 0 > >>>> dev.bge.0.stats.SendThresholdHit: 0 > >>>> dev.bge.0.stats.rx.ifHCInOctets: 491268800 > >>>> dev.bge.0.stats.rx.Fragments: 234 > >>>> dev.bge.0.stats.rx.UnicastPkts: 1977202324 > >>>> dev.bge.0.stats.rx.MulticastPkts: 0 > >>>> dev.bge.0.stats.rx.FCSErrors: 341 > >>> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ > >>> You have multiple FCS and Input errors. Check signal > >>> quality(i.e. UTP cable). > > Btw, I still think these errors are pretty seldom and cannot explain > why I can't get full output gigabit speed. And what do these Right. > DmaWriteQueueFull/DmaReadQueueFull mean? Will it help to increase State machine in controller will add DMA descriptors to DMA engine whenever controller send/receive frames. These numbers indicate how many times the state machine sees DMA write/read queue full. And the state machine will have to retry the operation once it see a queue full. > interface FIFO queue to eliminate output drops? > These queues reside in internal RISC processors and I don't think there is an interface that changes the queue length. It's not normal FIFO which is used to send/receive a frame. I don't see any abnormal DMA configuration for PCI-X 5704 so I'm still interested in knowing netperf benchmark result. > Eugene Grosbein