From owner-freebsd-net@FreeBSD.ORG Thu Jul 23 16:27:19 2009 Return-Path: Delivered-To: freebsd-net@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BDDFC106566B for ; Thu, 23 Jul 2009 16:27:19 +0000 (UTC) (envelope-from psteele@webmail.maxiscale.com) Received: from k2smtpout06-01.prod.mesa1.secureserver.net (k2smtpout06-01.prod.mesa1.secureserver.net [64.202.189.102]) by mx1.freebsd.org (Postfix) with SMTP id 8E7DA8FC08 for ; Thu, 23 Jul 2009 16:27:19 +0000 (UTC) (envelope-from psteele@webmail.maxiscale.com) Received: (qmail 25120 invoked from network); 23 Jul 2009 15:58:11 -0000 Received: from unknown (HELO owa.webmail.maxiscale.com) (72.167.52.135) by k2smtpout06-01.prod.mesa1.secureserver.net (64.202.189.102) with ESMTP; 23 Jul 2009 15:58:11 -0000 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: multipart/related; boundary="----_=_NextPart_001_01CA0BAF.0AE74E16"; type="multipart/alternative" Date: Thu, 23 Jul 2009 08:58:07 -0700 Message-ID: X-MS-Has-Attach: yes X-MS-TNEF-Correlator: Thread-Topic: nfe taskq performance issues Thread-Index: AcoLrl6qpviDJaoaRFaDGMkojP3VIQ== From: "Peter Steele" To: X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Subject: nfe taskq performance issues X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jul 2009 16:27:20 -0000 This is a multi-part message in MIME format. ------_=_NextPart_001_01CA0BAF.0AE74E16 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable We've been hitting serious nfe taskq performance issues during stress tests and in doing some research on the problem we came across this old email: =20 From: Ivan Voras Date: April 28, 2009 3:53:14 AM PDT To: freebsd-threads@freebsd.org Cc: freebsd-net@freebsd.org, freebsd-performance@freebsd.org Subject: Re: FreeBSD 7.1 taskq em performance > > I have been hitting some barrier with FreeBSD 7.1 network performance. I > have written an application which contains two kernel threads that takes > mbufs directly from a network interface and forwards to another network > interface. This idea is to simulate different network environment. > > I have been using FreeBSD 6.4 amd64 and tested with an Ixia box > (specialised hardware firing very high packet rate). The PC was a Core2 2.6 > GHz with dual ports Intel PCIE Gigabit network card. It can manage up to 1.2 > million pps. > > I have a higher spec PC with FreeBSD 7.1 amd64 and Quadcore 2.3 GHz and > PCIE Gigabit network card. The performance can only achieve up to 600k pps. > I notice the 'taskq em0' and 'taskq em1' is solid 100% CPU but it is not in > FreeBSD 6.4.=20 =20 In our case we are running FreeBSD 7.0, but we are seeing our boxes experience serious thread starvation issues as the nfe0 cpu percentage climbs steadily while cpu idle time drops at times to 0 percent. This email thread mentioned a patch for the em driver here: =20 http://people.yandex-team.ru/~wawa/=20 =20 =20 Does anyone know if this patch will work with the nfe driver? =20 ------_=_NextPart_001_01CA0BAF.0AE74E16--