From owner-freebsd-stable@FreeBSD.ORG  Sat Sep 20 20:31:49 2014
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 3EC96D73
 for <freebsd-stable@freebsd.org>; Sat, 20 Sep 2014 20:31:49 +0000 (UTC)
Received: from mail-we0-x22c.google.com (mail-we0-x22c.google.com
 [IPv6:2a00:1450:400c:c03::22c])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id CD7CA81F
 for <freebsd-stable@freebsd.org>; Sat, 20 Sep 2014 20:31:48 +0000 (UTC)
Received: by mail-we0-f172.google.com with SMTP id p10so764446wes.31
 for <freebsd-stable@freebsd.org>; Sat, 20 Sep 2014 13:31:46 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=ur2hgV93hWeuGfE2FMUn3a22osZoe2PNU4LN3rz+cB8=;
 b=Ur2ut/fjfgj6MfXdsNeLzCC94iIOPT2hW5LDCm2OMbs2tYPRQ080zzPM6Y7dDz505p
 cyDA3z3ioTQzF0YGbjMrqfTP7Rejb5ZPst5lodqbFiWJWDoddIXB0tCmW8onShw3WtcY
 gj8mf8D2uNCRIYDa/8t9eee6+mLfCgnnAWCziAdxNTtfaa5NwkV15vjaOiK4KUbcfkWM
 HZRwO4qqONtY9Mk+4Tryrce1XjI8+nVQd/5g//fvEVo7SqK/2VhA0+MpAl+6QdNJuGGb
 LHdN4svsvm7S9sBlN1UICmrXH5T1aoJh900JWLdk5rkwf3IGA/7jLUi1zA9qmm6Wm/h+
 LakQ==
MIME-Version: 1.0
X-Received: by 10.180.101.129 with SMTP id fg1mr5115892wib.20.1411245106045;
 Sat, 20 Sep 2014 13:31:46 -0700 (PDT)
Sender: adrian.chadd@gmail.com
Received: by 10.216.106.199 with HTTP; Sat, 20 Sep 2014 13:31:45 -0700 (PDT)
In-Reply-To: <CAENR+_VDVvnY0zWKVXHOjz2vWw27s+yVrz9ZFokZ=p6P6oFNvw@mail.gmail.com>
References: <CAENR+_VDVvnY0zWKVXHOjz2vWw27s+yVrz9ZFokZ=p6P6oFNvw@mail.gmail.com>
Date: Sat, 20 Sep 2014 13:31:45 -0700
X-Google-Sender-Auth: EHYWrLV_FjslSJV5Yq9NZ2k_6tI
Message-ID: <CAJ-Vmo=M-Z+w53jutuiA_1Fjsp3kL8=Ug3z9t-n5-6MbCRLQwQ@mail.gmail.com>
Subject: Re: FreeBSD 10 network performance problems
From: Adrian Chadd <adrian@freebsd.org>
To: Rumen Telbizov <telbizov@gmail.com>
Content-Type: text/plain; charset=UTF-8
Cc: "freebsd-stable@freebsd.org" <freebsd-stable@freebsd.org>
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-stable>,
 <mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable/>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
 <mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 20 Sep 2014 20:31:49 -0000

Hi,

The forwarding paths don't 100% use flowtable, so there's still
routing table lookups.

All those highly contended locks are the rtentry locking because the
forwarding and fast forwarding paths don't use flowtable.

This shouldn't be a difficult problem to solve; someone just has to go
through those places above, figure out what code is doing the lookups
and convert them to use flowtable.

The one place that's currently a pain is how IPv4 redirects are
handled; you can turn them off with a sysctl.


-a