From owner-freebsd-net@freebsd.org Thu Aug 13 20:43:20 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59E849B8524 for ; Thu, 13 Aug 2015 20:43:20 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: from mail-wi0-f179.google.com (mail-wi0-f179.google.com [209.85.212.179]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EE63FA19 for ; Thu, 13 Aug 2015 20:43:19 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: by wicja10 with SMTP id ja10so163503039wic.1 for ; Thu, 13 Aug 2015 13:43:11 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:date:message-id:subject:from :to:cc:content-type; bh=h6gHhS24Cb5lMQUrJIbSyUVRczzMGwfy1Jc8dtGv3cs=; b=labDtKjhk8DvMd75HR7FyiTyEyCWCWUG6mkChRCqCJ6TW0TNuEQtGcAm6qHpVYJLAC 1BCUh2lY1I4wl0alE90OqZzjLe9xgV4qj6oxqrtD34f0sTtw7TwquDAjKDp0RQuBNzWG FEgOFUz9nkkhDEOcKsmz1u67fmgXyOfrnVWvLMjtBzCW8/n+bTZbrgsJhH6UJ1VlH+ar Y3NGRyH3cv7jecVIj1vwIpkZV9EvrIlR10jUYKMiia1sW7NoE4uAlgr8GNepnE3piaBx j8QCKTQXWG5dVeC9mvOoY0EMc2XFoTkL5VXkvM2j4kLPkpxSPZH54nLMd2fMLUzaf88f XdMg== X-Gm-Message-State: ALoCoQlHi8Oo1d9G4s2Um9U6Ln3TeTkloHLcl2itY7MNVHyIsXjKHiwh/+7Pk9SZLvbP3JiHb98x MIME-Version: 1.0 X-Received: by 10.180.91.14 with SMTP id ca14mr10537731wib.5.1439498591733; Thu, 13 Aug 2015 13:43:11 -0700 (PDT) Sender: sobomax@sippysoft.com Received: by 10.27.143.15 with HTTP; Thu, 13 Aug 2015 13:43:11 -0700 (PDT) Date: Thu, 13 Aug 2015 13:43:11 -0700 X-Google-Sender-Auth: vTa5vjzrqCTxG1b6_ad0_zpolho Message-ID: Subject: Re: Poor high-PPS performance of the 10G ixgbe(9) NIC/driver in FreeBSD 10.1 From: Maxim Sobolev To: Adrian Chadd Cc: Luigi Rizzo , "Alexander V. Chernikov" , FreeBSD Net , Babak Farrokhi , "freebsd@intel.com" , =?UTF-8?Q?Jev_Bj=C3=B6rsell?= , =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Aug 2015 20:43:20 -0000 Thanks, we'll try that as well. We have not got as much traffic in the past 2 days, so we were running at about 140Kpps, well below the level that used to cause issues before. I'll try to redistribute traffic tomorrow so that we get it tested. -Max On Wed, Aug 12, 2015 at 11:47 PM, Adrian Chadd wrote: > Hi, > > Try this: > > * I'd disable AIM and hard-set interrupts to something sensible; > * I'd edit sys/conf/files and sys/dev/ixgbe/Makefile on 10.1 and > remove the '-DIXGBE_FDIR' bit that enabled flow director - the > software setup for flow director is buggy, and it causes things to get > wildly unhappy. >