From owner-freebsd-net@freebsd.org Wed Jan 11 09:24:08 2017 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 47BBCCAA793; Wed, 11 Jan 2017 09:24:08 +0000 (UTC) (envelope-from cochard@gmail.com) Received: from mail-qk0-x243.google.com (mail-qk0-x243.google.com [IPv6:2607:f8b0:400d:c09::243]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 01B1D1BF5; Wed, 11 Jan 2017 09:24:08 +0000 (UTC) (envelope-from cochard@gmail.com) Received: by mail-qk0-x243.google.com with SMTP id 11so14521926qkl.0; Wed, 11 Jan 2017 01:24:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=qHk+1HQQXMNJmCEne6ErGzm6iHqTjvN06ucD40zRCk0=; b=vK+DTbKcV5WpgSd/4bN/9+pDPYUlfIJkISQDquMckKU+0XSqt87FpWsHLxTekLVCui IAHQep8s+KVFohS9bs8wc8VTXDEpLzHp751nVZtdQH5v6Y+wztmhk9x+zYl+LJT2lqxr YVxKkB3k028beWz4M6s0OKq8aF4phG8xq8Xjzo2n+umR+zussQpIonNY4dHQ2lvFYEBw pcnYSzJeacvy6qbmJURMel1CiR7S6VM/6wiMjT4piFVW641oHpLxfHhwC0uO9VD8vuhC AEOhygGdiBKvtB1+JNWrkufIMv703JAPC5AMgjl7Rmsurj6CAd5ZWncfF8a0YpHTom2q GcQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=qHk+1HQQXMNJmCEne6ErGzm6iHqTjvN06ucD40zRCk0=; b=IQlNczWsARa6VeSgLY/kxA0CIrwsTXnX0LJoqrvGmJ7IHnQTdy7TQ4kS4YCi8KFcFD SUyjZwbtiijPxqAvgZxaoW3ylxlJfOShXHFufYNZXTkqLsAwdN/SlFCsL1ATvF6Raa2g f8w8HKGqwanZj4PEQmCvxTWtgvUO+LgXxflX7h/dUvLrCPnPZ8UVCCiXK1+xCSLMvL4k Aibq1fwJNVkR6su1IZPyzs9988Wj90q6l2WPkixYVRvnLNXa1VOl6nsNdHae/xPvnK8f SxveLs6YAc5jSQSsz2L/vuP376IKnLNlAhRZwQ0SMH3Bw1y0xY8mWku6V5g8Vd7Lj9lJ C26w== X-Gm-Message-State: AIkVDXLXDHLRxBmDiLbyXU/8LvsgHd2ym9BJCATg31DJSH24kaQeS+8r0/rpeOR0JHRl0SNuXkpmN46+hh+m4w== X-Received: by 10.55.151.199 with SMTP id z190mr7599149qkd.166.1484126647057; Wed, 11 Jan 2017 01:24:07 -0800 (PST) MIME-Version: 1.0 Sender: cochard@gmail.com Received: by 10.237.34.248 with HTTP; Wed, 11 Jan 2017 01:23:46 -0800 (PST) In-Reply-To: References: <30f21c75-d3a2-edcd-1999-d5ed9f970c06@freebsd.org> From: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= Date: Wed, 11 Jan 2017 10:23:46 +0100 X-Google-Sender-Auth: eyUA-q2jh4dSxdpfolN-B8JC0WY Message-ID: Subject: Re: HEADS-UP: IFLIB implementations of sys/dev/e1000 em, lem, igb pending To: Sean Bruno , "freebsd-net@freebsd.org" Cc: "freebsd-current@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jan 2017 09:24:08 -0000 On Tue, Jan 10, 2017 at 4:31 AM, Sean Bruno wrote: > > I've updated sys/dev/e1000 at svn R311849 to match Matt Macy's work on > IFLIB in the kernel. > > At this point, the driver deviates from Intel's code dramatically and > you now get to yell directly into the freebsd-net@ megaphone for things > that I may have broken. > > > =E2=80=8BI've got problem with this new drivers regarding number of queues = used on a Netgate RCC-VE 4860 (Intel i354 NIC). =E2=80=8BOnly one queue in place of 4 (on a 4 cores proc) previously: Perfo= rmance drops dramatically. BEFORE (r311848) : igb2: port 0x3000-0x301f mem 0xdfea0000-0xdfebffff,0xdff24000-0xdff27fff irq 18 at device 20.0 on pci0 igb2: Using MSIX interrupts with 5 vectors igb2: Ethernet address: 00:08:a2:09:33:da igb2: Bound queue 0 to cpu 0 igb2: Bound queue 1 to cpu 1 igb2: Bound queue 2 to cpu 2 igb2: Bound queue 3 to cpu 3 igb2: netmap queues/slots: TX 4/2048, RX 4/2048 AFTER (r3118489): igb2: port 0x3000-0x301f mem 0xdfea0000-0xdfebffff,0xdff24000-0xdff27fff irq 18 at device 20.0 on pci0 igb2: attach_pre capping queues at 8 igb2: using 1024 tx descriptors and 1024 rx descriptors igb2: msix_init qsets capped at 8 igb2: Unable to map MSIX table igb2: Using an MSI interrupt igb2: allocated for 1 tx_queues igb2: allocated for 1 rx_queues igb2: Ethernet address: 00:08:a2:09:33:da igb2: netmap queues/slots: TX 1/1024, RX 1/1024 =E2=80=8BNIC information:=E2=80=8B =E2=80=8Bigb2@pci0:0:20:0: class=3D0x020000 card=3D0x1f418086 chip=3D= 0x1f418086 rev=3D0x03 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D 'Ethernet Connection I354' class =3D network subclass =3D ethernet bar [10] =3D type Memory, range 64, base 0xdfea0000, size 131072, enabled bar [18] =3D type I/O Port, range 32, base 0x3000, size 32, enabled bar [20] =3D type Memory, range 64, base 0xdff24000, size 16384, enab= led cap 01[40] =3D powerspec 3 supports D0 D3 current D0 cap 05[50] =3D MSI supports 1 message, 64 bit, vector masks cap 11[70] =3D MSI-X supports 10 messages, enabled Table in map 0x20[0x0], PBA in map 0x20[0x2000] cap 10[a0] =3D PCI-Express 2 root endpoint max data 128(512) FLR RO NS ecap 0001[100] =3D AER 2 0 fatal 0 non-fatal 0 corrected ecap 0003[140] =3D Serial 1 0008a2ffff0933da ecap 0017[1a0] =3D TPH Requester 1 ecap 000d[1d0] =3D ACS 1 igb3@pci0:0:20:1: class=3D0x020000 card=3D0x1f4