From owner-freebsd-current@FreeBSD.ORG  Thu Jun  9 03:59:16 2011
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: freebsd-current@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 7395E106566C
	for <freebsd-current@freebsd.org>; Thu,  9 Jun 2011 03:59:16 +0000 (UTC)
	(envelope-from luigi@onelab2.iet.unipi.it)
Received: from onelab2.iet.unipi.it (onelab2.iet.unipi.it [131.114.59.238])
	by mx1.freebsd.org (Postfix) with ESMTP id 3FCB58FC13
	for <freebsd-current@freebsd.org>; Thu,  9 Jun 2011 03:59:16 +0000 (UTC)
Received: by onelab2.iet.unipi.it (Postfix, from userid 275)
	id BDCD07300A; Thu,  9 Jun 2011 05:59:52 +0200 (CEST)
Date: Thu, 9 Jun 2011 05:59:52 +0200
From: Luigi Rizzo <rizzo@iet.unipi.it>
To: freebsd-current@freebsd.org
Message-ID: <20110609035952.GA30464@onelab2.iet.unipi.it>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
User-Agent: Mutt/1.4.2.3i
Subject: any place to look at for PCI-express performance issues ?
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
	<freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>, 
	<mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 09 Jun 2011 03:59:16 -0000

hi,
during my tests with netmap with 10Gbit cards (82599, dual port),
i notice that a motherboard with an AMD 880G chipset
is performing significantly worse than an intel based one.
In both cases the NIC is mounted on a 16x PCIe slot,
and in both cases the driver reports the use 5Gb/4x per port.

On the intel i reach easily 14.88Mpps, on the AMD the card tops
at 1.8Mpps, and is not CPU limited (changing dev.cpu.0.freq does not change
the throughput).
Disabling flow control does not help (and in any case
the other end of the link is the same), and since
I am using the same picobsd image (based on FreeBSD/i386
head w/ my netmap code) i suspect that the difference in
performance has to do with the PCIe controller.
My netmap code
http://info.iet.unipi.it/~luigi/netmap/
does nothing special on the bus.

Now, the question is, is there any place in FreeBSD sources that
might be related to PCIe performance, e.g. initialising specific
features in one or another northbridge, etc ?

cheers
luigi