From owner-freebsd-net@FreeBSD.ORG  Wed Jul 21 11:44:01 2010
Return-Path: <owner-freebsd-net@FreeBSD.ORG>
Delivered-To: freebsd-net@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id AD059106567F
	for <freebsd-net@freebsd.org>; Wed, 21 Jul 2010 11:44:01 +0000 (UTC)
	(envelope-from dhartmei@insomnia.benzedrine.cx)
Received: from insomnia.benzedrine.cx (106-30.3-213.fix.bluewin.ch
	[213.3.30.106]) by mx1.freebsd.org (Postfix) with ESMTP id 0A4BF8FC13
	for <freebsd-net@freebsd.org>; Wed, 21 Jul 2010 11:43:59 +0000 (UTC)
Received: from insomnia.benzedrine.cx (localhost.benzedrine.cx [127.0.0.1])
	by insomnia.benzedrine.cx (8.14.1/8.13.4) with ESMTP id o6LBhwYd022657
	(version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO);
	Wed, 21 Jul 2010 13:43:58 +0200 (MEST)
Received: (from dhartmei@localhost)
	by insomnia.benzedrine.cx (8.14.1/8.12.10/Submit) id o6LBhuKm032193;
	Wed, 21 Jul 2010 13:43:56 +0200 (MEST)
Date: Wed, 21 Jul 2010 13:43:56 +0200
From: Daniel Hartmeier <daniel@benzedrine.cx>
To: Patrick Mahan <mahan@mahan.org>
Message-ID: <20100721114356.GA9247@insomnia.benzedrine.cx>
References: <4C463D90.6040308@mahan.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <4C463D90.6040308@mahan.org>
User-Agent: Mutt/1.5.12-2006-07-14
Cc: freebsd-net@freebsd.org
Subject: Re: Looking for some education on ALTQ
X-BeenThere: freebsd-net@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Networking and TCP/IP with FreeBSD <freebsd-net.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-net>
List-Post: <mailto:freebsd-net@freebsd.org>
List-Help: <mailto:freebsd-net-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-net>,
	<mailto:freebsd-net-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 21 Jul 2010 11:44:01 -0000

In your setup, the data is flowing from the iperf client (sender) on
NPX4 to the iperf server (receiver) on NPX1.

Apply the queue on the interface on NPX3 where the data is flowing
out, i.e. the interface facing NPX1. Queueing applies to outgoing
packets of an interface, not incoming packets.

It looks like you confused the interface, according to the drawing
the interface would be em0, but the ifconfig output places em0 in
the network towards NPX4. Then the pass rule in pf.conf uses em3.
It looks like you limited the (nearly non-existant) return traffic
instead.

When fixed, pfctl -vvsq should show quickly growing pkts and bytes
counters for test7788, of the order iperf reports (133KB vs. 597MB
in your output).

Kind regards,
Daniel