From owner-freebsd-hackers@FreeBSD.ORG  Wed May 30 15:58:15 2012
Return-Path: <owner-freebsd-hackers@FreeBSD.ORG>
Delivered-To: freebsd-hackers@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id ED815106566C;
	Wed, 30 May 2012 15:58:15 +0000 (UTC) (envelope-from jhb@freebsd.org)
Received: from bigwig.baldwin.cx (bigknife-pt.tunnel.tserv9.chi1.ipv6.he.net
	[IPv6:2001:470:1f10:75::2])
	by mx1.freebsd.org (Postfix) with ESMTP id C29C28FC1C;
	Wed, 30 May 2012 15:58:15 +0000 (UTC)
Received: from jhbbsd.localnet (unknown [209.249.190.124])
	by bigwig.baldwin.cx (Postfix) with ESMTPSA id 2B8ECB9BC;
	Wed, 30 May 2012 11:58:15 -0400 (EDT)
From: John Baldwin <jhb@freebsd.org>
To: freebsd-hackers@freebsd.org
Date: Wed, 30 May 2012 11:24:52 -0400
User-Agent: KMail/1.13.5 (FreeBSD/8.2-CBSD-20110714-p13; KDE/4.5.5; amd64; ; )
References: <CAJ-VmomWV2XibSNSr5Mfh7mpKsWrX5GKsNfU9iq7TO6+KxxQhw@mail.gmail.com>
In-Reply-To: <CAJ-VmomWV2XibSNSr5Mfh7mpKsWrX5GKsNfU9iq7TO6+KxxQhw@mail.gmail.com>
MIME-Version: 1.0
Content-Type: Text/Plain;
  charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
Message-Id: <201205301124.52597.jhb@freebsd.org>
X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.2.7
	(bigwig.baldwin.cx); Wed, 30 May 2012 11:58:15 -0400 (EDT)
Cc: Adrian Chadd <adrian@freebsd.org>, Alexander Motin <mav@freebsd.org>
Subject: Re: ULE/sched issues on stable/9 - why isn't preemption occuring?
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
	<freebsd-hackers.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>, 
	<mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-hackers>,
	<mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 30 May 2012 15:58:16 -0000

On Tuesday, May 29, 2012 4:08:23 pm Adrian Chadd wrote:
> Hi Alexander and others,
> 
> I've been tinkering with ath(4) IO scheduling and taskqueues. In order
> to get proper "in order" TX IO occuring, I've placed ath_start() into
> a taskqueue so now whenever ath_start() is called, it just schedules a
> taskqueue entry to run.
> 
> However, performance is worse. :-)
> 
> Here's a schedgraph trace.
> 
> http://people.freebsd.org/~adrian/ath/ktr.4-ath-iperf-using-taskqueue-for-
tx.ktr.gz
> 
> I've thrown this through schedgraph.py on stable/9 and I've found some
> rather annoying behaviour. It seems that the ath0 taskqueue stays in
> the "runq add" state for quite a long time (1.5ms and longer) because
> something else is going on on CPU #0.
> 
> I'm very confused about what's going on. I'd like a hand trying to
> figure out why the schedgraph output is the way it is.
> 
> Thanks!

As mentioned on IRC, you need to disable powerd and set machdep.idle=spin
and get new traces.  Right now your traces show multiple things executing
on a single CPU.

-- 
John Baldwin