From owner-freebsd-arch@FreeBSD.ORG Thu Oct 1 17:25:27 2009 Return-Path: Delivered-To: arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8D21B1065672; Thu, 1 Oct 2009 17:25:27 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from mail-yw0-f197.google.com (mail-yw0-f197.google.com [209.85.211.197]) by mx1.freebsd.org (Postfix) with ESMTP id 284938FC17; Thu, 1 Oct 2009 17:25:27 +0000 (UTC) Received: by ywh35 with SMTP id 35so541049ywh.7 for ; Thu, 01 Oct 2009 10:25:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=Ba4i6uMCi4MvwuwnxgVVuS6sSyd9EREMvZCgYhQhC4U=; b=gUJstEthqf/26IJ+i+ZkMtBNPQOIE2Zd6lsRR7zVjcFGeeZoIN72MM2UiaCOxjVeCc wrEXTU6HszuTbaoiQ6yupOjZWzwm4WQgXza3/VF9V9uwCjw5Qwt0hIA8BZ6GFq8GddJW 4sDYR+pbKzGjDPdunOCVm93iS8gse9C9A0+fU= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=l53VgklCPyddsInh/Ya2F7suRJyjp4XpL1Yj5jEd06tnAFrpFzNHy1lVi3h+tLw0Kp m61zzSCIwWcNIXLo/zjaSvIwHefXaIdmyE3wWqt4pX8JJX9MCnL7z0TleFVxcKkuCXAQ Gu9IdJ2gTmXrliNRhKxAr6Zhot66m+PsK/JgI= MIME-Version: 1.0 Received: by 10.101.62.6 with SMTP id p6mr1333969ank.153.1254417926173; Thu, 01 Oct 2009 10:25:26 -0700 (PDT) In-Reply-To: <20091002024550.X21519@delplex.bde.org> References: <200909301732.20589.jhb@freebsd.org> <20091001090218.L21015@delplex.bde.org> <200910010949.20849.jhb@freebsd.org> <20091002024550.X21519@delplex.bde.org> Date: Thu, 1 Oct 2009 10:25:26 -0700 Message-ID: <2a41acea0910011025q2b5834f2n113f5a8a607ecb4d@mail.gmail.com> From: Jack Vogel To: Bruce Evans Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: arch@freebsd.org Subject: Re: Interrupt Descriptions X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Oct 2009 17:25:27 -0000 What uses them, machines with multiqueue, in my ixgbe driver a rx/tx pair of queues is configured and bound to each cpu. This ability really matters when you do virtualization because the queues can be assigned per guest. So right now with 16 cpus a single Niantic or Oplin port (10G) has 33 MSIX vectors. I brought this request to John because our validation group complained. On Linux they have a description for each interrupt and they want the same for FreeBSD. Welcome to the 21st century :) Jack On Thu, Oct 1, 2009 at 10:14 AM, Bruce Evans wrote: > On Thu, 1 Oct 2009, John Baldwin wrote: > > On Wednesday 30 September 2009 8:02:57 pm Bruce Evans wrote: >> >>> On Wed, 30 Sep 2009, John Baldwin wrote: >>> >>> A few folks have asked recently for the ability to add descriptive >>>> strings to >>>> registered interrupt handlers. This is especially true since the advent >>>> of >>>> MSI with multiple interrupts per device. I hacked up a prototype today >>>> that >>>> >>> >>> Interrupt names should be no longer than 4 (5 works sometimes) characters >>> so >>> that they can be displayed by systat -v. >>> >> >> For the machines this is targeted at (i.e. ones with devices using >> MSI/MSI-X) >> the number of interrupts is already well beyond what systat -v can >> currently >> display anyway. >> > > This should be fixed before expanding the names into descriptions. > > I wonder what uses all these interrupts. Most FreeBSD cluster machines use > a whole 3 interrupts apart from acpi_timer, with 1 barely active (1 disk, > 1 net, and 1 serial i/o probably only used for a serial console). My > workstations use about 10 plus timers, but most are usually inactive > except for net, keyboard and sometimes disk. Does anyone have systems > more than about 16 disk controllers and 16 network cards so as to need > more than 32 interrupts? > > I believe most folks use vmstat -i or ithread stats in top >> to measure real-time interrupts at this point. Possibly systat could grow >> a >> new interrupt-only mode that has sufficient room for full interrupt names. >> > > I don't find static info and thus vmstat -i very useful. vmstat with a > repeat interval is useful, but for some reason vmstat -i never supported > the repeat interval (its multi-line display is certainly unsuitable for > repetitions being readable), and with systat -v repetition in vmstat -i > is rarely missed. A repeating vmstat -i would have even more space > problems than systat -v, since it would want to repeat single line output. > > systat and most things just want a unique tag, not a description or even > a full name. The full name could be looked up from a tag by looking at > vmstat -i output which could show both. > > >> FYI, it actually looks decent enough running a 7.x systat on a test 9.0 >> kernel: >> >> 25000 frevn pdpgs 2000 cpu0: >> time >> intrn >> igb0:tx 0 >> Disks da0 pass0 473896 wire 25 >> igb0:rx 0 >> KB/t 0.00 0.00 13872 act >> igb0:link >> tps 0 0 10080 inact >> igb1:tx 0 >> MB/s 0.00 0.00 128 cache 1 >> igb1:rx 0 >> %busy 0 0 7603460 free >> igb1:link >> >> For these devices with MSI, the description (tx 0, tx 1, link, etc.) is >> actually more meaningful than the IRQ. >> > > The irq is probably least useful for most devices. > > The above is only reasonable because I changed systat to move "irqN: > " to " irqN" at the end. "irq256: bce0" on FreeBSD cluster machines > is displayed reasonably as "bce0 256". But systat shouldn't have to > do this. At least the form of the names used by systat (== the one > given by the old intrnames API) should have names that are carefully > phrased to have the most useful info first, and to not waste space > with ": " or even "irq". > > Bruce > > _______________________________________________ > freebsd-arch@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-arch > To unsubscribe, send any mail to "freebsd-arch-unsubscribe@freebsd.org" >