From owner-freebsd-virtualization@FreeBSD.ORG  Sat Jun  7 21:28:24 2014
Return-Path: <owner-freebsd-virtualization@FreeBSD.ORG>
Delivered-To: virtualization@FreeBSD.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id DD301C2A;
 Sat,  7 Jun 2014 21:28:24 +0000 (UTC)
Received: from alto.onthenet.com.au (alto.OntheNet.com.au [203.13.68.12])
 by mx1.freebsd.org (Postfix) with ESMTP id A15DB238A;
 Sat,  7 Jun 2014 21:28:24 +0000 (UTC)
Received: from dommail.onthenet.com.au (dommail.OntheNet.com.au [203.13.70.57])
 by alto.onthenet.com.au (Postfix) with ESMTPS id 72A0012307;
 Sun,  8 Jun 2014 07:28:22 +1000 (EST)
Received: from Peter-Grehans-MacBook-Pro-2.local ([64.245.0.210])
 by dommail.onthenet.com.au (MOS 4.2.4-GA)
 with ESMTP id BUV17215 (AUTH peterg@ptree32.com.au);
 Sun, 8 Jun 2014 07:28:21 +1000
Message-ID: <539383F3.2060307@freebsd.org>
Date: Sat, 07 Jun 2014 14:28:19 -0700
From: Peter Grehan <grehan@freebsd.org>
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6;
 rv:24.0) Gecko/20100101 Thunderbird/24.5.0
MIME-Version: 1.0
To: Steve Wills <swills@FreeBSD.org>
Subject: Re: interrupt storm on ahci
References: <20140607212440.GB3163@mouf.net>
In-Reply-To: <20140607212440.GB3163@mouf.net>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: virtualization@FreeBSD.org
X-BeenThere: freebsd-virtualization@freebsd.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: "Discussion of various virtualization techniques FreeBSD supports."
 <freebsd-virtualization.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-virtualization/>
List-Post: <mailto:freebsd-virtualization@freebsd.org>
List-Help: <mailto:freebsd-virtualization-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization>, 
 <mailto:freebsd-virtualization-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 07 Jun 2014 21:28:24 -0000

Hi Steve,

> I'm running a FreeBSD guest in bhyve on a FreeBSD host. Both are running
> FreeBSD CURRENT, r266947. I've gotten this message about 12 times since boot:
>
> interrupt storm detected on "irq268:"; throttling interrupt source
>
> vmstat -i shows:
>
> irq268: ahci1                  236514222        839
>
> ahci1 is the second disk connected to the system:
>
> ahci1: <Intel ICH8 AHCI SATA controller> mem 0xc0002400-0xc00027ff irq 18 at device 4.0 on pci0
>
> The VM itself runs poudriere and was building a bunch of packages. At the
> moment, the VM seems to be in a rather odd state. The poudriere jails are
> running, but not doing anything. Ideas?

  Is this an 8.* host ? I don't believe AHCI has MSI support on that 
version, and AHCI legacy interrupts haven't had a huge amount of testing 
under load.

  If it is 8.*, I'd recommend using virtio-blk for the block device 
until we can work out what's going wrong.

later,

Peter.