From owner-freebsd-current@FreeBSD.ORG Tue Apr 28 07:54:21 2015 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 0647EF6C; Tue, 28 Apr 2015 07:54:21 +0000 (UTC) Received: from mail-la0-x229.google.com (mail-la0-x229.google.com [IPv6:2a00:1450:4010:c03::229]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D944157B; Tue, 28 Apr 2015 07:54:20 +0000 (UTC) Received: by labbd9 with SMTP id bd9so98031267lab.2; Tue, 28 Apr 2015 00:54:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=uVciRwHOvrc8tSl9V3hORQZVT9HWfPA9qvTsy8XVxI4=; b=lrhPIGC0tVj4YCgqL402sOKglFlkGJFzdwQff3SwoJ4siMNI/bl4aVgtGu6LvCrUJf zlB9BOBuKShHEK/j7NiW9Bvy9qfDBpENSEScx1QseEmbRNqKQxti58MCybdwMtT/sVtL 6m+83S5SbxW2Er4fg4o98ludxkLakb1prSrBps+PRIJwUuOojwVrKnBNcj4sOe3x9OzD EySyldBYU15vtV6/Qucppqebq9RvCfQiXnbJ5JLmuk1bCLRlxureNB2/0CYlaE5FGJrQ RT7/V5g+4jv0arvQBeXFeSBFvdcPZThVgDVQ6zd7DEcE0fyPojJtz0ZdMWwTxjhK4zLO kNTQ== X-Received: by 10.112.57.197 with SMTP id k5mr13807683lbq.102.1430207658690; Tue, 28 Apr 2015 00:54:18 -0700 (PDT) Received: from mavbook.mavhome.dp.ua ([91.198.175.1]) by mx.google.com with ESMTPSA id o8sm5361947lal.2.2015.04.28.00.54.16 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 28 Apr 2015 00:54:17 -0700 (PDT) Sender: Alexander Motin Message-ID: <553F3CA7.9090601@FreeBSD.org> Date: Tue, 28 Apr 2015 10:54:15 +0300 From: Alexander Motin User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.4.0 MIME-Version: 1.0 To: Garrett Cooper CC: FreeBSD Current , "freebsd-testing@freebsd.org" Subject: Re: cam(4) timeouts in bhyve/kyua runs up on Jenkins? References: <28845361-E624-4CB9-B255-1B2C1FD0DF28@gmail.com> <4BEE0A54-3AD2-42DB-AF4E-2B0A5E34DF4E@gmail.com> In-Reply-To: <4BEE0A54-3AD2-42DB-AF4E-2B0A5E34DF4E@gmail.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Apr 2015 07:54:21 -0000 Hi. On 27.04.2015 21:17, Garrett Cooper wrote: > On Apr 27, 2015, at 11:16, Garrett Cooper > wrote: > >> I was looking at the console log for the latest kyua run and I’ve >> noticed that it’s timing out a bit more [1] than it was >> previously [2]. I’ve seen some of your commits recently to cam(4) >> dealing with bhyve — has there been a performance regression >> there? Thanks! -NGie >> >> 1. >> https://jenkins.freebsd.org/job/FreeBSD_HEAD-tests2/940/console >> 2. >> https://jenkins.freebsd.org/job/FreeBSD_HEAD-tests2/983/console > > (Sorry for not being more explicit for the archives) These are the > timeouts I’m referring to: > > ahcich0: is 00000000 cs 00000000 ss 1f000000 rs 1f000000 tfd 50 > serr 00000000 cmd 1000dc17 (ada0:ahcich0:0:0:0): > WRITE_FPDMA_QUEUED. ACB: 61 08 a8 54 1e 40 00 00 00 00 00 00 > (ada0:ahcich0:0:0:0): CAM status: Command timeout > (ada0:ahcich0:0:0:0): Retrying command Last time I was more working on bhyve host disk emulation, rather then on cam(4) running on guest. Considering that, what guest and what host versions are you running? Is there any other load on host except this VM that could cause I/O delays high enough to trigger timeouts? What are you using to back the virtual disk (file, zvol, ...)? -- Alexander Motin