From owner-freebsd-scsi@FreeBSD.ORG Mon Jun 8 14:13:11 2015 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F357F1000 for ; Mon, 8 Jun 2015 14:13:11 +0000 (UTC) (envelope-from sibananda.sahu@avagotech.com) Received: from mail-wi0-x234.google.com (mail-wi0-x234.google.com [IPv6:2a00:1450:400c:c05::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8A54F1A94 for ; Mon, 8 Jun 2015 14:13:11 +0000 (UTC) (envelope-from sibananda.sahu@avagotech.com) Received: by wigg3 with SMTP id g3so53974752wig.1 for ; Mon, 08 Jun 2015 07:13:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=avagotech.com; s=google; h=from:mime-version:thread-index:date:message-id:subject:to:cc :content-type; bh=MbOw/p0BmX4BtW0n9v+RqG0AIttbSzd9ehLFAlJMQ+I=; b=xux6S1uDl3ToRr6HG8rPIFB/ET6l0+zKx8nwkz8qIZEIkiwlz19jRJNgqp5dB1y5OE NIZ6okxDqc8fLYlLsHll3NIo9iIPVzG/2wOQdZ1k0aZvhAw3+E1OQ8O/dFlBXqU0UtQX 6uehRPj4ofOP5mLFYi40HThYf2D3tjkAq2bko= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:mime-version:thread-index:date:message-id :subject:to:cc:content-type; bh=MbOw/p0BmX4BtW0n9v+RqG0AIttbSzd9ehLFAlJMQ+I=; b=D8rCsju0LYxLU51p5bWMaZQcrT7RHEkXw2t06YoW4JhM0LPMiBLvP/qm6KmncG8kbD P/yx47HvMCeFPXuQROYaF2gtqczV0Fokxszgrv7cJ0CbqKt3z+c/oDSIOhnBadjcIQL6 /8gbk73neZGiQqc2egQ5BFTtJOgFaCok+4tsJpvnODq04h0Ir80ruUyxd8ptzXbwjoTI PCA3fAAmcf1htbDDhrgwlTxZyNks1gRf2mYe+0V1yDA+xv99VbRbbuuJSbLhhigvCq0Y nN/ay/2FJKr0gT3CDu+/e4BYkZxjwsgrEOdOr9fZprfs6atk226q7/6eOTSA6G6s/jDM ZSNg== X-Gm-Message-State: ALoCoQlPESNT3MTUCNOJ+AVhUn8WObtE6/081dDFW9jpGrGLQcfKpZuDBQJkn2T03cMd6K/u2Xl7 X-Received: by 10.194.2.68 with SMTP id 4mr23677707wjs.82.1433772789844; Mon, 08 Jun 2015 07:13:09 -0700 (PDT) From: Sibananda Sahu MIME-Version: 1.0 X-Mailer: Microsoft Outlook 14.0 Thread-Index: AdCh9TDS5xEWt6+SSnqG+4nM6XvF1Q== Date: Mon, 8 Jun 2015 19:43:04 +0530 Message-ID: <74957f591aa372aee413a4f9fadda2e4@mail.gmail.com> Subject: IO stall in FreeBSD 9.1 To: freebsd-scsi@freebsd.org Cc: "Kenneth D. Merry" , scottl@freebsd.org, Scott Long , Konstantin Belousov Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jun 2015 14:13:12 -0000 Hi all, I am working on mrsas(4) driver for AVAGO=E2=80=99s 3108 Invader controller= s in FreeBSD. Recently while testing on FreeBSD-9.1-RELEASE I have observed that IOs running on VDs behind AVAGO 3108 controller, stalls after a while. I have two VDs, both configured of RAID0. I use fio(1) for to fire IOs to the disks with posixaio as the ioengine. POST ISSUE ANALYSIS DATA: In the gstat(1) utility it shows some pending items in the Queue and there is no activity of IO but fio(1) is running in the background. dT: 1.002s w: 1.000s L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name 11 0 0 0 0.0 0 0 0.0 0.0|da0 32 0 0 0 0.0 0 0 0.0 0.0| da1 0 0 0 0 0.0 0 0 0.0 0.0| ada0 0 0 0 0 0.0 0 0 0.0 0.0| ada0p1 0 0 0 0 0.0 0 0 0.0 0.0| ada0p2 0 0 0 0 0.0 0 0 0.0 0.0| ada0p3 I have also used the same configuration on FreeBSD-8.4-RELEASE and FreeBSD-10.0-RELEASE and the issue is not seen. IOs were running consistently and there was no IO stall at all. Furthermore, I have also checked that if mrsas(4) driver is causing this issue, but to my surprise mrsas(4) is not at all called after that IO stall= . I mean to say, the SIM driver=E2=80=99s action callback (mrsas_action() in = this case) is not at all called. Below is a dmesg log of camcontrol debug =E2=80=93TSX [bus:target:lun] afte= r IO stall: http://www.infysim.org/wp-content/dmesg_camcontrol_debug Can anyone provide any solution/suggestion to this issue? Thanks, Sibananda Sahu