From owner-freebsd-virtualization@freebsd.org Wed Nov 21 17:40:23 2018 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1CBE3113FB61 for ; Wed, 21 Nov 2018 17:40:23 +0000 (UTC) (envelope-from Paul.Esson@Redstor.com) Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60062.outbound.protection.outlook.com [40.107.6.62]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "GlobalSign Organization Validation CA - SHA256 - G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 99B996D06E for ; Wed, 21 Nov 2018 17:40:21 +0000 (UTC) (envelope-from Paul.Esson@Redstor.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redstorltd.onmicrosoft.com; s=selector1-redstor-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=p15x4gQZbexRA9Vh+r/FE+WWihzfvciVDdrydn6o8qU=; b=X6+beu9mza/W6aOIpIu3GsAxN/fGG6YhkPQLLnUx4GfegWFkTaPDYbnqA/jVS2JFlVXbzEcEgRDcjd7TooxWCsYJbCLX9L/WBcMlO/oQTjS7aufk/mWdPuG2wwlFbXCyeJfN4/fCcyUDX8431puSY+UUn+9IpOkLP1XbGNu7ehI= Received: from DB6P190MB0166.EURP190.PROD.OUTLOOK.COM (10.172.230.7) by DB6P190MB0360.EURP190.PROD.OUTLOOK.COM (10.175.242.30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1294.27; Wed, 21 Nov 2018 17:40:19 +0000 Received: from DB6P190MB0166.EURP190.PROD.OUTLOOK.COM ([fe80::31fb:dc24:e23d:926c]) by DB6P190MB0166.EURP190.PROD.OUTLOOK.COM ([fe80::31fb:dc24:e23d:926c%7]) with mapi id 15.20.1361.015; Wed, 21 Nov 2018 17:40:19 +0000 From: Paul Esson To: "freebsd-virtualization@freebsd.org" Subject: AHCI SATA controller timeouts Thread-Topic: AHCI SATA controller timeouts Thread-Index: AdSBvv2rWsZHJODoTNuSPfBYSUA8rQ== Date: Wed, 21 Nov 2018 17:40:19 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=Paul.Esson@Redstor.com; x-originating-ip: [81.136.184.115] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; DB6P190MB0360; 6:730+y6iOd9E9ruB+/gTjd85Wl10wWgicEBl2Muqg4xjAQ7kLyCSn3zBw7wGgQJAfhpZTJ0MzgA/v5xSWE4rDgyyNaKqm9I3Uz+IRwFmAD61+sbQONBFZn+iL78v+7D4V670GGY3sBWJ+CdyWcGS722f2fchr0pGbmabylyvM6GnQnBI/dZQhgElBLHwSUv9s/ebY3RaquaNgVVB5PPSZCKckrATe+tzXgR9ype77PfXAG2Tv8auJej0y4Lhz4F6K9MrPiaCphzBThMxDidPDDjoQYbmI2QiVgMN8+BY4JrQ7aS4iXwVeSSNU7ZTzjlICNru0Y8OGNSkAayhXmRIiXlEQZs1okbcHG1A10tZDvcTW6joqFCgjKhWMMrWeJYzSO8XMOKVL2MKju5BVJ3JwqM8lMqQgo5u6+TrvB3tBSAqiQGh4DuRTqHUwdPVRCdO8XvkV3fnHm5hsSoGpaqlk9w==; 5:kzzsIoyJW/F1MyoY54P6cGa+1ignQ/DzISM7bdJ6JM4HWiQhyu0GChNBHYqGfTXLDkZ4KgDXHY8qeOmaL71v+YTuKaJfcYAWF1Fg/tQTAwHx2pahWo5L2VxJ9EpWZmzOSqwt07KxkzXV9Lh0rywD59m2cdqQQe+S587u0sOi+bg=; 7:Qt9iyu2dFgubuz2SyLG/SCOy040KvCNjmCCb9JdwXyciYhmsHxCcdR81k8un1zV0CRqouk5emxXiWxUXBujg8YAdBxK04osq1rrJR9ruS5N48f1eof9HFqdtPUTbrEwu82wraLh3IEWED+7qWEPwpA== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 4e5b245a-094e-40de-9b8a-08d64fd86803 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390098)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7153060)(7193020); SRVR:DB6P190MB0360; x-ms-traffictypediagnostic: DB6P190MB0360: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(209352067349851)(163750095850)(21748063052155)(28532068793085)(190501279198761)(227612066756510)(128460861657000)(81160342030619)(31418570063057)(86561027422486); x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(93006095)(93001095)(3231442)(944501410)(52105112)(10201501046)(3002001)(148016)(149066)(150057)(6041310)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123562045)(20161123564045)(20161123558120)(201708071742011)(7699051)(76991095); SRVR:DB6P190MB0360; BCL:0; PCL:0; RULEID:; SRVR:DB6P190MB0360; x-forefront-prvs: 08635C03D4 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(376002)(39850400004)(346002)(396003)(136003)(52314003)(199004)(189003)(486006)(7736002)(72206003)(6916009)(25786009)(256004)(71190400001)(316002)(71200400001)(14444005)(3480700005)(217873002)(2906002)(99286004)(66066001)(68736007)(5660300001)(14454004)(3846002)(6116002)(2351001)(790700001)(7696005)(97736004)(9686003)(733005)(6306002)(54896002)(5640700003)(4743002)(236005)(102836004)(26005)(2501003)(186003)(106356001)(9326002)(478600001)(6436002)(86362001)(105586002)(55016002)(861006)(6506007)(8676002)(2900100001)(74316002)(33656002)(606006)(81166006)(53936002)(8936002)(81156014)(476003); DIR:OUT; SFP:1101; SCL:1; SRVR:DB6P190MB0360; H:DB6P190MB0166.EURP190.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: Redstor.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: /wcCM1wJVP/J6oS3xsUE4Ai/5OIOs37/mcYX5Xt3o57yYqujZhYiJQVxHvR56Vo7UPQPEvhxWD4dxroEf7nsnyju4gG4UTkXgIhc/GuX+AnmDVbvgO+VkyZOo/mBwsNGrH24ux9yziNxBNPHbT5MgOD7SwSChnQXvBaFqq8/FDG12qwj8kwGWAaPrNdH1cePVSLUGDjRkt59bo6Aj0wNfouJ/Axz3YsOjDH0GGWtQt8ZZ/kMXTU5BGXqa5rMF0PX17I17AOxZkvv2uqWDlJ06Lz/pF/k1pf71pGOmYTGUfnDjFrVC9fRGW8vd3u6uwb7UTwty5GbrUXXZowOCZqL7Rham8GgwCsZzi0xb3xPuPs= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: redstor.com X-MS-Exchange-CrossTenant-Network-Message-Id: 4e5b245a-094e-40de-9b8a-08d64fd86803 X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Nov 2018 17:40:19.4910 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 24ac53ae-15a7-4211-afef-61d8f34e2571 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6P190MB0360 X-Rspamd-Queue-Id: 99B996D06E X-Spamd-Result: default: False [-1.84 / 15.00]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; R_DKIM_ALLOW(-0.20)[redstorltd.onmicrosoft.com]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/17]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[Redstor.com]; NEURAL_HAM_LONG(-0.99)[-0.985,0]; URI_COUNT_ODD(1.00)[17]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; NEURAL_HAM_MEDIUM(-0.99)[-0.994,0]; DKIM_TRACE(0.00)[redstorltd.onmicrosoft.com:+]; MX_GOOD(-0.01)[mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net,mxtls.expurgate.net]; RCVD_IN_DNSWL_NONE(0.00)[62.6.107.40.list.dnswl.org : 127.0.3.0]; NEURAL_HAM_SHORT(-0.09)[-0.095,0]; TO_DN_EQ_ADDR_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-0.76)[ipnet: 40.64.0.0/10(-1.87), asn: 8075(-1.83), country: US(-0.09)]; ASN(0.00)[asn:8075, ipnet:40.64.0.0/10, country:US] X-Rspamd-Server: mx1.freebsd.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Nov 2018 17:40:23 -0000 Hi Folks, I have a bhyve FreeBSD guest 11.2-RELEASE running on a FreeBSD host 11.2-RE= LEASE that is experiencing issues with a zvol presented from the host as a = BHYVE SATA DISK and used by the guest to create a zpool. I used the ahci-h= d block driver because it supported TRIM and I did not have the virtio-scsi= driver available. Anyway, I have this configuration running on a number of Dell PowerEdge R73= 0xd servers without issue, but we recently purchased a next generation R740= xd model and suddenly when I am generating lots of writes to the guest zpoo= l via a zfs send/receive I see the following timeout messages causing the i= /o to terminate. I've noted some online conversation around examples in a physical hardware = context but not virtual and wondered if anyone had seen anything similar? Nov 20 10:54:45 dc2-olbp-sn-15b kernel: ahcich6: Timeout on slot 14 port 0 Nov 20 10:54:52 dc2-olbp-sn-15b kernel: ahcich6: is 00000008 cs 00000000 ss= 00000000 rs 00006000 tfd 50 serr 00000000 cmd 0001ce17 Nov 20 10:54:52 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): SEND_FPDMA_QU= EUED DATA SET MANAGEMENT. ACB: 64 01 00 00 00 40 00 00 00 00 00 00 Nov 20 10:54:52 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): CAM status: C= ommand timeout Nov 20 10:54:52 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): Retrying comm= and Nov 21 15:12:09 dc2-olbp-sn-15b kernel: ahcich6: Timeout on slot 24 port 0 Nov 21 15:12:09 dc2-olbp-sn-15b kernel: ahcich6: is 00000000 cs 00000000 ss= 03000000 rs 03000000 tfd 50 serr 00000000 cmd 0001d917 Nov 21 15:12:09 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): WRITE_FPDMA_Q= UEUED. ACB: 61 00 b0 50 b5 40 22 00 00 01 00 00 Nov 21 15:12:09 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): CAM status: C= ommand timeout Nov 21 15:12:09 dc2-olbp-sn-15b kernel: (ada0:ahcich6:0:0:0): Retrying comm= and Regards, Paul Esson | Redstor Limited t +44 (0)118 951 5235 | m +44 (0)776 690 6514 e paul.esson@redstor.com www.redstor.com [http://partners.redstor.com/files/redstor_email_signatures_linkedin_icon_p= adding.png][http://partners.redstor= .com/files/redstor_email_signatures_twitter_icon_padding.png][http://partners.redstor.com/files/redstor_email_signatures= _facebook_icon_padding.png][http://partn= ers.redstor.com/files/redstor_email_signatures_youtube_icon_padding.png] [http://partners.redstor.com/files/NEW_logo_larger.png]