From owner-freebsd-virtualization@freebsd.org Thu Dec 29 11:14:59 2016 Return-Path: Delivered-To: freebsd-virtualization@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED9CDC968A4; Thu, 29 Dec 2016 11:14:59 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8CB72145B; Thu, 29 Dec 2016 11:14:59 +0000 (UTC) (envelope-from freebsd@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [IPv6:2a00:e10:2800::a135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id uBTBEvG2083238; Thu, 29 Dec 2016 12:14:57 +0100 (CET) (envelope-from freebsd@omnilan.de) Received: from titan.inop.mo1.omnilan.net (titan.inop.mo1.omnilan.net [IPv6:2001:a60:f0bb:1::3:1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 7806F3AD; Thu, 29 Dec 2016 12:14:57 +0100 (CET) Message-ID: <5864F030.4050204@omnilan.de> Date: Thu, 29 Dec 2016 12:14:56 +0100 From: Harry Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: Alexander Motin CC: FreeBSD Stable , freebsd-virtualization@freebsd.org Subject: Re: ASM1062 AHCI timeouts, ppt(4) BAR aligning [Was: Re: svn commit: r309251 - head/sys/dev/ahci] References: <201611281623.uASGNWoA056995@repo.freebsd.org> <5864CADD.6020805@omnilan.de> <8c37d73e-59dc-3ca2-cab0-941a525f4d44@FreeBSD.org> In-Reply-To: <8c37d73e-59dc-3ca2-cab0-941a525f4d44@FreeBSD.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]); Thu, 29 Dec 2016 12:14:57 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: ; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Dec 2016 11:15:00 -0000 Bezüglich Alexander Motin's Nachricht vom 29.12.2016 11:32 (localtime): > On 29.12.2016 10:35, Harry Schmalzbauer wrote: >> I'd like to report that this doesn't fix timeouts for me (applied to >> 11-stable). >> >> For example my REV120 works without problems on Intel-AHCI but not on >> ASM1062-AHCI. >> Even attaching gives different output. Both look fine at first: >> # cd0 at ahcich0 bus 0 scbus5 target 0 lun 0 >> # cd0: Removable CD-ROM SCSI device >> # cd0: Serial Number 0C1E4D046E5DFF18 >> # cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO >> 8192bytes) >> >> When attached to the Intel-AHCI, it's followed by >> + cd0: Attempt to query device size failed: NOT READY, Medium not present >> while attaching to ASM1062 it reads (!?) >> - cd0: 0MB (1 0 byte sectors) >> >> Then these timeouts occur: >> ahcich7: Timeout on slot 11 port 0 >> ahcich7: is 00000000 cs 00000c00 ss 00000000 rs 00000c00 tfd 6051 serr >> 00000000 cmd 0004cb17 >> ahcich7: Timeout on slot 24 port 0 >> ahcich7: is 00000000 cs 01800000 ss 00000000 rs 01800000 tfd 2051 serr >> 00000000 cmd 0004d817 >> ahcich7: Timeout on slot 6 port 0 >> ahcich7: is 00000000 cs 00000060 ss 00000000 rs 00000060 tfd 2051 serr >> 00000000 cmd 0004c617 >> ahcich7: Timeout on slot 20 port 0 >> ahcich7: is 00000000 cs 00180000 ss 00000000 rs 00180000 tfd 2051 serr >> 00000000 cmd 0004d417 >> >> Also IDENT (via camcontrol) "hangs" for 20 seconds, but finally succeeds. > > I think problem may be different in your case. The HBA still reports > that command is not completed by the device. Unfortunately I don't have > those fancy drives to try, but I'll try to reproduce it with regular CD > drive when I get back home after short New Year holidays. Oic, then I need to test the patch with regular SSD usage! I have had problems with the asm1062 when I used it for a "roaming" SSD, backing virtio-blk/ahci,hd:/dev/ada4. After some mentionable I/O there were _always_ outages which I don't remember exactly, but moving the SSD from asm-ahci to intel-ahci made them vanish. I'll see if these are now solved for the ASM1062. Otherwise I'll report. >> Btw: I already found out that extending ppt(4) to support unaligned base >> address register wouldn't be too easy. >> Initially I added that ASM1062 card to use it for byhve(8) passthrough. >> Unfortunately that doesn't work: >> bhyve: passthru device 6/0/0 BAR 5: base 0xc3e10000 or size 0x200 not … > > I believe it is bhyve bug, since these values are just what hardware > reports. BAR size of 512 bytes indeed does not align to 4K, but that is > not our problem. :) > >> Are there any recommendations for AHCI (SATA-PCIe) controller >> cards/chips that do work (both, for byhve passthrough and also as plain >> AHCI provider)? > > Please don't mix multiple unrelated questions in one email. Yes, sorry, I should have sent that in two different mails. Took the wrong route because I thought others who are possibly searching/trying low-power SATA passthrough controllers could find this (useful)... > There is very little reasonable external AHCI controllers on the market > now. I am not sure anything other then Marvell and ASmedia were > released at all in last years since 6Gbps SATA came out. Marvell and > ASmedia probably worth each other, while later Marvell may be slightly > better on functionality (number of ports and FBS PMP support), but they > are both desktop products. If you need this in server environment -- > think about about SAS adapter like LSI. Or just use on-board Intel > AHCI, since they are probably the best om reliability you may get out of > SATA. Thanks for your hints! Usually I go with LSI2008 for such cases, but this time the additional 7W power consumption for only _one_ roaming SATA-SSD seemd inappropriate. Furthermore, I only have one spare slot, so I got a card with the ASM1062 and an Etron EJ168 USB 3.0 combined. That was exactly what I'd want to have as passthrough for my guest :-) Hopefully bhyve(8)/ppt will make that possible in the future. Thanks, -harry