From owner-freebsd-hackers@freebsd.org Sat Sep 14 05:08:36 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 47B86DF2A6 for ; Sat, 14 Sep 2019 05:08:36 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x836.google.com (mail-qt1-x836.google.com [IPv6:2607:f8b0:4864:20::836]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46VgWl2bhHz4WJX for ; Sat, 14 Sep 2019 05:08:35 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x836.google.com with SMTP id n7so36584531qtb.6 for ; Fri, 13 Sep 2019 22:08:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=sMk4s5+K/NrCXSQta4xceevmJWbNvDi9XWIbZT/XAMU=; b=zWBcmUAkfRyVyPHYBVPIav4xRbMVR8dneFhaZaMYtG3mlCnEDdt2vcHnT+7aoUaCOo 3xgSMuqiGt3QCiPp9OBZKNrr/IZRxRY3MkM3Hb5R9HKTIkYpUvV/pBeaJO0/GB/c09jR K+eiuAyRpBxBt4QVu2aNaozLuHmjI65wxv/Y9qpdUGP/xPDrOFk7fV0YiUiUSKt21Rjy SvBSIuDlC39Z3SoiCQby14T/eDSLTA2UTM7tgGiQLJTD8Y4jG02kKyovJ2KkIFz6hirP YjNHWUsd2tUj8MSlaQFl9qYfyrbVD0E96MywvO7eCDUiPcRUEGElOmBSjNDNUxZtebSn yDvg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=sMk4s5+K/NrCXSQta4xceevmJWbNvDi9XWIbZT/XAMU=; b=KVdgR06LVeOxDQdDmXGsc6H5De2xce2kMkE03yyyqerYqJ+7aVUOXXjT1P+YeJ2LN2 F7H8ex2aOZxvOsvPr1SCyqnkt7fLpqu8dEaNvazscJ3TKVKRdN8Nx60DiwBvUMkwMVLJ nCSw6yXMmEgbMaj88T/Ci6lhQuuL/JjHSIFdUMtWoy76QRjduHVcZwjblq0USGD5kYIo yvOwqDgsjxlJ8h/y4DUB3o7yevliLIIwRDT7BcfyGrGDUrRjrZtsaFWFLtPbq7YtOVup vAZgBIuZev+2yVbDBmSL44DB5MAgbMshs035RtgTIZyM4GMNg4EWSiaaVpUJRQhxGU0C 3pbQ== X-Gm-Message-State: APjAAAVcMtesg16JCnosX/KoM0OwMsE7uoJLu3YHGW4TIXZv/6DuKEop 0rYg2Y+bW1QgvzDa4SGsPG1SNBcPaATN1NuokVyRrBGBlxs= X-Google-Smtp-Source: APXvYqz+N2Zt9sxW/j6kDWEXDl3x0H3G3QPnyqtwB2k+ipxwjVU8NjG9Pf/M3Y64RVW1LPJU1ODjhHj1Fw0F95rUwT0= X-Received: by 2002:ac8:3564:: with SMTP id z33mr6913445qtb.291.1568437713831; Fri, 13 Sep 2019 22:08:33 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Fri, 13 Sep 2019 23:08:22 -0600 Message-ID: Subject: Re: Problems with port of NVMe support To: Sebastian Huber Cc: FreeBSD Hackers X-Rspamd-Queue-Id: 46VgWl2bhHz4WJX X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=zWBcmUAk; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::836) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-3.85 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; URI_COUNT_ODD(1.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[6.3.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; IP_SCORE(-2.85)[ip: (-9.26), ipnet: 2607:f8b0::/32(-2.70), asn: 15169(-2.24), country: US(-0.05)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Sep 2019 05:08:36 -0000 On Fri, Sep 13, 2019, 12:02 AM Sebastian Huber < sebastian.huber@embedded-brains.de> wrote: > Hello, > > I port currently the NVMe support from FreeBSD to RTEMS. Basically, it > works. I can issue administration commands and some IO commands (e.g. > FLUSH). I use this SSD for testing: > > $ nvmecontrol identify nvme0 > Controller Capabilities/Features > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > Vendor ID: 8086 > Subsystem Vendor ID: 8086 > Serial Number: PHM27390006S280AGN > Model Number: INTEL SSDPE21D280GA > Firmware Version: E2010325 > Recommended Arb Burst: 0 > IEEE OUI Identifier: e4 d2 5c > Multi-Path I/O Capabilities: Not Supported > Max Data Transfer Size: 131072 > Controller ID: 0x0000 > Version: 0.0.0 > > My problem is now, that every WRITE transfer ends up in a DATA TRANSFER > ERROR: > > nvme0: WRITE sqid:1 cid:127 nsid:1 lba:0 len:8 > nvme0: DATA TRANSFER ERROR (00/04) sqid:1 cid:127 cdw0:0 > nvme0: async event occurred (type 0x0, info 0x04, page 0x01) > > Every READ transfer ends up in a UNRECOVERED READ ERROR: > > nvme0: READ sqid:1 cid:127 nsid:1 lba:0 len:8 > nvme0: UNRECOVERED READ ERROR (02/81) sqid:1 cid:127 cdw0:0 > nvme0: async event occurred (type 0x0, info 0x04, page 0x01) > > I see the transfers in the error log: > > $ nvmecontrol logpage -p 1 nvme0 > > > Error Information Log > > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > > Entry 01 > > > =3D=3D=3D=3D=3D=3D=3D=3D=3D > > > Error count: 2546 > > > Submission queue ID: 1 > > > Command ID: 32512 > > > Status: > > > Phase tag: 0 > > > Status code: 129 > > > Status code type: 2 > > > More: 1 > > > DNR: 1 > > > Error location: 0 > > > LBA: 0 > > > Namespace ID: 1 > > > Vendor specific info: 0 > > > Transport type: 0 > > > Command specific info:0 > > > Transport specific: 0 > > > Entry 02 > > > =3D=3D=3D=3D=3D=3D=3D=3D=3D > > > Error count: 2545 > > > Submission queue ID: 1 > > > Command ID: 32512 > > > Status: > > > Phase tag: 0 > > > Status code: 4 > > > Status code type: 0 > > > More: 1 > > > DNR: 1 > > > Error location: 0 > > > LBA: 0 > > > Namespace ID: 1 > > > Vendor specific info: 0 > > > Transport type: 0 > > > Command specific info:0 > > > Transport specific: 0 > > From the NVMe specification I didn't get any hints what the error > reason could be. Maybe someone has a hint for me. The platform is a > T4240 PowerPC (big-endian). > Maybe the physaddr in the SG list for these commands doesn't translate right? Warner --=20 > Sebastian Huber, embedded brains GmbH > > Address : Dornierstr. 4, D-82178 Puchheim, Germany > Phone : +49 89 189 47 41-16 > Fax : +49 89 189 47 41-09 > E-Mail : sebastian.huber@embedded-brains.de > PGP : Public key available on request. > > Diese Nachricht ist keine gesch=C3=A4ftliche Mitteilung im Sinne des EHUG= . > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org= " >