From owner-freebsd-scsi@freebsd.org Sun Jan 22 00:08:13 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0554ECB016C; Sun, 22 Jan 2017 00:08:13 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (gate2.funkthat.com [208.87.223.18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "gold.funkthat.com", Issuer "gold.funkthat.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C825C6A; Sun, 22 Jan 2017 00:08:12 +0000 (UTC) (envelope-from jmg@gold.funkthat.com) Received: from gold.funkthat.com (localhost [127.0.0.1]) by gold.funkthat.com (8.15.2/8.15.2) with ESMTPS id v0LNpVDb043310 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 21 Jan 2017 15:51:31 -0800 (PST) (envelope-from jmg@gold.funkthat.com) Received: (from jmg@localhost) by gold.funkthat.com (8.15.2/8.15.2/Submit) id v0LNpVBV043309; Sat, 21 Jan 2017 15:51:31 -0800 (PST) (envelope-from jmg) Date: Sat, 21 Jan 2017 15:51:31 -0800 From: John-Mark Gurney <jmg@funkthat.com> To: Aijaz Baig <aijazbaig1@gmail.com> Cc: "Greg 'groggy' Lehey" <grog@freebsd.org>, FreeBSD Hackers <freebsd-hackers@freebsd.org>, freebsd-scsi@freebsd.org Subject: Re: Understanding the rationale behind dropping of "block devices" Message-ID: <20170121235131.GF1768@funkthat.com> Mail-Followup-To: Aijaz Baig <aijazbaig1@gmail.com>, Greg 'groggy' Lehey <grog@freebsd.org>, FreeBSD Hackers <freebsd-hackers@freebsd.org>, freebsd-scsi@freebsd.org References: <CAHB2L+dRbX=E9NxGLd_eHsEeD0ZVYDYAx2k9h17BR0Lc=xu5HA@mail.gmail.com> <20170116071105.GB4560@eureka.lemis.com> <CAHB2L+d9=rBBo48qR+PXgy+JDa=VRk5cM+9hAKDCPW+rqFgZAQ@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <CAHB2L+d9=rBBo48qR+PXgy+JDa=VRk5cM+9hAKDCPW+rqFgZAQ@mail.gmail.com> X-Operating-System: FreeBSD 11.0-ALPHA2 amd64 X-PGP-Fingerprint: D87A 235F FB71 1F3F 55B7 ED9B D5FF 5A51 C0AC 3D65 X-Files: The truth is out there X-URL: https://www.funkthat.com/ X-Resume: https://www.funkthat.com/~jmg/resume.html X-TipJar: bitcoin:13Qmb6AeTgQecazTWph4XasEsP7nGRbAPE X-to-the-FBI-CIA-and-NSA: HI! HOW YA DOIN? can i haz chizburger? User-Agent: Mutt/1.6.1 (2016-04-27) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (gold.funkthat.com [127.0.0.1]); Sat, 21 Jan 2017 15:51:31 -0800 (PST) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Sun, 22 Jan 2017 00:08:13 -0000 Aijaz Baig wrote this message on Mon, Jan 16, 2017 at 14:19 +0530: > Nevertheless my question still holds. What does 'removing support for block > device' mean in this context? Was what I mentioned earlier with regards to > my understanding correct? Viz. all disk devices now have a character (or > raw) interface and are no longer served via the "page cache" but rather the > "buffer cache". Does that mean all disk accesses are now direct by passing > the file system?? One of the other reasons block devices were removed was that if there was a write error on the underlying device, there was no way for the writer to know that the write failed. This could/would lead to corrupted data which is bad. -- John-Mark Gurney Voice: +1 415 225 5579 "All that I will do, has been done, All that I have, has not." From owner-freebsd-scsi@freebsd.org Sun Jan 22 08:02:44 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 473B3CBCC14; Sun, 22 Jan 2017 08:02:44 +0000 (UTC) (envelope-from phk@freebsd.org) Received: from phk.freebsd.dk (phk.freebsd.dk [130.225.244.222]) by mx1.freebsd.org (Postfix) with ESMTP id 0D233A7D; Sun, 22 Jan 2017 08:02:43 +0000 (UTC) (envelope-from phk@freebsd.org) Received: from critter.freebsd.dk (unknown [192.168.55.3]) by phk.freebsd.dk (Postfix) with ESMTP id ADC22273DA; Sun, 22 Jan 2017 08:02:35 +0000 (UTC) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.15.2/8.15.2) with ESMTP id v0M82Ynx074697; Sun, 22 Jan 2017 08:02:35 GMT (envelope-from phk@freebsd.org) To: John-Mark Gurney <jmg@funkthat.com> cc: Aijaz Baig <aijazbaig1@gmail.com>, "Greg 'groggy' Lehey" <grog@freebsd.org>, FreeBSD Hackers <freebsd-hackers@freebsd.org>, freebsd-scsi@freebsd.org Subject: Re: Understanding the rationale behind dropping of "block devices" In-reply-to: <20170121235131.GF1768@funkthat.com> From: "Poul-Henning Kamp" <phk@freebsd.org> References: <CAHB2L+dRbX=E9NxGLd_eHsEeD0ZVYDYAx2k9h17BR0Lc=xu5HA@mail.gmail.com> <20170116071105.GB4560@eureka.lemis.com> <CAHB2L+d9=rBBo48qR+PXgy+JDa=VRk5cM+9hAKDCPW+rqFgZAQ@mail.gmail.com> <20170121235131.GF1768@funkthat.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <74695.1485072153.1@critter.freebsd.dk> Content-Transfer-Encoding: quoted-printable Date: Sun, 22 Jan 2017 08:02:34 +0000 Message-ID: <74696.1485072154@critter.freebsd.dk> X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Sun, 22 Jan 2017 08:02:44 -0000 -------- In message <20170121235131.GF1768@funkthat.com>, John-Mark Gurney writes: >Aijaz Baig wrote this message on Mon, Jan 16, 2017 at 14:19 +0530: >> Nevertheless my question still holds. What does 'removing support for b= lock >> device' mean in this context? Was what I mentioned earlier with regards= to >> my understanding correct? Viz. all disk devices now have a character (o= r >> raw) interface and are no longer served via the "page cache" but rather= the >> "buffer cache". Does that mean all disk accesses are now direct by pass= ing >> the file system?? > >One of the other reasons block devices were removed was that if there >was a write error on the underlying device, there was no way for the >writer to know that the write failed. This could/would lead to corrupted >data which is bad. This paper hopefully answers a lot of the questions: https://www.usenix.org/conference/bsdcon02/rethinking-dev-and-devices-= unix-kernel -- = Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe = Never attribute to malice what can adequately be explained by incompetence= . From owner-freebsd-scsi@freebsd.org Tue Jan 24 04:40:17 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7DCDACBF0A3; Tue, 24 Jan 2017 04:40:17 +0000 (UTC) (envelope-from aijazbaig1@gmail.com) Received: from mail-wm0-x235.google.com (mail-wm0-x235.google.com [IPv6:2a00:1450:400c:c09::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 154AA3EC; Tue, 24 Jan 2017 04:40:17 +0000 (UTC) (envelope-from aijazbaig1@gmail.com) Received: by mail-wm0-x235.google.com with SMTP id r126so163416730wmr.0; Mon, 23 Jan 2017 20:40:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=6TVJwf6yjP1d56UpF8cXGajYWsnDZcxv0oePv8iA1Oc=; b=Yy9EgPKSO0EVxcKnrN/1odQq0EgPlTDJHP7tvLXyL6p9azpJyM7ZrK3NIY7mue3+B4 5GCfPB8DDCgFkzDbMZLV3wIEsuK4HiEiOwHatti0ic9U5yNCPS88cLU6zRfT3po9gszW BqH7n3UjKlwQSGDHgb9bxmnBNbDRky8WmoIylG97hCEzXXd0MUbGa5noudbSUzaVs71x EY49i8Ap9FWwuBX6WMua4D324bnvdee+/3TCkIWgwtM5hR8oGwfpnyrXpqvubvxO6GBJ MAt8zVCmYVYuoF+hfhSdueZhWX6XaRLo4wSQpe1JsjkVstyltumj6oIvnkz+Ua7ctkKW qaOw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=6TVJwf6yjP1d56UpF8cXGajYWsnDZcxv0oePv8iA1Oc=; b=r4xsFhSivGLEHylJ2g1xe+bSeZtNpp8Kht5H93mz5wlGJj1yJ6y0xVMzdQLPkVTrIG +Toom0fDKbAkXSbwGRLu0s4BOkKCq+LGUPGFqrR/8wRjn9v/A1qHsuFLkFY+7ZNjgITf RdJtGPxK6db+tE0b2YO9Uv/9ILbTC0XVBI4i8vDMJwkY7S0ymPGP5rbjtPjyPFBubzaw hXSB8XptFwh0EIXs8RdAwbhwaFbv/6LFp9AhKxIG1tbZeiSssJSONavjpykGl/LEoesa jrbBqlelwgqF+4bbYehluFfThDFYTrhpGYS8VesO+AnHeNF6PA4kTDjDudxSIIYtgCAq +Qgg== X-Gm-Message-State: AIkVDXKqcAv6/Ns4U32KVv6qTMbK6xjeEbpyuIt/uVnhMu/Yfrh8KmEqjgUlJMUy8fN33y61TCLZgIe3JHqBPA== X-Received: by 10.223.165.87 with SMTP id j23mr32293490wrb.79.1485232815040; Mon, 23 Jan 2017 20:40:15 -0800 (PST) MIME-Version: 1.0 Received: by 10.194.189.103 with HTTP; Mon, 23 Jan 2017 20:40:14 -0800 (PST) In-Reply-To: <74696.1485072154@critter.freebsd.dk> References: <CAHB2L+dRbX=E9NxGLd_eHsEeD0ZVYDYAx2k9h17BR0Lc=xu5HA@mail.gmail.com> <20170116071105.GB4560@eureka.lemis.com> <CAHB2L+d9=rBBo48qR+PXgy+JDa=VRk5cM+9hAKDCPW+rqFgZAQ@mail.gmail.com> <20170121235131.GF1768@funkthat.com> <74696.1485072154@critter.freebsd.dk> From: Aijaz Baig <aijazbaig1@gmail.com> Date: Tue, 24 Jan 2017 10:10:14 +0530 Message-ID: <CAHB2L+fPpqCZJ_PXfgxZDS2qDAvs5M9fLRMXWg1d+4eDgqxQ9w@mail.gmail.com> Subject: Re: Understanding the rationale behind dropping of "block devices" To: Poul-Henning Kamp <phk@freebsd.org> Cc: John-Mark Gurney <jmg@funkthat.com>, "Greg 'groggy' Lehey" <grog@freebsd.org>, FreeBSD Hackers <freebsd-hackers@freebsd.org>, freebsd-scsi@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Tue, 24 Jan 2017 04:40:17 -0000 Oh thank you Poul. This would hopefully cover almost everything I need to know! On Sun, Jan 22, 2017 at 1:32 PM, Poul-Henning Kamp <phk@freebsd.org> wrote: > -------- > In message <20170121235131.GF1768@funkthat.com>, John-Mark Gurney writes: > >Aijaz Baig wrote this message on Mon, Jan 16, 2017 at 14:19 +0530: > >> Nevertheless my question still holds. What does 'removing support for > block > >> device' mean in this context? Was what I mentioned earlier with regards > to > >> my understanding correct? Viz. all disk devices now have a character (or > >> raw) interface and are no longer served via the "page cache" but rather > the > >> "buffer cache". Does that mean all disk accesses are now direct by > passing > >> the file system?? > > > >One of the other reasons block devices were removed was that if there > >was a write error on the underlying device, there was no way for the > >writer to know that the write failed. This could/would lead to corrupted > >data which is bad. > > This paper hopefully answers a lot of the questions: > > https://www.usenix.org/conference/bsdcon02/rethinking-dev-and-devices- > unix-kernel > > > -- > Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 > phk@FreeBSD.ORG | TCP/IP since RFC 956 > FreeBSD committer | BSD since 4.3-tahoe > Never attribute to malice what can adequately be explained by incompetence. > -- Best Regards, Aijaz Baig From owner-freebsd-scsi@freebsd.org Wed Jan 25 10:26:43 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3128FCBF36D for <freebsd-scsi@mailman.ysv.freebsd.org>; Wed, 25 Jan 2017 10:26:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1ECF51B9C for <freebsd-scsi@FreeBSD.org>; Wed, 25 Jan 2017 10:26:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v0PAQg3u027432 for <freebsd-scsi@FreeBSD.org>; Wed, 25 Jan 2017 10:26:42 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-scsi@FreeBSD.org Subject: [Bug 212454] [request] iSCSI hardware CRC32C support Date: Wed, 25 Jan 2017 10:26:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: ben.rubson@gmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-scsi@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: <bug-212454-5312-B2NPhg00I2@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> References: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Wed, 25 Jan 2017 10:26:43 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212454 --- Comment #3 from Ben RUBSON <ben.rubson@gmail.com> --- Hi, Some thoughts regarding this ? Many thanks ! Ben --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-scsi@freebsd.org Wed Jan 25 10:51:28 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 27440CC024F for <freebsd-scsi@mailman.ysv.freebsd.org>; Wed, 25 Jan 2017 10:51:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 173BC173E for <freebsd-scsi@FreeBSD.org>; Wed, 25 Jan 2017 10:51:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v0PApRkU086946 for <freebsd-scsi@FreeBSD.org>; Wed, 25 Jan 2017 10:51:27 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-scsi@FreeBSD.org Subject: [Bug 212454] [request] iSCSI hardware CRC32C support Date: Wed, 25 Jan 2017 10:51:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: trasz@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-scsi@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: <bug-212454-5312-1uJdjs3Am2@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> References: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Wed, 25 Jan 2017 10:51:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212454 --- Comment #4 from Edward Tomasz Napierala <trasz@FreeBSD.org> --- Not sure, to be honest. I don't really plan on taking on this at this poin= t, due to lack of time. But I also think the PR is kind of titled wrong, for a number of reasons. First, CRC32C is optional in iSCSI, and disabled by def= ault - and for a reason, it can lower performance (obviously). Second, I think = we actually do have CRC32C offload, along with other iSCSI offloads, in cxgbei= .=20 And third, iSCSI doesn't implement CRC32C; it just calls the calculate_crc3= 2c() routine. So it's actually just about implementing optimized versions of calculate_crc32c(). --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-scsi@freebsd.org Wed Jan 25 21:28:04 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AC6CACC1CFA for <freebsd-scsi@mailman.ysv.freebsd.org>; Wed, 25 Jan 2017 21:28:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9C21EF6 for <freebsd-scsi@FreeBSD.org>; Wed, 25 Jan 2017 21:28:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v0PLS4vh088938 for <freebsd-scsi@FreeBSD.org>; Wed, 25 Jan 2017 21:28:04 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-scsi@FreeBSD.org Subject: [Bug 212454] [request] iSCSI hardware CRC32C support Date: Wed, 25 Jan 2017 21:28:04 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: ben.rubson@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-scsi@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: <bug-212454-5312-7mNoPwcLq0@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> References: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Wed, 25 Jan 2017 21:28:04 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212454 Ben RUBSON <ben.rubson@gmail.com> changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |DUPLICATE --- Comment #5 from Ben RUBSON <ben.rubson@gmail.com> --- Thank you very much for your feedback ! Mmmmh unfortunately I do not run Chelsio but MLX adapters. I agree with you, goal would be to have optimized versions of calculate_crc32c(). I then just opened the following request : 216467 Thank you ! *** This bug has been marked as a duplicate of bug 216467 *** --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-scsi@freebsd.org Fri Jan 27 02:25:43 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D60E2CC30A4; Fri, 27 Jan 2017 02:25:43 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from vps1.elischer.org (vps1.elischer.org [204.109.63.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vps1.elischer.org", Issuer "CA Cert Signing Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id BA4D9DC4; Fri, 27 Jan 2017 02:25:43 +0000 (UTC) (envelope-from julian@freebsd.org) Received: from Julian-MBP3.local (ppp121-45-228-247.lns20.per1.internode.on.net [121.45.228.247]) (authenticated bits=0) by vps1.elischer.org (8.15.2/8.15.2) with ESMTPSA id v0R2Pb45085620 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NO); Thu, 26 Jan 2017 18:25:41 -0800 (PST) (envelope-from julian@freebsd.org) Subject: Re: Understanding the rationale behind dropping of "block devices" To: Konstantin Belousov <kostikbel@gmail.com> References: <CAHB2L+dRbX=E9NxGLd_eHsEeD0ZVYDYAx2k9h17BR0Lc=xu5HA@mail.gmail.com> <20170116071105.GB4560@eureka.lemis.com> <CAHB2L+d9=rBBo48qR+PXgy+JDa=VRk5cM+9hAKDCPW+rqFgZAQ@mail.gmail.com> <a86ad6f5-954d-62f0-fdb3-9480a13dc1c3@freebsd.org> <20170116110009.GN2349@kib.kiev.ua> Cc: Aijaz Baig <aijazbaig1@gmail.com>, "Greg 'groggy' Lehey" <grog@freebsd.org>, FreeBSD Hackers <freebsd-hackers@freebsd.org>, freebsd-scsi@freebsd.org From: Julian Elischer <julian@freebsd.org> Message-ID: <7cf12959-5c1e-2be8-5974-69a96f2cd9d7@freebsd.org> Date: Fri, 27 Jan 2017 10:25:32 +0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <20170116110009.GN2349@kib.kiev.ua> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Fri, 27 Jan 2017 02:25:43 -0000 On 16/1/17 7:00 pm, Konstantin Belousov wrote: > On Mon, Jan 16, 2017 at 05:20:25PM +0800, Julian Elischer wrote: >> On 16/01/2017 4:49 PM, Aijaz Baig wrote: >>> Oh yes I was actually running an old release inside a VM and yes I had >>> changed the device names myself while jotting down notes (to give it a more >>> descriptive name like what the OSX does). So now I've checked it on a >>> recent release and yes there is indeed no block device. >>> >>> root@bsd-client:/dev # gpart show >>> => 34 83886013 da0 GPT (40G) >>> 34 1024 1 freebsd-boot (512K) >>> 1058 58719232 2 freebsd-ufs (28G) >>> 58720290 3145728 3 freebsd-swap (1.5G) >>> 61866018 22020029 - free - (10G) >>> >>> root@bsd-client:/dev # ls -lrt da* >>> crw-r----- 1 root operator 0x4d Dec 19 17:49 da0p1 >>> crw-r----- 1 root operator 0x4b Dec 19 17:49 da0 >>> crw-r----- 1 root operator 0x4f Dec 19 23:19 da0p3 >>> crw-r----- 1 root operator 0x4e Dec 19 23:19 da0p2 >>> >>> So this shows that I have a single SATA or SAS drive and there are >>> apparently 3 partitions ( or is it four?? Why does it show unused space >>> when I had used the entire disk?) >>> >>> Nevertheless my question still holds. What does 'removing support for block >>> device' mean in this context? Was what I mentioned earlier with regards to >>> my understanding correct? Viz. all disk devices now have a character (or >>> raw) interface and are no longer served via the "page cache" but rather the >>> "buffer cache". Does that mean all disk accesses are now direct by passing >>> the file system?? >> Basically, FreeBSD never really buffered/cached by device. >> >> Buffering and caching is done by vnode in the filesystem. >> We have no device-based block cache. If you want file X at offset Y, >> then we can satisfy that from cache. >> VM objects map closely to vnode objects so the VM system IS the file >> system buffer cache. > This is not true. > > We do have buffer cache of the blocks read through the device (special) > vnode. This is how, typically, the metadata for filesystems which are > clients of the buffer cache, is handled, i.e. UFS msdosfs cd9600 etc. > It is up to the filesystem to not create aliased cached copies of the > blocks both in the device vnode buffer list and in the filesystem vnode. > > In fact, sometimes filesystems, e.g. UFS, consciously break this rule > and read blocks of the user vnode through the disk cache. For instance, > this happens for the SU truncation of the indirect blocks. yes this caches blocks as an offset into a device, but it is still really a part of the system which provides caching services to vnodes. (at least that is how it was last time I looked) > >> If you want device M, at offset N we will fetch it for you from the >> device, DMA'd directly into your address space, >> but there is no cached copy. >> Having said that, it would be trivial to add a 'caching' geom layer to >> the system but that has never been needed. > The useful interpretation of the claim that FreeBSD does not cache > disk blocks is that the cache is not accessible over the user-initiated > i/o (read(2) and write(2)) through the opened devfs nodes. If a program > issues such request, it indeed goes directly to/from disk driver, which > is supplied a kernel buffer formed by remapped user pages. Note that > if this device was or is mounted and filesystem kept some metadata in > the buffer cache, then the devfs i/o would make the cache inconsistent. > >> The added complexity of carrying around two alternate interfaces to >> the same devices was judged by those who did the work to be not worth >> the small gain available to the very few people who used raw devices. >> Interestingly, since that time ZFS has implemented a block-layer cache >> for itself which is of course not integrated with the non-existing >> block level cache in the system :-). > We do carry two interfaces in the cdev drivers, which are lumped into > one. In particular, it is not easy to implement mapping of the block > devices exactly because the interfaces are mixed. If cdev disk device is > mapped, VM would try to use cdevsw d_mmap or later mapping interfaces to > handle user page faults, which is incorrect for the purpose of the disk > block mapping. > From owner-freebsd-scsi@freebsd.org Fri Jan 27 17:44:10 2017 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AA58DCBF674 for <freebsd-scsi@mailman.ysv.freebsd.org>; Fri, 27 Jan 2017 17:44:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9A3E065C for <freebsd-scsi@FreeBSD.org>; Fri, 27 Jan 2017 17:44:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v0RHiA03000851 for <freebsd-scsi@FreeBSD.org>; Fri, 27 Jan 2017 17:44:10 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-scsi@FreeBSD.org Subject: [Bug 212454] [request] iSCSI hardware CRC32C support Date: Fri, 27 Jan 2017 17:44:10 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: ben.rubson@gmail.com X-Bugzilla-Status: Closed X-Bugzilla-Resolution: DUPLICATE X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-scsi@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: <bug-212454-5312-wUvHpthitH@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> References: <bug-212454-5312@https.bugs.freebsd.org/bugzilla/> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Fri, 27 Jan 2017 17:44:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212454 --- Comment #6 from Ben RUBSON <ben.rubson@gmail.com> --- Just for info, has just been implemented by Conrad : https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D216467 Really nice improvement ! --=20 You are receiving this mail because: You are the assignee for the bug.=