From owner-freebsd-fs@freebsd.org Wed Jun 22 11:26:26 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 28118AC58CC for ; Wed, 22 Jun 2016 11:26:26 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E3B5F2DFA for ; Wed, 22 Jun 2016 11:26:25 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id 3A79A153402; Wed, 22 Jun 2016 10:57:05 +0200 (CEST) X-Virus-Scanned: amavisd-new at digiware.com Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xWtymWGBsLaS; Wed, 22 Jun 2016 10:56:55 +0200 (CEST) Received: from [192.168.10.10] (asus [192.168.10.10]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id F0A86153430; Wed, 22 Jun 2016 10:56:54 +0200 (CEST) Subject: Re: pNFS server Plan B To: Jordan Hubbard , Rick Macklem References: <1524639039.147096032.1465856925174.JavaMail.zimbra@uoguelph.ca> Cc: freebsd-fs , Alexander Motin From: Willem Jan Withagen Message-ID: <16d38847-f515-f532-1300-d2843005999e@digiware.nl> Date: Wed, 22 Jun 2016 10:56:57 +0200 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jun 2016 11:26:26 -0000 Hi Jordan, To rip just a bit of your text out of context: On 18-6-2016 22:50, Jordan Hubbard wrote: > Some, if not most, of them are also far > better supported under Linux than FreeBSD (I don’t think we even have > a working ceph port yet). In the spare time I have left, I'm trying to get a lot of small fixes into the ceph tree to get it actually compiling, testing, and running on FreeBSD. But Ceph is a lot of code, and since a lot of people are working on it, the number of code changes are big. And just keeping up with that is sometimes hard. More and more Linux-isms are dropped into the the code. So progress is slow. I only because it is hard to get people to look at the commits and get them. Current state is that I have it compile everything, and I can run 120 of 129 test with success. I once had them complete all, but then a busload of changes were dropped in the tree. And so I needed to "start "repairing" again. I gave a small presentation of my work thus far at Ceph Day Cern in Geneva. https://indico.cern.ch/event/542464/contributions/2202309/ Differences in code are not really that big in the CC-code, most of the things to fix are additional tools that have to deal with the infrastructure that fully assumes it is running a Linux-distro. Next to that is Ceph going to its own diskstore system: BlueStore, where as I hope(d) to base it on a ZFS underlying layer... To run BlueStore AIO is needed for diskdevices, but the current AIO is not call for call compatible, and requires a glue layer. I have not looked into the size of the semantic problems between Linux and FreeBSD here. On the other hand they just declared CephFS (a posix filesystem running on Ceph) stable and to be used. --WjW