From owner-freebsd-fs@freebsd.org Mon Dec 7 00:03:58 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 01C909A0E4C for ; Mon, 7 Dec 2015 00:03:58 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from smtp.digiware.nl (unknown [IPv6:2001:4cb8:90:ffff::3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8EF6115D4 for ; Mon, 7 Dec 2015 00:03:57 +0000 (UTC) (envelope-from wjw@digiware.nl) Received: from rack1.digiware.nl (unknown [127.0.0.1]) by smtp.digiware.nl (Postfix) with ESMTP id D1678153418; Mon, 7 Dec 2015 01:03:51 +0100 (CET) X-Virus-Scanned: amavisd-new at digiware.nl Received: from smtp.digiware.nl ([127.0.0.1]) by rack1.digiware.nl (rack1.digiware.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ha1dfKy0tFPK; Mon, 7 Dec 2015 01:03:42 +0100 (CET) Received: from [IPv6:2001:4cb8:3:1:953f:f3db:1564:452f] (unknown [IPv6:2001:4cb8:3:1:953f:f3db:1564:452f]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.digiware.nl (Postfix) with ESMTPSA id ED1CB153416; Sun, 6 Dec 2015 23:52:11 +0100 (CET) Subject: Re: CEPH + FreeBSD To: Jordan Hubbard References: <5661752C.1090200@digiware.nl> <88732E11-8570-4D02-9374-3F1419EABC6F@icloud.com> Cc: Rakshith Venkatesh , freebsd-fs@freebsd.org From: Willem Jan Withagen Message-ID: <5664BC1C.6060207@digiware.nl> Date: Sun, 6 Dec 2015 23:52:12 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.4.0 MIME-Version: 1.0 In-Reply-To: <88732E11-8570-4D02-9374-3F1419EABC6F@icloud.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Dec 2015 00:03:58 -0000 On 6-12-2015 21:56, Jordan Hubbard wrote: > >> On Dec 4, 2015, at 3:12 AM, Willem Jan Withagen >> wrote: >> >> Talking to Sage Weill, he said that one of the main things to keep >> FreeBSD-Ceph up and running, is the possibility to actually run >> the automated builds and tests on a FreeBSD system. So that is >> something I/we need to think about. > > I think sufficient cloud resources to run a jenkins CI environment or > something which does the builds on commit triggers and runs > regression tests are the easy part - we run dozens (if not hundreds) > of virtual FreeBSD instances in multiple datacenters to facilitate > our own testing and donating a VM to this effort would be trivial. I have for this more or less the same feeling. Given the number of companies actually running FreeBSD in all shapes and form, would it not be very hard to find either real hardware, let alone getting VMs to run tests.... > I’m more intrigued by the part of the sentence which says “to keep > FreeBSD-Ceph up and running” since it implies that Ceph on FreeBSD is > already working? It was my understanding that we were more at the > part of the story where “sufficiently motivated and skilled > filesystem porting engineers” could not be found, and if that’s > changed then that’s obviously a different ball game! I think I paraphrased Sage words incomplete, and the part I forgot is where you wishful thinking is. I've received several (atleast 3) Git Pull sets that modify the Ceph tree into a shape that it more or less compiles. However these sets do not overlap, and each all fix different parts of the tree. And some of the monitoring is claimed to be able to connect to a Linux based storage system. So no, Ceph is by no way completely ported. Sage response was more to my question whether the Ceph community would accept patches to get more parts in Ceph working. And in essence was the response: Yes, but note that it is only useful if and only if the FreeBSD port is integrated with the automatic testing framework that they are running to make sure that porting efforts are not wasted by bitrot due to little maintenance. And that I think refers back again to you original remark that a first effort to port was started, but then that attempt got orphaned. Which resulted in odd FreeBSD bit and pieces in several parts of the code. I've really started with another perception: I like to make sure that all tests are passed for the parts that at first (easy) portable to FreeBSD. And continue from there. Let alone that I hardy qualify as "skilled filesystem porting engineer", so once I get caught in that corner progress is going to be slow to none. So for the time I've not set my goal to have it all done real soon. Some tests are easy to fix, where the test-scripts want to use 'grep -P', where 'grep -E' would also work. Other fixes require more understanding of what is actually going on under the hood. --WjW