From owner-freebsd-hackers@freebsd.org Wed Feb 22 06:54:22 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C9DEBCE9573 for ; Wed, 22 Feb 2017 06:54:22 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from id.bluezbox.com (id.bluezbox.com [45.55.20.155]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9EC111B30; Wed, 22 Feb 2017 06:54:21 +0000 (UTC) (envelope-from gonzo@bluezbox.com) Received: from [127.0.0.1] (helo=id.bluezbox.com) by id.bluezbox.com with esmtps (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256) (Exim 4.87 (FreeBSD)) (envelope-from ) id 1cgQoT-000520-3Y; Tue, 21 Feb 2017 22:54:22 -0800 Received: (from gonzo@localhost) by id.bluezbox.com (8.15.2/8.15.2/Submit) id v1M6s8ld019343; Tue, 21 Feb 2017 22:54:08 -0800 (PST) (envelope-from gonzo@bluezbox.com) X-Authentication-Warning: id.bluezbox.com: gonzo set sender to gonzo@bluezbox.com using -f Date: Tue, 21 Feb 2017 22:54:08 -0800 From: Oleksandr Tymoshenko To: Alan Somers Cc: "freebsd-hackers@freebsd.org" Subject: Re: TravisCI vs BuildBot vs Bamboo vs Jenkins Message-ID: <20170222065408.GA19302@bluezbox.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Operating-System: FreeBSD/11.0-RELEASE-p2 (amd64) User-Agent: Mutt/1.6.1 (2016-04-27) X-Spam-Level: -- X-Spam-Report: Spam detection software, running on the system "id.bluezbox.com", has NOT identified this incoming email as spam. The original message has been attached to this so you can view it or label similar future email. If you have any questions, see The administrator of that system for details. Content preview: Alan Somers (asomers@freebsd.org) wrote: > All of the cool kids are hosting their projects on Github and using > TravisCI for continuous testing. The integration is fairly slick. > But TravisCI only supports OSX and Linux. Every time a user opens a > feature request for FreeBSD support > (https://github.com/travis-ci/travis-ci/issues/1818, > https://github.com/travis-ci/travis-ci/issues/5473, > https://github.com/travis-ci/travis-ci/issues/6671), it gets closed by > a Travis employee who thinks that FreeBSD is a Linux distro. > > One overachiever managed to trick Travis into running FreeBSD by using > QEMU to fire up a VM as an unprivileged user process and run his tests > inside of that. > https://erouault.blogspot.com/2016/09/running-freebsd-in-travis-ci.html > > And a few projects are even doing this very thing, though it seems > like a bit abusive to me. > https://travis-ci.org/rust-lang/libc/jobs/203950308 > > > So my question is, what's the best alternative? > > BuildBot can run on pretty much anything, and supposedly it can hook > into all of the popular code hosting platforms. > https://docs.buildbot.net/latest/manual/cfg-wwwhooks.html > > Bamboo is also very portable, and has a slick GUI to connect to > Bitbucket. Unfortunately, it's closed-source, but free licenses are > available for open-source developers. Unfortunately, it's written in > Java. > https://developer.atlassian.com/blog/2016/02/totw-connecting-bamboo-and-bitbucket-cloud/ > > Jenkins is free and portable and has some level of Github and > Bitbucket integration. Unfortunately it's also written in Java. > https://jenkins.io/solutions/github/ > > > Does anybody have experience with any of these solutions? Are there > alternatives I've overlooked? [...] Content analysis details: (-2.9 points, 5.0 required) pts rule name description ---- ---------------------- -------------------------------------------------- 0.0 URIBL_BLOCKED ADMINISTRATOR NOTICE: The query to URIBL was blocked. See http://wiki.apache.org/spamassassin/DnsBlocklists#dnsbl-block for more information. [URIs: atlassian.com] -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Feb 2017 06:54:22 -0000 Alan Somers (asomers@freebsd.org) wrote: > All of the cool kids are hosting their projects on Github and using > TravisCI for continuous testing. The integration is fairly slick. > But TravisCI only supports OSX and Linux. Every time a user opens a > feature request for FreeBSD support > (https://github.com/travis-ci/travis-ci/issues/1818, > https://github.com/travis-ci/travis-ci/issues/5473, > https://github.com/travis-ci/travis-ci/issues/6671), it gets closed by > a Travis employee who thinks that FreeBSD is a Linux distro. > > One overachiever managed to trick Travis into running FreeBSD by using > QEMU to fire up a VM as an unprivileged user process and run his tests > inside of that. > https://erouault.blogspot.com/2016/09/running-freebsd-in-travis-ci.html > > And a few projects are even doing this very thing, though it seems > like a bit abusive to me. > https://travis-ci.org/rust-lang/libc/jobs/203950308 > > > So my question is, what's the best alternative? > > BuildBot can run on pretty much anything, and supposedly it can hook > into all of the popular code hosting platforms. > https://docs.buildbot.net/latest/manual/cfg-wwwhooks.html > > Bamboo is also very portable, and has a slick GUI to connect to > Bitbucket. Unfortunately, it's closed-source, but free licenses are > available for open-source developers. Unfortunately, it's written in > Java. > https://developer.atlassian.com/blog/2016/02/totw-connecting-bamboo-and-bitbucket-cloud/ > > Jenkins is free and portable and has some level of Github and > Bitbucket integration. Unfortunately it's also written in Java. > https://jenkins.io/solutions/github/ > > > Does anybody have experience with any of these solutions? Are there > alternatives I've overlooked? FreeBSD's CI is built using Jenkins: https://ci.freebsd.org also https://wiki.freebsd.org/Jenkins so it must be working fine with FreeBSD. I've been using Jenkins for number of years (not in *BSD world though) and I kind of like it despite somewhat trashy UI. My main complaint is that you can't have CI pipeline description/settings in file in version control (like in GitLab for instance) and have to set it up manually via web UI or API. Other than that it's fairly good system. -- gonzo