From owner-freebsd-hackers@freebsd.org Wed Feb 22 00:32:40 2017 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6982FCE5939 for ; Wed, 22 Feb 2017 00:32:40 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-yw0-x230.google.com (mail-yw0-x230.google.com [IPv6:2607:f8b0:4002:c05::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2B58315DB for ; Wed, 22 Feb 2017 00:32:40 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-yw0-x230.google.com with SMTP id l19so72585358ywc.2 for ; Tue, 21 Feb 2017 16:32:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:from:date:message-id:subject:to; bh=WlN8DaBgFplWDgmkVHLR6s/vwxPEwntXKI8Yg0z5pJg=; b=msK5b3N6S685z/8ZXAQ4gI+xulHoYRtDS4ur3zYXosm+60TH7DauJHsznsnoWUf97L ZfgckL/KE8LQY2i4c5KFpPt/sDoxzmU7oLemVeXuJxeS8+Him6cKU21Lxlo7R65IWp86 uZqszDL8xXiiDsuOHwBJRgMOtl0Tf3k3lxLAmMBpgf38U5iWSp1RkJDUzjlp4baJ1LC3 AoxvFBDuuJj8+bx0n4EezCSowUZlQuB9Q1RotMiY6c5a2r5VMpvobyQ2ZI9tqNLN80TD VfHgJpnGuU8HyN4BI50X6tYQANVrGLI5vIjGTMQiWEQC39549uyrxyf5y3dpXyNR5UK0 W1Qw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:from:date:message-id:subject :to; bh=WlN8DaBgFplWDgmkVHLR6s/vwxPEwntXKI8Yg0z5pJg=; b=AfINGBy0S2+rsE40nIkPe3DfsZ6xvYjy6OqYGsT2B4Of7472VslbL6b0Ugir5ZRmyJ U95vVzYvWNlEUyaYjMVryQ2Hl0MnHo8KNl+aGuIGjp/Kdte4sCU8bCr/HSbMZQsbHFNT feUZgklYgzza8RrXTV6NoAiH8M0wvTEp0Jl/3fgK9Pd183b55aYMNRLf4ibgKxfU2C3d lISnPCrcH7WyvvnfevRu5gYoGqw3A+l7ULq8s9DxvzaCkeSL4pYqC77cyOH3Tkc4h/hy 3sfkqKdvMUY4b+yDv/3ATSZc+9puXvrNYhdfa5ksrIG2d7usu6odvS7U70fPB60l6Bjl nY/Q== X-Gm-Message-State: AMke39kqT5yyrRFRk+XSKj4w43x3SSt/2jju2+ZAbUM8N5+xmHoy/+RKD8Z83j7BEvHCPsGrI+H+XHr8/OBIUA== X-Received: by 10.129.141.6 with SMTP id d6mr22233790ywg.36.1487723559066; Tue, 21 Feb 2017 16:32:39 -0800 (PST) MIME-Version: 1.0 Sender: asomers@gmail.com Received: by 10.129.38.133 with HTTP; Tue, 21 Feb 2017 16:32:38 -0800 (PST) From: Alan Somers Date: Tue, 21 Feb 2017 17:32:38 -0700 X-Google-Sender-Auth: -WWzViUCwHFfQU64OcoBtLV3Fdg Message-ID: Subject: TravisCI vs BuildBot vs Bamboo vs Jenkins To: "freebsd-hackers@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Feb 2017 00:32:40 -0000 All of the cool kids are hosting their projects on Github and using TravisCI for continuous testing. The integration is fairly slick. But TravisCI only supports OSX and Linux. Every time a user opens a feature request for FreeBSD support (https://github.com/travis-ci/travis-ci/issues/1818, https://github.com/travis-ci/travis-ci/issues/5473, https://github.com/travis-ci/travis-ci/issues/6671), it gets closed by a Travis employee who thinks that FreeBSD is a Linux distro. One overachiever managed to trick Travis into running FreeBSD by using QEMU to fire up a VM as an unprivileged user process and run his tests inside of that. https://erouault.blogspot.com/2016/09/running-freebsd-in-travis-ci.html And a few projects are even doing this very thing, though it seems like a bit abusive to me. https://travis-ci.org/rust-lang/libc/jobs/203950308 So my question is, what's the best alternative? BuildBot can run on pretty much anything, and supposedly it can hook into all of the popular code hosting platforms. https://docs.buildbot.net/latest/manual/cfg-wwwhooks.html Bamboo is also very portable, and has a slick GUI to connect to Bitbucket. Unfortunately, it's closed-source, but free licenses are available for open-source developers. Unfortunately, it's written in Java. https://developer.atlassian.com/blog/2016/02/totw-connecting-bamboo-and-bitbucket-cloud/ Jenkins is free and portable and has some level of Github and Bitbucket integration. Unfortunately it's also written in Java. https://jenkins.io/solutions/github/ Does anybody have experience with any of these solutions? Are there alternatives I've overlooked? -Alan