&os; Cluster Administration Team

From owner-svn-doc-head@freebsd.org Fri Oct 16 02:49:34 2015 Return-Path: Delivered-To: svn-doc-head@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A9A18A1544E; Fri, 16 Oct 2015 02:49:34 +0000 (UTC) (envelope-from bjk@FreeBSD.org) Received: from repo.freebsd.org (repo.freebsd.org [IPv6:2610:1c1:1:6068::e6a:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 856781DD; Fri, 16 Oct 2015 02:49:34 +0000 (UTC) (envelope-from bjk@FreeBSD.org) Received: from repo.freebsd.org ([127.0.1.37]) by repo.freebsd.org (8.15.2/8.15.2) with ESMTP id t9G2nX1m042954; Fri, 16 Oct 2015 02:49:33 GMT (envelope-from bjk@FreeBSD.org) Received: (from bjk@localhost) by repo.freebsd.org (8.15.2/8.15.2/Submit) id t9G2nXKd042953; Fri, 16 Oct 2015 02:49:33 GMT (envelope-from bjk@FreeBSD.org) Message-Id: <201510160249.t9G2nXKd042953@repo.freebsd.org> X-Authentication-Warning: repo.freebsd.org: bjk set sender to bjk@FreeBSD.org using -f From: Benjamin Kaduk Date: Fri, 16 Oct 2015 02:49:33 +0000 (UTC) To: doc-committers@freebsd.org, svn-doc-all@freebsd.org, svn-doc-head@freebsd.org Subject: svn commit: r47587 - head/en_US.ISO8859-1/htdocs/news/status X-SVN-Group: doc-head MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-BeenThere: svn-doc-head@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: SVN commit messages for the doc tree for head List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 16 Oct 2015 02:49:34 -0000 Author: bjk Date: Fri Oct 16 02:49:33 2015 New Revision: 47587 URL: https://svnweb.freebsd.org/changeset/doc/47587 Log: Add clusteradm report Modified: head/en_US.ISO8859-1/htdocs/news/status/report-2015-07-2015-09.xml Modified: head/en_US.ISO8859-1/htdocs/news/status/report-2015-07-2015-09.xml ============================================================================== --- head/en_US.ISO8859-1/htdocs/news/status/report-2015-07-2015-09.xml Fri Oct 16 02:39:45 2015 (r47586) +++ head/en_US.ISO8859-1/htdocs/news/status/report-2015-07-2015-09.xml Fri Oct 16 02:49:33 2015 (r47587) @@ -1601,4 +1601,83 @@ + + &os; Cluster Administration Team + + + + &os; Cluster Administration Team + + clusteradm@ + + + + +

The &os; Cluster Administration Team consists of the people + responsible for administering the machines that the project + relies on for its distributed work and communications to be + synchronised.

+ +

Our primary cluster has been hosted as a guest in California + for many years. Our ongoing project is relocating the core + functionality to a location in New Jersey with a formal + hosting arrangement. This is an equipment refresh, + consolidation for better use of resources, and for better + continuity of service.

+ +

There is a significant amount of behind-the-scenes work to + make this happen. The original cluster was implemented with + a common, shared, assumed-to-be secure network with + ubiquitous NFS everywhere. This structure does not lend + itself well to being distributed across geographically + diverse locations, particularly when Internet transit is + required. The bulk of the work is rebuilding services to be + portable, stand-alone components that do not depend on + shared-network access and are safe enough to use across the + insecure Internet.

+ +

Highlights this quarter:

+ +

Many internal distribution systems switched from rsync to + a distribution mesh using "syncthing".
We have implemented more code/data signing infrastructure + with out-of-band verification.
New 32-core reference build hosts are online.
Internal admbugs switched from bugzilla 4.4 to 5.0 and + packages were made available for the bugmeister team.
Finally switched from varnish3 to varnish4.
We exorcised hub.FreeBSD.org, the last survivor of the + 2012 security incident.
vuxml and the legacy portaudit build system were converted to + components and integrated.
https://download.FreeBSD.org/ is nearing completion (please + do not use until officially announced).
A Taiwan node was brought into service for pkg, ftp, + svn, and vuxml mirroring.
One of the freebsd-update mirrors was converted from + lighttpd to nginx due to a data corruption bug.
Completed detachment of the svn repository from the old + cluster and moved it to its new location.

+ +

Ongoing:

+ +

The cluster runs a mixture of 11-current and 10-stable + as part of our "eat our own dogfood" project. For this + to be useful we do monthly cluster refreshes to keep up with + current code.
We build internal base system snapshots every few days + and packages every day.
We also provide support for non-clusteradm-operated + services including jenkins, reviews, portsnap, + freebsd-update, bugzilla, package builders, git, and mercurial. + This varies from as little as maintaining SSL front-ends + through operating servers, distributing data or building + packages/binaries to run.

+ + +