From owner-freebsd-hubs@FreeBSD.ORG Thu Sep 13 10:38:38 2012 Return-Path: Delivered-To: freebsd-hubs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8DF8D1065673 for ; Thu, 13 Sep 2012 10:38:38 +0000 (UTC) (envelope-from simon@qxnitro.org) Received: from mail-ie0-f182.google.com (mail-ie0-f182.google.com [209.85.223.182]) by mx1.freebsd.org (Postfix) with ESMTP id 45FAC8FC0C for ; Thu, 13 Sep 2012 10:38:37 +0000 (UTC) Received: by iea17 with SMTP id 17so655159iea.13 for ; Thu, 13 Sep 2012 03:38:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qxnitro.org; s=google; h=mime-version:sender:x-originating-ip:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type; bh=aCSyZ/q5PxcRL9PJfnLlsrnL/1p52V73rj1cyr62nOE=; b=A3Hmc/Mrk4C8L2cXscNMO1PGKW61ulDO4v0Wwh9vfDA+nsWXncmOK6HcQ6XzCGUgtq 7APpLRCQtn9JyIzUF/LPUrldBVHxZ43JNT9Gehw1jkKq9xQRU5QOwNyJ2oBqbfOg2746 zflgIXuDx0U0MwsPxe6ojcsnxx2apu6G8k5Xo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:sender:x-originating-ip:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :x-gm-message-state; bh=aCSyZ/q5PxcRL9PJfnLlsrnL/1p52V73rj1cyr62nOE=; b=O6nNCItDpyr8jcoxxDccKNYPl/6EpG8X39//kOvmPGePP5ky4wAij/6+yYCnlxFL3H T/+1opFhmle3b++cWgDbBXKbYNNSYBf2Y4gkb8jrFski5oiR/BRia3PJBO0PBR0jOADb McnsDFUO0PdVrA4hcOzCfW+krVzKdCst6+kWJgT64jf7pn4+cDMwImAQhYVasCRiha/I how7NfQENZGuGWp6VB5NJKoKeVM3OkOem3HwIwIZY11NzIcxxuQQwIUdeuDZBtoV9EVy iPNN1pTtfFC9s9SDg4bqv/UZeUZ6MA8k8pju4V4jxV3moK4fXyy2apLZDd0Z2Oq/khyM LFyQ== MIME-Version: 1.0 Received: by 10.50.157.201 with SMTP id wo9mr1895556igb.57.1347532717295; Thu, 13 Sep 2012 03:38:37 -0700 (PDT) Sender: simon@qxnitro.org Received: by 10.64.102.104 with HTTP; Thu, 13 Sep 2012 03:38:37 -0700 (PDT) X-Originating-IP: [2620:0:1040:201:ec21:fca4:8fbc:892d] In-Reply-To: <6D5EF049FD84BF0620E50077@ogg.in.absolight.net> References: <021473D8D9E6A7A785543024@ogg.in.absolight.net> <6D5EF049FD84BF0620E50077@ogg.in.absolight.net> Date: Thu, 13 Sep 2012 11:38:37 +0100 X-Google-Sender-Auth: CayNhspe0kmyaug44C_l2tr22Vs Message-ID: From: "Simon L. B. Nielsen" To: Mathieu Arnold Content-Type: text/plain; charset=UTF-8 X-Gm-Message-State: ALoCoQmNKY+rNHT8epbfJ3SpChTTz7is6lWmLcABEYQPhQ4hAkKJzfsKXZJZ0mOX1uuBKyzadDLi Cc: freebsd-hubs@freebsd.org Subject: Re: freebsd-update "mirror" howto X-BeenThere: freebsd-hubs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "FreeBSD Distributions Hubs: mail sup ftp" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Sep 2012 10:38:38 -0000 On Wed, Sep 12, 2012 at 2:23 PM, Mathieu Arnold wrote: > +--On 12 septembre 2012 13:57:34 +0100 "Simon L. B. Nielsen" > wrote: > | On Wed, Sep 12, 2012 at 12:42 PM, Mathieu Arnold wrote: > | > |> It's not really a hubs thing, but anyway, I thought I'd share my few > |> bits... > |> > |> For a long time, I pondered about upgrading my 300+ freebsd servers, and > |> a few months back freebsd-update seemed like the way to go... > | > | Very interesting for information like this to be shared. Even better > | if somebody could be tricked into putting it in the handbook :-). > > Hum, I see where you're going with that ;-) :-) > The thing is, I wanted a bit of feedback to see if I wasn't doing something > stupid before committing myself into doing that. Sure. I don't see any fundamental problem doing it that way, though I recall reading in the past that you shouldn't use varnish as a forward cache - but I never looked into why. One thing which may or may not be a problem is support for HTTP pipelining. At least using squid I found the lack of pipelining support to really slow down freebsd-update (and portsnap). Can be that varnish is enough faster than squid that this becomes less of an issue. > I have not written doc for a long time, I'll try to see if I can coerce > myself into doing that next week while I'm vacationing in Corsica. Great :-). I'm sure the freebsd-doc people would be happy to help with extra markup etc. > |> Now, I did not want all those servers to hit the main freebsd-update > |> servers, so I setup a nice local "mirror" using varnish. > | > | Why did you decide to go with Varnish instead of a program designed as > | a forward cache? > > Because Varnish is *cool*. :-p OK :-). > |> Varnish's configuration is there https://gist.github.com/2637602 and it > |> would be even better if varnish could use SRV records to define it's > |> backends by itself, but for now, there are a couple of shell that I have > |> to run whenever I feel like it to update the list. > | > | Evil workaround thing would be to just parse the SRV records in a > | script and then generate the varnish config wrt. backend based on > | that... not pretty though :-). > > Well, that's almost already what's there, when I feel the need to update, I > edit the file with vim, I remove the old lines, copy the shell line in the > script, remove the # and type "V!bash" ;-) Ah, right. I hadn't yet looked at the varnish config file. -- Simon L. B. Nielsen