Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 13 Sep 2012 11:38:37 +0100
From:      "Simon L. B. Nielsen" <simon@FreeBSD.org>
To:        Mathieu Arnold <mat@freebsd.org>
Cc:        freebsd-hubs@freebsd.org
Subject:   Re: freebsd-update "mirror" howto
Message-ID:  <CAC8HS2G-judrdj5Hevih=dDznYH92J8UWCAk=PQWqPCXCxXDCg@mail.gmail.com>
In-Reply-To: <6D5EF049FD84BF0620E50077@ogg.in.absolight.net>
References:  <021473D8D9E6A7A785543024@ogg.in.absolight.net> <CAC8HS2FRaJRkFfH-F2Ro4SXOt_=wrzFFDYadZEhmU4D_Ez0xMg@mail.gmail.com> <6D5EF049FD84BF0620E50077@ogg.in.absolight.net>

next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Sep 12, 2012 at 2:23 PM, Mathieu Arnold <mat@freebsd.org> wrote:
> +--On 12 septembre 2012 13:57:34 +0100 "Simon L. B. Nielsen"
> <simon@FreeBSD.org> wrote:
> | On Wed, Sep 12, 2012 at 12:42 PM, Mathieu Arnold <mat@freebsd.org> wrote:
> |
> |> It's not really a hubs thing, but anyway, I thought I'd share my few
> |> bits...
> |>
> |> For a long time, I pondered about upgrading my 300+ freebsd servers, and
> |> a few months back freebsd-update seemed like the way to go...
> |
> | Very interesting for information like this to be shared. Even better
> | if somebody could be tricked into putting it in the handbook :-).
>
> Hum, I see where you're going with that ;-)

:-)

> The thing is, I wanted a bit of feedback to see if I wasn't doing something
> stupid before committing myself into doing that.

Sure. I don't see any fundamental problem doing it that way, though I
recall reading in the past that you shouldn't use varnish as a forward
cache - but I never looked into why.

One thing which may or may not be a problem is support for HTTP
pipelining. At least using squid I found the lack of pipelining
support to really slow down freebsd-update (and portsnap). Can be that
varnish is enough faster than squid that this becomes less of an
issue.

> I have not written doc for a long time, I'll try to see if I can coerce
> myself into doing that next week while I'm vacationing in Corsica.

Great :-). I'm sure the freebsd-doc people would be happy to help with
extra markup etc.

> |> Now, I did not want all those servers to hit the main freebsd-update
> |> servers, so I setup a nice local "mirror" using varnish.
> |
> | Why did you decide to go with Varnish instead of a program designed as
> | a forward cache?
>
> Because Varnish is *cool*. :-p

OK :-).

> |> Varnish's configuration is there https://gist.github.com/2637602 and it
> |> would be even better if varnish could use SRV records to define it's
> |> backends by itself, but for now, there are a couple of shell that I have
> |> to run whenever I feel like it to update the list.
> |
> | Evil workaround thing would be to just parse the SRV records in a
> | script and then generate the varnish config wrt. backend based on
> | that... not pretty though :-).
>
> Well, that's almost already what's there, when I feel the need to update, I
> edit the file with vim, I remove the old lines, copy the shell line in the
> script, remove the # and type "V!bash" ;-)

Ah, right. I hadn't yet looked at the varnish config file.

-- 
Simon L. B. Nielsen



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAC8HS2G-judrdj5Hevih=dDznYH92J8UWCAk=PQWqPCXCxXDCg>