From owner-freebsd-questions@FreeBSD.ORG  Mon Nov 11 14:17:41 2013
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
Delivered-To: freebsd-questions@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTP id E9E34606
 for <freebsd-questions@freebsd.org>; Mon, 11 Nov 2013 14:17:41 +0000 (UTC)
 (envelope-from rwmaillists@googlemail.com)
Received: from mail-we0-x22c.google.com (mail-we0-x22c.google.com
 [IPv6:2a00:1450:400c:c03::22c])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id 85CD82A37
 for <freebsd-questions@freebsd.org>; Mon, 11 Nov 2013 14:17:41 +0000 (UTC)
Received: by mail-we0-f172.google.com with SMTP id q58so4650276wes.31
 for <freebsd-questions@freebsd.org>; Mon, 11 Nov 2013 06:17:40 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=googlemail.com; s=20120113;
 h=date:from:to:subject:message-id:in-reply-to:references:mime-version
 :content-type:content-transfer-encoding;
 bh=apGnmsBGKc9YdhzeiVS4IykAQH91nF7FLi3VAbUbd5M=;
 b=fUEhWIyoLBuX8/aQXRcvLP4ZhxNDQqnEpdZfms/G0oigLhNJ5txcMgH6N6Qm4bUGYo
 UFc9KL7XedTejxAx8eTf+0aifzN7Auwp+0X9oVKIZYngzlLSSr5IeSjbEwtT/zz9DNAd
 e1SsRKAyRxzwf659Ct95R2VWsLYuVaHFq4PYv7E+kGeGhiiTjuvi0yomyV6Wv0v9nUCw
 x0IN/zhqYIyNINhdzHiXJTUiz2A306yY2pAyqVc+EDLRH8UZeSfuq40VGPZhmnyOULll
 19LEjVzp+gGzq5ZqvNZ3xZTjIaiQQ3jN2YIVyBHOzByT2fwv9fWBlvyCUR04+WVVihOS
 D6UA==
X-Received: by 10.180.83.228 with SMTP id t4mr12448056wiy.12.1384179459933;
 Mon, 11 Nov 2013 06:17:39 -0800 (PST)
Received: from gumby.homeunix.com (87-194-105-247.bethere.co.uk.
 [87.194.105.247])
 by mx.google.com with ESMTPSA id ma3sm34633030wic.1.2013.11.11.06.17.38
 for <freebsd-questions@freebsd.org>
 (version=SSLv3 cipher=RC4-SHA bits=128/128);
 Mon, 11 Nov 2013 06:17:39 -0800 (PST)
Date: Mon, 11 Nov 2013 14:17:37 +0000
From: RW <rwmaillists@googlemail.com>
To: freebsd-questions@freebsd.org
Subject: Re: freebsd-update: fetch or phttpget?
Message-ID: <20131111141737.05813fed@gumby.homeunix.com>
In-Reply-To: <CAKoxK+578cNgbhpwB5_oX3SSxdH6dh0gSwYbPf+n3TAA8Xx0xw@mail.gmail.com>
References: <CAKoxK+578cNgbhpwB5_oX3SSxdH6dh0gSwYbPf+n3TAA8Xx0xw@mail.gmail.com>
X-Mailer: Claws Mail 3.9.2 (GTK+ 2.24.19; amd64-portbld-freebsd10.0)
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 11 Nov 2013 14:17:42 -0000

On Mon, 11 Nov 2013 14:18:08 +0100
Luca Ferrari wrote:

> Hi all,
> I noted that freebsd-update uses phttpget as main downloader except in
> a point, where fetch(1) is used:
> 
> fetch ${QUIETFLAG} http://${SERVERNAME}/${FETCHDIR}/latest.ssl
> 
> Now, this causes problems with the authentication when behind  a
> proxy, since phttpget and fetch seem to use a different approach to
> username/password authentication. In particular fetch handles an
> http_proxy variable that includes username/password, while phttpget
> does not.
> What is the rationale behind the usage of two downloader within the
> same script?


phttpget is very basic, but does support http pipelining, so it's much
faster downloading a lot of small files - in the script  phttpget is
always used with xargs. fetch is used for individual files, it has more
features and better error reporting.