From owner-freebsd-pkg@freebsd.org Sat Jul 13 15:03:46 2019 Return-Path: Delivered-To: freebsd-pkg@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7214A15EAD78 for ; Sat, 13 Jul 2019 15:03:46 +0000 (UTC) (envelope-from jbliao@cs.nctu.edu.tw) Received: from tcsmailer.cs.nctu.edu.tw (tcsmailer.cs.nctu.edu.tw [140.113.235.123]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D767189555 for ; Sat, 13 Jul 2019 15:03:43 +0000 (UTC) (envelope-from jbliao@cs.nctu.edu.tw) Received: from tcsmailer.cs.nctu.edu.tw (localhost [127.0.0.1]) by tcsmailer.cs.nctu.edu.tw (Postfix) with ESMTP id 1653B9383 for ; Sat, 13 Jul 2019 23:03:29 +0800 (CST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cs.nctu.edu.tw; s=cs.nctu.edu.tw; t=1563030209; bh=ayqdBhMhvmsUBKM3/o79e/eV1Zx92MdGORjlUJBYyIQ=; h=From:Date:Subject:To; b=Qi3RDAsmuFR7rVaL65Qe1+1uWBhwuUgbpR39yTrpBXsS+RKC7vbtpmOyNAHJ5kU79 bzqZ7LcTaou5MNsFo8SToGQy84T75CnlTibjQN7UwUzBNokCVmvyH3zcb/7YoSXGi7 sAfB5ubY8gihdD5WmQdnFGOt/G3/Boezw6jz6mR9Xe5gTvofwDWtCt6YRCKQNa3IU+ GTm34hw/4PcPq76SfBk4zo9zbChq2yjiVTPLiZojyhJCP5LuTs2F9Wj2TyW7g7tpxV NW6oSPKFj1bRE28D8sUE8EBhrZzfe5Dum3ZQyjxbDhDhj7wZXUc3rq73Jyt9Xo0SY7 DQDekxTAa2DkPtWcUhEsJ9eNoMJWJ+0QfWiu5zwo4DB+u8Yc5DdfPqBfRY3zehPbix OPs1tNx368j8e0GVsWsEVVDZGmnGvE5DCLrQAcCmZ6mIWq1C/m7UBvKj00aJVJexEq Y8ng3cAY6Nj43mnnmSm95tRJGjWXRZRIEJuQNdt4XQfjsthXweTQfpzyYiSqLtmf8v EBzTGebwme3OsCrcVJxJG+ca47zZL16rpV1BCv/jm9I9D9VZpK+30B9uzOTdgfMa4t ZogYhFRGXeE0UlbHEUdhAYirzSGFkEHLGqVaGr6wekd47ha4je/0+uQ180WtsfPhhr 4qjQazPD2g92gOV8f6U199QY= Received: from tcsmailer.cs.nctu.edu.tw ([127.0.0.1]) by tcsmailer.cs.nctu.edu.tw (tcsmailer.cs.nctu.edu.tw [127.0.0.1]) (amavisd-new, port 10027) with ESMTP id mF-4QjKnXJhg for ; Sat, 13 Jul 2019 23:03:28 +0800 (CST) Received: from csmailer.cs.nctu.edu.tw (csmailer.cs.nctu.edu.tw [140.113.235.130]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by tcsmailer.cs.nctu.edu.tw (Postfix) with ESMTPS id E98AC9381 for ; Sat, 13 Jul 2019 23:03:28 +0800 (CST) Received: from csmailer.cs.nctu.edu.tw (localhost [127.0.0.1]) by csmailer.cs.nctu.edu.tw (Postfix) with ESMTP id CE0CE1B75F for ; Sat, 13 Jul 2019 23:03:28 +0800 (CST) X-Virus-Scanned: amavisd-new at cs.nctu.edu.tw Received: from csmailer.cs.nctu.edu.tw ([127.0.0.1]) by csmailer.cs.nctu.edu.tw (csmailer.cs.nctu.edu.tw [127.0.0.1]) (amavisd-new, port 10027) with ESMTP id qgQcGf4TW6Uj for ; Sat, 13 Jul 2019 23:03:28 +0800 (CST) Received: from csmail2.cs.nctu.edu.tw (csmail2.cc.cs.nctu.edu.tw [10.1.0.122]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by csmailer.cs.nctu.edu.tw (Postfix) with ESMTPS id 84FB61B757 for ; Sat, 13 Jul 2019 23:03:28 +0800 (CST) Received: from mail-wm1-f49.google.com (mail-wm1-f49.google.com [209.85.128.49]) (Authenticated sender: jbliao) by csmail2.cs.nctu.edu.tw (Postfix) with ESMTPA id 24A1E1744A8 for ; Sat, 13 Jul 2019 23:03:28 +0800 (CST) Received: by mail-wm1-f49.google.com with SMTP id x15so11320581wmj.3 for ; Sat, 13 Jul 2019 08:03:28 -0700 (PDT) X-Gm-Message-State: APjAAAW9KhUzVE7+qNoyA+dpWCBIVUIAcQbEjSQ2b9qUX8ilkQj2uuJd 9hQe2mJqPA1XpkqNQePebaMjYizMy/vS8WXJz8vonQ== X-Google-Smtp-Source: APXvYqxYrNISC7PHFwgYkHFXwZavz0oRfskZ4f5WTHuwlTpqi+aui2JYpI+Q7zua88u7JXIdEdYF+JQMIr306Hmuk0c= X-Received: by 2002:a1c:1d08:: with SMTP id d8mr14632724wmd.22.1563030206407; Sat, 13 Jul 2019 08:03:26 -0700 (PDT) MIME-Version: 1.0 From: =?UTF-8?B?5bu65Y2a5buW?= Date: Sat, 13 Jul 2019 23:03:16 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Is there a method to host a pkg-mirror for my internal usage? To: freebsd-pkg@freebsd.org X-Rspamd-Queue-Id: D767189555 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cs.nctu.edu.tw header.s=cs.nctu.edu.tw header.b=Qi3RDAsm; spf=pass (mx1.freebsd.org: domain of jbliao@cs.nctu.edu.tw designates 140.113.235.123 as permitted sender) smtp.mailfrom=jbliao@cs.nctu.edu.tw X-Spamd-Result: default: False [-4.28 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[cs.nctu.edu.tw:s=cs.nctu.edu.tw]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:tcsmailer.cs.nctu.edu.tw]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkg@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.01)[csmx3.cs.nctu.edu.tw,csmx1.cs.nctu.edu.tw]; DKIM_TRACE(0.00)[cs.nctu.edu.tw:+]; DMARC_NA(0.00)[nctu.edu.tw]; NEURAL_HAM_SHORT(-0.99)[-0.988,0]; IP_SCORE(-1.78)[ipnet: 140.113.0.0/16(-4.89), asn: 9916(-3.92), country: TW(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:9916, ipnet:140.113.0.0/16, country:TW]; RCVD_COUNT_SEVEN(0.00)[9] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Jul 2019 15:03:46 -0000 Hi, I was finding a method to host a pkg mirror, so that it can provide a repo to my FreeBSD servers through LAN. I found a page that told me to use pkg-fetch to do such things https://www.freebsd.org/doc/zh_TW.UTF-8/articles/hubs/mirror-howto.html I have used 'pkg fetch -o /path/to/repo -r FreeBSD -y -a' to create my repo, and that just succeed. But when I want to update the repo, use the same command, daily. I got the messages that says the package's checksum was mismatch. The previously fetched package had been deleted and the process was exited. I tried to update the repo again and succeed, but failed at another checksum mismatch. That means I need to update 30k packages one by one which is such a stupid thing, or recreate the repo at another empty directory and fetch almost 90GB packages everyday which waste time and network bandwidth. There are someone having the same problem: https://forums.freebsd.org/threads/problems-with-pkg-fetch-a-to-create-local-mirror.70959/ I wonder to know if there is a better way to host a pkg-mirror, or I could only use http proxy to do that. Sorry for my poor English :P Regards, Jian-Bo Liao Teaching Assistant Computer Center, Department of Computer Science, National Chiao Tung University, Taiwan. 1001 University Road, Hsinchu, Taiwan 300, ROC.