From owner-freebsd-pkg@freebsd.org Sun Apr 5 21:02:01 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 32C7326BA0B for ; Sun, 5 Apr 2020 21:02:01 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48wR1g2ylPz3wtm for ; Sun, 5 Apr 2020 21:01:59 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.nyi.freebsd.org (Postfix) id AEC2726B9B1; Sun, 5 Apr 2020 21:01:54 +0000 (UTC) Delivered-To: pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ACC0226B9B0 for ; Sun, 5 Apr 2020 21:01:54 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48wR1S6c1dz3wjK for ; Sun, 5 Apr 2020 21:01:48 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 9D1D11BFFA for ; Sun, 5 Apr 2020 21:00:46 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 035L0kEg059606 for ; Sun, 5 Apr 2020 21:00:46 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 035L0kU4059605 for pkg@FreeBSD.org; Sun, 5 Apr 2020 21:00:46 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202004052100.035L0kU4059605@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: pkg@FreeBSD.org Subject: Problem reports for pkg@FreeBSD.org that need special attention Date: Sun, 5 Apr 2020 21:00:46 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Apr 2020 21:02:01 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- Open | 220049 | ports-mgmt/pkg installs unneeded packages Open | 237369 | ports-mgmt/pkg: pkg delete removes required NLS d New | 245204 | ports-mgmt/pkg: pkg(8) install new package versio 3 problems total for which you should take action. From owner-freebsd-pkg@freebsd.org Mon Apr 6 16:42:45 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 676142B51DC for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48wxD528Rrz4HgQ for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 47FC42B51D8; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) Delivered-To: pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 47BF62B51D7 for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48wxD51B5pz4HgN for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 21C6A2B0FF for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 036GgjUb043876 for ; Mon, 6 Apr 2020 16:42:45 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 036Ggjdl043875 for pkg@FreeBSD.org; Mon, 6 Apr 2020 16:42:45 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: pkg@FreeBSD.org Subject: [Bug 245401] ports-mgmt/pkg breaks NanoBSD builds Date: Mon, 06 Apr 2020 16:42:44 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: wout@canodus.be X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: pkg@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter flagtypes.name Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Apr 2020 16:42:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245401 Bug ID: 245401 Summary: ports-mgmt/pkg breaks NanoBSD builds Product: Ports & Packages Version: Latest Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: Individual Port(s) Assignee: pkg@FreeBSD.org Reporter: wout@canodus.be Assignee: pkg@FreeBSD.org Flags: maintainer-feedback?(pkg@FreeBSD.org) After upgrading from pkg-1.13.2 to pkg-1.14.2 it seems NanoBSD builds are broken. 1) Creating the pkg package (`pkg create pkg` or `pkg create -a`) to place = in Pkg directory works but returns with the following warning: pkg: lstat(/usr/local/lib/compat/pkg): No such file or directory 2) Ignoring the above, and trying the create a NanoBSD image fails with the= the following error in _.cust.cust_pkgng: ... + env 'BATCH=3DYES' 'ASSUME_ALWAYS_YES=3DYES' 'PKG_DBDIR=3D/var/db/pkg' 'SIGNATURE_TYPE=3Dnone' /usr/sbin/pkg add /_.p/pkg-1.14.2.txz Installing pkg-1.14.2... Extracting pkg-1.14.2: .......... done pkg-static: Fail to set time on /usr/local/lib/compat/pkg:No such file or directory Failed to install the following 1 package(s): /_.p/pkg-1.14.2.txz --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-pkg@freebsd.org Mon Apr 6 16:42:45 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 38E332B51D5 for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 48wxD50XLTz4HgM for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 123AA2B51D3; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) Delivered-To: pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1201D2B51D2 for ; Mon, 6 Apr 2020 16:42:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48wxD45jC1z4HgK for ; Mon, 6 Apr 2020 16:42:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id BF47E2B0FD for ; Mon, 6 Apr 2020 16:42:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 036GgiPK043866 for ; Mon, 6 Apr 2020 16:42:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 036GgiHj043865 for pkg@FreeBSD.org; Mon, 6 Apr 2020 16:42:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" From: bugzilla-noreply@freebsd.org To: pkg@FreeBSD.org Subject: maintainer-feedback requested: [Bug 245401] ports-mgmt/pkg breaks NanoBSD builds Date: Mon, 06 Apr 2020 16:42:44 +0000 X-Bugzilla-Type: request X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: pkg@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? Message-ID: In-Reply-To: References: X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Apr 2020 16:42:45 -0000 Bugzilla Automation has asked freebsd-pkg mailing li= st for maintainer-feedback: Bug 245401: ports-mgmt/pkg breaks NanoBSD builds https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245401 --- Description --- After upgrading from pkg-1.13.2 to pkg-1.14.2 it seems NanoBSD builds are broken. 1) Creating the pkg package (`pkg create pkg` or `pkg create -a`) to place = in Pkg directory works but returns with the following warning: pkg: lstat(/usr/local/lib/compat/pkg): No such file or directory 2) Ignoring the above, and trying the create a NanoBSD image fails with the= the following error in _.cust.cust_pkgng: ... + env 'BATCH=3DYES' 'ASSUME_ALWAYS_YES=3DYES' 'PKG_DBDIR=3D/var/db/pkg' 'SIGNATURE_TYPE=3Dnone' /usr/sbin/pkg add /_.p/pkg-1.14.2.txz Installing pkg-1.14.2... Extracting pkg-1.14.2: .......... done pkg-static: Fail to set time on /usr/local/lib/compat/pkg:No such file or directory Failed to install the following 1 package(s): /_.p/pkg-1.14.2.txz From owner-freebsd-pkg@freebsd.org Mon Apr 6 20:08:04 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 029F4279E0A for ; Mon, 6 Apr 2020 20:08:04 +0000 (UTC) (envelope-from dj@0xc0fee.dev) Received: from weatherwax.trouble.is (weatherwax.trouble.is [IPv6:2a00:1098:82:3a::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "weatherwax.trouble.is", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48x1mz2qsTz4XV4 for ; Mon, 6 Apr 2020 20:08:02 +0000 (UTC) (envelope-from dj@0xc0fee.dev) Received: from localhost (mail.0xc0fee.dev [5.9.7.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.0xc0fee.dev", Issuer "mail.0xc0fee.dev" (not verified)) by weatherwax.trouble.is (Postfix) with ESMTPS id 48x1mw71cLz1RNV for ; Mon, 6 Apr 2020 20:08:00 +0000 (UTC) Received: from localhost ( [10.3.10.10]) by localhost (OpenSMTPD) with ESMTP id 2b5e8975 for ; Mon, 6 Apr 2020 20:06:17 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=0xc0fee.dev; h=date:from :to:subject:message-id:mime-version:content-type :content-transfer-encoding; s=selector1; bh=Roj4KmdsrVx2/qy6xCU1 aVtbmnc=; b=WeUe8EX5SNgUTTbtEnERmdOHOo2CPq2oxV3jeT+i1NhZkovRcQYK k1ts4i81zT1d3KQgWwXDeO4KeJ+Cz+p8z1nntYMDCCGTqRQN8BmT/xkO3mKxNJoL RGBQyuT9ak20S4feA4vE+heSIsHHu82j83v1pk8QQ+H3bVD7ZQRl5BI= DomainKey-Signature: a=rsa-sha1; c=nofws; d=0xc0fee.dev; h=date:from:to :subject:message-id:mime-version:content-type :content-transfer-encoding; q=dns; s=selector1; b=sympWPYDaBMhli qS/lb9OlgZ6eAAknbI8qpGZF8t8vxkI4jd6KcF4HMq4cosXjv13LYsalyo9GlHiI mJJZAQNUUxbXoMc7dEha+S6+vuqks8NLxtQ8RXLtlIY4CRMkrfnJgrGfUCKmQzEI dlrvuomIYuE0y81EddcV7sKWNm6X0= Received: from localhost (ip5f5bd7ec.dynamic.kabel-deutschland.de [95.91.215.236]) by localhost (OpenSMTPD) with ESMTPSA id 14c02f32 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Mon, 6 Apr 2020 20:06:17 +0000 (UTC) Date: Mon, 6 Apr 2020 22:07:50 +0200 From: Dhananjay Balan To: freebsd-pkg@freebsd.org Subject: EU - pkg mirror is slow Message-ID: <20200406200750.2plzuyhsitstcxtn@tempp0> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit User-Agent: NeoMutt/20180716 X-Rspamd-Queue-Id: 48x1mz2qsTz4XV4 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=0xc0fee.dev header.s=selector1 header.b=WeUe8EX5; dmarc=none; spf=pass (mx1.freebsd.org: domain of dj@0xc0fee.dev designates 2a00:1098:82:3a::1 as permitted sender) smtp.mailfrom=dj@0xc0fee.dev X-Spamd-Result: default: False [-3.37 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[0xc0fee.dev:s=selector1]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1098:82:3a::1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkg@freebsd.org]; TO_DN_NONE(0.00)[]; RCVD_DKIM_ARC_DNSWL_MED(-0.50)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[0xc0fee.dev]; RCVD_IN_DNSWL_MED(-0.20)[1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.0.a.3.0.0.2.8.0.0.8.9.0.1.0.0.a.2.list.dnswl.org : 127.0.6.2]; DKIM_TRACE(0.00)[0xc0fee.dev:+]; IP_SCORE(-0.97)[ipnet: 2a00:1098::/32(-2.52), asn: 44684(-2.26), country: GB(-0.07)]; FORGED_SENDER(0.30)[dbalan@0xc0fee.dev,dj@0xc0fee.dev]; MID_RHS_NOT_FQDN(0.50)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:44684, ipnet:2a00:1098::/32, country:GB]; FROM_NEQ_ENVFROM(0.00)[dbalan@0xc0fee.dev,dj@0xc0fee.dev]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Apr 2020 20:08:04 -0000 (Please point me to the correct list if this is not the right one.) Recently I've started observing http://pkg0.bme.freebsd.org/ to be really slow, max bandwidth I can get is 250kb/s on a good day. I've tried it from two networks that I've access to -- hetzner DC (FSN1) and Vodafone (Berlin). Is that mirror overloaded or do I have some weird peering? — dbalan @notmycommit From owner-freebsd-pkg@freebsd.org Tue Apr 7 07:41:01 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C774A2ACD0D for ; Tue, 7 Apr 2020 07:41:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48xK8Y4yqVz4Dq5 for ; Tue, 7 Apr 2020 07:41:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id AA5CE2ACD09; Tue, 7 Apr 2020 07:41:01 +0000 (UTC) Delivered-To: pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AA1A42ACD08 for ; Tue, 7 Apr 2020 07:41:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48xK8Y45Lsz4Dq4 for ; Tue, 7 Apr 2020 07:41:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 874D861CF for ; Tue, 7 Apr 2020 07:41:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 0377f1Un034872 for ; Tue, 7 Apr 2020 07:41:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 0377f1ww034871 for pkg@FreeBSD.org; Tue, 7 Apr 2020 07:41:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: pkg@FreeBSD.org Subject: [Bug 241007] ports-mgmt/pkg: cannot open sqlite3 db: Not a directory (FreeBSD 13.0-CURRENT) Date: Tue, 07 Apr 2020 07:41:01 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: marten@zstream.se X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: pkg@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Apr 2020 07:41:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D241007 M=C3=A5rten Lindblad changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |marten@zstream.se --- Comment #6 from M=C3=A5rten Lindblad --- Had the same issue today on 12.1 version 1.13.2. I was standing in /usr/ports/www/node10 and did portsnap extract and then a= pkg install failed with: pkg: Repository FreeBSD load error: cannot open sqlite3 db: Not a directory --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From owner-freebsd-pkg@freebsd.org Wed Apr 8 22:02:40 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED3A027E62F for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48yJDJ66BXz3Djb for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id D1A8427E62A; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) Delivered-To: pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D174527E629 for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48yJDJ5CfDz3DjY for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id AE2EE22B8 for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 038M2eBw099589 for ; Wed, 8 Apr 2020 22:02:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 038M2elb099588 for pkg@FreeBSD.org; Wed, 8 Apr 2020 22:02:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: pkg@FreeBSD.org Subject: [Bug 245462] ports-mgmt/pkg: 1.14.2 pipe remains open while running scripts Date: Wed, 08 Apr 2020 22:02:40 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: pkg@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter flagtypes.name Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Apr 2020 22:02:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245462 Bug ID: 245462 Summary: ports-mgmt/pkg: 1.14.2 pipe remains open while running scripts Product: Ports & Packages Version: Latest Hardware: Any OS: Any Status: New Severity: Affects Some People Priority: --- Component: Individual Port(s) Assignee: pkg@FreeBSD.org Reporter: sobomax@FreeBSD.org Assignee: pkg@FreeBSD.org Flags: maintainer-feedback?(pkg@FreeBSD.org) We are observing latest version of pkg hanging if some process spawn by the script remains running after script itself exits. Inspecting the process with GDB the pkg-static process stucks doing poll() = on FD#7: (gdb) bt #0 0x000000000084ba1a in _poll () #1 0x00000000007fad26 in __thr_poll () #2 0x00000000005e7303 in pkg_script_run (pkg=3D0x801079000, type=3DPKG_SCRIPT_POST_INSTALL, upgrade=3Dfalse) at scripts.c:248 #3 0x0000000000469574 in pkg_add_port (db=3D0x801078700, pkg=3D0x801079000, input_path=3D0x7fffffffe7b7 "/tmp/media/ssp_port/work/stage", reloc=3D0x0, testing=3Dfalse) at pkg_ports.c:1338 #4 0x0000000000416535 in exec_register (argc=3D7, argv=3D0x7fffffffe3e8) at register.c:195 #5 0x0000000000411202 in main (argc=3D7, argv=3D0x7fffffffe3e8) at main.c:= 886 Then checking the file descriptor table using lsof shows the following, the stray denyhosts process is a culprit, however it's unclear why it should ha= ve a pipe connected all the way to the pkg-static: [sobomax@builder ~]$ ps -xalww | grep -w 33903 0 33903 33901 0 52 0 27020 22276 select I - 0:02.54 /usr/local/sbin/pkg-static register -i /tmp/media/ssp_port/work/stage -m /tmp/media/ssp_port/work/.metadir -f /tmp/media/ssp_port/work/.PLIST.mktmp 0 33923 33903 0 73 0 0 0 - Z - 0:02.16 0 34324 33903 0 75 0 0 0 - Z - 0:00.00 0 34325 33903 0 20 0 21096 17760 select S - 0:00.01 /usr/local/bin/python2.7 /usr/local/bin/denyhosts.py --config /usr/local/etc/denyhosts.conf --noemail --daemon 70 34361 33903 0 73 0 0 0 - Z - 0:05.03 [sobomax@builder ~]$ sudo lsof | grep -w 0xfffff8017cc32000 pkg-stati 33903 root 7u unix 0xfffff8017cc32000 0t0= =20=20=20=20 ->0xfffff80480a06000 python2.7 34325 root 4u unix 0xfffff80480a06000 0t0= =20=20=20=20 ->0xfffff8017cc32000 I believe this is direct result of the single change here: https://github.com/freebsd/pkg/commit/767fbd77ee64e22a31a4d5903c1e36dcd8533= a70 Some comments were left in that commit as to how to fix possibly. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-pkg@freebsd.org Wed Apr 8 22:02:40 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AF39327E627 for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48yJDJ4HGKz3DjX for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 92F5C27E626; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) Delivered-To: pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 92BD327E625 for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48yJDJ3LzHz3DjW for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 6E81E22B7 for ; Wed, 8 Apr 2020 22:02:40 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 038M2eiS099585 for ; Wed, 8 Apr 2020 22:02:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 038M2e3X099584 for pkg@FreeBSD.org; Wed, 8 Apr 2020 22:02:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" From: bugzilla-noreply@freebsd.org To: pkg@FreeBSD.org Subject: maintainer-feedback requested: [Bug 245462] ports-mgmt/pkg: 1.14.2 pipe remains open while running scripts Date: Wed, 08 Apr 2020 22:02:40 +0000 X-Bugzilla-Type: request X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: pkg@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? Message-ID: In-Reply-To: References: X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Apr 2020 22:02:40 -0000 Bugzilla Automation has asked freebsd-pkg mailing li= st for maintainer-feedback: Bug 245462: ports-mgmt/pkg: 1.14.2 pipe remains open while running scripts https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245462 --- Description --- We are observing latest version of pkg hanging if some process spawn by the script remains running after script itself exits. Inspecting the process with GDB the pkg-static process stucks doing poll() = on FD#7: (gdb) bt #0 0x000000000084ba1a in _poll () #1 0x00000000007fad26 in __thr_poll () #2 0x00000000005e7303 in pkg_script_run (pkg=3D0x801079000, type=3DPKG_SCRIPT_POST_INSTALL, upgrade=3Dfalse) at scripts.c:248 #3 0x0000000000469574 in pkg_add_port (db=3D0x801078700, pkg=3D0x801079000, input_path=3D0x7fffffffe7b7 "/tmp/media/ssp_port/work/stage", reloc=3D0x0, testing=3Dfalse) at pkg_ports.c:1338 #4 0x0000000000416535 in exec_register (argc=3D7, argv=3D0x7fffffffe3e8) at register.c:195 #5 0x0000000000411202 in main (argc=3D7, argv=3D0x7fffffffe3e8) at main.c:= 886 Then checking the file descriptor table using lsof shows the following, the stray denyhosts process is a culprit, however it's unclear why it should ha= ve a pipe connected all the way to the pkg-static: [sobomax@builder ~]$ ps -xalww | grep -w 33903 0 33903 33901 0 52 0 27020 22276 select I - 0:02.54 /usr/local/sbin/pkg-static register -i /tmp/media/ssp_port/work/stage -m /tmp/media/ssp_port/work/.metadir -f /tmp/media/ssp_port/work/.PLIST.mktmp 0 33923 33903 0 73 0 0 0 - Z - 0:02.16 0 34324 33903 0 75 0 0 0 - Z - 0:00.00 0 34325 33903 0 20 0 21096 17760 select S - 0:00.01 /usr/local/bin/python2.7 /usr/local/bin/denyhosts.py --config /usr/local/etc/denyhosts.conf --noemail --daemon 70 34361 33903 0 73 0 0 0 - Z - 0:05.03 [sobomax@builder ~]$ sudo lsof | grep -w 0xfffff8017cc32000 pkg-stati 33903 root 7u unix 0xfffff8017cc32000 0t0=20=20=20=20 ->0xfffff80480a06000 python2.7 34325 root 4u unix 0xfffff80480a06000 0t0=20=20=20=20 ->0xfffff8017cc32000 I believe this is direct result of the single change here: https://github.com/freebsd/pkg/commit/767fbd77ee64e22a31a4d5903c1e36dcd8533= a70 Some comments were left in that commit as to how to fix possibly. From owner-freebsd-pkg@freebsd.org Wed Apr 8 22:03:41 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 42EA827E72E for ; Wed, 8 Apr 2020 22:03:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 48yJFT13W0z3Drw for ; Wed, 8 Apr 2020 22:03:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 2429F27E72D; Wed, 8 Apr 2020 22:03:41 +0000 (UTC) Delivered-To: pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 23F1F27E72C for ; Wed, 8 Apr 2020 22:03:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48yJFT093vz3Drv for ; Wed, 8 Apr 2020 22:03:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 00D5622BB for ; Wed, 8 Apr 2020 22:03:41 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 038M3e5i000868 for ; Wed, 8 Apr 2020 22:03:40 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 038M3eCD000867 for pkg@FreeBSD.org; Wed, 8 Apr 2020 22:03:40 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: pkg@FreeBSD.org Subject: [Bug 245462] ports-mgmt/pkg: 1.14.2 pipe remains open while running scripts Date: Wed, 08 Apr 2020 22:03:41 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: sobomax@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bapt@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Apr 2020 22:03:41 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D245462 Maxim Sobolev changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |sobomax@FreeBSD.org Assignee|pkg@FreeBSD.org |bapt@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-pkg@freebsd.org Thu Apr 9 14:53:05 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1D5332BC5EF for ; Thu, 9 Apr 2020 14:53:05 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from mail.rlwinm.de (mail.rlwinm.de [IPv6:2a01:4f8:171:f902::5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48ykf802PSz3CWm for ; Thu, 9 Apr 2020 14:53:03 +0000 (UTC) (envelope-from crest@rlwinm.de) Received: from crest-mbp.local (200116b864217300cd4cc80d4742dca7.dip.versatel-1u1.de [IPv6:2001:16b8:6421:7300:cd4c:c80d:4742:dca7]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.rlwinm.de (Postfix) with ESMTPSA id D35F01E2A for ; Thu, 9 Apr 2020 14:52:55 +0000 (UTC) Subject: Re: EU - pkg mirror is slow To: freebsd-pkg@freebsd.org References: <20200406200750.2plzuyhsitstcxtn@tempp0> From: Jan Bramkamp Message-ID: <5be71991-74f3-b5d2-d9d2-5cad4aff4caf@rlwinm.de> Date: Thu, 9 Apr 2020 16:52:54 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:68.0) Gecko/20100101 Thunderbird/68.6.0 MIME-Version: 1.0 In-Reply-To: <20200406200750.2plzuyhsitstcxtn@tempp0> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-GB X-Rspamd-Queue-Id: 48ykf802PSz3CWm X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of crest@rlwinm.de designates 2a01:4f8:171:f902::5 as permitted sender) smtp.mailfrom=crest@rlwinm.de X-Spamd-Result: default: False [-5.02 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[7.a.c.d.2.4.7.4.d.0.8.c.c.4.d.c.0.0.3.7.1.2.4.6.8.b.6.1.1.0.0.2.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkg@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; DMARC_NA(0.00)[rlwinm.de]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; IP_SCORE(-2.72)[ip: (-9.37), ipnet: 2a01:4f8::/29(-2.61), asn: 24940(-1.59), country: DE(-0.02)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/29, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Apr 2020 14:53:05 -0000 On 06.04.20 22:07, Dhananjay Balan wrote: > (Please point me to the correct list if this is not the right one.) > > Recently I've started observing http://pkg0.bme.freebsd.org/ to be > really slow, max bandwidth I can get is 250kb/s on a good day. I've > tried it from two networks that I've access to -- hetzner DC (FSN1) > and Vodafone (Berlin). > > Is that mirror overloaded or do I have some weird peering? Good question it is even slow just enough of a response from it to validate a cache. With the Cache-Control header set to max-age=0 this slows down things a lot. Is there an efficient way to keep a full mirror synced? Just fetching all packages again and again to get a full mirror puts a lot of otherwise avoidable load on the poor package servers. Is there any help needed to adress the problem? From owner-freebsd-pkg@freebsd.org Thu Apr 9 18:00:45 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1BFA5278FF4 for ; Thu, 9 Apr 2020 18:00:45 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 48yppg1y8Sz3xxk for ; Thu, 9 Apr 2020 18:00:42 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 70C0B5C27BB for ; Thu, 9 Apr 2020 14:00:42 -0400 (EDT) Received: from imap6 ([10.202.2.56]) by compute4.internal (MEProxy); Thu, 09 Apr 2020 14:00:42 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=skunkwerks.at; h=mime-version:message-id:in-reply-to:references:date:from:to :subject:content-type:content-transfer-encoding; s=fm2; bh=rHcyO qO2Qpz01slN5BX6MJObOQhnOx32x5hRZ5M6e9c=; b=lefysevGnfqTt2++cdQDe Ua90oVoQWjCA2HhnUdPb551kSRjXGyyCIFnIQIlK1LM1LFndVeUC5WFSCRU9mq/l s9c2FLiUv4OaAFXjHvqzy62PfYs1b7SSFo3k7cEtGtMEvn/YrqgqVakVCu/uBMjY F4tkz5elPF7UaIKYnRjl4LayeCZ7joftdOBGPpNDVFrkXrU/vwtef4mAF7ITlRKc cM0KceHh/3vyGnAsxu+y4nsIw2Vqz36BGAOHCBF74nZF9TQWyXp2gT7krWD5NFKZ vFb8Va2xahhHdS3n9pTwUpaQ9OlD15zpgEsFGgehVMF0hzQ/QxPcH57HHIVvKJx8 A== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; bh=rHcyOqO2Qpz01slN5BX6MJObOQhnOx32x5hRZ5M6e 9c=; b=kprpwl8JZRepq4cIzd4+zUpJ8paTsLzzK5OsdN92RVLU/bLsvzZ5hIZR3 L4s1h5rnDJrUz/i4fKTGEYJMrbibQ8MSl4YJ8a0NvNChVSIelkFFp4sJfOW2Zr+E CO+05AGO4N0V/s+cK8jx1aW9/QACMYO2c3kvy5++xte3zd1QscSVODVB5pj2tyHv Q/TfoPSk3AwwAFzggU2y53r++wzGvo1jswoIlA8CM6TN+9n0gua2A5kexJaVY8R4 JQRejbz2DURvACS0tbEa6RJpOKferTka88cQgAbs1mV/RAYkmvXMg3XB48RVKYL/ Ry0FECFEPmAriHjUv+OegvPxa3wVw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduhedrudelgdduudegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfgjfhffhffvufgtgfesth hqredtreerjeenucfhrhhomhepfdffrghvvgcuvehothhtlhgvhhhusggvrhdfuceouggt hhesshhkuhhnkhifvghrkhhsrdgrtheqnecuffhomhgrihhnpehfrhgvvggsshgurdhorh hgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepuggt hhesshhkuhhnkhifvghrkhhsrdgrth X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 0EB4D1403E0; Thu, 9 Apr 2020 14:00:42 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.1.7-1104-g203475c-fmstable-20200408v2 Mime-Version: 1.0 Message-Id: In-Reply-To: <5be71991-74f3-b5d2-d9d2-5cad4aff4caf@rlwinm.de> References: <20200406200750.2plzuyhsitstcxtn@tempp0> <5be71991-74f3-b5d2-d9d2-5cad4aff4caf@rlwinm.de> Date: Thu, 09 Apr 2020 20:00:02 +0200 From: "Dave Cottlehuber" To: freebsd-pkg@freebsd.org Subject: Re: EU - pkg mirror is slow Content-Type: text/plain;charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 48yppg1y8Sz3xxk X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=skunkwerks.at header.s=fm2 header.b=lefysevG; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=kprpwl8J; dmarc=none; spf=pass (mx1.freebsd.org: domain of dch@skunkwerks.at designates 66.111.4.26 as permitted sender) smtp.mailfrom=dch@skunkwerks.at X-Spamd-Result: default: False [-5.08 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[skunkwerks.at:s=fm2,messagingengine.com:s=fm2]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[26.4.111.66.rep.mailspike.net : 127.0.0.18]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkg@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[skunkwerks.at]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[skunkwerks.at:+,messagingengine.com:+]; IP_SCORE(-3.49)[ip: (-9.82), ipnet: 66.111.4.0/24(-4.89), asn: 11403(-2.69), country: US(-0.05)]; RCVD_IN_DNSWL_LOW(-0.10)[26.4.111.66.list.dnswl.org : 127.0.5.1]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MID_RHS_WWW(0.50)[] X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Apr 2020 18:00:45 -0000 On Thu, 9 Apr 2020, at 16:52, Jan Bramkamp wrote: > On 06.04.20 22:07, Dhananjay Balan wrote: >=20 > > (Please point me to the correct list if this is not the right one.) > > > > Recently I've started observing http://pkg0.bme.freebsd.org/ to be > > really slow, max bandwidth I can get is 250kb/s on a good day. I've > > tried it from two networks that I've access to -- hetzner DC (FSN1) > > and Vodafone (Berlin). > > > > Is that mirror overloaded or do I have some weird peering? It=E2=80=99s the mirror. There=E2=80=99s another one coming - the hw is = there and i hope it will be up and running soon. =E2=80=94 Dave From owner-freebsd-pkg@freebsd.org Sat Apr 11 20:42:11 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id AFA4A27A5AE for ; Sat, 11 Apr 2020 20:42:11 +0000 (UTC) (envelope-from tomek@cedro.info) Received: from mail-ot1-x32c.google.com (mail-ot1-x32c.google.com [IPv6:2607:f8b0:4864:20::32c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4906J26Rw7z45f0 for ; Sat, 11 Apr 2020 20:42:10 +0000 (UTC) (envelope-from tomek@cedro.info) Received: by mail-ot1-x32c.google.com with SMTP id x11so5297172otp.6 for ; Sat, 11 Apr 2020 13:42:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cedro.info; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=LNHLTBzp3FIKOPdE/n6XyMyV4aIH6Bhs1iCfB/qe6kc=; b=LMGFTmhSpN6aTkChYwM442/uScSJzLfhVia1ktwC8GDAQ7JHVXJjwZYb/zYQMNOT+j ONS+RZgAIXORZI9z+5lwJFhUglsnFBGQ8RfljR24cdEOXbypyORz4i7exsZ8iklrZSfZ w77lM5xekKNrSyV2CPIZHRYXnWaFbLs4IafOUTMFs2f2UsJHH6Lw7aSbaFl1xcdmlphT uHu/hy3WuEp47Y2bXgBMJotjPtZlk9P59WSMLulmPBKoldfXMNoBJ06W2dIkAtS+Aut0 6gEUBVJeUWgNAkyHt76KpwHcU93JN79uuo7dQ7ucB9kZDYMPVUjeH/KkJFFoKnHT2nPI XtUg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=LNHLTBzp3FIKOPdE/n6XyMyV4aIH6Bhs1iCfB/qe6kc=; b=q4yRxHLRUHOKPHtO7M3ikEot/6CsvwhMTHZzG6Ms/BwhRJl5PnuxA47ePAOeJnbqJy 8LoG2e+fnc2yKrcIB3m2sEhG5GSIVAGDfqlpLhzqVUIYYvtLBi0B287TvYL7K81fQ8V/ 5tHegfMv/7L3SxAxMb+mgCI9wsQgXfR2O/C44lUPtdhl5Mj4/U5Lvn2wuJ3S+2vRMM2P 5A9q2/qfwKLHOX/r0mbrfux/d1wEeqE4abVjMTDVT7WRneabFjckXf0aoXBMt9bcQjwr PCveGigeqKp0tiUJMSP/I0OVFEd6maYR7pa2siPekAcmaeJXltWsQst5CSBDLDFCjQn5 4mqw== X-Gm-Message-State: AGi0PuZ8AGlB+wZsUlhxtip/eFpt1ilkyoQiHEsGAa3UM3G2Upoy5RiJ DODx+n/ny+W/96uIijoRpYOIUA== X-Google-Smtp-Source: APiQypLDAUjUAfkPvW9lSI5GG/8Z6S1ZUTWAA4HlPGjlhMT7T+VUxXfVAOKBn6ojj7NVaCuDQe+Bxw== X-Received: by 2002:a9d:12a6:: with SMTP id g35mr8755131otg.333.1586637729554; Sat, 11 Apr 2020 13:42:09 -0700 (PDT) Received: from mail-oi1-f172.google.com (mail-oi1-f172.google.com. [209.85.167.172]) by smtp.gmail.com with ESMTPSA id l188sm3449881oib.44.2020.04.11.13.42.08 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 11 Apr 2020 13:42:08 -0700 (PDT) Received: by mail-oi1-f172.google.com with SMTP id e4so4315986oig.9; Sat, 11 Apr 2020 13:42:08 -0700 (PDT) X-Received: by 2002:a05:6808:485:: with SMTP id z5mr7242943oid.78.1586637727970; Sat, 11 Apr 2020 13:42:07 -0700 (PDT) MIME-Version: 1.0 References: <6094091586626901@vla1-a1bfe7298e26.qloud-c.yandex.net> In-Reply-To: <6094091586626901@vla1-a1bfe7298e26.qloud-c.yandex.net> From: Tomasz CEDRO Date: Sat, 11 Apr 2020 22:41:44 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: pkg mirrors extremely slow, why not use the ftp mirrors? To: Martin Hanson Cc: FreeBSD Questions Mailing List , freebsd-pkg@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4906J26Rw7z45f0 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cedro.info header.s=google header.b=LMGFTmhS; dmarc=none; spf=none (mx1.freebsd.org: domain of tomek@cedro.info has no SPF policy when checking 2607:f8b0:4864:20::32c) smtp.mailfrom=tomek@cedro.info X-Spamd-Result: default: False [-3.04 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[cedro.info:s=google]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkg@freebsd.org]; DMARC_NA(0.00)[cedro.info]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[cedro.info:+]; RCVD_IN_DNSWL_NONE(0.00)[c.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[yandex.com]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[]; IP_SCORE(-1.74)[ip: (-7.88), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)] X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Apr 2020 20:42:11 -0000 On Sat, Apr 11, 2020 at 7:42 PM Martin Hanson wrote: > I'm on a gigabit connection in EU, using the "pkg0.bme.freebsd.org" is horrible: +1 on this one :-( Compared to Linux repos where you can fetch really large amount of packages in a seconds we are really behind :-( I can see some improvement in speed recently but its still too slow.. I love PKG system, it saves so much time on compiling, setting up, and maintenance. I know that PKG is using geolocation for better access and that packages need to be signed for security so these repositories are in control of the FreeBSD project.. Maybe creating more smaller mirrors could be helpful? Maybe allowing people to share their broadbands could be helpful? How about creating a dedicated low-power distributed ARM based PKG delivery system that could be burned to a SD card then run from some sort of *Pi device connected to a broadband? This way we could have lots of low power local delivery locations that could act as PKG mirrors :-) I will provide a dedicated thread for that idea to discuss :-) Best regards :-) Tomek -- CeDeROM, SQ7MHZ, http://www.tomek.cedro.info From owner-freebsd-pkg@freebsd.org Sat Apr 11 21:03:22 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5F46F27B271 for ; Sat, 11 Apr 2020 21:03:22 +0000 (UTC) (envelope-from tomek@cedro.info) Received: from mail-oi1-x22a.google.com (mail-oi1-x22a.google.com [IPv6:2607:f8b0:4864:20::22a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4906mT2bQPz47KJ for ; Sat, 11 Apr 2020 21:03:21 +0000 (UTC) (envelope-from tomek@cedro.info) Received: by mail-oi1-x22a.google.com with SMTP id b7so1798143oic.2 for ; Sat, 11 Apr 2020 14:03:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cedro.info; s=google; h=mime-version:from:date:message-id:subject:to; bh=hVDcV3jmtRPwmv4No+a9QGxAmKAXjOWmxTlkFQX/ajE=; b=NdVEyZALVyQSXKUxSdmEOF0W4fDGo/E7+IpoNYicWFhD7ftVeYP1ujJPaUV5MMouAJ D5xXZS/puBoTGlR7I2Ir7nwP4wlUly63BX9yDKPtgSeIOJNrQS9VaaXqAon/i3gAiUg1 Aog4HTaYhYdYq0BuqVZ3KIy1J7N92Mf3l5fIHt7MuDGvXWRDgD+h+Ur1spAVGVGFgRJR frVatRzc6tZE7f4jfwNHe/9bKehvK/HeF9sZ+7B7eruzPSi7NLPydTt6XIFvzkxur/GR PD8C5J/DrVPDJhYrQ24C4n8t5BYEvhD2u2eq79VySGieclvqYIgjbHchCIfAkrI3K1xg ASLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=hVDcV3jmtRPwmv4No+a9QGxAmKAXjOWmxTlkFQX/ajE=; b=XSOxeR/BhYCa5VbGOlVZUc1muA0EKQgtNTODUKjBJgnQheLDQJJ4M0Dc6Y+PB0nqpw BJDprYR98trG9OuEUb1HiB5EuewjphnanZXDXKSJAnD1lYBJmPxwxFKaum6WluSxNyzr FSeEZRqaGAGQyvdm8SqdzAcrlF/XVl3D0WwYQ1ojYEvAYsyRpza/9yI3DHf0htXCcG90 mZB/R9QGEcNXkJPRWZPdvoE9z07F/DkmtISTEGIIu8YOK52pPU3rW8rEtkUIkCh5HXQc sdeAY3fqpBCQbccc6YSsgTfr2BY5c9bguzaJQmj6eBo2q7TAt4R86GViXkTkMvIJzlRv tSWQ== X-Gm-Message-State: AGi0PuYirxG/7tMUPDhBJ1h8yVtz5whHYagMbMMH3Pn2K5dDi7LfiqYu ZElkD+A7Ez1HGbxOZy84+0Jyrw== X-Google-Smtp-Source: APiQypKe9adPVf7kBVKQWIsiTZ1PQQCmAQ+5o3spaMyYX3yfje2WVChr+X5OnHNr3HsxyBtk4xf40Q== X-Received: by 2002:aca:47c8:: with SMTP id u191mr7661104oia.170.1586639000133; Sat, 11 Apr 2020 14:03:20 -0700 (PDT) Received: from mail-oi1-f170.google.com (mail-oi1-f170.google.com. [209.85.167.170]) by smtp.gmail.com with ESMTPSA id f1sm3834551ooj.38.2020.04.11.14.03.18 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 11 Apr 2020 14:03:19 -0700 (PDT) Received: by mail-oi1-f170.google.com with SMTP id k9so4350734oia.8; Sat, 11 Apr 2020 14:03:18 -0700 (PDT) X-Received: by 2002:a05:6808:485:: with SMTP id z5mr7275471oid.78.1586638998185; Sat, 11 Apr 2020 14:03:18 -0700 (PDT) MIME-Version: 1.0 From: Tomasz CEDRO Date: Sat, 11 Apr 2020 23:02:55 +0200 X-Gmail-Original-Message-ID: Message-ID: Subject: BSDPKGNET: PKG MESH CDN P2P To: FreeBSD Questions Mailing List , freebsd-pkg@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4906mT2bQPz47KJ X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cedro.info header.s=google header.b=NdVEyZAL; dmarc=none; spf=none (mx1.freebsd.org: domain of tomek@cedro.info has no SPF policy when checking 2607:f8b0:4864:20::22a) smtp.mailfrom=tomek@cedro.info X-Spamd-Result: default: False [-1.93 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[cedro.info:s=google]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-pkg@freebsd.org]; DMARC_NA(0.00)[cedro.info]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[cedro.info:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[a.2.2.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; SUBJ_ALL_CAPS(2.03)[27]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-1.65)[ip: (-7.46), ipnet: 2607:f8b0::/32(-0.33), asn: 15169(-0.43), country: US(-0.05)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Apr 2020 21:03:22 -0000 Hello world :-) I have this idea on how we could improve PKG delivery speeds.. :-) How about creating a dedicated low-power distributed head-less ARM based PKG delivery system that could be burned to a SD card then run from some sort of *Pi (RaspberryPi, BananaPi, ARM routers, etc) device connected to a broadband by users all around the planet? Another idea is to use P2P of some sort, so such proxies would provide only bits of data, maybe even FreeBSD users could serve as P2P nodes if they wanted to. This way we could have lots of low power local delivery locations that could act as Tier-2 PKG mirrors / caches / proxies. We could have then Tier-1 PKG platrofms and control provided by the FreeBSD project :-) I would gladly share my 60MBit uplink broadband to host this kind of PKG CDN. I could also install such low-power devices in places with fast broadband which are barely used in casual everyday situations. Here are the goals: 1. I would run on a low power device such as network router or BananaPi of any sort (around 10W power usage). 2. It would require only burning a SD card image to set up. Maybe ifconfig (local uart CLI no web interface). 3. All cached packages would be also stored on a SD card (64GB? 128GB?) no external drives attached. 4. All maintenance could be automated from a central command and require no user interaction. 5. The SD card image can be even encrypted to improve security. 6. P2P protocols could be used to spread the bits of data and off-load the traffic from a single pkg host to a many smaller hosts or even workstations. Hints and Comments are welcome :-) Tomek -- CeDeROM, SQ7MHZ, http://www.tomek.cedro.info From owner-freebsd-pkg@freebsd.org Sat Apr 11 21:08:42 2020 Return-Path: Delivered-To: freebsd-pkg@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0329327B637 for ; Sat, 11 Apr 2020 21:08:42 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: from connect.ultra-secure.de (connect.ultra-secure.de [88.198.71.201]) by mx1.freebsd.org (Postfix) with ESMTP id 4906tc4phzz47bv for ; Sat, 11 Apr 2020 21:08:40 +0000 (UTC) (envelope-from rainer@ultra-secure.de) Received: (Haraka outbound); Sat, 11 Apr 2020 23:08:28 +0200 Received-SPF: None (connect.ultra-secure.de: domain of ultra-secure.de does not designate 217.71.83.52 as permitted sender) receiver=connect.ultra-secure.de; identity=mailfrom; client-ip=217.71.83.52; helo=[192.168.1.238]; envelope-from= Received: from [192.168.1.238] (217-071-083-052.ip-tech.ch [217.71.83.52]) by connect.ultra-secure.de (Haraka/2.6.2-toaster) with ESMTPSA id 3CFD4454-6A0D-4C13-9635-0E6AFE2D5F7A.1 envelope-from (authenticated bits=0) (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 verify=NO); Sat, 11 Apr 2020 23:08:24 +0200 From: Rainer Duffner Message-Id: Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.14\)) Subject: Re: pkg mirrors extremely slow, why not use the ftp mirrors? Date: Sat, 11 Apr 2020 23:08:27 +0200 In-Reply-To: Cc: freebsd-pkg@freebsd.org To: Tomasz CEDRO References: <6094091586626901@vla1-a1bfe7298e26.qloud-c.yandex.net> X-Mailer: Apple Mail (2.3445.104.14) X-Haraka-GeoIP: EU, CH, 451km X-Haraka-ASN: 24951 X-Haraka-GeoIP-Received: X-Haraka-ASN: 24951 217.71.80.0/20 X-Haraka-ASN-CYMRU: asn=24951 net=217.71.80.0/20 country=CH assignor=ripencc date=2003-08-07 X-Haraka-FCrDNS: 217-071-083-052.ip-tech.ch X-Haraka-p0f: os="Mac OS X " link_type="DSL" distance=14 total_conn=5 shared_ip=N X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on spamassassin X-Spam-Level: X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, HTML_MESSAGE,SPF_NONE,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.1 X-Haraka-Karma: score: 6, good: 12957, bad: 153, connections: 14363, history: 12804, asn_score: 614, asn_connections: 814, asn_good: 666, asn_bad: 52, pass:asn, relaying X-Rspamd-Queue-Id: 4906tc4phzz47bv X-Spamd-Bar: ++++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of rainer@ultra-secure.de has no SPF policy when checking 88.198.71.201) smtp.mailfrom=rainer@ultra-secure.de X-Spamd-Result: default: False [4.43 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_TRACE(0.00)[0:+,1:+,2:~]; DMARC_NA(0.00)[ultra-secure.de]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.55)[0.549,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_SPAM_LONG(0.98)[0.984,0]; R_SPF_NA(0.00)[]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:24940, ipnet:88.198.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.39)[ipnet: 88.198.0.0/16(3.57), asn: 24940(-1.58), country: DE(-0.02)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-pkg@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Binary package management and package tools discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Apr 2020 21:08:42 -0000 > Am 11.04.2020 um 22:41 schrieb Tomasz CEDRO : >=20 > How about creating a dedicated low-power distributed ARM based PKG Most people who use packages more than casually simply run their own = build-server. Most of the commercial users of FreeBSD run their own internal forks. I just have a couple of machines (there were many more=E2=80=A6) and I = still run my own poudriere server.