From nobody Mon Jun 12 14:01:59 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QftfZ44Kkz4cKDc for ; Mon, 12 Jun 2023 14:02:14 +0000 (UTC) (envelope-from number201724@me.com) Received: from pv50p00im-tydg10021701.me.com (pv50p00im-tydg10021701.me.com [17.58.6.54]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QftfY6qBmz4DZD for ; Mon, 12 Jun 2023 14:02:13 +0000 (UTC) (envelope-from number201724@me.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=me.com header.s=1a1hai header.b="wD/dJDnk"; spf=pass (mx1.freebsd.org: domain of number201724@me.com designates 17.58.6.54 as permitted sender) smtp.mailfrom=number201724@me.com; dmarc=pass (policy=quarantine) header.from=me.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=me.com; s=1a1hai; t=1686578531; bh=R7nRn6Aq7xdcfVu5i0cZGKtz7K+IWu/xtIHpwhKH0M4=; h=Content-Type:Message-ID:Date:MIME-Version:Subject:From:To; b=wD/dJDnknW2vqYliFPhiW1yjo2LJ/iFpR4g8Y6AVZqgVKIPpfBHAvXTxgecU8P/xb g79t0V/SF5ZSPsqAmuIOoFUQ8UAjtRJpSn+1cHEaStMGXGK3VzKv58oJo1uMVWPy1v 5Wq7mF+tW++++9IEfqahFJiP4qfJCcUjInQ7zfJ4cs5aUx2+DbcS1k4seJcqa1rn7z uxqlXelpVB7U5EDxG6/w9R2AmsAGntIDRUKoSGkQGOyPmnITq9i4NA1UXc0slYkd6S Lxnfvy7fFA5RajI4dIsdkUUwHOwH9bH6+nNNDSpFQpbZCw4B9DW3MntdXSCVNRwVgU oEoBFvsvWTpSw== Received: from [192.168.1.109] (pv50p00im-dlb-asmtp-mailmevip.me.com [17.56.9.10]) by pv50p00im-tydg10021701.me.com (Postfix) with ESMTPSA id 84BE23A0D3E; Mon, 12 Jun 2023 14:02:04 +0000 (UTC) Content-Type: multipart/alternative; boundary="------------rje1GRDqt5ygZhkHLy9D4CwB" Message-ID: <2d9e2449-93cd-76ca-44a5-ca9287a11e7e@me.com> Date: Mon, 12 Jun 2023 22:01:59 +0800 List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Subject: =?UTF-8?Q?how_to_mirror_pkg_and_update_from_official_site=ef=bc=9f?= From: YUAN RUI To: mirror-admin@FreeBSD.org, freebsd-hubs@freebsd.org, hostmaster@CC.FreeBSD.org References: <04c739c1-0d45-73ae-2cd3-295b460e8030@me.com> Content-Language: en-US In-Reply-To: <04c739c1-0d45-73ae-2cd3-295b460e8030@me.com> X-Proofpoint-ORIG-GUID: G5LXkQwLIs2A6EAdTFHAd4LmZ4v55Tgc X-Proofpoint-GUID: G5LXkQwLIs2A6EAdTFHAd4LmZ4v55Tgc X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.138,18.0.572,17.11.64.514.0000000_definitions?= =?UTF-8?Q?=3D2020-02-14=5F11:2020-02-14=5F02,2020-02-14=5F11,2022-02-23?= =?UTF-8?Q?=5F01_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 phishscore=0 bulkscore=0 malwarescore=0 adultscore=0 suspectscore=0 clxscore=1011 mlxlogscore=564 mlxscore=0 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000 definitions=main-2306120120 X-Spamd-Result: default: False [-5.08 / 15.00]; DWL_DNSWL_LOW(-1.00)[me.com:dkim]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_MEDIUM(-0.99)[-0.992]; NEURAL_HAM_LONG(-0.99)[-0.992]; DMARC_POLICY_ALLOW(-0.50)[me.com,quarantine]; R_SPF_ALLOW(-0.20)[+ip4:17.58.0.0/16]; R_DKIM_ALLOW(-0.20)[me.com:s=1a1hai]; RCVD_IN_DNSWL_LOW(-0.10)[17.58.6.54:from]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:714, ipnet:17.58.0.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[me.com]; MLMMJ_DEST(0.00)[freebsd-hubs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[me.com:+]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[me.com]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4QftfY6qBmz4DZD X-Spamd-Bar: ----- X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --------------rje1GRDqt5ygZhkHLy9D4CwB Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Hello I am coordinating the update and pkg of Nanjing University (https://www.nju.edu.cn/) mirror FreeBSD. How to mirror pkg and update from official mirror sites? Can you provide an rsync or other mirror method? The following IP addresses can be used if whitelisting is required. mirror info: http://mirror.nju.edu.cn/xxx/ https://mirror.nju.edu.cn/xxx/ rsync://mirror.nju.edu.cn/xxx/ Synchronization frequency: every day Bandwidth: 10Gb/s Location: Nanjing, China Sponsor: eScience Center, Nanjing University Sponsor URL: https://sci.nju.edu.cn Admin Name: YAO GE Admin Email contact: my@yaoge123.com IPv4 address to authorize: 210.28.130.33, 210.28.130.3 IPv6 address to authorize: 2001:da8:1007:4011::89, 2001:da8:1007:4011::3 Nanjing University can also provide rsync for mirroring other sites in mainland China. Best regards, YUAN RUI --------------rje1GRDqt5ygZhkHLy9D4CwB Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit

Hello


I am coordinating the update and pkg of Nanjing University (https://www.nju.edu.cn/) mirror FreeBSD.

How to mirror pkg and update from official mirror sites?

Can you provide an rsync or other mirror method?

The following IP addresses can be used if whitelisting is required.


mirror info:

http://mirror.nju.edu.cn/xxx/
https://mirror.nju.edu.cn/xxx/
rsync://mirror.nju.edu.cn/xxx/

Synchronization frequency: every day
Bandwidth: 10Gb/s
Location: Nanjing, China
Sponsor: eScience Center, Nanjing University
Sponsor URL: https://sci.nju.edu.cn
Admin Name: YAO GE
Admin Email contact: my@yaoge123.com
IPv4 address to authorize: 210.28.130.33, 210.28.130.3
IPv6 address to authorize: 2001:da8:1007:4011::89, 2001:da8:1007:4011::3


Nanjing University can also provide rsync for mirroring other sites in mainland China.


Best regards,

YUAN RUI



--------------rje1GRDqt5ygZhkHLy9D4CwB-- From nobody Mon Nov 6 11:34:59 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SP8RY1Yvcz50RNB for ; Mon, 6 Nov 2023 11:35:37 +0000 (UTC) (envelope-from junho.choi@gmail.com) Received: from mail-qt1-x834.google.com (mail-qt1-x834.google.com [IPv6:2607:f8b0:4864:20::834]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SP8RX3f4hz4dDr for ; Mon, 6 Nov 2023 11:35:36 +0000 (UTC) (envelope-from junho.choi@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=UfFm6oFF; spf=pass (mx1.freebsd.org: domain of junho.choi@gmail.com designates 2607:f8b0:4864:20::834 as permitted sender) smtp.mailfrom=junho.choi@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-qt1-x834.google.com with SMTP id d75a77b69052e-41feb963f60so8957651cf.1 for ; Mon, 06 Nov 2023 03:35:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1699270535; x=1699875335; darn=freebsd.org; h=cc:to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=gddbL4dxX/PbTLoCk3wkw3A8GZZM7ltPr22a38VaLd4=; b=UfFm6oFFODTx0Snhw40DHrnBzsivh2wYrFeX/Xxw2u8ski4JG7jR4oAtoYSmeEcU/2 hkPCeD0WfBlJW3QZAyz6k/jqkRxCUBTiQlqVabivbswHBRtAZFSOVH7qI/npHHd6gUwt qsMZelCgWwwa1nTHDoi/XFz72bH+GVeBGHMscr0CFCHZ7amvdGqmPFjiAQ8RFVZR6LNa /Ccdbi84tkvrAxRP9KevleMS3v91p7kcL+X7I1rZCyoZV6VKuwYR5pgm98uvTaJt6+0H 53MkJsbIcSQel27OiEnxiScgfhqJbkOfphmtY+K6U8xzwE7xwJf1r8Evrv6ATpQc4xYB b8SQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699270535; x=1699875335; h=cc:to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=gddbL4dxX/PbTLoCk3wkw3A8GZZM7ltPr22a38VaLd4=; b=fIuyAB5KcZKZTzlYjdaAl0ehJ7re7iQOvAXNxbAEyggYHXmxMc39LFt98Zks3BoWR7 dtT4pGaLtjMjq5fvF9ZZhEKV8KPSV8TQi2dEYz0oy8HR3tDXOdwPbEjfDIU6Jq2gfNND l9XO+u4C4HVviGOnghcG1YbvDgG7jIrb5PurSnYFBvXjXjaIyEcUeMbj29EJfp3L6jqf gMXL+PhBg/W3pdKs4KQ+D0s/tIrsJgNcnXMhdtzlg0vG4YBmq83RMy7RoocLCD9Sq0hI 91TluWIzCDgVlrytKxdTsI7UH+rBWXV0Ut8tp6dYFibvTucAT2yarCgbIqpCEtyh6sFC UuOQ== X-Gm-Message-State: AOJu0YwzfoZe5E8RdlK7xDfCxqB4lvUnowdZsOMe/9fehlCB8msXi2Tp wNqq9XYiZMonpPHyZy9M7qze/8vH19bgBPZ8cLjqgVw9J1iCDQ== X-Google-Smtp-Source: AGHT+IEPXvGLrOkWczOch9RJhk4qzuz8LgZkaIZnLBEugyEIYmEciyNqRofJ07iAATmZQFoI/ntK+N3bP9mbMOUkhrI= X-Received: by 2002:a05:622a:11d1:b0:417:fa13:a8f7 with SMTP id n17-20020a05622a11d100b00417fa13a8f7mr14422142qtk.4.1699270535240; Mon, 06 Nov 2023 03:35:35 -0800 (PST) List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 From: Junho Choi Date: Mon, 6 Nov 2023 20:34:59 +0900 Message-ID: Subject: ftp-master rsync client issue? To: freebsd-hubs Cc: admin@kr.freebsd.org Content-Type: text/plain; charset="UTF-8" X-Spamd-Result: default: False [-1.00 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-0.98)[-0.975]; NEURAL_HAM_SHORT(-0.91)[-0.915]; NEURAL_SPAM_MEDIUM(0.89)[0.886]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hubs@freebsd.org]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::834:from]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TAGGED_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-hubs@freebsd.org] X-Rspamd-Queue-Id: 4SP8RX3f4hz4dDr X-Spamd-Bar: - Hi, I am running ftp/rsync.kr.freebsd.org and recently (not sure when it starts, but at least a few weeks) starting to see it's always full: ============================================================================== This is the FreeBSD master archive for the ftp area /pub/FreeBSD It is available for primary mirrors in order to ensure rapid archive updates and distribution. rsync -vaHz --delete rsync://ftp-master.freebsd.org/FreeBSD/ ~ftp/pub/FreeBSD/ Contact information etc: http://www.FreeBSD.org/doc/en/articles/hubs/ ============================================================================== ******** MINIMUM RSYNC VERSION REQUIRED = 3.00 (prefer 3.1.0+) ********* ============================================================================== @ERROR: max connections (10) reached -- try again later rsync error: error starting client-server protocol (code 5) at main.c(1880) [Receiver=3.2.7] Is there any issue or simply connecting too many clients? Best, -- Junho Choi | https://saturnsoft.net From nobody Mon Nov 6 16:58:18 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SPHbz01zGz50Gtf for ; Mon, 6 Nov 2023 16:58:23 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SPHby6hfHz4LxK; Mon, 6 Nov 2023 16:58:22 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1699289902; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=IMQhOPPpLnr+j3gOyFsaF5tvNPdBsc4/8WCHGn4mIDc=; b=fVNtyenbtPnMQB4ha/wRzZfk3oI8xFmVjw0WEpXrAlxs5WXcLd2eI3iN8bmLK0ehXbg0k6 Arp/A1IyGm/8ZRsFqZw05TXZKtSBB02vk+vGjvSVeDLGVgTAGrG84SgGhGFMwBAhnd4X67 /Ma7SLgnLGtCuboHeEX+Ig7PMpnyitRinf8rl90CWRE/mP5x5e+QSFp+9CeWvVViYBf2hE x70SkIfmGGdg2JmplT7Z8/v7PbO9t3+kHErdloYDAPa9GzvL1jxhK4WzgTkf6rWIOXO31o ub2lBGfbkFhL4rEqjJp5kNSYRHe4mbb0DClan1ynn1NkukqUJwpgYzli0N8SyQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1699289902; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=IMQhOPPpLnr+j3gOyFsaF5tvNPdBsc4/8WCHGn4mIDc=; b=PsPAFdfLTr9yEOz8Nrkvn3CArYRP4nuKick7uGypZJ/ahYgX2f4gvdIdaPAe6UUD+yb4Au Ll5sqRo8nBl8iRTfCSbu5MWW5h0Cscr8dUpLoHD6xTA5qB0JL0YGxTyAcmJ6GZLilOitPM Y1iI58aiiYI3NiRRjAb40eSSzc24i4Q7dfyxn5f0jMhJKOS0bEDQ2SPx99TArKMKapMlCC QCwoex08Y7OWouwWWfkNqpBUFL8kLgb/l4o5eYTBMSShiyxw5Xd8XBiTlrgU7hV8UMzPc6 2evCY9T0Rt6UUh1wVxCx+yyJO8odTc5tzc173KHUbkhVAHp3z2Ftzzt1EKTwiA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1699289902; a=rsa-sha256; cv=none; b=s4Ln5QUPUp3dd70c43AhNgpV3Okkz6ne68HBHB65Nw1GR+7djn1JuOTkTkhPo2apX/AGNN 1T3icnKiZpwYiZCGGbqdD7gwxm9qt72TfGZlmdX8niVhm42YAM98u6arLtPQkN/JgumhbH 7T4PXJ3qhUGBMqqTvFOMAbtu3O3/rVOfEEgVvhvH0t+iQEgDRyDWmn/4PubjwABx4PFlFs sLtA3UYp5xD9GiAJM52e9NIBDU1X7nNzy1dYPaN3Thd73QViEDqFs6JH1fl4wno3uhfY8l JwBEI34jQs3p7O1YS4Ji4YSyCtmhTr1hHh3BeA3k+YV6COkNbIw8cD2OyOO9+g== Received: from auth1-smtp.messagingengine.com (auth1-smtp.messagingengine.com [66.111.4.227]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SPHby5YNpz1JY6; Mon, 6 Nov 2023 16:58:22 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailauth.nyi.internal (Postfix) with ESMTP id 684A127C0054; Mon, 6 Nov 2023 11:58:22 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Mon, 06 Nov 2023 11:58:22 -0500 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedruddugedgleefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffokfgjfhggtgesthdtmhdtredttdenucfhrhhomheprfhhihhl ihhpucfrrggvphhsuceophhhihhlihhpsehfrhgvvggsshgurdhorhhgqeenucggtffrrg htthgvrhhnpedvheehkefghfeiteehteduudeuhfdvgeettdeihfffleeuteeggeetuddt tddufeenucffohhmrghinhepfhhrvggvsghsugdrohhrghenucevlhhushhtvghrufhiii gvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehphhhilhhiphdomhgvshhmthhprghu thhhphgvrhhsohhnrghlihhthidqudduieeivdeivdegkedqvdefhedukedttdekqdhphh hilhhipheppehfrhgvvggsshgurdhorhhgsehtrhhouhgslhgvrdhish X-ME-Proxy: Feedback-ID: ia691475d:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Mon, 6 Nov 2023 11:58:20 -0500 (EST) From: Philip Paeps To: Junho Choi Cc: admin@kr.freebsd.org, freebsd-hubs@freebsd.org Subject: Re: ftp-master rsync client issue? Date: Tue, 07 Nov 2023 00:58:18 +0800 X-Mailer: MailMate (1.14r5998) Message-ID: <9793F40D-BA47-4F12-9F03-70C4AB0D75C7@freebsd.org> In-Reply-To: References: List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed On 2023-11-06 19:34:59 (+0800), Junho Choi wrote: > I am running ftp/rsync.kr.freebsd.org and recently (not sure when it > starts, but at least a few weeks) starting to see it's always full: Hi! Thanks for running a local mirror for us. We're still looking for new full mirror sites (ftp/git/pkg) to include in the pkg.freebsd.org / download.freebsd.org geodns. Are you interested in / able to host a full site for us? Meanwhile, let's try to fix your ftp / rsync problem. Could you let me know a src address I can grep for in the ftp-master logs? > @ERROR: max connections (10) reached -- try again later This is a very odd error. Our limit should be higher than that. But it's late at night and I might be looking at the wrong rsync.conf. A source address will help me trace your connection through the machinery. Many thanks. Best wishes. Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises From nobody Mon Nov 6 21:40:20 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SPPt24Wpcz50GTw for ; Mon, 6 Nov 2023 21:40:58 +0000 (UTC) (envelope-from junho.choi@gmail.com) Received: from mail-qt1-x829.google.com (mail-qt1-x829.google.com [IPv6:2607:f8b0:4864:20::829]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SPPt22gyxz3dB9; Mon, 6 Nov 2023 21:40:58 +0000 (UTC) (envelope-from junho.choi@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qt1-x829.google.com with SMTP id d75a77b69052e-41cc0e9d92aso31779761cf.3; Mon, 06 Nov 2023 13:40:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1699306857; x=1699911657; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=uCssZT7T3xFdxEks/p2ee0WYJXEk4hfZSSBTqhorT9k=; b=HmwTCuIwAPFSCkvoMqVcfzYJ9WHuNZMe1po67W2G0q7sUeK+soTsI3KHImeOwntiiB sl/LOSLlqyR79DMR+3Al/Xt77kbdsziaJMqfDWzIciPeHNBJMePcq6SILWPzW/d//10m GDX9mImUrvzp/G6diG8pU8awXKsBGZdl3HuPIdpTmKB73m1a8WIHROKTN+KlKPBSuynJ LZ08oDxVNmi9mQeE6mss7gemXa9d8unb14In5aPysYV+lTLnYR8Q5F64TPVsjUbK5QC8 hzrL3Aq8JSdjkcYkCnNhqDXgloSK27GMTbPM2o6Fzh2pbeg8lGU9rzbNtRZZMe9YkLKp RdaA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699306857; x=1699911657; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=uCssZT7T3xFdxEks/p2ee0WYJXEk4hfZSSBTqhorT9k=; b=SHuRLONAehYdjx3HCltDMSaIeCPPtkj9Pzrq9XGsvjPHXsOVxPpP2zVqeNH1hhtUdZ OcW/6ODhdsTqPODKT9+3sHv4Rs/107MLu6VUHggkcvE7X++oxERhFSdYyQUxO/KsqJIz 4owzbwj7ikfsF3Fea5YKAxQVibnHdca2l8L9WdhidjWunjCPhhCGXrVbDXhJwBHf49um Opjm6Cieh28D06WcQp8txw2EroHqozbxxuBYUDxVxkD5xV5tTbarYLjcjD2r4Z5KqWJg Y/qLJ3nTc41Zl9QE8dldk/UxSBqntUBv12nFAYpJSkid/aDzWeOJYQMVoKNYCfMnK8pr iL/Q== X-Gm-Message-State: AOJu0YwnU0NHtnIOVC4Y3/Ru4c8Mzs5Tms/94JXt1XRpdys/4qwsVL7n ihsGY66M/WBRxedzgsxA75GKoj2aSBKYmglHh5mWckqnf2P2YA== X-Google-Smtp-Source: AGHT+IHfECQHYnJJVnEZrzfO5a+YMhFvg/VrHk9ibPnUYGkElJ3D0g/LZm7fiAI58sCXs57JRn3FPpz9ytpkKgMpvWA= X-Received: by 2002:ac8:5943:0:b0:403:e3ce:565b with SMTP id 3-20020ac85943000000b00403e3ce565bmr38133141qtz.4.1699306857192; Mon, 06 Nov 2023 13:40:57 -0800 (PST) List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 References: <9793F40D-BA47-4F12-9F03-70C4AB0D75C7@freebsd.org> In-Reply-To: <9793F40D-BA47-4F12-9F03-70C4AB0D75C7@freebsd.org> From: Junho Choi Date: Tue, 7 Nov 2023 06:40:20 +0900 Message-ID: Subject: Re: ftp-master rsync client issue? To: Philip Paeps Cc: admin@kr.freebsd.org, freebsd-hubs@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4SPPt22gyxz3dB9 Thanks! Source address should be 182.252.182.30 (ftp.kr.freebsd.org) Best, On Tue, Nov 7, 2023 at 1:58=E2=80=AFAM Philip Paeps wr= ote: > > On 2023-11-06 19:34:59 (+0800), Junho Choi wrote: > > I am running ftp/rsync.kr.freebsd.org and recently (not sure when it > > starts, but at least a few weeks) starting to see it's always full: > > Hi! Thanks for running a local mirror for us. > > We're still looking for new full mirror sites (ftp/git/pkg) to include > in the pkg.freebsd.org / download.freebsd.org geodns. Are you > interested in / able to host a full site for us? > > Meanwhile, let's try to fix your ftp / rsync problem. > > Could you let me know a src address I can grep for in the ftp-master > logs? > > > @ERROR: max connections (10) reached -- try again later > > This is a very odd error. Our limit should be higher than that. But > it's late at night and I might be looking at the wrong rsync.conf. A > source address will help me trace your connection through the machinery. > > Many thanks. > > Best wishes. > Philip > > -- > Philip Paeps > Senior Reality Engineer > Alternative Enterprises --=20 Junho Choi | https://saturnsoft.net From nobody Tue Nov 7 07:05:02 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SPfNy3RP2z503y5 for ; Tue, 7 Nov 2023 07:05:06 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SPfNy2yZPz4Wl2; Tue, 7 Nov 2023 07:05:06 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1699340706; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gyZ1Nf6FzLJ1DSstmsd2W3NmT1+/Y2VV79MrD3LnxQs=; b=OQyVQhd7n/vJ4WBCpTxam5qYRcN6qgLLld1KJUq8vHYddD9ScxELrzmGG5i441axWbcSuk vTkuyAgqWzPLhyTdnow74EjVPGvUC6aUGa61UXeZwdBYWhuJliR2dYwwgDJWvMzb2smsV4 Kz2e0f+xvkUoOIo2AKhth6nQxRvvCkgi1XZu618C1Tr/8v+vvVFh4Murxo5W2TXEAc+NKL UBIZg32zhVjk6JVZbyZqTWb7t3/qSZrn2pIGdKpXs+2O9r+SATwpLRum9RBcmg98KyTV/T fbvFFmN5nUdH1TXglj4EfLmu+y++HrXo7ixNO7W2BUVOlKwiUO9owMSYeAaTCw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1699340706; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gyZ1Nf6FzLJ1DSstmsd2W3NmT1+/Y2VV79MrD3LnxQs=; b=VKY0F7L9AwPMednXTUYxU14AtsBISCLHWrY7RokXWkQ50D6AvJ7hQebCi5rvj3jds6QpwZ uG5aPKgmlx4kPXLRnnf/llA6QimZXnOrjE8ay23v5fe1rc/ZCWpyN1g816gPyca7yZe3aL ZKz3tgeDOAEol/p4NAsf5sXUZrfIgNuYKBkSdBFE5sET6muRRJm/xz3XmE9ZyIxeJNzr/f s0S04tuNdLj5tYvuBhI9KLHmXhd14fkFMxQWfSsi4bmKAzwOWOLxMLCCxSIl1MAfwdXdpK OsIvEcXdCPVEM90nvz4lObrPApKEoRSFHqGuyc19y/JwQFPJj1K9ZK5Uc0w/2w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1699340706; a=rsa-sha256; cv=none; b=UP9qc9YvQTO/6DKFIyQ95YU/ny5IB2+Y3cSjcDBNuPfNmBZfRaxyoINj+CncJUOlrg5Vpa DJXVeR9kqasCgesduBDjgq2FkF1d4D5R5b1gJMnTTSlMKJ8DsoJGEXuSSivMsBI2q2pPfT kicrgVAI3DbktEbNhzZUD0VjYZSVWsVY+usk4TnipkrqYaMQgAf2SDFz+9wQFO0sKOLzAp OOBPO6d3lxZYK77VVFCm8Tq3OYpDRblISJgj/1/TrQiXM9RdcHlDSNZ1XkRIv9yQhnGGej csIIzVwcH2yhKHeyRQWUqSVj2b3VgGtjbLyfG67MO6AxpafA2U1mVVHZyDNQNw== Received: from auth2-smtp.messagingengine.com (auth2-smtp.messagingengine.com [66.111.4.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SPfNy1pG0z6Jk; Tue, 7 Nov 2023 07:05:06 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailauth.nyi.internal (Postfix) with ESMTP id 111B527C005C; Tue, 7 Nov 2023 02:05:06 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Tue, 07 Nov 2023 02:05:06 -0500 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrudduhedguddtudcutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmd enucfjughrpefhvfevufffoffkjghfgggtgfesthekmhdtredtjeenucfhrhhomheprfhh ihhlihhpucfrrggvphhsuceophhhihhlihhpsehfrhgvvggsshgurdhorhhgqeenucggtf frrghtthgvrhhnpeefueekkeeiudeileduteehtdeiveeufeelheetgfekiefgleefieeg feekfefgueenucffohhmrghinhepfhhrvggvsghsugdrohhrghenucevlhhushhtvghruf hiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehphhhilhhiphdomhgvshhmthhp rghuthhhphgvrhhsohhnrghlihhthidqudduieeivdeivdegkedqvdefhedukedttdekqd hphhhilhhipheppehfrhgvvggsshgurdhorhhgsehtrhhouhgslhgvrdhish X-ME-Proxy: Feedback-ID: ia691475d:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 7 Nov 2023 02:05:04 -0500 (EST) From: Philip Paeps To: Junho Choi Cc: admin@kr.freebsd.org, freebsd-hubs@freebsd.org Subject: Re: ftp-master rsync client issue? Date: Tue, 07 Nov 2023 15:05:02 +0800 X-Mailer: MailMate (1.14r5998) Message-ID: <327523F3-5122-455F-952D-65DC36A7C1B1@freebsd.org> In-Reply-To: References: <9793F40D-BA47-4F12-9F03-70C4AB0D75C7@freebsd.org> List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 2023-11-07 05:40:20 (+0800), Junho Choi wrote: > On Tue, Nov 7, 2023 at 1:58 AM Philip Paeps > wrote: >> On 2023-11-06 19:34:59 (+0800), Junho Choi wrote: >>> I am running ftp/rsync.kr.freebsd.org and recently (not sure when it >>> starts, but at least a few weeks) starting to see it's always full: >> >> Could you let me know a src address I can grep for in the ftp-master >> logs? > > Source address should be 182.252.182.30 (ftp.kr.freebsd.org) I believe I've fixed your problem. You were hitting the wrong section of the rsyncd.conf with tighter limits. Please let me know if you still run into limits. Best wishes. Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises From nobody Tue Nov 7 21:44:22 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SQ1wD0Y8lz50Xw4 for ; Tue, 7 Nov 2023 21:45:00 +0000 (UTC) (envelope-from junho.choi@gmail.com) Received: from mail-qt1-x832.google.com (mail-qt1-x832.google.com [IPv6:2607:f8b0:4864:20::832]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SQ1wC5z08z4mtC; Tue, 7 Nov 2023 21:44:59 +0000 (UTC) (envelope-from junho.choi@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qt1-x832.google.com with SMTP id d75a77b69052e-41cb615c6fbso39408561cf.1; Tue, 07 Nov 2023 13:44:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1699393499; x=1699998299; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=cKjKycmCuwqKI1xXH8lqXK79cIOIeuXgxokPU8J1Yl0=; b=E8a9TJnwYz1n/xaI0Nf2oiZYkYz9MuF8KgNNKxbxrfRmt7PFFlrAuDWNK40CnOEeGn 0iiDMVrow0RMfE93FYWuDEkLQFZzIc9va/SKg/9LK7Lg5hZ6eh1qTV+32HYyLJMtVi4q +pw7RsOKoet/8nqibjJR3mC1bl0zTQ5m+EWpJbmkciKFNnwuOMeBCLot/ZbhIhC/5GEB x1M0RUu/n0qfoq/nyXWbIZuFMj8d9vM/Npu81kgimMokCRvEP7aae+e9Oysu+C+mq/UD YTUtOqHciJKeaYombkZvyBCzJBSSm0lkDHhb/ZaSi349nFUbbFrOvtJqsz8xP+NWkNW5 zoyA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699393499; x=1699998299; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=cKjKycmCuwqKI1xXH8lqXK79cIOIeuXgxokPU8J1Yl0=; b=FxcbvvRvwzQQYbTkEyTsGRYGK0OHIdEq3NunZXrR8Su03+ybx90xUN22wx5+3+PsTt smp3JvqNBECmxIef5DMW7mcUhLsHXGw9kSwdNWlUZaD01gGxRhryELIElrmC7WorNzax OvSSVnyuTeHoIpN/UXo5aGU6st/uVSOknHpQnJpaRtQ4r2JD8Um+SnvCLDaXZwHABYbX jzP2YwEaGgaUsZeSJftj3XK/SbBtUfr3qbNnX0osJi128/oxwZ0yTwhAuxjpy2Vp/c2f n1GMbihFZfqi+34u8K6xTTbsMNLkGdRqYrr5kgzOSL4qHmYXf+NGgVHGa4XQgLtObUCP 5HYw== X-Gm-Message-State: AOJu0Yy1uc5rgy2YSbejQWowkWSVTLDm0BDbWelT1iH7jXzafeKPGVOj b6H3roURQsPjVkSue8OtsQGSbx+kygk67QuI9tZMon0HyhE= X-Google-Smtp-Source: AGHT+IEcUVxLdmh3VLpC9K3aTaDvkgQ29QILcBtZpRAxyeuw2Bfb8y347qjCW1y2SSNOIh7rUc9cx76kAjeMj05oDFo= X-Received: by 2002:ac8:590b:0:b0:41c:cc6d:bba with SMTP id 11-20020ac8590b000000b0041ccc6d0bbamr106482qty.44.1699393498825; Tue, 07 Nov 2023 13:44:58 -0800 (PST) List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 References: <9793F40D-BA47-4F12-9F03-70C4AB0D75C7@freebsd.org> <327523F3-5122-455F-952D-65DC36A7C1B1@freebsd.org> In-Reply-To: <327523F3-5122-455F-952D-65DC36A7C1B1@freebsd.org> From: Junho Choi Date: Wed, 8 Nov 2023 06:44:22 +0900 Message-ID: Subject: Re: ftp-master rsync client issue? To: Philip Paeps Cc: admin@kr.freebsd.org, freebsd-hubs@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Queue-Id: 4SQ1wC5z08z4mtC Yes it started working again. Thanks! For a full mirror, what's the requirement? Last time I checked it's too big for me. (I have one server running, not easy to expand) Best, On Tue, Nov 7, 2023 at 4:05=E2=80=AFPM Philip Paeps wr= ote: > > On 2023-11-07 05:40:20 (+0800), Junho Choi wrote: > > On Tue, Nov 7, 2023 at 1:58=E2=80=AFAM Philip Paeps > > wrote: > >> On 2023-11-06 19:34:59 (+0800), Junho Choi wrote: > >>> I am running ftp/rsync.kr.freebsd.org and recently (not sure when it > >>> starts, but at least a few weeks) starting to see it's always full: > >> > >> Could you let me know a src address I can grep for in the ftp-master > >> logs? > > > > Source address should be 182.252.182.30 (ftp.kr.freebsd.org) > > I believe I've fixed your problem. You were hitting the wrong section > of the rsyncd.conf with tighter limits. Please let me know if you still > run into limits. > > Best wishes. > Philip > > -- > Philip Paeps > Senior Reality Engineer > Alternative Enterprises --=20 Junho Choi | https://saturnsoft.net From nobody Wed Nov 8 00:49:22 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SQ6132P7Tz4yvf7 for ; Wed, 8 Nov 2023 00:49:27 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SQ61319yKz3Rs8; Wed, 8 Nov 2023 00:49:27 +0000 (UTC) (envelope-from philip@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1699404567; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0Fp8laPf4Zl/vyr+kmnMc98b50ghffqStoLc4L6q3QE=; b=Cad+9WjgveVeZCMXh/B22ExN3STjy6d4J9xKu3ZhwezvDpVI7qFx9GH2XzNVYQ00UOjuFE tjljLaYKm7l5H3RaXYE0Loe4qUUjZ7h4XPK9FYrcmnGy9Gi0lfKsb+nTRT14pRi5Li0Fyi 1sJ+9ceBBFDdqJm9BmKiLH4wrTkriO92uH1HeV7jEZjmzHg9GB2GcyOWU1XH27eEPMtM0e sS8jiS4oVQIhat4yChm429IqvJkdiGdsCrJWvyfxNeQ6F/kPj/p8xN5mop8fT/ujWxHAf3 52lFULkLU4gXB77+sGwejeoQFpP8wloac35sj57lcFLGk8SbwqqIfq/LMFBd5A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1699404567; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=0Fp8laPf4Zl/vyr+kmnMc98b50ghffqStoLc4L6q3QE=; b=q28XcjtP5OrCkrohUNFvANUoYMEGIILoZjTiJP0Ph9uJSOkfzD2WhoVMTvFQ4dVgOuj5AA cM9mCihyuUYc+yxm0ZjNPl4+1Ws/vbQPWLxGIvPDu8Mg/iqPMS/HAZPmXnMU7/NTtN5rrc 0wFUUbKb6OCpOySj5kHFqgRuzWPRzWUJ9yoQh9UXY0ax1RYZC3r0edGariJP2OG1eW2+qO ypaCQ67ycn1PhyyuHTSw2i1v6wrDRGgc9yifPtdxzbqd8jhfGnUEcWyiohZ3QqfhTqIg1O eT6yR7kL84nnpQDn54OduwAimP9EkQrvdwPs3DMSwxobUhV0wa794/C2Uugltw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1699404567; a=rsa-sha256; cv=none; b=yQJ8ykJT44t73Pb1/tiHvO6bN5oIjL+7DlU+/ysOeH36Xd+FtmL8nuKolERycQGuP1pt3y OI70FSV0CA8VRV9iohP/2+BwJeSwxrPGdnLo54pL9Lu1SUZ001OMPcbGxmKzGqJOhIY6UY 7jWhqWrGAVh1vxOc0Pl/DF41MhTmlodPZmfUgz7gzWDXNWj/z7XrP1rLlessCvGckWSQuR nQIfhDoNEBfdIrjs+/r1sQmXGNeilsD2+6ClSmabexBETv5HZbVwMGp9SGWBZkN7DuPuFU QXGbYYtaAphFDGBF/SPRlYNVQCH0XG+Yn2hupoR44P/b110eJH2jNb3d8sqXyw== Received: from auth2-smtp.messagingengine.com (auth2-smtp.messagingengine.com [66.111.4.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: philip/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SQ61301WFzwW7; Wed, 8 Nov 2023 00:49:26 +0000 (UTC) (envelope-from philip@freebsd.org) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailauth.nyi.internal (Postfix) with ESMTP id 72EC927C005A; Tue, 7 Nov 2023 19:49:26 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Tue, 07 Nov 2023 19:49:26 -0500 X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedruddukedgvdeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffokfgjfhggtgfgsehtkehmtdertdejnecuhfhrohhmpefrhhhi lhhiphcurfgrvghpshcuoehphhhilhhiphesfhhrvggvsghsugdrohhrgheqnecuggftrf grthhtvghrnhepfeeukeekieduieeludethedtieevueefleehtefgkeeigfelfeeigeef keefgfeunecuffhomhgrihhnpehfrhgvvggsshgurdhorhhgnecuvehluhhsthgvrhfuih iivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepphhhihhlihhpodhmvghsmhhtphgr uhhthhhpvghrshhonhgrlhhithihqdduudeiiedviedvgeekqddvfeehudektddtkedqph hhihhlihhppeepfhhrvggvsghsugdrohhrghesthhrohhusghlvgdrihhs X-ME-Proxy: Feedback-ID: ia691475d:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Tue, 7 Nov 2023 19:49:25 -0500 (EST) From: Philip Paeps To: Junho Choi Cc: admin@kr.freebsd.org, freebsd-hubs@freebsd.org Subject: Re: ftp-master rsync client issue? Date: Wed, 08 Nov 2023 08:49:22 +0800 X-Mailer: MailMate (1.14r5998) Message-ID: <816C7FD5-A139-47DC-A45E-0D53FC3DB8A5@freebsd.org> In-Reply-To: References: <9793F40D-BA47-4F12-9F03-70C4AB0D75C7@freebsd.org> <327523F3-5122-455F-952D-65DC36A7C1B1@freebsd.org> List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 2023-11-08 05:44:22 (+0800), Junho Choi wrote: > On Tue, Nov 7, 2023 at 4:05 PM Philip Paeps > wrote: >> On 2023-11-07 05:40:20 (+0800), Junho Choi wrote: >>> On Tue, Nov 7, 2023 at 1:58 AM Philip Paeps wrote: >>>> On 2023-11-06 19:34:59 (+0800), Junho Choi wrote: >>>>> I am running ftp/rsync.kr.freebsd.org and recently (not sure when >>>>> it >>>>> starts, but at least a few weeks) starting to see it's always >>>>> full: >>>> >>>> Could you let me know a src address I can grep for in the >>>> ftp-master >>>> logs? >>> >>> Source address should be 182.252.182.30 (ftp.kr.freebsd.org) >> >> I believe I've fixed your problem. You were hitting the wrong >> section >> of the rsyncd.conf with tighter limits. Please let me know if you >> still >> run into limits. > > Yes it started working again. Thanks! Hooray! > For a full mirror, what's the requirement? Last time I checked it's > too big for me. (I have one server running, not easy to expand) Still too big for you in that case, I think. ;-) We can do single-machine installations, but the machine has to be very beefy. pkg alone currently needs about 10TB on disk on average, and a bit more during times we have to support three stable/X branches plus main. The workload also wants 100+GB memory for ZFS to keep up. But no worries. As I wrote earlier: you're well connected to Japan, where we have two full multi-machine installations (AS9597 and AS7530). Thanks again for keeping ftp.kr.freebsd.org up! Best wishes. Philip -- Philip Paeps Senior Reality Engineer Alternative Enterprises From nobody Wed Nov 8 13:13:18 2023 X-Original-To: freebsd-hubs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SQQX50JdKz50Ttk for ; Wed, 8 Nov 2023 13:13:57 +0000 (UTC) (envelope-from junho.choi@gmail.com) Received: from mail-qt1-x82a.google.com (mail-qt1-x82a.google.com [IPv6:2607:f8b0:4864:20::82a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SQQX45D74z3fWH; Wed, 8 Nov 2023 13:13:56 +0000 (UTC) (envelope-from junho.choi@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qt1-x82a.google.com with SMTP id d75a77b69052e-41cd1fe4645so40799691cf.0; Wed, 08 Nov 2023 05:13:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1699449235; x=1700054035; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=p2fqOdpegli7RS3QTo1pBC3asBKRmuG7c1799q4ccR8=; b=WuHoUFG9gmEX1WIBS3MDAOElhGDqt175omHih22DsP55ECpRoVwOA1249++BLV0wg0 1vLEFD3OBf2dlw+JDkjEQnDhcc/uoqdgBAGjQ0pvx9pFFYrsoFMe04CfkLQGevzES2IB anTVp+nC7tOY/SjrY5NUjh8A8QoMbp4/Nkaj2gKObdfYFPiOKCLJuwUQD++yZNJ0InEN /a64Zz+7PIPOMpTr+u89ueG2VxeYuxzeT1i3l+FPZVtUClAOuBSOqmGjNbeSuTfph7gr A140/S6pcnIWryjHK6fUmAn7KEyyyXazAZoI3fvlNHBUX0GKW62lyAGoRl+YszbO3Moz OOjA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699449235; x=1700054035; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=p2fqOdpegli7RS3QTo1pBC3asBKRmuG7c1799q4ccR8=; b=oajQLohUENA2od3OBdKRJExckn9ES3cV3w2wZ08OZGNaO4lhanvEnhyBhJLsgv8/AM /8jzPO07Mn4bozf/mo3ErFLW0AJyePUd8EH8LeA/vZw8NcKgNXsWoDJfk6D4j4PYcefI dqXYolf35LkKmRqCqH1R2TAE9gmKX3ZDk4Tx2nNalgEVYMYn2TgNcOaY13D54qBZfYoh Q9vm2G/H2swlb01BhofeFAoEk9Nkke5BcbroMaSh98SbVH05h094v76jJV5lJiyn3jCY 5WVwoLpQiuxN7hXh0jIApgNdhXcOvHo5ymTb2BRgx+t5xZ0DUN4p43TciQg1bQ9H8INL uoHw== X-Gm-Message-State: AOJu0YyCNkdq2h1LmXCZ0MxuCAHD0NIDibpb4BwdR9N2hlBUtap9OqN3 p6DoSKILr5MTecxrv4jWAncQOvhsy9kLq107Uy/P36fu9ik8iA== X-Google-Smtp-Source: AGHT+IGRKVMtK62d5ySMIyDb6oBIWa49E7YWomR8JGPhmcsdboAmRS+ovpID8chMiop9uf9EWV9RxV+MQVHmMVRUkf8= X-Received: by 2002:a05:622a:244:b0:41e:24aa:81a0 with SMTP id c4-20020a05622a024400b0041e24aa81a0mr2037233qtx.62.1699449234962; Wed, 08 Nov 2023 05:13:54 -0800 (PST) List-Id: FreeBSD Distributions Hubs: mail sup ftp List-Archive: https://lists.freebsd.org/archives/freebsd-hubs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hubs@freebsd.org MIME-Version: 1.0 References: <9793F40D-BA47-4F12-9F03-70C4AB0D75C7@freebsd.org> <327523F3-5122-455F-952D-65DC36A7C1B1@freebsd.org> <816C7FD5-A139-47DC-A45E-0D53FC3DB8A5@freebsd.org> In-Reply-To: <816C7FD5-A139-47DC-A45E-0D53FC3DB8A5@freebsd.org> From: Junho Choi Date: Wed, 8 Nov 2023 22:13:18 +0900 Message-ID: Subject: Re: ftp-master rsync client issue? To: Philip Paeps Cc: admin@kr.freebsd.org, freebsd-hubs@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[] X-Rspamd-Queue-Id: 4SQQX45D74z3fWH Philip, Thanks for your help. Now rsync is connecting but getting slow and almost stopped after a few minutes: $ /usr/local/bin/rsync -vaHz --delete --progress --stats ftp-master.freebsd.org::FreeBSD/ /FreeBSD/ =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D This is the FreeBSD master archive for the ftp area /pub/FreeBSD It is available for primary mirrors in order to ensure rapid archive updates and distribution. rsync -vaHz --delete rsync://ftp-master.freebsd.org/FreeBSD/ ~ftp/pub/FreeB= SD/ Contact information etc: http://www.FreeBSD.org/doc/en/articles/hubs/ =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D ******** MINIMUM RSYNC VERSION REQUIRED =3D 3.00 (prefer 3.1.0+) ****= ***** =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D receiving incremental file list ./ TIMESTAMP 35 100% 34.18kB/s 0:00:00 (xfr#1, ir-chk=3D1006/1013) dir.sizes 3,110 100% 337.46kB/s 0:00:00 (xfr#2, ir-chk=3D1005/1013) development/ development/TIMESTAMP 35 100% 3.42kB/s 0:00:00 (xfr#3, ir-chk=3D1027/1041) development/tarballs/ development/tarballs/doc_main.tar.gz 851,895 0% 392.42kB/s 0:04:33 ^C^C Latency is high (expected) and no obvious loss. > ping -c 10 ftp-master.freebsd.org PING ftp-master.freebsd.org (96.47.72.39): 56 data bytes 64 bytes from 96.47.72.39: icmp_seq=3D0 ttl=3D50 time=3D206.468 ms 64 bytes from 96.47.72.39: icmp_seq=3D1 ttl=3D50 time=3D205.864 ms 64 bytes from 96.47.72.39: icmp_seq=3D2 ttl=3D50 time=3D205.773 ms 64 bytes from 96.47.72.39: icmp_seq=3D3 ttl=3D50 time=3D205.814 ms 64 bytes from 96.47.72.39: icmp_seq=3D4 ttl=3D50 time=3D205.780 ms 64 bytes from 96.47.72.39: icmp_seq=3D5 ttl=3D50 time=3D205.958 ms 64 bytes from 96.47.72.39: icmp_seq=3D6 ttl=3D50 time=3D205.775 ms 64 bytes from 96.47.72.39: icmp_seq=3D7 ttl=3D50 time=3D205.817 ms 64 bytes from 96.47.72.39: icmp_seq=3D8 ttl=3D50 time=3D206.643 ms 64 bytes from 96.47.72.39: icmp_seq=3D9 ttl=3D50 time=3D205.772 ms --- ftp-master.freebsd.org ping statistics --- 10 packets transmitted, 10 packets received, 0.0% packet loss round-trip min/avg/max/stddev =3D 205.772/205.966/206.643/0.302 ms I used to sync with ftp-master all the time before this connection issue. I can sync with other mirrors (e.g. ftp.jp) so probably not a network issue here. Any help appreciated. Best, On Wed, Nov 8, 2023 at 9:49=E2=80=AFAM Philip Paeps wr= ote: > > On 2023-11-08 05:44:22 (+0800), Junho Choi wrote: > > On Tue, Nov 7, 2023 at 4:05=E2=80=AFPM Philip Paeps > > wrote: > >> On 2023-11-07 05:40:20 (+0800), Junho Choi wrote: > >>> On Tue, Nov 7, 2023 at 1:58=E2=80=AFAM Philip Paeps wrote: > >>>> On 2023-11-06 19:34:59 (+0800), Junho Choi wrote: > >>>>> I am running ftp/rsync.kr.freebsd.org and recently (not sure when > >>>>> it > >>>>> starts, but at least a few weeks) starting to see it's always > >>>>> full: > >>>> > >>>> Could you let me know a src address I can grep for in the > >>>> ftp-master > >>>> logs? > >>> > >>> Source address should be 182.252.182.30 (ftp.kr.freebsd.org) > >> > >> I believe I've fixed your problem. You were hitting the wrong > >> section > >> of the rsyncd.conf with tighter limits. Please let me know if you > >> still > >> run into limits. > > > > Yes it started working again. Thanks! > > Hooray! > > > For a full mirror, what's the requirement? Last time I checked it's > > too big for me. (I have one server running, not easy to expand) > > Still too big for you in that case, I think. ;-) > > We can do single-machine installations, but the machine has to be very > beefy. pkg alone currently needs about 10TB on disk on average, and a > bit more during times we have to support three stable/X branches plus > main. The workload also wants 100+GB memory for ZFS to keep up. > > But no worries. As I wrote earlier: you're well connected to Japan, > where we have two full multi-machine installations (AS9597 and AS7530). > > Thanks again for keeping ftp.kr.freebsd.org up! > > Best wishes. > Philip > > -- > Philip Paeps > Senior Reality Engineer > Alternative Enterprises --=20 Junho Choi | https://saturnsoft.net