From owner-freebsd-hackers@freebsd.org Tue Feb 18 19:51:47 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 792212448CA for ; Tue, 18 Feb 2020 19:51:47 +0000 (UTC) (envelope-from rahul.dshmkh1@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 48MWhM12HYz3DWw for ; Tue, 18 Feb 2020 19:51:47 +0000 (UTC) (envelope-from rahul.dshmkh1@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 20BBD2448C9; Tue, 18 Feb 2020 19:51:47 +0000 (UTC) Delivered-To: hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1BA8E2448C8 for ; Tue, 18 Feb 2020 19:51:47 +0000 (UTC) (envelope-from rahul.dshmkh1@gmail.com) Received: from mail-il1-x12d.google.com (mail-il1-x12d.google.com [IPv6:2607:f8b0:4864:20::12d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48MWhJ0CpSz3DTw for ; Tue, 18 Feb 2020 19:51:43 +0000 (UTC) (envelope-from rahul.dshmkh1@gmail.com) Received: by mail-il1-x12d.google.com with SMTP id f5so18445584ilq.5 for ; Tue, 18 Feb 2020 11:51:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9Qwk3Hm+RD3HYkQDtkz6undaTVEfbbwo6iVSWC/BciM=; b=h+3TbM/sxIwUs+ytOlwh/56TXKGVOpq0kIS9b5OEH3f1ObQQMMfVB2wBG/cv0qeu0I syYQh5fYK/BC9WzK75QX599GHwLV12oXdGcXGKQ/rtaOCeUV4WIf5T1n/M8opwuSDn1H pN9LuUPyer0UW7eBG6Zwe+AIxXxIwe7NSJfAFj7o+tYEqgWVk4CZb8AkpMDc0/76fKGz 2PiMonbhnLdHCUtJmRqdC8YkxzAth21QqToWXZdXqBrP3EPsQRO/6Zgf94qZ9uGYDtUq zjh4zXA78EVm/r+UWcNPq87KSGPJKiWYGUDGzYeQwb9/I3r/WK1hmiXMxx0u+wKernMi K/Jw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9Qwk3Hm+RD3HYkQDtkz6undaTVEfbbwo6iVSWC/BciM=; b=nv5p0lnybcKhjyk84JJWUFRS2fg19jBnQ2FSOIOG0whLUsEeT9HqyqMmnAO3EFjkFZ fmC9tAPW9JVF/72FRg7/jQz8kNNc64F4kPGiMz1eXcJ0/Cq6yDODj4H31UDL0rw0jsyd kjVegwVv27GVFgoiQnbab7U2osWDS4y2j9D599i/wB/glJlByIQ9NlltgG6NN3hR7BGx xh4EhalRcQ1icmk7Tld0O60VTjyOmzUe2yVd9bGYTSlWHVFFuRhklF8So2KlNLJukKBR ZVj1SbuhhNRwnGk2MPNzpbrjk7U5oCY5yJM2zKEq00DjcoW8bzI996ZAE/uDHrvtLNYv 2ilg== X-Gm-Message-State: APjAAAVnnIbNeQDgrTOpd5xDvY0Wh5UBYCA1GZ65vW/cywuYxDjoY6y0 M+oY8d61PsJopXRnT8HzhY3HTjjIwCE1Hu9oBw== X-Google-Smtp-Source: APXvYqyloZlzLT63L+WE/P7JS6dm55YmF/2BwFpz9EZ3seMkK3RLg96qaNOiSRVFGf4qiB9dFvQXxQcKGoaLBXUNa/A= X-Received: by 2002:a05:6e02:5cb:: with SMTP id l11mr19978773ils.307.1582055503206; Tue, 18 Feb 2020 11:51:43 -0800 (PST) MIME-Version: 1.0 References: <96840ED1-2F2C-4EF6-8BD5-6B7DEF1CB9B6@gmail.com> In-Reply-To: From: rahul deshmukh Date: Wed, 19 Feb 2020 01:21:30 +0530 Message-ID: Subject: Re: Rsync copy tuneable To: Nick Wolff Cc: hackers@freebsd.org X-Rspamd-Queue-Id: 48MWhJ0CpSz3DTw X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=h+3TbM/s; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rahuldshmkh1@gmail.com designates 2607:f8b0:4864:20::12d as permitted sender) smtp.mailfrom=rahuldshmkh1@gmail.com X-Spamd-Result: default: False [-2.00 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; URI_COUNT_ODD(1.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (-8.58), ipnet: 2607:f8b0::/32(-1.89), asn: 15169(-1.68), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; TAGGED_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[hackers@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[d.2.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Feb 2020 19:51:47 -0000 I can bypass storage gateway using rclone i believe based as per initial reading, is it better than aws s3 cli? Will give it a try tomorrow. -Rdx On Wed, Feb 19, 2020, 1:09 AM rahul deshmukh wrote: > Hi Nick, > > I would be using aws storage gateway as nfs mount point on my host to > perform the rsync. > > I will certainly look into it rclone. Thank you. > > Regards, > Rdx > > On Wed, Feb 19, 2020, 1:04 AM Nick Wolff wrote: > >> You probably want to look at rclone to copy the data to use a properly >> object aware method that is parallel. >> >> How were you planning on using rsync to do the migration? >> >> Thanks, >> >> Nick Wolff >> >> On Tue, Feb 18, 2020 at 2:16 PM rahul deshmukh >> wrote: >> >>> Hello hackers, >>> I have one question, I am planning to copy date from onprem to AWS S3 >>> using Rsync do I need tune any kernel parameters to optimise copy process >>> in FreeBSD or defaults are suffice? Any other suggestions will be helpful. >>> >>> Regards, >>> Rdx >>> >>> Sent from my iPad >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to " >>> freebsd-hackers-unsubscribe@freebsd.org" >>> >>