Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 9 Aug 2023 14:49:48 +0200
From:      Juraj Lutter <otis@FreeBSD.org>
To:        void <void@f-m.fm>
Cc:        freebsd-hackers@freebsd.org
Subject:   Re: can sftp be made multi-threaded?
Message-ID:  <3639ADD0-3715-4B2B-9C25-EBF367FC09A0@FreeBSD.org>
In-Reply-To: <ZNOJUfIHGtY9lLpg@int21h>
References:  <ZNOJUfIHGtY9lLpg@int21h>

next in thread | previous in thread | raw e-mail | index | archive | help


> On 9 Aug 2023, at 14:40, void <void@f-m.fm> wrote:
>=20
> Hello hackers@
>=20
> Can sftp be made multi-threaded? Would rsync-over-ssh accomplish the =
same thing?
>=20
> The issue I'm having is with large backups taking ages to transfer
> even with both source and destination being on gigabit fibre.
>=20
> It looks like sftp is single-threaded and the bandwidth per thread is
> something like 5-50 Mbps and it's nowhere near saturating the =
bandwidth. Would multi-threaded sftp (if it were possible)
> or rsync-over-ssh work multi-threaded on a single huge backup file?

Have you played with misc/mbuffer from ports? It might do what you are =
looking for (provided that sftp alone isn=E2=80=99t sufficient).


=E2=80=94
Juraj Lutter
otis@FreeBSD.org




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3639ADD0-3715-4B2B-9C25-EBF367FC09A0>