From owner-freebsd-hackers@freebsd.org  Mon Apr 29 19:56:31 2019
Return-Path: <owner-freebsd-hackers@freebsd.org>
Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id C4F32159B9D3
 for <freebsd-hackers@mailman.ysv.freebsd.org>;
 Mon, 29 Apr 2019 19:56:31 +0000 (UTC)
 (envelope-from eugen@grosbein.net)
Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13::5])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "eg.sd.rdtc.ru", Issuer "eg.sd.rdtc.ru" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id B0DF26FEF8
 for <freebsd-hackers@freebsd.org>; Mon, 29 Apr 2019 19:56:30 +0000 (UTC)
 (envelope-from eugen@grosbein.net)
X-Envelope-From: eugen@grosbein.net
X-Envelope-To: freebsd-hackers@freebsd.org
Received: from [10.58.0.4] ([10.58.0.4])
 by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id x3TJuPTR097409
 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT);
 Tue, 30 Apr 2019 02:56:25 +0700 (+07)
 (envelope-from eugen@grosbein.net)
Subject: Re: very low performance tcp/rsh
To: Wojciech Puchar <wojtek@puchar.net>
References: <alpine.BSF.2.20.1904292028400.48623@puchar.net>
 <ef440d5f-c543-148a-4e68-44b0bc62b28f@grosbein.net>
 <alpine.BSF.2.20.1904292111080.57162@puchar.net>
Cc: freebsd-hackers@freebsd.org
From: Eugene Grosbein <eugen@grosbein.net>
Message-ID: <cb76aa41-1472-5df1-5b24-384f6453f3de@grosbein.net>
Date: Tue, 30 Apr 2019 02:56:20 +0700
User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101
 Thunderbird/45.8.0
MIME-Version: 1.0
In-Reply-To: <alpine.BSF.2.20.1904292111080.57162@puchar.net>
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: 7bit
X-Rspamd-Queue-Id: B0DF26FEF8
X-Spamd-Bar: /
Authentication-Results: mx1.freebsd.org;
 spf=permerror (mx1.freebsd.org: domain of eugen@grosbein.net uses mechanism
 not recognized by this client) smtp.mailfrom=eugen@grosbein.net
X-Spamd-Result: default: False [-0.45 / 15.00]; ARC_NA(0.00)[];
 NEURAL_HAM_MEDIUM(-0.86)[-0.859,0]; MX_INVALID(0.50)[cached];
 FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[];
 NEURAL_SPAM_SHORT(0.61)[0.609,0];
 NEURAL_HAM_LONG(-0.60)[-0.602,0]; MIME_GOOD(-0.10)[text/plain];
 DMARC_NA(0.00)[grosbein.net]; TO_MATCH_ENVRCPT_SOME(0.00)[];
 R_SPF_PERMFAIL(0.00)[]; RCPT_COUNT_TWO(0.00)[2];
 IP_SCORE(0.00)[country: RU(0.00)]; FROM_EQ_ENVFROM(0.00)[];
 R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+];
 ASN(0.00)[asn:29072, ipnet:2a03:3100::/32, country:RU];
 MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[];
 RCVD_COUNT_TWO(0.00)[2]
X-BeenThere: freebsd-hackers@freebsd.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: Technical Discussions relating to FreeBSD
 <freebsd-hackers.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-hackers>, 
 <mailto:freebsd-hackers-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-hackers/>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Help: <mailto:freebsd-hackers-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-hackers>, 
 <mailto:freebsd-hackers-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 29 Apr 2019 19:56:31 -0000

30.04.2019 2:22, Wojciech Puchar wrote:

> create 32GB hole-file
> 
> dd if=/dev/zero of=test bs=32k seek=1m count=0
> 
> fetch -o /dev/null over ftp (proftpd) gives 1.4GB/s
> 
> proftpd consumed 100% of single core. much better.
> 
> tested with FreeBSD ftpd  - 1.7GB/s
> 
> seems like freebsd can saturate 10Gb/s ethernet with single core (Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz)
> 
> 
> Still where is the most overhead? one memcopy to packet buffers+creating packet headers (send).
> 
> reception is on separate process taking another core.
> 
> 
> still - quite good. But compared to filesystem overhead - large.

Do not use file with holes (holes require special processing taking lots of CPU cycles).
Create ordinary file within RAM disk and use sock ftp daemon for sake of sendfile().