From owner-freebsd-hackers@freebsd.org Sun Jan 19 18:32:59 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5ED702219F8 for ; Sun, 19 Jan 2020 18:32:59 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: from puchar.net (puchar.net [194.1.144.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4813MF38B8z4YDV for ; Sun, 19 Jan 2020 18:32:57 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: Received: from 127.0.0.1 (localhost [127.0.0.1]) by puchar.net (8.15.2/8.15.2) with ESMTPS id 00JIWr14018348 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Sun, 19 Jan 2020 19:32:54 +0100 (CET) (envelope-from puchar-wojtek@puchar.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=puchar.net; s=default; t=1579458774; bh=E8yj3QoBlTT4rv8BGo3vigT9MwOXEUHfcWFd1DcPAoA=; h=Date:From:To:Subject; b=X89gTJ2UDb3UVuNXWPEK9PkaQzrdBl93/CJzNdG1ca8fDcwhj2WFaxNQ4qhVQ7pHK CEjRLic1NtjVGmKwfN4jF489lSlALPq1GTDb97FsSHeUAXmQ4PRlx78bjsUHQ79ayw lumjxZ3WEq3E+Hut+zN3Fd05pTP0rb7329drEKTE= Received: from localhost (puchar-wojtek@localhost) by puchar.net (8.15.2/8.15.2/Submit) with ESMTP id 00JIWr1U018345 for ; Sun, 19 Jan 2020 19:32:53 +0100 (CET) (envelope-from puchar-wojtek@puchar.net) Date: Sun, 19 Jan 2020 19:32:53 +0100 (CET) From: Wojciech Puchar To: freebsd-hackers@freebsd.org Subject: slow directory operation on huge dirs Message-ID: User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-Rspamd-Queue-Id: 4813MF38B8z4YDV X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=fail (rsa verify failed) header.d=puchar.net header.s=default header.b=X89gTJ2U; dmarc=none; spf=pass (mx1.freebsd.org: domain of wojtek@puchar.net designates 194.1.144.90 as permitted sender) smtp.mailfrom=wojtek@puchar.net X-Spamd-Result: default: False [-3.46 / 15.00]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_REJECT(1.00)[puchar.net:s=default]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; DMARC_NA(0.00)[puchar.net]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[puchar.net:-]; RCVD_IN_DNSWL_NONE(0.00)[90.144.1.194.list.dnswl.org : 127.0.10.0]; IP_SCORE(-2.66)[ip: (-7.03), ipnet: 194.1.144.0/24(-3.52), asn: 43476(-2.81), country: PL(0.07)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:43476, ipnet:194.1.144.0/24, country:PL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 Jan 2020 18:32:59 -0000 i have UFS_DIRHASH enabled and enough large dirhash_maxmem yet when there is heavy I/O on large directory (like dovecot indexing so it reads every file) it randomly works fast or slow. Most often slow. Whole system slows down, and system cpu usage gets above 50% on quad core Xeon. lowering maxvnodes from 500000 to 100000 "fixes" the problem. what is going on here? 11.3-STABLE from maybe 2 weeks ago.