From owner-freebsd-hackers@freebsd.org Thu Jan 23 11:45:36 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7F0F2236718 for ; Thu, 23 Jan 2020 11:45:36 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: from puchar.net (puchar.net [194.1.144.90]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 483L7M2CHNz4WTh for ; Thu, 23 Jan 2020 11:45:34 +0000 (UTC) (envelope-from wojtek@puchar.net) Received: Received: from 127.0.0.1 (localhost [127.0.0.1]) by puchar.net (8.15.2/8.15.2) with ESMTPS id 00NBjSnb098758 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Thu, 23 Jan 2020 12:45:29 +0100 (CET) (envelope-from puchar-wojtek@puchar.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=puchar.net; s=default; t=1579779929; bh=VeP8sSxtZUaIvPd6FiHqiTvp4ruVJQSwMiDsZXpS/Wo=; h=Date:From:To:cc:Subject:In-Reply-To:References; b=Rq+lw1YGiFiwWvh1BFrAkVvA8NifUAiV76Tkk6T9uzRpJbOX/HzpHV0P0+WJqxHe7 T5N+rWE9AKbKpkapzdfIiehiAyC9TssD/giLFB3Jl/8CvyyMxupUv/UCp3bgSH4WnZ uRsoJ4tx4Lil1G5Miw4NJffQRXEVCeqQ7LYT1/d0= Received: from localhost (puchar-wojtek@localhost) by puchar.net (8.15.2/8.15.2/Submit) with ESMTP id 00NBjSHA098754; Thu, 23 Jan 2020 12:45:28 +0100 (CET) (envelope-from puchar-wojtek@puchar.net) Date: Thu, 23 Jan 2020 12:45:28 +0100 (CET) From: Wojciech Puchar To: Wojciech Puchar cc: freebsd-hackers@freebsd.org Subject: Re: slow directory operation on huge dirs In-Reply-To: Message-ID: References: User-Agent: Alpine 2.20 (BSF 67 2015-01-07) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 483L7M2CHNz4WTh X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=fail (rsa verify failed) header.d=puchar.net header.s=default header.b=Rq+lw1YG; dmarc=none; spf=pass (mx1.freebsd.org: domain of wojtek@puchar.net designates 194.1.144.90 as permitted sender) smtp.mailfrom=wojtek@puchar.net X-Spamd-Result: default: False [-3.45 / 15.00]; ARC_NA(0.00)[]; SUBJECT_ENDS_SPACES(0.50)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_REJECT(1.00)[puchar.net:s=default]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[puchar.net]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[puchar.net:-]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[90.144.1.194.list.dnswl.org : 127.0.10.0]; IP_SCORE(-2.65)[ip: (-7.00), ipnet: 194.1.144.0/24(-3.50), asn: 43476(-2.80), country: PL(0.07)]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:43476, ipnet:194.1.144.0/24, country:PL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2020 11:45:36 -0000 On Sun, 19 Jan 2020, Wojciech Puchar wrote: > i have UFS_DIRHASH enabled and enough large dirhash_maxmem > yet when there is heavy I/O on large directory (like dovecot indexing so it > reads every file) it randomly works fast or slow. Most often slow. > Whole system slows down, and system cpu usage gets above 50% on quad core > Xeon. > > lowering maxvnodes from 500000 to 100000 "fixes" the problem. > > what is going on here? > > 11.3-STABLE from maybe 2 weeks ago. > nobody have idea what's the problem?