From owner-freebsd-hackers@freebsd.org Thu Jan 23 18:42:48 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C89DA1FA305 for ; Thu, 23 Jan 2020 18:42:48 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from smtp-out-so.shaw.ca (smtp-out-so.shaw.ca [64.59.136.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 483WNl5Sxzz3yRr for ; Thu, 23 Jan 2020 18:42:47 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from spqr.komquats.com ([70.67.125.17]) by shaw.ca with ESMTPA id uhRBiXnQk17ZDuhRDinaQJ; Thu, 23 Jan 2020 11:42:45 -0700 X-Authority-Analysis: v=2.3 cv=ZsqT1OzG c=1 sm=1 tr=0 a=VFtTW3WuZNDh6VkGe7fA3g==:117 a=VFtTW3WuZNDh6VkGe7fA3g==:17 a=jpOVt7BSZ2e4Z31A5e1TngXxSK0=:19 a=IkcTkHD0fZMA:10 a=Jdjhy38mL1oA:10 a=_8di5KHbAAAA:8 a=6I5d2MoRAAAA:8 a=YxBL1-UpAAAA:8 a=lI3h0bHuk6_Q36RTsWsA:9 a=QEXdDO2ut3YA:10 a=z0NWOAd74rtbdv5dRerE:22 a=IjZwj45LgO3ly-622nXo:22 a=Ia-lj3WSrqcvXOmTRaiG:22 Received: from Resas-iPad.esitwifi.local (S0106788a207e2972.gv.shawcable.net [70.66.154.233]) by spqr.komquats.com (Postfix) with ESMTPSA id 81C2D330; Thu, 23 Jan 2020 10:42:40 -0800 (PST) Date: Thu, 23 Jan 2020 10:22:54 -0800 User-Agent: K-9 Mail for Android In-Reply-To: <7685f996-c1b8-e11b-aaf6-b59c001ce226@sentex.net> References: <9b426949-be87-106a-46c3-f1b6a2e5bb83@quip.cz> <7685f996-c1b8-e11b-aaf6-b59c001ce226@sentex.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: slow directory operation on huge dirs To: freebsd-hackers@freebsd.org, Mike Tancsa , Wojciech Puchar , Miroslav Lachman <000.fbsd@quip.cz> From: Cy Schubert Message-ID: X-CMAE-Envelope: MS4wfIT6bhOYo8HbK5GDjdGc7KgSMFAHiF1cFf5nMTW6J3ivIJF3GjOJCl0MsF8x3mBvQbS0Jy4l0polbjnisLAURI2jcF/MZNWQ6taqGKk4NSTWoKVHS7NF pqQEUrKcC5JSKadlfD8UarhoWPA9JS2whJswvRgoc53LkeybWrneLU6iuKBUopyCv3TOFBo/WUZdgXRVsDHbQhgOjCTU9vJ3wEZ6RTyzw5Ht+f0elPoD1nKf n9I+2klPd9OBZQvB6qM9fOGPyzuiumFNdpteH5t0k9s= X-Rspamd-Queue-Id: 483WNl5Sxzz3yRr X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of cy.schubert@cschubert.com has no SPF policy when checking 64.59.136.137) smtp.mailfrom=cy.schubert@cschubert.com X-Spamd-Result: default: False [-4.58 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[137.136.59.64.rep.mailspike.net : 127.0.0.17]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[17.125.67.70.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11,233.154.66.70.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11]; R_SPF_NA(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[137.136.59.64.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6327, ipnet:64.59.128.0/20, country:CA]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(-2.38)[ip: (-6.18), ipnet: 64.59.128.0/20(-3.17), asn: 6327(-2.47), country: CA(-0.09)]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Jan 2020 18:42:48 -0000 On January 23, 2020 8:41:47 AM PST, Mike Tancsa wrote: >On 1/23/2020 1:40 PM, Wojciech Puchar wrote: >> >> first - we have DIRHASH option and i have it enabled=2E >> second - it is not just a problem of huge directory but both huge >> directory and large maxvnodes settings=2E >> >> Large directories works fast when kern=2Emaxvnodes is small and there >is >> enough dirhash_maxmem=2E >> >> it's clearly an error somewhere=2E=20 > > >Dont know about the vnodes adjustment, and its probably not related=2E >But >on our largish mail servers, we need to change the defaults in nsswitch >as ls takes forever on large directories otherwise=2E > >--- /usr/src/etc/nsswitch=2Econf=C2=A0 2019-07-10 14:46:40=2E871619000 -0= 400 >+++ /etc/nsswitch=2Econf=C2=A0 2016-01-27 14:21:30=2E400226032 -0500 >@@ -1,13 +1,12 @@ >=C2=A0# >=C2=A0# nsswitch=2Econf(5) - name service switch configuration file >-# $FreeBSD: stable/11/etc/nsswitch=2Econf 301711 2016-06-09 01:28:44Z >markj $ >+# $FreeBSD: src/etc/nsswitch=2Econf,v 1=2E1=2E10=2E1 2009/08/03 08:13:06 >kensmith Exp $ >=C2=A0# >-group: compat >+group: files >=C2=A0group_compat: nis >=C2=A0hosts: files dns >-netgroup: compat >=C2=A0networks: files >-passwd: compat >+passwd: files >=C2=A0passwd_compat: nis >=C2=A0shells: files >=C2=A0services: compat > > >=C2=A0=C2=A0=C2=A0 ---Mike > >_______________________________________________ >freebsd-hackers@freebsd=2Eorg mailing list >https://lists=2Efreebsd=2Eorg/mailman/listinfo/freebsd-hackers >To unsubscribe, send any mail to >"freebsd-hackers-unsubscribe@freebsd=2Eorg" Do you use a directory service such as ldap, nis, or a/d? --=20 Pardon the typos and autocorrect, small keyboard in use=2E=20 Cy Schubert FreeBSD UNIX: Web: https://www=2EFreeBSD=2Eorg The need of the many outweighs the greed of the few=2E Sent from my Android device with K-9 Mail=2E Please excuse my brevity=2E