From nobody Fri Sep 30 19:52:03 2022 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MfLV90cPcz4YGmc for ; Fri, 30 Sep 2022 19:52:17 +0000 (UTC) (envelope-from pprocacci@gmail.com) Received: from mail-oi1-x236.google.com (mail-oi1-x236.google.com [IPv6:2607:f8b0:4864:20::236]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MfLV80zBJz3MtH for ; Fri, 30 Sep 2022 19:52:16 +0000 (UTC) (envelope-from pprocacci@gmail.com) Received: by mail-oi1-x236.google.com with SMTP id o64so5745423oib.12 for ; Fri, 30 Sep 2022 12:52:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date; bh=rFVAC9L4VGh6f8D3j2Q0BG1EDtlHVZtY/nHnNdVPNQI=; b=ahbCqPYeSYJfrW/M+KpNz/6cA7Lkz+wgwqlxjSsTe9Q/Z7zwB/7obufqGS00E9YwVW ahP3fs9AZAva08ytftyaqTEA4nIcHCkHW/xGNZ7bzA9waXlN6e99kymO5IcL/F8ZSbwJ drBwJ0ohLjWiBOgI5KypX7jYzUkW6Asx1+cO91P+sLiFDVlmG3kBDa/W75Kj6WMza2sd S/RTg31npWmP3FySzS+uRUS8vW/W2gjRmh6i3X/Y/3+b14yD71ZN+cQYXjEwZlwzJf8T na3SyWCfcMf9TY1t9h2QPIpuDYgrU/sfUwowCj/0ueTEz2S0gzKu+2J1t/MAVzuXPaAO Qk0g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date; bh=rFVAC9L4VGh6f8D3j2Q0BG1EDtlHVZtY/nHnNdVPNQI=; b=ZNR7LaBpczsi6WaPrMspLKoNWQEgxehS5lpYnI0cZX1J2tBbQCGzxl+wMCPN5ov+VY BRQ2GP7ELxBXt+s5ab3ws8kwUSZjHE6y/uX/BGLyEC6aVmSZV+4ynCyU1K/5zjFTlGn/ eh6k1Tqaq9XRewYVcUv+W6LhDNwV8OkrwEwdFWB7QkL7KzZDUQI2Q4+TKWjdqx/dNVSq KhwOz3BqXrsMTh57NwHhZW8+mPHQqmBDNsBiD7JClFhmnl2lqKdxoQrgGZuKb1CeQx2D 6teXh1PwKqcCtHCRgyncnHnzNu6qk3nCaBdwa1vlTKX8hEwVozPTnxdfFIbvL7EPASYN j05g== X-Gm-Message-State: ACrzQf1FOtPDnMNOtPdiJCZwh8Y/6B5pIqRKz/t+zNrEvJdKV1niAtoV jBvyDDDG/e3WdBBof9Y0oE9KU8tDVfX3kl+fkvjTdeSihQ== X-Google-Smtp-Source: AMsMyM6vkbgnrptRCtzkvY4T70y1dz7yWu94bPqNpVggsJMo/3L1+5wVv21ZOqejBI1kLeaksL/rWU147Swtkx6z0sc= X-Received: by 2002:a05:6808:13d0:b0:34f:f370:b581 with SMTP id d16-20020a05680813d000b0034ff370b581mr9512359oiw.148.1664567535059; Fri, 30 Sep 2022 12:52:15 -0700 (PDT) List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 References: <20220930200244.31d71c489812fd26c0d39769@sohara.org> In-Reply-To: From: Paul Procacci Date: Fri, 30 Sep 2022 15:52:03 -0400 Message-ID: Subject: Re: mkdir error message -- what does this mean? To: Aryeh Friedman Cc: "Steve O'Hara-Smith" , "freebsd-questions@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000a1c70105e9ea5455" X-Rspamd-Queue-Id: 4MfLV80zBJz3MtH X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20210112 header.b=ahbCqPYe; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of pprocacci@gmail.com designates 2607:f8b0:4864:20::236 as permitted sender) smtp.mailfrom=pprocacci@gmail.com X-Spamd-Result: default: False [-2.99 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.991]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20210112]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; TAGGED_RCPT(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::236:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; MLMMJ_DEST(0.00)[questions@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --000000000000a1c70105e9ea5455 Content-Type: text/plain; charset="UTF-8" Hey Aryeh, You can still retain the files, but you just need to organize them in a fashion in which the parent (or otherwise) doesn't reach the limit. I'd suggest the easiest way is organizing them by year or even going a bit more fine tuned like parent/year/month/day ... or maybe even parent/archive/year/month ... or .... you get the idea. There are many ways to skin this cat. Regardless of what you decide, you now know there's a limit and can conceivably determine the best way of fixing it. ;) Thanks, Paul Procacci On Fri, Sep 30, 2022 at 3:21 PM Aryeh Friedman wrote: > On Fri, Sep 30, 2022 at 3:03 PM Steve O'Hara-Smith > wrote: > > > > On Fri, 30 Sep 2022 14:48:09 -0400 > > Paul Procacci wrote: > > > > > 31 EMLINK Too many links. Maximum allowable hard links to a single > > > file has been exceeded (limit of 32767 hard links per file). > > > > > > I betcha the parent directory has at least this many number of objects > in > > > it. > > > > DIRHASH has a lot to answer for, time was we'd jump through hoops > > when writing applications to avoid having huge numbers of files in a > > directory, now nobody notices any problems until they hit the limit. > > To make matters worse many modern apps have a legal requirement to > retain files. The offending app is a medical records system that has > a minimal retention requirements for most of the files of 18 months > and some files as long as 7 years (the offending files where in the > second category since they are the "physical" proscription from a > doctor [the system has several hundred doctors spread over 50 or so > orgs). Note it took 8 years of moderate to heavy use to hit this > limit and it was only because we never wrote any code to delete > emptied out dirs. > > > > -- > > Steve O'Hara-Smith > > > > > -- > Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org > > -- __________________ :(){ :|:& };: --000000000000a1c70105e9ea5455 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hey Aryeh,

You can still ret= ain the files, but you just need to organize them in a fashion in which the= parent (or otherwise) doesn't reach the limit.
I'd s= uggest the easiest way is organizing them by year or even going a bit more = fine tuned like parent/year/month/day ... or maybe even parent/archive/year= /month ... or .... you get the idea.=C2=A0 There are many ways to skin this= cat.
Regardless of what you decide, you now know there's a limit an= d can conceivably determine the best way of fixing it.=C2=A0 ;)

Thanks,
Paul Procacci

On Fri, Sep 30, = 2022 at 3:21 PM Aryeh Friedman <aryeh.friedman@gmail.com> wrote:
On Fri, Sep 30, 2022 at 3:03 PM Steve O'Har= a-Smith <steve@soh= ara.org> wrote:
>
> On Fri, 30 Sep 2022 14:48:09 -0400
> Paul Procacci <pprocacci@gmail.com> wrote:
>
> >=C2=A0 =C2=A0 =C2=A0 31 EMLINK Too many links. Maximum allowable h= ard links to a single
> > file has been exceeded (limit of 32767 hard links per file).
> >
> > I betcha the parent directory has at least this many number of ob= jects in
> > it.
>
>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0DIRHASH has a lot to answer for, time= was we'd jump through hoops
> when writing applications to avoid having huge numbers of files in a > directory, now nobody notices any problems until they hit the limit.
To make matters worse many modern apps have a legal requirement to
retain files.=C2=A0 The offending app is a medical records system that has<= br> a minimal retention requirements for most of the files of 18 months
and some files as long as 7 years (the offending files where in the
second category since they are the "physical" proscription from a=
doctor [the system has several hundred doctors spread over 50 or so
orgs).=C2=A0 Note it took 8 years of moderate to heavy use to hit this
limit and it was only because we never wrote any code to delete
emptied out dirs.
>
> --
> Steve O'Hara-Smith <steve@sohara.org>
>


--
Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org



--
__________________

:(){ :|:& };:
--000000000000a1c70105e9ea5455--