From nobody Thu Nov 7 22:44:04 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xkxvh5bwyz5cm1p for ; Thu, 07 Nov 2024 22:44:16 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-ed1-x529.google.com (mail-ed1-x529.google.com [IPv6:2a00:1450:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xkxvh2HVBz4HNN; Thu, 7 Nov 2024 22:44:16 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x529.google.com with SMTP id 4fb4d7f45d1cf-5c948c41edeso1931738a12.1; Thu, 07 Nov 2024 14:44:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1731019455; x=1731624255; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=x5pTC1y5WKuwG+2+ntRQUCA4sxTsyqu48J2wE29hvc4=; b=HvDCxykMx0i0B1j2Q5Wv2wFxitlUP+TwFX1JzAEfPDOfNjGXPxbTs01RhUYG8J4iNO zUCwGCnoHFXiYGhXfWt1KpRThpjO5DVo72ZZBB99Bgs4Cp0DDbT3aPAkqiHbyYh3R0TR wrIMnytOvaxjHAwg+MhZFOxkKhqijhq1NA8wgxjVgVawLw+TmjgA+bHsG1PBz/E/RH0h U5vJw8DI5Yi6L2EoonfcRbOUuqZ149x7PVhBcEipOq0Qb1PB/VxVkiLM5Qp66z4pg5J7 9gdeLwvXktiDOlW9dd3D1AihOqvy9CTgqujpaAObli/vWbzR9e9HHkwfox5D6BIVrFog wkkw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1731019455; x=1731624255; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=x5pTC1y5WKuwG+2+ntRQUCA4sxTsyqu48J2wE29hvc4=; b=Vn8rZSskcf60xr2FhiFcnknScSGGso8xlFTK9tWSVY8cWdW9uxF6b+RdboyQjNRbaW IwXYX21IAtA2yrdO/SikHerBzhX1+TAExeiYa+L4/RyvLMN4AhP64aOCRolwybAKhF/j F582HIMbeR+0YJFk+kPioxiP5Qker1MRO4KHyXGLg+DPwiMjoXS013nqG1lEgVG5OXYM eNQxKQoIParQhVvmFZqZRJUhF2UZM7XhN9I5zX16skIqYXJ9fNKHfZ+s45N7Zam5NIAy Ah4ikRMflYHflajAecQc6//q+9JgqMbIb+1x6n6jZ86G73LiZTCvYWqPqMfTetlRXBGu So1w== X-Forwarded-Encrypted: i=1; AJvYcCUKIyOS9IzFTYZzYZ0OcG+PxPmGNyWPcKNaDuR6SvbKeA2uCETOKVSB5aHrpGkURrpr6ZiCMgy+xhmc9g==@freebsd.org X-Gm-Message-State: AOJu0YxvZeqJRvgkc+3dA+jJExba6PDe3CNUrdQmtG4DXRaXC2UKHwOW ukJzhycKLmiE5lLylNn6l77UGVSOrbfRSQ9gWt+iavaUBou9LHpf1f4ub5kqBdCHeyHua+E0Yl2 0uKdqjYwn/0o2vJQd8x3LXpSUt1BCkK0= X-Google-Smtp-Source: AGHT+IGUBvHPjFjo8mO8gIE8M9xSgaeD/OwEyzYwyZ999M8Ede9eOlPzybrgoFY12vhoQUYdKqbsQfb/YWApehDvlzA= X-Received: by 2002:a05:6402:13ca:b0:5c9:45cf:483d with SMTP id 4fb4d7f45d1cf-5cf0a323567mr395260a12.15.1731019454575; Thu, 07 Nov 2024 14:44:14 -0800 (PST) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: <7FFE3D2B-4DD9-4657-ADC1-9C40CB54991F@neville-neil.com> <8187509e-c9fb-403f-8569-28ba58425cff@FreeBSD.org> In-Reply-To: From: Rick Macklem Date: Thu, 7 Nov 2024 14:44:04 -0800 Message-ID: Subject: Re: An interesting anomaly in NFS client... To: Mark Johnston Cc: Andriy Gapon , freebsd-net@freebsd.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Xkxvh2HVBz4HNN X-Spamd-Bar: ---- On Thu, Nov 7, 2024 at 2:09=E2=80=AFPM Mark Johnston wr= ote: > > On Thu, Nov 07, 2024 at 07:28:59AM +0200, Andriy Gapon wrote: > > On 07/11/2024 02:43, George Neville-Neil wrote: > > > Howdy, > > > > > > We've been digging into an interesting possible issue in the FreeBSD = NFS > > > client. Here is the scenario. I have a FreeBSD VM on my Mac, the Mac = is > > > the NFS server, the VM is the client. I then attempt to build an out = of > > > tree kernel module that I'm working on. The build looks like it's > > > hanging for 1.5 seconds, and when we look at the packets (pcap file > > > attached) we see a ton of GETATTRs over the first 1.5 seconds. I've p= ut > > > the pcap up here: oct_8_2024.pcapng > > people.freebsd.org/~gnn/oct_8_2024.pcapng> > > > > > > I also note that an issue was raised on the forums that seems similar= , > > > way back between FreeBSD 10 and 11: > > > > > > https://forums.freebsd.org/threads/nfs-cache-misses-after-upgrading-t= o-11-1- > > > from-10-3.65491/ > > > > > upgrading-to-11-1-from-10-3.65491/> > > > > > > I'm seeing this on 15 currentish (last few months). > > > > Could it be just make checking for stale targets? > > I.e., stat-ing various files to check their timestamps. All I can tell you is that the GETATTRs all check directories (at least all the ones I looked at). They all appear to be different directories. Btw, if you have not already done so, look at the packet trace in wireshark= . It actually knows how to decode NFS. rick > > I suspect it is from this line in sys/conf/config.mk: > > __MPATH!=3Dfind ${SYSDIR:tA}/ -name \*_if.m > > This is running a find command over all of sys/, so it'll stat about > 35000 files. I believe it's from > https://cgit.freebsd.org/src/commit/?id=3D12f05b84463baacfada5a79eaed061a= 4899d98aa >