From owner-freebsd-hackers@freebsd.org Fri Feb 28 02:26:51 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DF0E9256BF0 for ; Fri, 28 Feb 2020 02:26:51 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48TD233Pq5z4S0F for ; Fri, 28 Feb 2020 02:26:51 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 4FCF0256BEF; Fri, 28 Feb 2020 02:26:51 +0000 (UTC) Delivered-To: hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 4DC43256BED for ; Fri, 28 Feb 2020 02:26:51 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: from mail-wm1-x344.google.com (mail-wm1-x344.google.com [IPv6:2a00:1450:4864:20::344]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48TD21677wz4Rvh for ; Fri, 28 Feb 2020 02:26:49 +0000 (UTC) (envelope-from rank1seeker@gmail.com) Received: by mail-wm1-x344.google.com with SMTP id m10so8293075wmc.0 for ; Thu, 27 Feb 2020 18:26:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=nZKIm/wCA3WpNS8B9uq/XHs9b6rqGBbrnf0fg7ENipE=; b=HuZjxHCcVzjlKiPKSPPuPC1ZxvtWsQAzAno+5PXNYdwNoFhdxQQiCLKbfLTQgC0pID cjkF8B5p/gnxcmsgwp/A5SiWtE7AgQrntS1G2Fcm34wuNgoSw68ib4IU5A/EBQYcQNGD nFSoIham1FAumzJ8Fnwn+5e8V/hBkrDpwC13kxvYROvbSCXWakB/Wk5Fev1zNME2LsPL XWdVYE60W+wtqHeJX20Y4iQX8SbmAwRlh2/ADtjIGaU1LR6FVoOYILOgZ0Udb47cC+sp lzk5PJaImsj4OtpTvKvhe57gv0VRULzi2SDJG0H9pGLHEe8xJfF9+nDmEepF0FWmIn9H 4q7g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=nZKIm/wCA3WpNS8B9uq/XHs9b6rqGBbrnf0fg7ENipE=; b=NkXVG9sqwV8bWhIP6weZoyJeoWo1F5ngyxsG+2J70oCgRq3BptXMffMmTN/hfv5NiJ /soJVSKb5vIMfL98JBIit6UbYVj7ho8ja7+nvsZ4WTjn1CVhbmSwW/bN/VSJEUObcmQT 0SPjcq1VI+Bjn7+gWVJ5Ni0eew8svDWIyIic+KtzFxaY1mcQysebU5exiNw5WNvfFTmG 617AQwdlR2FgvKuZosNGWczbmENtWK0SeXhxJDyf41uwSRSVADNQjVmeAk0jYL5I55vs La5GrAGUf4PK5o9KEbzQJMrubzK16Vx7ZLNeR1LZckhbzlp+KM7MoWs0NTDCGFkiljDq OogA== X-Gm-Message-State: APjAAAUnoKHOtiDXQbm2sd3wO5/n6lqz/hyTUJJwaYhNA8kU96PAFtgP 7xdQ9L7OAeFNAgaPIH+6KAzC31E1 X-Google-Smtp-Source: APXvYqyaU6slYsQmxpzoH7HT81OInVDvFa3umP2QTTNoC+yDlv7fECNUmnoc0UAjT/6p22ufP8qCEg== X-Received: by 2002:a1c:660a:: with SMTP id a10mr1901863wmc.122.1582856808000; Thu, 27 Feb 2020 18:26:48 -0800 (PST) Received: from localhost ([213.149.54.218]) by smtp.gmail.com with ESMTPSA id a62sm61412wmh.33.2020.02.27.18.26.47 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 27 Feb 2020 18:26:47 -0800 (PST) Date: Fri, 28 Feb 2020 03:26:44 +0100 From: Domagoj =?UTF-8?Q?Smol=C4=8Di=C4=87?= To: hackers@freebsd.org Cc: Mark Saad Subject: Re: Slow PXE boot Message-ID: <20200228032644.000018c3@gmail.com> In-Reply-To: <8F7B8958-5295-4A26-82E9-94C7A62ED8A1@longcount.org> References: <20200224032300.00006290@gmail.com> <8F7B8958-5295-4A26-82E9-94C7A62ED8A1@longcount.org> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 48TD21677wz4Rvh X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=HuZjxHCc; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rank1seeker@gmail.com designates 2a00:1450:4864:20::344 as permitted sender) smtp.mailfrom=rank1seeker@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(0.00)[ip: (2.60), ipnet: 2a00:1450::/32(-2.41), asn: 15169(-1.67), country: US(-0.05)]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[hackers@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[4.4.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Feb 2020 02:26:52 -0000 Mark, PXE clients are directly connected to FreeBSD based PXE server, with same E= TH cable. There is no any intermediate hardware like switch, etc ... Regarding '... running at 100mb 1/2 duplex', nope ..., in bios setting is a= ll set to "max" for NICs Finally, result is always 100% repeatable for both tested clients. One always being super fast and the other, unbelievably slow ... On Mon, 24 Feb 2020 08:46:20 -0500 Mark Saad wrote: > Domagoj=20 > I regularly boot 11.3-Stable and 12.1-Stable amd64 on servers with > 64gb, 128gb , and occasional more . I do t have that issue . Can you > take a peak at the switch your boxes are attached to ; It sounds like > a device is running at 100mb 1/2 duplex . I remember the realtec nics > doing this when set to auto .=20 >=20 > --- > Mark Saad | nonesuch@longcount.org >=20 > > On Feb 23, 2020, at 9:23 PM, Domagoj Smol=C4=8Di=C4=87 > > wrote: > >=20 > > =EF=BB=BFYo Crew! > >=20 > > During PXE boot, from server (11.3-RELEASE-p5 i386) with 1 GB RAM, > > client with: 4 GB RAM booted kernel in ~2 min > > 8 GB RAM booted kernel in ~20 min (at least) > > So all below is tested with 2 different clients, each with NIC of > > different manufacturer (Realtec & Intel) > >=20 > > I've read on forums that if client has much, much more RAM than > > server, this happens. Suggestion was to to set loader(8) tunable > > hw.memtest.tests to 0, so client would skip RAM test. > >=20 > > PXE boot is served to clients from /PXE, so ... > > Setting hw.memtest.tests=3D"0" in /PXE/boot/loader.conf, yielded no > > results! > >=20 > > By the way, for some reason, hw.memtest.tests tunable DOESN'T exist > > in man pages! I had to look in source code to confirm it still > > exists. > >=20 > >=20 > > Next, I've tried: > > # echo 'nfs.read_size=3D"16384"' > /PXE/boot/loader.conf > > Changing value to ANY value other than default 1024, completely > > halts client's kernel loading at 'Loading kernel...'! > >=20 > >=20 > > Lastly, I've tried tactic used with UFS's stage 2 /boot/boot, to > > skip stage 3 loader completely and to directly load kernel instead. > > So in dhcpd.conf, I've replaced: filename "boot/pxeboot"; > > with: > > filename "boot/kernel/kernel"; > >=20 > > Result: > > Attempt to pull GENERIC kernel directly, resulted in: "NBP is > > too big to fit in free base memory" Maybe I should try to compile > > custom minimal kernel 'ident PXE' ... It is unbelievable how many > > problems do I have ... > >=20 > >=20 > >=20 > > Domagoj Smol=C4=8Di=C4=87