From owner-freebsd-hackers@freebsd.org Mon Feb 24 13:47:35 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A5ACE25D302 for ; Mon, 24 Feb 2020 13:47:35 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 48R3KL5t5cz3G28 for ; Mon, 24 Feb 2020 13:47:34 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: by mailman.nyi.freebsd.org (Postfix) id B25F725D2FC; Mon, 24 Feb 2020 13:47:34 +0000 (UTC) Delivered-To: hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B19D725D2F8 for ; Mon, 24 Feb 2020 13:47:34 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: from mail-qt1-x82b.google.com (mail-qt1-x82b.google.com [IPv6:2607:f8b0:4864:20::82b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48R3KJ4fW8z3FyR for ; Mon, 24 Feb 2020 13:47:32 +0000 (UTC) (envelope-from nonesuch@longcount.org) Received: by mail-qt1-x82b.google.com with SMTP id r5so6542935qtt.9 for ; Mon, 24 Feb 2020 05:47:32 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=longcount-org.20150623.gappssmtp.com; s=20150623; h=content-transfer-encoding:from:mime-version:subject:date:message-id :references:cc:in-reply-to:to; bh=DZMjjZTm7LqE5ipzaUCK2F2ItO3Ijdwzkai87ki8UQA=; b=cQhzHmRA/NDYene6J1aS016FlcpK+xuYm5YlCPJT/ziahG2j0ifJIDzufhZf86NqpS l22sGvECvAIDUc2L3eKa7oi+GTlWeIQMcLjUVP2YzEEQCYEppZdM0aXTyXOV/loCBDzo FgevE7hCl1g2EhPtkRWiysURO2/2PtwpQk1GG/kWYnAMxJqhwq5CQmkMvw8iCNRJqCgh Kfswnr0InQqNdS6D9DZBQG+SRQVVrK7NDlhpSSR2wIqREuUQBpwJuWYe5C+auATZMSzQ X/ayCHS0F7CHfznKY6Xevxbne8g4enxEDnf9PUlOIIaP8vBDxkxQxAyke29kIcaPie4z 9Ygw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:content-transfer-encoding:from:mime-version :subject:date:message-id:references:cc:in-reply-to:to; bh=DZMjjZTm7LqE5ipzaUCK2F2ItO3Ijdwzkai87ki8UQA=; b=RiGSk03GclHYs2q9p29h5+pkmwpAJkgNSYPy/lx2DfLoSe5NT0W23jvEzvbJ1dxpqy j4GHpfI0afFo5EbLwLPcQRHcQiIR3iOm3IYvkDD1v3nKmj5a3jmVqZk0K3lMG1OawUWI oq4o3fVF6p2EL1qsQKBeALxeO0yWFy15aHQyEga+hxaeppr0spzOpESgWtVRaYSpkmHq IFePHy2P4HSULAtHTgXpE2o0yia4rlFgLg/EHN517sxXW+nG2WKOaP9yxKDqzC5xayJt xtsOz/eyHVzXRh/vsWblj8Vlo4lzZBVHe6KdiGGael86JYxTeBur+lP9bqE8dv0/6hXu +N7w== X-Gm-Message-State: APjAAAVywarK/B3Zc3atDhuQQHymL21wAZcYMS10fhGYlfS50uFvufYm bICxTdxiX3a1UbvcB9tEdXiuJoxsXjQ= X-Google-Smtp-Source: APXvYqxi+k+4P9A5MNR3BGRqomLmtvdIdyCZDIvmKqJofj8/qYPE1hOqN+EC9TZXlS/JSn4MCb2GAw== X-Received: by 2002:ac8:6046:: with SMTP id k6mr49486886qtm.357.1582552050807; Mon, 24 Feb 2020 05:47:30 -0800 (PST) Received: from ?IPv6:2600:1017:b40e:274c:690a:2278:d7ba:c7a7? ([2600:1017:b40e:274c:690a:2278:d7ba:c7a7]) by smtp.gmail.com with ESMTPSA id v50sm6213725qtb.20.2020.02.24.05.47.29 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 24 Feb 2020 05:47:30 -0800 (PST) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable From: Mark Saad Mime-Version: 1.0 (1.0) Subject: Re: Slow PXE boot Date: Mon, 24 Feb 2020 08:46:20 -0500 Message-Id: <8F7B8958-5295-4A26-82E9-94C7A62ED8A1@longcount.org> References: <20200224032300.00006290@gmail.com> Cc: hackers@freebsd.org In-Reply-To: <20200224032300.00006290@gmail.com> To: =?utf-8?Q?Domagoj_Smol=C4=8Di=C4=87?= X-Mailer: iPhone Mail (17D50) X-Rspamd-Queue-Id: 48R3KJ4fW8z3FyR X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=longcount-org.20150623.gappssmtp.com header.s=20150623 header.b=cQhzHmRA; dmarc=none; spf=none (mx1.freebsd.org: domain of nonesuch@longcount.org has no SPF policy when checking 2607:f8b0:4864:20::82b) smtp.mailfrom=nonesuch@longcount.org X-Spamd-Result: default: False [-4.38 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[longcount-org.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[hackers@freebsd.org]; DMARC_NA(0.00)[longcount.org]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[longcount-org.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[b.2.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-2.58)[ip: (-9.31), ipnet: 2607:f8b0::/32(-1.88), asn: 15169(-1.67), country: US(-0.05)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Feb 2020 13:47:35 -0000 Domagoj=20 I regularly boot 11.3-Stable and 12.1-Stable amd64 on servers with 64gb, 1= 28gb , and occasional more . I do t have that issue . Can you take a peak at= the switch your boxes are attached to ; It sounds like a device is running a= t 100mb 1/2 duplex . I remember the realtec nics doing this when set to auto= .=20 --- Mark Saad | nonesuch@longcount.org > On Feb 23, 2020, at 9:23 PM, Domagoj Smol=C4=8Di=C4=87 wrote: >=20 > =EF=BB=BFYo Crew! >=20 > During PXE boot, from server (11.3-RELEASE-p5 i386) with 1 GB RAM, client w= ith: > 4 GB RAM booted kernel in ~2 min > 8 GB RAM booted kernel in ~20 min (at least) > So all below is tested with 2 different clients, each with NIC of differen= t manufacturer (Realtec & Intel) >=20 > I've read on forums that if client has much, much more RAM than server, th= is happens. > Suggestion was to to set loader(8) tunable hw.memtest.tests to 0, so clien= t would skip RAM test. >=20 > PXE boot is served to clients from /PXE, so ... > Setting hw.memtest.tests=3D"0" in /PXE/boot/loader.conf, yielded no result= s! >=20 > By the way, for some reason, hw.memtest.tests tunable DOESN'T exist in man= pages! > I had to look in source code to confirm it still exists. >=20 >=20 > Next, I've tried: > # echo 'nfs.read_size=3D"16384"' > /PXE/boot/loader.conf > Changing value to ANY value other than default 1024, completely halts c= lient's kernel loading at 'Loading kernel...'! >=20 >=20 > Lastly, I've tried tactic used with UFS's stage 2 /boot/boot, to skip stag= e 3 loader completely and to directly load kernel instead. > So in dhcpd.conf, I've replaced: > filename "boot/pxeboot"; > with: > filename "boot/kernel/kernel"; >=20 > Result: > Attempt to pull GENERIC kernel directly, resulted in: "NBP is too big t= o fit in free base memory" > Maybe I should try to compile custom minimal kernel 'ident PXE' ... > It is unbelievable how many problems do I have ... >=20 >=20 >=20 > Domagoj Smol=C4=8Di=C4=87 > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org"=