From owner-freebsd-stable@freebsd.org Tue Aug 6 17:26:53 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id A9698C6329 for ; Tue, 6 Aug 2019 17:26:53 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene.sentex.ca (unknown [IPv6:2607:f3e0:0:3::18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "pyroxene.sentex.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4631lc58Xjz4FsW for ; Tue, 6 Aug 2019 17:26:52 +0000 (UTC) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:201a:99e3:8455:4326] ([IPv6:2607:f3e0:0:4:201a:99e3:8455:4326]) by pyroxene.sentex.ca (8.15.2/8.15.2) with ESMTPS id x76HQfKJ054494 (version=TLSv1.2 cipher=AES128-SHA bits=128 verify=NO) for ; Tue, 6 Aug 2019 13:26:42 -0400 (EDT) (envelope-from mike@sentex.net) To: freebsd-stable@freebsd.org From: mike tancsa Subject: UEFI, ipmi console and double text (DDOOUUBBLLE TTEEXXT) Message-ID: <7a2d12f5-df4e-3cd5-9988-183266c9d8fc@sentex.net> Date: Tue, 6 Aug 2019 13:26:43 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: 4631lc58Xjz4FsW X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:3::18 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [-1.42 / 15.00]; ARC_NA(0.00)[]; RDNS_NONE(1.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-0.998,0]; DMARC_NA(0.00)[sentex.net]; NEURAL_HAM_SHORT(-0.90)[-0.903,0]; NEURAL_HAM_MEDIUM(-1.00)[-0.998,0]; IP_SCORE(-1.72)[ipnet: 2607:f3e0::/32(-4.94), asn: 11647(-3.57), country: CA(-0.09)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Aug 2019 17:26:53 -0000 I did a fresh install of a RELENG12 image and did EFI for the boot / install process.  Most everything seems to work ok, but the boot menu gets double text printing. As before and after is OK, its not a huge thing, but is there a way to fix this ? loader.conf is simple comconsole_speed="115200"       # Set the current serial console speed boot_multicons="YES" boot_serial="YES" console="comconsole,efi" ipmi_load="YES" comconsole_port="0x2f8"   # for SuperMicro boards Press DEL to run Setup                                                          Press F11 to invoke Boot Menu                                                   Press F12 to boot from PXE/LAN                                                    DXE--Ready to Boot..Consoles: EFI console                                     LLooaaddiinngg  //bboooott//llooaaddeerr..ccoonnf                            B2 -- Command line arguments: loader.efi    EFI version: 2.40    EFI Firmware: American Megatrends (rev 5.11)    Console: efi (0x20000000)    Load Path: \EFI\BOOT\BOOTX64.EFI    Load Device: PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(1,GPT,09C9B414-AA1E-11E9-BBD8-6045CBA08A84,0x28,0x64000)    BootCurrent: 0006    BootOrder: 0006[*] 0007 0004 0003 0005    BootInfo Path: HD(1,GPT,09C9B414-AA1E-11E9-BBD8-6045CBA08A84,0x28,0x64000)/\EFI\BOOT\BOOTX64.EFI Ignoring Boot0006: Only one DP found Trying ESP: PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(1,GPT,09C9B414-AA1E-11E9-BBD8-6045CBA08A84,0x28,0x64000) Setting currdev to disk0p1: Trying: PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(2,GPT,09D3BF1A-AA1E-11E9-BBD8-6045CBA08A84,0 Setting currdev to disk0p2: Trying: PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(3,GPT,09DEAE25-AA1E-11E9-BBD8-6045CBA08A84,0x1064800,0x39321800) Setting currdev to zfs:bucam/ROOT/default: Loading /boot/defaults/loader.conf Loading /boot/device.hints Loading /boot/loader.conf - JH    ____________                              ________      __________  __________     H  ||    ________||                          ||    __  \\  //  ________||    ____  \\   H  ||  ||______  __  ____  ______    ______  ||  ||__))  ||  ((______  ||  ||    ||  ||  H  ||    ______||  ''____//  __  \\//  __  \\||    __  <<  \\______;2HH  ||  ||      ||  ||  ||    ____//    ____//||  ||__))  ||________))  ||  ||____||  ||  H  ||  ||      ||  ||  ||        ||        ||||          ||            ||            ||  H  ||__||      ||__||    \\______||\\______||||________//||__________//||__________//                                                 H    ``````                                                ``  HH-Í-Í-Í-Í-ÍHWWeellccoommee  ttoo  FFrreeeeBBSSDDÍ-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-ÍÍ-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í-Í  H|º                                       H|º H  ++oo      ..----``                  //yy::``            ++..  H|ºH11..  BBoooott  MMuullttii  uusseerr  [[EEnntteerr]]`::..                        ::oo            ``++--  H|ºH22..  BBoooott  SSiinnggllee  uusseerrH|º H      yy//                              --//``      --oo//  H|ºH33..  EEssccaappee  ttoo  llooaaddeerr  pprroommpptt                                   :::://ssyy++::..  H|ºH44..  RReebboooott                    H|º H    //                                          ``----    //  H|ºH                                      H|º H  ``::                        ::``  H|ºHOOppttiioonnss::                      H|º H  ``::                                                    ::``  55..  KKeerrnneell::  ddeeffaauulltt//22kkeerrnneell  ((11  ooff  22))                                   //  H|ºH66..  BBoooo[25;1HH                   H|º H    ..--                                                --..  H|º                                       H|º H      ----                                            --..  H|º                                           H        ``::``                                    ``::``                                            H|º H            ..----             22;48  H\È                                       H/¼ H                  ..------..........--------..    HAAuuttoobboooott  iinn  44  sseeccoonnddss,,  hhiitt  [[EEnntteerr]]  ttoo  bboooott  oorr  aannyy  ootthheerr  kkeeyy  ttoo  ssttoopp            HLLooaaddiinngg  kkeerrnneell...... //bboooott//kkeerrnneell//kkeerrnneell  tteexxtt==00xxaa889988cc22  ddaattaa==00xx3344aa8822cc++00xx6644ff99ddcc  ssyymmss==[[00xx88++00xx110055118800++00xx88++00xx112222bb7755]] ---<>--- Copyright (c) 1992-2019 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994         The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-STABLE r350629 server amd64 FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on LLVM 8.0.1) VT(efifb): resolution 1024x768 CPU: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz (3504.15-MHz K8-class CPU)   Origin="GenuineIntel"  Id=0x906e9  Family=0x6  Model=0x9e  Stepping=9   Features=0xbfebfbff   Features2=0x7ffafbff   AMD Features=0x2c100800   AMD Features2=0x121   Structured Extended Features=0x29c6fbf   Structured Extended Features3=0x9c002400   XSAVE Features=0xf   VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID   TSC: P-state invariant, performance statistics real memory  = 68719476736 (65536 MB) avail memory = 66673238016 (63584 MB) CPU microcode: updated from 0x8e to 0xb4 From owner-freebsd-stable@freebsd.org Wed Aug 7 00:06:04 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C737BB6B59 for ; Wed, 7 Aug 2019 00:06:04 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x829.google.com (mail-qt1-x829.google.com [IPv6:2607:f8b0:4864:20::829]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 463BcC3R5Sz3RB4 for ; Wed, 7 Aug 2019 00:06:03 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x829.google.com with SMTP id x22so13138070qtp.12 for ; Tue, 06 Aug 2019 17:06:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=EdYFJnAYbEaqWJoVVh33AymFPqSzECP30KniokLcUJw=; b=hRP1yAtf0BgOA15v4CVQQTjr7q1PdZFwbl8yMmX8IMVsbhJyop5HxUn2uruZ7KMRLf c0V3iJFMn0l1cBZHIaLVEq9oh+iodCXz0UF2Yyf3667PpVL6MxceNQNJRniwHAlTOElx XfYOaXkOd9jfYbcB1dtSsLxMpZOpW/eHXWvIXDr7Q/Ny01UeMkyL/1xwIGu+CClIXZKg E/j9QyIS3piCymNcuO1qP3dVS56DwS3XMwueSOE9oBr86Z9SyqZs8dbXyik/Zq7E/kmM L6aUIHIooxlUDhEBaFnE6hD1S/weHFr4hD+Lr4NqSQs85Z4VheT/MIj2S0/Hxcvf1wNb uDew== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=EdYFJnAYbEaqWJoVVh33AymFPqSzECP30KniokLcUJw=; b=J2ntIKgCnpxIvAEKSK4DBah6yS2Y4v5fVBnfSmfBKdqfedF3T4KdefrNBDqK78m8ZZ RYHsJlZZUwiigKvpuZy1DsXu9IFu03SUJ6N7qggr4H6QueHZWBc9thJkJ85J3xiUTSj1 uirkoGe+GBpeTcb2I6p1lm2evhdfp1SzgigHOn/rW61fbgVL0nx6IC629F18EswQvLQA Mg6XKk7M4of/PzXznNRRxyusjZSpf5Zix/Kp4E5iVQZapv3GIzd5isn9eIzv5KI68ufD CvielWVwU6Hp3eXgz8SydwYyHUZDqs5t8nqjviSK2Eb1nk2X4E5ozuOp6o/EgkCuAC2w HqtA== X-Gm-Message-State: APjAAAVsEq4GUhLJaUCvGJCaWkABssv+TwZEbJxnB0BP4A+HuguwEhmo 1h4YG9jxx+XFfJ3vN3iJF4DuSX4mk7RyUPD770GXcw== X-Google-Smtp-Source: APXvYqx4YjacBoEihY072Hg3Fo7izwZP1T3oYIbgEhiw5Djv5Ho/Z/KTb5TY8ZUKadUwODQUPlczqEfwdeluzb8NZwM= X-Received: by 2002:ac8:244f:: with SMTP id d15mr5373752qtd.32.1565136362026; Tue, 06 Aug 2019 17:06:02 -0700 (PDT) MIME-Version: 1.0 References: <7a2d12f5-df4e-3cd5-9988-183266c9d8fc@sentex.net> In-Reply-To: <7a2d12f5-df4e-3cd5-9988-183266c9d8fc@sentex.net> From: Warner Losh Date: Tue, 6 Aug 2019 18:05:51 -0600 Message-ID: Subject: Re: UEFI, ipmi console and double text (DDOOUUBBLLE TTEEXXT) To: mike tancsa Cc: FreeBSD-STABLE Mailing List X-Rspamd-Queue-Id: 463BcC3R5Sz3RB4 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=hRP1yAtf; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::829) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-4.88 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997,0]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.993,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; URI_COUNT_ODD(1.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[9.2.8.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-1.00)[-0.997,0]; MIME_BASE64_TEXT(0.10)[]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; IP_SCORE(-2.99)[ip: (-9.41), ipnet: 2607:f8b0::/32(-3.05), asn: 15169(-2.45), country: US(-0.05)]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 00:06:04 -0000 On Tue, Aug 6, 2019 at 4:32 PM mike tancsa wrote: > I did a fresh install of a RELENG12 image and did EFI for the boot / > install process. Most everything seems to work ok, but the boot menu > gets double text printing. As before and after is OK, its not a huge > thing, but is there a way to fix this ? > > loader.conf is simple > > comconsole_speed=3D"115200" # Set the current serial console speed > boot_multicons=3D"YES" > boot_serial=3D"YES" > console=3D"comconsole,efi" > Don't do that. console=3D"efi" is all you need with your BIOS. The BIOS doe= s the splitting between screen and COM port, which is why you are getting doubled characters. Warner > ipmi_load=3D"YES" > comconsole_port=3D"0x2f8" # for SuperMicro boards > > > > > Press DEL to run > Setup > Press F11 to invoke Boot > Menu > Press F12 to boot from > PXE/LAN > DXE--Ready to Boot..Consoles: EFI > console > LLooaaddiinngg > //bboooott//llooaaddeerr..ccoonnf B2 > > -- Command line arguments: loader.efi > EFI version: 2.40 > EFI Firmware: American Megatrends (rev 5.11) > Console: efi (0x20000000) > Load Path: \EFI\BOOT\BOOTX64.EFI > Load Device: > > PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(1,GPT,09C9B414-AA1E-11= E9-BBD8-6045CBA08A84,0x28,0x64000) > BootCurrent: 0006 > BootOrder: 0006[*] 0007 0004 0003 0005 > BootInfo Path: > > HD(1,GPT,09C9B414-AA1E-11E9-BBD8-6045CBA08A84,0x28,0x64000)/\EFI\BOOT\BOO= TX64.EFI > Ignoring Boot0006: Only one DP found > Trying ESP: > > PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(1,GPT,09C9B414-AA1E-11= E9-BBD8-6045CBA08A84,0x28,0x64000) > Setting currdev to disk0p1: > Trying: > > PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(2,GPT,09D3BF1A-AA1E-11= E9-BBD8-6045CBA08A84,0 > Setting currdev to disk0p2: > Trying: > > PciRoot(0x0)/Pci(0x17,0x0)/Sata(0x2,0xFFFF,0x0)/HD(3,GPT,09DEAE25-AA1E-11= E9-BBD8-6045CBA08A84,0x1064800,0x39321800) > Setting currdev to zfs:bucam/ROOT/default: > Loading /boot/defaults/loader.conf > Loading /boot/device.hints > Loading /boot/loader.conf > - > JH ____________ ________ > __________ __________ > H || ________|| || __ \\ // > ________|| ____ \\ > H || ||______ __ ____ ______ ______ || ||__)) || ((______ > || || || || > H || ______|| ''____// __ \\// __ \\|| __ << > \\______;2HH || || || || || ____// ____//|| ||__)) > ||________)) || ||____|| || > > H || || || || || || |||| || > || || > H ||__|| ||__|| > \\______||\\______||||________//||__________//||__________// > H > `````` `` > HH-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8DHWWeellccoommee ttoo > > FFrreeeeBBSSDD=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3= =8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D=C3=8D-=C3=8D-=C3=8D-= =C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3= =8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-= =C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3=8D-=C3= =8D-=C3=8D > H|=C2=BA H|=C2=BA H ++oo > ..----`` //yy::`` ++.. > H|=C2=BAH11.. BBoooott MMuullttii uusseerr > [[EEnntteerr]]`::.. ::oo ``++-- > H|=C2=BAH22.. BBoooott SSiinnggllee uusseerrH|=C2=BA H > yy// --//`` --oo// > H|=C2=BAH33.. EEssccaappee ttoo llooaaddeerr > pprroommpptt :::://ssyy++::.. > H|=C2=BAH44.. RReebboooott H|=C2=BA H > // ``---- // > H|=C2=BAH H|=C2=BA H > ``:: ::`` > H|=C2=BAHOOppttiioonnss:: H|=C2=BA H > ``:: ::`` > 55.. KKeerrnneell:: ddeeffaauulltt//22kkeerrnneell ((11 ooff > 22)) // > H|=C2=BAH66.. BBoooo[25;1HH H|=C2=BA H > ..-- --.. > H|=C2=BA H|=C2=BA H > ---- --.. > H|=C2=BA H > ``::`` ``::`` > H|=C2=BA H > ..---- 22;48 > H\=C3=88 H/=C2=BC H > ..------..........--------.. > HAAuuttoobboooott iinn 44 sseeccoonnddss,, hhiitt > [[EEnntteerr]] ttoo bboooott oorr aannyy ootthheerr kkeeyy ttoo > ssttoopp > > HLLooaaddiinngg kkeerrnneell...... > > //bboooott//kkeerrnneell//kkeerrnneell tteexxtt=3D=3D00xxaa889988cc22 > ddaattaa=3D=3D00xx3344aa8822cc++00xx6644ff99ddcc > ssyymmss=3D=3D[[00xx88++00xx110055118800++00xx88++00xx112222bb7755]] > > ---<>--- > Copyright (c) 1992-2019 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 12.0-STABLE r350629 server amd64 > FreeBSD clang version 8.0.1 (tags/RELEASE_801/final 366581) (based on > LLVM 8.0.1) > VT(efifb): resolution 1024x768 > CPU: Intel(R) Xeon(R) CPU E3-1230 v6 @ 3.50GHz (3504.15-MHz K8-class CPU) > Origin=3D"GenuineIntel" Id=3D0x906e9 Family=3D0x6 Model=3D0x9e Step= ping=3D9 > > > Features=3D0xbfebfbff > > > Features2=3D0x7ffafbff > AMD Features=3D0x2c100800 > AMD Features2=3D0x121 > Structured Extended > > Features=3D0x29c6fbf > Structured Extended > Features3=3D0x9c002400 > XSAVE Features=3D0xf > VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID > TSC: P-state invariant, performance statistics > real memory =3D 68719476736 (65536 MB) > avail memory =3D 66673238016 (63584 MB) > CPU microcode: updated from 0x8e to 0xb4 > > _______________________________________________ > freebsd-stable@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" > From owner-freebsd-stable@freebsd.org Wed Aug 7 04:16:05 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 489E5BD622 for ; Wed, 7 Aug 2019 04:16:05 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from roadkill.tharned.org (tunnel294749-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:107f::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "tharned.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 463J8g6WDHz4BrF for ; Wed, 7 Aug 2019 04:16:03 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from flake.tharned.org ([IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705]) (authenticated bits=0) by roadkill.tharned.org (8.15.2/8.15.2) with ESMTPSA id x774Fsfh003188 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Tue, 6 Aug 2019 23:15:54 -0500 (CDT) (envelope-from gcr+freebsd-stable@tharned.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tharned.org; s=2017; t=1565151354; bh=lzeQ/Kwpbhr794GpOboCTt7fTL3Wu6l/uL6VfMtC1Ik=; h=From:To:Subject:Date; b=l5W0UAX2kO1+AGEBEIVFPVS7YBMiDx+s+Kr7LfDAA6oVt4up1oCJOV1SlaH4ljOA+ BFKT3Q8MQK58N3JURhAuDzO0pFvcrRBvDFZr6YPEhuygJFWjj4bwNevgHl5ClL9N4q VdiiMRCb7UEYL8xtyJYdsFrM74u3+t7Tl2Td1K/ttmgXTSifrLjM54TPZDtj/igzP0 4tH55zrEzE7I2f8JmCGRSQZYC0wg+NMOdI1D+QeE7cGi4TjpFKkBhMB1I/I/9k03i0 dd9gV1l1y5I8L7g4ZfK6BTmtydlezaIfNzTWVAqTyN48L/sd+GXVChbMCPUzqCdE7r MkDiLII4Dx6Ew== X-Authentication-Warning: roadkill.tharned.org: Host [IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705] claimed to be flake.tharned.org From: Greg Rivers To: freebsd-stable@freebsd.org Subject: Regression in IXGBE(4) on 12.0-RELEASE? Date: Tue, 06 Aug 2019 23:15:54 -0500 Message-ID: <15504838.vxEf1mJfsr@no.place.like.home> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (roadkill.tharned.org [IPv6:2001:470:1f10:107f:0:0:0:2]); Tue, 06 Aug 2019 23:15:54 -0500 (CDT) X-Rspamd-Queue-Id: 463J8g6WDHz4BrF X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tharned.org header.s=2017 header.b=l5W0UAX2; dmarc=none; spf=none (mx1.freebsd.org: domain of gcr@tharned.org has no SPF policy when checking 2001:470:1f10:107f::2) smtp.mailfrom=gcr@tharned.org X-Spamd-Result: default: False [-5.28 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_XAW(0.00)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[tharned.org:+]; NEURAL_HAM_SHORT(-0.99)[-0.987,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-1.49)[ipnet: 2001:470::/32(-4.49), asn: 6939(-2.92), country: US(-0.05)]; SUBJECT_ENDS_QUESTION(1.00)[]; CTE_CASE(0.50)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; TAGGED_FROM(0.00)[freebsd-stable]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[tharned.org:s=2017]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[tharned.org.dwl.dnswl.org : 127.0.6.2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[tharned.org]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; R_SPF_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 04:16:05 -0000 These Intel NICs have been performing very well for me: ix0@pci0:7:0:0: class=0x020000 card=0x17d3103c chip=0x10fb8086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' class = network subclass = ethernet On 11.2-RELEASE, the cards probe like this: ix0: port 0x7000-0x701f mem 0xf7f00000-0xf7ffffff,0xf7ef0000-0xf7ef3fff irq 28 at device 0.0 numa-domain 0 on pci1 ix0: Using MSI-X interrupts with 9 vectors ix0: Ethernet address: 8c:dc:d4:af:8a:e0 ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix0: netmap queues/slots: TX 8/2048, RX 8/2048 As expected, all 8 queues are enabled on the NIC, with 8 corresponding interrupt threads pinned to 8 different CPUs But on 12.0-RELEASE, the cards probe like this: ix0: port 0x4020-0x403f mem 0xe2900000-0xe29fffff,0xe2a04000-0xe2a07fff at device 0.0 numa-domain 0 on pci4 ix0: using 2048 tx descriptors and 2048 rx descriptors ix0: msix_init qsets capped at 16 ix0: Unable to map MSIX table ix0: Using an MSI interrupt ix0: allocated for 1 queues ix0: allocated for 1 rx queues ix0: Ethernet address: 48:df:37:62:be:38 ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix0: netmap queues/slots: TX 1/2048, RX 1/2048 ix0: link state changed to UP MSI-X is disabled, and only one queue is enabled. I'm sure this is going to perform poorly under high network loads. Does anyone know why this is? -- Greg Rivers From owner-freebsd-stable@freebsd.org Wed Aug 7 09:51:24 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DDB75C4D6C for ; Wed, 7 Aug 2019 09:51:24 +0000 (UTC) (envelope-from wolfgang@lyxys.ka.sub.org) Received: from saturn.lyxys.ka.sub.org (saturn.lyxys.ka.sub.org [217.29.35.151]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 463Rbb5jHbz4Tw5 for ; Wed, 7 Aug 2019 09:51:23 +0000 (UTC) (envelope-from wolfgang@lyxys.ka.sub.org) Received: from juno.lyxys.ka.sub.org (juno.lyx [IPv6:fd2a:89ca:7d54:0:240:caff:fe92:4f47]) by saturn.lyxys.ka.sub.org (8.15.2/8.15.2) with ESMTPS id x779MLDc002623 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=FAIL) for ; Wed, 7 Aug 2019 11:22:23 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) Received: from juno.lyxys.ka.sub.org (localhost [127.0.0.1]) by juno.lyxys.ka.sub.org (8.15.2/8.15.2) with ESMTPS id x779MLAq050363 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Wed, 7 Aug 2019 11:22:21 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) Received: (from wolfgang@localhost) by juno.lyxys.ka.sub.org (8.15.2/8.15.2/Submit) id x779MKkk050360 for freebsd-stable@freebsd.org; Wed, 7 Aug 2019 11:22:20 +0200 (CEST) (envelope-from wolfgang@lyxys.ka.sub.org) X-Authentication-Warning: juno.lyx: wolfgang set sender to wolfgang@lyxys.ka.sub.org using -f Date: Wed, 7 Aug 2019 11:22:20 +0200 From: Wolfgang Zenker To: freebsd-stable@freebsd.org Subject: local_unbound broken in 11.2-p13 Message-ID: <20190807092220.GA49811@lyxys.ka.sub.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Organization: private site User-Agent: Mutt/1.12.1 (2019-06-15) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (saturn.lyxys.ka.sub.org [IPv6:fd2a:89ca:7d54:1:200:24ff:feca:b4cc]); Wed, 07 Aug 2019 11:22:23 +0200 (CEST) X-Rspamd-Queue-Id: 463Rbb5jHbz4Tw5 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of wolfgang@lyxys.ka.sub.org designates 217.29.35.151 as permitted sender) smtp.mailfrom=wolfgang@lyxys.ka.sub.org X-Spamd-Result: default: False [-3.44 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.990,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-0.95)[-0.951,0]; NEURAL_HAM_SHORT(-0.96)[-0.963,0]; DMARC_NA(0.00)[sub.org]; IP_SCORE(-0.23)[ipnet: 217.29.32.0/20(-0.65), asn: 16188(-0.52), country: DE(-0.01)]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16188, ipnet:217.29.32.0/20, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 09:51:24 -0000 Hi, I was trying to use local_unbound in a jail on a newly configured server running 11.2-p13. First using an external nameserver in resolv.conf (works) and after starting local_unbound for the first time, config was created and local_unbound starts ok, but any queries get an answer with rcode SERVFAIL. No information in /var/log/messages. Same setup on 11.2-p9 works as expected. Comparing config on both servers, it appears that local_inbound now creates a root.key file with a DS record for the root zone, while the working installation has a DNSKEY record for the root zone. Changing the root.key file to one with DNSKEY record gets local_unbound working again. Wolfgang From owner-freebsd-stable@freebsd.org Wed Aug 7 15:14:22 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DC773AD339 for ; Wed, 7 Aug 2019 15:14:22 +0000 (UTC) (envelope-from sergey@akhmatov.ru) Received: from dutch.chaklun.ru (dutch.chaklun.ru [IPv6:2a01:7c8:aab0:135::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 463ZmG02kLz3Kqk for ; Wed, 7 Aug 2019 15:14:21 +0000 (UTC) (envelope-from sergey@akhmatov.ru) Received: from mx.ddosprevention.ru ([212.65.69.58] helo=[127.0.0.1]) by dutch.chaklun.ru with esmtpsa (TLSv1.3:TLS_AES_128_GCM_SHA256:128) (Exim 4.92.1 (FreeBSD)) (envelope-from ) id 1hvNdb-000OcH-GF; Wed, 07 Aug 2019 18:14:03 +0300 Subject: Re: Regression in IXGBE(4) on 12.0-RELEASE? To: Greg Rivers , freebsd-stable@freebsd.org References: <15504838.vxEf1mJfsr@no.place.like.home> From: Sergey Akhmatov Message-ID: Date: Wed, 7 Aug 2019 18:14:01 +0300 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: <15504838.vxEf1mJfsr@no.place.like.home> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 463ZmG02kLz3Kqk X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of sergey@akhmatov.ru has no SPF policy when checking 2a01:7c8:aab0:135::1) smtp.mailfrom=sergey@akhmatov.ru X-Spamd-Result: default: False [-2.09 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; NEURAL_HAM_MEDIUM(-0.90)[-0.897,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; IP_SCORE(-1.17)[ipnet: 2a01:7c8::/32(-3.62), asn: 20857(-2.23), country: NL(0.01)]; TAGGED_RCPT(0.00)[freebsd-stable]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[akhmatov.ru]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.99)[-0.987,0]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.94)[-0.935,0]; RCPT_COUNT_TWO(0.00)[2]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:20857, ipnet:2a01:7c8::/32, country:NL]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 15:14:22 -0000 On 07/08/2019 07:15, Greg Rivers wrote: > These Intel NICs have been performing very well for me: > > ix0@pci0:7:0:0: class=0x020000 card=0x17d3103c chip=0x10fb8086 rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' > class = network > subclass = ethernet > > On 11.2-RELEASE, the cards probe like this: > > ix0: port 0x7000-0x701f mem 0xf7f00000-0xf7ffffff,0xf7ef0000-0xf7ef3fff irq 28 at device 0.0 numa-domain 0 on pci1 > ix0: Using MSI-X interrupts with 9 vectors > ix0: Ethernet address: 8c:dc:d4:af:8a:e0 > ix0: PCI Express Bus: Speed 5.0GT/s Width x8 > ix0: netmap queues/slots: TX 8/2048, RX 8/2048 > > As expected, all 8 queues are enabled on the NIC, with 8 corresponding interrupt threads pinned to 8 different CPUs > > But on 12.0-RELEASE, the cards probe like this: > > ix0: port 0x4020-0x403f mem 0xe2900000-0xe29fffff,0xe2a04000-0xe2a07fff at device 0.0 numa-domain 0 on pci4 > ix0: using 2048 tx descriptors and 2048 rx descriptors > ix0: msix_init qsets capped at 16 > ix0: Unable to map MSIX table > ix0: Using an MSI interrupt > ix0: allocated for 1 queues > ix0: allocated for 1 rx queues > ix0: Ethernet address: 48:df:37:62:be:38 > ix0: PCI Express Bus: Speed 5.0GT/s Width x8 > ix0: netmap queues/slots: TX 1/2048, RX 1/2048 > ix0: link state changed to UP > > MSI-X is disabled, and only one queue is enabled. I'm sure this is going to perform poorly under high network loads. Does anyone know why this is? Don't know if it could help somehow, but I've got two identical boxes with similar NICs side by side, one running 11.2 and the other one 12.0 and I don't have such problems. If someone points me where to look, I could help collecting more data to know how my system is different from Greg's. $ freebsd-version 12.0-RELEASE-p7 $ pciconf -lvc ix0 ix0@pci0:17:0:0: class=0x020000 card=0x7a128086 chip=0x10fb8086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' class = network subclass = ethernet cap 01[40] = powerspec 3 supports D0 D3 current D0 cap 05[50] = MSI supports 1 message, 64 bit, vector masks cap 11[70] = MSI-X supports 64 messages, enabled Table in map 0x20[0x0], PBA in map 0x20[0x2000] cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] = Serial 1 90e2baffff809b08 ecap 000e[150] = ARI 1 ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI disabled 0 VFs configured out of 64 supported First VF RID Offset 0x0180, VF RID Stride 0x0002 VF Device ID 0x10ed Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576, 4194304 $ dmesg ix0: port 0x2fc0-0x2fdf mem 0x91200000-0x912fffff,0x910fc000-0x910fffff irq 32 at device 0.0 on pci2 ix0: using 2048 tx descriptors and 2048 rx descriptors ix0: msix_init qsets capped at 16 ix0: pxm cpus: 8 queue msgs: 63 admincnt: 1 ix0: using 8 rx queues 8 tx queues ix0: Using MSIX interrupts with 9 vectors ix0: allocated for 8 queues ix0: allocated for 8 rx queues ix0: Ethernet address: 90:e2:ba:80:9b:08 ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix0: netmap queues/slots: TX 8/2048, RX 8/2048 ========== $ freebsd-version 11.2-RELEASE-p3 $ dmesg ix0: port 0x2fc0-0x2fdf mem 0x91200000-0x912fffff,0x910fc000-0x910fffff irq 32 at device 0.0 numa-domain 0 on pci2 ix0: Using MSI-X interrupts with 9 vectors ix0: Ethernet address: 90:e2:ba:80:99:d0 ix0: PCI Express Bus: Speed 5.0GT/s Width x8 ix0: netmap queues/slots: TX 8/2048, RX 8/2048 From owner-freebsd-stable@freebsd.org Wed Aug 7 16:27:20 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 51BD0AF4D1 for ; Wed, 7 Aug 2019 16:27:20 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from roadkill.tharned.org (tunnel294749-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:107f::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "tharned.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 463cNQ4t1dz3QfR for ; Wed, 7 Aug 2019 16:27:18 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from flake.tharned.org ([IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705]) (authenticated bits=0) by roadkill.tharned.org (8.15.2/8.15.2) with ESMTPSA id x77GRAwx012204 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 7 Aug 2019 11:27:11 -0500 (CDT) (envelope-from gcr+freebsd-stable@tharned.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tharned.org; s=2017; t=1565195232; bh=SzAnZJoacTFPz6NS07STjqP6oJ5aoW0rbQKHE/xd1bI=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=EaFAFLff9wL2t0vif4xyjXLLOqfNJxKM3UQuhbwJrmZ9nTbxZ3/EkplI5CSdA/rEU /tKN8yvSUiYEFOCgPsqBSiC6y2h3vsxWGrH3l2TZKZx391MOwf0JyBJkyOwTGbFyoT 1Zo3X3+RYpOeln/mSBDi71Z44HBErq5FQPEAoo0oEQxjr5N1AMGrUUn14+T7r4v8PZ 4Vs2YXgB8YntXcKj2826Ksy4Zpzp9+IQSt0BWF7i7NogPb8xQf3Az16raZP6i5vvQr uOY7/ebEgNhsYKYArRvfF7kbSYMvNlzLWRAZT7oNxzuXBj7iRLKS75m5Z7Du79tGZV A31lWudmV+2nQ== X-Authentication-Warning: roadkill.tharned.org: Host [IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705] claimed to be flake.tharned.org From: Greg Rivers To: freebsd-stable@freebsd.org Cc: Sergey Akhmatov Subject: Re: Regression in IXGBE(4) on 12.0-RELEASE? Date: Wed, 07 Aug 2019 11:27:10 -0500 Message-ID: <1955050.cYikG52F1y@no.place.like.home> In-Reply-To: References: <15504838.vxEf1mJfsr@no.place.like.home> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (roadkill.tharned.org [IPv6:2001:470:1f10:107f:0:0:0:2]); Wed, 07 Aug 2019 11:27:12 -0500 (CDT) X-Rspamd-Queue-Id: 463cNQ4t1dz3QfR X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tharned.org header.s=2017 header.b=EaFAFLff; dmarc=none; spf=none (mx1.freebsd.org: domain of gcr@tharned.org has no SPF policy when checking 2001:470:1f10:107f::2) smtp.mailfrom=gcr@tharned.org X-Spamd-Result: default: False [-5.29 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[tharned.org:s=2017]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; DWL_DNSWL_MED(-2.00)[tharned.org.dwl.dnswl.org : 127.0.6.2]; IP_SCORE(-1.49)[ipnet: 2001:470::/32(-4.49), asn: 6939(-2.93), country: US(-0.05)]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; DMARC_NA(0.00)[tharned.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[tharned.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.99)[-0.993,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; CTE_CASE(0.50)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; TAGGED_FROM(0.00)[freebsd-stable]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 16:27:20 -0000 On Wednesday, August 7, 2019 10:14:01 AM CDT Sergey Akhmatov wrote: > $ freebsd-version > 12.0-RELEASE-p7 > > $ pciconf -lvc ix0 > ix0@pci0:17:0:0: class=0x020000 card=0x7a128086 chip=0x10fb8086 > rev=0x01 hdr=0x00 > vendor = 'Intel Corporation' > device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' > class = network > subclass = ethernet > cap 01[40] = powerspec 3 supports D0 D3 current D0 > cap 05[50] = MSI supports 1 message, 64 bit, vector masks > cap 11[70] = MSI-X supports 64 messages, enabled > Table in map 0x20[0x0], PBA in map 0x20[0x2000] > cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS > link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) > ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected > ecap 0003[140] = Serial 1 90e2baffff809b08 > ecap 000e[150] = ARI 1 > ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI > disabled > 0 VFs configured out of 64 supported > First VF RID Offset 0x0180, VF RID Stride 0x0002 > VF Device ID 0x10ed > Page Sizes: 4096 (enabled), 8192, 65536, 262144, > 1048576, 4194304 > Thank you Sergey. Good call adding -c to list capabilities. There are some differences between your card and mine (I also added -e to list errors): $ freebsd-version 12.0-RELEASE-p9 $ pciconf -lvce ix0 ix0@pci0:17:0:0: class=0x020000 card=0x17d3103c chip=0x10fb8086 rev=0x01 hdr=0x00 vendor = 'Intel Corporation' device = '82599ES 10-Gigabit SFI/SFP+ Network Connection' class = network subclass = ethernet cap 01[40] = powerspec 3 supports D0 D3 current D0 cap 05[50] = MSI supports 1 message, 64 bit, vector masks enabled with 1 message cap 11[70] = MSI-X supports 64 messages Table in map 0x1c[0x0], PBA in map 0x1c[0x2000] cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR RO NS link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) cap 03[e0] = VPD ecap 0001[100] = AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] = Serial 1 48df37ffff62be38 ecap 000e[150] = ARI 1 ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI enabled 0 VFs configured out of 64 supported First VF RID Offset 0x0080, VF RID Stride 0x0002 VF Device ID 0x10ed Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576, 4194304 PCI-e errors = Correctable Error Detected Unsupported Request Detected Corrected = Advisory Non-Fatal Error I confirmed that it's not just a difference between hosts; when I boot the 11.3-RELEASE memstick image on this very same machine the NIC is properly configured with all 8 queues. So it's almost certainly a difference between ixgbe driver versions. I don't know if it matters, but this is an HPE branded Intel NIC in a DL380 Gen10. -- Greg From owner-freebsd-stable@freebsd.org Wed Aug 7 17:53:49 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 58B4EB2CB3 for ; Wed, 7 Aug 2019 17:53:49 +0000 (UTC) (envelope-from jeffrey.e.pieper@intel.com) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "fmsmga101.fm.intel.com", Issuer "COMODO RSA Organization Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 463fJC6Vzzz4502 for ; Wed, 7 Aug 2019 17:53:47 +0000 (UTC) (envelope-from jeffrey.e.pieper@intel.com) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga002.jf.intel.com ([10.7.209.21]) by fmsmga101.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 07 Aug 2019 10:53:45 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.64,358,1559545200"; d="scan'208";a="186075200" Received: from orsmsx105.amr.corp.intel.com ([10.22.225.132]) by orsmga002.jf.intel.com with ESMTP; 07 Aug 2019 10:53:45 -0700 Received: from orsmsx124.amr.corp.intel.com (10.22.240.120) by ORSMSX105.amr.corp.intel.com (10.22.225.132) with Microsoft SMTP Server (TLS) id 14.3.439.0; Wed, 7 Aug 2019 10:53:44 -0700 Received: from orsmsx111.amr.corp.intel.com ([169.254.12.46]) by ORSMSX124.amr.corp.intel.com ([169.254.2.63]) with mapi id 14.03.0439.000; Wed, 7 Aug 2019 10:53:44 -0700 From: "Pieper, Jeffrey E" To: Greg Rivers , "freebsd-stable@freebsd.org" Subject: RE: Regression in IXGBE(4) on 12.0-RELEASE? Thread-Topic: Regression in IXGBE(4) on 12.0-RELEASE? Thread-Index: AQHVTNblW6Vv/dCzaUiLQfplFVWtF6bwQSeAgAAUcAD//6KDIA== Date: Wed, 7 Aug 2019 17:53:44 +0000 Message-ID: <2A35EA60C3C77D438915767F458D6568B8F7FE5B@ORSMSX111.amr.corp.intel.com> References: <15504838.vxEf1mJfsr@no.place.like.home> <1955050.cYikG52F1y@no.place.like.home> In-Reply-To: <1955050.cYikG52F1y@no.place.like.home> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiN2NkZTkwNDktNDQ4Mi00ZmI5LWIyYjYtYmZkNTA0YTAzZDUzIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiTWFIcE1KanlEV2xSaUMwckVFdk00cTZFRlNib2NrUVNnT0hYdmVLNmN5OXdYaVhrelhMend4RHJcL2pVM0dIelwvIn0= x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.2.0.6 dlp-reaction: no-action x-originating-ip: [10.22.254.138] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Rspamd-Queue-Id: 463fJC6Vzzz4502 X-Spamd-Bar: ---------- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=intel.com; spf=pass (mx1.freebsd.org: domain of jeffrey.e.pieper@intel.com designates 192.55.52.88 as permitted sender) smtp.mailfrom=jeffrey.e.pieper@intel.com X-Spamd-Result: default: False [-10.07 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:192.55.52.88/32]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TAGGED_RCPT(0.00)[freebsd-stable]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.993,0]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[intel.com,none]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:4983, ipnet:192.55.52.0/24, country:US]; RCVD_IN_DNSWL_HI(-0.50)[88.52.55.192.list.dnswl.org : 127.0.9.3]; IP_SCORE(-3.78)[ip: (-9.91), ipnet: 192.55.52.0/24(-4.96), asn: 4983(-3.96), country: US(-0.05)]; WHITELIST_SPF_DKIM(-3.00)[intel.com:s:+] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 17:53:49 -0000 Please file a PR @ https://bugs.freebsd.org/bugzilla/enter_bug.cgi Thanks, Jeff -----Original Message----- From: owner-freebsd-stable@freebsd.org O= n Behalf Of Greg Rivers Sent: Wednesday, August 07, 2019 6:27 PM To: freebsd-stable@freebsd.org Cc: Sergey Akhmatov Subject: Re: Regression in IXGBE(4) on 12.0-RELEASE? On Wednesday, August 7, 2019 10:14:01 AM CDT Sergey Akhmatov wrote: > $ freebsd-version > 12.0-RELEASE-p7 >=20 > $ pciconf -lvc ix0 > ix0@pci0:17:0:0: class=3D0x020000 card=3D0x7a128086 chip=3D0x10fb8= 086=20 > rev=3D0x01 hdr=3D0x00 > vendor =3D 'Intel Corporation' > device =3D '82599ES 10-Gigabit SFI/SFP+ Network Connection' > class =3D network > subclass =3D ethernet > cap 01[40] =3D powerspec 3 supports D0 D3 current D0 > cap 05[50] =3D MSI supports 1 message, 64 bit, vector masks > cap 11[70] =3D MSI-X supports 64 messages, enabled > Table in map 0x20[0x0], PBA in map 0x20[0x2000] > cap 10[a0] =3D PCI-Express 2 endpoint max data 256(512) FLR RO NS > link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) > ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 1 corrected > ecap 0003[140] =3D Serial 1 90e2baffff809b08 > ecap 000e[150] =3D ARI 1 > ecap 0010[160] =3D SR-IOV 1 IOV disabled, Memory Space disabled,=20 > ARI disabled > 0 VFs configured out of 64 supported > First VF RID Offset 0x0180, VF RID Stride 0x0002 > VF Device ID 0x10ed > Page Sizes: 4096 (enabled), 8192, 65536, 262144,=20 > 1048576, 4194304 >=20 Thank you Sergey. Good call adding -c to list capabilities. There are some = differences between your card and mine (I also added -e to list errors): $ freebsd-version = = 12.0-RELEASE-p9 $ pciconf -lvce ix0 ix0@pci0:17:0:0: class=3D0x020000 card=3D0x17d3103c chip=3D0x10fb808= 6 rev=3D0x01 hdr=3D0x00 vendor =3D 'Intel Corporation' device =3D '82599ES 10-Gigabit SFI/SFP+ Network Connection' class =3D network subclass =3D ethernet cap 01[40] =3D powerspec 3 supports D0 D3 current D0 cap 05[50] =3D MSI supports 1 message, 64 bit, vector masks enabled wit= h 1 message cap 11[70] =3D MSI-X supports 64 messages Table in map 0x1c[0x0], PBA in map 0x1c[0x2000] cap 10[a0] =3D PCI-Express 2 endpoint max data 256(512) FLR RO NS link x8(x8) speed 5.0(5.0) ASPM disabled(L0s) cap 03[e0] =3D VPD ecap 0001[100] =3D AER 1 0 fatal 0 non-fatal 1 corrected ecap 0003[140] =3D Serial 1 48df37ffff62be38 ecap 000e[150] =3D ARI 1 ecap 0010[160] =3D SR-IOV 1 IOV disabled, Memory Space disabled, ARI en= abled 0 VFs configured out of 64 supported First VF RID Offset 0x0080, VF RID Stride 0x0002 VF Device ID 0x10ed Page Sizes: 4096 (enabled), 8192, 65536, 262144, 10485= 76, 4194304 PCI-e errors =3D Correctable Error Detected Unsupported Request Detected Corrected =3D Advisory Non-Fatal Error I confirmed that it's not just a difference between hosts; when I boot the = 11.3-RELEASE memstick image on this very same machine the NIC is properly c= onfigured with all 8 queues. So it's almost certainly a difference between = ixgbe driver versions. I don't know if it matters, but this is an HPE brand= ed Intel NIC in a DL380 Gen10. -- Greg _______________________________________________ freebsd-stable@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-stable To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" From owner-freebsd-stable@freebsd.org Wed Aug 7 22:49:30 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6FA5DBA69B for ; Wed, 7 Aug 2019 22:49:30 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from roadkill.tharned.org (tunnel294749-pt.tunnel.tserv9.chi1.ipv6.he.net [IPv6:2001:470:1f10:107f::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "tharned.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 463msP3J3mz4S50 for ; Wed, 7 Aug 2019 22:49:28 +0000 (UTC) (envelope-from gcr+freebsd-stable@tharned.org) Received: from flake.tharned.org ([IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705]) (authenticated bits=0) by roadkill.tharned.org (8.15.2/8.15.2) with ESMTPSA id x77LvAJ0016519 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 7 Aug 2019 16:57:11 -0500 (CDT) (envelope-from gcr+freebsd-stable@tharned.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tharned.org; s=2017; t=1565215031; bh=ypJR9rPUM6RNJ2nHe+iNmuN843KT0tZy5uDaJqYGIVg=; h=From:To:Subject:Date:In-Reply-To:References; b=nstlVZhpMmNxif3zbC3T2mk427zbll1OZtHdHMl9EYu5ijXEs74L/W0QdbNV/Gffh 0CyS7Q1QN/4qcQMk0ZTlwZcj6IkUUXpaUeHfwutReLwh48KhLO0uD17wToaM0TrGbK OtvobSNCAhNjYs2gsLGfGhI1pc9CaI+eWYnke47dSgL0A+7DtWPli9yPeDUBhTbUrm 1f+Hp4CQ31xLEuWWG/cc03wfX9FmBMOVXy2O6f8376WeH0UtelecmGLXjEX7gCeiap lOg8W13DGDw9yMRyMJyd2qljp69UvL8CQeCz6hDcmNd2D6oWjE8UU1swyfRqwHZ/4x bkR/IrSV7hCOg== X-Authentication-Warning: roadkill.tharned.org: Host [IPv6:2001:470:1f11:107f:6e:6ea1:3618:4705] claimed to be flake.tharned.org From: Greg Rivers To: "Pieper, Jeffrey E" , freebsd-stable@freebsd.org Subject: Re: Regression in IXGBE(4) on 12.0-RELEASE? Date: Wed, 07 Aug 2019 16:57:10 -0500 Message-ID: <10238453.tl44eWmHdd@no.place.like.home> In-Reply-To: <2A35EA60C3C77D438915767F458D6568B8F7FE5B@ORSMSX111.amr.corp.intel.com> References: <15504838.vxEf1mJfsr@no.place.like.home> <1955050.cYikG52F1y@no.place.like.home> <2A35EA60C3C77D438915767F458D6568B8F7FE5B@ORSMSX111.amr.corp.intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Greylist: Sender succeeded SMTP AUTH, not delayed by milter-greylist-4.6.2 (roadkill.tharned.org [IPv6:2001:470:1f10:107f:0:0:0:2]); Wed, 07 Aug 2019 16:57:11 -0500 (CDT) X-Rspamd-Queue-Id: 463msP3J3mz4S50 X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tharned.org header.s=2017 header.b=nstlVZhp; dmarc=none; spf=none (mx1.freebsd.org: domain of gcr@tharned.org has no SPF policy when checking 2001:470:1f10:107f::2) smtp.mailfrom=gcr@tharned.org X-Spamd-Result: default: False [2.63 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; HAS_XAW(0.00)[]; DKIM_TRACE(0.00)[tharned.org:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.91)[-0.913,0]; FROM_EQ_ENVFROM(0.00)[]; IP_SCORE(-1.50)[ipnet: 2001:470::/32(-4.49), asn: 6939(-2.94), country: US(-0.05)]; SUBJECT_ENDS_QUESTION(1.00)[]; CTE_CASE(0.50)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; TAGGED_FROM(0.00)[freebsd-stable]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.98)[-0.978,0]; R_DKIM_ALLOW(0.00)[tharned.org:s=2017]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_MED(-2.00)[tharned.org.dwl.dnswl.org : 127.0.6.2]; NEURAL_HAM_LONG(-0.98)[-0.982,0]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[tharned.org]; BAD_REP_POLICIES(0.10)[]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[]; URIBL_BLACK(7.50)[tharned.org.multi.uribl.com]; RCVD_COUNT_TWO(0.00)[2]; GREYLIST(0.00)[pass,body]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Aug 2019 22:49:30 -0000 On Wednesday, August 7, 2019 12:53:44 PM CDT Pieper, Jeffrey E wrote: > Please file a PR @ https://bugs.freebsd.org/bugzilla/enter_bug.cgi > Thanks Jeff. . -- Greg From owner-freebsd-stable@freebsd.org Fri Aug 9 18:09:43 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D95C5CE22D for ; Fri, 9 Aug 2019 18:09:43 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 464tYg4WzSz3Ly3 for ; Fri, 9 Aug 2019 18:09:43 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 9B5E7CE22B; Fri, 9 Aug 2019 18:09:43 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9B1F9CE22A for ; Fri, 9 Aug 2019 18:09:43 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-ot1-x32e.google.com (mail-ot1-x32e.google.com [IPv6:2607:f8b0:4864:20::32e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 464tYf66Bsz3Ly2 for ; Fri, 9 Aug 2019 18:09:42 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-ot1-x32e.google.com with SMTP id z17so17516130otk.13 for ; Fri, 09 Aug 2019 11:09:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=N3PV9buf9C6S99dYrlNqKr+l6TRzWXJ1m383gRlyzm4=; b=Fu4ORxs/G1MKvXgsuqOVWZde+oti2VF+Owg/sFqPL25Xg/04P0jidIIaNdV9xpfHTb 4FNys4/Eu3al0y4KtW3c/gVjZSUy/NuYbVH3A2REckqMk2eJ/0TALaLaXw0vQmsPVsCe PMdkREjo07TPEWCJ+Ghk5NOZKg0DMGBqGSxYlz0rPuWEoh4OacN3w5Jj04R2xGWCuJWk sYG7TLiPADmmB9993JVapqbQL7DOnT1ZGvuI3OYDwZmQ+TuxmLOQ358VPt3MpmR31cZz l1/sKdvNwGmOoBvwJpouRM3gos0i5Wt0oJe7htLzSJRMPQxi3RR7zcUJjpw/4GqwgkB7 HUdA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=N3PV9buf9C6S99dYrlNqKr+l6TRzWXJ1m383gRlyzm4=; b=lex/1D6BhspffhyBgGG+41GILn5VnqTV7EKQaBezfht7g79B4XZdcIYFcClVrdbL/e n+C7FudGxjPkf0bb8T3g9YPa1pM5zoeRrkeJ4euByDeDmanEGy4z4CNKh7YNtM7xe5Et 2HxAedZibABXlKL+BQvYTHS7eb5IB6haY75DTJ04nqt6mdJHO9kvabnq/6YxfOtC2/14 AYX2TJzazZf5MbXO0MQN+MLitVBQPoQZCPPwu4EJyw1aOIP+KwCVnEvygLjJKl2EmBzA McCBEOxO6m2L+dbta5icbDX7N+ZqBouCnFEOyyHzn6affiAq8UV6sRpw7cUV3tqoj8jR fYcA== X-Gm-Message-State: APjAAAUWuWRrA6rqbJdNidxgV1+TbK9BtPtAhNrTG4os/DQdKeWAXmfP 7g/2kiDtBgHSuj+YXXYtt802XsKpusmsOR7cyi4r835F X-Google-Smtp-Source: APXvYqy5iFKcXAcKjDixtu0Wq8MwcSVHKdhlN8lP+kESwD2YTSRW2h7hPW1/xEE91m8YYac4k1oBu/QS3hCRuVuOruQ= X-Received: by 2002:aca:4806:: with SMTP id v6mr7400720oia.133.1565374181164; Fri, 09 Aug 2019 11:09:41 -0700 (PDT) MIME-Version: 1.0 From: Kevin Oberman Date: Fri, 9 Aug 2019 11:09:24 -0700 Message-ID: Subject: Memory management changes after kernel update on 6-Aug To: FreeBSD Stable ML X-Rspamd-Queue-Id: 464tYf66Bsz3Ly2 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Fu4ORxs/; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of kob6558@gmail.com designates 2607:f8b0:4864:20::32e as permitted sender) smtp.mailfrom=kob6558@gmail.com X-Spamd-Result: default: False [-3.70 / 15.00]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-1.00)[-0.998,0]; FORGED_SENDER(0.30)[rkoberman@gmail.com,kob6558@gmail.com]; IP_SCORE(0.00)[ip: (-9.12), ipnet: 2607:f8b0::/32(-2.98), asn: 15169(-2.40), country: US(-0.05)]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[rkoberman@gmail.com,kob6558@gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; IP_SCORE_FREEMAIL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[e.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Aug 2019 18:09:43 -0000 Since I updated my 12.0-STABLE system on 6-Aug I have been seeing issues resuming my Win7 VM on VirtualBox. My prior kernel was built on 24-Jul. If there is not sufficient memory available to reload the system (4 Meg.), the resume fails with a message that memory was exhausted. Usually I can try resuming again and it will work. Sometimes I get the error two or three times before the system resumes. Since I have not touched VirtualBox other than to rebuild the kmod after the kernel build, it looks like something in the OS triggered this. Since the system frees up some memory each time so that the VM eventually resumes, it looks like the memory request is made to the OS, but VB is not waiting or not enough memory is freed to allow the VB to complete the resume. Any clue what might have changed over those 13 days? I am running GENERIC except that I run the 4BSD scheduler. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Fri Aug 9 18:35:53 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CBA9DCEA17 for ; Fri, 9 Aug 2019 18:35:53 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 464v7s42yWz3N8Y for ; Fri, 9 Aug 2019 18:35:53 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 88E2ACEA16; Fri, 9 Aug 2019 18:35:53 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 88A53CEA15 for ; Fri, 9 Aug 2019 18:35:53 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-ot1-x344.google.com (mail-ot1-x344.google.com [IPv6:2607:f8b0:4864:20::344]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 464v7s0NPyz3N8W for ; Fri, 9 Aug 2019 18:35:52 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-ot1-x344.google.com with SMTP id k18so4137607otr.3 for ; Fri, 09 Aug 2019 11:35:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=xp5nEJogvrbQcdqb6MDFO37njnyDeN4hXhTZwIRo3xI=; b=JRkG3tNU7w/LlFCEWzgsy5PKcNDz5yttppxe/ngMwI8IjjKHO7pMiFYCxpbi3tqEJp 1r14wH2DkRr5itQNS8+h6QW8pXt3SWGbUNbfBhUfg12k8guPzx7LXMBtwRC2Vu5hr8mA AvMaWzEkt4HQ0y1rjm6dMsfY6+U5OsBLFU/CiQJzpboBIoFQ6pjY/hWSA7Dbk0stw7Ha olQl14zr3rm3Nm5D0GW3pnYE+ADho2+4zdpvcZ3U8Uc62ZVb21O+awiIH7aJxteRb1Hf xkQ4M21PkpG4503xV5twciYVoNLhzK5rk7gEbGI/3oKXG21GxXVpuhs6rNxwmiisNYDz UG+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=xp5nEJogvrbQcdqb6MDFO37njnyDeN4hXhTZwIRo3xI=; b=Iw5e8eLOkPe4U9sAkyleOU61YsJWBYxnRDNBvfDD0S1nZxwH26DoVhRW/Au18IAGYJ ap54WaunR7h3RC8LEJIpUS8PtwWfCrI1U8HL0EhG0CUElu9wkYaSSSBdXAcsy73rMppq 7Gq7TiFVR14DHwWp2Yh2itao+HZm+jCXztW9ORsc1Ci5qKqx91ce53g4fw09bWZAKCc5 lmhmK/27XsSDKXv4SR17xwmi5Oo4uiez+J47RlP8sh6PO86ZDtnUEDi1a3/ypPEDIUpW rD0sLv7ojErEIN7kovia6JitM1KYRghlt9UQhP9i6zYKBsURBSyA/Luk6CjLJeStUzfS ClCg== X-Gm-Message-State: APjAAAWzBT2KKg5hvEIAG8qjqc4VNdvO8CyUvw2mP/UJhyyr4B/YdDKE 3kQAorNixTOkZYh+zKHvoak= X-Google-Smtp-Source: APXvYqwDtHFEMPb97Liub/sL4Rk69x+vl9hNGI1+js5Rsw2EhSAyR8dE3ADZHSfnmMB7hw7rHyGR6w== X-Received: by 2002:a5d:80c1:: with SMTP id h1mr356452ior.268.1565375751788; Fri, 09 Aug 2019 11:35:51 -0700 (PDT) Received: from raichu (toroon0560w-lp130-04-184-145-252-124.dsl.bell.ca. [184.145.252.124]) by smtp.gmail.com with ESMTPSA id l2sm10494860ioq.83.2019.08.09.11.35.49 (version=TLS1_3 cipher=AEAD-AES256-GCM-SHA384 bits=256/256); Fri, 09 Aug 2019 11:35:50 -0700 (PDT) Sender: Mark Johnston Date: Fri, 9 Aug 2019 14:35:47 -0400 From: Mark Johnston To: Kevin Oberman Cc: FreeBSD Stable ML Subject: Re: Memory management changes after kernel update on 6-Aug Message-ID: <20190809183547.GE86532@raichu> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.1 (2019-06-15) X-Rspamd-Queue-Id: 464v7s0NPyz3N8W X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=JRkG3tNU; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::344 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-3.08 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.92)[-0.918,0]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[124.252.145.184.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-0.46)[ip: (3.12), ipnet: 2607:f8b0::/32(-2.98), asn: 15169(-2.40), country: US(-0.05)]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[4.4.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Aug 2019 18:35:53 -0000 On Fri, Aug 09, 2019 at 11:09:24AM -0700, Kevin Oberman wrote: > Since I updated my 12.0-STABLE system on 6-Aug I have been seeing issues > resuming my Win7 VM on VirtualBox. My prior kernel was built on 24-Jul. If > there is not sufficient memory available to reload the system (4 Meg.), the Where does this number come from? What memory usage stats do you see in top(1) when the error occurs? > resume fails with a message that memory was exhausted. Usually I can try > resuming again and it will work. Sometimes I get the error two or three > times before the system resumes. What exactly is the error message? > Since I have not touched VirtualBox other than to rebuild the kmod after > the kernel build, it looks like something in the OS triggered this. Since > the system frees up some memory each time so that the VM eventually > resumes, it looks like the memory request is made to the OS, but VB is not > waiting or not enough memory is freed to allow the VB to complete the > resume. > > Any clue what might have changed over those 13 days? I am running GENERIC > except that I run the 4BSD scheduler. Possible culprits are r350374 and r350375, but I can't really see how. From owner-freebsd-stable@freebsd.org Fri Aug 9 20:06:09 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id ED2D5A8697 for ; Fri, 9 Aug 2019 20:06:09 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 464x814gn7z3ygy for ; Fri, 9 Aug 2019 20:06:09 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id A0244A8696; Fri, 9 Aug 2019 20:06:09 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9FE82A8695 for ; Fri, 9 Aug 2019 20:06:09 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-ot1-x330.google.com (mail-ot1-x330.google.com [IPv6:2607:f8b0:4864:20::330]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 464x813l8rz3ygx; Fri, 9 Aug 2019 20:06:09 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-ot1-x330.google.com with SMTP id b7so86957418otl.11; Fri, 09 Aug 2019 13:06:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=/gZUS+GyfuiKEaLF8cDMw1KCvKUJFdodETmGoh8hp0s=; b=F55lM3NjRNWH5L/leD9WgfYm/ZtZLj+iJ/Z6nJ8dD7BLIVZ24GntSUsL9bHEm8quuE a2MgEgcT4vm+wy/ESobzvr1RWraYRO7t67bQRAGpP2OefFdgMJDYpfj5M2e9QhpWITAq jWSRC6z7yEOAGeiqCzSve55IQXz/1p1bjgY7FC5NwUgkihUjYuJpBg2ImIpwRyymuVAB SBRzL8QQz+Xy1tfA/IZOc/5+yeAU+QUGAIB7KZmV/2ybIdYwNCkCB3W66OMegC4NvMsi zGCXO4b3ZMZ3OrpzFkXFqQkUumPIQOwJBtJwbpr7ZkgBZCq6lVpTKP6AIjVnYkaVrbwh H0EA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=/gZUS+GyfuiKEaLF8cDMw1KCvKUJFdodETmGoh8hp0s=; b=rHtVn5Cg9z4Tod4hd3gOaD3hGaeWNtx7t+DTLDl/h4sBVgCp/iBbyOLnBwFuj2wg/V gm4FQNKIA7bckx71YBs99V1MjJPBblpxYXWHxG2teNa9b5KZba4QFQ9jgmj2GntF0ety nXOhxPzEjDY8AOv1lA3qIHGIoOuNlH6sGMViIkqlSyzyF+pORTOmy24MKznJ4XtAKb/u dwcOY7UK0wroG/Wdtx03IHZ0xjQHHusRk0s77AayNEJDHvlqG47IJpE7NGUmNazVTTr1 IE5+ZlK7LDTLw/zJfrUhCvwWlkdFP6GZxudbeHhV4CKOV17PcrJMPTdV+pSoR+pJXwpn FYnA== X-Gm-Message-State: APjAAAWPUKl6Wh86FJNrh5IX0wt1MWRCvGrl3ZR/0BP2jAytNxC+MfZH iheoKkLYoPFIxA0Kk1qY2Kl23geiaGb2tzrKUNSDtwYZYJQ= X-Google-Smtp-Source: APXvYqzGYUhx9XavtRn6/hwUn1AdfReZ/VTiYAJRsIn7jnYjgkHVM7aUqYwrKagxZB6u2bRI0H4pFaKIbfDGBwxYY/0= X-Received: by 2002:aca:1c02:: with SMTP id c2mr7634215oic.166.1565381167718; Fri, 09 Aug 2019 13:06:07 -0700 (PDT) MIME-Version: 1.0 References: <20190809183547.GE86532@raichu> In-Reply-To: <20190809183547.GE86532@raichu> From: Kevin Oberman Date: Fri, 9 Aug 2019 13:05:50 -0700 Message-ID: Subject: Re: Memory management changes after kernel update on 6-Aug To: Mark Johnston Cc: FreeBSD Stable ML X-Rspamd-Queue-Id: 464x813l8rz3ygx X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-6.98 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.982,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Aug 2019 20:06:10 -0000 On Fri, Aug 9, 2019 at 11:35 AM Mark Johnston wrote: > On Fri, Aug 09, 2019 at 11:09:24AM -0700, Kevin Oberman wrote: > > Since I updated my 12.0-STABLE system on 6-Aug I have been seeing issues > > resuming my Win7 VM on VirtualBox. My prior kernel was built on 24-Jul. > If > > there is not sufficient memory available to reload the system (4 Meg.), > the > > Where does this number come from? What memory usage stats do you see in > top(1) when the error occurs? > I am monitoring memory usage with gkrellm. It appears to define "Free" as the sum of "Inactive" and "Free". If you are referring to size of the VM, was supposed to be the memory specified when I created the VM, but my fingers got ahead of my brain and it should have been 4G, not 4M. Hey! What's a few orders of magnitude? Oddly, when I watch memory space closely I note that, as the VM loads, I started seeing swap utilization increase as free space was exhausted at about 80% loaded. Loading continued to 98%. at that point loading stopped and swap use continued to grow for a bit. Then free space started to increase from about 300M to about 700M before the error window popped up. > > resume fails with a message that memory was exhausted. Usually I can try > > resuming again and it will work. Sometimes I get the error two or three > > times before the system resumes. > > What exactly is the error message? > Failed to open a session for the virtual machine Win7. Failed to load unit 'pgm' (VERR_EM_NO_MEMORY). Result Code: NS_ERROR_FAILURE (0x80004005) Component: ConsoleWrap Interface: IConsole {872da645-4a9b-1727-bee2-5585105b9eed} > > > Since I have not touched VirtualBox other than to rebuild the kmod after > > the kernel build, it looks like something in the OS triggered this. Since > > the system frees up some memory each time so that the VM eventually > > resumes, it looks like the memory request is made to the OS, but VB is > not > > waiting or not enough memory is freed to allow the VB to complete the > > resume. > > > > Any clue what might have changed over those 13 days? I am running GENERIC > > except that I run the 4BSD scheduler. > > Possible culprits are r350374 and r350375, but I can't really see how. > This started after the 6-Aug build (r350664). My prior build was r350292, so just before these two commits. Can I try just reverting these two? Once I do, it will need to run for a while or do something to tie up a lot of memory before the error will recur. In normal use it is a matter of firefox increasing resident memory until there is not enough free memory to load the VM without swapping. (These days I often see the sum of all firefox process resident memory exceeding 3G after it's been up for a day or two. Still, not worse than chromium.) Thanks, Mark, for the quick response. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683 From owner-freebsd-stable@freebsd.org Fri Aug 9 21:16:18 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7E026AA29F for ; Fri, 9 Aug 2019 21:16:18 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 464yhy1nccz43Tk for ; Fri, 9 Aug 2019 21:16:18 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id 3D534AA29E; Fri, 9 Aug 2019 21:16:18 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3D134AA29D for ; Fri, 9 Aug 2019 21:16:18 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-ot1-x344.google.com (mail-ot1-x344.google.com [IPv6:2607:f8b0:4864:20::344]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 464yhx16z5z43Tj for ; Fri, 9 Aug 2019 21:16:16 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-ot1-x344.google.com with SMTP id n5so137960066otk.1 for ; Fri, 09 Aug 2019 14:16:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=gcxUP6bHXuQdMuIF1WJ7Pvm+PekKzeu05mulLi4Dh40=; b=tIAs7RAFUN2jULO4VeuvxFAMD7RqIGMZqN4zcD/lg73nRvLCun97AAP/3pNEIIE7GY cTauJ8FvZy4iaY80qvOJmchREUikNqRqLX81okJGtyDG3q0PpvNj758PCQ2jTCWHS878 l5Y1ckzHSr//t9NeoBXAAqmrb8UjepZIIKRf10j/pL28ACuDq1u+2wEwUUloDkLtW9YL geCh8oLc19rc7XBiG1XAJifGGT1CGgPh3N6JP+ort9chAZ0THGQIkFV8HbGytyx84uok cl70sUzVFIdFJ7xUD/drw77jIgQyPYn/zhWjF5RM3ECqPZNFkF1XJRqmFrVguN1cKfOf xCrg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=gcxUP6bHXuQdMuIF1WJ7Pvm+PekKzeu05mulLi4Dh40=; b=FBsikYwUhP5GsGaPQYalInFzi5WRnaQG4uI/ysv3NAnOQashT/F0QbWShTq9xotIHU V/jEc0QiH7EmZubVrj6neqJixD8U9jz8b3D9NMiQqaf/1QCTqWmSfG8Vu7UhD3600jNu U3AxXRCyn9pL5PO6bGRupY5EMdhXn+4BrIj1B2343y2jt8fZrpGdAQN0GWYqjB+tKGu4 Ldmkk1Ynf0z+GW6x/uKux+Pp2XvvlLS4UMOLhrG9KS9tcHVBEUbiu5pPrYcz9KEHzjuy haLFQpvxzYzTrNlg+D05PXtjfFfF9eIjOtaXvqmpSzw87auGUpAEPqyWSvrv6nB75g1s jirw== X-Gm-Message-State: APjAAAUuume8v7Zt+HQRQDlA1C2uY37OoSD3W2knKRmkSqcop+YMemSN ILadIre8i4K97ykl6Ago9Bw= X-Google-Smtp-Source: APXvYqwIsI/MMkblBo/FpCE3f1old4pJKjBLNvUhX62l/NN7kFRXOe3yNQmFvMgB13+IkB+ofBbQiA== X-Received: by 2002:a5d:8b4d:: with SMTP id c13mr9973997iot.151.1565385376000; Fri, 09 Aug 2019 14:16:16 -0700 (PDT) Received: from raichu (toroon0560w-lp130-04-184-145-252-124.dsl.bell.ca. [184.145.252.124]) by smtp.gmail.com with ESMTPSA id 8sm78225730ion.26.2019.08.09.14.16.14 (version=TLS1_3 cipher=AEAD-AES256-GCM-SHA384 bits=256/256); Fri, 09 Aug 2019 14:16:14 -0700 (PDT) Sender: Mark Johnston Date: Fri, 9 Aug 2019 17:16:12 -0400 From: Mark Johnston To: Kevin Oberman Cc: FreeBSD Stable ML Subject: Re: Memory management changes after kernel update on 6-Aug Message-ID: <20190809211612.GF86532@raichu> References: <20190809183547.GE86532@raichu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.1 (2019-06-15) X-Rspamd-Queue-Id: 464yhx16z5z43Tj X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=tIAs7RAF; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::344 as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-3.15 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.99)[-0.987,0]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; RECEIVED_SPAMHAUS_PBL(0.00)[124.252.145.184.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11]; MIME_TRACE(0.00)[0:+]; IP_SCORE(-0.46)[ip: (3.11), ipnet: 2607:f8b0::/32(-2.98), asn: 15169(-2.40), country: US(-0.05)]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[4.4.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Aug 2019 21:16:18 -0000 On Fri, Aug 09, 2019 at 01:05:50PM -0700, Kevin Oberman wrote: > On Fri, Aug 9, 2019 at 11:35 AM Mark Johnston wrote: > > > On Fri, Aug 09, 2019 at 11:09:24AM -0700, Kevin Oberman wrote: > > > Since I updated my 12.0-STABLE system on 6-Aug I have been seeing issues > > > resuming my Win7 VM on VirtualBox. My prior kernel was built on 24-Jul. > > If > > > there is not sufficient memory available to reload the system (4 Meg.), > > the > > > > Where does this number come from? What memory usage stats do you see in > > top(1) when the error occurs? > > > > I am monitoring memory usage with gkrellm. It appears to define "Free" as > the sum of "Inactive" and "Free". If you are referring to size of the VM, > was supposed to be the memory specified when I created the VM, but my > fingers got ahead of my brain and it should have been 4G, not 4M. Hey! > What's a few orders of magnitude? > > Oddly, when I watch memory space closely I note that, as the VM loads, I > started seeing swap utilization increase as free space was exhausted at > about 80% loaded. Loading continued to 98%. at that point loading stopped > and swap use continued to grow for a bit. Then free space started to > increase from about 300M to about 700M before the error window popped up. > > > > > resume fails with a message that memory was exhausted. Usually I can try > > > resuming again and it will work. Sometimes I get the error two or three > > > times before the system resumes. > > > > What exactly is the error message? > > > Failed to open a session for the virtual machine Win7. > > Failed to load unit 'pgm' (VERR_EM_NO_MEMORY). > > Result Code: NS_ERROR_FAILURE (0x80004005) > Component: ConsoleWrap > Interface: IConsole {872da645-4a9b-1727-bee2-5585105b9eed} > > > > > > > Since I have not touched VirtualBox other than to rebuild the kmod after > > > the kernel build, it looks like something in the OS triggered this. Since > > > the system frees up some memory each time so that the VM eventually > > > resumes, it looks like the memory request is made to the OS, but VB is > > not > > > waiting or not enough memory is freed to allow the VB to complete the > > > resume. > > > > > > Any clue what might have changed over those 13 days? I am running GENERIC > > > except that I run the 4BSD scheduler. > > > > Possible culprits are r350374 and r350375, but I can't really see how. > > > > This started after the 6-Aug build (r350664). My prior build was r350292, > so just before these two commits. > > Can I try just reverting these two? Once I do, it will need to run for a > while or do something to tie up a lot of memory before the error will > recur. In normal use it is a matter of firefox increasing resident memory > until there is not enough free memory to load the VM without swapping. > (These days I often see the sum of all firefox process resident memory > exceeding 3G after it's been up for a day or two. Still, not worse than > chromium.) Those commits can simply be reverted, but I am skeptical that they will help. You should also verify that these same conditions don't lead to errors on your prior build, if you haven't already. From owner-freebsd-stable@freebsd.org Fri Aug 9 21:51:09 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2563FAB29E; Fri, 9 Aug 2019 21:51:09 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 464zT90GNTz45cC; Fri, 9 Aug 2019 21:51:09 +0000 (UTC) (envelope-from lwhsu@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 1129) id DBE047192; Fri, 9 Aug 2019 21:51:08 +0000 (UTC) Date: Fri, 9 Aug 2019 21:51:08 +0000 From: Li-Wen Hsu To: freebsd-testing@freebsd.org Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Subject: FreeBSD CI Weekly Report 2019-08-04 Message-ID: <20190809215108.GA43519@freefall.freebsd.org> Reply-To: freebsd-testing@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.11.4 (2019-03-13) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Aug 2019 21:51:09 -0000 (Please send the followup to freebsd-testing@ and note Reply-To is set.) FreeBSD CI Weekly Report 2019-08-04 =================================== Here is a summary of the FreeBSD Continuous Integration results for the period from 2019-07-29 to 2019-08-04. During this period, we have: * 1662 builds (95.8% (-1.3) passed, 4.2% (+1.3) failed) were executed on aarch64, amd64, armv6, armv7, i386, mips, mips64, powerpc, powerpc64, powerpcspe, riscv64, sparc64 architectures for head, stable/12, stable/11 branches. * 309 test runs (87.4% (+6.6) passed, 12.6% (-6.3) unstable, 0% (-0.3) exception) were executed on amd64, i386, riscv64 architectures for head, stable/12, stable/11 branches. * 18 doc builds (100% (+0) passed) Test case status (on 2019-07-28 23:59): | Branch/Architecture | Total | Pass | Fail | Skipped | | ------------------- | ---------- | --------- | ------- | -------- | | head/amd64 | 7460 (+0) | 7409 (+0) | 0 (+0) | 51 (+0) | | head/i386 | 7458 (+0) | 7400 (+0) | 0 (+0) | 58 (+0) | | 12-STABLE/amd64 | 7388 (+0) | 7344 (+0) | 0 (+0) | 44 (+0) | | 12-STABLE/i386 | 7386 (+0) | 7332 (-3) | 0 (+0) | 54 (+3) | | 11-STABLE/amd64 | 6845 (+0) | 6800 (+3) | 1 (+0) | 44 (-3) | | 11-STABLE/i386 | 6843 (+0) | 6760 (+1) | 34 (-1) | 49 (+0) | (The statistics from experimental jobs are omitted) If any of the issues found by CI are in your area of interest or expertise please investigate the PRs listed below. The latest web version of this report is available at https://hackmd.io/s/rkEiIYr7B and archive is available at http://hackfoldr.org/freebsd-ci-report/, any help is welcome. ## News * [FCP 20190401-ci_policy: CI policy ](https://github.com/freebsd/fcp/blob/master/fcp-20190401-ci_policy.md) is in "feedback" state, please check and provide comments. * We are skipping the test cases failing in CI system only when "ci" configuration variable is true. This value can be set in kyua.conf or cli as: `kyua -v test_suites.FreeBSD.ci=true test` ## Failing Tests * https://ci.freebsd.org/job/FreeBSD-stable-11-i386-test/ * local.kyua.* (31 cases) * local.lutok.* (3 cases) ## Failing and Flaky Tests (from experimental jobs) * https://ci.freebsd.org/job/FreeBSD-head-amd64-dtrace_test/ * Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d https://bugs.freebsd.org/237641 * https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/ * There are ~60 failing cases, including flakey ones, see https://ci.freebsd.org/job/FreeBSD-head-amd64-test_zfs/lastCompletedBuild/testReport/ for more details ## Disabled Tests * lib.libc.sys.mmap_test.mmap_truncate_signal https://bugs.freebsd.org/211924 * sys.fs.tmpfs.mount_test.large https://bugs.freebsd.org/212862 * sys.fs.tmpfs.link_test.kqueue https://bugs.freebsd.org/213662 * sys.kqueue.libkqueue.kqueue_test.main https://bugs.freebsd.org/233586 * sys.kern.ptrace_test.ptrace__PT_KILL_competing_stop https://bugs.freebsd.org/220841 * usr.bin.procstat.procstat_test.command_loogle.com/ine_arguments https://bugs.freebsd.org/233587 * usr.bin.procstat.procstat_test.environment https://bugs.freebsd.org/233588 * lib.libc.regex.exhaust_test.regcomp_too_big (i386 only) https://bugs.freebsd.org/237450 * sys.netinet.socket_afinet.socket_afinet_bind_zero (new) https://bugs.freebsd.org/238781 * sys.netpfil.pf.names.names * sys.netpfil.pf.synproxy.synproxy https://bugs.freebsd.org/238870 * sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger https://bugs.freebsd.org/239292 * sys.netpfil.pf.forward.v4 (i386 only) * sys.netpfil.pf.forward.v6 (i386 only) * sys.netpfil.pf.set_tos.v4 (i386 only) https://bugs.freebsd.org/239380 * sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger https://bugs.freebsd.org/239397 * sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger https://bugs.freebsd.org/239399 * sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger https://bugs.freebsd.org/239425 ## Issues ### Cause build fails * https://bugs.freebsd.org/233735 Possible build race: genoffset.o /usr/src/sys/sys/types.h: error: machine/endian.h: No such file or directory * https://bugs.freebsd.org/233769 Possible build race: ld: error: unable to find library -lgcc_s * https://bugs.freebsd.org/238828 Possible build race: lib/libsysdecode/tables.h:948: error: 'IPV6_MIN_MEMBERSHIPS' undeclared Patch available: https://reviews.freebsd.org/D21069 ### Cause kernel panics * https://bugs.freebsd.org/238870 sys.netpfil.pf.names.names and sys.netpfil.pf.synproxy.synproxy cause panic Patch exists: * https://reviews.freebsd.org/D20868 * https://reviews.freebsd.org/D20869 ### Open * https://bugs.freebsd.org/237077 possible race in build: /usr/src/sys/amd64/linux/linux_support.s:38:2: error: expected relocatable expression * https://bugs.freebsd.org/237403 Tests in sys/opencrypto should be converted to Python3 * https://bugs.freebsd.org/237641 Flakey test case: common.misc.t_dtrace_contrib.tst_dynopt_d * https://bugs.freebsd.org/237652 tests.hotspare.hotspare_test.hotspare_snapshot_001_pos timeout since somewhere in (r346814, r 346845] * https://bugs.freebsd.org/237655 Non-deterministic panic when running pf tests in interface ioctl code (NULL passed to strncmp) * https://bugs.freebsd.org/237656 "Freed UMA keg (rtentry) was not empty (18 items). Lost 1 pages of memory." seen when running sys/netipsec tests * https://bugs.freebsd.org/237657 sys.kern.pdeathsig.signal_delivered_ptrace timing out periodically on i386 * https://bugs.freebsd.org/238781 sys.netinet.socket_afinet.socket_afinet_bind_zero does not work when mac_portacl(4) loaded * https://bugs.freebsd.org/239292 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_child_detached_unrelated_debugger * https://bugs.freebsd.org/239380 sys.netpfil.pf.forward.{v4,v6} and sys.netpfil.pf.set_tos.v4 fail on i386 * https://bugs.freebsd.org/239397 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_both_attached_unrelated_debugger * https://bugs.freebsd.org/239399 Flakey test case: sys.kern.ptrace_test.ptrace__parent_sees_exit_after_child_debugger * https://bugs.freebsd.org/239425 Flakey test case: sys.kern.ptrace_test.ptrace__follow_fork_parent_detached_unrelated_debugger ### Others * [Tickets related to testing@](https://preview.tinyurl.com/y9maauwg) From owner-freebsd-stable@freebsd.org Sat Aug 10 00:34:33 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 667C2AE347 for ; Sat, 10 Aug 2019 00:34:33 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 46535h6jdCz4Djf for ; Sat, 10 Aug 2019 00:34:32 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mailman.nyi.freebsd.org (Postfix) id E1F0AAE346; Sat, 10 Aug 2019 00:34:32 +0000 (UTC) Delivered-To: stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E1674AE345 for ; Sat, 10 Aug 2019 00:34:32 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: from mail-ot1-x32f.google.com (mail-ot1-x32f.google.com [IPv6:2607:f8b0:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46535h5gVHz4Djd; Sat, 10 Aug 2019 00:34:32 +0000 (UTC) (envelope-from kob6558@gmail.com) Received: by mail-ot1-x32f.google.com with SMTP id q20so139224012otl.0; Fri, 09 Aug 2019 17:34:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=zfXxn7xJscnw4FMfrXMpVfKmKGkodne3vF6p6tiTbng=; b=buQh0xxEQa3fe26jCuJ+PENpEJDPRposPsQ7B1u+45OIatOpq7fWPvQSNXWbqvZ8EO pOcX8a3olOPLrJq9Ez5ZiKl/xMMY5kohvNt+/c4dyxqwFYo+gZge4M6wOg+7PHy9R8Lq mlNvzplxBNARaTwrQTGfEruPAVCKPCP5hDtOc7NMRoD6jXkuKjCc59UWIoO7ZTpFKyx7 zTS264Qu16iBOEYmDmUGJ5vMwmfPX0pzXy+00LZ00Oq37E4dI2auHJg89d8hGAZoJisN NDzBanZMh+6rZ101NW2a8hvh/ogO+onADIVki846pGkPDYbrj3YYoIByyt/HPLd9/Wm6 iRLw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=zfXxn7xJscnw4FMfrXMpVfKmKGkodne3vF6p6tiTbng=; b=bbhfkwkaD+yrMSrjJqYhj8k1yicUaRgi0F62c+y3zOW0hpjtBdQ3IMwVGWePxlASW2 1kq1D4CfMNzIOfGOE1Pfry6y2Krehb32X4lPszXSAWXxpvRl+J8TjZAZfn3ml9HBwd03 0PBlB7rrYZv+vFpt/Zdck0irurXwWPP2vlaHgsDcWCyBo7+w3GyobLZoZe29yFYdLGnd ol2/RDBdKzoREYOfv7Z0Ex1r0o43b6uYarl7AX5DKwro6vNU03c+ca32NmfL/uy3dRiS 6VLCtoDALRnjTkMwxH9U2y+Fg9aQl2W7xLbkWc42YTfd/vht+Rv4W6tvYkVbG9F5iOWY j+TA== X-Gm-Message-State: APjAAAUPZz0N0M8VhqCnyRErLSkbcwR8575cdU59aXlt+Dz4i3WPr0Es S3nj8nCI1aiVsRCUa/iCY6oN2Lmw97Qx/b8RgniFws1K1+8= X-Google-Smtp-Source: APXvYqwchFcIS/ex3O/08aSoVNkCMB8mKyKpHLh0hvJX3vH4ssr8vT/p51i5LmYPxDyu+yohGggZwLhOBEkjWqcOgRg= X-Received: by 2002:a9d:7988:: with SMTP id h8mr20346737otm.301.1565397270924; Fri, 09 Aug 2019 17:34:30 -0700 (PDT) MIME-Version: 1.0 References: <20190809183547.GE86532@raichu> <20190809211612.GF86532@raichu> In-Reply-To: <20190809211612.GF86532@raichu> From: Kevin Oberman Date: Fri, 9 Aug 2019 17:34:14 -0700 Message-ID: Subject: Re: Memory management changes after kernel update on 6-Aug To: Mark Johnston Cc: FreeBSD Stable ML X-Rspamd-Queue-Id: 46535h5gVHz4Djd X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-6.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; REPLY(-4.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.993,0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Aug 2019 00:34:33 -0000 On Fri, Aug 9, 2019 at 2:16 PM Mark Johnston wrote: > On Fri, Aug 09, 2019 at 01:05:50PM -0700, Kevin Oberman wrote: > > On Fri, Aug 9, 2019 at 11:35 AM Mark Johnston wrote: > > > > > On Fri, Aug 09, 2019 at 11:09:24AM -0700, Kevin Oberman wrote: > > > > Since I updated my 12.0-STABLE system on 6-Aug I have been seeing > issues > > > > resuming my Win7 VM on VirtualBox. My prior kernel was built on > 24-Jul. > > > If > > > > there is not sufficient memory available to reload the system (4 > Meg.), > > > the > > > > > > Where does this number come from? What memory usage stats do you see > in > > > top(1) when the error occurs? > > > > > > > I am monitoring memory usage with gkrellm. It appears to define "Free" as > > the sum of "Inactive" and "Free". If you are referring to size of the VM, > > was supposed to be the memory specified when I created the VM, but my > > fingers got ahead of my brain and it should have been 4G, not 4M. Hey! > > What's a few orders of magnitude? > > > > Oddly, when I watch memory space closely I note that, as the VM loads, I > > started seeing swap utilization increase as free space was exhausted at > > about 80% loaded. Loading continued to 98%. at that point loading stopped > > and swap use continued to grow for a bit. Then free space started to > > increase from about 300M to about 700M before the error window popped up. > > > > > > > > resume fails with a message that memory was exhausted. Usually I can > try > > > > resuming again and it will work. Sometimes I get the error two or > three > > > > times before the system resumes. > > > > > > What exactly is the error message? > > > > > Failed to open a session for the virtual machine Win7. > > > > Failed to load unit 'pgm' (VERR_EM_NO_MEMORY). > > > > Result Code: NS_ERROR_FAILURE (0x80004005) > > Component: ConsoleWrap > > Interface: IConsole {872da645-4a9b-1727-bee2-5585105b9eed} > > > > > > > > > > > Since I have not touched VirtualBox other than to rebuild the kmod > after > > > > the kernel build, it looks like something in the OS triggered this. > Since > > > > the system frees up some memory each time so that the VM eventually > > > > resumes, it looks like the memory request is made to the OS, but VB > is > > > not > > > > waiting or not enough memory is freed to allow the VB to complete the > > > > resume. > > > > > > > > Any clue what might have changed over those 13 days? I am running > GENERIC > > > > except that I run the 4BSD scheduler. > > > > > > Possible culprits are r350374 and r350375, but I can't really see how. > > > > > > > This started after the 6-Aug build (r350664). My prior build was r350292, > > so just before these two commits. > > > > Can I try just reverting these two? Once I do, it will need to run for a > > while or do something to tie up a lot of memory before the error will > > recur. In normal use it is a matter of firefox increasing resident memory > > until there is not enough free memory to load the VM without swapping. > > (These days I often see the sum of all firefox process resident memory > > exceeding 3G after it's been up for a day or two. Still, not worse than > > chromium.) > > Those commits can simply be reverted, but I am skeptical that they will > help. You should also verify that these same conditions don't lead to > errors on your prior build, if you haven't already. > OK. Running identical kernel except for 350374-5. Yes, I am sure that it was not happening with the r350292 kernel. I hit this quite consistently when firefox has been running for a while. Firefox has rss of just under 3G on startup and will slowly grow until I don't have the resources to run the Win7 VM without the error. Right now the VM completes loading with no swapping and about 800M of memory free after it is running. I'll let you know when it gets big enough to cause a problem and whether it fails. Probably won't happen until tomorrow. -- Kevin Oberman, Part time kid herder and retired Network Engineer E-mail: rkoberman@gmail.com PGP Fingerprint: D03FB98AFA78E3B78C1694B318AB39EF1B055683