From owner-freebsd-current@freebsd.org Sat Feb 23 03:26:49 2019 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0DC0E1504908 for ; Sat, 23 Feb 2019 03:26:49 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (troutmask.apl.washington.edu [128.95.76.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "troutmask", Issuer "troutmask" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C4DE86F317; Sat, 23 Feb 2019 03:26:46 +0000 (UTC) (envelope-from sgk@troutmask.apl.washington.edu) Received: from troutmask.apl.washington.edu (localhost [127.0.0.1]) by troutmask.apl.washington.edu (8.15.2/8.15.2) with ESMTPS id x1N3QiMD014068 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Fri, 22 Feb 2019 19:26:44 -0800 (PST) (envelope-from sgk@troutmask.apl.washington.edu) Received: (from sgk@localhost) by troutmask.apl.washington.edu (8.15.2/8.15.2/Submit) id x1N3QiEs014067; Fri, 22 Feb 2019 19:26:44 -0800 (PST) (envelope-from sgk) Date: Fri, 22 Feb 2019 19:26:44 -0800 From: Steve Kargl To: freebsd-current@freebsd.org Cc: kib@freebsd.org, pho@freebsd.org, markj@freebsd.org Subject: Re: r343567 aka PAE vs non-PAE merge breaks i386 freebsd Message-ID: <20190223032644.GA14058@troutmask.apl.washington.edu> Reply-To: sgk@troutmask.apl.washington.edu References: <20190222033924.GA25285@troutmask.apl.washington.edu> <20190222060410.GA25817@troutmask.apl.washington.edu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20190222060410.GA25817@troutmask.apl.washington.edu> User-Agent: Mutt/1.11.2 (2019-01-07) X-Rspamd-Queue-Id: C4DE86F317 X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [1.39 / 15.00]; ARC_NA(0.00)[]; HAS_REPLYTO(0.00)[sgk@troutmask.apl.washington.edu]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-0.52)[-0.523,0]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[washington.edu]; AUTH_NA(1.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; NEURAL_SPAM_SHORT(0.79)[0.786,0]; RCVD_IN_DNSWL_MED(-0.20)[21.76.95.128.list.dnswl.org : 127.0.11.2]; MX_GOOD(-0.01)[cached: troutmask.apl.washington.edu]; NEURAL_SPAM_MEDIUM(0.38)[0.377,0]; R_SPF_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:73, ipnet:128.95.0.0/16, country:US]; MID_RHS_MATCH_FROM(0.00)[]; IP_SCORE(0.06)[ip: (0.12), ipnet: 128.95.0.0/16(0.18), asn: 73(0.09), country: US(-0.07)] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Feb 2019 03:26:49 -0000 On Thu, Feb 21, 2019 at 10:04:10PM -0800, Steve Kargl wrote: > On Thu, Feb 21, 2019 at 07:39:25PM -0800, Steve Kargl wrote: > > r343567 merges the PAE vs non-PAE pmap headers for i386 > > freebsd. After bisection and dealing with the drm-legacy-kmod > > fallout, I bisected /usr/src to r343567. Building world and > > a GENERIC kernel and the minimum set of ports to start Xorg > > on my Dell Latitude D530 laptop, results in a black screen > > of death and a locked up laptop (no keyboard, mouse, or video). > > > > A comparison of /etc/log/Xorg.0.log for r343566 (Xorg loads > > and functions) and r353467 (Xorg black screen of death) shows > > that /boot/modules/i915kms.ko loads correctly as the log > > files are identical. > > > > Comparing dmesg for r343566 to r343567 shows the following > > > > --- dmesg.343566 2019-02-20 08:13:07.727202000 -0800 > > +++ dmesg.343567 2019-02-21 19:02:24.469562000 -0800 > > @@ -3,11 +3,11 @@ > > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > > The Regents of the University of California. All rights reserved. > > FreeBSD is a registered trademark of The FreeBSD Foundation. > > -FreeBSD 13.0-CURRENT r343566 GENERIC i386 > > +FreeBSD 13.0-CURRENT r343567 GENERIC i386 > > FreeBSD clang version 7.0.1 (tags/RELEASE_701/final 349250) (based on LLVM 7.0.1) > > WARNING: WITNESS option enabled, expect reduced performance. > > VT(vga): resolution 640x480 > > -CPU: Intel(R) Core(TM)2 Duo CPU T7250 @ 2.00GHz (1995.05-MHz 686-class CPU) > > +CPU: Intel(R) Core(TM)2 Duo CPU T7250 @ 2.00GHz (1995.04-MHz 686-class CPU) > > Origin="GenuineIntel" Id=0x6fd Family=0x6 Model=0xf Stepping=13 > > Features=0xbfebfbff > > Features2=0xe3bd > > @@ -16,7 +16,7 @@ > > VT-x: (disabled in BIOS) HLT,PAUSE > > TSC: P-state invariant, performance statistics > > real memory = 4294967296 (4096 MB) > > -avail memory = 3639914496 (3471 MB) > > +avail memory = 4154175488 (3961 MB) > > > > Somehow the r343567 kernel found an addition 490 MB of memory, > > which leads me to believe the after loading i915kms.ko there > > is some serious memory stomping issues. > > > > I willing to do whatever is necessary to fix this issue (shorter > > of mailing the laptop to someone). Is it possible to revert > > r343567 and move forward? > > > > More info from sysctl. With the "good" r343566, I see > > vm.kmem_map_free: 1187033088 > vm.kmem_map_size: 27234304 > vm.kmem_size_scale: 3 > vm.kmem_size_max: 1715470336 > vm.kmem_size_min: 12582912 > vm.kmem_zmax: 65536 > vm.kmem_size: 1214267392 > hw.physmem: 3714269184 > hw.usermem: 3650867200 > hw.realmem: 4294963200 > > With the problematic r343567, I see > > vm.kmem_map_free: 1683152896 > vm.kmem_map_size: 28123136 > vm.kmem_size_scale: 1 > vm.kmem_size_max: 1711276032 > vm.kmem_size_min: 12582912 > vm.kmem_zmax: 65536 > vm.kmem_size: 1711276032 > hw.physmem: 4252360704 > hw.usermem: 4146999296 > hw.realmem: 4294963200 > > Ideas? > Here's the 'diff -uw' between a verbose dmesg boot of r343566 and dmesg boot of r343567. The memory size looks rather puzzling. Can the people responsible for the i386 pmap.h merging take a look? --- dmesg.343566.verbose 2019-02-22 19:08:33.458559000 -0800 +++ dmesg.343567.verbose 2019-02-22 08:55:21.623310000 -0800 @@ -8,25 +8,25 @@ Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. -FreeBSD 13.0-CURRENT r343566 GENERIC i386 +FreeBSD 13.0-CURRENT r343567 GENERIC i386 FreeBSD clang version 7.0.1 (tags/RELEASE_701/final 349250) (based on LLVM 7.0.1) WARNING: WITNESS option enabled, expect reduced performance. VT(vga): resolution 640x480 -Preloaded elf kernel "/boot/kernel/kernel" at 0x2501000. -Preloaded boot_entropy_cache "/boot/entropy" at 0x2509b20. -Preloaded elf module "/boot/kernel/cpuctl.ko" at 0x2509b6c. -Preloaded elf module "/boot/kernel/if_ath.ko" at 0x2509f68. -Preloaded elf module "/boot/kernel/ath_dfs.ko" at 0x250a314. -Preloaded elf module "/boot/kernel/ath_rate.ko" at 0x250a6c0. -Preloaded elf module "/boot/kernel/ath_hal_ar9300.ko" at 0x250aa70. -Preloaded elf module "/boot/kernel/ath_hal_ar5416.ko" at 0x250ae9c. -Preloaded elf module "/boot/kernel/ath_hal_ar5212.ko" at 0x250b2c8. -Preloaded elf module "/boot/kernel/ath_hal_ar5211.ko" at 0x250b6f4. -Preloaded elf module "/boot/kernel/ath_hal_ar5210.ko" at 0x250baf8. +Preloaded elf kernel "/boot/kernel/kernel" at 0x2528000. +Preloaded elf module "/boot/kernel/cpuctl.ko" at 0x2530b20. +Preloaded boot_entropy_cache "/boot/entropy" at 0x2530f1c. +Preloaded elf module "/boot/kernel/if_ath.ko" at 0x2530f68. +Preloaded elf module "/boot/kernel/ath_dfs.ko" at 0x2531314. +Preloaded elf module "/boot/kernel/ath_rate.ko" at 0x25316c0. +Preloaded elf module "/boot/kernel/ath_hal_ar9300.ko" at 0x2531a70. +Preloaded elf module "/boot/kernel/ath_hal_ar5416.ko" at 0x2531e9c. +Preloaded elf module "/boot/kernel/ath_hal_ar5212.ko" at 0x25322c8. +Preloaded elf module "/boot/kernel/ath_hal_ar5211.ko" at 0x25326f4. +Preloaded elf module "/boot/kernel/ath_hal_ar5210.ko" at 0x2532af8. Table 'FACP' at 0xdf6c1c9c FACP: Found table at 0xdf6c1c9c -Calibrating TSC clock ... TSC clock: 1995051200 Hz -CPU: Intel(R) Core(TM)2 Duo CPU T7250 @ 2.00GHz (1995.05-MHz 686-class CPU) +Calibrating TSC clock ... TSC clock: 1995040840 Hz +CPU: Intel(R) Core(TM)2 Duo CPU T7250 @ 2.00GHz (1995.04-MHz 686-class CPU) Origin="GenuineIntel" Id=0x6fd Family=0x6 Model=0xf Stepping=13 Features=0xbfebfbff Features2=0xe3bd @@ -53,14 +53,15 @@ Physical memory chunk(s): 0x0000000000001000 - 0x000000000009dfff, 643072 bytes (157 pages) 0x0000000000100000 - 0x00000000007fffff, 7340032 bytes (1792 pages) -0x0000000002829000 - 0x00000000db998fff, 3642163200 bytes (889200 pages) -avail memory = 3639914496 (3471 MB) +0x00000000026ff000 - 0x00000000da2bcfff, 3619414016 bytes (883646 pages) +0x0000000100000000 - 0x000000011ffe7fff, 536772608 bytes (131048 pages) +avail memory = 4154175488 (3961 MB) MADT: Found CPU APIC ID 0 ACPI ID 0: enabled SMP: Added CPU 0 (AP) MADT: Found CPU APIC ID 1 ACPI ID 1: enabled SMP: Added CPU 1 (AP) Event timer "LAPIC" quality 100 -LAPIC: ipi_wait() us multiplier 45 (r 4401300 tsc 1995051200) +LAPIC: ipi_wait() us multiplier 45 (r 4401350 tsc 1995040840) ACPI APIC Table: Package ID shift: 1 L2 cache ID shift: 1 @@ -76,7 +77,6 @@ CPU1 (AP): APIC ID: 1 APIC: CPU 0 has ACPI ID 0 APIC: CPU 1 has ACPI ID 1 -Pentium Pro MTRR support enabled bios32: Found BIOS32 Service Directory header at 0x4ffa00 bios32: Entry = 0xffa10 (4ffa10) Rev = 0 Len = 1 pcibios: PCI BIOS entry at 0xf0000+0xab56 @@ -84,6 +84,7 @@ pnpbios: Entry = f0000:e2f4 Rev = 1.0 pnpbios: Event flag at 4b4 Other BIOS signatures found: +Pentium Pro MTRR support enabled random: read 3840 bytes from preloaded cache random: unblocking device. arc4random: read 32 bytes from preloaded cache @@ -117,7 +118,7 @@ lapic1: LINT1 trigger: edge lapic1: LINT1 polarity: high ioapic0 irqs 0-23 on motherboard -lapic: Divisor 2, Frequency 99752593 Hz +lapic: Divisor 2, Frequency 99752070 Hz cpu0 BSP: ID: 0x00000000 VER: 0x00050014 LDR: 0x00000000 DFR: 0xffffffff lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff @@ -129,7 +130,7 @@ timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 TSC timecounter disables C2 and C3. SMP: passed TSC synchronization test -Timecounter "TSC" frequency 1995051200 Hz quality 1000 +Timecounter "TSC" frequency 1995040840 Hz quality 1000 random: entropy device external interface wlan: <802.11 Link Layer> snd_unit_init() u=0x00ff8000 [512] d=0x00007c00 [32] c=0x000003ff [1024] @@ -138,7 +139,7 @@ [ath_hal] loaded nfslock: pseudo-device crypto: -module_register_init: MOD_LOAD (vesa, 0x1669cc0, 0) error 19 +module_register_init: MOD_LOAD (vesa, 0x166cb90, 0) error 19 io: kbd: new array size 4 kbd1 at kbdmux0 @@ -152,9 +153,9 @@ [ar5211] loaded [ar5210] loaded [ath] loaded -hpt27xx: RocketRAID 27xx controller driver v1.2.8 hptnr: R750/DC7280 controller driver v1.1.5 hptrr: RocketRAID 17xx/2xxx SATA controller driver v1.2 +hpt27xx: RocketRAID 27xx controller driver v1.2.8 nexus0 vtvga0: on motherboard cryptosoft0: on motherboard @@ -204,8 +205,8 @@ PCIe: Memory Mapped configuration base @ 0xf8000000 ioapic0: routing intpin 9 (ISA IRQ 9) to lapic 0 vector 48 ACPI: Dynamic OEM Table Load: -ACPI: SSDT 0x0000000009FFEA00 000043 (v01 LMPWR DELLLOM 00001001 INTL 20050624) -acpi0: wakeup code va 0xa1d1000 pa 0x1000 +ACPI: SSDT 0x000000001A404A80 000043 (v01 LMPWR DELLLOM 00001001 INTL 20050624) +acpi0: wakeup code va 0x1a452000 pa 0x1000 Table 'FACP' at 0xdf6c1c9c FACP: Found table at 0xdf6c1c9c Table 'FACP' at 0xdf6c1c9c @@ -234,15 +235,15 @@ cpu0: Processor \134_PR_.CPU0 (ACPI ID 0) -> APIC ID 0 cpu0: on acpi0 ACPI: Dynamic OEM Table Load: -ACPI: SSDT 0x000000000A21C000 000286 (v01 PmRef Cpu0Ist 00003000 INTL 20050624) +ACPI: SSDT 0x000000001A422C00 000286 (v01 PmRef Cpu0Ist 00003000 INTL 20050624) ACPI: Dynamic OEM Table Load: -ACPI: SSDT 0x000000000A22D800 0004B6 (v01 PmRef Cpu0Cst 00003001 INTL 20050624) +ACPI: SSDT 0x000000001A44B800 0004B6 (v01 PmRef Cpu0Cst 00003001 INTL 20050624) cpu1: Processor \134_PR_.CPU1 (ACPI ID 1) -> APIC ID 1 cpu1: on acpi0 ACPI: Dynamic OEM Table Load: -ACPI: SSDT 0x000000000A235100 0000C4 (v01 PmRef Cpu1Ist 00003000 INTL 20050624) +ACPI: SSDT 0x000000001A428D00 0000C4 (v01 PmRef Cpu1Ist 00003000 INTL 20050624) ACPI: Dynamic OEM Table Load: -ACPI: SSDT 0x000000000A235000 000085 (v01 PmRef Cpu1Cst 00003000 INTL 20050624) +ACPI: SSDT 0x000000001A428C00 000085 (v01 PmRef Cpu1Cst 00003000 INTL 20050624) Table 'FACP' at 0xdf6c1c9c FACP: Found table at 0xdf6c1c9c atrtc0: port 0x70-0x71,0x72-0x77 irq 8 on acpi0 @@ -526,7 +527,7 @@ vgapci0: port 0xeff8-0xefff mem 0xfea00000-0xfeafffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0 agp0: on vgapci0 pcib0: allocated type 3 (0xf0000000-0xf0000fff) for rid 64 of agp0 -agp0: Allocated flush page phys 0xf0000000 virt 0x18fba000 +agp0: Allocated flush page phys 0xf0000000 virt 0xd522000 agp0: aperture size is 256M, detected 7676k stolen memory agp0: AGP_I965_PGTBL_CTL2: 00000000 agp0: AGP_I855_GCC1: 0x30 @@ -933,9 +934,9 @@ IPsec: Initialized Security Association Processing. tcp_init: net.inet.tcp.tcbhashsize auto tuned to 32768 AcpiOsExecute: enqueue 6 pending tasks -hpt27xx: no controller detected. hptnr: no controller detected. hptrr: no controller detected. +hpt27xx: no controller detected. hdacc0: at cad 0 on hdac0 hdaa0: at nid 1 on hdacc0 hdaa0: Subsystem ID: 0x10280200 @@ -1057,27 +1058,27 @@ pcm0: Automatically set rec source to: monitor pcm0: Recording channel set is: Front Left, Front Right, pcm0: Recording channel matrix is: 2.0 (unknown) -ugen1.1: at usbus1 +ugen5.1: at usbus5 ugen6.1: at usbus6 -uhub0: on usbus1 +uhub0: on usbus5 uhub1: on usbus6 -ugen2.1: at usbus2 -ugen5.1: at usbus5 -uhub2: on usbus2 -ugen4.1: at usbus4 ugen0.1: at usbus0 -uhub3: on usbus4 +ugen4.1: at usbus4 +uhub2: on usbus0 ugen3.1: at usbus3 +ugen1.1: at usbus1 +uhub3: on usbus3 +uhub5: on usbus1 +ugen2.1: at usbus2 ata0: reset tp1 mask=03 ostat0=50 ostat1=01 -uhub4: on usbus3 +uhub6: on usbus2 acpi_acad0: acline initialization start acpi_acad0: On Line acpi_acad0: acline initialization done, tried 1 times battery0: battery initialization start -battery1: battery initialization start battery0: battery initialization done, tried 1 times -uhub5: on usbus5 -uhub6: on usbus0 +battery1: battery initialization start +uhub4: on usbus4 ata0: stat0=0x00 err=0x01 lsb=0x14 msb=0xeb ata0: stat1=0x01 err=0x04 lsb=0x00 msb=0x00 ata0: reset tp2 stat0=00 stat1=01 devices=0x10000 @@ -1092,10 +1093,6 @@ ses0 at ahciem0 bus 0 scbus3 target 0 lun 0 ses0: SEMB S-E-S 2.00 device ses0: SEMB SES Device -cd0 at ata0 bus 0 scbus0 target 0 lun 0 -cd0: Removable CD-ROM SCSI device -cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) -cd0: 680MB (348277 2048 byte sectors) ada0 at ahcich0 bus 0 scbus1 target 0 lun 0 ada0: ACS-4 ATA SATA 3.x device ada0: Serial Number 1B0607771A0800257271 @@ -1104,11 +1101,15 @@ ada0: 114473MB (234441648 512 byte sectors) ses0: Generation Code 0x0 has 1 SubEnclosures pass0 at ata0 bus 0 scbus0 target 0 lun 0 -ses0: pass0: SubEnclosure ID 0, 1 Types With this ID, Descriptor Length 36, offset 8 - Removable CD-ROM SCSI device -ses0: pass0: 33.300MB/s transfersWWN: 0 -ses0: Type Desc[0]: Type 0x17, MaxElt 3, In Subenc 0, Text Length 0: +ses0: SubEnclosure ID 0, 1 Types With this ID, Descriptor Length 36, offset 8 +pass0: ses0: Removable CD-ROM SCSI device +WWN: 0 +ses0: pass0: 33.300MB/s transfers Type Desc[0]: Type 0x17, MaxElt 3, In Subenc 0, Text Length 0: (UDMA2, ATAPI 12bytes, PIO 65534bytes) +cd0 at ata0 bus 0 scbus0 target 0 lun 0 +cd0: Removable CD-ROM SCSI device +cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes) +cd0: 680MB (348277 2048 byte sectors) pass1 at ahcich0 bus 0 scbus1 target 0 lun 0 pass1: ACS-4 ATA SATA 3.x device pass1: Serial Number 1B0607771A0800257271 @@ -1119,15 +1120,15 @@ Trying to mount root from ufs:/dev/ada0s1a [rw]... WARNING: WITNESS option enabled, expect reduced performance. uhub0: 2 ports with 2 removable, self powered +uhub2: 2 ports with 2 removable, self powered +uhub5: 2 ports with 2 removable, self powered uhub3: 2 ports with 2 removable, self powered uhub4: 2 ports with 2 removable, self powered -uhub5: 2 ports with 2 removable, self powered -uhub6: 2 ports with 2 removable, self powered -uhub2: 4 ports with 4 removable, self powered +uhub6: 4 ports with 4 removable, self powered +uhub1: 6 ports with 6 removable, self powered GEOM: new disk ada0 atrtc0: providing initial system time start_init: trying /sbin/init -uhub1: 6 ports with 6 removable, self powered ugen6.2: at usbus6 umass0 on uhub1 umass0: on usbus6 @@ -1146,7 +1147,7 @@ da0: quirks=0x2 da0: Delete methods: ugen4.2: at usbus4 -ukbd0 on uhub3 +ukbd0 on uhub4 ukbd0: on usbus4 kbd2 at ukbd0 kbd2: ukbd0, generic (0), config:0x0, flags:0x3d0000 @@ -1154,10 +1155,10 @@ wlan0: bpf attached wlan0: Ethernet address: 00:1c:bf:90:ab:44 lo0: link state changed to UP -firmware: 'wpifw' version 153229: 150100 bytes loaded at 0x2f809000 +firmware: 'wpifw' version 153229: 150100 bytes loaded at 0x34009000 wlan0: link state changed to UP -ums0 on uhub3 +ums0 on uhub4 ums0: on usbus4 ums0: 16 buttons and [XYZT] coordinates ID=2 -uhid0 on uhub3 +uhid0 on uhub4 uhid0: on usbus4 -- Steve 20170425 https://www.youtube.com/watch?v=VWUpyCsUKR4 20161221 https://www.youtube.com/watch?v=IbCHE-hONow