From owner-freebsd-ppc@freebsd.org Thu Oct 11 01:55:08 2018 Return-Path: Delivered-To: freebsd-ppc@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D132810C5A35 for ; Thu, 11 Oct 2018 01:55:07 +0000 (UTC) (envelope-from cam@neo-zeon.de) Received: from neo-zeon.de (neo-zeon.de [96.90.244.226]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.neo-zeon.de", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6D46C7C49F for ; Thu, 11 Oct 2018 01:55:07 +0000 (UTC) (envelope-from cam@neo-zeon.de) Received: from cberkenp-ld2.linkedin.biz ([216.52.21.5]) (authenticated bits=0) by neo-zeon.de (8.15.2/8.15.2) with ESMTPSA id w9B1fmf3024148 (version=TLSv1.2 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Wed, 10 Oct 2018 18:41:49 -0700 (PDT) (envelope-from cam@neo-zeon.de) Subject: Re: FreeBSD 12.0-ALPHA4 fails to boot on POWER9/KVM From: Cameron Berkenpas To: freebsd-ppc@freebsd.org References: <5d84652d-8b54-19f9-1396-e7c9acbe6c03@neo-zeon.de> <5f44c6d6-7eec-6732-6fef-123e7e0d3292@freebsd.org> Message-ID: <2b4455f4-37f6-5645-dcba-2cc41c845ae8@neo-zeon.de> Date: Wed, 10 Oct 2018 18:41:43 -0700 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.3.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-BeenThere: freebsd-ppc@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Porting FreeBSD to the PowerPC List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Oct 2018 01:55:08 -0000 Made a LITTLE progress on getting FreeBSD to run as a KVM VM on POWER9/TalosII again with the following: qemu-system-ppc64 -enable-kvm -m 2048 -nographic -vga none -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x7 -drive file=FreeBSD-12.0-ALPHA9-powerpc-powerpc64-20181009-r339271-disc1.iso,format=raw,if=none,id=drive-scsi0-0-0-0,readonly=on -device scsi-cd,bus=scsi0.0,channel=0,scsi-id=0,lun=0,drive=drive-scsi0-0-0-0,id=scsi0-0-0-0,bootindex=1 -drive file=/var/lib/libvirt/images/freebsd-ppc.qcow2,format=qcow2,if=none,id=drive-scsi0-0-0-1 -device scsi-hd,bus=scsi0.0,channel=0,scsi-id=0,lun=1,drive=drive-scsi0-0-0-1,id=scsi0-0-0-1,bootindex=2 -mem-prealloc -mem-path /dev/hugepages -smp 2 Seems like issue is that you need to use a SCSI CDROM! Unfortunately, we are don't quite get there. Hope it's not a problem to put this inline, I'm unable to access pastebin right now: qemu-system-ppc64: warning: System page size 0x1000000 is not enabled in page_size_mask (0x11000). Performance may be slow SLOF ********************************************************************** QEMU Starting  Build Date = Sep 24 2017 12:23:07  FW Version = buildd@ release 20170724  Press "s" to enter Open Firmware. Populating /vdevice methods Populating /vdevice/vty@71000000 Populating /vdevice/nvram@71000001 Populating /vdevice/l-lan@71000002 Populating /pci@800000020000000                      00 3800 (D) : 1af4 1004    virtio [ scsi ] Populating /pci@800000020000000/scsi@7        SCSI: Looking for devices           100000100000000 DISK     : "QEMU     QEMU HARDDISK 2.5+"           100000000000000 CD-ROM   : "QEMU     QEMU CD-ROM 2.5+" No NVRAM common partition, re-initializing... Scanning USB Using default console: /vdevice/vty@71000000   Welcome to Open Firmware   Copyright (c) 2004, 2017 IBM Corporation All rights reserved.   This program and the accompanying materials are made available   under the terms of the BSD License available at   http://www.opensource.org/licenses/bsd-license.php Trying to load:  from: /pci@800000020000000/scsi@7/disk@100000000000000 ...   Successfully loaded Consoles: Open Firmware console FreeBSD/powerpc64 Open Firmware loader, Revision 0.1 Memory: 2097152KB Booted from: /pci@800000020000000/scsi@7/disk@100000000000000 block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! / block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! \ block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! / block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! | block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! - block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! - block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUND- block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! Loading /boot/defaults/loader.conf block-size NOT FOUND #blocks NOT FOUND\ block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! | block-size NOT FOUND #blocks NOT FOUND- block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUND- block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUND/ block-size NOT FOUND #blocks NOT FOUND- block-size NOT FOUND #blocks NOT FOUND\ block-size NOT FOUND #blocks NOT FOUND| block-size NOT FOUND #blocks NOT FOUND\ block-size NOT FOUND #blocks NOT FOUND- block-size NOT FOUND #blocks NOT FOUND/ block-size NOT FOUND #blocks NOT FOUND/boot/kernel/kernel data=0x13776e0+0x54dfe0 syms=[0x8+0x176ef8+0x8+0x1727c1] block-size NOT FOUND #blocks NOT FOUND\ block-size NOT FOUND #blocks NOT FOUND/ Hit [Enter] to boot immediately, or any other key for command prompt. Booting [/boot/kernel/kernel]... block-size NOT FOUND #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! SCSI-DISK: Access beyond end of device ! Kernel entry at 0x1024b0 ... KDB: debugger backends: ddb KDB: current backend: ddb ---<>--- Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994     The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 12.0-ALPHA9 r339271 GENERIC powerpc gcc version 4.2.1 20070831 patched [FreeBSD] WARNING: WITNESS option enabled, expect reduced performance. VT: init without driver. cpu0: IBM POWER9 revision 2.2, 2234.00 MHz cpu0: Features dc007182 cpu0: Features2 eee00000 real memory  = 2101960704 (2004 MB) avail memory = 1983193088 (1891 MB) FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs arc4random: no preloaded entropy cache random: entropy device external interface random: registering fast source PowerISA DARN random number generator random: fast provider: "PowerISA DARN random number generator" kbd0 at kbdmux0 ofwbus0: on nexus0 xicp0: on ofwbus0 xicp0: Handling CPUs 0-15 vdevice0: on ofwbus0 llan0: irq 16781321 on vdevice0 llan0: Ethernet address: 00:12:34:56:00:00 uart0: irq 16781315 on vdevice0 pcib0: on ofwbus0 pci0: on pcib0 pci0: at device 7.0 (no driver attached) cpulist0: on ofwbus0 cpu0: on cpulist0 cpu1: on cpulist0 rtas0: on ofwbus0 rtas0: registered as a time-of-day clock, resolution 0.002000s Timecounter "timebase" frequency 512000000 Hz quality 0 Event timer "decrementer" frequency 512000000 Hz quality 1000 Timecounters tick every 1.000 msec llan0: link state changed to UP usb_needs_explore_all: no devclass SMP: AP CPU #1 launched arc4random: no preloaded entropy cache Trying to mount root from cd9660:/dev/iso9660/12_0_ALPHA9_POWERPC64_CD [ro]... WARNING: WITNESS option enabled, expect reduced performance. mountroot: waiting for device /dev/iso9660/12_0_ALPHA9_POWERPC64_CD... Mounting from cd9660:/dev/iso9660/12_0_ALPHA9_POWERPC64_CD failed with error 19. Loader variables:   vfs.root.mountfrom=cd9660:/dev/iso9660/12_0_ALPHA9_POWERPC64_CD   vfs.root.mountfrom.options=ro Manual root filesystem specification:   : [options]       Mount using filesystem       and with the specified (optional) option list.     eg. ufs:/dev/da0s1a         zfs:zroot/ROOT/default         cd9660:/dev/cd0 ro           (which is equivalent to: mount -t cd9660 -o ro /dev/cd0 /)   ?               List valid disk boot devices   .               Yield 1 second (for background tasks)       Abort manual input mountroot> ? List of GEOM managed disk devices: mountroot> On 09/04/2018 12:56 PM, Cameron Berkenpas wrote: > The last working ISO I tried was probably from July (definitely no > earlier at least) if that helps slightly. Unfortunately, I deleted my > older ISO's. > > Unfortunately, I don't see any older 12-CURRENT images archived to try > and get some idea of when this broke. > > If I have some time, I'll see if it's possible/feasible for me to > build a PPC64 image of some kind from a PC to try unless someone has a > better idea of course. :D > > Thanks! > > On 09/04/2018 08:10 AM, Nathan Whitehorn wrote: >> The 32 and 64-bit loaders are identical binaries, so the issue is >> probably universal. >> -Nathan >> >> On 9/4/18 12:18 AM, Michael Tuexen wrote: >>>> On 4. Sep 2018, at 07:13, Nathan Whitehorn >>>> wrote: >>>> >>>> Maybe this is Lua loader fallout? The problem seems to be entirely in >>>> the boot loader. >>> At least the problem I reported earlier to this list regarding booting >>> a G4 system is related to the lua loader. >>> >>> When installing the fourth loader, booting works, when installing >>> the lua loader, booting fails with the output given. >>> >>> However, this is on a 32-bit PPC machine. Can't test on a 64-bit PPC >>> machine. >>> >>> Best regards >>> Michael >>>> -Nathan >>>> >>>> On 9/3/18 9:54 PM, Cameron Berkenpas wrote: >>>>> Hello, >>>>> >>>>> Argh. I went out of my way to select the right ISO image and then >>>>> apparently still grabbed the wrong one without noticing the name. >>>>> >>>>> I went and tried this image: >>>>> FreeBSD-12.0-ALPHA4-powerpc-powerpc64-20180831-r338410-disc1.iso >>>>> >>>>> Still the same issue though. >>>>> >>>>> Thanks! >>>>> >>>>> On 09/03/2018 07:42 PM, Justin Hibbits wrote: >>>>>> Hello Cameron, >>>>>> >>>>>> On Sun, Sep 2, 2018 at 11:15 PM Cameron Berkenpas >>>>>> wrote: >>>>>>> Hello, >>>>>>> >>>>>>> It seems that FreeBSD 12.0-ALPHA4 is having trouble booting on >>>>>>> KVM on >>>>>>> POWER9 (Talos II). >>>>>>> >>>>>>> Here's the image I've tried: >>>>>>> FreeBSD-12.0-ALPHA4-powerpc-powerpcspe-20180831-r338410-disc1.iso >>>>>>> >>>>>> The powerpcspe ISO won't work on a Talos.  I don't even expect that >>>>>> particular ISO to work at all, given the nature of the architecture. >>>>>> For Talos, and IBM POWER* in general, you need the powerpc64 ISO. >>>>>> >>>>>> I don't know if that will solve your problem, given the errors >>>>>> printed >>>>>> below, but it's at least a first step. >>>>>> >>>>>> - Justin >>>>>> >>>>>> >>>>>>> It fails regardless of whether I run kvm from the console or >>>>>>> through >>>>>>> virt-manager. >>>>>>> >>>>>>> Seems to be disk related... I get the messages below regardless of >>>>>>> whether I try to boot from CD-ROM or disk. I've tried all disk >>>>>>> types >>>>>>> for >>>>>>> both (usb, scsi, sata, virtio, etc). >>>>>>> >>>>>>> It's important to note that this worked on an older snapshot of >>>>>>> 12.0-CURRENT, though I don't know the last specific working >>>>>>> revision I >>>>>>> tried. >>>>>>> >>>>>>> Here's the output: >>>>>>> >>>>>>> SLOF >>>>>>> ********************************************************************** >>>>>>> >>>>>>> QEMU Starting >>>>>>>     Build Date = Sep 24 2017 12:23:07 >>>>>>>     FW Version = buildd@ release 20170724 >>>>>>>     Press "s" to enter Open Firmware. >>>>>>> >>>>>>> Populating /vdevice methods >>>>>>> Populating /vdevice/vty@71000000 >>>>>>> Populating /vdevice/nvram@71000001 >>>>>>> Populating /vdevice/v-scsi@71000002 >>>>>>>           SCSI: Looking for devices >>>>>>>              8200000000000000 CD-ROM   : "QEMU QEMU CD-ROM 2.5+" >>>>>>> Populating /pci@800000020000000 >>>>>>>                         00 0000 (D) : 8086 100e e1000 [ net ] >>>>>>> No NVRAM common partition, re-initializing... >>>>>>> Scanning USB >>>>>>> Using default console: /vdevice/vty@71000000 >>>>>>> >>>>>>> >>>>>>> >>>>>>>      Welcome to Open Firmware >>>>>>> >>>>>>>      Copyright (c) 2004, 2017 IBM Corporation All rights reserved. >>>>>>>      This program and the accompanying materials are made available >>>>>>>      under the terms of the BSD License available at >>>>>>> http://www.opensource.org/licenses/bsd-license.php >>>>>>> >>>>>>> >>>>>>> Trying to load:  from: >>>>>>> /vdevice/v-scsi@71000002/disk@8200000000000000 >>>>>>> ...   Successfully loaded >>>>>>> Consoles: Open Firmware console >>>>>>> >>>>>>> FreeBSD/powerpcspe Open Firmware loader, Revision 0.1 >>>>>>> (Fri Aug 31 17:53:54 UTC 2018 root@releng3.nyi.freebsd.org) >>>>>>> Memory: 33554432KB >>>>>>> Booted from: /vdevice/v-scsi@71000002/disk@8200000000000000 >>>>>>> >>>>>>> >>>>>>> block-size NOT FOUND >>>>>>> #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> / >>>>>>> block-size NOT FOUND >>>>>>> #blocks NOT FOUNDSCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> SCSI-DISK: Access beyond end of device ! >>>>>>> \ >>>>>>> block-size NOT FOUND >>>>>>> #blocks NOT FOUND >>>>>>> >>>>>>> ( 700 ) Program Exception [ 0 ] >>>>>>> >>>>>>> >>>>>>>        R0 .. R7           R8 .. R15         R16 .. R23         >>>>>>> R24 .. >>>>>>> R31 >>>>>>> 000000000000000b   000000000345ddd4   ffffffffffffffff >>>>>>> 0000000002c50dd8 >>>>>>> 0000000002c559e0   0000000028686561   0000000002c57c50 >>>>>>> 0000000002c51d10 >>>>>>> 0000000000000000   0000000002c68540   0000000002c57c48 >>>>>>> 0000000002c52594 >>>>>>> 000000000345e900   0000000002c68280   0000000002c63300 >>>>>>> 0000000000000000 >>>>>>> 0000000002c682c0   0000000020000048   0000000000000000 >>>>>>> 000000000345e900 >>>>>>> 0000000000000000   0000000000000000   0000000000000000 >>>>>>> 0000000000000000 >>>>>>> 0000000000000040   0000000000000000   0000000002c6eb00 >>>>>>> 0000000000000000 >>>>>>> 0000000000000008   000000007fffffff   0000000002c5cb04 >>>>>>> 000000000345e900 >>>>>>> >>>>>>>        CR / XER           LR / CTR          SRR0 / SRR1        >>>>>>> DAR / >>>>>>> DSISR >>>>>>>            80000044   0000000002c029f0 0000000028686560 >>>>>>> 0000000000000000 >>>>>>> 0000000020040000   0000000028686561   0000000000083000 00000000 >>>>> _______________________________________________ >>>>> freebsd-ppc@freebsd.org mailing list >>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-ppc >>>>> To unsubscribe, send any mail to >>>>> "freebsd-ppc-unsubscribe@freebsd.org" >>>>> >>>> _______________________________________________ >>>> freebsd-ppc@freebsd.org mailing list >>>> https://lists.freebsd.org/mailman/listinfo/freebsd-ppc >>>> To unsubscribe, send any mail to "freebsd-ppc-unsubscribe@freebsd.org" >> _______________________________________________ >> freebsd-ppc@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-ppc >> To unsubscribe, send any mail to "freebsd-ppc-unsubscribe@freebsd.org" >