Date: Mon, 03 Dec 2012 20:33:51 -0800 From: Sean Bruno <seanbru@yahoo-inc.com> To: Egoitz Aurrekoetxea Aurre <egoitz@sarenet.es> Cc: "freebsd-xen@freebsd.org" <freebsd-xen@freebsd.org> Subject: Re: xenbusb_nop_confighook_cb timeout and cd issue Message-ID: <1354595632.3045.7.camel@powernoodle> In-Reply-To: <FE6F607E-085B-45EA-B085-612647677B71@sarenet.es> References: <FE6F607E-085B-45EA-B085-612647677B71@sarenet.es>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, 2012-12-03 at 19:04 +0100, Egoitz Aurrekoetxea Aurre wrote: > Good morning, > > After doing some checks and debugs about this problem, I can conclude that : under Xen 4.1.3 on Debian Wheezy it works properly although in XCP1.6 if you remove the cd drive from the vm works too. I'm going to describe the two test environments have used for debugging this : > > ENV 1.- XCP 1.6 XEN 4.1.3 + FREEBSD 9.1-RC3 : > > As you can see with an iso image mounted and without it, the boot process gets stuck there….. (I paste here both screenshot location). > > http://postfixquotareject.ramattack.net/PastedGraphic-8.tiff > http://postfixquotareject.ramattack.net/PastedGraphic-11.tiff > > I have placed here two examples, with an empty (but existing) cd drive and with a iso mounted in the drive. > > BUT If I do a in the XCP shell : > > xe vm-cd-remove uuid=08aec342-9572-8690-5e58-91d1b1f0aab2 cd-name=xs-tools.iso > > The drive is being removed from the vm and it boots normally. This is the workaround I'm using for the moment. > > Another debugging check I have done too is to apply this patch (although it's just for testing purposes and for checking if cd drive works) to see how the drive behaves after booting but without stopping in that loop of the FreeBSD kernel source code. > > --- /usr/src/sys/kern/subr_autoconf.c-defecto 2012-10-10 13:51:27.000000000 +0200 > +++ /usr/src/sys/kern/subr_autoconf.c 2012-10-10 18:21:51.000000000 +0200 > @@ -133,16 +133,17 @@ > /* Block boot processing until all hooks are disestablished. */ > mtx_lock(&intr_config_hook_lock); > warned = 0; > - while (!TAILQ_EMPTY(&intr_config_hook_list)) { > + /* while (!TAILQ_EMPTY(&intr_config_hook_list)) { */ > if (msleep(&intr_config_hook_list, &intr_config_hook_lock, > 0, "conifhk", WARNING_INTERVAL_SECS * hz) == > EWOULDBLOCK) { > mtx_unlock(&intr_config_hook_lock); > warned++; > run_interrupt_driven_config_hooks_warning(warned); > mtx_lock(&intr_config_hook_lock); > } > - } > + /* } */ > mtx_unlock(&intr_config_hook_lock); > } > > After applying this patch, kernel boots under XCP 1.6Beta and cd can be mounted in the shell (should say I have not noticed about IRQ problems after this). It seems like FreeBSD domU is not able to continue the boot process because it's not able to finish up some test related to THIS (the cd drive) device setup (IRQ assigning tests I assume concretely) that should succeed before being able to continue the boot process. > > ENV 2.- Debian Wheezy (testing) XEN 4.1.3 + FreeBSD 9.1-RC3 : > > Here is the concrete environment and config : > > root@pruebas-xen-egoitz:~# uname -ar > Linux pruebas-xen-egoitz 3.2.0-4-amd64 #1 SMP Debian 3.2.32-1 x86_64 GNU/Linux > > root@pruebas-xen-egoitz:~# cat /etc/issue > Debian GNU/Linux wheezy/sid \n \l > > root@pruebas-xen-egoitz:~# dpkg -l | grep -i xen > ii libxen-4.1 4.1.3-4 amd64 Public libs for Xen > ii libxenstore3.0 4.1.3-4 amd64 Xenstore communications library for Xen > ri linux-image-2.6.32-5-xen-amd64 2.6.32-46 amd64 Linux 2.6.32 for 64-bit PCs, Xen dom0 support > rc xen-hypervisor-4.0-amd64 4.0.1-5.4 amd64 The Xen Hypervisor on AMD64 > ii xen-hypervisor-4.1-amd64 4.1.3-4 amd64 Xen Hypervisor on AMD64 > ii xen-linux-system-3.2.0-4-amd64 3.2.32-1 amd64 Xen system with Linux 3.2 on 64-bit PCs (meta-package) > ii xen-linux-system-amd64 3.2+46 amd64 Xen system with Linux for 64-bit PCs (meta-package) > ii xen-system-amd64 4.1.3-4 amd64 Xen System on AMD64 (meta-package) > ii xen-tools 4.3.1-1 all Tools to manage Xen virtual servers > ii xen-utils-4.1 4.1.3-4 amd64 XEN administrative tools > ii xen-utils-common 4.1.3-4 all Xen administrative tools - common files > ii xenstore-utils 4.1.3-4 amd64 Xenstore utilities for Xen > > root@pruebas-xen-egoitz:~# xm list > Name ID Mem VCPUs State Time(s) > Domain-0 0 6908 8 r----- 1526.2 > freebsd90js.ramattack.net 24 512 2 -b---- 59.9 > > I normally create the life cycle with a xm new, later xm start……. the config file is : > > root@pruebas-xen-egoitz:~# cat /etc/xen/freebsd90rjs.ramattack.net.cfg > kernel = '/usr/lib/xen-4.1/boot/hvmloader' > builder = 'hvm' > vcpus = 2 > memory = 512 > name = 'freebsd90js.ramattack.net' > vif = [ 'bridge=eth0, mac=00:13:3E:19:88:22, type=ioemu' ] > disk = [ 'file:/servidores/freebsd90r/freebsd90js.img,hda,w', 'file:/imagenes-cd/FreeBSD-9.1-RC3-amd64-disc1.iso,hdc:cdrom,r' ] > boot = 'cd' > device_model = 'qemu-dm' > sdl = 0 > vnc = 1 > vncpasswd = 'agoodpassword' > serial = 'pty' > > And after booting properly and from the own vm inside the Dom0 running Debian and Xen : > > > root@pruebas:/root # uname -ar > FreeBSD pruebas.sare.net 9.1-RC3 FreeBSD 9.1-RC3 #0: Fri Nov 30 12:14:50 CET 2012 root@pruebas.sare.net:/usr/obj/usr/src/sys/XENHVM amd64 > > root@pruebas:/root # xen-detect > Running in HVM context on Xen v4.1. > > root@pruebas:/root # dmesg > Copyright (c) 1992-2012 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 9.1-RC3 #0: Fri Nov 30 12:14:50 CET 2012 > root@pruebas.sare.net:/usr/obj/usr/src/sys/XENHVM amd64 > CPU: Intel(R) Xeon(R) CPU L3426 @ 1.87GHz (1862.83-MHz K8-class CPU) > Origin = "GenuineIntel" Id = 0x106e5 Family = 6 Model = 1e Stepping = 5 > Features=0x1781fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,MMX,FXSR,SSE,SSE2,HTT> > Features2=0x81b82201<SSE3,SSSE3,CX16,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,HV> > AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM> > AMD Features2=0x1<LAHF> > real memory = 536870912 (512 MB) > avail memory = 492093440 (469 MB) > Event timer "LAPIC" quality 400 > ACPI APIC Table: <Xen HVM> > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > FreeBSD/SMP: 1 package(s) x 2 core(s) > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 2 > ioapic0: Changing APIC ID to 1 > MADT: Forcing active-low polarity and level trigger for SCI > ioapic0 <Version 1.1> irqs 0-47 on motherboard > kbd1 at kbdmux0 > acpi0: <Xen> on motherboard > acpi0: Power Button (fixed) > acpi0: Sleep Button (fixed) > acpi0: reservation of 0, a0000 (3) failed > cpu0: <ACPI CPU> on acpi0 > cpu1: <ACPI CPU> on acpi0 > attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0 > Timecounter "i8254" frequency 1193182 Hz quality 0 > Event timer "i8254" frequency 1193182 Hz quality 100 > atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0 > Event timer "RTC" frequency 32768 Hz quality 0 > Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 > acpi_timer0: <32-bit timer at 3.579545MHz> port 0xb008-0xb00b on acpi0 > pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 > pci0: <ACPI PCI bus> on pcib0 > isab0: <PCI-ISA bridge> at device 1.0 on pci0 > isa0: <ISA bus> on isab0 > atapci0: <Intel PIIX3 WDMA2 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc200-0xc20f at device 1.1 on pci0 > ata0: <ATA channel> at channel 0 on atapci0 > ata1: <ATA channel> at channel 1 on atapci0 > pci0: <bridge> at device 1.3 (no driver attached) > vgapci0: <VGA-compatible display> mem 0xf0000000-0xf1ffffff,0xf3000000-0xf3000fff at device 2.0 on pci0 > xenpci0: <Xen Platform Device> port 0xc000-0xc0ff mem 0xf2000000-0xf2ffffff irq 28 at device 3.0 on pci0 > xenstore0: <XenStore> on xenpci0 > atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 > atkbd0: <AT Keyboard> irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > psm0: <PS/2 Mouse> irq 12 on atkbdc0 > psm0: [GIANT-LOCKED] > psm0: model IntelliMouse Explorer, device ID 4 > fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 > fdc0: does not respond > device_attach: fdc0 attach returned 6 > uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > ppc0: <Parallel port> port 0x378-0x37f irq 7 on acpi0 > ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode > ppbus0: <Parallel port bus> on ppc0 > plip0: <PLIP network interface> on ppbus0 > lpt0: <Printer> on ppbus0 > lpt0: Interrupt-driven port > ppi0: <Parallel I/O> on ppbus0 > sc0: <System console> at flags 0x100 on isa0 > sc0: VGA <16 virtual consoles, flags=0x300> > vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > fdc0: No FDOUT register! > ctl: CAM Target Layer loaded > Timecounters tick every 10.000 msec > xenbusb_front0: <Xen Frontend Devices> on xenstore0 > xn0: <Virtual Network Interface> at device/vif/0 on xenbusb_front0 > xn0: Ethernet address: 00:13:3e:19:88:22 > xenbusb_back0: <Xen Backend Devices> on xenstore0 > xctrl0: <Xen Control Device> on xenstore0 > xn0: backend features: feature-sg feature-gso-tcp4 > xbd0: 40920MB <Virtual Block Device> at device/vbd/768 on xenbusb_front0 > xbd0: attaching as ad0 > xbd1: 685MB <Virtual Block Device> at device/vbd/5632 on xenbusb_front0 > xbd1: attaching as ad2 > GEOM: ad0s1: geometry does not match label (16h,63s != 255h,63s). > cd0 at ata1 bus 0 scbus1 target 0 lun 0 > cd0: <QEMU QEMU DVD-ROM 0.10> Removable CD-ROM SCSI-0 device > cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes) > cd0: cd present [350977 x 2048 byte records] > SMP: AP CPU #1 Launched! > Trying to mount root from ufs:/dev/ad0s1a [rw]... > xn0: 2 link states coalesced > > A test showing how I'm able to mount an iso image : > > root@pruebas:/root # mount > /dev/ad0s1a on / (ufs, local, journaled soft-updates) > devfs on /dev (devfs, local, multilabel) > /dev/ad2 on /puntomontajes (cd9660, local, read-only) > > root@pruebas:/root # ls -la /puntomontajes/ > total 638 > drwxr-xr-x 17 root wheel 4096 Jan 1 1970 . > drwxr-xr-x 19 root wheel 1024 Dec 3 11:42 .. > -rw-r--r-- 2 root wheel 1011 Oct 30 02:48 .cshrc > -rw-r--r-- 2 root wheel 253 Oct 30 02:48 .profile > drwxr-xr-x 2 root wheel 4096 Oct 30 02:47 .rr_moved > -r--r--r-- 1 root wheel 6200 Oct 30 02:48 COPYRIGHT > -r--r--r-- 1 root wheel 13814 Oct 30 02:48 ERRATA.HTM > -r--r--r-- 1 root wheel 8442 Oct 30 02:48 ERRATA.TXT > -r--r--r-- 1 root wheel 201433 Oct 30 02:48 HARDWARE.HTM > -r--r--r-- 1 root wheel 122955 Oct 30 02:48 HARDWARE.TXT > -r--r--r-- 1 root wheel 20807 Oct 30 02:48 README.HTM > -r--r--r-- 1 root wheel 14764 Oct 30 02:48 README.TXT > -r--r--r-- 1 root wheel 118904 Oct 30 02:48 RELNOTES.HTM > -r--r--r-- 1 root wheel 61896 Oct 30 02:48 RELNOTES.TXT > drwxr-xr-x 2 root wheel 6144 Oct 30 02:47 bin > drwxr-xr-x 7 root wheel 6144 Oct 30 02:48 boot > dr-xr-xr-x 2 root wheel 2048 Oct 30 02:47 dev > -r--r--r-- 1 root wheel 4143 Oct 30 02:48 docbook.css > drwxr-xr-x 20 root wheel 12288 Oct 30 02:48 etc > drwxr-xr-x 3 root wheel 6144 Oct 30 02:48 lib > drwxr-xr-x 3 root wheel 2048 Oct 30 02:48 libexec > drwxr-xr-x 2 root wheel 2048 Oct 30 02:47 media > drwxr-xr-x 2 root wheel 2048 Oct 30 02:47 mnt > dr-xr-xr-x 2 root wheel 2048 Oct 30 02:47 proc > drwxr-xr-x 2 root wheel 2048 Oct 30 02:47 rescue > drwxr-xr-x 2 root wheel 2048 Oct 30 02:48 root > drwxr-xr-x 2 root wheel 16384 Oct 30 02:48 sbin > lrwxr-xr-x 1 root wheel 11 Oct 30 02:47 sys -> usr/src/sys > drwxrwxrwt 2 root wheel 2048 Oct 30 02:47 tmp > drwxr-xr-x 15 root wheel 2048 Oct 30 02:48 usr > drwxr-xr-x 23 root wheel 4096 Oct 30 02:47 var > root@pruebas:/root # fgrep -r -i aa /puntomontajes/* > /puntomontajes/HARDWARE.HTM:"http://www.FreeBSD.org/cgi/man.cgi?query=aac&sektion=4&manpath=FreeBSD+9-current">; > /puntomontajes/HARDWARE.HTM:<span class="citerefentry"><span class="refentrytitle">aac</span>(4)</span></a> driver > /puntomontajes/HARDWARE.HTM:<p>Adaptec AAC-364</p> > /puntomontajes/HARDWARE.HTM:<p>Newer ServeRAID controllers are supported by the aac(4) or mfi(4) driver.</p> > /puntomontajes/HARDWARE.HTM:<p>RAIDarray 230 controllers, aka the Ultra-SCSI DEC KZPAC-AA (1-ch, 4MB cache), KZPAC-CA > /puntomontajes/HARDWARE.HTM:<p>Texas Instruments TSB43AA22</p> > /puntomontajes/HARDWARE.HTM:<p>Texas Instruments TSB82AA2</p> > /puntomontajes/HARDWARE.TXT: [i386,ia64,amd64] Controllers supported by the aac(4) driver > /puntomontajes/HARDWARE.TXT: * Adaptec AAC-364 > /puntomontajes/HARDWARE.TXT: Newer ServeRAID controllers are sup > . > . > . > . > etc > etc… > > > So, summarizing : > > Seems like under Debian with the same version of Xen works properly, so… I have taken a look at the patches applied to Xen sources for composing the Debian package and concretely one of them drew my attention : > > > > If someone at Citrix or XEN development team is reading this could tell us something?. Could this give a clue for solving the problem?. I can further investigate too if no one knows about it… but I assume this should be much easier and faster to if could be checked by some of the Xen development staff. > > Let us know something please, > Very thankful, > Best regards. If you have the time, can you submit a PR for this issue? I'll try and reproduce it in tomorrow after I get the xen4 hypervisor working again. Sean
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1354595632.3045.7.camel>