Skip site navigation (1)Skip section navigation (2)
Date:      Tue,  2 Aug 2005 18:16:15 -0300 (ADT)
From:      "Marc G.Fournier" <scrappy@hub.org>
To:        FreeBSD-gnats-submit@FreeBSD.org
Subject:   kern/84498: file system hangs when jail starts if unionfs is involved
Message-ID:  <20050802211615.2C4FE482F9@ganymede.hub.org>
Resent-Message-ID: <200508022120.j72LKGAE084186@freefall.freebsd.org>

next in thread | raw e-mail | index | archive | help

>Number:         84498
>Category:       kern
>Synopsis:       file system hangs when jail starts if unionfs is involved
>Confidential:   no
>Severity:       critical
>Priority:       high
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Tue Aug 02 21:20:15 GMT 2005
>Closed-Date:
>Last-Modified:
>Originator:     Marc G. Fournier
>Release:        FreeBSD 6.0-BETA1 i386
>Organization:
>Environment:
System: FreeBSD ganymede.hub.org 6.0-BETA1 FreeBSD 6.0-BETA1 #2: Sat Jul 30 00:36:35 ADT 2005 root@ganymede.hub.org:/shared/obj/usr/src/sys/kernel i386

Copyright (c) 1992-2005 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD 6.0-BETA1 #2: Sat Jul 30 00:36:35 ADT 2005
    root@ganymede.hub.org:/shared/obj/usr/src/sys/kernel
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) 4 CPU 2.40GHz (2394.01-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0xf27  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4400<CNTX-ID,<b14>>
real memory  = 1073676288 (1023 MB)
avail memory = 1045864448 (997 MB)
mptable_probe: MP Config Table has bad signature: 
npx0: [FAST]
npx0: <math processor> on motherboard
npx0: INT 16 interface
acpi0: <AOpen AWRDACPI> on motherboard
acpi0: Power Button (fixed)
pci_link0: <ACPI PCI Link LNKA> irq 3 on acpi0
pci_link1: <ACPI PCI Link LNKB> irq 11 on acpi0
pci_link2: <ACPI PCI Link LNKC> irq 11 on acpi0
pci_link3: <ACPI PCI Link LNKD> irq 7 on acpi0
pci_link4: <ACPI PCI Link LNKE> irq 0 on acpi0
pci_link5: <ACPI PCI Link LNKF> irq 0 on acpi0
pci_link6: <ACPI PCI Link LNK0> irq 10 on acpi0
pci_link7: <ACPI PCI Link LNK1> irq 10 on acpi0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0
cpu0: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <Intel 82865 host to AGP bridge> mem 0xe8000000-0xefffffff at device 0.0 on pci0
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
pci1: <display, VGA> at device 0.0 (no driver attached)
pci0: <serial bus, USB> at device 29.0 (no driver attached)
pci0: <serial bus, USB> at device 29.1 (no driver attached)
pci0: <serial bus, USB> at device 29.2 (no driver attached)
pci0: <serial bus, USB> at device 29.3 (no driver attached)
pci0: <serial bus, USB> at device 29.7 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci2: <ACPI PCI bus> on pcib2
rl0: <RealTek 8139 10/100BaseTX> port 0xd000-0xd0ff mem 0xfa030000-0xfa0300ff irq 10 at device 7.0 on pci2
miibus0: <MII bus> on rl0
rlphy0: <RealTek internal media interface> on miibus0
rlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
rl0: Ethernet address: 00:01:80:4f:54:5b
fxp0: <Intel 82550 Pro/100 Ethernet> port 0xd100-0xd13f mem 0xfa031000-0xfa031fff,0xfa000000-0xfa01ffff irq 7 at device 9.0 on pci2
miibus1: <MII bus> on fxp0
inphy0: <i82555 10/100 media interface> on miibus1
inphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
fxp0: Ethernet address: 00:02:b3:ee:da:3e
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 SATA150 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf000-0xf00f irq 11 at device 31.2 on pci0
atapci0: failed to enable memory mapping!
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
pcm0: <Intel ICH5 (82801EB)> port 0xea00-0xeaff,0xeb00-0xeb3f mem 0xfa101000-0xfa1011ff,0xfa102000-0xfa1020ff irq 11 at device 31.5 on pci0
pcm0: [GIANT-LOCKED]
pcm0: <Avance Logic ALC655 AC97 Codec>
acpi_tz0: <Thermal Zone> on acpi0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FAST]
sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model MouseMan+, device ID 0
orm0: <ISA Option ROM> at iomem 0xd0000-0xd17ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sio1: configured irq 3 not in bitmap of probed irqs 0
sio1: port may not be enabled
Timecounter "TSC" frequency 2394012756 Hz quality 800
Timecounters tick every 1.000 msec
ad0: 38166MB <WDC WD400JB-00ENA0 05.03E05> at ata0-master UDMA100
ad1: 76319MB <WDC WD800JB-00ETA0 77.07W77> at ata0-slave UDMA100
ad2: 152627MB <SAMSUNG SP1614C SW100-27> at ata1-master SATA150
ad3: 190782MB <WDC WD2000JD-55HBB0 08.02D08> at ata1-slave SATA150

>Description:

In preparation of deploying our first non-4.x production server, I've attempted to take a 4.x VM (jail environment) and start it up ... each time it starts, 
the start up hangs while sendmail is trying to start up, and if you try and
cd to the directory where the 'jail root' is located, the file system will
subsequently freeze up, and no more keyboard input is available on that
termimal ...

Of note ... sendmail == postfix, so unless I'm mistaken, that would be the 
first process to try and access something *on* the unionfs file system ...

The following is what Robert has suggested pulling in the way of information
from DDB, through a serial console ... as well, I have a core dump, if that
can be used to provide further information.

ganymede# /usr/sbin/jail /vm/1/test.hub.org test.hub.org 192.168.0.65 4 /bin/sh /etc/rc
/etc/rc: cannot create /dev/null: error 45
Skipping disk checks ...
/etc/rc: cannot create /dev/null: error 45
cp: /dev/null: Operation not supported
Doing initial network setup:.
/etc/rc: cannot create /dev/null: error 45
Additional routing options:.
Routing daemons:.
/etc/rc: cannot create /dev/null: error 45
/etc/rc: cannot create /dev/null: error 45
Clearing /tmp:.
Additional daemons: syslogd.
Doing additional network setup:.
Starting final network daemons: creating ssh1 RSA host key
PRNG is not seeded
 creating ssh2 RSA host key
/etc/rc: /usr/bin/ssh-keygen: permission denied
 creating ssh2 DSA host key
/etc/rc: /usr/bin/ssh-keygen: permission denied
.
ELF ldconfig path: /usr/lib /usr/lib/compat /usr/X11R6/lib /usr/local/lib
a.out ldconfig path: /usr/lib/aout /usr/lib/compat/aout /usr/X11R6/lib/aout
Starting standard daemons: cron sshdPRNG is not seeded
 sendmail.
load: 0.00  cmd: sendmail 1454 [union] 0.00u 0.00s 0% 60k
load: 0.00  cmd: sendmail 1454 [union] 0.00u 0.00s 0% 60k
KDB: enter: manual escape to debugger
[thread pid 13 tid 100003 ]
Stopped at      kdb_enter+0x2b: nop     
db> show pcpu
cpuid        = 0
curthread    = 0xc1ec9a80: pid 13 "irq1: atkbd0"
curpcb       = 0xe3254d90
fpcurthread  = none
idlethread   = 0xc1ec9780: pid 11 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
db> show pcpu 0
cpuid        = 0
curthread    = 0xc1ec9a80: pid 13 "irq1: atkbd0"
curpcb       = 0xe3254d90
fpcurthread  = none
idlethread   = 0xc1ec9780: pid 11 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
db> ps
  pid   proc     uid  ppid  pgrp  flag   stat  wmesg    wchan  cmd
 1454 c23aec48    0     1  1389 4000002 [SLPQ union 0xc4cb6058][SLP] sendmail
 1450 c2312000    0     1  1450 0000000 [SLPQ ufs 0xc278e6b8][SLP] cron
 1440 c2313000    0     1  1440 0000000 [SLPQ select 0xc0672ee4][SLP] syslogd
 1389 c23fc830    0  1385  1389 0004002 [SLPQ union 0xc2291af8][SLP] sh
 1385 c2f7c830    0   812  1385 0004002 [SLPQ pause 0xc2f7c864][SLP] csh
 1384 c2190c48 1001   627   627 0004100 [SLPQ lockf 0xc27d05c0][SLP] smtpd
 1383 c2f7c418 1001   627   627 0004100 [SLPQ lockf 0xc225f680][SLP] smtpd
 1382 c2f7c20c 1001   627   627 0004100 [SLPQ lockf 0xc27d0a40][SLP] smtpd
 1381 c2665c48 1001   627   627 0004100 [SLPQ lockf 0xc2d15240][SLP] smtpd
 1380 c23ae418   60   657   657 0004001 [SLPQ select 0xc0672ee4][SLP] lmtpd
 1379 c2f7c000 1001   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] lmtp
 1378 c2f7ca3c    0   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] local
 1377 c2f79c48 1001   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] cleanup
 1376 c23af000 1001   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] trivial-rewrite
 1375 c2f7c624 1001   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] proxymap
 1374 c2f7cc48 1001   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] smtpd
 1352 c2313a3c    0   805    45 0004000 [SLPQ nanslp 0xc066c34c][SLP] fsck_ufs
  813 c23fc624    0   809   813 0004002 [SLPQ ufs 0xc278e6b8][SLP] csh
  812 c23fcc48    0     1   812 0004102 [SLPQ wait 0xc23fcc48][SLP] login
  811 c2664418    0     1   811 0004002 [SLPQ ttyin 0xc2039c10][SLP] getty
  810 c218f20c    0     1   810 0004002 [SLPQ ttyin 0xc2039410][SLP] getty
  809 c23a8c48    0     1   809 0004102 [SLPQ wait 0xc23a8c48][SLP] login
  806 c2664624    0     1    45 0004002 [SLPQ piperd 0xc23a5198][SLP] logger
  805 c2664000    0   804    45 0004002 [SLPQ wait 0xc2664000][SLP] fsck
  804 c266420c    0     1    45 0000002 [SLPQ wait 0xc266420c][SLP] sh
  793 c2664830    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  792 c2664a3c    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  791 c2664c48    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  790 c2665000    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  789 c266520c    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  788 c2665418    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  787 c2665624    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  786 c2665830    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  785 c23af418    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  784 c23fb20c    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  783 c23af20c    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  782 c23a8830    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  781 c23af624    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  780 c23fb624    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  779 c23fc000    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  778 c23a8a3c    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  777 c2313830    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  776 c23fbc48    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  775 c23a820c    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  774 c23fb830    0   706   706 0000000 [SLPQ accept 0xc236d892][SLP] perl
  757 c23afa3c    0     1   757 0000000 [SLPQ select 0xc0672ee4][SLP] moused
  752 c23af830    0   726   726 0000101 [SLPQ pause 0xc23af864][SLP] smbd
  726 c23afc48    0     1   726 0000101 [SLPQ select 0xc0672ee4][SLP] smbd
  725 c23fb000   60   657   657 0004001 [SLPQ select 0xc0672ee4][SLP] imapd
  721 c23fba3c    0     1   721 0000001 [SLPQ select 0xc0672ee4][SLP] nmbd
  706 c23fc20c    0     1   706 0000000 [SLPQ pause 0xc23fc240][SLP] perl
  691 c23fb418    0     1   691 0000101 [SLPQ select 0xc0672ee4][SLP] proftpd
  684 c23fc418   80   637   637 0000100 [SLPQ accept 0xc239319e][SLP] httpd
  683 c2190830   80   637   637 0000100 [SLPQ accept 0xc239319e][SLP] httpd
  682 c2312830   80   637   637 0000100 [SLPQ accept 0xc239319e][SLP] httpd
  681 c23a8418   80   637   637 0000100 [SLPQ accept 0xc239319e][SLP] httpd
  680 c23a8000   80   637   637 0000100 [SLPQ accept 0xc239319e][SLP] httpd
  661 c23a8624    0     1    45 0004002 [SLPQ select 0xc0672ee4][SLP] imspd
  657 c23ae000   60     1   657 0000101 [SLPQ select 0xc0672ee4][SLP] master
  637 c2313418    0     1   637 0000000 [SLPQ select 0xc0672ee4][SLP] httpd
  629 c231320c 1001   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] qmgr
  628 c229b418 1001   627   627 0004100 [SLPQ select 0xc0672ee4][SLP] pickup
  627 c2312418    0     1   627 0004100 [SLPQ select 0xc0672ee4][SLP] master
  553 c229ba3c    0     1   553 0000000 [SLPQ nanslp 0xc066c34c][SLP] cron
  536 c1f83c48    0     1   536 0000100 [SLPQ select 0xc0672ee4][SLP] sshd
  527 c229b000    1     1   527 0000100 [SLPQ sbwait 0xc227ba64][SLP] rwhod
  448 c2190624    0   443   443 0000000 [SLPQ - 0xc22d0a00][SLP] nfsd
  447 c2190418    0   443   443 0000000 [SLPQ - 0xc22d0c00][SLP] nfsd
  446 c1f83830    0   443   443 0000000 [SLPQ - 0xc22d0e00][SLP] nfsd
  445 c219020c    0   443   443 0000000 [SLPQ - 0xc22d0800][SLP] nfsd
  443 c2190a3c    0     1   443 0000000 [SLPQ accept 0xc22ce03a][SLP] nfsd
  429 c229bc48    0     1   429 0000000 [SLPQ select 0xc0672ee4][SLP] mountd
  425 c229b20c    0     1   425 0000000 [SLPQ select 0xc0672ee4][SLP] rpcbind
  352 c1f83a3c   53     1   352 0008180 (threaded)  named
   thread 0xc22b6000 ksegrp 0xc1ecb000 [SLPQ kserel 0xc1ecb034][SLP]
   thread 0xc22b5d80 ksegrp 0xc1ecb000 [SLPQ select 0xc0672ee4][SLP]
   thread 0xc2191180 ksegrp 0xc1ecc780 [SLPQ ksesigwait 0xc1f83b74][SLP]
  291 c229b830    0     1   291 0000000 [SLPQ select 0xc0672ee4][SLP] syslogd
  258 c218f000    0     1   258 0000000 [SLPQ select 0xc0672ee4][SLP] devd
   44 c218f418    0     0     0 0000204 [SLPQ - 0xe4cd4d08][SLP] schedcpu
   43 c218f624    0     0     0 0000204 [SLPQ syncer 0xc066c0bc][SLP] syncer
   42 c218f830    0     0     0 0000204 [SLPQ vlruwt 0xc218f830][SLP] vnlru
   41 c218fa3c    0     0     0 0000204 [SLPQ psleep 0xc067342c][SLP] bufdaemon
   40 c218fc48    0     0     0 000020c [SLPQ pgzero 0xc067bc04][SLP] pagezero
   39 c2190000    0     0     0 0000204 [SLPQ psleep 0xc067b754][SLP] vmdaemon
   38 c1f1ec48    0     0     0 0000204 [SLPQ psleep 0xc067b710][SLP] pagedaemon
   37 c1f80000    0     0     0 0000204 [IWAIT] swi0: sio
   36 c1f8020c    0     0     0 0000204 [SLPQ - 0xc1f7f43c][SLP] fdc0
   35 c1f80418    0     0     0 0000204 [SLPQ tzpoll 0xc0778674][SLP] acpi_thermal
    9 c1f80624    0     0     0 0000204 [SLPQ - 0xc1ec7b80][SLP] thread taskq
   34 c1f80830    0     0     0 0000204 [IWAIT] swi6:+
    8 c1f80a3c    0     0     0 0000204 [SLPQ - 0xc1ec7d00][SLP] acpi_task2
    7 c1f80c48    0     0     0 0000204 [SLPQ - 0xc1ec7d00][SLP] acpi_task1
    6 c1f83000    0     0     0 0000204 [SLPQ - 0xc1ec7d00][SLP] acpi_task0
   33 c1f8320c    0     0     0 0000204 [IWAIT] swi6: task queue
   32 c1f83418    0     0     0 0000204 [IWAIT] swi2: cambio
    5 c1f16624    0     0     0 0000204 [SLPQ - 0xc1f15080][SLP] kqueue taskq
   31 c1f16830    0     0     0 0000204 [IWAIT] swi5:+
   30 c1f16a3c    0     0     0 0000204 [SLPQ - 0xc0666ec0][SLP] yarrow
    4 c1f16c48    0     0     0 0000204 [SLPQ - 0xc0669868][SLP] g_down
    3 c1f1e000    0     0     0 0000204 [SLPQ - 0xc0669864][SLP] g_up
    2 c1f1e20c    0     0     0 0000204 [SLPQ - 0xc066985c][SLP] g_event
   29 c1f1e418    0     0     0 0000204 [IWAIT] swi3: vm
   28 c1f1e624    0     0     0 000020c [RUNQ] swi4: clock sio
   27 c1f1e830    0     0     0 0000204 [IWAIT] swi1: net
   26 c1f1ea3c    0     0     0 0000204 [IWAIT] irq15: ata1
   25 c1ecd20c    0     0     0 0000204 [IWAIT] irq14: ata0
   24 c1ecd418    0     0     0 0000204 [IWAIT] irq13:
   23 c1ecd624    0     0     0 0000204 [IWAIT] irq12: psm0
   22 c1ecd830    0     0     0 0000204 [IWAIT] irq11: pcm0
   21 c1ecda3c    0     0     0 0000204 [IWAIT] irq10: rl0
   20 c1ecdc48    0     0     0 0000204 [IWAIT] irq9: acpi0
   19 c1f16000    0     0     0 0000204 [IWAIT] irq8: rtc
   18 c1f1620c    0     0     0 0000204 [IWAIT] irq7: fxp0
   17 c1f16418    0     0     0 0000204 [IWAIT] irq6: fdc0
   16 c1ec8000    0     0     0 0000204 [IWAIT] irq5:
   15 c1ec820c    0     0     0 0000204 [IWAIT] irq4: sio0
   14 c1ec8418    0     0     0 0000204 [IWAIT] irq3:
   13 c1ec8624    0     0     0 0000204 [CPU 0] irq1: atkbd0
   12 c1ec8830    0     0     0 0000204 [IWAIT] irq0: clk
   11 c1ec8a3c    0     0     0 000020c [Can run] idle: cpu0
    1 c1ec8c48    0     0     1 0004200 [SLPQ wait 0xc1ec8c48][SLP] init
   10 c1ecd000    0     0     0 0000204 [SLPQ ktrace 0xc066a2b8][SLP] ktrace
    0 c0669960    0     0     0 0000200 [IWAIT] swapper
db> show pcpu
cpuid        = 0
curthread    = 0xc1ec9a80: pid 13 "irq1: atkbd0"
curpcb       = 0xe3254d90
fpcurthread  = none
idlethread   = 0xc1ec9780: pid 11 "idle: cpu0"
APIC ID      = 0
currentldt   = 0x50
db> trace 13
Tracing pid 13 tid 100003 td 0xc1ec9a80
kdb_enter(c062dfe9) at kdb_enter+0x2b
scgetc(c0695880,2,1,c2036c00,c067bc20) at scgetc+0x510
sckbdevent(c067bc20,0,c0695880) at sckbdevent+0x1c8
atkbd_intr(c067bc20,0,e3254d10,c04b8589,c067bc20) at atkbd_intr+0x20
atkbdintr(c067bc20) at atkbdintr+0x16
ithread_loop(c1ec6900,e3254d38) at ithread_loop+0x14d
fork_exit(c04b843c,c1ec6900,e3254d38) at fork_exit+0x71
fork_trampoline() at fork_trampoline+0x8
--- trap 0x1, eip = 0, esp = 0xe3254d6c, ebp = 0 ---
db> show lockedvnods
Locked vnodes

0xc27afbb0: tag ufs, type VDIR
    usecount 1, writecount 0, refcount 4 mountedhere 0
    flags ()
    v_object 0xc0c68318 ref 0 pages 1
     lock type ufs: EXCL (count 1) by thread 0xc23a9c00 (pid 813)
	ino 49701, on dev ad0s1a

0xc278e660: tag ufs, type VDIR
    usecount 14, writecount 0, refcount 15 mountedhere 0
    flags ()
    v_object 0xc374f6b4 ref 0 pages 0
     lock type ufs: EXCL (count 1) by thread 0xc22b6600 (pid 1454) with 2 pending
	ino 49704, on dev ad0s1a

0xc4cb6000: tag union, type VDIR
    usecount 9, writecount 0, refcount 9 mountedhere 0
    flags (VV_ROOT)
     lock type union: EXCL (count 1) by thread 0xc23a9a80 (pid 1389) with 1 pending
	vp=0xc4cb6000, uppervp=0xc4cafcc0, lowervp=0xc27d7550
union: upper
0xc4cafcc0: tag ufs, type VDIR
    usecount 12, writecount 0, refcount 13 mountedhere 0xc201d800
    flags ()
    
	ino 17736, on dev ad0s1a
union: lower
0xc27d7550: tag ufs, type VDIR
    usecount 3, writecount 0, refcount 4 mountedhere 0
    flags ()
    v_object 0xc343ee70 ref 0 pages 0
    
	ino 8470704, on dev ad1s1a

0xc2291aa0: tag union, type VDIR
    usecount 5, writecount 0, refcount 5 mountedhere 0
    flags ()
     lock type union: EXCL (count 1) by thread 0xc2f7b600 (pid 1461) with 1 pending
	vp=0xc2291aa0, uppervp=0xc2291000, lowervp=0xc3445990
union: upper
0xc2291000: tag ufs, type VDIR
    usecount 5, writecount 0, refcount 6 mountedhere 0
    flags ()
    
	ino 17752, on dev ad0s1a
union: lower
0xc3445990: tag ufs, type VDIR
    usecount 2, writecount 0, refcount 4 mountedhere 0
    flags ()
    v_object 0xc4b1f630 ref 0 pages 1
    
	ino 8494974, on dev ad1s1a
db> trace 813
Tracing pid 813 tid 100111 td 0xc23a9c00
sched_switch(c23a9c00,0,1) at sched_switch+0x14b
mi_switch(1,0,c23a9c00,0,c23a9c00) at mi_switch+0x1ba
sleepq_switch(c278e6b8) at sleepq_switch+0x133
sleepq_wait(c278e6b8,0,c05b0514,0,c278e6b8) at sleepq_wait+0xb
msleep(c278e6b8,c066a90c,50,c0622b25,0) at msleep+0x356
acquire(ef202974,40,60000,c23a9c00,0) at acquire+0x76
lockmgr(c278e6b8,2002,c278e6dc,c23a9c00,ef202998) at lockmgr+0x3f6
vop_stdlock(ef2029e0,c0656f40,ef2029e0,ef2029a8,c0591a18) at vop_stdlock+0x1e
VOP_LOCK_APV(c0657480,ef2029e0,ef2029bc,c0602457,ef2029e0) at VOP_LOCK_APV+0x43
ffs_lock(ef2029e0,2002,c278e660,ef2029fc,c05308bc) at ffs_lock+0x10
VOP_LOCK_APV(c0656f40,ef2029e0) at VOP_LOCK_APV+0x43
vn_lock(c278e660,2002,c23a9c00,c278e660,2002) at vn_lock+0xf4
vget(c278e660,2002,c23a9c00,3002,c21b6c2c) at vget+0xba
cache_lookup(c27afbb0,ef202c14,ef202c28) at cache_lookup+0x441
vfs_cache_lookup(ef202b18,c27afbb0,c362b012,ef202b34,c051dd09) at vfs_cache_lookup+0x8f
VOP_LOOKUP_APV(c0656f40,ef202b18) at VOP_LOOKUP_APV+0x43
lookup(ef202c00,c27afbb0,0,c23a9c00,ef202c28) at lookup+0x431
namei(ef202c00,0,c064fde0,ef202c24,c21c7a68) at namei+0x396
kern_stat(c23a9c00,80e3008,0,ef202c74) at kern_stat+0x35
stat(c23a9c00,ef202d04,2,0,246) at stat+0x1b
syscall(3b,3b,3b,bfbde55c,bfbcd060) at syscall+0x2bb
Xint0x80_syscall() at Xint0x80_syscall+0x1f
--- syscall (188, FreeBSD ELF32, stat), eip = 0x2814ba47, esp = 0xbfbcbbac, ebp = 0xbfbccc28 ---
db> trace 1454
Tracing pid 1454 tid 100093 td 0xc22b6600
sched_switch(c22b6600,0,1) at sched_switch+0x14b
mi_switch(1,0,c22b6600,2,c22b6600) at mi_switch+0x1ba
sleepq_switch(c4cb6058) at sleepq_switch+0x133
sleepq_wait(c4cb6058,0,ef1be7dc,0,c4cb6058) at sleepq_wait+0xb
msleep(c4cb6058,c066b350,50,c4cc1a6f,0) at msleep+0x356
acquire(ef1be830,80,60000,c22b6600,0) at acquire+0x76
lockmgr(c4cb6058,2002,c4cb607c,c22b6600,ef1be854) at lockmgr+0x3f6
vop_stdlock(ef1be878,2,c4cb6000,ef1be894,c05308bc) at vop_stdlock+0x1e
VOP_LOCK_APV(c4cc2240,ef1be878) at VOP_LOCK_APV+0x43
vn_lock(c4cb6000,2,c22b6600,1,12) at vn_lock+0xf4
union_allocvp(ef1be948,c201d800,0,0,0) at union_allocvp+0x165
union_root(c201d800,2,ef1be948,c22b6600,1) at union_root+0x3f
lookup(c2f53300,8055000,0,c22b6600,c2f53328) at lookup+0x6d7
namei(c2f53300,3,0,0,0) at namei+0x396
elf32_load_file(c23aec48,e335f0f4,ef1bea84,ef1bec00,1000) at elf32_load_file+0xa8
exec_elf32_imgact(ef1bebe8,0,1,0,0) at exec_elf32_imgact+0x52c
do_execve(c22b6600,ef1becb4,0,0,ef1becb4) at do_execve+0x23a
kern_execve(c22b6600,ef1becb4,0,df1d2000,df1d2000) at kern_execve+0xcc
execve(c22b6600,ef1bed04,3,0,293) at execve+0x32
syscall(3b,3b,3b,0,8068da8) at syscall+0x2bb
Xint0x80_syscall() at Xint0x80_syscall+0x1f
--- syscall (59, FreeBSD ELF32, execve), eip = 0x2817a634, esp = 0xbfbfec44, ebp = 0xbfbfec70 ---
db> trace 1389
Tracing pid 1389 tid 100112 td 0xc23a9a80
sched_switch(c23a9a80,0,1) at sched_switch+0x14b
mi_switch(1,0,c23a9a80,1,c23a9a80) at mi_switch+0x1ba
sleepq_switch(c2291af8) at sleepq_switch+0x133
sleepq_wait(c2291af8,0,c0524382,0,c2291af8) at sleepq_wait+0xb
msleep(c2291af8,c066aff0,50,c4cc1a6f,0) at msleep+0x356
acquire(ef1ff92c,80,60000,c23a9a80,0) at acquire+0x76
lockmgr(c2291af8,2002,c2291b1c,c23a9a80,ef1ff950) at lockmgr+0x3f6
vop_stdlock(ef1ff974,2,c2291aa0,ef1ff990,c05308bc) at vop_stdlock+0x1e
VOP_LOCK_APV(c4cc2240,ef1ff974) at VOP_LOCK_APV+0x43
vn_lock(c2291aa0,2,c23a9a80,0,9) at vn_lock+0xf4
union_allocvp(ef1ffc14,c201d800,c4cb6000,c4cafcc0,ef1ffc28) at union_allocvp+0x165
union_lookup(ef1ffb18,c4cb6000,c21b8809,ef1ffb34,c051dd09) at union_lookup+0x2cf
VOP_LOOKUP_APV(c4cc2240,ef1ffb18) at VOP_LOOKUP_APV+0x43
lookup(ef1ffc00,0,0,c23a9a80,ef1ffc28) at lookup+0x431
namei(ef1ffc00,c05aba97,ef1ffbbc,ef1ffbbc,c37a4948) at namei+0x396
kern_stat(c23a9a80,80b59d8,0,ef1ffc74) at kern_stat+0x35
stat(c23a9a80,ef1ffd04,2,4,297) at stat+0x1b
syscall(3b,3b,3b,ffffffff,0) at syscall+0x2bb
Xint0x80_syscall() at Xint0x80_syscall+0x1f
--- syscall (188, FreeBSD ELF32, stat), eip = 0x8075858, esp = 0xbfbfeab4, ebp = 0xbfbfeb50 ---
db> trace 1461
Thread 1461 not found
db> panic
panic: from debugger
cpuid = 0
Uptime: 24m19s
Dumping 1023 MB (2 chunks)
  chunk 0: 1MB (159 pages) ... ok
  chunk 1: 1023MB (261872 pages) 1007 991 975 959 943 927 911 895 879 863 847 831 815 799 783 767 751 735 719 703 687 671 655 639 623 607 591 575 559 543 527 511 495 479 463 447 431 415 399 383 367 351 335 319 303 287 271 255 239 223 207 191 175 159 143 127 111 95 79 63 47 31 15 ... ok

Dump complete
Automatic reboot in 15 seconds - press a key on the console to abort
Rebooting...
>How-To-Repeat:

This hang happens at the same point every time I do this, so repeating is a
simple matter of mounting proc/unionfs for the jail, and then running the
jail command to start things up ...


>Fix:

	


>Release-Note:
>Audit-Trail:
>Unformatted:



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20050802211615.2C4FE482F9>