Date: Wed, 12 Nov 2008 11:57:07 -0600 From: Ross Gohlke <ross@grinz.com> To: FreeBSD PowerPC <freebsd-ppc@FreeBSD.org> Subject: SMP success (sort of) on Xserve G4 Message-ID: <491B18F3.4010900@grinz.com> In-Reply-To: <48DD91A4.2060306@freebsd.org> References: <b9c23c9f0809230355y26d463c4s5a60a22293daa05d@mail.gmail.com> <b9c23c9f0809230952n159c3179t90b6a542eaf94a4f@mail.gmail.com> <b9c23c9f0809231028j3d20b1bcgc8f4aaec15fe23d2@mail.gmail.com> <48DD91A4.2060306@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
I am new to -CURRENT and to synchronizing source, trying to parse
conflicting instructions (mostly between Handbook and
/usr/src/UPDATING). I still have some things to work out (server is
remote, becomes unreachable periodically and has to be
power-cycled), but my Xserve DP 1GHz G4 is using both processors.
I'll try a UP kernel and may just go through the whole process again to
see if errors go away.
% dmesg
Copyright (c) 1992-2008 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.0-CURRENT #0: Tue Nov 11 15:01:01 CST 2008
root@rorty.grinz.com:/usr/obj/usr/src/sys/RORTY.8
WARNING: WITNESS option enabled, expect reduced performance.
cpu0: Motorola PowerPC 7455 revision 2.1, 1000.00 MHz
cpu0: HID0 8450c0bc<EMCP,TBEN,NAP,DPM,ICE,DCE,SGE,BTIC,LRSTK,FOLD,BHT>
real memory = 2135240704 (2036 MB)
avail memory = 2067062784 (1971 MB)
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
cpu0: dev=ff87f908 (BSP)
cpu1: dev=ff880bc8
kbd0 at kbdmux0
nexus0: <Open Firmware Nexus device>
unin0: <Apple UniNorth System Controller> on nexus0
unin0: Version 36
pcib0: <Apple UniNorth Host-PCI bridge> on nexus0
pci0: <OFW PCI bus> on pcib0
bge0: <Apple BCM5701 B5, ASIC rev. 0x105> mem 0xa0000000-0xa000ffff irq
48 at device 16.0 on pci0
miibus0: <MII bus> on bge0
brgphy0: <BCM5701 10/100/1000baseTX PHY> PHY 1 on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
bge0: Ethernet address: 00:03:93:c0:50:fc
bge0: [ITHREAD]
pcib1: <Apple UniNorth Host-PCI bridge> on nexus0
pci1: <OFW PCI bus> on pcib1
pcib2: <OFW PCI-PCI bridge> at device 13.0 on pci1
pci2: <OFW PCI bus> on pcib2
macio0: <KeyLargo I/O Controller> mem 0x80000000-0x8007ffff at device
7.0 on pci2
openpic0: <OpenPIC Interrupt Controller> mem 0x40000-0x7ffff on macio0
macgpio0: <MacIO GPIO Controller> mem 0x50-0x7f on macio0
pmuextint0: <Apple PMU99 External Interrupt> gpio 9 irq 47 on macgpio0
scc0: <Zilog Z8530 dual channel SCC> mem
0x13000-0x13fff,0x8400-0x84ff,0x8500-0x85ff,0x8600-0x86ff,0x8700-0x87ff
irq 22,5,6,23,7,8 on macio0
scc0: [FILTER]
scc0: [FILTER]
uart0: <z8530, channel A> on scc0
uart0: [FILTER]
uart1: <z8530, channel B> on scc0
uart1: [FILTER]
pmu0: <Apple PMU99 Controller> mem 0x16000-0x17fff irq 25 on macio0
pmu0: [ITHREAD]
ata0 mem 0x1f000-0x1ffff,0x8a00-0x8aff irq 19,11 on macio0
ata0: [ITHREAD]
ohci0: <Apple KeyLargo USB controller> mem 0x80081000-0x80081fff irq 27
at device 8.0 on pci2
ohci0: [GIANT-LOCKED]
ohci0: [ITHREAD]
usb0: OHCI version 1.0
usb0: <Apple KeyLargo USB controller> on ohci0
usb0: USB revision 1.0
uhub0: <Apple OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0
uhub0: 2 ports with 2 removable, self powered
ohci1: <Apple KeyLargo USB controller> mem 0x80080000-0x80080fff irq 28
at device 9.0 on pci2
ohci1: [GIANT-LOCKED]
ohci1: [ITHREAD]
usb1: OHCI version 1.0
usb1: <Apple KeyLargo USB controller> on ohci1
usb1: USB revision 1.0
uhub1: <Apple OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb1
uhub1: 2 ports with 2 removable, self powered
pcib3: <OFW PCI-PCI bridge> at device 17.0 on pci1
pci3: <OFW PCI bus> on pcib3
pcib1: failed to reserve resource for (null)
vgapci0: <VGA-compatible display> mem
0x88000000-0x8fffffff,0x80100000-0x8010ffff irq 52 at device 2.0 on pci3
atapci0: <Promise PDC20270 UDMA100 controller> port
0x1090-0x1097,0x1080-0x1083,0x1070-0x1077,0x1060-0x1063,0x1050-0x105f
mem 0x90030000-0x9003ffff irq 58 at device 21.0 on pci1
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
atapci1: <Promise PDC20270 UDMA100 controller> port
0x1040-0x1047,0x1030-0x1033,0x1020-0x1027,0x1010-0x1013,0x1000-0x100f
mem 0x90010000-0x9001ffff irq 63 at device 27.0 on pci1
atapci1: [ITHREAD]
ata4: <ATA channel 0> on atapci1
ata4: [ITHREAD]
ata5: <ATA channel 1> on atapci1
ata5: [ITHREAD]
pcib4: <Apple UniNorth Host-PCI bridge> on nexus0
pci4: <OFW PCI bus> on pcib4
fwohci0: <Apple UniNorth> mem 0xf5000000-0xf5000fff irq 40 at device
14.0 on pci4el
fwohci0: [FILTER]
fwohci0: OHCI version 1.10 (ROM=0)
fwohci0: No. of Isochronous channels is 8.
fwohci0: EUI64 00:03:93:ff:fe:b5:d4:8e
fwohci0: Phy 1394a available S400, 3 ports.
fwohci0: Link S400, max_rec 2048 bytes.
firewire0: <IEEE1394(FireWire) bus> on fwohci0
fwe0: <Ethernet over FireWire> on firewire0
if_fwe0: Fake Ethernet address: 02:03:93:b5:d4:8e
fwe0: Ethernet address: 02:03:93:b5:d4:8e
sbp0: <SBP-2/SCSI over FireWire> on firewire0
fwohci0: Initiate bus reset
fwohci0: BUS reset
fwohci0: node_id=0xc800ffc1, gen=2, CYCLEMASTER mode
gem0: <Apple UniNorth2 GMAC Ethernet> mem 0xf5200000-0xf53fffff irq 41
at device 15.0 on pci4
miibus1: <MII bus> on gem0
brgphy1: <BCM5754 10/100/1000baseTX PHY> PHY 0 on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT,
1000baseT-FDX, auto
gem0: 10kB RX FIFO, 4kB TX FIFO
gem0: Ethernet address: 00:03:93:b5:d4:8e
gem0: [ITHREAD]
sc0: <System console> on nexus0
sc0: Unknown <16 virtual consoles, flags=0x300>
uhub2: <Mitsumi Electric Hub in Apple USB Keyboard, class 9/0, rev
1.10/2.11, addr 2> on uhub0
uhub2: 3 ports with 2 removable, bus powered
ukbd0: <Mitsumi Electric Apple USB Keyboard, class 0/0, rev 1.00/1.03,
addr 3> on uhub2
kbd1 at ukbd0
ums0: <Logitech M4848, class 0/0, rev 1.00/5.00, addr 4> on uhub2
ums0: 1 buttons.
Timecounter "decrementer" frequency 33229775 Hz quality 0
Timecounters tick every 10.000 msec
IP Filter: v4.1.28 initialized. Default = pass all, Logging = enabled
firewire0: 2 nodes, maxhop <= 1, cable IRM = 1 (me)
firewire0: bus manager 1 (me)
acd0: CDRW <LG CD-ROM CRN-8245B/AHT9> at ata0-master UDMA33
ad0: 117800MB <IBM IC35L120AVVA07-0 VA6BA52A> at ata2-master UDMA100
ad1: 58644MB <IBM IC35L060AVVA07-0 VA3BA52A> at ata3-master UDMA100
Waking up CPU 1 (dev=ff880bc8)
WARNING: WITNESS option enabled, expect reduced performance.
Trying to mount root from ufs:/dev/ad0s3
WARNING: / was not properly dismounted
lock order reversal:
1st 0xc44048 user map (user map) @ /usr/src/sys/vm/vm_map.c:3115
2nd 0xe0aafc ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2047
KDB: stack backtrace:
0xe08cf930: at kdb_backtrace+0x4c
0xe08cf950: at _witness_debugger+0x3c
0xe08cf970: at witness_checkorder+0x8d0
0xe08cf9d0: at __lockmgr_args+0x23c
0xe08cfa50: at ffs_lock+0x9c
0xe08cfa80: at VOP_LOCK1_APV+0xec
0xe08cfaa0: at _vn_lock+0x84
0xe08cfaf0: at vget+0xdc
0xe08cfb30: at vnode_pager_lock+0x20c
0xe08cfb90: at vm_fault+0x218
0xe08cfca0: at trap_pfault+0x128
0xe08cfce0: at trap+0x1ac
0xe08cfda0: at powerpc_interrupt+0x15c
0xe08cfdd0: user ISI trap by 0x1818f4c: srr1=0x4000d032
r1=0x7fffded0 cr=0x24000048 xer=0 ctr=0
WARNING: /mnt/disk2 was not properly dismounted
lock order reversal:
1st 0xd9d27400 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
2nd 0xe41e00 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:263
KDB: stack backtrace:
0xe50c1a20: at kdb_backtrace+0x4c
0xe50c1a40: at _witness_debugger+0x3c
0xe50c1a60: at witness_checkorder+0x8d0
0xe50c1ac0: at _sx_xlock+0x90
0xe50c1af0: at ufsdirhash_acquire+0x40
0xe50c1b10: at ufsdirhash_remove+0x2c
0xe50c1b40: at ufs_dirremove+0x100
0xe50c1b80: at ufs_remove+0x8c
0xe50c1bc0: at VOP_REMOVE_APV+0xe0
0xe50c1be0: at kern_unlinkat+0x1b4
0xe50c1ca0: at kern_unlink+0x24
0xe50c1cc0: at unlink+0x1c
0xe50c1ce0: at trap+0x460
0xe50c1da0: at powerpc_interrupt+0x15c
0xe50c1dd0: user SC trap by 0x21940288: srr1=0xd032
r1=0x7fffd570 cr=0x40000042 xer=0 ctr=0x21940280
lock order reversal:
1st 0x4181c0c ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1064
2nd 0x41896bc devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2047
KDB: stack backtrace:
0xe510c7f0: at kdb_backtrace+0x4c
0xe510c810: at _witness_debugger+0x3c
0xe510c830: at witness_checkorder+0x8d0
0xe510c890: at __lockmgr_args+0xaf8
0xe510c910: at vop_stdlock+0x48
0xe510c930: at VOP_LOCK1_APV+0xec
0xe510c950: at _vn_lock+0x84
0xe510c9a0: at vget+0xdc
0xe510c9e0: at devfs_allocv+0x11c
0xe510ca20: at devfs_root+0x5c
0xe510ca60: at vfs_donmount+0x1458
0xe510cca0: at nmount+0xd8
0xe510cce0: at trap+0x460
0xe510cda0: at powerpc_interrupt+0x15c
0xe510cdd0: user SC trap by 0x218d2788: srr1=0xd032
r1=0x7fffcd10 cr=0x20000044 xer=0 ctr=0x218d2780
link_elf: symbol dev2unit undefined
lock order reversal:
1st 0x88efd1c ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:420
2nd 0xd9d5b118 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
3rd 0xf2c05c ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:541
KDB: stack backtrace:
0xe511b5b0: at kdb_backtrace+0x4c
0xe511b5d0: at _witness_debugger+0x3c
0xe511b5f0: at witness_checkorder+0x8d0
0xe511b650: at __lockmgr_args+0xaf8
0xe511b6d0: at ffs_lock+0x9c
0xe511b700: at VOP_LOCK1_APV+0xec
0xe511b720: at _vn_lock+0x84
0xe511b770: at ffs_snapshot+0x12ec
0xe511b970: at ffs_mount+0x10a4
0xe511ba60: at vfs_donmount+0x108c
0xe511bca0: at nmount+0xd8
0xe511bce0: at trap+0x460
0xe511bda0: at powerpc_interrupt+0x15c
0xe511bdd0: user SC trap by 0x218d8788: srr1=0xf032
r1=0x7fffdb90 cr=0x20004044 xer=0 ctr=0x218d8780
lock order reversal:
1st 0xd9d5b118 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443
2nd 0x8923b9c snaplk (snaplk) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:790
KDB: stack backtrace:
0xe511b5b0: at kdb_backtrace+0x4c
0xe511b5d0: at _witness_debugger+0x3c
0xe511b5f0: at witness_checkorder+0x8d0
0xe511b650: at __lockmgr_args+0xaf8
0xe511b6d0: at ffs_lock+0x9c
0xe511b700: at VOP_LOCK1_APV+0xec
0xe511b720: at _vn_lock+0x84
0xe511b770: at ffs_snapshot+0x22f8
0xe511b970: at ffs_mount+0x10a4
0xe511ba60: at vfs_donmount+0x108c
0xe511bca0: at nmount+0xd8
0xe511bce0: at trap+0x460
0xe511bda0: at powerpc_interrupt+0x15c
0xe511bdd0: user SC trap by 0x218d8788: srr1=0xf032
r1=0x7fffdb90 cr=0x20004044 xer=0 ctr=0x218d8780
lock order reversal:
1st 0x8923b9c snaplk (snaplk) @ /usr/src/sys/kern/vfs_vnops.c:293
2nd 0x88efd1c ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:1584
KDB: stack backtrace:
0xe511b880: at kdb_backtrace+0x4c
0xe511b8a0: at _witness_debugger+0x3c
0xe511b8c0: at witness_checkorder+0x8d0
0xe511b920: at __lockmgr_args+0xaf8
0xe511b9a0: at ffs_snapremove+0x148
0xe511ba10: at softdep_releasefile+0x54
0xe511ba40: at ufs_inactive+0x1c8
0xe511ba80: at VOP_INACTIVE_APV+0xe0
0xe511baa0: at vinactive+0x98
0xe511bae0: at vput+0x21c
0xe511bb30: at vn_close+0x10c
0xe511bb80: at vn_closefile+0x114
0xe511bbf0: at _fdrop+0x60
0xe511bc10: at closef+0x2f8
0xe511bc90: at kern_close+0x144
0xe511bcc0: at close+0x18
0xe511bce0: at trap+0x460
0xe511bda0: at powerpc_interrupt+0x15c
0xe511bdd0: user SC trap by 0x2197f088: srr1=0xf032
r1=0x7fffdb60 cr=0x22004028 xer=0 ctr=0x2197f080
lock order reversal:
1st 0x4181c0c ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1207
2nd 0x41895ac syncer (syncer) @ /usr/src/sys/kern/vfs_subr.c:2147
KDB: stack backtrace:
0xe5206a70: at kdb_backtrace+0x4c
0xe5206a90: at _witness_debugger+0x3c
0xe5206ab0: at witness_checkorder+0x8d0
0xe5206b10: at __lockmgr_args+0xaf8
0xe5206b90: at vop_stdlock+0x48
0xe5206bb0: at VOP_LOCK1_APV+0xec
0xe5206bd0: at _vn_lock+0x84
0xe5206c20: at vrele+0x158
0xe5206c60: at dounmount+0x3b0
0xe5206ca0: at unmount+0x2e4
0xe5206ce0: at trap+0x460
0xe5206da0: at powerpc_interrupt+0x15c
0xe5206dd0: user SC trap by 0x218b1e38: srr1=0xd032
r1=0x7fffd540 cr=0x20004082 xer=0 ctr=0x218b1e30
% sysctl kern.smp
kern.smp.forward_roundrobin_enabled: 1
kern.smp.forward_signal_enabled: 1
kern.smp.topology: 0
kern.smp.cpus: 2
kern.smp.disabled: 0
kern.smp.active: 1
kern.smp.maxcpus: 2
kern.smp.maxid: 1
% vmstat -ia
interrupt total rate
irq48: bge0 66399 0
irq22: scc0 0 0
irq23: scc0 0 0
irq47: pmu0 0 0
irq19: ata0 35 0
irq27: ohci0 4 0
irq28: ohci1 1 0
irq58: atapci0 1796238 26
irq63: atapci1 0 0
irq40: fwohci0 2 0
irq41: gem0 237728 3
irq64: IPI 7734095 114
Total 9834502 146
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?491B18F3.4010900>