From owner-freebsd-bugs  Sun May 12 11: 0:27 2002
Delivered-To: freebsd-bugs@hub.freebsd.org
Received: from freefall.freebsd.org (freefall.FreeBSD.org [216.136.204.21])
	by hub.freebsd.org (Postfix) with ESMTP id BD8BA37B406
	for <freebsd-bugs@hub.freebsd.org>; Sun, 12 May 2002 11:00:13 -0700 (PDT)
Received: (from gnats@localhost)
	by freefall.freebsd.org (8.11.6/8.11.6) id g4CI0D230483;
	Sun, 12 May 2002 11:00:13 -0700 (PDT)
	(envelope-from gnats)
Received: from nwww.freebsd.org (www.FreeBSD.org [216.136.204.117])
	by hub.freebsd.org (Postfix) with ESMTP id 9C00937B404
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 12 May 2002 10:57:14 -0700 (PDT)
Received: from www.freebsd.org (localhost [127.0.0.1])
	by nwww.freebsd.org (8.12.2/8.12.2) with ESMTP id g4CHvChG031638
	for <freebsd-gnats-submit@FreeBSD.org>; Sun, 12 May 2002 10:57:12 -0700 (PDT)
	(envelope-from nobody@www.freebsd.org)
Received: (from nobody@localhost)
	by www.freebsd.org (8.12.2/8.12.2/Submit) id g4CHvCSa031637;
	Sun, 12 May 2002 10:57:12 -0700 (PDT)
Message-Id: <200205121757.g4CHvCSa031637@www.freebsd.org>
Date: Sun, 12 May 2002 10:57:12 -0700 (PDT)
From: Sergey Zorin <sergey@cc.tpu.edu.ru>
To: freebsd-gnats-submit@FreeBSD.org
X-Send-Pr-Version: www-1.0
Subject: kern/37998: panic: vinvalbuf: dirty bufs
Sender: owner-freebsd-bugs@FreeBSD.ORG
Precedence: bulk
List-ID: <freebsd-bugs.FreeBSD.ORG>
List-Archive: <http://docs.freebsd.org/mail/> (Web Archive)
List-Help: <mailto:majordomo@FreeBSD.ORG?subject=help> (List Instructions)
List-Subscribe: <mailto:majordomo@FreeBSD.ORG?subject=subscribe%20freebsd-bugs>
List-Unsubscribe: <mailto:majordomo@FreeBSD.ORG?subject=unsubscribe%20freebsd-bugs>
X-Loop: FreeBSD.org


>Number:         37998
>Category:       kern
>Synopsis:       panic: vinvalbuf: dirty bufs
>Confidential:   no
>Severity:       serious
>Priority:       high
>Responsible:    freebsd-bugs
>State:          open
>Quarter:        
>Keywords:       
>Date-Required:
>Class:          sw-bug
>Submitter-Id:   current-users
>Arrival-Date:   Sun May 12 11:00:13 PDT 2002
>Closed-Date:
>Last-Modified:
>Originator:     Sergey Zorin
>Release:        4.5-RELEASE-p4
>Organization:
Cybernetic Center
>Environment:
uname -a output
FreeBSD prosaic.cctpu.edu.ru 4.5-RELEASE-p4 FreeBSD 4.5-RELEASE-p4 #1: Sun May 12 18:59:31 GMT 2002     root@prosaic.cctpu.edu.ru:/usr/src/sys/compile/GENERIC-p  i386

kernel: config -g GENERIC

dmesg output:

Copyright (c) 1992-2002 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD 4.5-RELEASE-p4 #1: Sun May 12 18:59:31 GMT 2002
    root@prosaic.cctpu.edu.ru:/usr/src/sys/compile/GENERIC-p
Timecounter "i8254"  frequency 1193182 Hz
CPU: Pentium III/Pentium III Xeon/Celeron (868.64-MHz 686-class CPU)
  Origin = "GenuineIntel"  Id = 0x68a  Stepping = 10
  Features=0x383f9ff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE>
real memory  = 134152192 (131008K bytes)
avail memory = 125767680 (122820K bytes)
Preloaded elf kernel "kernel" at 0xc04af000.
Pentium Pro MTRR support enabled
md0: Malloc disk
Using $PIR table, 11 entries at 0xc00fdec0
npx0: <math processor> on motherboard
npx0: INT 16 interface
pcib0: <Host to PCI bridge> on motherboard
pci0: <PCI bus> on pcib0
pcib1: <Intel 82801BA/BAM (ICH2) PCI-PCI (AGP) bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
pci1: <ATI Mach64-GM graphics accelerator> at 0.0 irq 11
pcib2: <Intel 82801BA/BAM (ICH2) Hub to PCI bridge> at device 30.0 on pci0
pci2: <PCI bus> on pcib2
xl0: <3Com 3c905C-TX Fast Etherlink XL> port 0xa000-0xa07f mem 0xd9000000-0xd900007f irq 12 at device 2.0 on pci2
xl0: Ethernet address: 00:04:75:70:a4:13
miibus0: <MII bus> on xl0
ukphy0: <Generic IEEE 802.3u media interface> on miibus0
ukphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto
ahc0: <Adaptec 29160 Ultra160 SCSI adapter> port 0xa400-0xa4ff mem 0xd9001000-0xd9001fff irq 11 at device 3.0 on pci2
aic7892: Ultra160 Wide Channel A, SCSI Id=7, 32/255 SCBs
isab0: <Intel 82801BA/BAM (ICH2) PCI to LPC bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH2 ATA100 controller> port 0xf000-0xf00f at device 31.1 on pci0
ata0: at 0x1f0 irq 14 on atapci0
ata1: at 0x170 irq 15 on atapci0
uhci0: <Intel 82801BA/BAM (ICH2) USB controller USB-A> port 0xb000-0xb01f irq 9 at device 31.2 on pci0
usb0: <Intel 82801BA/BAM (ICH2) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801BA/BAM (ICH2) USB controller USB-B> port 0xb800-0xb81f irq 9 at device 31.4 on pci0
usb1: <Intel 82801BA/BAM (ICH2) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
pci0: <unknown card> (vendor=0x8086, dev=0x2445) at 31.5 irq 5
orm0: <Option ROM> at iomem 0xc0000-0xc97ff on isa0
fdc0: <NEC 72065B or clone> at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0
fdc0: FIFO enabled, 8 bytes threshold
fd0: <1440-KB 3.5" drive> on fdc0 drive 0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio0 at port 0x3f8-0x3ff irq 4 flags 0x10 on isa0
sio0: type 16550A
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
ppc0: <Parallel port> at port 0x378-0x37f irq 7 on isa0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
plip0: <PLIP network interface> on ppbus0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
Profiling kernel, textsize=2373056 [c0128e00..c036c3c0]
Waiting 15 seconds for SCSI devices to settle
Mounting root from ufs:/dev/da0s3a
da1 at ahc0 bus 0 target 1 lun 0
da1: <IBM DDYS-T18350N S96H> Fixed Direct Access SCSI-3 device 
da1: 160.000MB/s transfers (80.000MHz, offset 63, 16bit), Tagged Queueing Enabled
da1: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
cd0 at ahc0 bus 0 target 6 lun 0
cd0: <NEC CD-ROM DRIVE:466 1.26> Removable CD-ROM SCSI-2 device 
cd0: 20.000MB/s transfers (20.000MHz, offset 16)
cd0: cd present [319346 x 2048 byte records]
da2 at ahc0 bus 0 target 2 lun 0
da2: <IBM DDYS-T18350N S96H> Fixed Direct Access SCSI-3 device 
da2: 160.000MB/s transfers (80.000MHz, offset 63, 16bit), Tagged Queueing Enabled
da2: 17501MB (35843670 512 byte sectors: 255H 63S/T 2231C)
da0 at ahc0 bus 0 target 0 lun 0
da0: <IBM DNES-309170W SA30> Fixed Direct Access SCSI-3 device 
da0: 80.000MB/s transfers (40.000MHz, offset 31, 16bit), Tagged Queueing Enabled
da0: 8748MB (17916240 512 byte sectors: 255H 63S/T 1115C)
WARNING: / was not properly dismounted

>Description:
Kernel paniced with vinvalbuf: dirty bufs while system under heavy IO on local (ffs) disks.
System has three SCSI disks. First is system disk (80Mb/s), second and third are data disks (160Mb/s). IO activity is issued by unpacking /cdrom/port/ports.tgz archive. One archive unpacked on each disk. Operation repeated in loop. All working ok from few minutes to 3 hours, after that kernel paniced. 
Bellow is gdb output.
GNU gdb 4.18
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-unknown-freebsd"...
IdlePTD at phsyical address 0x004b1000
initial pcb at physical address 0x003f60c0
panicstr: vinvalbuf: dirty bufs
panic messages:
---
panic: vinvalbuf: dirty bufs

syncing disks... 72 48 48 48 48 48 48 48 48 48 48 48 48 48 48 48 48 48 48 48 48 
giving up on 48 buffers
Uptime: 2h40m6s

dumping to dev #da/0x20001, offset 231360
dump 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0 
---
#0  dumpsys () at ../../kern/kern_shutdown.c:474
474		if (dumping++) {
(kgdb) where
#0  dumpsys () at ../../kern/kern_shutdown.c:474
#1  0xc01c1f8b in boot (howto=256) at ../../kern/kern_shutdown.c:313
#2  0xc01c236c in poweroff_wait (junk=0xc037b6ee, howto=-921301632)
    at ../../kern/kern_shutdown.c:582
#3  0xc01eeaf6 in vinvalbuf (vp=0xc9160d80, flags=1, cred=0x0, p=0xc7f3c780, 
    slpflag=0, slptimeo=0) at ../../kern/vfs_subr.c:783
#4  0xc01efd8f in vclean (vp=0xc9160d80, flags=8, p=0xc7f3c780)
    at ../../kern/vfs_subr.c:1831
#5  0xc01effa3 in vgonel (vp=0xc9160d80, p=0xc7f3c780)
    at ../../kern/vfs_subr.c:1995
#6  0xc01ee5fe in vlrureclaim (mp=0xc104f800, count=10)
    at ../../kern/vfs_subr.c:481
#7  0xc01ee6cc in vnlru_proc () at ../../kern/vfs_subr.c:528
(kgdb) up
#1  0xc01c1f8b in boot (howto=256) at ../../kern/kern_shutdown.c:313
313			dumpsys();
(kgdb) up
#2  0xc01c236c in poweroff_wait (junk=0xc037b6ee, howto=-921301632)
    at ../../kern/kern_shutdown.c:582
582		boot(bootopt);
(kgdb) up
#3  0xc01eeaf6 in vinvalbuf (vp=0xc9160d80, flags=1, cred=0x0, p=0xc7f3c780, 
    slpflag=0, slptimeo=0) at ../../kern/vfs_subr.c:783
warning: Source file is more recent than executable.

783			/*	s = splbio();	*/
(kgdb) print vp->v_numoutput
$1 = 0
(kgdb) print vp_ ->v_dirtyblkhd
$2 = {tqh_first = 0xc3844304, tqh_last = 0xc384430c}
(kgdb) 
>How-To-Repeat:
Try heavy load system's local hard drives. And wait about 1 hour and 30 minutes.
>Fix:
      
>Release-Note:
>Audit-Trail:
>Unformatted:

To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-bugs" in the body of the message