Date: Fri, 24 Sep 1999 19:25:08 +0200 (CEST) From: Thierry.Besancon@lps.ens.fr To: FreeBSD-gnats-submit@freebsd.org Cc: besancon@lps.ens.fr Subject: i386/13933: NFS server panics Message-ID: <199909241725.TAA96154@tournesol.lps.ens.fr>
next in thread | raw e-mail | index | archive | help
>Number: 13933 >Category: i386 >Synopsis: nfs server panics in tulip_rx_intr() >Confidential: no >Severity: critical >Priority: high >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Fri Sep 24 10:30:00 PDT 1999 >Closed-Date: >Last-Modified: >Originator: >Release: FreeBSD 3.3-RELEASE i386 >Organization: Laboratoire de Physique Statistique -- Ecole Normale Supérieure >Environment: The problem occurs on a PC running FreeBSD 3.3 and acting as a NFS server for my lab. It has 8 external scsi UW disks : 4 disks on a tekram 390 DF, 4 other on another tekram 390 df. It has also an adaptec 2940 for a DLT tape streamer and a narrow scsi disk. Here's the uname -a output : FreeBSD fileserver.lps.ens.fr 3.3-RELEASE FreeBSD 3.3-RELEASE #0: Tue Sep 21 14:01:54 CEST 1999 root@demo.lps.ens.fr:/usr/src/sys/compile/FILESERVER i386 Here's the dmesg : Copyright (c) 1992-1999 FreeBSD Inc. Copyright (c) 1982, 1986, 1989, 1991, 1993 The Regents of the University of California. All rights reserved. FreeBSD 3.3-RELEASE #0: Tue Sep 21 14:01:54 CEST 1999 root@demo.lps.ens.fr:/usr/src/sys/compile/FILESERVER Timecounter "i8254" frequency 1193182 Hz Timecounter "TSC" frequency 333410044 Hz CPU: AMD-K6(tm) 3D processor (333.41-MHz 586-class CPU) Origin = "AuthenticAMD" Id = 0x58c Stepping = 12 Features=0x8021bf<FPU,VME,DE,PSE,TSC,MSR,MCE,CX8,PGE,MMX> AMD Features=0x80000800<SYSCALL,3DNow!> real memory = 33488896 (32704K bytes) avail memory = 29855744 (29156K bytes) Preloaded elf kernel "kernel" at 0xc02a9000. Preloaded userconfig_script "/boot/kernel.conf" at 0xc02a909c. Probing for devices on PCI bus 0: chip0: <AcerLabs M1541 (Aladdin-V) PCI host bridge> rev 0x04 on pci0.0.0 chip1: <AcerLabs M5243 PCI-PCI bridge> rev 0x04 on pci0.1.0 chip2: <PCI to 0x80 bridge (vendor=10b9 device=7101)> rev 0x00 on pci0.3.0 chip3: <AcerLabs M1533 portable PCI-ISA bridge> rev 0xc3 on pci0.7.0 ncr0: <ncr 53c875 fast20 wide scsi> rev 0x26 int a irq 12 on pci0.9.0 ahc0: <Adaptec 2940 SCSI adapter> rev 0x03 int a irq 10 on pci0.11.0 ahc0: aic7870 Single Channel A, SCSI Id=7, 16/255 SCBs de0: <Digital 21143 Fast Ethernet> rev 0x30 int a irq 11 on pci0.12.0 de0: DEC DE500-BA 21143 [10-100Mb/s] pass 3.0 de0: address 00:00:f8:1f:d4:5c ncr1: <ncr 53c875 fast20 wide scsi> rev 0x26 int a irq 12 on pci0.13.0 Probing for devices on PCI bus 1: vga0: <ATI model 4742 graphics accelerator> rev 0x5c int a irq 11 on pci1.0.0 Probing for devices on the ISA bus: sc0 on isa sc0: VGA color <16 virtual consoles, flags=0x0> atkbdc0 at 0x60-0x6f on motherboard atkbd0 irq 1 on isa fdc0 at 0x3f0-0x3f7 irq 6 drq 2 on isa fdc0: FIFO enabled, 8 bytes threshold fd0: 1.44MB 3.5in vga0 at 0x3b0-0x3df maddr 0xa0000 msize 131072 on isa npx0 on motherboard npx0: INT 16 interface Waiting 3 seconds for SCSI devices to settle de0: enabling 10baseT port changing root device to da0s1a da15 at ahc0 bus 0 target 3 lun 0 da15: <SEAGATE ST34555N 0930> Fixed Direct Access SCSI-2 device da15: 10.000MB/s transfers (10.000MHz, offset 15), Tagged Queueing Enabled da15: 4340MB (8888924 512 byte sectors: 255H 63S/T 553C) da7 at ahc0 bus 0 target 2 lun 0 da7: <SEAGATE ST15150N 0023> Fixed Direct Access SCSI-2 device da7: 10.000MB/s transfers (10.000MHz, offset 15), Tagged Queueing Enabled da7: 4095MB (8388315 512 byte sectors: 255H 63S/T 522C) da10 at ncr1 bus 0 target 2 lun 0 da10: <IBM DDRS-39130D DC1B> Fixed Direct Access SCSI-2 device da10: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da10: 8715MB (17850000 512 byte sectors: 255H 63S/T 1111C) da3 at ncr0 bus 0 target 3 lun 0 da3: <IBM DDRS-39130D DC1B> Fixed Direct Access SCSI-2 device da3: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da3: 8715MB (17850000 512 byte sectors: 255H 63S/T 1111C) da1 at ncr0 bus 0 target 1 lun 0 da1: <IBM DDRS-39130D DC1B> Fixed Direct Access SCSI-2 device da1: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da1: 8715MB (17850000 512 byte sectors: 255H 63S/T 1111C) da11 at ncr1 bus 0 target 3 lun 0 da11: <IBM DDRS-39130D DC1B> Fixed Direct Access SCSI-2 device da11: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da11: 8715MB (17850000 512 byte sectors: 255H 63S/T 1111C) da9 at ncr1 bus 0 target 1 lun 0 da9: <IBM DDRS-39130D DC1B> Fixed Direct Access SCSI-2 device da9: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da9: 8715MB (17850000 512 byte sectors: 255H 63S/T 1111C) da2 at ncr0 bus 0 target 2 lun 0 da2: <IBM DDRS-39130D DC1B> Fixed Direct Access SCSI-2 device da2: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da2: 8715MB (17850000 512 byte sectors: 255H 63S/T 1111C) da0 at ncr0 bus 0 target 0 lun 0 da0: <IBM DDRS-34560D DC1B> Fixed Direct Access SCSI-2 device da0: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da0: 4357MB (8925000 512 byte sectors: 255H 63S/T 555C) da12 at ncr1 bus 0 target 4 lun 0 da12: <IBM DDRS-39130D DC1B> Fixed Direct Access SCSI-2 device da12: 40.000MB/s transfers (20.000MHz, offset 15, 16bit), Tagged Queueing Enabled da12: 8715MB (17850000 512 byte sectors: 255H 63S/T 1111C) WARNING: / was not properly dismounted de0: enabling 100baseTX port de0: enabling Full Duplex 100baseTX port Here's the configuration file of the kernel : ###################################################################### ###################################################################### machine "i386" cpu "I386_CPU" cpu "I486_CPU" cpu "I586_CPU" cpu "I686_CPU" ident FILESERVER maxusers 96 options GPL_MATH_EMULATE #Support for x87 emulation via #new math emulator options INCLUDE_CONFIG_FILE # Include this file in kernel config kernel root on wd0 options INET #InterNETworking options FFS #Berkeley Fast Filesystem options FFS_ROOT #FFS usable as root device [keep this!] options NFS #Network Filesystem options NFS_ROOT #NFS usable as root device, "NFS" req'ed options PROCFS #Process filesystem options "COMPAT_43" #Compatible with BSD 4.3 [KEEP THIS!] options FAILSAFE #Be conservative options USERCONFIG #boot -c editor options VISUAL_USERCONFIG #visual boot -c editor options KTRACE #ktrace(1) syscall trace support options SYSVSHM #SYSV-style shared memory options SYSVMSG #SYSV-style message queues options SYSVSEM #SYSV-style semaphores options "MD5" controller isa0 controller eisa0 controller pci0 # Floppy drives controller fdc0 at isa? port "IO_FD1" bio irq 6 drq 2 disk fd0 at fdc0 drive 0 controller ncr0 controller ncr1 controller ahc1 controller scbus0 at ncr0 controller scbus1 at ncr1 bus 0 controller scbus2 at ahc1 bus 0 device da0 at scbus0 target 0 device da1 at scbus0 target 1 device da2 at scbus0 target 2 device da3 at scbus0 target 3 device da4 at scbus0 target 4 device da5 at scbus0 target 5 device da6 at scbus0 target 6 # device da8 at scbus1 target 0 device da9 at scbus1 target 1 device da10 at scbus1 target 2 device da11 at scbus1 target 3 device da12 at scbus1 target 4 device da13 at scbus1 target 5 device da14 at scbus1 target 6 # device da16 at scbus2 target 0 device da17 at scbus2 target 1 device da18 at scbus2 target 2 device da19 at scbus2 target 3 device da20 at scbus2 target 4 device da21 at scbus2 target 5 device da22 at scbus2 target 6 device sa0 #SCSI tapes device pass0 #CAM passthrough driver options SCSI_REPORT_GEOMETRY options SCSI_DELAY=3000 controller atkbdc0 at isa? port IO_KBD tty device atkbd0 at isa? tty irq 1 device vga0 at isa? port ? conflicts pseudo-device splash device sc0 at isa? tty device npx0 at isa? port IO_NPX irq 13 options MAXCONS=16 device de0 # DEC/Intel DC21x4x (``Tulip'') device fxp0 # Intel EtherExpress PRO/100B (82557, 82558) pseudo-device loop # Network loopback pseudo-device ether # Ethernet support pseudo-device pty 48 # Pseudo-ttys (telnet etc) pseudo-device vn #Vnode driver (turns a file into a device) ## pseudo-device bpfilter 1 #Berkeley packet filter makeoptions DEBUG="-g" #Build kernel with debug symbols. options DDB ## options DDB_UNATTENDED options "MSGBUF_SIZE=40960" ###################################################################### ###################################################################### >Description: After two months of perfect production, my NFS server running FreeBSD 3.2 started to crash unexpectedly. I changed the complete hardware of the CPU (mainboard, memory, ethernet card (fxp0)) and it still crashed. I updated to FreeBSD 3.3 (changing the system disk as well). It crashed several other times. I noticed at this time that it always paniced in ip_reass ou fxp driver. So I changed the fxp card for a brand new DIGITAL DE500, namely de driver. And it kept on crashing, with different place of crash in the code but still in the networking part of the kernel. Please find enclosed 2 uuencoded traces from kgdb run on the 2 vmcore I managed to get yesterday and today. begin 644 typescript M4V-R:7!T('-T87)T960@;VX@1G)I(%-E<" R-" Q.#HR-SHU-R Q.3DY"@HC M(&=D8B M:PI'3E4@9V1B(#0N,3@*0V]P>7)I9VAT(#$Y.3@@1G)E92!3;V9T M=V%R92!&;W5N9&%T:6]N+"!);F,N"D=$0B!I<R!F<F5E('-O9G1W87)E+"!C M;W9E<F5D(&)Y('1H92!'3E4@1V5N97)A;"!0=6)L:6,@3&EC96YS92P@86YD M('EO=2!A<F4*=V5L8V]M92!T;R!C:&%N9V4@:70@86YD+V]R(&1I<W1R:6)U M=&4@8V]P:65S(&]F(&ET('5N9&5R(&-E<G1A:6X@8V]N9&ET:6]N<RX*5'EP M92 B<VAO=R!C;W!Y:6YG(B!T;R!S964@=&AE(&-O;F1I=&EO;G,N"E1H97)E M(&ES(&%B<V]L=71E;'D@;F\@=V%R<F%N='D@9F]R($=$0BX@(%1Y<&4@(G-H M;W<@=V%R<F%N='DB(&9O<B!D971A:6QS+@I4:&ES($=$0B!W87,@8V]N9FEG M=7)E9"!A<R B:3,X-BUU;FMN;W=N+69R965B<V0B+@HH:V=D8BD@<WEM8F]L M+69I;&4@:V5R;F5L+F1E8G5G"E)E861I;F<@<WEM8F]L<R!F<F]M(&ME<FYE M;"YD96)U9RXN+F1O;F4N"BAK9V1B*2!E>&5C+69I;&4@+W9A<B]C<F%S:"]K M97)N96PN,0HH:V=D8BD@8V]R92UF:6QE("]V87(O8W)A<V@O=FUC;W)E+C$* M261L95!41" R.#8S,3 T"FEN:71I86P@<&-B(&%T(#(T9&8Y. IP86YI8W-T M<CH@9G)O;2!D96)U9V=E<@IP86YI8R!M97-S86=E<SH*+2TM"D9A=&%L('1R M87 @,3(Z('!A9V4@9F%U;'0@=VAI;&4@:6X@:V5R;F5L(&UO9&4*9F%U;'0@ M=FER='5A;"!A9&1R97-S"3T@,'AC,#5A,S4S-@IF875L="!C;V1E"0D]('-U M<&5R=FES;W(@=W)I=&4L('!A9V4@;F]T('!R97-E;G0*:6YS=')U8W1I;VX@ M<&]I;G1E<@D](#!X.#HP>&,P,6,P,C%F"G-T86-K('!O:6YT97()(" @(" @ M(" ](#!X,3 Z,'AC-#$P8C=B8PIF<F%M92!P;VEN=&5R"2 @(" @(" @/2 P M>#$P.C!X8S0Q,&(W9F,*8V]D92!S96=M96YT"0D](&)A<V4@,'@P+"!L:6UI M=" P>&9F9F9F+"!T>7!E(#!X,6(*"0D)/2!$4$P@,"P@<')E<R Q+"!D968S M,B Q+"!G<F%N(#$*<')O8V5S<V]R(&5F;&%G<PD](&EN=&5R<G5P="!E;F%B M;&5D+"!R97-U;64L($E/4$P@/2 P"F-U<G)E;G0@<')O8V5S<PD)/2 Q.#@@ M*&YF<V0I"FEN=&5R<G5P="!M87-K"0D](&YE=" *<&%N:6,Z(&9R;VT@9&5B M=6=G97(*<&%N:6,Z(&9R;VT@9&5B=6=G97(*"F1U;7!I;F<@=&\@9&5V(#(P M-# Q+"!O9F9S970@,3DV-S,V"F1U;7 @,S$@,S @,CD@,C@@,C<@,C8@,C4@ M,C0@,C,@,C(@,C$@,C @,3D@,3@@,3<@,38@,34@,30@,3,@,3(@,3$@,3 @ M.2 X(#<@-B U(#0@,R R(#$@," *+2TM"B,P("!B;V]T("AH;W=T;STR-C I M(&%T("XN+RXN+VME<FXO:V5R;E]S:'5T9&]W;BYC.C(X-0HR.#4)"0ED=6UP M<&-B+G!C8E]C<C,@/2!R8W(S*"D["BAK9V1B*2!B= HC," @8F]O=" H:&]W M=&\],C8P*2!A=" N+B\N+B]K97)N+VME<FY?<VAU=&1O=VXN8SHR.#4*(S$@ M(#!X8S Q-#)C8S4@:6X@<&%N:6,@*&9M=#TP>&,P,C%A-F0X(")F<F]M(&1E M8G5G9V5R(BD*(" @(&%T("XN+RXN+VME<FXO:V5R;E]S:'5T9&]W;BYC.C0T M-@HC,B @,'AC,#$R-F-B,2!I;B!D8E]P86YI8R H861D<CTM,3 W,3DP-C(W M,RP@:&%V95]A9&1R/3 L(&-O=6YT/2TQ+" *(" @(&UO9&EF/3!X8S0Q,&(V M-# @(B(I(&%T("XN+RXN+V1D8B]D8E]C;VUM86YD+F,Z-#,R"B,S(" P>&,P M,3(V8S4Q(&EN(&1B7V-O;6UA;F0@*&QA<W1?8VUD<#TP>&,P,C,V8CEC+"!C M;61?=&%B;&4],'AC,#(S-CEF8RP@"B @("!A=7A?8VUD7W1A8FQE<#TP>&,P M,C1B8S<P*2!A=" N+B\N+B]D9&(O9&)?8V]M;6%N9"YC.C,S,@HC-" @,'AC M,#$R-F0Q-B!I;B!D8E]C;VUM86YD7VQO;W @*"D@870@+BXO+BXO9&1B+V1B M7V-O;6UA;F0N8SHT-30*(S4@(#!X8S Q,CDQ.&8@:6X@9&)?=')A<" H='EP M93TQ,BP@8V]D93TP*2!A=" N+B\N+B]D9&(O9&)?=')A<"YC.C<Q"B,V(" P M>&,P,68V,#8V(&EN(&MD8E]T<F%P("AT>7!E/3$R+"!C;V1E/3 L(')E9W,] M,'AC-#$P8C<X,"D*(" @(&%T("XN+RXN+VDS.#8O:3,X-B]D8E]I;G1E<F9A M8V4N8SHQ-3<*(S<@(#!X8S R,#$P.30@:6X@=')A<%]F871A;" H9G)A;64] M,'AC-#$P8C<X,"P@979A/3,R,C<Q,S<S,S0I"B @("!A=" N+B\N+B]I,S@V M+VDS.#8O=')A<"YC.CDS-PHC." @,'AC,#(P,&0W,R!I;B!T<F%P7W!F875L M=" H9G)A;64],'AC-#$P8C<X,"P@=7-E<FUO9&4],"P@979A/3,R,C<Q,S<S M,S0I"B @("!A=" N+B\N+B]I,S@V+VDS.#8O=')A<"YC.C@S-0HC.2 @,'AC M,#(P,#EA-B!I;B!T<F%P("AF<F%M93U[=&9?97,@/2 Q-BP@=&9?9',@/2 Q M-BP@=&9?961I(#T@+3$P-C,S,C,V-#@L( H@(" @("!T9E]E<VD@/2 M,3 V M.#0W,C S,BP@=&9?96)P(#T@+3$P,#4U,S<R.#0L('1F7VES<" ]("TQ,# U M-3,W,S8X+" *(" @(" @=&9?96)X(#T@+3$P-C@T-S(P-C0L('1F7V5D>" ] M(#<X,S8W,"P@=&9?96-X(#T@+3$P-C,S,SDX.#@L( H@(" @("!T9E]E87@@ M/2 M,3 V.#8Q,S8S,BP@=&9?=')A<&YO(#T@,3(L('1F7V5R<B ](#(L('1F M7V5I<" ]("TQ,#<Q.3 V,C<S+" *(" @(" @=&9?8W,@/2 X+"!T9E]E9FQA M9W,@/2 V-C W,"P@=&9?97-P(#T@+3$P-C,S,C,V-#@L('1F7W-S(#T@+3(V M,38X-3$X-'TI"B @("!A=" N+B\N+B]I,S@V+VDS.#8O=')A<"YC.C0S-PHC M,3 @,'AC,#%C,#(Q9B!I;B!T=6QI<%]R>%]I;G1R("AS8STP>&,P.65F.# P M*2!A=" N+B\N+B]P8VDO:69?9&4N8SHS-C0Y"B,Q,2 P>&,P,6,P.#1F(&EN M('1U;&EP7VEN=')?:&%N9&QE<B H<V,],'AC,#EE9C@P,"P@<')O9W)E<W-? M<#TP>&,T,3!B.#(T*0H@(" @870@+BXO+BXO<&-I+VEF7V1E+F,Z,SDY. HC M,3(@,'AC,#%C,#EA9"!I;B!T=6QI<%]I;G1R7VYO<FUA;" H87)G/3!X8S Y M968X,# I(&%T("XN+RXN+W!C:2]I9E]D92YC.C0Q.#<*(S$S(#!X8S Q9F9A M96,@:6X@<VUA;&Q?:34X-E]B8V]P>2 H*0HC,30@,'AC,#%A,3<Y8B!I;B!N M9G-?<F5A;&EG;B H<&T],'AC,#1F938P,"P@:'-I>CTT,"D*(" @(&%T("XN M+RXN+VYF<R]N9G-?<V]C:V5T+F,Z,38V,@HC,34@,'AC,#%A,C%E-B!I;B!N M9G-R=E]R8W8@*'-O/3!X8S-E939A83 L(&%R9STP>&,P.64X,# P+"!W86ET M9FQA9STQ*0H@(" @870@+BXO+BXO;F9S+VYF<U]S;V-K970N8SHR,#,S"B,Q M-B P>&,P,35C,S T(&EN('-O=V%K975P("AS;STP>&,S964V86$P+"!S8CTP M>&,S964V864T*0H@(" @870@+BXO+BXO:V5R;B]U:7!C7W-O8VME=#(N8SHS M,C8*(S$W(#!X8S Q.#4W,V0@:6X@=61P7VEN<'5T("AM/3!X8S T9F4V,# L M(&EP:&QE;CTR."D*(" @(&%T("XN+RXN+VYE=&EN970O=61P7W5S<G)E<2YC M.C,R-PHC,3@@,'AC,#$W9&%E8R!I;B!I<%]I;G!U=" H;3TP>&,P-&9E-C P M*2!A=" N+B\N+B]N971I;F5T+VEP7VEN<'5T+F,Z-S X"B,Q.2 P>&,P,3=D M8C1B(&EN(&EP:6YT<B H*2!A=" N+B\N+B]N971I;F5T+VEP7VEN<'5T+F,Z M-S,U"B,R," P>&,P,68W8V8Q(&EN('-W:5]N971?;F5X=" H*0HC,C$@,'AC M,#%C83DT92!I;B!F9G-?:&%S:&%L;&]C("AI<#TP>&,P8F4T,3 P+"!C9STQ M-S$L('!R968]-38P,S,S-BP@"B @("!S:7IE/3@Q.3(L(&%L;&]C871O<CTP M>&,P,6-A8V,T(#QF9G-?86QL;V-C9SXI"B @("!A=" N+B\N+B]U9G,O9F9S M+V9F<U]A;&QO8RYC.C<V-0HC,C(@,'AC,#%C.60R,B!I;B!F9G-?86QL;V,@ M*&EP/3!X8S!B930Q,# L(&QB;CTQ,3 P+"!B<')E9CTU-C S,S,V+" *(" @ M('-I>F4].#$Y,BP@8W)E9#TP>&,P86(T-S@T+"!B;G ],'AC-#$P8F(T."D* M(" @(&%T("XN+RXN+W5F<R]F9G,O9F9S7V%L;&]C+F,Z,30P"B,R,R P>&,P M,6-D,6,T(&EN(&9F<U]B86QL;V,@*&%P/3!X8S0Q,&)C,#0I(&%T("XN+RXN M+W5F<R]F9G,O9F9S7V)A;&QO8RYC.C(X.0HC,C0@,'AC,#%D,3 T."!I;B!F M9G-?=W)I=&4@*&%P/3!X8S0Q,&)C-V,I(&%T('9N;V1E7VEF+F@Z,3 Q-0HC M,C4@,'AC,#$X9F5E.2!I;B!N9G-R=E]W<FET92 H;F9S9#TP>&,P86(T-S P M+"!S;' ],'AC,#EE.# P,"P@"B @("!P<F]C<#TP>&,T,&0T9C0P+"!M<G$] M,'AC-#$P8F4S-"D@870@=FYO9&5?:68N:#HS,S$*(S(V(#!X8S Q838X8F4@ M:6X@;F9S<W9C7VYF<V0@*&YS9#TP>&,T,3!B93DT+"!A<F=P/3!X.# W,68P M-" B(BP@<#TP>&,T,&0T9C0P*0H@(" @870@+BXO+BXO;F9S+VYF<U]S>7-C M86QL<RYC.C8U-@HC,C<@,'AC,#%A-C%D.2!I;B!N9G-S=F,@*' ],'AC-#!D M-&8T,"P@=6%P/3!X8S0Q,&)F.30I"B @("!A=" N+B\N+B]N9G,O;F9S7W-Y M<V-A;&QS+F,Z,S0R"B,R." P>&,P,C Q,S S(&EN('-Y<V-A;&P@*&9R86UE M/7MT9E]E<R ](#,Y+"!T9E]D<R ](#,Y+"!T9E]E9&D@/2 X+" *(" @(" @ M=&9?97-I(#T@,2P@=&9?96)P(#T@+3$P-S<Y-#0X.38L('1F7VES<" ]("TQ M,# U-3,U,C8P+"!T9E]E8G@@/2 P+" *(" @(" @=&9?961X(#T@+3$P-S<Y M-#4R.3(L('1F7V5C>" ](# L('1F7V5A>" ](#$U-2P@=&9?=')A<&YO(#T@ M,3(L( H@(" @("!T9E]E<G(@/2 R+"!T9E]E:7 @/2 Q,S0U,3@Y-S(L('1F M7V-S(#T@,S$L('1F7V5F;&%G<R ](#8T-BP@"B @(" @('1F7V5S<" ]("TQ M,#<W.30U,C@T+"!T9E]S<R ](#,Y?2D@870@+BXO+BXO:3,X-B]I,S@V+W1R M87 N8SHQ,3 P"B,R.2 P>&,P,68V.6)C(&EN(%AI;G0P>#@P7W-Y<V-A;&P@ M*"D*(S,P(#!X.# T.#!E.2!I;B _/R H*0HH:V=D8BD@9G)A;64@,3 *(S$P M(#!X8S Q8S R,68@:6X@='5L:7!?<GA?:6YT<B H<V,],'AC,#EE9C@P,"D@ M870@+BXO+BXO<&-I+VEF7V1E+F,Z,S8T.0HS-C0Y"0D)(" @($U#3$=%5"AM M,"P@35]$3TY45T%)5"D["@H**&MG9&(I(&QI<W0*,S8T- D)(" @($U'151( M1%(H;3 L($U?1$].5%=!250L($U47T1!5$$I.PHS-C0U"0D@(" @:68@*&TP M("$]($Y53$PI('L*,S8T-@DC:68@9&5F:6YE9"A454Q)4%]#3U!97U)81$%4 M02D*,S8T-PD)"6EF("@A86-C97!T('Q\('1O=&%L7VQE;B ^/2!-2$Q%3BD@ M>PHS-C0X"2-E;F1I9@HS-C0Y"0D)(" @($U#3$=%5"AM,"P@35]$3TY45T%) M5"D["C,V-3 )"0D@(" @:68@*"AM,"T^;5]F;&%G<R F($U?15A4*2 ]/2 P M*2!["C,V-3$)"0D);5]F<F5E;2AM,"D["C,V-3()"0D);3 @/2!.54Q,.PHS M-C4S"0D)(" @('T*"BAK9V1B*2!P(&TP"B0Q(#T@*'-T<G5C="!M8G5F("HI M(#!X8S P-C X,# **&MG9&(I(' @*FTP"B0R(#T@>VU?:&1R(#T@>VUH7VYE M>'0@/2 P>&8U-&8W,&1A+"!M:%]N97AT<&MT(#T@,'@W,#8V.#,Q92P@"B @ M("!M:%]D871A(#T@,'AB-S!D.3(V8B \061D<F5S<R P>&(W,&0Y,C9B(&]U M="!O9B!B;W5N9',^+" *(" @(&UH7VQE;B ](#$V,3<U,C T,S$L(&UH7W1Y M<&4@/2 M,C<Q,C,L(&UH7V9L86=S(#T@,C0Q,3)]+"!-7V1A=" ]('M-2" ] M('L*(" @(" @34A?<&MT:&1R(#T@>W)C=FEF(#T@,'@W8S,X.6,X-RP@;&5N M(#T@+3,U-S,P,C,V,2P@:&5A9&5R(#T@,'@T-#-C-&(W.'TL( H@(" @("!- M2%]D870@/2![34A?97AT(#T@>PH@(" @(" @(" @97AT7V)U9B ](#!X9#,X M,V%A-# @/$%D9')E<W,@,'AD,S@S86$T,"!O=70@;V8@8F]U;F1S/BP@"B @ M(" @(" @("!E>'1?9G)E92 ](#!X8S%E,V8T96(L(&5X=%]S:7IE(#T@,S4U M,S8Y-S(Y,"P@97AT7W)E9B ](#!X.3EB964U-C-]+" *(" @(" @("!-2%]D M871A8G5F(#T@(D"J7#(P,]/K]./!7&Y<,#,VT=-CY;Y<,C,Q+2?4Q5PP,C \ M7#(P,V1!7#(P,#Q<8;THV]JZ]SE<,# U7#(R,5PR,S7&7#(R-5PR,#1(:UPP M,S9?<^\RN5)K]/FO2JU<,#(P7UPR,#73;5PP,3=[W7,Y7#(Q-'9<,C(U7&(P M7#(Q-O%E7# S-5PP,S"]7# S-O]9W?-67#(Q,>Q<,C$SP%OC7UCGN4HV7# R M,R)]?2P@"B @("!-7V1A=&%B=68@/2 B7#(P-UPR,S0X?*?_L^IX2SQ$0*I< M,C ST^OTX\%<;EPP,S;1TV/EOEPR,S$M)]3%7# R,#Q<,C S9$%<,C P/%QA MO2C;VKKW.5PP,#5<,C(Q7#(S-<9<,C(U7#(P-$AK7# S-E]S[S*Y4FOT^:]* MK5PP,C!?7#(P-=-M7# Q-WO=<SE<,C$T=EPR,C5<8C!<,C$V\65<,#,U7# S M,+U<,#,V_UG=\U9<,C$Q[%PR,3/ 6^-?6.>Y2C9<,#(S(GU]"@H*"@H*"@H* M"BAK9V1B*2!E>&5C+69I;&4@+W9A<B]C<F%S:"]K97)N96PN, HH:V=D8BD@ M8V]R92UF:6QE("]V87(O8W)A<V@O=FUC;W)E+C *261L95!41" R.#8S,3 T M"FEN:71I86P@<&-B(&%T(#(T9&8Y. IP86YI8W-T<CH@9G)O;2!D96)U9V=E M<@IP86YI8R!M97-S86=E<SH*+2TM"D9A=&%L('1R87 @,3(Z('!A9V4@9F%U M;'0@=VAI;&4@:6X@:V5R;F5L(&UO9&4*9F%U;'0@=FER='5A;"!A9&1R97-S M"3T@,'@S.#,S,SDS- IF875L="!C;V1E"0D]('-U<&5R=FES;W(@<F5A9"P@ M<&%G92!N;W0@<')E<V5N= II;G-T<G5C=&EO;B!P;VEN=&5R"3T@,'@X.C!X M,S@S,S,Y,S0*<W1A8VL@<&]I;G1E<@D@(" @(" @(#T@,'@Q,#HP>&,T,3$W M839C"F9R86UE('!O:6YT97()(" @(" @(" ](#!X,3 Z,'AC-#$Q-V$X- IC M;V1E('-E9VUE;G0)"3T@8F%S92 P># L(&QI;6ET(#!X9F9F9F8L('1Y<&4@ M,'@Q8@H)"0D]($103" P+"!P<F5S(#$L(&1E9C,R(#$L(&=R86X@,0IP<F]C M97-S;W(@969L86=S"3T@:6YT97)R=7!T(&5N86)L960L(')E<W5M92P@24]0 M3" ](# *8W5R<F5N="!P<F]C97-S"0D](#$V-2 H;F9S9"D*:6YT97)R=7!T M(&UA<VL)"3T@;F5T( H*"D9A=&%L('1R87 @,3(Z('!A9V4@9F%U;'0@=VAI M;&4@:6X@:V5R;F5L(&UO9&4*9F%U;'0@=FER='5A;"!A9&1R97-S"3T@,'@S M.#,S,SDS- IF875L="!C;V1E"0D]('-U<&5R=FES;W(@<F5A9"P@<&%G92!N M;W0@<')E<V5N= II;G-T<G5C=&EO;B!P;VEN=&5R"3T@,'@X.C!X8S Q9C8Q M,V,*<W1A8VL@<&]I;G1E<@D@(" @(" @(#T@,'@Q,#HP>&,T,3$W.&4T"F9R M86UE('!O:6YT97()(" @(" @(" ](#!X,3 Z,'AC-#$Q-SAE. IC;V1E('-E M9VUE;G0)"3T@8F%S92 P># L(&QI;6ET(#!X9F9F9F8L('1Y<&4@,'@Q8@H) M"0D]($103" P+"!P<F5S(#$L(&1E9C,R(#$L(&=R86X@,0IP<F]C97-S;W(@ M969L86=S"3T@:6YT97)R=7!T(&5N86)L960L(')E<W5M92P@24]03" ](# * M8W5R<F5N="!P<F]C97-S"0D](#$V-2 H;F9S9"D*:6YT97)R=7!T(&UA<VL) M"3T@;F5T( H*"D9A=&%L('1R87 @,3(Z('!A9V4@9F%U;'0@=VAI;&4@:6X@ M:V5R;F5L(&UO9&4*9F%U;'0@=FER='5A;"!A9&1R97-S"3T@,'@S.#,S,SDS M- IF875L="!C;V1E"0D]('-U<&5R=FES;W(@<F5A9"P@<&%G92!N;W0@<')E M<V5N= II;G-T<G5C=&EO;B!P;VEN=&5R"3T@,'@X.C!X8S Q9C8Q,V,*<W1A M8VL@<&]I;G1E<@D@(" @(" @(#T@,'@Q,#HP>&,T,3$W.#(P"F9R86UE('!O M:6YT97()(" @(" @(" ](#!X,3 Z,'AC-#$Q-S@R- IC;V1E('-E9VUE;G0) M"3T@8F%S92 P># L(&QI;6ET(#!X9F9F9F8L('1Y<&4@,'@Q8@H)"0D]($10 M3" P+"!P<F5S(#$L(&1E9C,R(#$L(&=R86X@,0IP<F]C97-S;W(@969L86=S M"3T@:6YT97)R=7!T(&5N86)L960L(')E<W5M92P@24]03" ](# *8W5R<F5N M="!P<F]C97-S"0D](#$V-2 H;F9S9"D*:6YT97)R=7!T(&UA<VL)"3T@;F5T M( IP86YI8SH@9G)O;2!D96)U9V=E<@H*"D9A=&%L('1R87 @,3(Z('!A9V4@ M9F%U;'0@=VAI;&4@:6X@:V5R;F5L(&UO9&4*9F%U;'0@=FER='5A;"!A9&1R M97-S"3T@,'@S.#,S,SDS- IF875L="!C;V1E"0D]('-U<&5R=FES;W(@<F5A M9"P@<&%G92!N;W0@<')E<V5N= II;G-T<G5C=&EO;B!P;VEN=&5R"3T@,'@X M.C!X8S Q9C8Q,V,*<W1A8VL@<&]I;G1E<@D@(" @(" @(#T@,'@Q,#HP>&,T M,3$W.&4T"F9R86UE('!O:6YT97()(" @(" @(" ](#!X,3 Z,'AC-#$Q-SAE M. IC;V1E('-E9VUE;G0)"3T@8F%S92 P># L(&QI;6ET(#!X9F9F9F8L('1Y M<&4@,'@Q8@H)"0D]($103" P+"!P<F5S(#$L(&1E9C,R(#$L(&=R86X@,0IP M<F]C97-S;W(@969L86=S"3T@:6YT97)R=7!T(&5N86)L960L(')E<W5M92P@ M24]03" ](# *8W5R<F5N="!P<F]C97-S"0D](#$V-2 H;F9S9"D*:6YT97)R M=7!T(&UA<VL)"3T@;F5T( IP86YI8SH@9G)O;2!D96)U9V=E<@H*9'5M<&EN M9R!T;R!D978@,C T,#$L(&]F9G-E=" Q.38W,S8*9'5M<" S,2 S," R.2 R M." R-R R-B R-2 R-" R,R R,B R,2 R," Q.2 Q." Q-R Q-B Q-2 Q-" Q M,R Q,B Q,2 Q," Y(#@@-R V(#4@-" S(#(@,2 P( HM+2T*(S @(&)O;W0@ M*&AO=W1O/3(V,"D@870@+BXO+BXO:V5R;B]K97)N7W-H=71D;W=N+F,Z,C@U M"C(X-0D)"61U;7!P8V(N<&-B7V-R,R ](')C<C,H*3L**&MG9&(I(&)T"B,P M("!B;V]T("AH;W=T;STR-C I(&%T("XN+RXN+VME<FXO:V5R;E]S:'5T9&]W M;BYC.C(X-0HC,2 @,'AC,#$T,F-C-2!I;B!P86YI8R H9FUT/3!X8S R,6$V M9#@@(F9R;VT@9&5B=6=G97(B*0H@(" @870@+BXO+BXO:V5R;B]K97)N7W-H M=71D;W=N+F,Z-#0V"B,R(" P>&,P,3(V8V(Q(&EN(&1B7W!A;FEC("AA9&1R M/3DT,C@X,3 W-BP@:&%V95]A9&1R/3 L(&-O=6YT/2TQ+" *(" @(&UO9&EF M/3!X8S0Q,3<X9C @(B(I(&%T("XN+RXN+V1D8B]D8E]C;VUM86YD+F,Z-#,R M"B,S(" P>&,P,3(V8S4Q(&EN(&1B7V-O;6UA;F0@*&QA<W1?8VUD<#TP>&,P M,C,V8CEC+"!C;61?=&%B;&4],'AC,#(S-CEF8RP@"B @("!A=7A?8VUD7W1A M8FQE<#TP>&,P,C1B8S<P*2!A=" N+B\N+B]D9&(O9&)?8V]M;6%N9"YC.C,S M,@HC-" @,'AC,#$R-F0Q-B!I;B!D8E]C;VUM86YD7VQO;W @*"D@870@+BXO M+BXO9&1B+V1B7V-O;6UA;F0N8SHT-30*(S4@(#!X8S Q,CDQ.&8@:6X@9&)? M=')A<" H='EP93TQ,BP@8V]D93TP*2!A=" N+B\N+B]D9&(O9&)?=')A<"YC M.C<Q"B,V(" P>&,P,68V,#8V(&EN(&MD8E]T<F%P("AT>7!E/3$R+"!C;V1E M/3 L(')E9W,],'AC-#$Q-V$S,"D*(" @(&%T("XN+RXN+VDS.#8O:3,X-B]D M8E]I;G1E<F9A8V4N8SHQ-3<*(S<@(#!X8S R,#$P.30@:6X@=')A<%]F871A M;" H9G)A;64],'AC-#$Q-V$S,"P@979A/3DT,C@X,3 W-BD*(" @(&%T("XN M+RXN+VDS.#8O:3,X-B]T<F%P+F,Z.3,W"B,X(" P>&,P,C P9#<S(&EN('1R M87!?<&9A=6QT("AF<F%M93TP>&,T,3$W83,P+"!U<V5R;6]D93TP+"!E=F$] M.30R.#@Q,#<V*0H@(" @870@+BXO+BXO:3,X-B]I,S@V+W1R87 N8SHX,S4* M(SD@(#!X8S R,# Y838@:6X@=')A<" H9G)A;64]>W1F7V5S(#T@,38L('1F M7V1S(#T@,38L('1F7V5D:2 ]("TQ,#<S,S0V-38P+" *(" @(" @=&9?97-I M(#T@+3$P-C@P.34T.#@L('1F7V5B<" ]("TQ,# U-#@W-#@T+"!T9E]I<W @ M/2 M,3 P-30X-S4R."P@"B @(" @('1F7V5B>" ]("TQ,#8X,#DU-#@X+"!T M9E]E9'@@/2 M,3 W,S,T-C4V,"P@=&9?96-X(#T@+3$P-C@Q,S@T.38L( H@ M(" @("!T9E]E87@@/2 Y-#(X.#$P-S8L('1F7W1R87!N;R ](#$R+"!T9E]E M<G(@/2 P+"!T9E]E:7 @/2 Y-#(X.#$P-S8L( H@(" @("!T9E]C<R ](#@L M('1F7V5F;&%G<R ](#8V,#4P+"!T9E]E<W @/2 M,3 W,C,R-S8P,BP@=&9? M<W,@/2 X-#(U-#(V-#!]*0H@(" @870@+BXO+BXO:3,X-B]I,S@V+W1R87 N M8SHT,S<*(S$P(#!X,S@S,S,Y,S0@:6X@/S\@*"D*(S$Q(#!X8S Q-S4S-C8@ M:6X@971H97)?:6YP=70@*&EF<#TP>&,P.65F.#$X+"!E:#TP>&,T,3$W864P M+"!M/3!X8S U-C Q,# I"B @("!A=" N+B\N+B]N970O:69?971H97)S=6)R M+F,Z-C0Q"B,Q,B P>&,P,6,P,CEB(&EN('1U;&EP7W)X7VEN='(@*'-C/3!X M8S Y968X,# I(&%T("XN+RXN+W!C:2]I9E]D92YC.C,V-S$*(S$S(#!X8S Q M8S X-&8@:6X@='5L:7!?:6YT<E]H86YD;&5R("AS8STP>&,P.65F.# P+"!P M<F]G<F5S<U]P/3!X8S0Q,3=B,3@I"B @("!A=" N+B\N+B]P8VDO:69?9&4N M8SHS.3DX"B,Q-" P>&,P,6,P.6%D(&EN('1U;&EP7VEN=')?;F]R;6%L("AA M<F<],'AC,#EE9C@P,"D@870@+BXO+BXO<&-I+VEF7V1E+F,Z-#$X-PHC,34@ M,'AC,#%F9F%E8R!I;B!S;6%L;%]I-3@V7V)C;W!Y("@I"B,Q-B P>&,P,60Q M,60W(&EN(&9F<U]W<FET92 H87 ],'AC-#$Q-V,W8RD*(" @(&%T("XN+RXN M+W5F<R]U9G,O=69S7W)E861W<FET92YC.C0W, HC,3<@,'AC,#$X9F5E.2!I M;B!N9G-R=E]W<FET92 H;F9S9#TP>&,P8C!D,C P+"!S;' ],'AC,#EE.# P M,"P@"B @("!P<F]C<#TP>&,T,&0T8C(P+"!M<G$],'AC-#$Q-V4S-"D@870@ M=FYO9&5?:68N:#HS,S$*(S$X(#!X8S Q838X8F4@:6X@;F9S<W9C7VYF<V0@ M*&YS9#TP>&,T,3$W93DT+"!A<F=P/3!X.# W,68P-" B(BP@<#TP>&,T,&0T M8C(P*0H@(" @870@+BXO+BXO;F9S+VYF<U]S>7-C86QL<RYC.C8U-@HC,3D@ M,'AC,#%A-C%D.2!I;B!N9G-S=F,@*' ],'AC-#!D-&(R,"P@=6%P/3!X8S0Q M,3=F.30I"B @("!A=" N+B\N+B]N9G,O;F9S7W-Y<V-A;&QS+F,Z,S0R"B,R M," P>&,P,C Q,S S(&EN('-Y<V-A;&P@*&9R86UE/7MT9E]E<R ](#,Y+"!T M9E]D<R ](#,Y+"!T9E]E9&D@/2 X+" *(" @(" @=&9?97-I(#T@,"P@=&9? M96)P(#T@+3$P-S<Y-#0X.38L('1F7VES<" ]("TQ,# U-#@V,3 X+"!T9E]E M8G@@/2 P+" *(" @(" @=&9?961X(#T@+3$P-S<Y-#4R.3(L('1F7V5C>" ] M(# L('1F7V5A>" ](#$U-2P@=&9?=')A<&YO(#T@,3(L( H@(" @("!T9E]E M<G(@/2 R+"!T9E]E:7 @/2 Q,S0U,3@Y-S(L('1F7V-S(#T@,S$L('1F7V5F M;&%G<R ](#8T-BP@"B @(" @('1F7V5S<" ]("TQ,#<W.30U,C@T+"!T9E]S M<R ](#,Y?2D@870@+BXO+BXO:3,X-B]I,S@V+W1R87 N8SHQ,3 P"B,R,2 P M>&,P,68V.6)C(&EN(%AI;G0P>#@P7W-Y<V-A;&P@*"D*(S(R(#!X.# T.#!E M.2!I;B _/R H*0HH:V=D8BD@"BAK9V1B*2!Q=6ET"@I38W)I<'0@9&]N92!O ;;B!&<FD@4V5P(#(T(#$X.C,R.C V(#$Y.3D* end >How-To-Repeat: I don't know at all. >Fix: I don't know a fix. >Release-Note: >Audit-Trail: >Unformatted: To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-bugs" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?199909241725.TAA96154>