Date: Sat, 23 Jun 2007 11:01:49 +0300 From: =?ISO-8859-9?Q?=D6zkan_KIRIK?= <ozkan@mersin.edu.tr> To: freebsd-hackers@freebsd.org Subject: 6.1 - amd64 arch. Hangs twice a day, how can i debug problem Message-ID: <467CD36D.4020709@mersin.edu.tr>
next in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format.
--------------050607020800020905070703
Content-Type: text/plain; charset=ISO-8859-9; format=flowed
Content-Transfer-Encoding: 7bit
I have a FreeBSD 6.1 - STABLE 200609 gateway have 3 up interfaces.
First one connected to 16Mbps Internet Connection,
Next onet connected to DMZ Zone (192.168.0.0/24 network)
The Last interface connected to Local network.
this system hangs twice a day. Keyboard doesnt work, everything locks,
no network reponse!
For a quick solution i wrote a crontab that reboots system at 20.00 PM &
06.00 AM.
How can I find the problem which hangs system? Is there any method for
this.
Or any known bug reports at this release ?
a note: "if i enable hyper threading & SMP, system hangs 6 times a day"
Waiting for your suggestions,
With Best Regards,
Ozkan KIRIK
System runs squid2.6, isc-dhcp3-server, ipfw, netgraph, ng_nat, ng_ipfw,
poptop, mrtg, bsnmp and etc.
some outputs are below:
# ipfw show | wc -l
271
dmesg, kernel config (SMP Disabled), sysctl, ngctl filed are attached.
# ps ax | grep natd
1099 ?? Ss 0:27.58 /sbin/natd -f /etc/natd.conf
1101 ?? Ss 1:00.36 /sbin/natd -f /etc/portfwd.conf
# ifconfig em1 | grep inet\ | wc -l
29
28 aliases above belongs to WAN Interface for DMZ servers.
--------------050607020800020905070703
Content-Type: text/plain;
name="dmesg.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="dmesg.txt"
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 6.1-STABLE-200609 #2: Thu Mar 15 07:32:11 EET 2007
root@firewall.antikor:/usr/obj/usr/src/sys/antikor-fw
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.00GHz (3000.12-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0xf4a Stepping = 10
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,<b14>>
AMD Features=0x20000800<SYSCALL,LM>
AMD Features2=0x1<LAHF>
Logical CPUs per core: 2
real memory = 4764725248 (4543 MB)
avail memory = 4065804288 (3877 MB)
ACPI APIC Table: <HP 00000083>
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
ioapic3 <Version 2.0> irqs 72-95 on motherboard
ioapic4 <Version 2.0> irqs 96-119 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <HP P51> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
cpu0: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib2
bge0: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem 0xfddf0000-0xfddfffff irq 25 at device 1.0 on pci3
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge0: Ethernet address: 00:17:08:59:82:97
bge1: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem 0xfdde0000-0xfddeffff irq 26 at device 1.1 on pci3
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge1: Ethernet address: 00:17:08:59:82:96
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci2
pci4: <ACPI PCI bus> on pcib3
ciss0: <HP Smart Array 6i> port 0x4000-0x40ff mem 0xfdef0000-0xfdef1fff,0xfde80000-0xfdebffff irq 51 at device 3.0 on pci4
ciss0: [GIANT-LOCKED]
pcib4: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci5: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 0.0 on pci5
pci6: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 0.2 on pci5
pci10: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection Version - 6.1.4> port 0x5000-0x503f mem 0xfdfe0000-0xfdffffff,0xfdf80000-0xfdfbffff irq 97 at device 1.0 on pci10
em0: Ethernet address: 00:11:0a:5f:6f:0e
em0: [FAST]
em1: <Intel(R) PRO/1000 Network Connection Version - 6.1.4> port 0x5040-0x507f mem 0xfdf60000-0xfdf7ffff irq 98 at device 1.1 on pci10
em1: Ethernet address: 00:11:0a:5f:6f:0f
em1: [FAST]
uhci0: <Intel 82801EB (ICH5) USB controller USB-A> port 0x2000-0x201f irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82801EB (ICH5) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801EB (ICH5) USB controller USB-B> port 0x2020-0x203f irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <Intel 82801EB (ICH5) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801EB (ICH5) USB controller USB-C> port 0x2040-0x205f irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <Intel 82801EB (ICH5) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3: <Intel 82801EB (ICH5) USB controller USB-D> port 0x2060-0x207f irq 16 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
usb3: <Intel 82801EB (ICH5) USB controller USB-D> on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0: <Intel 82801EB/R (ICH5) USB 2.0 controller> mem 0xfbef0000-0xfbef03ff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <Intel 82801EB/R (ICH5) USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib7
pci1: <display, VGA> at device 3.0 (no driver attached)
pci1: <base peripheral> at device 4.0 (no driver attached)
pci1: <base peripheral> at device 4.2 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f at device 31.1 on pci0
firewall# dmesg | head -150
Copyright (c) 1992-2006 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD 6.1-STABLE-200609 #2: Thu Mar 15 07:32:11 EET 2007
root@firewall.antikor:/usr/obj/usr/src/sys/antikor-fw
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Xeon(TM) CPU 3.00GHz (3000.12-MHz K8-class CPU)
Origin = "GenuineIntel" Id = 0xf4a Stepping = 10
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x641d<SSE3,RSVD2,MON,DS_CPL,CNTX-ID,CX16,<b14>>
AMD Features=0x20000800<SYSCALL,LM>
AMD Features2=0x1<LAHF>
Logical CPUs per core: 2
real memory = 4764725248 (4543 MB)
avail memory = 4065804288 (3877 MB)
ACPI APIC Table: <HP 00000083>
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
ioapic2 <Version 2.0> irqs 48-71 on motherboard
ioapic3 <Version 2.0> irqs 72-95 on motherboard
ioapic4 <Version 2.0> irqs 96-119 on motherboard
kbd1 at kbdmux0
ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413)
acpi0: <HP P51> on motherboard
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
cpu0: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci2: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib2
bge0: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem 0xfddf0000-0xfddfffff irq 25 at device 1.0 on pci3
miibus0: <MII bus> on bge0
brgphy0: <BCM5704 10/100/1000baseTX PHY> on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge0: Ethernet address: 00:17:08:59:82:97
bge1: <Broadcom BCM5704 B0, ASIC rev. 0x2100> mem 0xfdde0000-0xfddeffff irq 26 at device 1.1 on pci3
miibus1: <MII bus> on bge1
brgphy1: <BCM5704 10/100/1000baseTX PHY> on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto
bge1: Ethernet address: 00:17:08:59:82:96
pcib3: <ACPI PCI-PCI bridge> at device 0.2 on pci2
pci4: <ACPI PCI bus> on pcib3
ciss0: <HP Smart Array 6i> port 0x4000-0x40ff mem 0xfdef0000-0xfdef1fff,0xfde80000-0xfdebffff irq 51 at device 3.0 on pci4
ciss0: [GIANT-LOCKED]
pcib4: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci5: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 0.0 on pci5
pci6: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> at device 0.2 on pci5
pci10: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection Version - 6.1.4> port 0x5000-0x503f mem 0xfdfe0000-0xfdffffff,0xfdf80000-0xfdfbffff irq 97 at device 1.0 on pci10
em0: Ethernet address: 00:11:0a:5f:6f:0e
em0: [FAST]
em1: <Intel(R) PRO/1000 Network Connection Version - 6.1.4> port 0x5040-0x507f mem 0xfdf60000-0xfdf7ffff irq 98 at device 1.1 on pci10
em1: Ethernet address: 00:11:0a:5f:6f:0f
em1: [FAST]
uhci0: <Intel 82801EB (ICH5) USB controller USB-A> port 0x2000-0x201f irq 16 at device 29.0 on pci0
uhci0: [GIANT-LOCKED]
usb0: <Intel 82801EB (ICH5) USB controller USB-A> on uhci0
usb0: USB revision 1.0
uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub0: 2 ports with 2 removable, self powered
uhci1: <Intel 82801EB (ICH5) USB controller USB-B> port 0x2020-0x203f irq 19 at device 29.1 on pci0
uhci1: [GIANT-LOCKED]
usb1: <Intel 82801EB (ICH5) USB controller USB-B> on uhci1
usb1: USB revision 1.0
uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub1: 2 ports with 2 removable, self powered
uhci2: <Intel 82801EB (ICH5) USB controller USB-C> port 0x2040-0x205f irq 18 at device 29.2 on pci0
uhci2: [GIANT-LOCKED]
usb2: <Intel 82801EB (ICH5) USB controller USB-C> on uhci2
usb2: USB revision 1.0
uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub2: 2 ports with 2 removable, self powered
uhci3: <Intel 82801EB (ICH5) USB controller USB-D> port 0x2060-0x207f irq 16 at device 29.3 on pci0
uhci3: [GIANT-LOCKED]
usb3: <Intel 82801EB (ICH5) USB controller USB-D> on uhci3
usb3: USB revision 1.0
uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1
uhub3: 2 ports with 2 removable, self powered
ehci0: <Intel 82801EB/R (ICH5) USB 2.0 controller> mem 0xfbef0000-0xfbef03ff irq 23 at device 29.7 on pci0
ehci0: [GIANT-LOCKED]
usb4: EHCI version 1.0
usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3
usb4: <Intel 82801EB/R (ICH5) USB 2.0 controller> on ehci0
usb4: USB revision 2.0
uhub4: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1
uhub4: 8 ports with 8 removable, self powered
pcib7: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib7
pci1: <display, VGA> at device 3.0 (no driver attached)
pci1: <base peripheral> at device 4.0 (no driver attached)
pci1: <base peripheral> at device 4.2 (no driver attached)
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel ICH5 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x500-0x50f at device 31.1 on pci0
ata0: <ATA channel 0> on atapci0
ata1: <ATA channel 1> on atapci0
acpi_tz0: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> flags 0x1 irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model Generic PS/2 mouse, device ID 0
sio0: <Standard PC COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
sio0: type 16550A, console
fdc0: <floppy drive controller (FDE)> port 0x3f2-0x3f5 irq 6 drq 2 on acpi0
fdc0: [FAST]
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff,0xcc000-0xcd7ff,0xee000-0xeffff on isa0
ppc0: cannot reserve I/O port range
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
sio1 at port 0x2f8-0x2ff irq 3 on isa0
sio1: type 16550A
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
Timecounter "TSC" frequency 3000121852 Hz quality 800
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert loadable, rule-based forwarding enabled, default to accept, logging limited to 100000 packets/entry by default
acd0: CDROM <CD-224E-N/C.AA> at ata0-master UDMA33
da0 at ciss0 bus 0 target 0 lun 0
da0: <COMPAQ RAID 1 VOLUME OK> Fixed Direct Access SCSI-0 device
da0: 135.168MB/s transfers
da0: 140006MB (286734240 512 byte sectors: 255H 32S/T 35139C)
--------------050607020800020905070703
Content-Type: text/plain;
name="kernel config.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="kernel config.txt"
options IPFIREWALL
options IPFIREWALL_FORWARD
options IPFIREWALL_VERBOSE
options IPFIREWALL_VERBOSE_LIMIT=100000
options IPFIREWALL_DEFAULT_TO_ACCEPT
options IPDIVERT
options DUMMYNET
options IPSTEALTH
options TCP_DROP_SYNFIN
options HZ=4000
options NETGRAPH
options LIBALIAS
options NETGRAPH_NAT
options NETGRAPH_IPFW
options GEOM_BDE
device vlan
--------------050607020800020905070703
Content-Type: text/plain;
name="sysctl.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="sysctl.txt"
net.inet.ip.fw.dyn_max=32768
net.inet.tcp.msl=7500
kern.maxfiles=65536
kern.maxfilesperproc=32768
net.inet.tcp.sendspace=65536
net.inet.tcp.recvspace=65536
net.inet.udp.recvspace=65535
net.inet.udp.maxdgram=65535
kern.ipc.maxsockbuf=2097152
kern.ipc.somaxconn=4096
vfs.vmiodirenable=1
net.inet.tcp.blackhole=2
net.inet.udp.blackhole=1
--------------050607020800020905070703
Content-Type: text/plain;
name="ngctl.txt"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
filename="ngctl.txt"
# ngctl list
There are 11 total nodes:
Name: ngctl9313 Type: socket ID: 00000030 Num hooks: 0
Name: Network1 Type: nat ID: 0000002c Num hooks: 2
Name: Network2 Type: nat ID: 00000027 Num hooks: 2
Name: Network3 Type: nat ID: 00000022 Num hooks: 2
Name: Network4 Type: nat ID: 0000001d Num hooks: 2
Name: Network5 Type: nat ID: 00000018 Num hooks: 2
Name: Network6 Type: nat ID: 00000013 Num hooks: 2
Name: Network7 Type: nat ID: 0000000e Num hooks: 2
Name: Network8 Type: nat ID: 00000009 Num hooks: 2
Name: Network9 Type: nat ID: 00000004 Num hooks: 2
Name: ipfw Type: ipfw ID: 00000001 Num hooks: 18
--------------050607020800020905070703--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?467CD36D.4020709>