Date: Tue, 26 Apr 2011 16:02:42 +0200 From: Mikael Bak <mbak@inbox.lv> To: freebsd-questions@freebsd.org Subject: Suddenly lots processes exits signal 11 (core dumped) Message-ID: <4DB6D082.4020907@inbox.lv>
next in thread | raw e-mail | index | archive | help
Hi list, I have a system running FreeBSD 7.3. Its main function is running Postfix SMTP server and a few perl based content filters. Nothing exotic really. It has been nicely up and running approx 150 days when it suddenly starts behaving very strange. First I noticed a converter script failing. It is basically a small shell script that converts a quite big file replacing a few words using sed. The output is mostly damaged. Another problem is that lots of processes exits signal 11 (core dumped). And I need to restart them by hand. See dmesg output below. I know I don't give you guys much to go on. I just want to know it it's possible to find out somehow if some hardware is failing and must be changed. My first thought was overheating. But my collegue went to the site and he said the hardware is not hot at all. TIA, Mikael # dmesg Copyright (c) 1992-2010 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 7.3-RELEASE-p2 #0: Mon Jul 12 19:23:19 UTC 2010 root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64 Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Atom(TM) CPU 330 @ 1.60GHz (1600.01-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x106c2 Stepping = 2 Features=0xbfe9fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> Features2=0x40e31d<SSE3,DTES64,MON,DS_CPL,TM2,SSSE3,CX16,xTPR,PDCM,MOVBE> AMD Features=0x20100800<SYSCALL,NX,LM> AMD Features2=0x1<LAHF> TSC: P-state invariant Cores per package: 2 Logical CPUs per core: 2 usable memory = 3475918848 (3314 MB) avail memory = 3353677824 (3198 MB) ACPI APIC Table: <081309 APIC0925> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 2 ioapic0: Changing APIC ID to 3 ioapic0 <Version 1.1> irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: <081309 RSDT0925> on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: reservation of fefe1000, 1000 (3) failed acpi0: reservation of fee01000, ff000 (3) failed acpi0: reservation of fec00000, 1000 (3) failed acpi0: reservation of fee00000, 1000 (3) failed acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, dff00000 (3) failed Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x4008-0x400b on acpi0 acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 25000000 Hz quality 900 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: <memory, RAM> at device 0.1 (no driver attached) isab0: <PCI-ISA bridge> port 0x4f00-0x4fff at device 3.0 on pci0 isa0: <ISA bus> on isab0 pci0: <memory, RAM> at device 3.1 (no driver attached) pci0: <serial bus, SMBus> at device 3.2 (no driver attached) pci0: <memory, RAM> at device 3.3 (no driver attached) pci0: <processor> at device 3.5 (no driver attached) ohci0: <OHCI (generic) USB controller> mem 0xfae7f000-0xfae7ffff irq 22 at device 4.0 on pci0 ohci0: [GIANT-LOCKED] ohci0: [ITHREAD] usb0: OHCI version 1.0, legacy support usb0: SMM does not respond, resetting usb0: <OHCI (generic) USB controller> on ohci0 usb0: USB revision 1.0 uhub0: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb0 uhub0: 6 ports with 6 removable, self powered ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfae7ec00-0xfae7ecff irq 23 at device 4.1 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb1: EHCI version 1.0 usb1: companion controller, 12 ports each: usb0 usb1: <EHCI (generic) USB 2.0 controller> on ehci0 usb1: USB revision 2.0 uhub1: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb1 uhub1: 6 ports with 6 removable, self powered ohci1: <OHCI (generic) USB controller> mem 0xfae7d000-0xfae7dfff irq 20 at device 6.0 on pci0 ohci1: [GIANT-LOCKED] ohci1: [ITHREAD] usb2: OHCI version 1.0, legacy support usb2: SMM does not respond, resetting usb2: <OHCI (generic) USB controller> on ohci1 usb2: USB revision 1.0 uhub2: <nVidia OHCI root hub, class 9/0, rev 1.00/1.00, addr 1> on usb2 uhub2: 6 ports with 6 removable, self powered ehci1: <EHCI (generic) USB 2.0 controller> mem 0xfae7e800-0xfae7e8ff irq 21 at device 6.1 on pci0 ehci1: [GIANT-LOCKED] ehci1: [ITHREAD] usb3: EHCI version 1.0 usb3: companion controller, 12 ports each: usb2 usb3: <EHCI (generic) USB 2.0 controller> on ehci1 usb3: USB revision 2.0 uhub3: <nVidia EHCI root hub, class 9/0, rev 2.00/1.00, addr 1> on usb3 uhub3: 6 ports with 6 removable, self powered pci0: <multimedia, HDA> at device 8.0 (no driver attached) pcib1: <ACPI PCI-PCI bridge> at device 9.0 on pci0 pci1: <ACPI PCI bus> on pcib1 nfe0: <NVIDIA nForce MCP79 Networking Adapter> port 0xd080-0xd087 mem 0xfae7c000-0xfae7cfff,0xfae7e400-0xfae7e4ff,0xfae7e000-0xfae7e00f irq 23 at device 10.0 on pci0 miibus0: <MII bus> on nfe0 rgephy0: <RTL8169S/8110S/8211B media interface> PHY 3 on miibus0 rgephy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto nfe0: Ethernet address: 00:01:2e:2c:b0:56 nfe0: [FILTER] atapci0: <nVidia ATA controller> port 0xd000-0xd007,0xcc00-0xcc03,0xc880-0xc887,0xc800-0xc803,0xc480-0xc48f mem 0xfae76000-0xfae77fff irq 20 at device 11.0 on pci0 atapci0: [ITHREAD] ata2: <ATA channel 0> on atapci0 ata2: [ITHREAD] ata3: <ATA channel 1> on atapci0 ata3: [ITHREAD] pcib2: <ACPI PCI-PCI bridge> irq 21 at device 12.0 on pci0 pci2: <ACPI PCI bus> on pcib2 pcib3: <ACPI PCI-PCI bridge> at device 16.0 on pci0 pci3: <ACPI PCI bus> on pcib3 vgapci0: <VGA-compatible display> port 0xec00-0xec7f mem 0xfb000000-0xfbffffff,0xe0000000-0xefffffff,0xf8000000-0xf9ffffff irq 22 at device 0.0 on pci3 pcib4: <ACPI PCI-PCI bridge> irq 22 at device 21.0 on pci0 pci4: <ACPI PCI bus> on pcib4 pci4: <network> at device 0.0 (no driver attached) pcib5: <ACPI PCI-PCI bridge> irq 23 at device 22.0 on pci0 pci5: <ACPI PCI bus> on pcib5 pcib6: <ACPI PCI-PCI bridge> irq 20 at device 23.0 on pci0 pci6: <ACPI PCI bus> on pcib6 pcib7: <ACPI PCI-PCI bridge> irq 21 at device 24.0 on pci0 pci7: <ACPI PCI bus> on pcib7 acpi_button0: <Power Button> on acpi0 sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: configured irq 4 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio0: [FILTER] cpu0: <ACPI CPU> on acpi0 p4tcc0: <CPU Frequency Thermal Control> on cpu0 cpu1: <ACPI CPU> on acpi0 p4tcc1: <CPU Frequency Thermal Control> on cpu1 orm0: <ISA Option ROM> at iomem 0xc0000-0xce7ff on isa0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] ppc0: cannot reserve I/O port range sc0: <System console> at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> sio1: configured irq 3 not in bitmap of probed irqs 0 sio1: port may not be enabled vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 Timecounters tick every 1.000 msec ad4: 476940MB <Seagate ST3500418AS CC38> at ata2-master UDMA33 ad6: 476940MB <Seagate ST3500418AS CC38> at ata3-master UDMA33 SMP: AP CPU #1 Launched! GEOM_MIRROR: Device mirror/gm0 launched (2/2). Trying to mount root from ufs:/dev/mirror/gm0s1a nfe0: link state changed to UP pid 767 (clamd), uid 110: exited on signal 11 pid 1046 (clamscan), uid 110: exited on signal 11 (core dumped) pid 1337 (perl), uid 110: exited on signal 11 pid 8777 (smtpd), uid 125: exited on signal 10 pid 8876 (smtpd), uid 125: exited on signal 10 pid 548 (named), uid 53: exited on signal 6 pid 10246 (smtpd), uid 125: exited on signal 10 pid 12223 (smtpd), uid 125: exited on signal 10 pid 13347 (perl), uid 110: exited on signal 10 pid 14959 (clamscan), uid 0: exited on signal 10 (core dumped) pid 19583 (clamscan), uid 0: exited on signal 11 (core dumped) pid 20467 (gpg2), uid 0: exited on signal 11 (core dumped) pid 20471 (cp), uid 0: exited on signal 11 (core dumped) pid 20478 (bash), uid 0: exited on signal 11 (core dumped) pid 20263 (bash), uid 0: exited on signal 11 (core dumped) sigreturn: rflags = 0x1020a a pid 16204 (master), uid 0: exited on signal 10 pid 21243 (clamscan), uid 0: exited on signal 11 (core dumped) pid 22102 (clamscan), uid 0: exited on signal 11 (core dumped) pid 22125 (clamscan), uid 0: exited on signal 11 (core dumped) pid 22200 (clamscan), uid 0: exited on signal 11 (core dumped) pid 23161 (clamscan), uid 0: exited on signal 10 (core dumped) pid 26288 (clamscan), uid 0: exited on signal 11 (core dumped) pid 26542 (smtpd), uid 125: exited on signal 10 pid 26821 (smtpd), uid 125: exited on signal 10 pid 27204 (clamscan), uid 0: exited on signal 11 (core dumped) pid 27236 (clamscan), uid 0: exited on signal 11 (core dumped) pid 27245 (clamscan), uid 0: exited on signal 11 (core dumped) pid 28583 (clamscan), uid 0: exited on signal 10 (core dumped) pid 28696 (perl), uid 110: exited on signal 10 pid 27729 (clamd), uid 110: exited on signal 11 pid 29680 (clamscan), uid 110: exited on signal 11 (core dumped) pid 29690 (clamscan), uid 110: exited on signal 11 (core dumped) pid 29719 (clamscan), uid 110: exited on signal 11 (core dumped) pid 29781 (clamscan), uid 110: exited on signal 10 (core dumped) pid 29808 (clamscan), uid 110: exited on signal 11 (core dumped) pid 29884 (clamscan), uid 110: exited on signal 11 (core dumped) pid 30531 (clamscan), uid 0: exited on signal 10 (core dumped) pid 30686 (clamd), uid 110: exited on signal 11 pid 30935 (smtpd), uid 125: exited on signal 10 pid 31024 (clamscan), uid 110: exited on signal 11 (core dumped) pid 31061 (clamscan), uid 110: exited on signal 11 (core dumped) pid 31083 (smtpd), uid 125: exited on signal 10 pid 31147 (smtpd), uid 125: exited on signal 10 pid 31630 (sendmail), uid 0: exited on signal 11 (core dumped) pid 31738 (clamscan), uid 0: exited on signal 11 (core dumped) pid 31759 (clamscan), uid 0: exited on signal 11 (core dumped) pid 32455 (smtpd), uid 125: exited on signal 10 pid 38591 (clamscan), uid 110: exited on signal 6 (core dumped) pid 38954 (clamscan), uid 110: exited on signal 11 (core dumped) pid 39045 (clamscan), uid 110: exited on signal 10 (core dumped) pid 39087 (clamscan), uid 110: exited on signal 10 (core dumped) pid 39098 (clamscan), uid 110: exited on signal 10 (core dumped) pid 39148 (clamscan), uid 110: exited on signal 10 (core dumped) pid 39184 (clamscan), uid 110: exited on signal 11 (core dumped) pid 39225 (clamscan), uid 110: exited on signal 11 (core dumped) pid 39247 (clamscan), uid 110: exited on signal 11 (core dumped) pid 39279 (clamscan), uid 110: exited on signal 11 (core dumped) pid 40210 (clamscan), uid 110: exited on signal 10 (core dumped) pid 40352 (clamscan), uid 110: exited on signal 11 (core dumped) pid 40642 (clamscan), uid 0: exited on signal 11 (core dumped) pid 40667 (clamscan), uid 0: exited on signal 11 (core dumped) pid 43747 (clamscan), uid 110: exited on signal 11 (core dumped) pid 45077 (clamscan), uid 110: exited on signal 10 (core dumped) pid 45987 (clamscan), uid 110: exited on signal 11 (core dumped) pid 46699 (gpg2), uid 0: exited on signal 11 pid 46795 (clamscan), uid 0: exited on signal 11 (core dumped) pid 46807 (clamscan), uid 0: exited on signal 11 (core dumped) pid 46857 (rm), uid 0: exited on signal 11 (core dumped) pid 46867 (rm), uid 0: exited on signal 11 (core dumped) pid 46873 (clamscan), uid 110: exited on signal 10 (core dumped)
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4DB6D082.4020907>