From owner-freebsd-questions@FreeBSD.ORG Wed Oct 6 08:10:08 2010 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 15B6410656BB for ; Wed, 6 Oct 2010 08:10:08 +0000 (UTC) (envelope-from perikillo@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id D63558FC1C for ; Wed, 6 Oct 2010 08:10:07 +0000 (UTC) Received: by iwn8 with SMTP id 8so795180iwn.13 for ; Wed, 06 Oct 2010 01:10:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:received:date:message-id :subject:from:to:content-type; bh=+Z129SqcjQgLzI8/f/QeECLsQZZYwVwXHIewEDgPVc4=; b=xDt2ANrfrzmYVMDnErQ4lX6z3EB7n02W1rcaR6JM0bONnxlbbx08REtJinXEo8PaJ0 iMOb95C0P9b7xOb6VQlV1MuQQwd/l64Wv3u3O21kmTuI02ERg3FpAuv1A/JxWIgz8swd rLRhL2jxtV37SpIz7rAbtQHsMkxaBQaqIodaY= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; b=KGwlqzra5bQ7FuRQc9oDQfqM4TYeRsodqrbAMZJTJ+VJxFj0i/AomLIvSuDIWaueu8 vuaMgQsHVrB1oxAVBKFqv2cWESbpjQ4sWoY8qlWnNvXKHejR6fqjXPwxUH0/7TpSruH3 ceFbxuHSpg48ITfEc86CVM0QUd9u9iXSRiHD8= MIME-Version: 1.0 Received: by 10.42.2.81 with SMTP id 17mr13914789icj.40.1286350809905; Wed, 06 Oct 2010 00:40:09 -0700 (PDT) Received: by 10.42.2.198 with HTTP; Wed, 6 Oct 2010 00:40:09 -0700 (PDT) Date: Wed, 6 Oct 2010 00:40:09 -0700 Message-ID: From: perikillo To: FreeBSD Mailing List Content-Type: text/plain; charset=ISO-8859-1 Subject: Issues with FlowCleaner on a spam server. X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Oct 2010 08:10:08 -0000 Hi my friends I have a big issue that I still cannot track what is causing that my server stop working. I have a spam gateway running: spamassassin clamavis amavis apache+mailgraph postfix bacula client apcupsd client My server is running freebsd 8.0-p2 AMD64. Raid-1. Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-RELEASE-p2 #5: Mon May 10 23:23:20 PDT 2010 root@filter.oakwest.com:/usr/obj/usr/src/sys/SPAMKER Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Xeon(R) CPU E3110 @ 3.00GHz (2999.68-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x1067a Stepping = 10 Features=0xbfebfbff Features2=0x408e3fd AMD Features=0x20100800 AMD Features2=0x1 TSC: P-state invariant real memory = 4294967296 (4096 MB) avail memory = 4119261184 (3928 MB) ACPI APIC Table: <090208 APIC1432> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 For some reason that I still don't know, amavisd stop working, the port no longer answer any inbound, postfix, spamd, clamd works, amavisd is the issue normally. My server can work for a month, each weekend I update the ports and upgrade my packages, spamd rules every month are updated. No issue here, suddenly after a month or 4-5 weeks the server stop working, amavisd stop doing the job, I can access the server via ssh and see the issue. This is the 4th time that happens. My IDLE goes to 50%, when I start debugging I see a process called "FlowCleaner" eating 1 CPU. Always got the PID 20, looks like a internal process, I have been searching info about this process but not to much info. I cannot kill this process, I can restart clamd, spamd, apache, bacula, but amavisd is stuck. If I send a shutdown -r now won't work, my server just hang-up, if I press the power button won't work to. I have to do a cold reboot, I don't have other choice. I have read logs but don't see any issue (maillog, console, all, message). One thing to mention, is that every time this happen, my server fan's are working more faster that usual, the first day I detect this I create a batch that send every 5 minutes the core temperature using freebsd coretemp.ko module. Avg. I got 40'c for each core: dev.cpu.0.temperature: 42.0C dev.cpu.1.temperature: 41.0C I search around on Intel site and this chip max temp. is 70'c, I had never seen this number on my emails, the biggest number had been 54'c and this appear before my server got crazy yesterday: dev.cpu.0.temperature: 53.0C dev.cpu.1.temperature: 49.0C Something is causing this, a spam attack, memory leak mmm I had not seen my server use the whole 4GB ever. My friends, what do u you recommend to me to track this? Any input will be very appreciated, I got 1 month to track this before this happen again, thanks!