From owner-freebsd-stable@freebsd.org Tue Jan 9 07:36:36 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5CB8DE69FA3 for ; Tue, 9 Jan 2018 07:36:36 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv190.fwdcdn.com (frv190.fwdcdn.com [212.42.77.190]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 203DD6E6E8 for ; Tue, 9 Jan 2018 07:36:35 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv198.fwdcdn.com ([212.42.77.198]) by frv190.fwdcdn.com with esmtp ID 1eYo4R-000CMu-JL for freebsd-stable@freebsd.org; Tue, 09 Jan 2018 09:11:39 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:Message-Id:To: Subject:From:Date:Sender:Reply-To:Cc:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: In-Reply-To:References:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=M6r9ZRE1fikr2ymh4Q/dBpQrwyGmHIteLDuvC13j+vQ=; b=q6bLMnjGMO47i8c6r/gsBTB6Oc UqffJB2TfoJy+5UbKofzZl12nOXGcf0OM+DtpgxNCtktKgF/f1IvM0Q77sKOLlebWfjREJH1NzOL3 yaJaZAi/UN5/vE0QTyYHt8AxIC70ShXR295oVStT7LrTnHonTf7vHur6Z8sIjnyHPH00=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv198.fwdcdn.com with smtp ID 1eYo4I-000CAB-Rn for freebsd-stable@freebsd.org; Tue, 09 Jan 2018 09:11:30 +0200 Date: Tue, 09 Jan 2018 09:11:30 +0200 From: wishmaster Subject: swap_pager_getswapspace(32) Error To: freebsd-net@freebsd.org, freebsd-stable X-Mailer: mail.ukr.net 5.0 Message-Id: <1515479672.203020608.2hyrh1bv@frv52.fwdcdn.com> Received: from artemrts@ukr.net by frv52.fwdcdn.com; Tue, 09 Jan 2018 09:11:30 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 07:36:36 -0000 Hi, colleagues. In December 2017 I wrote to freebsd-net@ about tons of errors in log-file Jan 5 09:49:40 server kernel: swap_pager_getswapspace(32): failed Jan 5 09:49:40 server kernel: swap_pager_getswapspace(24): failed Jan 5 09:49:40 server kernel: swap_pager_getswapspace(18): failed This errors had happened after I add netgraph rule for my IPFW ruleset. This was just ng_patch for setting TTL on OUTGOING interface. /usr/sbin/ngctl -f- <<-SEQ mkpeer ipfw: patch 100 in name ipfw:100 ttl_set msg ttl_set: setconfig { count=1 csum_flags=1 ops=[ \ { mode=1 value=128 length=1 offset=8 } ] } SEQ /sbin/ipfw add 15002 netgraph 100 ip from me to any { recv re2 or recv epair* } And I did not established the reason for this error, just netgraph rule was removed. After that, after playing with ipfw/fq_codel in VirtualBox I wanted setup it in the production. But after some hours of the work, the old error was occurred. I have 2 identical servers (ZFS mirror, VNET'ed Jails, IPFW ruleset and so on). The difference is only in CPU, amount of RAM and connection to Internet. This server uses pppoe via built-in ppp client. The second server works fine without any errors. I do not understand, is this problem is due to incorrect IPFW ruleset or something else? Without netgraph/dummynet rules I see in top -HSP a lot of processes of MySQL. But innodb_buffer_pool_size is just 2GB. Server has 16GB RAM. PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11570 106 20 0 570M 516M select 3 0:38 0.00% clamd{clamd} 11570 106 20 0 570M 516M select 1 0:00 0.00% clamd{clamd} 10612 88 20 0 2909M 451M uwait 3 0:07 0.01% mysqld{mysqld} 10612 88 20 0 2909M 451M uwait 3 0:04 0.01% mysqld{mysqld} ..... uname -a FreeBSD server 11.1-STABLE FreeBSD 11.1-STABLE #0 r325503: Tue Nov 7 13:38:44 EET 2017 wishmaster@servers:/usr/obj/usr/src/sys/MY amd64 Please help. -- Vitaly From owner-freebsd-stable@freebsd.org Tue Jan 9 08:45:03 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4411DE6E696; Tue, 9 Jan 2018 08:45:03 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id CCD4E71446; Tue, 9 Jan 2018 08:45:02 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w098iltu079188 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 9 Jan 2018 09:44:48 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: artemrts@ukr.net Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id w098ietK023611 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Tue, 9 Jan 2018 15:44:40 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: swap_pager_getswapspace(32) Error To: wishmaster , freebsd-net@freebsd.org, freebsd-stable References: <1515479672.203020608.2hyrh1bv@frv52.fwdcdn.com> From: Eugene Grosbein Message-ID: <5A5480F4.3080404@grosbein.net> Date: Tue, 9 Jan 2018 15:44:36 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 In-Reply-To: <1515479672.203020608.2hyrh1bv@frv52.fwdcdn.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=2.2 required=5.0 tests=BAYES_00, LOCAL_FROM, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS * 2.6 LOCAL_FROM From my domains X-Spam-Level: ** X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 08:45:03 -0000 09.01.2018 14:11, wishmaster wrote: > Jan 5 09:49:40 server kernel: swap_pager_getswapspace(32): failed > Jan 5 09:49:40 server kernel: swap_pager_getswapspace(24): failed > Jan 5 09:49:40 server kernel: swap_pager_getswapspace(18): failed [skip] This has nothing to do with netgraph, dummynet or ipfw. > Without netgraph/dummynet rules I see in top -HSP a lot of processes of MySQL. But innodb_buffer_pool_size is just 2GB. Server has 16GB RAM. > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > > 11570 106 20 0 570M 516M select 3 0:38 0.00% clamd{clamd} > 11570 106 20 0 570M 516M select 1 0:00 0.00% clamd{clamd} > 10612 88 20 0 2909M 451M uwait 3 0:07 0.01% mysqld{mysqld} > 10612 88 20 0 2909M 451M uwait 3 0:04 0.01% mysqld{mysqld} > ..... > > uname -a > FreeBSD server 11.1-STABLE FreeBSD 11.1-STABLE #0 r325503: Tue Nov 7 13:38:44 EET 2017 wishmaster@servers:/usr/obj/usr/src/sys/MY amd64 Have you configured any swap partitions for the server? From owner-freebsd-stable@freebsd.org Tue Jan 9 09:15:26 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D4FF2E705EE for ; Tue, 9 Jan 2018 09:15:26 +0000 (UTC) (envelope-from tempestade.anaflavia@bol.com.br) Received: from a2-sato2.bol.com.br (a2-sato2.bol.com.br [200.147.32.241]) by mx1.freebsd.org (Postfix) with ESMTP id 601737282E for ; Tue, 9 Jan 2018 09:15:26 +0000 (UTC) (envelope-from tempestade.anaflavia@bol.com.br) Received: from smtps.bol.com.br (a4-smart3.host.intranet [10.131.129.52]) by a2-sato2.bol.com.br (Postfix) with ESMTP id D8B8270000935 for ; Tue, 9 Jan 2018 07:07:35 -0200 (BRST) Received: from localhost (localhost.localdomain [127.0.0.1]) by a4-smart3.bol.com.br (Postfix) with ESMTP id D65C920000C4 for ; Tue, 9 Jan 2018 07:07:28 -0200 (BRST) X-UOL-SMTP: SMTPS587 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=bol.com.br; s=afl; t=1515488848; bh=C7Lm4l4w36ef6xjvUKqnAdb5u3kQ+I9qGzhMBn2k8W4=; h=From:To:Subject:Date; b=ZvT570bEOR+Gm7OgJ4V3V+Tn6dtClspoXTuU/qHsIYlTBaWRn8/SAmreaeJJLZCjx FQmGDSMroPayViEluG8xdY6CvDkTtOfSDD7ZHU+eiauIrLSYRsIVbDEcxLNWxg/BXI v2MgFRhG++LM1ZgFJVJlb4iKpZ5D0+eLPdj/k7Q0= Received: from smtps.bol.com.br (unknown [47.29.4.76]) (Authenticated sender: tempestade.anaflavia@bol.com.br) by a4-smart3.bol.com.br (Postfix) with ESMTPA id 773DE20000C3 for ; Tue, 9 Jan 2018 07:07:23 -0200 (BRST) From: "filippomore" To: "freebsd stable" Subject: Date: Tue, 9 Jan 2018 12:07:21 +0300 Message-Id: <860848yh96ug$ru1yzc0n$25nes24k$@bol.com.br> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 16.0 Thread-Index: XyghMjh5ayM0eXheX2QyN2MqKG5lOA== Content-Language: en-us X-SIG5: 64c8a11d8efc8043a31b80b2b0dbb96f Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 09:15:26 -0000 hiya Freebsd https://goo.gl/5UBhBX https://goo.gl/uEFSr9 Best Regards From owner-freebsd-stable@freebsd.org Tue Jan 9 09:22:09 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7B921E70CCF for ; Tue, 9 Jan 2018 09:22:09 +0000 (UTC) (envelope-from filippomore@makenji.com.br) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 673BF72DFD for ; Tue, 9 Jan 2018 09:22:09 +0000 (UTC) (envelope-from filippomore@makenji.com.br) Received: by mailman.ysv.freebsd.org (Postfix) id 668F1E70CCE; Tue, 9 Jan 2018 09:22:09 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6643EE70CCD for ; Tue, 9 Jan 2018 09:22:09 +0000 (UTC) (envelope-from filippomore@makenji.com.br) Received: from mail.makenji.com.br (mail.makenji.com.br [189.90.55.12]) by mx1.freebsd.org (Postfix) with ESMTP id 2228472DFB for ; Tue, 9 Jan 2018 09:22:08 +0000 (UTC) (envelope-from filippomore@makenji.com.br) Received: from localhost (localhost.localdomain [127.0.0.1]) by mail.makenji.com.br (Postfix) with ESMTP id 4933320871941 for ; Tue, 9 Jan 2018 07:13:07 -0200 (BRST) X-Virus-Scanned: amavisd-new at makenji.com.br Received: from mail.makenji.com.br ([127.0.0.1]) by localhost (mail.makenji.com.br [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id iOjH-L5ZvHDj for ; Tue, 9 Jan 2018 07:13:06 -0200 (BRST) Received: from mail.makenji.com.br (unknown [49.35.107.202]) by mail.makenji.com.br (Postfix) with ESMTPA id 5A0DB2069985F for ; Tue, 9 Jan 2018 07:13:04 -0200 (BRST) Date: Tue, 9 Jan 2018 12:13:04 +0300 Subject: Message-Id: From: "filippomore" To: "stable" MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 09:22:09 -0000 SGVsbG8gU3RhYmxlDQoNCg0KDQpodHRwczovL2dvby5nbC9vaHY3cXENCg0KDQpodHRwczovL2dv by5nbC9hQXBia3QNCg0KDQoNCg0KDQpmaWxpcHBvbW9yZQ== From owner-freebsd-stable@freebsd.org Tue Jan 9 09:30:16 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5750CE714EA for ; Tue, 9 Jan 2018 09:30:16 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv196.fwdcdn.com (frv196.fwdcdn.com [212.42.77.196]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1C8B0733B6 for ; Tue, 9 Jan 2018 09:30:15 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=/zTYoDBmMfvg04Mt/QwWlvQtdeMZUmrJIuwhXz0Um68=; b=LLX8o5r3vvsIrdMT2iZ5Mo/SiU d6JkblB9tKfGq+BVs9YXJ1O1dfX/aq96oT96pqccLqp7VYJw/yrnaXnfhGQ30p9PqeDCVDj2ldUpp rUNd4rOh4Bj5MB469Eh0hZEuhc+MD+zmNw3Vsa9ENj23Fm7/I5+9XrtwTtaKJCkWcSZM=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv196.fwdcdn.com with smtp ID 1eYqEV-0006TJ-Im for freebsd-stable@freebsd.org; Tue, 09 Jan 2018 11:30:11 +0200 Date: Tue, 09 Jan 2018 11:30:11 +0200 From: wishmaster Subject: Re[2]: swap_pager_getswapspace(32) Error To: Eugene Grosbein Cc: freebsd-net@freebsd.org, freebsd-stable X-Mailer: mail.ukr.net 5.0 Message-Id: <1515489509.866388124.tjhm60c8@frv52.fwdcdn.com> In-Reply-To: <5A5480F4.3080404@grosbein.net> References: <1515479672.203020608.2hyrh1bv@frv52.fwdcdn.com> <5A5480F4.3080404@grosbein.net> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Tue, 09 Jan 2018 11:30:11 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 09:30:16 -0000 Hi, Eugene. --- Original message --- From: "Eugene Grosbein" Date: 9 January 2018, 10:45:13 > 09.01.2018 14:11, wishmaster wrote: > > > Jan 5 09:49:40 server kernel: swap_pager_getswapspace(32): failed > > Jan 5 09:49:40 server kernel: swap_pager_getswapspace(24): failed > > Jan 5 09:49:40 server kernel: swap_pager_getswapspace(18): failed > > [skip] > > This has nothing to do with netgraph, dummynet or ipfw. Yes, you right, I think. > > > Without netgraph/dummynet rules I see in top -HSP a lot of processes of MySQL. But innodb_buffer_pool_size is just 2GB. Server has 16GB RAM. > > > > PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU COMMAND > > > > 11570 106 20 0 570M 516M select 3 0:38 0.00% clamd{clamd} > > 11570 106 20 0 570M 516M select 1 0:00 0.00% clamd{clamd} > > 10612 88 20 0 2909M 451M uwait 3 0:07 0.01% mysqld{mysqld} > > 10612 88 20 0 2909M 451M uwait 3 0:04 0.01% mysqld{mysqld} > > ..... > > > > uname -a > > FreeBSD server 11.1-STABLE FreeBSD 11.1-STABLE #0 r325503: Tue Nov 7 13:38:44 EET 2017 wishmaster@servers:/usr/obj/usr/src/sys/MY amd64 > > Have you configured any swap partitions for the server? This problematic server has two HDD in mirror. Swap is about 32GB and located on each HDD. The second almost identical server has only one HDD. >From dmesg: avail memory = 16527147008 (15761 MB) GEOM_MIRROR: Device mirror/swap launched (2/2). # zpool status pool: my_zroot state: ONLINE scan: resilvered 2,19M in 0h0m with 0 errors on Wed May 17 13:14:09 2017 config: NAME STATE READ WRITE CKSUM my_zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada1p4 ONLINE 0 0 0 ada0p4 ONLINE 0 0 0 errors: No known data errors # swapinfo Device 1K-blocks Used Avail Capacity /dev/mirror/swap 33554428 0 33554428 0% The Capacity parameter of swapinfo is <= 2...3% even though swap_pager_getswapspace(32) is occurred. -- Vitaliy From owner-freebsd-stable@freebsd.org Tue Jan 9 10:31:44 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B3E01E74BFC; Tue, 9 Jan 2018 10:31:44 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [78.47.246.247]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4A2F075B11; Tue, 9 Jan 2018 10:31:43 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w09AVYOl079989 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 9 Jan 2018 11:31:35 +0100 (CET) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: artemrts@ukr.net Received: from [10.58.0.4] (dadv@[10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id w09AVUMx054853 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Tue, 9 Jan 2018 17:31:30 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: swap_pager_getswapspace(32) Error To: wishmaster References: <1515479672.203020608.2hyrh1bv@frv52.fwdcdn.com> <5A5480F4.3080404@grosbein.net> <1515489509.866388124.tjhm60c8@frv52.fwdcdn.com> Cc: freebsd-net@freebsd.org, freebsd-stable From: Eugene Grosbein Message-ID: <5A549A03.9060906@grosbein.net> Date: Tue, 9 Jan 2018 17:31:31 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:38.0) Gecko/20100101 Thunderbird/38.7.2 MIME-Version: 1.0 In-Reply-To: <1515489509.866388124.tjhm60c8@frv52.fwdcdn.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=2.2 required=5.0 tests=BAYES_00, LOCAL_FROM, RDNS_NONE autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 1.9 RDNS_NONE Delivered to internal network by a host with no rDNS * 2.6 LOCAL_FROM From my domains X-Spam-Level: ** X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 10:31:44 -0000 09.01.2018 16:30, wishmaster wrote: >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(32): failed >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(24): failed >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(18): failed [skip] > # swapinfo > Device 1K-blocks Used Avail Capacity > /dev/mirror/swap 33554428 0 33554428 0% > > The Capacity parameter of swapinfo is <= 2...3% even though swap_pager_getswapspace(32) is occurred. Do you have any real problem with some running service like crashing/restarting processes? From owner-freebsd-stable@freebsd.org Tue Jan 9 11:10:07 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D9E0E76A61 for ; Tue, 9 Jan 2018 11:10:07 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv191.fwdcdn.com (frv191.fwdcdn.com [212.42.77.191]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1FBA27734A for ; Tue, 9 Jan 2018 11:10:06 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv199.fwdcdn.com ([212.42.77.199]) by frv191.fwdcdn.com with esmtp ID 1eYrn9-0002AH-Lq for freebsd-stable@freebsd.org; Tue, 09 Jan 2018 13:10:03 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=j+QhdMqw4OIKRNo1vzUw0xQNYY4mh5UpsxcVOqZTag0=; b=MC6bijw76FU8L0BhyO0MuBGv6I rYOz+pKoSSMj7GokpToaKuTf+Cq0JOi378uHPeTapYCsy2h0hwMbXInBm/V8ttn1Hz78ncPKCbAFN FppECcLPBkXdXwdWuk3mulR5sDAMqHAPytdESgeJlGf7RQ3Gn+DOD9F5WMKBRjvVvzwo=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv199.fwdcdn.com with smtp ID 1eYrn1-0001sH-Ge for freebsd-stable@freebsd.org; Tue, 09 Jan 2018 13:09:55 +0200 Date: Tue, 09 Jan 2018 13:09:55 +0200 From: wishmaster Subject: Re[2]: swap_pager_getswapspace(32) Error To: Eugene Grosbein Cc: freebsd-stable X-Mailer: mail.ukr.net 5.0 Message-Id: <1515496068.300390056.2weeea17@frv52.fwdcdn.com> In-Reply-To: <5A549A03.9060906@grosbein.net> References: <1515479672.203020608.2hyrh1bv@frv52.fwdcdn.com> <5A5480F4.3080404@grosbein.net> <1515489509.866388124.tjhm60c8@frv52.fwdcdn.com> <5A549A03.9060906@grosbein.net> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Tue, 09 Jan 2018 13:09:55 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 11:10:07 -0000 --- Original message --- From: "Eugene Grosbein" Date: 9 January 2018, 12:31:45 > 09.01.2018 16:30, wishmaster wrote: > > >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(32): failed > >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(24): failed > >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(18): failed > > [skip] > > > # swapinfo > > Device 1K-blocks Used Avail Capacity > > /dev/mirror/swap 33554428 0 33554428 0% > > > > The Capacity parameter of swapinfo is <= 2...3% even though swap_pager_getswapspace(32) is occurred. > > Do you have any real problem with some running service like crashing/restarting processes? No. This system stable enough. From owner-freebsd-stable@freebsd.org Tue Jan 9 11:22:29 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 90D8DE77486 for ; Tue, 9 Jan 2018 11:22:29 +0000 (UTC) (envelope-from artemrts@ukr.net) Received: from frv198.fwdcdn.com (frv198.fwdcdn.com [212.42.77.198]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 52C6377B3B for ; Tue, 9 Jan 2018 11:22:28 +0000 (UTC) (envelope-from artemrts@ukr.net) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=ukr.net; s=ffe; h=Content-Transfer-Encoding:Content-Type:MIME-Version:References: In-Reply-To:Message-Id:Cc:To:Subject:From:Date:Sender:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe: List-Post:List-Owner:List-Archive; bh=Dl/mR6GLrIk1W1HngX3zKaZ5tjOsklF1n+wQhQW0+r8=; b=maVrwvhC7KoYgPcHpqucfZjeD9 nQcFao0Wu8MTUsTZsi3LtXjn2M3153x3ml0d64h8K1V5Tl9HspzVtQn/fmenb3Jx7CwuHRiXS0fB5 XoYbHYwJ/1lN+XWn/h8cwNE2rBdrcH3qLeUPTvdtWbkhKManc1MmM6I6ZhFAiK4h0ClY=; Received: from [10.10.10.52] (helo=frv52.fwdcdn.com) by frv198.fwdcdn.com with smtp ID 1eYrz7-000IzD-Kr for freebsd-stable@freebsd.org; Tue, 09 Jan 2018 13:22:25 +0200 Date: Tue, 09 Jan 2018 13:22:25 +0200 From: wishmaster Subject: Re[2]: swap_pager_getswapspace(32) Error To: Eugene Grosbein Cc: freebsd-stable X-Mailer: mail.ukr.net 5.0 Message-Id: <1515496886.447895213.lph608ol@frv52.fwdcdn.com> In-Reply-To: <5A549A03.9060906@grosbein.net> References: <1515479672.203020608.2hyrh1bv@frv52.fwdcdn.com> <5A5480F4.3080404@grosbein.net> <1515489509.866388124.tjhm60c8@frv52.fwdcdn.com> <5A549A03.9060906@grosbein.net> X-Reply-Action: reply Received: from artemrts@ukr.net by frv52.fwdcdn.com; Tue, 09 Jan 2018 13:22:25 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: binary X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Jan 2018 11:22:29 -0000 --- Original message --- From: "Eugene Grosbein" Date: 9 January 2018, 12:31:45 > 09.01.2018 16:30, wishmaster wrote: > > >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(32): failed > >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(24): failed > >>> Jan 5 09:49:40 server kernel: swap_pager_getswapspace(18): failed > > [skip] > > > # swapinfo > > Device 1K-blocks Used Avail Capacity > > /dev/mirror/swap 33554428 0 33554428 0% > > > > The Capacity parameter of swapinfo is <= 2...3% even though swap_pager_getswapspace(32) is occurred. > > Do you have any real problem with some running service like crashing/restarting processes? > > I think, may be this is something ZFS-related? See ARC cache below. last pid: 37336; load averages: 0.39, 0.34, 0.28 up 1+01:08:28 13:19:14 490 processes: 5 running, 462 sleeping, 23 waiting CPU 0: 0.8% user, 0.0% nice, 0.4% system, 2.4% interrupt, 96.5% idle CPU 1: 3.9% user, 0.0% nice, 1.2% system, 0.0% interrupt, 94.9% idle CPU 2: 0.8% user, 0.0% nice, 1.6% system, 1.2% interrupt, 96.5% idle CPU 3: 0.8% user, 0.0% nice, 0.4% system, 2.8% interrupt, 96.1% idle Mem: 42M Active, 1186M Inact, 14G Wired, 495M Free ARC: 12G Total, 610M MFU, 11G MRU, 32K Anon, 44M Header, 467M Other 11G Compressed, 12G Uncompressed, 1.07:1 Ratio Swap: 32G Total, 32G Free See ARC cache. From owner-freebsd-stable@freebsd.org Thu Jan 11 05:34:15 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 94001E6E76B for ; Thu, 11 Jan 2018 05:34:15 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 6E3FC7F83A for ; Thu, 11 Jan 2018 05:34:15 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: by mailman.ysv.freebsd.org (Postfix) id 6DA21E6E768; Thu, 11 Jan 2018 05:34:15 +0000 (UTC) Delivered-To: stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D4CAE6E765 for ; Thu, 11 Jan 2018 05:34:15 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: from mail-ua0-x22c.google.com (mail-ua0-x22c.google.com [IPv6:2607:f8b0:400c:c08::22c]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3E9917F838 for ; Thu, 11 Jan 2018 05:34:15 +0000 (UTC) (envelope-from sobomax@sippysoft.com) Received: by mail-ua0-x22c.google.com with SMTP id e19so895203uam.6 for ; Wed, 10 Jan 2018 21:34:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sippysoft-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:from:date:message-id:subject:to:cc; bh=4OBAemUci7kUGe9nTz1NHCr6wlESxpyKXIB8HTypPxg=; b=dgxFPd3nz8+foMs7DXIsD0fCvgHa5u374bTai3K/zy6j7Jm0YJD/aQmm+zq7kw/GHM D3e7MZ/OFIZRYzFyrJFR2r06LDZm1XZyX16Z4m8PYprdHTkCiC/Nr/AxVkdVQcuD2iFd bGqKDuE6oatPCKAee/ZU47R7qEc90MkqLUxuDB09Rz2X+anQBUJHAUFbdy57aGlOYcOb RY0alorocneQl+k6hqlFHv+9fCU5xA5bQnsY2l5ksJ8zt0N2MfcdpUrt6lSPvU0sPuSQ GPATvuG2tZ/uLRwoPYlWUaORxaflH7dpdeG6CL3avvAqV4CVKozYdC2Ckik2/t1CubI0 gqoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:from:date:message-id:subject :to:cc; bh=4OBAemUci7kUGe9nTz1NHCr6wlESxpyKXIB8HTypPxg=; b=pjLusEYrkb2OQh1EznX1l4lZN/Y6kngDS8BeNqBK84pTtwroehyoCcfxG9n+CZenWu WBRBn2PPX4J4wgrP8r2QbM2Vw4Lovq+O9/vuil0ax152vbuG+yjNjQ66eSjgN+aK9DUY wjjpHw+ozQjVh/bjvrhdghdWiKzEVRvMy7rQ2D6Ye+lUSqfHF35Wf64lHUCCDi+KbHHV WRYlDmRl06648ggXsmWtD7QtgksMeaBpZX9vOuRPqoFa8AbOe+HVdKM14n4rNro5kdsj zBbGm26zt8un8yL3f9zqFJIwDWbLRBb0ptzajrG9SsO9WsnyP+pgf85bfKMgGRqUYlxx Rs2A== X-Gm-Message-State: AKwxytegxv9wynwHl3QZ0yQ95L2G9OY8xg77w37pWnRHfiTRgpTakGbs jjroshQNbKi9HERLAppHTtv+aeBl77/qyLoNk6Hshg== X-Google-Smtp-Source: ACJfBotTrDmnChhd29LvcKuG3BO4tPdnjwJ31jF1UDqzwckdXZZ+9BxPmAtzbpFangUKTH9pQZrr25ig1HJuu2i2Hck= X-Received: by 10.176.83.66 with SMTP id y2mr18755499uay.121.1515648853871; Wed, 10 Jan 2018 21:34:13 -0800 (PST) MIME-Version: 1.0 Sender: sobomax@sippysoft.com Received: by 10.159.41.102 with HTTP; Wed, 10 Jan 2018 21:34:13 -0800 (PST) From: Maxim Sobolev Date: Wed, 10 Jan 2018 21:34:13 -0800 X-Google-Sender-Auth: 0pBEklYER5wITT8NAQNlxshcGPY Message-ID: Subject: ena(4) is not in GENERIC, now default for some/all instances on AWS EC2 To: stable@freebsd.org, freebsd-virtualization@freebsd.org Cc: mk@semihalf.com, mw@semihalf.com, FreeBSD Release Engineering Team Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jan 2018 05:34:15 -0000 Hi, today we've migrated one of our FreeBSD EC2 r4.xlarge instances and painstakingly found that xn(4) interface is no longer provided by the Amazon "hardware". ena(4) seems to be now default for a newly created VMs, but it's not part of the GENERIC kernel. This could affect both new users trying to deploy stock FreeBSD on AWS, as well as existing users migrating their virtual assets running FreeBSD. I am not sure if there any technical reasons for not having it, but perhaps somebody needs to take a look to add it in there if there are none? -Max From owner-freebsd-stable@freebsd.org Thu Jan 11 12:02:56 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 34F2AEA4AB0 for ; Thu, 11 Jan 2018 12:02:56 +0000 (UTC) (envelope-from leoniehsa1@afrihost.co.za) Received: from smtp01-smtpout04.rb.za.mtnbusiness.net (smtp01-smtpout04.rb.za.mtnbusiness.net [41.181.159.172]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 939C36C2B6 for ; Thu, 11 Jan 2018 12:02:53 +0000 (UTC) (envelope-from leoniehsa1@afrihost.co.za) Received: from [41.115.98.7] (helo=LAPTOP0NUM49HR) by smtp.mtnbusiness.co.za with smtps (Blowfish SMTP) (envelope-from ) id 1eZbV9-0002q0-Ji for freebsd-stable@freebsd.org; Thu, 11 Jan 2018 13:58:35 +0200 From: "Leonie Botha" To: Subject: Hope Drive Date: Thu, 11 Jan 2018 13:49:58 +0200 Message-ID: <060101d38ad3$9d0af570$d720e050$@afrihost.co.za> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 16.0 Thread-Index: AdOK0fieNk3b7e2nQEGF5aW4EhPfcQ== Content-Language: en-za X-Spam-Score: -0.4 (/) X-Spam-Report: BAYES_00=-1.9, FSL_HELO_NON_FQDN_1=0.001, HTML_MESSAGE=0.001, RDNS_NONE=0.793, SPF_SOFTFAIL=0.665, * 0.0 FSL_HELO_NON_FQDN_1 No description available. * 0.7 SPF_SOFTFAIL SPF: sender does not match SPF record (softfail) * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 HTML_MESSAGE BODY: HTML included in message * 0.8 RDNS_NONE Delivered to internal network by a host with no rDNS Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Jan 2018 12:02:56 -0000 We would like to give everyone a special thank you for assisting with our Christmas Drive we handed out an amazing 964 Food Parcels to needy families and elderly and assisted an extra 461 individuals with clothing and food parcels, apart from our monthly list of destitute families. Helping SA's Children and Elderly in Need There are hundreds of families that struggle on a daily basis with no food or clothing for them and their children, a lot of these families live in horrific conditions. Many children are going to school hungry, exhausted and poorly clothed because their parents are so strapped for cash. Some are so hungry they have resorted to stealing food off others, some even stealing extra for later as their whole family are hungry. We help them with food parcels, school needs and stationary especially this time of year it's a great need, clothing, toiletries, blankets, etc. We assist families with children, this way we keep the family together, the children are not taken away from their parents due to them struggling financially, we only get involved with families where the parents are willing to make a difference in their own lives and that needs just that little bit extra help, to feed and take care of their children, ensuring their children can't be removed from them because with our assistance, the children are fed and clothed, the family are able to grow till the point where our help is not needed anymore and we can move on to other families. When thinking about elderly care we generally tend to think, struggling to: get up in the mornings, get to shops, get to church, getting to the hairdresser, and have difficulties driving! BUT no one actually realize, that not all elderly persons problems begin and end with getting older, but actually starts in the morning waking up in a cold room with dirty or no bedding at all, feeling the hunger pains, do not have shampoo to wash hair never mind going to a hairdresser, don't have any hot water, don't have R10 to go to the shop to buy a bread, can't even afford bus fare never mind struggling to see where to drive, in their own car, they don't have a problem getting to church as they do not have any clothes to wear to church. We assist the elderly with food parcels, clothing and bedding, some do receive a state pension which is barely enough for rent, and most did not have the opportunity to save up for their old days as they took care of their children's needs first and now are being forgotten by their children and family, it is sad to think that a child visits once a year and brings a bit of food but what about the rest of the year, it seems unreal but it is the reality of life. Most of the elderly that we assist have illnesses or problems like, arthritis, hip replacements, back and neck problems. Our goal is to provide the elderly with the comfortable bedding and clothing and healthy meals. We are also in the process of trying to help people that are willing to help themselves, by assisting them in finding employment. Providing a basic food parcels per family is costly and we need sponsors, without assistance none of this will be possible. The fundraising for this project will be done by asking for a R100 donation, in return you will receive a Hope Ribbon Keyring (Silver) and an invoice to claim back from tax, please help us to keep families together and the elderly feel loved and not forgotten. Donations received towards our children and elderly in need project will be used to buy food, beds and bedding, clothes and shoes, this project will assist families with children and elderly as well as children safety houses, old age homes and orphanages. Because we buy in bulk we are able to assist more with less; * R50 - 2 Children / Elderly have food for 1 day * R 100 - 2 Children / Elderly have food for 2 days * R 500 - 2 Children / Elderly have food for 10 days * R 1000 - 2 Children / Elderly have food for 20 days * R5000 - 2 Children / Elderly have food for 3 months * R10'000 - 2 Children / Elderly have food for 6 Months (186 days) You can give hope where there is none!! If you are doing a donation through the bank for this worthy project, please reply to this email with your details and postal address to ensure you receive your Invoice and special Keyring. To view our NPO and Section 18A certificates please visit our website, while you are visiting please enjoy our photos and videos. (To receive copies of our certificates / proof of registration, accounting letters etc. you can also email admin (@) hsa-team.co.za or reply to this email requesting documents) Hope you can find it your heart to assist with these projects. ABSA HELPING SA ACC NR; 4080925296 BRANCH: HORISON, 632005 CURRENT ACCOUNT PLEASE USE REFERENCE LC AND YOUR NAME OR COMPANY NAME WHEN DOING A TRANSFER - THANKING YOU IN ADVANCE We would like this project to go on for a long time, so that it can really make an impact on the ones we assist, thus we do have debit facilities now, if you would like to assist this project more than once we would really appreciate it, you can request a debit order form by email. Yours Faithfully Leonie Botha Vice-Chairperson/Fundraiser Helping SA 081 703 6774 Fax: 086 509 9871 Alternative email: leonie (@) helpingsa.co.za / leonie (@) hsa-team.co.za Web: (www) helping-sa.co.za NPO: 115-333 PBO: 930043138 "Generosity consists not the sum given, but the manner in which it is bestowed" If you wish not to receive emails from me, please reply with a blank email and I will never email you again, we do not mean to spam anyone we are just trying to assist as many as possible. Thanking you in advance. OR UNSUBSCRIBE We rather email than trouble you on the phone while you are busy this way you can decide when you have time to go through our email.