Date: Fri, 18 Jan 2008 19:18:28 +0000 From: Tom Judge <tom@tomjudge.com> To: Ulrich Spoerlein <uspoerlein@gmail.com> Cc: freebsd-stable@freebsd.org, =?ISO-8859-1?Q?Johan_Str=F6m?= <johan@stromnet.se> Subject: Re: Backup solution suggestions [ggated] Message-ID: <4790FB84.1040409@tomjudge.com> In-Reply-To: <7ad7ddd90801180128m114b0491p7d8f44ae7b1b4cb7@mail.gmail.com> References: <E6BCC509-6CC8-44F1-98C2-416920A52218@stromnet.se> <39FB5CF3-F2F4-401B-9D6D-7796608152E5@ish.com.au> <4FF9842D-ADC9-4A99-9DC4-E0FE1CC9CDCF@stromnet.se> <20080116222729.GB1529@roadrunner.spoerlein.net> <134BD86C-19CF-42A7-9190-FAD3BB564A06@stromnet.se> <7ad7ddd90801170030l790810b5r5bb156e3cda286b1@mail.gmail.com> <73ED6B7D-49C5-4C69-8BE2-27F0BDAA246E@stromnet.se> <7ad7ddd90801180128m114b0491p7d8f44ae7b1b4cb7@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Ulrich Spoerlein wrote: > On Jan 18, 2008 9:11 AM, Johan Ström <johan@stromnet.se> wrote: >> Your no,barely, bad hell no seems to fit pretty good.. I did some >> testing during the night with the above (non-production) setup. >> What I did was doing some rsyncing over the night: >> >> while true ; do >> echo "`date` Clearing vmail" >> logfile >> rm -rf vmail >> echo "`date` Starting rsync" >> logfile >> rsync -vr /usr/var/vmail . |tee -a logfile >> echo "`date` Rsync finished " >> logfile >> done >> >> I started this at ~02.0. The results? A freshly rebooted 6.2 (6.2- >> RELEASE-p6 FreeBSD 6.2-RELEASE-p6 #0: Fri Jul 27 15:47:50 UTC 2007) >> box in the morning.. >> [...] >> What I dont have is a coredump, judging from dmesg -a savecore wasnt >> even run.. running it now, 5 hours later, didnt find any cores. >> >> The other end (7.0 server) wasnt affected at all. >> >> Not realy sure what it had been doing, because looking at my >> bandwidth graphs from the switch, nothing was done at all.. It didnt >> even go through one iteration of rsync... ~7.5k files/directorys >> seems to have been transfered, then the log doesnt say more. But >> according to the BW graph, after ~03.00 no traffic was sent at all... >> >> Some known bug with 6.2? > > There was some ggatec problems with TCP and/or sockets, I think they > have been mostly resolved post-6.2. If you want to pursue this further > (it *would* be a cool setup, no doubt) I'd suggest three things: > - Update to 6.3 > - Leave GELI out of the loop for now (only do ggate, with random data perhaps) > - Build a kernel *without* options PREEMPTION > Hi, We have 4 production High Avaliability NFS clusters running GMirror+GGate+LinuxHA (2 Nodes per cluster) on RELENG_6_2. This setup has proved very stable for us you have to do some tuning though: /etc/sysctl.conf: net.inet.tcp.sendspace=1048576 net.inet.tcp.recvspace=1048576 kern.ipc.maxsockbuf=2049152 /boot/loader.conf: kern.ipc.nmbclusters="32768" Command line options to ggate[cd] ggate[dc]_buf_size="1310720" ggatec_timeout="5" ggatec_queue_size="2048" Cluster node uptimes range from 40-160 days with the last reboots being caused by power problems not FreeBSD issues. The problems may be in the tuning or with geli, personally I would leave geli out at try with the above configuration. Then try above with geli to see what the problem is. Tom
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4790FB84.1040409>