From owner-freebsd-questions@FreeBSD.ORG Thu Dec 4 04:39:47 2014 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9AAE4E9E for ; Thu, 4 Dec 2014 04:39:47 +0000 (UTC) Received: from nm8-vm0.bullet.mail.bf1.yahoo.com (nm8-vm0.bullet.mail.bf1.yahoo.com [98.139.213.95]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 50E432B2 for ; Thu, 4 Dec 2014 04:39:46 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1417667985; bh=Bg7oeO+mO4G19Ynyv0eboPebMA9hbNWqbKmLJvDBvbE=; h=Date:From:To:Subject:References:In-Reply-To:From:Subject; b=MByqOUcn27vTRlsU8zlijL/FHT4VMsHBh67CsXQw/6PHuudMOyopmmKkda3hYdryDBnSCz0D5niHz7sQ9uj+wgEUK9PudseNgvEB+oB5KxFl5Vhui9Sadp6l18FdCoUN9afUpHOi8jAAyV9E4XOgjLUDH1WCiE7CIGOn0BANfZnY1cLaxorR3bT9e0Jj0K18kgRKSuf9l8WBFCk+JZkP4ewpzPvL9lKKLlmznxvdqlHcAeVXU5PDbLpkmadtwKvE6tpVsBjaROImRXEU29a6ZEQef4Qk0JgO0nNGzz9MKv5zSwLIocUrGwyqnOI8pVUIiY2iLRJyy8/wV6JgddZUhQ== DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s2048; d=yahoo.com; b=PMMIrW8PqnVLY0vYRx/GTloAWyiKGCm2/fJmFaK3qdefW/PBMhXeQgUfnEgNKKgjRysIzoTx+HgG2nawx7rZKS5G+93jO1aHQaK+IqBm7muhMxie/oQpOie1dFs6zRAap5JG8CZlrB4x2lp1XkswKsYMcEaouuCBOD3bidKNXq7+Z/8px9YX1gVkCuT/TE9DNE5q+MWx2Xw3GUCoqksKepoD2LThPTmmrQkVK3SuI0RFGi4NrL5++wvJ6n6kKhP7hA34QpBqbnhVv/U7QJkjavWtZothTQh98VgwkW8mDAEynCWLfbnkv1mnv6sxyTwJIw+o6XlpcKke+LMSIAxbCg==; Received: from [98.139.212.149] by nm8.bullet.mail.bf1.yahoo.com with NNFMP; 04 Dec 2014 04:39:45 -0000 Received: from [98.139.213.14] by tm6.bullet.mail.bf1.yahoo.com with NNFMP; 04 Dec 2014 04:39:45 -0000 Received: from [127.0.0.1] by smtp114.mail.bf1.yahoo.com with NNFMP; 04 Dec 2014 04:39:45 -0000 X-Yahoo-Newman-Id: 667337.21635.bm@smtp114.mail.bf1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: 2Nqw6M4VM1mzWrJ3SPSswwBcO1r.U1IMbfU4TeO9lqCdD5r 36hNPCYxAHIAI0X4q2sFJeYEev_HbrPDHUeSMODf_ia.bBQhfpIKxvZXTFFv sv6ktd65aPlJpevqcUV7aM6O9GXoP8BVDg2OuFy1h98GYI64cS6KoGu0fWOO Wq012BXT2Us2_x4l0TWcQS6GWncqSzpHtMsxx5zA4WN4iXlvJbq0Wu7tvjOL yEC1wy7W9nDATnNmE0dIhMFCO.ET6aTIBfnYc6y7CAf9Y8KAsEpRTu2foajt WWkok2pWAAGPTuGfcs.7ElDPOQOwdDontg2UJV4T1BP2LO2sd91i61Iae.lG QJO8i6x9nQDjO7jnsuOtZR6tLNRhcRqtURyGbXAZynP0IFc8RRiSJ1wW23RU 3M07m_CxlO3ffbjwpCWZZlwdkuKPbmj.B3NuUVuA7rDtDJ9ui6T.MB2WoK8F r2iihO0S7ulxlfEj8Qz85kKBQkfvqgkhv_X1Iz1IkbUgM6Zi82WrYh2v6W3L YndDZ76ewRq4_Q52ueealNCuAp.q7LCTPgs3qqCLdI_ufj84KQCUZNOPoL__ TT4dRvSRGxmxQljIQ7qJp0g-- X-Yahoo-SMTP: h3Xqg6.swBC0yI913RMMwp94grO_cg-- Message-ID: <547FE590.1050403@yahoo.com> Date: Wed, 03 Dec 2014 23:39:44 -0500 From: Paul Pathiakis User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-questions@freebsd.org Subject: Re: Backup solution for freeBSD/Symantec Backup exec porting References: <999d7e80e60f466682c736f275b75788@Server02.ad.ezmax.ca> In-Reply-To: <999d7e80e60f466682c736f275b75788@Server02.ad.ezmax.ca> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 8bit X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Dec 2014 04:39:47 -0000 Ian, Check into BackupPC in the ports collection. It's very useful and very fast. It's a little bit to wrap your mind around when configuring, but once you're up and running, it's very easy to use. As for storage, I might suggest a RAID5 or RAID6 with 4 TB SATA drives. The drives are pretty much going to be write once and read a few, pretty static in other words. The whole retention issue for large companies comes under the Sarbannes-Oxley (SOX) compliance. If you don't need to retain fulls for long periods of time (10 years), you could buy something like a SuperMicro 4U with 45 disk drives. With 7 drives per stripe, you might come out with 6 x 4000GB / 1024 = 22.5 TB in RAID 5 and about 5 x 4000GB/1024=19 TB in RAID 6. After that, 6 total pools and 3 for hot spares (a necessity for RAID5, kind of optional for RAID 6, yes, everyone, that's my opinion.) I would also suggest this is done with ZFS and RAIDZ or RAIDZ2. Also, if you want to keep growing the repository, they have 45 disk expansion chassis. (Of course, any vendor will do, but I try to keep my costs manageable - The enclosure is about $2K, the drives would be about 45x$100= $4.5K, plus guts for about another $1.5K... Total cost for this would be about $8500 or so.) You would end up with about with somewhere between 110TB (RAID 6) and about 130TB (RAID 5). Disk is very cheap these days. Also, ZFS will let you know there's a failure and you can rebuild. Digital tape over the years, may lose information. (Yes, other people will tell you no way. However, do you want to find out when trying to restore? - I'm speaking from experience). The other issue is keeping the disk powered and online. That's power and heat. More $$$ versus tape. Also, tape is a lot more mechanical than disk and it's sequential when restoring. When someone needs something back... NOW is not soon enough in most cases. Also, there is a misconception about backups. Many vendors have products that 'stream across' multiple media at a time. That is not a good thing. It means that you can backup fast. However, it usually means that all the drives that were streamed across have to be available to restore. Otherwise if you streamed across 4 tapes drives and only two are available, it means you will read the first two parts of the stream, unload those tapes, load the next two, stream those two parts... lather, rinse, repeat. People have to remember, backup speed is not the critical point of backups (you have to figure out a good schedule to get everything done but that's it.) it's restore that is critical. The backup vendors want you to believe the opposite as their restore speed tends to be abysmal. Oh, backuppc is free. What you save on Backup exec licensing will pay for your array. ;-) I hope this helps. P. On 12/03/2014 19:01, Ian Lord wrote: > Hi, > > I've been using freebsd since version 4.11 and always dealt with backup semi manually with dump, copying files over, database dumps, etc. > > By the way, not as a home user, but for 8-10 servers used in a SAAS application. We are looking for something more serious as we are dealing with about 10TB of data for documents, and 600-800 gigs of SQL database. Everything is redundant, replicated, etc, but we need a serious backup solution. > > We are thinking of purchasing a DELL Powervault LT2000 device which consists of 1 or 2 LTO6 tape drives with 24 slots giving 60TB of data space for retention > > I've read a lot on the subject and many people seem to do dumps on a remote HD, etc, but to get to 60TB of disk space would cost a lot and would be less reliable then a tape library in my opinion. > > We need something automated and reliable. Hopefully, with a nice gui to restore individual files etc... > > We already have backup exec 2014 for our windows servers, but they don't make an agent for freebsd. > Symantec has netbackup which supports FreeBSD, but it seems really expensive (A rep will call me, tells all about the price lol) > > I've read on Bacula and Amanda, and it really doesn't feel like a product mature enough (outdated documentation, no clear indication the tape library would work, etc). Their commercial counterparts are really expensives... I'm afraid to purchase hardware, new server, etc and end up with nothing working. > > In the past, we used backup exec to backup freebsd using their legacy backup agents in linux compat mode and it was working really well. We tried (without extensive effort) to make work their linux agent on freebsd without success. > > So my questions are: > > 1- Does anyone have a tape library working with bacula or Amanda ? Does it work well ? (meaning stable, reliable and good performance) > > 2- Would anyone be willing to try to make backup exec work on freebsd using linux compat mode ? I would be willing to finance the project up to 500$ perhaps other people reading this could also contribute to have more man hours on this task. > > I love so much FreeBSD Over Linux, but it's always hard to get support from vendors... We are even evaluating to switch our fileservers to Centos (where we also dump sql databases and could replicate important data from freeBSD) to be able to easily back them up using Backup Exec's agent. But this would be my last resort as I don't want to support linux box where everything else in in FreeBSD. > > Any help/comment would be appreciated. > > Thanks > > ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ > Ian Lord > MSD Informatique > 143 Rue des Fauvettes > St-Colomban (Québec) J5K 0E2 > Tél: (514) 776-6734 #201 > Sans Frais: 1(877) 776-6734 #201 > http://www.msdi.ca/ > > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"