Date: Fri, 13 Feb 1998 09:32:01 -0500 From: sbabkin@dcn.att.com To: hackers@FreeBSD.ORG, matthew@netsol.net Subject: RE: Large system backups; recommendations for devices & strategie s? Message-ID: <C50B6FBA632FD111AF0F0000C0AD71EE413293@dcn71.dcn.att.com>
next in thread | raw e-mail | index | archive | help
This message is in MIME format. Since your mail reader does not understand this format, some or all of this message may not be legible. ------ =_NextPart_000_01BD3862.3E7705A0 Content-Type: text/plain The most I did was 6 systems (3 pairs) and 20G of data :-) The idea was the following: there is one backup system. Once a week a full backup is done manually (in meaning that it's necessary to manually insert tapes, kick off the backup scripts and check their results for errors, after that manually put tapes into safe). During the week this system has a tape with ongoing data. We changed this tape once a day (manually, with storing all the tapes unused at the moment in a fireproof safe) by two reasons: 1. In the worst case (like total destruction by fire) we can tolerate loss of one day of data, but better not more. 2. The tape is big enough (DDS-2 120m) to store all data for one day, so we don't need to change it more often. Application explicitly stores the data into a separate hierarchy of directories (the same as the main one). A particular case of that is Oracle archived logs. This second hierarchy gets polled, data transferred as cpio archive to backup server, saved in 2 copies. The backup servers restores this data into its main directory hierarchy, after what passes the cpio archive with server ID added to tape server and initiates removal of backed up data in the backup hierarchy on main server. After that backup server does any necessary additional things to newly received data, like applying Oracle archived logs. The tape servers pours everything it receives into the tape. The reason for explicit second hierarchy is an attempt to reduce overhead of searching for new data and reduce the period of polling. In case when restoration is needed, search the backup log for the latest occurrence of given file name, get its cpio archive name and date of copy, take the tape, restore archive from it (mt fsf is useful with it), and finally restore file from archive. And there was a like but separate technology for archived data that has to be stored for several years. Now I see that they have nothing like in AT&T :-) Although [mostly] batch processing of billing data has different requirements than online operation of a bank. -SB > ---------- > From: matthew@netsol.net[SMTP:matthew@netsol.net] > Sent: Thursday, February 12, 1998 8:05 PM > To: 'hackers@FreeBSD.ORG' > Subject: RE: Large system backups; recommendations for devices & > strategies? > > As many times as you can if all this data may e modified from minutes > ro minutes > matt at Future Lab > > ---------- > From: Mike Smith > Sent: Monday, February 09, 1998 7:56 PM > To: hackers@FreeBSD.ORG > Subject: Large system backups; recommendations for > devices & strategies? > > > (Please pardon the crosspost to -isp; I'm looking for comments > from > people with experience administering backup strategies for > largish > networks, and I suspect some of you lurk there.) > > I'm looking for recommendations for both backup devices and > backup > strategies for a network of about six systems and perhaps 50GB > of > data. Ultimately, I'd like something that can run more or less > unattended, modulo media changes, etc. (ie. I expect using > Amanda or > similar.) > > I'd be interested in hearing from anyone that's been involved in > > setting up and/or operating such a backup system, as well as > perhaps > being interested in doing something similar for the FreeBSD > project. > > -- > \\ Sometimes you're ahead, \\ Mike Smith > \\ sometimes you're behind. \\ mike@smith.net.au > \\ The race is long, and in the \\ msmith@freebsd.org > \\ end it's only with yourself. \\ msmith@cdrom.com > > > > To Unsubscribe: send mail to majordomo@FreeBSD.org > with "unsubscribe hackers" in the body of the message > > ------ =_NextPart_000_01BD3862.3E7705A0 Content-Type: application/ms-tnef Content-Transfer-Encoding: base64 eJ8+IgUOAQaQCAAEAAAAAAABAAEAAQeQBgAIAAAA5AQAAAAAAADoAAEIgAcAGAAAAElQTS5NaWNy b3NvZnQgTWFpbC5Ob3RlADEIAQWAAwAOAAAAzgcCAA0ACQAgAAEABQATAQEggAMADgAAAM4HAgAN AAkAIAACAAUAFAEBCYABACEAAABENDFGMzg4MzM5QTREMTExQUYyMDAwMDBDMEFENzFFRQAQBwEE gAEARAAAAFJFOiBMYXJnZSBzeXN0ZW0gYmFja3VwczsgcmVjb21tZW5kYXRpb25zIGZvciBkZXZp Y2VzICYgc3RyYXRlZ2llcz8AlxgBDYAEAAIAAAACAAIAAQOQBgDkDQAAIQAAAAMAJgAAAAAAAwA2 AAAAAAAeAHAAAQAAAEQAAABSRTogTGFyZ2Ugc3lzdGVtIGJhY2t1cHM7IHJlY29tbWVuZGF0aW9u cyBmb3IgZGV2aWNlcyAmIHN0cmF0ZWdpZXM/AAIBcQABAAAAGwAAAAG9OBt+lhcM72qjyhHRs/RE RVNUAAAAG0bVMQADAC4AAAAAAAIBCRABAAAAAgoAAP4JAAD8EwAATFpGdZrNIDX/AAoBDwIVAqQD 5AXrAoMAUBMDVAIAY2gKwHNldG4yBgAGwwKDMgPFAgBwhHJxEiJzdGVtAoNuMwPGBxMCgzQPfxCH NTMTDBZfZjYERhNzMSAwRVIgSwhzGqBPSeg4LVICgH0KgAjPCdniOxx/MjU1AoAKgQ2xwQtgbmcx MDMUkAsKKxmBC/JjAEAgCoVUaAxlIARgFAAgSSBkIGlkIHdhBCA2IEZzE/MEICgzIAqwaTkR4Ckg AHAioAHQRyAUb2YicGEBkCA6LXckICHSIpBlJSAKhSLCdLsh4QIQbBwQA/AfgDoKhX8KhSbBHIAl sAQgAiAh8GIRANBrdXAjFS4gT6xuYyHwJSB3CeBrKoHcZnUnIClGKOFkKREKheUDgXUHQGx5I5AL gCIAPyXgAwAfgCaxJQAlsHQnPwQgKSAqYAQQCsAtMHRvnyy4C4AR8AAgJrBhcAeQ8iwKhWtpKXAk sSTQJsL/KVYFAwQgJEIRsAWQKuAmwfUj8CAcgHMrMDLhAhAFwO8EkANgEeAw1mEBgBrxLhN5LMdw dTBlMAEvUS8AZvRlKSogRAhxLeMh8Cqy9ygXKOEjJCARwDLxMHMisOUuYGgpAWdvLdIk8iog/lch 8BGxH4AJgDmkMIIKhd8CICpjJPAtMSzGLDsUFADfBbAt0i0BJrM3NHUs4BHw/yKgJQAoGCIBB4AC MDABKvL1I/BlE5BvJME34ylALzFedy9gHIAi0AIgcyedMb0qIEkDoDjDNQEFQGMi0KEh8ChsaWtA kW8BkAcDIA2wFABydWN0af8CIEQCQxIkICqwRtFGIQbw/wSQJQAsRhwQBBEkwSkSPnJrJMU/QGI3 AWISADXSbtdHoCIBHIAuJ6wyKiAh0nM60yjhYmkt8AnwCGBnQTtQKEREUy0SIDH9AdBtJCA3sj/B KnErQSTzvzSSSyUw1kSwSTIsEScFQP8pIDzSL2A8hC5RTRMksRQQ8m5NbUFwC1AxYCUASHL8ZXhW oi5gLSFQ8yakJPP/N5MlIBHwCrFKATpgCJEKwP0RsHk9liTRQyFIUD/RB5H+KCbCLwAHgCQwJqQA wC1h+ykROCFBI8EAIDFgKzAKwV9G4yTAKBcuMgQgT0nwY2dJ0CQwWkFpdjzRHBBnvnNOYjnSBZEk UVn3IDzA/TLhcCcRCYAw1iTzSCAAcc84ADTgQVIEIGNwSHBgNu8vQilWBJBgkHI/QC8AYJL/LWES IAWgZRAHkE1mIdJmC/8EIDQRWAYr4li3LmAEIFzz71smLTBZ9zU8dy4iCrAEEF9YNWULP2RmgyJQ RCQwZP8NsFQDOtNv9TVGJFELgC5g7wcwFBBpkgRgdkfBJMEpUv880SmRWKUx2mH4SIFc82Z0/12B NchmCywBB5EAcC0wLrj/cJFysQIgB0A5SB+AJqEvYP0pIHctIVtBM9BgkkvUR0P7MJALUHkt0l/f YOInrE6Hr2k2YuAIcAQgZWaheXsj/1SyfCU3dUB2KiB/T0R1NIT/V1VhfyjSA5ElABQRBTEvUf8c gUhAPYdmoSHgcJAkshHw/2BDLeE0knvBJOQkQoh0JrP/MKAFEARwJLJi4idhTW1GEf9G423QCfBp pVbkKOFT0mMh/4n1Mdpg0TSDJsFKNnLiBUC8b2NeEGSBKlIkwWdggf+FYQMQIfB6gAeAP0BikWsj /2ULlOJx6STxk+NnoT8xAZD/R2JAhT9AabVlRwNSVLI+sP8FQAPQXtYo4UExKyE7FC5g/ik/QCRC QxB6gXvzUPSUk/+aU2BFVZ4kUSiEIsIlIEdD/0wyWWcUEBGwTOBg0UjBBbH/YEdjxC4hCoU6cmXS XBFRAt+dEQWxEfBmoUfBeYoRfy7+TidAIlER8IwCLjEmwWxBH2cBTNKB80dDLWFBVCaqVCUzQTRQ aE+jWyIS9S0gXSlBdBGwCoVDUS7S/y3Sc7IDEI0yJOQ6ciKADdDnKKFCkRyAcXVDIUJyJqL/A5EC II0xPYeMYVbkJMElIIkpUG5rTW0tU0InrCMK9EdAMTgwAtFpLXgxNDQN8AzQtZMLWTHvGYBDUaJR BUAtt7cKh7Zr6wwwtzZGA2E6uL63NgyC5yyxAkAh4HdAKSAy4AbwAi688VtTTVRQOvm8f3RduF+5 bQZgAjC6n5+7qyHQgVFSYrpAZWJIMAcvElBgP0AxOTk4IIA4OjA1IFBNvy/ZuW1Ub8Fvu6snEcB0 AQ0R4EC6UAngQlNELjBPUkcnxX/APnViTmpbUcefu6tSRc0wTM8KwFSROgUpVHM7fBIDcN9CcSTx SHE0dA2wdjFgB5HeJj+hSfKUMAeQP7O/tMO8Mza2NxSSIPS3J0FrUu95QUhgB4Ii0XkIYEljBpD/ QCVqZgDALTAh8q7RCJCdEf2aYm0LgDcAcwIvYdp0ys35FcIxN7cnvfJBcbpANwD3CHAh8M9QYsrN 1V8FQLQt/jK3ALVP3Aq3H7gv4za5v+vi37vYTUdSU9pgJsDk3z/AP8FK57/owmGxw6swOfHElTc6 NSMAxV/qj8d6/+x/vEHJj8qQ78/L38zt8o//vEHPX9Bv0X/Sj9OfAcHe/fngLShQSdBG8gsCSIFu k18DYAQQYuAiMS9RLQQAcNn6gEknOlAcEG8xUIp1//rENGKaYgqFjFFnsH4xOyP/V0GMcZOzcJDa YRfANdEt0t8pVvyXNINeMZQwc6xmLqH5REFyazDAJDOoIUEwMKD/5AFEsFxRJMHXkh1QClAodPwu KY2NAx36r6MREnA7Qf8pVfvmJEIpVVKmCDwlIAoF57HzECChkml4IxckQoxh0zpw+mAgNSSQQiSy Y1n5KiAgVTRQ1xBKAT8iAwD/YLFHUguCgeQuE9fSSDAtcf9VA0qBLuGD5kEQh8IkUJBi/9mBKzAv YZBActA8dQpxvXD+YxdRLVCDwSJgBiLkAUEw/S3SQSzBJPAaglKm1xCeQP/LAAzvGFGlQTeRKKEV AWcz/4mBP+OehHlAKRIuEi6BTHD7jwHfMHZJwGcVUqZMgS3S+ymRCqEvUfKxdC3hNDCQ4f+yMjJE FPOc0aDwKrArQaDh/xWmysVMcIIDIktTcCfDGOd/IFWR9rpByiOs0szysp4td7QXMMEd4FMY4tcT 15En/1EiiYI/QDKUMMTo/zDEGNP3MXpMcHsxZBdRMsjaYEdgjEBz6VK9Ui5hdTBb/4TTc/BO80qg VICc1HTVNqatN2NABJAk0GLDgC6jEP5nMFv7AZyRJJGwkUQgBdM315FGoCmgZhdROttjZL2aYS4P AbKsg/0ckFX7cPXM0HMB0GlMcM8wpiAKsedrcdhhHJFhaqMQU3DZgHfJ9zwoBdMiGhBCd/O2Iv90 x9mQS4Ncs3miVJD9P9ReV+OQ/2/LAX3KwABMsAAAQAA5AGB31CWMOL0BAwDxPwkEAAAeADFAAQAA AAgAAABTQkFCS0lOAAMAGkAAAAAAHgAwQAEAAAAIAAAAU0JBQktJTgADABlAAAAAAAMA/T/kBAAA AgFHAAEAAAArAAAAYz1VUzthPSA7cD1BVFQ7bD1EQ043MS05ODAyMTMxNDMyMDFaLTE0MDE1AAAC Afk/AQAAAEcAAAAAAAAA3KdAyMBCEBq0uQgAKy/hggEAAAAAAAAAL089QVRUL09VPURDTkVYQ0gv Q049UkVDSVBJRU5UUy9DTj1TQkFCS0lOAAAeAPg/AQAAAA4AAABCYWJraW4sIFNlcmdlAAAAHgA4 QAEAAAAIAAAAU0JBQktJTgACAfs/AQAAAEcAAAAAAAAA3KdAyMBCEBq0uQgAKy/hggEAAAAAAAAA L089QVRUL09VPURDTkVYQ0gvQ049UkVDSVBJRU5UUy9DTj1TQkFCS0lOAAAeAPo/AQAAAA4AAABC YWJraW4sIFNlcmdlAAAAHgA5QAEAAAAIAAAAU0JBQktJTgBAAAcw+je23Yg4vQFAAAgw0K8NJow4 vQEeAD0AAQAAAAUAAABSRTogAAAAAB4AHQ4BAAAAQAAAAExhcmdlIHN5c3RlbSBiYWNrdXBzOyBy ZWNvbW1lbmRhdGlvbnMgZm9yIGRldmljZXMgJiBzdHJhdGVnaWVzPwAeADUQAQAAADsAAAA8QzUw QjZGQkE2MzJGRDExMUFGMEYwMDAwQzBBRDcxRUU0MTMyOTNAZGNuNzEuZGNuLmF0dC5jb20+AAAL ACkAAAAAAAsAIwAAAAAAAwAGEES8QwQDAAcQIgsAAAMAEBAAAAAAAwAREAIAAAAeAAgQAQAAAGUA AABUSEVNT1NUSURJRFdBUzZTWVNURU1TKDNQQUlSUylBTkQyMEdPRkRBVEE6LSlUSEVJREVBV0FT VEhFRk9MTE9XSU5HOlRIRVJFSVNPTkVCQUNLVVBTWVNURU1PTkNFQVdFRUtBAAAAAAIBfwABAAAA OwAAADxDNTBCNkZCQTYzMkZEMTExQUYwRjAwMDBDMEFENzFFRTQxMzI5M0BkY243MS5kY24uYXR0 LmNvbT4AAK3A ------ =_NextPart_000_01BD3862.3E7705A0-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?C50B6FBA632FD111AF0F0000C0AD71EE413293>