From owner-freebsd-questions@freebsd.org Fri Jan 19 02:41:32 2018 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 07DEBEBC7A3 for ; Fri, 19 Jan 2018 02:41:32 +0000 (UTC) (envelope-from amutu@amutu.com) Received: from mail-ot0-x236.google.com (mail-ot0-x236.google.com [IPv6:2607:f8b0:4003:c0f::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BFBAF6D28E for ; Fri, 19 Jan 2018 02:41:31 +0000 (UTC) (envelope-from amutu@amutu.com) Received: by mail-ot0-x236.google.com with SMTP id x4so240546otg.7 for ; Thu, 18 Jan 2018 18:41:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amutu-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=hF4f3sLg4cn8pCbWd3xPtHbLhilphtmliqtL6jOYlUw=; b=aHVTk4NhF5u70UzgDaJB0u8kRjm3UJLhWaxon7TJtM9P337KaRr3QzJpxcC4B//WGp QdOaSKikfN1cmmcUyapjZgrXNmnqx+kAUS+VElFPysKrJTT+FxjMo/d6jmr7qhssA2P6 zT/vhh7hUhcDgIhZfON3IA7C/58uUn5gExAvuRboBIAMf/HUa1Z/tCr24ya6Zi3FJIId 0rmUDXOzTMizBYg+Lu7ICGMeehSI9CIi8UofvUt08s2bz2ab7Wm3g1kTtxhrQfT2Wvfa MyV3Gm1ybINXT7hxkDNMkpST9u/hvEX4xg7+1Rl3F/72DdKdF1t4yQ59Rt1Ke9wEvdhG Oo/w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=hF4f3sLg4cn8pCbWd3xPtHbLhilphtmliqtL6jOYlUw=; b=QjFgOeNVAEipm8y9AqrT98S5uYWV4TAP3ZkCblYLYoGfQB7VUWu/vl/KaQvyjF2jNu MRSk3BZQPL6i2xha5bWgCY/oB8nTz1DS88o+Rx6OPblOCVSF4L+sxKWoCA08MpRJEFvp pWGUFacXuWUjmbW/4Ok6F7yA8D7WlcXYTYrja56bgnFE33shbBHAoSwFw7clEc1ZxxYq imu3RTVi8c1pASjunoh0Lbao06vusRMDT1auzUmJaGHdhokC+xO79Nma8bc1J2knTXnI Dr1yxrawFptP+YoL+j9AZueZPTf79pmf6M9qeBtz+4unGGBzOdONZxD1qfVLuzg7T7b9 1zPA== X-Gm-Message-State: AKwxyte1HrpCCE6IVmYwtg/ua7MdasuNLqMVT/MAmx72+Ww3sQLsAmqO kb2vEF88Bc6ZOD/MXaV2sglfp6RUTp0= X-Google-Smtp-Source: ACJfBosB+POgU4TkgZmklSOvzqx6kYBpRjTZ/DPAip/RygToZBTi/4oTYaz6ACkV80pkN2VidORMNQ== X-Received: by 10.157.114.80 with SMTP id a16mr5627361otk.88.1516329690740; Thu, 18 Jan 2018 18:41:30 -0800 (PST) Received: from mail-ot0-f177.google.com (mail-ot0-f177.google.com. [74.125.82.177]) by smtp.gmail.com with ESMTPSA id i67sm3555212oih.40.2018.01.18.18.41.30 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 18 Jan 2018 18:41:30 -0800 (PST) Received: by mail-ot0-f177.google.com with SMTP id 44so237004otk.8 for ; Thu, 18 Jan 2018 18:41:30 -0800 (PST) X-Received: by 10.157.83.4 with SMTP id g4mr5668864oth.264.1516329690039; Thu, 18 Jan 2018 18:41:30 -0800 (PST) MIME-Version: 1.0 Received: by 10.74.188.140 with HTTP; Thu, 18 Jan 2018 18:41:09 -0800 (PST) In-Reply-To: <68377.1516327618@segfault.tristatelogic.com> References: <68377.1516327618@segfault.tristatelogic.com> From: Jov Date: Fri, 19 Jan 2018 10:41:09 +0800 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Splitting up sets of files for archiving (e.g. to tape, optical media) To: "Ronald F. Guilmette" Cc: FreeBSD Mailing List Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jan 2018 02:41:32 -0000 dar may help=EF=BC=9Ahttp://dar.linux.free.fr/ from the man page=EF=BC=9A *dar* is a full featured backup tool, aimed for disks (floppy, CD-R(W), DVD-R(W), zip, jazz, hard-disks, usb keys, etc.) and since release 2.4.0 also adapted to tapes. *dar* can store a backup in several files (called "slices" in the following) of a given size, eventually pausing or running a user command/script before starting the next slice. This can allow for example, the burning of the last generated slice on a DVD-R(W), Blue-ray Disk, or changing of usb key before continuing on the next one. Like its grand-brother, the great "tar" command, *dar* may also use compression, at the difference that compression is used inside the archive to be able to have compressed slices of the defined size. 2018-01-19 10:06 GMT+08:00 Ronald F. Guilmette : > > This isn't really FreeBSD specific, but in my experience the folks on > this list have a lot of knowledge about a lot nice, useful free software > tools, so I hope nobody will begrudgd me for asking this question here. > > I'm looking for a pre-existing software tool, which may or may not alread= y > exist, and which will do the following job... > > Problem statement: > > Imagine that you have a big set of files that you would like to archive > to some sort of archiving media, such as tapes, or optical media, where > each unit of said archiving media has a capacity considerably less than > the total aggregate size of all of the files you want to archive. > > Imagine further that you would like your set of input files to be spread > across the units of the output (archive) media such that no single input > file is ever split across more than one unit of the output media, in orde= r > to simplify recovery/restore of individual files. > > Lastly, assume that it is desired to minimize, as much as reasonably > possible, the total number of output (archive) media units used to > archive the entire set of input files. (And to further this goal, > it is acceptable for files from any single input subdirectory to be > scattered among the various output media units. > > +_+_+_+_+_+_+_+_+_+_ > > In my case, I want to archive several hundred gigabytes onto a set of > blank BD-R disks. > > I plan to use ImgBurn to actually write the BD-R disks. > > So basically, I just need a tool to analyze the input file set, applying > some sort of bin packing algorithm, and then spit out a list of which > specific files should go into each specific archive volume, e.g. #01, #02= , > #03... etc. Each such set of files will then, in turn, be hard-linked > into a temporary directory, and then, one by one, ImghBurn will be told > to write each of these temp directories to a single output BD-R disk. > > I have written a small software tool to do the above "splitting" job, > and I am currently improving upon it, but it occured to me that I > should at least ask if someone else has perhaps already perfected this > exact wheel that I am busy re-inventing. > > > Regards, > rfg > > > P.S. It seems unlikely that I'm the first and only person to have ever > written a tool to do this specific job, but on the off chance that I am, > I am more than willing to contribute my little tool to the ever-expanding > ports tree. > _______________________________________________ > freebsd-questions@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions- > unsubscribe@freebsd.org" >