From owner-freebsd-arch@freebsd.org Tue Dec 1 18:25:52 2015 Return-Path: Delivered-To: freebsd-arch@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1FC19A3E3CD for ; Tue, 1 Dec 2015 18:25:52 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from na01-by2-obe.outbound.protection.outlook.com (mail-by2on0119.outbound.protection.outlook.com [207.46.100.119]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "MSIT Machine Auth CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9F8D51023; Tue, 1 Dec 2015 18:25:51 +0000 (UTC) (envelope-from sjg@juniper.net) Received: from BY2PR05CA052.namprd05.prod.outlook.com (10.141.250.42) by BL2PR05MB049.namprd05.prod.outlook.com (10.255.228.144) with Microsoft SMTP Server (TLS) id 15.1.331.20; Tue, 1 Dec 2015 18:25:49 +0000 Received: from BL2FFO11OLC009.protection.gbl (2a01:111:f400:7c09::153) by BY2PR05CA052.outlook.office365.com (2a01:111:e400:2c5f::42) with Microsoft SMTP Server (TLS) id 15.1.331.20 via Frontend Transport; Tue, 1 Dec 2015 18:25:49 +0000 Authentication-Results: spf=softfail (sender IP is 66.129.239.18) smtp.mailfrom=juniper.net; freebsd.org; dkim=none (message not signed) header.d=none;freebsd.org; dmarc=none action=none header.from=juniper.net; Received-SPF: SoftFail (protection.outlook.com: domain of transitioning juniper.net discourages use of 66.129.239.18 as permitted sender) Received: from p-emfe01b-sac.jnpr.net (66.129.239.18) by BL2FFO11OLC009.mail.protection.outlook.com (10.173.160.145) with Microsoft SMTP Server (TLS) id 15.1.331.11 via Frontend Transport; Tue, 1 Dec 2015 18:25:48 +0000 Received: from magenta.juniper.net (172.17.27.123) by p-emfe01b-sac.jnpr.net (172.24.192.21) with Microsoft SMTP Server (TLS) id 14.3.123.3; Tue, 1 Dec 2015 10:25:28 -0800 Received: from chaos.jnpr.net (chaos.jnpr.net [172.21.16.28]) by magenta.juniper.net (8.11.3/8.11.3) with ESMTP id tB1IPND88504; Tue, 1 Dec 2015 10:25:24 -0800 (PST) (envelope-from sjg@juniper.net) Received: from chaos (localhost [IPv6:::1]) by chaos.jnpr.net (Postfix) with ESMTP id 4E60F580A9; Tue, 1 Dec 2015 10:25:23 -0800 (PST) To: Tim Kientzle CC: Warner Losh , Michal Ratajsky , Brooks Davis , "freebsd-arch@freebsd.org" , Subject: Re: mtree "language" enhancements In-Reply-To: <71D3DCA2-B336-4849-88E3-8412F8A93324@kientzle.com> References: <0A51B6D4-9EDD-4EFF-876F-C6B515DBB4F3@kientzle.com> <71D3DCA2-B336-4849-88E3-8412F8A93324@kientzle.com> Comments: In-reply-to: Tim Kientzle message dated "Mon, 30 Nov 2015 18:31:07 -0800." From: "Simon J. Gerraty" X-Mailer: MH-E 8.6; nmh 1.6; GNU Emacs 24.5.1 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <27384.1448994323.1@chaos> Content-Transfer-Encoding: quoted-printable Date: Tue, 1 Dec 2015 10:25:23 -0800 Message-ID: <535.1448994323@chaos> X-EOPAttributedMessage: 0 X-Microsoft-Exchange-Diagnostics: 1; BL2FFO11OLC009; 1:/pQbuSQN8qNzrCmqknRAtcYDQ0jJlWmqh3ndigwxCYLbp1IIRfZL6uhRIICqNfPIW3toEJRIv+oXnDHq4X3nBHMYM6MIBSAIRn4vz2wZCCn3xL/pgO4PMVAHcf7dvgbjWcR+oDWPq6RKtOesI2p3pGGw+T/Byk/CoSbn2O4ZVuis7OQbZNdAzTpnIQWwz30Q3yXESWJ1YxoxNUXLYUDE22Ss43i4ZkYPmBlks0lvR6D9D0QUVoJJZlA1P9zU0tirTipA1igVlAYlrLG4M8zffl9gSaVMijRubFNjDsMc3uJhMxvSoqzUUW788OGi1opPRVjBEHx2BcO7gHJ/JTOk564s+OvEhEqjlwljPl4xdeEhSaXIXvmfRom6qRKlHFor+Jk2B13wLzwqElr/8laXvg== X-Forefront-Antispam-Report: CIP:66.129.239.18; CTRY:US; IPV:NLI; EFV:NLI; SFV:NSPM; SFS:(10019020)(6009001)(2980300002)(24454002)(189002)(199003)(586003)(5001960100002)(1096002)(97756001)(33716001)(81156007)(77096005)(105596002)(50226001)(19580405001)(86362001)(69596002)(93886004)(76176999)(23726003)(11100500001)(47776003)(50466002)(19580395003)(110136002)(46406003)(4001430100002)(189998001)(87936001)(97736004)(76506005)(551544002)(50986999)(1220700001)(106466001)(57986006)(6806005)(117636001)(107886002)(5008740100001)(92566002)(2950100001)(42262002); DIR:OUT; SFP:1102; SCL:1; SRVR:BL2PR05MB049; H:p-emfe01b-sac.jnpr.net; FPR:; SPF:SoftFail; PTR:InfoDomainNonexistent; MX:1; A:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; BL2PR05MB049; 2:urYK/zZVmCLoemdsP8zVeUmQD+1wY97Cy9VNF7sMYNNtyGYQb+tb9z7xyU0TBdzJrKPxhZGoCQuGlyjP2Ee2fKwkir7KeHYp0W+89qBqahgLWBImXAtuz4LZpg/g7Vsad/Eo+sktLivKp10FfdwzPQ==; 3:Qpyn670B5OLgvhSdwahDmND/A4TG4GU8QANZaUeOTxCypphFAFhxrzAAjFuaMXncuun6f7TJpHJukbilHEslleRH7aW9hwU70mPGMDWycNE4y/ynv62vHAuevKmke4NUbqdVuetjti8/82yg9ZyA4Ldkfp5Sfo7SW+kyCAm6vEGyQHzc2JKl3ZClkoKqc6o2gM6j1Pg5PWcbiWb3B1uk6PcVBKQ4JdqPnEdJwuEm6XY=; 25:Z8KodfR+9z26Cia/UIUMTHdTK0ueRC6SL7fI1Z6GAmLUV9VArn1jUqmeGO1lxMX3S4AN8BXB6Nnm4QUdCF0LVwk0SVbOOZsgSxSwgPptIzmYSxQ+jHnQH6rTVEFS3Jn9aEIdfqr88vfnYWPabZkqT42LJRPMqXwzFsk5/A4gZObwld72wzYwEUXJj/aBCb+LrrIkcLRYwJGa3HP2Zjw7g7YBh+DFkoT8EcjiNt37goERxqVeCmWh6jMtfvsbhzv0YpDOQHHm0NTYuReJFjNoQg== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BL2PR05MB049; X-Microsoft-Exchange-Diagnostics: 1; BL2PR05MB049; 20:458D9Dpigxs7TGFTOPDRNtdK5WnYKW3GTJ1NXPnH8RtscVFyHWvogFElZ0nihl0KFigMFpEzbDPgeWomwWOkOAuwzpVycMEM8UqEhkjLsw1ntLyf9xM3zvbs4p6I4U0nC62k8wjLMM6VaPfkREjW7EfaftxTg4ZXY4a9arJVvTMGHYaSZgEk/jkH0hknX/DAW2hsaJ2YdNbh65+Yxt0h9cwzeGbPNL+EHxknx7E/l9+ZceIgw3rUon5yig0gvX8Dj1aa9tCY4GhAM+jsWpiBB70h/L0yOooZDhN4i+wZWuk/hreEXkjUgtThH511g9OjqWCAVg1gEwh1SPYa+nHRL9oreItYmn5d2as4uxa1w8L/1p7ngsJHQW3j5EXReREXMH6Vs7K9OoCM9siOZKxTqO3Qg2lu/4F9HGfKkgcBOPkTTRaZwG2M+7/L8QnggUWIgwqdf68VhEwgClBppbSmHD26lMHgXw0A/+hLfqJOM7xGWPLC5ZfxBfDU97IXlp8x; 4:vndVolHq0HjU2Mm8bXY8WZ8M9nIFCxz2xCPzjsNhJ0l4DAFhsvRVflF3pzo+1bHuVdDAJDtP8FNfmkE1hgoyafaS+hGz1BXUe3ByYZK4ADFwpmKuIgN79KekbYPvs8GQC9F8cGk1yPClu7QXuJ5Os23ocnrFOFV17/XSUG2hYgOaJ/lLreg6ACgCOxqC7c0GyzaazQuewEWj5oA/RAKTN/WfadGz2ol6DguLX+y24aw5ynEQPH7D1FFxIg9E7aKaVM1ektuv6T6pApmk2pufo8U++OMErCHkepEXOXlGFM2k+cV6iXDIAI+8+2PdxXPXL1htGgIEvKGK9ThuZUH+ZpC2zzEC3tM5Guh5K3g75eaVQUZr0qxC2ojyYt2rYRTn X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(5005006)(8121501046)(520078)(10201501046)(3002001); SRVR:BL2PR05MB049; BCL:0; PCL:0; RULEID:; SRVR:BL2PR05MB049; X-Forefront-PRVS: 07778E4001 X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BL2PR05MB049; 23:vNYmZo/cur7fZlFg0h9SRAsuZkJuBeZXEVytWdAz4d?= =?us-ascii?Q?JXcoF6AtT2z73Tjl0IRWmjlJ+5xMvWwZNPq/uIk0UJkx5PZkytGnK69OAury?= =?us-ascii?Q?vxfUr3Kp8f80quI6OWiNUt3yq+mFaw1knTbJC7N0GdguFNJ4VXeYmx6vqKmE?= =?us-ascii?Q?lN5LSMbL3UpbjGn5s6My40Z2oMLiGXteYQ7rJtKAJe4zMGFzPfOkkMWyHgz8?= =?us-ascii?Q?wE6KCPdfgwQOPRadqJwICDhvLCa0UWfKDzeY3Ud4vMXvUd8ZaD0MPNd68DK2?= =?us-ascii?Q?Bk4R5McbtN2qK94rL8e31gBEye4p7yE5rpi43xhMhrQSyctPJKl2G4DuT0vq?= =?us-ascii?Q?vb6qT/TRhE9nHfBWHjbEMvB9gpJsZYuDbyuXgNht568pMCB6koSUTCxnvgAH?= =?us-ascii?Q?2BV2YWBgGimE5/F/3u056ANr/WPpsjOOHzwXub/0l7ORuN0Gw0aOJEK3mo8n?= =?us-ascii?Q?Aq1cWNSgnGWhQaO2oMmYOPEial7bmQ/+vMHZg8oJhTj9GelVicPTsngd694d?= =?us-ascii?Q?+UfBhHdEWPhO6P6HFS8aMtJmsNUmygZClEMGMdXR30ImUpO99cPl7iigokkY?= =?us-ascii?Q?Ydm5Boy6QElTLK3VWhp5+dSiKrQkpIRVgWpF+3/rKPES2ATBkVZDGXeoE3VA?= =?us-ascii?Q?7vb1NqHCFUfArhdUtUVvD2cf/fZcdYdfOGkok7WklTiXs1CXgpStBaeRkzNL?= =?us-ascii?Q?fWu8h6cDnX/vwwkPj1UtyfvYfuARb8j0hFgQvNNerB3W8eOPjcT3cJsl0O7L?= =?us-ascii?Q?YyrxE4grKF22wd32HzFXUGTWDJjK1k1JOOw4sGd1WCnAFNbSR2XUsgbwLdyL?= =?us-ascii?Q?DDQa2OZFpegYLvg2FAj2KOf1sysePqbDbND1y1I8wtkAhqNuoEmmSrPIHpM+?= =?us-ascii?Q?yFCVpGBMR6Nt//ktrEyMduY1UHF1nm/88iFmrp6bmJaCFnNySG7+ez7BudHw?= =?us-ascii?Q?NY2fznUR97wkjfjwtxFYWOUyB3Qli5vx0x9mK4LdU/GVDD1vuKLeRMhcur/2?= =?us-ascii?Q?ByWuYY6KtmV1VRBs/iMMSknl7xnB1t4VOYhODI+25xcRhqEsiJCBUdlRrscC?= =?us-ascii?Q?Bs1M8Llhyy3tXHJKxAlIb62r9z//R5TqoDgBJavCp5kqawHnFwlj8/YfZKkT?= =?us-ascii?Q?jdzHx9kztBnjXL/uSEwJZofJy/VGNm?= X-Microsoft-Exchange-Diagnostics: 1; BL2PR05MB049; 5:X+QbOLZLnMsNFLHqpxrHDuSml8MeNPgsF+sCVoGIdGmQ151OeTLUvxJsRUaslW30otBtQHhzDavQVWovDmUWHT9Hl19JMb9SNMO1ZzVtvgf7wcVQWJdvrV9blYZnPykMg71UQLsk0rPKoaoct6udNA==; 24:7Mk50RMlO8kJXSl4piVv8h3zXbUfVXEGVz/VKM/vOkXl2Bwwpj1ZHS3HlKVWu//SiHiRfbCkBugRNpbwwyyy2Qgi2xeBSBuCMQbZ83Saouw= SpamDiagnosticOutput: 1:23 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: juniper.net X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Dec 2015 18:25:48.5631 (UTC) X-MS-Exchange-CrossTenant-Id: bea78b3c-4cdb-4130-854a-1d193232e5f4 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bea78b3c-4cdb-4130-854a-1d193232e5f4; Ip=[66.129.239.18]; Helo=[p-emfe01b-sac.jnpr.net] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL2PR05MB049 X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Dec 2015 18:25:52 -0000 Tim Kientzle wrote: > > So I'm left thinking that maybe the rule should be 'last one wins' at = least > > for the use case where we use the target's /etc/master_password. That'= s > > what I've actually implemented. > = > There are two key cases that drove this design for tar: > = > 1. Handling user info that is not (yet) in the target password file. > In practice, images get built up in different orders: I might add a > bunch of new files owned by a new user before some other process gets > a chance to add the user. This is the issue we face. We don't like magic numbers so prefer to use names (uid=3D0 gid=3D0 is fine). We use mtree with BSD.var.dist at various times, and in at least some of those cases we cannot assume that the passwd or group databases will be complete (or even valid - eg during recovery from corrupted storage). In such cases we could easily tollerate mtree simply using 0:0 (or current uid:gid) for any uname:gname it could not resolve, since we aren't likely to care about those dirs until we are up and running properly - by which time the ownership would have been fixed. What we don't want is for mtree to toss its cookies or flood the console with pointless noise (which it is wont to do). What we currently have to do to avoid problems, is run BSD.var.dist through sed to replace all \([gu]\)name=3D[^ ]* with \1id=3D0 and and it would be nice to be able to skip that.