Skip site navigation (1)Skip section navigation (2)
Date:      23 Jul 2015 11:03:05 -0400
From:      "Vivara" <vivara@news.vivara.com.br>
To:        freebsd-questions@freebsd.org
Subject:   =?utf-8?B?Q29uaGXDp2EgbyBwZXJmdW1lIHF1ZSBleHByZXNzYSBhIHNvZmlzdGljYcOnw6NvLCByb21hbnRpc21vIGUgc2Vuc3VhbGlkYWRlIGRhIG11bGhlciBWSVZBUkEu?=
Message-ID:  <ef606550acb54a3fb226365cb243a23f@1108385463>

next in thread | raw e-mail | index | archive | help
SWYgeW91IGhhdmUgdHJvdWJsZSB2aWV3aW5nIHRoaXMgZW1haWwsIHJlYWQgdGhlIG9u
bGluZSB2ZXJzaW9uLg0KW2h0dHA6Ly9zMTEwODM4NTQ2My50LmVuMjUuY29tL2UvZXMu
YXNweD9zPTExMDgzODU0NjMmZT01NTQmZWxxPWVmNjA2NTUwYWNiNTRhM2ZiMjI2MzY1
Y2IyNDNhMjNmXSAgICAgDQoNCg0KIkFuw6lpcyIgPGh0dHA6Ly9hcHAubmV3cy52aXZh
cmEuY29tLmJyL2UvZXI/cz0xMTA4Mzg1NDYzJmxpZD05NTAmZWxxPWVmNjA2NTUwYWNi
NTRhM2ZiMjI2MzY1Y2IyNDNhMjNmJmVscWFpZD0xMTYmZWxxYXQ9MSZlbHFUcmFja0lk
PWQ2MjFjMDU0M2Y2NzQ3MTY4MTMzZDNiMDI1YmRjNzFkPiAgICAgICAgICAgICAiQWxp
YW7Dp2FzIiA8aHR0cDovL2FwcC5uZXdzLnZpdmFyYS5jb20uYnIvZS9lcj9zPTExMDgz
ODU0NjMmbGlkPTk1MSZlbHE9ZWY2MDY1NTBhY2I1NGEzZmIyMjYzNjVjYjI0M2EyM2Ym
ZWxxYWlkPTExNiZlbHFhdD0xJmVscVRyYWNrSWQ9ZGM5NDQ4NTRiNTZkNDdiZjhlZjY4
NzExOGRlMTdlYmY+ICAgICAgICAgICAgICJCcmluY29zIiA8aHR0cDovL2FwcC5uZXdz
LnZpdmFyYS5jb20uYnIvZS9lcj9zPTExMDgzODU0NjMmbGlkPTk1MiZlbHE9ZWY2MDY1
NTBhY2I1NGEzZmIyMjYzNjVjYjI0M2EyM2YmZWxxYWlkPTExNiZlbHFhdD0xJmVscVRy
YWNrSWQ9YTA0Y2M5YTE3MmM1NDZiN2JkMzRmODM3MTQyZDI4YjQ+ICAgICAgICAgICAg
ICJQdWxzZWlyYXMiIDxodHRwOi8vYXBwLm5ld3Mudml2YXJhLmNvbS5ici9lL2VyP3M9
MTEwODM4NTQ2MyZsaWQ9OTUzJmVscT1lZjYwNjU1MGFjYjU0YTNmYjIyNjM2NWNiMjQz
YTIzZiZlbHFhaWQ9MTE2JmVscWF0PTEmZWxxVHJhY2tJZD0wYTljM2NkN2QyZTA0YmNl
OGE0NmNkYTg3NDYwNGVjNz4gICAgICAgICAgICAgIkNvbGFyZXMiIDxodHRwOi8vYXBw
Lm5ld3Mudml2YXJhLmNvbS5ici9lL2VyP3M9MTEwODM4NTQ2MyZsaWQ9NDAmZWxxPWVm
NjA2NTUwYWNiNTRhM2ZiMjI2MzY1Y2IyNDNhMjNmJmVscWFpZD0xMTYmZWxxYXQ9MSZl
bHFUcmFja0lkPWYzZGJiMmIxYmY4ZTQ2NDNhOGExNTNmY2NlZDE2ZDVlPiAgICAgICAg
ICAgICAiUGluZ2VudGVzIiA8aHR0cDovL2FwcC5uZXdzLnZpdmFyYS5jb20uYnIvZS9l
cj9zPTExMDgzODU0NjMmbGlkPTQxJmVscT1lZjYwNjU1MGFjYjU0YTNmYjIyNjM2NWNi
MjQzYTIzZiZlbHFhaWQ9MTE2JmVscWF0PTEmZWxxVHJhY2tJZD04NzQzN2NlZTRhNGY0
ZTY0OTg0MTI1MjI0NjQ5M2RjYT4gICAgICAgICAgICAgIlJlbMOzZ2lvcyIgPGh0dHA6
Ly9hcHAubmV3cy52aXZhcmEuY29tLmJyL2UvZXI/cz0xMTA4Mzg1NDYzJmxpZD0xMiZl
bHE9ZWY2MDY1NTBhY2I1NGEzZmIyMjYzNjVjYjI0M2EyM2YmZWxxYWlkPTExNiZlbHFh
dD0xJmVscVRyYWNrSWQ9MmYwOGU3ZjdiMDNkNGI4MTllMDgxNmQ2MjZkN2QwYzQ+ICAg
ICAgICAgICAgICJMaWZlIiA8aHR0cDovL2FwcC5uZXdzLnZpdmFyYS5jb20uYnIvZS9l
cj9zPTExMDgzODU0NjMmbGlkPTQzJmVscT1lZjYwNjU1MGFjYjU0YTNmYjIyNjM2NWNi
MjQzYTIzZiZlbHFhaWQ9MTE2JmVscWF0PTEmZWxxVHJhY2tJZD1mOGFiYjk3MmFmYWY0
Y2UxYjQ4YzQ2NDM5ZTVjY2QxNT4gICAgICAgICAgICAgIkFjZXNzw7NyaW9zIiA8aHR0
cDovL2FwcC5uZXdzLnZpdmFyYS5jb20uYnIvZS9lcj9zPTExMDgzODU0NjMmbGlkPTE0
JmVscT1lZjYwNjU1MGFjYjU0YTNmYjIyNjM2NWNiMjQzYTIzZiZlbHFhaWQ9MTE2JmVs
cWF0PTEmZWxxVHJhY2tJZD04NGM4YWU2M2Q3Y2Y0YjZkODZkMDkyM2FkNGIyZjFkOT4g
ICAgICAgICAgICAgIlNhbGUiIDxodHRwOi8vYXBwLm5ld3Mudml2YXJhLmNvbS5ici9l
L2VyP3M9MTEwODM4NTQ2MyZsaWQ9NDUmZWxxPWVmNjA2NTUwYWNiNTRhM2ZiMjI2MzY1
Y2IyNDNhMjNmJmVscWFpZD0xMTYmZWxxYXQ9MSZlbHFUcmFja0lkPTJhY2Q2YzNkYmQ2
ZDQ5NjU5NzA0MjY1MzFiYWNjZTk2PiAgICAgICAgIA0KIlZpdmFyYSIgPGh0dHA6Ly9h
cHAubmV3cy52aXZhcmEuY29tLmJyL2UvZXI/cz0xMTA4Mzg1NDYzJmxpZD0xNiZlbHE9
ZWY2MDY1NTBhY2I1NGEzZmIyMjYzNjVjYjI0M2EyM2YmZWxxYWlkPTExNiZlbHFhdD0x
JmVscVRyYWNrSWQ9ZDM3YjFlMjNlYzhmNDY3NjgyNzg4M2FjNzI4YmUzZjY+ICAgICAg
ICAgDQoiQ29uaGXDp2EgbyBwZXJmdW1lIHF1ZSBleHByZXNzYSBhIHNvZmlzdGljYcOn
w6NvLCByb21hbnRpc21vIGUgc2Vuc3VhbGlkYWRlIGRhIG11bGhlciBWSVZBUkEiIDxo
dHRwOi8vYXBwLm5ld3Mudml2YXJhLmNvbS5ici9lL2VyP3M9MTEwODM4NTQ2MyZsaWQ9
OTU0JmVscT1lZjYwNjU1MGFjYjU0YTNmYjIyNjM2NWNiMjQzYTIzZiZlbHFhaWQ9MTE2
JmVscWF0PTEmZWxxVHJhY2tJZD1mZTdmOGM5YWNlMGU0NTQ4YTFmY2RlMzEyYTViMDRl
Yj4gICAgICAgICANCiJQZXJmdW1lIiA8aHR0cDovL2FwcC5uZXdzLnZpdmFyYS5jb20u
YnIvZS9lcj9zPTExMDgzODU0NjMmbGlkPTk1NCZlbHE9ZWY2MDY1NTBhY2I1NGEzZmIy
MjYzNjVjYjI0M2EyM2YmZWxxYWlkPTExNiZlbHFhdD0xJmVscVRyYWNrSWQ9MWQyMTc1
MDI3OTRkNDA0MzkxMGVkMzQyZjJmMzlhYjQ+ICAgICAgICAgDQoiTGV2ZSwgYSBwcmlt
ZWlyYSBpbXByZXNzw6NvIGNvbSBmcmFnw6JuY2lhIGxldmUgZSByZWZyZXNjYW50ZSIg
PGh0dHA6Ly9hcHAubmV3cy52aXZhcmEuY29tLmJyL2UvZXI/cz0xMTA4Mzg1NDYzJmxp
ZD05NTQmZWxxPWVmNjA2NTUwYWNiNTRhM2ZiMjI2MzY1Y2IyNDNhMjNmJmVscWFpZD0x
MTYmZWxxYXQ9MSZlbHFUcmFja0lkPTZiODRhNWE4ZWVhNDQwZDY4YzkyMGUzMWE4MWIx
ZjUwPiAgICAgICAgICAgICAiU2Vuc3VhbCwgYXJvbWFzIGZsb3JhaXMgZSBzdWF2ZXMg
Zm9ybWFtIHVtYSBwZXJzb25hbGlkYWRlIG1hcmNhbnRlLiIgPGh0dHA6Ly9hcHAubmV3
cy52aXZhcmEuY29tLmJyL2UvZXI/cz0xMTA4Mzg1NDYzJmxpZD05NTQmZWxxPWVmNjA2
NTUwYWNiNTRhM2ZiMjI2MzY1Y2IyNDNhMjNmJmVscWFpZD0xMTYmZWxxYXQ9MSZlbHFU
cmFja0lkPWQxZjgyZWFmODQ5NjRlYjg4OTQ3ODc2NmViNDI0ODg0PiAgICAgICAgICAg
ICAiSW5lc3F1ZWPDrXZlbCwgdW0gdG9xdWUgcXVlbnRlIGUgYW1hZGVpcmFkbyBxdWUg
dHJhZHV6IHNvZmlzdGljYcOnw6NvLiIgPGh0dHA6Ly9hcHAubmV3cy52aXZhcmEuY29t
LmJyL2UvZXI/cz0xMTA4Mzg1NDYzJmxpZD05NTQmZWxxPWVmNjA2NTUwYWNiNTRhM2Zi
MjI2MzY1Y2IyNDNhMjNmJmVscWFpZD0xMTYmZWxxYXQ9MSZlbHFUcmFja0lkPWJhOTNk
Yjc3NmQwMDQ4MjU5ZTkzNzg1ZWE1YmY5OTFkPiAgICAgICAgIA0KIkNvbXByZSBvbmxp
bmUiIDxodHRwOi8vYXBwLm5ld3Mudml2YXJhLmNvbS5ici9lL2VyP3M9MTEwODM4NTQ2
MyZsaWQ9OTU0JmVscT1lZjYwNjU1MGFjYjU0YTNmYjIyNjM2NWNiMjQzYTIzZiZlbHFh
aWQ9MTE2JmVscWF0PTEmZWxxVHJhY2tJZD1kMzVkYTg1MWExMDQ0ZDQ4OTA3NzJhZTdi
NjQ0Y2RjZT4gICAgICAgICANCiJGcmV0ZSIgICAgICAgICAgICAgICAgICAgICAgICAg
ICJEZXZvbHXDp8OjbyIgICAgICAgICAgICAgICAgICAgICAgICAgICJUcm9jYSIgICAg
ICAgICAgICAgICAgICAgICAgICAgICJUb2RvIG8gc2l0ZSBlbSBhdMOpIDEweCIgICAg
ICAgICANCg0KIkZhY2Vib29rIiA8aHR0cDovL2FwcC5uZXdzLnZpdmFyYS5jb20uYnIv
ZS9lcj9zPTExMDgzODU0NjMmbGlkPTE4JmVscT1lZjYwNjU1MGFjYjU0YTNmYjIyNjM2
NWNiMjQzYTIzZiZlbHFhaWQ9MTE2JmVscWF0PTEmZWxxVHJhY2tJZD1lZTc2YmIxODNl
MTQ0OTRlYTNhM2NkZjY0MGZiNjZlMz4gICAgICAgICAgICAgIlR3aXR0ZXIiIDxodHRw
Oi8vYXBwLm5ld3Mudml2YXJhLmNvbS5ici9lL2VyP3M9MTEwODM4NTQ2MyZsaWQ9MTkm
ZWxxPWVmNjA2NTUwYWNiNTRhM2ZiMjI2MzY1Y2IyNDNhMjNmJmVscWFpZD0xMTYmZWxx
YXQ9MSZlbHFUcmFja0lkPTZmZDFkMTU0ZDkxZjRkNDVhNTliZjZkMzgwMGY1MTA0PiAg
ICAgICAgICAgICAiSW5zdGFncmFtIiA8aHR0cDovL2FwcC5uZXdzLnZpdmFyYS5jb20u
YnIvZS9lcj9zPTExMDgzODU0NjMmbGlkPTIwJmVscT1lZjYwNjU1MGFjYjU0YTNmYjIy
NjM2NWNiMjQzYTIzZiZlbHFhaWQ9MTE2JmVscWF0PTEmZWxxVHJhY2tJZD0wY2ZhZDk2
NjVhMjE0NzAzODhhMDY3ZmI0ZTEzOGQ3MD4gICAgICAgICAgICAgICAgICAgICAgICAg
ICAgICAgICAgICAgICAiVml2YXJhIiA8aHR0cDovL2FwcC5uZXdzLnZpdmFyYS5jb20u
YnIvZS9lcj9zPTExMDgzODU0NjMmbGlkPTE2JmVscT1lZjYwNjU1MGFjYjU0YTNmYjIy
NjM2NWNiMjQzYTIzZiZlbHFhaWQ9MTE2JmVscWF0PTEmZWxxVHJhY2tJZD01ZGI1OTNj
YjhjYWQ0NjA4YTVkM2I0M2I1MWM5ZTg4OT4gICAgICAgICANCiJWZW5kYXMgMDgwMCA3
NyA0NCA5OTkiICAgICAgICAgDQoNCg0KVG8gdW5zdWJzY3JpYmUgZnJvbSBmdXR1cmUg
ZW1haWxzIG9yIHRvIHVwZGF0ZSB5b3VyIGVtYWlsIHByZWZlcmVuY2VzLCBwbGVhc2Ug
Y3V0IGFuZCBwYXN0ZSB0aGlzIGxpbmsgaW50byB0aGUgYnJvd3Nlci4gDQpbaHR0cDov
L3MxMTA4Mzg1NDYzLnQuZW4yNS5jb20vZS91LmFzcHg/cz0xMTA4Mzg1NDYzJmVscT1l
ZjYwNjU1MGFjYjU0YTNmYjIyNjM2NWNiMjQzYTIzZl0NCg0KWW91ciBDb21wYW55IE5h
bWUNCllvdXIgQ29tcGFueSBBZGRyZXNzDQpZb3VyIENvbXBhbnkgQ2l0eSBhbmQgU3Rh
dGUNCllvdXIgQ29tcGFueSBQb3N0YWwgQ29kZS9aaXAgQ29kZQ0KWW91ciBDb21wYW55
IFBob25lDQoNClByaXZhY3kgUG9saWN5DQpbTElOSyBUTyBDTElFTlQgUFJJVkFDWSBQ
T0xJQ1kgR09FUyBIRVJFXQ==
From owner-freebsd-questions@freebsd.org  Thu Jul 23 15:40:51 2015
Return-Path: <owner-freebsd-questions@freebsd.org>
Delivered-To: freebsd-questions@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id E53CB9A85FE
 for <freebsd-questions@mailman.ysv.freebsd.org>;
 Thu, 23 Jul 2015 15:40:51 +0000 (UTC)
 (envelope-from vrwmiller@gmail.com)
Received: from mail-oi0-x236.google.com (mail-oi0-x236.google.com
 [IPv6:2607:f8b0:4003:c06::236])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (Client CN "smtp.gmail.com",
 Issuer "Google Internet Authority G2" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id AB4FC1CA5
 for <freebsd-questions@freebsd.org>; Thu, 23 Jul 2015 15:40:51 +0000 (UTC)
 (envelope-from vrwmiller@gmail.com)
Received: by oihq81 with SMTP id q81so168079344oih.2
 for <freebsd-questions@freebsd.org>; Thu, 23 Jul 2015 08:40:50 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:date:message-id:subject:from:to:content-type;
 bh=gj08A8gKGLiysUWSDXorG1YP2xzna5Nb0uQoA75Eh1c=;
 b=sx3nTNLAMkqML1QBQhnO9J84c21Vsm59MmZ2hIQ6bDJjDpVFS1rsP8dFQpGOIUpTTa
 FujBYNLoH1kXFbKHAyQvwB/EQ4jOu0mDxCDg56pz99VSm8ICLGMUHlAmFGIMQzgy+Tpe
 ED/haoJfhr4jYhAnn3vAZY0cB3+j4GlhSy+YzDJbHKEpEp+VIAcRkyqswRrG5Ya6tdq2
 CUNyJwTmvR/W0hOl4xHKujrBlKHSBiZkYTfZRDURSryBsbHfxwf7h1UrrjFcDZFCtf+U
 WU+DCrSarEgaow0lgewDZB68xgr9+ao2u1tY3kRUASW++2e7VO9hLpnHN51A1iTvzXVk
 T0Jg==
MIME-Version: 1.0
X-Received: by 10.202.185.133 with SMTP id j127mr8847785oif.9.1437666050804;
 Thu, 23 Jul 2015 08:40:50 -0700 (PDT)
Sender: vrwmiller@gmail.com
Received: by 10.202.8.142 with HTTP; Thu, 23 Jul 2015 08:40:50 -0700 (PDT)
Date: Thu, 23 Jul 2015 11:40:50 -0400
X-Google-Sender-Auth: TmPqdWTP0MPxINJdp_hI3AHHcmE
Message-ID: <CAHzLAVFvPmp88e_J1zyD4OObCphT2eX19ZUz1N2eWXJeqxY_zA@mail.gmail.com>
Subject: freebsd-update-server findstamps() problem
From: Rick Miller <vmiller@hostileadmin.com>
To: FreeBSD Questions <freebsd-questions@freebsd.org>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.20
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.20
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions/>;
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 23 Jul 2015 15:40:52 -0000

Hi all,

Utilizing Colin Percival's freebsd-update-server[1] and instructions[2],
I'm building update server content for a customized FreeBSD distribution,
which appears to work, but exhibits unexpected behavior.  Can someone
review and provide information that may help me track this down?

The behavior manifests itself in the findstamps() function during the
while() loop that executes the findstamps binary (reference code below).
The input, as specified in stampedfiles.new, resulting in the behavior is:

world|doc|/usr/share/doc/psd/13.rcs/paper.ascii.gz

The files as they exist on the disk are as follows:

$ ls -ld world0/R/trees/world/doc/usr/share/doc/psd/13.rcs/paper.ascii.gz
world1/R/trees/world/doc/usr/share/doc/psd/13.rcs/paper.ascii.gz
-r--r--r--  1 root  wheel  22287 Jul 21 18:28
world0/R/trees/world/doc/usr/share/doc/psd/13.rcs/paper.ascii.gz
-r--r--r--  1 root  wheel  22290 Aug 24  2016
world1/R/trees/world/doc/usr/share/doc/psd/13.rcs/paper.ascii.gz

The files are, obviously, binary gzip compressed files of differing sizes.
The output of the operation performed on these files (findstamps piped to
lam()) is evident within stampvalues.new and illustrated below where the
file begins with ASCII, but where the bottom portion of the file contains
garbled characters, as if a binary were cat'd to STDOUT.  It is
subsequently followed by the error "findstamps: Files have different
lengths!" (note, the output is truncated to remove much of the binary
output).

This suggests differences in buildworld and logs do exist, but admittedly,
the low-level details of generating releases is unfamiliar to me so I'm
unsure exactly how to interpret the log files.


=3D=3D=3D Begin stampvalues.new =3D=3D=3D

scanner.po/     1437502232  0     0     100644  54784     `
reader.po/      1437502231  0     0     100644  5392      `
api.po/         1437502230  0     0     100644  38640     `
#   date: Tue Jul 21 18:29:06 2015
?"?
r
3
I?
|?
?$??w
s=3D??????????x???O????<????????????z?Y??=DC=BE?F??,wE?o?m?7??E?????=CD=AF?=
U?]?????oW?2
...
,?C?D?????n??!sY?Xe??D???v????N?N??vz??M.?q.?%?=C5=BC?\=C4=95??;????_?j~???=
~)+yb!??_??vU????7?X???6?3z????m??
findstamps: Files have different lengths!

=3D=3D=3D End stampvalues.new =3D=3D=3D



=3D=3D=3D Begin findstamps() code snippet =3D=3D=3D

        # Find stamps!
        tr '|' ' ' < ${WORKDIR}/stampedfiles.new |
            while read C SC F; do
                FP=3D"R/trees/${C}/${SC}${F}"
                echo "FP =3D ${FP}"
                if file -b ${WORKDIR}/$1/${FP} | grep -q "text"; then
                        echo "text"
                        ${BINDIR}/findstamps -t         \
                            ${WORKDIR}/$1/${FP} ${WORKDIR}/$2/${FP} |
                            lam -s "${C}|${SC}|${F}|t|" -
                else
                        echo "binary"
                        ${BINDIR}/findstamps            \
                            ${WORKDIR}/$1/${FP} ${WORKDIR}/$2/${FP} |
                            lam -s "${C}|${SC}|${F}|b|" -
                fi
            done > ${WORKDIR}/stamplocations.new        \
                2> ${WORKDIR}/stampvalues.new

=3D=3D=3D End findstamps() code snippet =3D=3D=3D


[1] https://svnweb.freebsd.org/base/user/cperciva/freebsd-update-build/
[2]
https://www.freebsd.org/doc/en_US.ISO8859-1/articles/freebsd-update-server/=
index.html

--=20
Take care
Rick Miller



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ef606550acb54a3fb226365cb243a23f>