From owner-svn-src-head@freebsd.org Sun Aug 9 08:48:39 2020 Return-Path: Delivered-To: svn-src-head@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C44D33B06EB; Sun, 9 Aug 2020 08:48:39 +0000 (UTC) (envelope-from arichardson.kde@gmail.com) Received: from mail-ed1-f66.google.com (mail-ed1-f66.google.com [209.85.208.66]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BPXnM3PWbz3ZrX; Sun, 9 Aug 2020 08:48:39 +0000 (UTC) (envelope-from arichardson.kde@gmail.com) Received: by mail-ed1-f66.google.com with SMTP id di22so4250838edb.12; Sun, 09 Aug 2020 01:48:39 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=mo/6WYqFgWPmyS2mUqkBmq+N7zXh/q8YMJyBZvFxju4=; b=eUOSOWLcFNLWZjquWHnhBKy+11CrfYSCXYZgcyIsPW9/lLRoHBq2MRXUPeJbO3lPd2 i9S+TN4hpo2JRhaWuXXU6inZOqwDPTVU2ryrzbf2sa5moNCsF4bbIxpVgDdeyFP5Yp1Z HiZO7D+W1OpMS4epdRcohgljbh5eAXqV3B9wkaz2LOs1e6hhBXep5CDe8bAsSw1LGH9k 811gj9j4RLsEPWdJuVYhQGIYe0aQgUARzCgRI/N8P/1zFooHoIHq10rfQHszNnCP48pq Y3kykOo4727/v1DWnv2I9PYDh2d34j8HJkXmKtZOU/pwuzUDifHlVORUhnhys/f6le8a f5TA== X-Gm-Message-State: AOAM530kjME/aQJyBRbfbnxKGgd7/SjK9JW8YIzFiwLUpFtJXjCQijVz 3fkKclABCKesfjQBfT9VO6CwsMTf9Z3afQ== X-Google-Smtp-Source: ABdhPJxVESQZPC97HxsAdTD/HV6QYZ4lI8fsb8dm0RxbnmvV3i/xBBTh4exnfXlJi9A2z/u0jKeoKw== X-Received: by 2002:a05:6402:3130:: with SMTP id dd16mr9451083edb.55.1596962916788; Sun, 09 Aug 2020 01:48:36 -0700 (PDT) Received: from mail-wr1-f53.google.com (mail-wr1-f53.google.com. [209.85.221.53]) by smtp.gmail.com with ESMTPSA id l7sm9505409edn.45.2020.08.09.01.48.36 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 09 Aug 2020 01:48:36 -0700 (PDT) Received: by mail-wr1-f53.google.com with SMTP id c15so5388345wrs.11; Sun, 09 Aug 2020 01:48:36 -0700 (PDT) X-Received: by 2002:adf:f806:: with SMTP id s6mr20228665wrp.252.1596962915963; Sun, 09 Aug 2020 01:48:35 -0700 (PDT) MIME-Version: 1.0 References: <202008062046.076KkDSc013901@repo.freebsd.org> <11fb770c36b3da67506c9a8fb919490d038b98e5.camel@freebsd.org> In-Reply-To: <11fb770c36b3da67506c9a8fb919490d038b98e5.camel@freebsd.org> From: Alexander Richardson Date: Sun, 9 Aug 2020 09:48:25 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: svn commit: r363992 - head/usr.sbin/pwd_mkdb To: Ian Lepore Cc: Mateusz Guzik , src-committers , svn-src-all , svn-src-head Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 4BPXnM3PWbz3ZrX X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TAGGED_FROM(0.00)[] X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Aug 2020 08:48:39 -0000 On Sat, 8 Aug 2020 at 17:27, Ian Lepore wrote: > > On Sat, 2020-08-08 at 11:08 +0100, Alexander Richardson wrote: > > On Sat, 8 Aug 2020 at 02:19, Mateusz Guzik wrote: > > > > > > This broke i386 builds: > > > > > > /usr/src/usr.bin/chpass/field.c:175:15: error: incompatible pointer > > > types passing > > > '_bootstrap_time_t *' (aka 'unsigned long long *') to > > > parameter > > > of type 'time_t *' > > > (aka 'int *') [-Werror,-Wincompatible-pointer-types] > > > if (!atot(p, &pw->pw_change)) > > > ^~~~~~~~~~~~~~ > > > /usr/src/usr.bin/chpass/chpass.h:67:27: note: passing argument to > > > parameter here > > > int atot(char *, time_t *); > > > ^ > > > /usr/src/usr.bin/chpass/field.c:185:15: error: incompatible pointer > > > types passing > > > '_bootstrap_time_t *' (aka 'unsigned long long *') to > > > parameter > > > of type 'time_t *' > > > (aka 'int *') [-Werror,-Wincompatible-pointer-types] > > > if (!atot(p, &pw->pw_expire)) > > > ^~~~~~~~~~~~~~ > > > /usr/src/usr.bin/chpass/chpass.h:67:27: note: passing argument to > > > parameter here > > > int atot(char *, time_t *); > > > ^ > > > > Sorry, fixed in r364049. > > > > It may be fixed in terms of compiling, but how about at runtime? > _bootstrap_time_t is still typedef'd as 64-bit, but on i386 a time_t is > a 32-bit type. > > -- Ian > The structure is only used as a temporary buffer before serializing the values to a fixed format. That format truncates all integers to 32-bit so changing it to 64-bits on i386 it does not change the format. Arguably, pwd_mkdb should be using 64-bit time_t values everywhere, but this commit is intended to allow bootstrapping and not to introduce a future-proof binary format. Alex > > > On 8/6/20, Alex Richardson wrote: > > > > Author: arichardson > > > > Date: Thu Aug 6 20:46:13 2020 > > > > New Revision: 363992 > > > > URL: https://svnweb.freebsd.org/changeset/base/363992 > > > > > > > > Log: > > > > Allow bootstrapping pwd_mkdb on Linux/macOS > > > > > > > > We need to provide a struct passwd that is compatible with the > > > > target > > > > system and this is not the case when cross-building from > > > > macOS/Linux. > > > > It should also be a problem when bootstrapping for an i386 > > > > target from a > > > > FreeBSD amd64 host since time_t does not match across those > > > > systems. > > > > However, pwd_mkdb always truncates integer values to 32-bit so > > > > this > > > > difference does not result in different databases. > > > > > > > > Reviewed By: brooks > > > > Differential Revision: https://reviews.freebsd.org/D25931 > > > > > > > > Added: > > > > head/usr.sbin/pwd_mkdb/pwd.h (contents, props changed) > > > > Modified: > > > > head/usr.sbin/pwd_mkdb/Makefile > > > > > > > > Modified: head/usr.sbin/pwd_mkdb/Makefile > > > > ================================================================= > > > > ============= > > > > --- head/usr.sbin/pwd_mkdb/Makefile Thu Aug 6 20:44:40 > > > > 2020 (r363991) > > > > +++ head/usr.sbin/pwd_mkdb/Makefile Thu Aug 6 20:46:13 > > > > 2020 (r363992) > > > > @@ -9,5 +9,8 @@ MAN= pwd_mkdb.8 > > > > SRCS= pw_scan.c pwd_mkdb.c > > > > > > > > CFLAGS+= -I${SRCTOP}/lib/libc/gen # for pw_scan.h > > > > +.if defined(BOOTSTRAPPING) > > > > +CFLAGS+=-I${.CURDIR} > > > > +.endif > > > > > > > > .include > > > > > > > > Added: head/usr.sbin/pwd_mkdb/pwd.h > > > > ================================================================= > > > > ============= > > > > --- /dev/null 00:00:00 1970 (empty, because file is newly > > > > added) > > > > +++ head/usr.sbin/pwd_mkdb/pwd.h Thu Aug 6 20:46:13 > > > > 2020 (r363992) > > > > @@ -0,0 +1,66 @@ > > > > +/*- > > > > + * SPDX-License-Identifier: BSD-2-Clause > > > > + * > > > > + * Copyright 2018-2020 Alex Richardson > > > > + * > > > > + * This software was developed by SRI International and the > > > > University of > > > > + * Cambridge Computer Laboratory (Department of Computer Science > > > > and > > > > + * Technology) under DARPA contract HR0011-18-C-0016 ("ECATS"), > > > > as part of > > > > the > > > > + * DARPA SSITH research programme. > > > > + * > > > > + * This software was developed by SRI International and the > > > > University of > > > > + * Cambridge Computer Laboratory under DARPA/AFRL contract > > > > (FA8750-10-C-0237) > > > > + * ("CTSRD"), as part of the DARPA CRASH research programme. > > > > + * > > > > + * Redistribution and use in source and binary forms, with or > > > > without > > > > + * modification, are permitted provided that the following > > > > conditions > > > > + * are met: > > > > + * 1. Redistributions of source code must retain the above > > > > copyright > > > > + * notice, this list of conditions and the following > > > > disclaimer. > > > > + * 2. Redistributions in binary form must reproduce the above > > > > copyright > > > > + * notice, this list of conditions and the following > > > > disclaimer in the > > > > + * documentation and/or other materials provided with the > > > > distribution. > > > > + * > > > > + * THIS SOFTWARE IS PROVIDED BY THE AUTHOR AND CONTRIBUTORS ``AS > > > > IS'' AND > > > > + * ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED > > > > TO, THE > > > > + * IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A > > > > PARTICULAR > > > > PURPOSE > > > > + * ARE DISCLAIMED. IN NO EVENT SHALL THE AUTHOR OR CONTRIBUTORS > > > > BE LIABLE > > > > + * FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR > > > > CONSEQUENTIAL > > > > + * DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF > > > > SUBSTITUTE GOODS > > > > + * OR SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS > > > > INTERRUPTION) > > > > + * HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN > > > > CONTRACT, > > > > STRICT > > > > + * LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) > > > > ARISING IN ANY > > > > WAY > > > > + * OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE > > > > POSSIBILITY OF > > > > + * SUCH DAMAGE. > > > > + * > > > > + * $FreeBSD$ > > > > + */ > > > > + > > > > +/* > > > > + * When building pwd_mkdb we need to use target systems > > > > definition of > > > > + * struct passwd. This protects against future changes to struct > > > > passwd > > > > and > > > > + * is essential to allow cross-building from Linux/macOS hosts > > > > since the > > > > + * structure is not compatible there. > > > > + */ > > > > +#include > > > > +#include > > > > +/* > > > > + * Note: pwd_mkdb always stores uint32_t for all integer fields > > > > (including > > > > + * time_t!) so these definitions do not need to match > > > > sys/sys/_types.h > > > > + */ > > > > +typedef uint32_t _bootstrap_gid_t; > > > > +typedef uint32_t _bootstrap_uid_t; > > > > +typedef uint64_t _bootstrap_time_t; > > > > +#define _GID_T_DECLARED > > > > +#define _TIME_T_DECLARED > > > > +#define _UID_T_DECLARED > > > > +#define _SIZE_T_DECLARED > > > > + > > > > +#define gid_t _bootstrap_gid_t > > > > +#define uid_t _bootstrap_uid_t > > > > +#define time_t _bootstrap_time_t > > > > +#define passwd _bootstrap_passwd > > > > +#include "../../include/pwd.h" > > > > +#undef gid_t > > > > +#undef uid_t > > > > +#undef time_t > > > > > > > > > > > > > -- > > > Mateusz Guzik >