From owner-freebsd-hackers@freebsd.org Fri Sep 11 19:35:34 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 10B263E3FAC for ; Fri, 11 Sep 2020 19:35:34 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-io1-xd29.google.com (mail-io1-xd29.google.com [IPv6:2607:f8b0:4864:20::d29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp5ZY2DYmz3W72 for ; Fri, 11 Sep 2020 19:35:32 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-io1-xd29.google.com with SMTP id z25so12247317iol.10 for ; Fri, 11 Sep 2020 12:35:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=sender:from:mime-version:subject:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=c85G+W35JQyxGVEavyK23zpqyldtwP+bLK3n/+VjWls=; b=VgZQYclnH4W1XoSyqClTq4UTNbv9/hzlK3cmXCi0F1KY+YS9Soz/xPkKj+Zr2hfmLY XFpr/o0HqxZ1TbWwtWo95XNQtCZC8pJnxN4pVfwG1l2b2Ml/V46VDZCpN3VS/wjfonky i6AZFhL6QmZYCfwttTElIKVCuWTe3M/SDQqFSazWZaKyUibpg+u2RXDeTcQTlxAtwklm V0ru3r9zdl3+2+knxgEUlikUab+j86fAOZ3TX7DUIaL+cq7aqlChHEeeCRPTjBG/VpsE 2pUualqg3TYvOa+AHCmQD+a8pFPSCznIEHixRtnwUNtpL6ZU4q5Nb6mCy8yPKjEw3aJC IcLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:mime-version:subject:in-reply-to :date:cc:content-transfer-encoding:message-id:references:to; bh=c85G+W35JQyxGVEavyK23zpqyldtwP+bLK3n/+VjWls=; b=LJG5XJs8Ulknz5WxhtH5ec8aHh/R8OfLcaRUyobNMrIo4MH9nz6Z663xwPoy9BMcCJ eQE0sqmxgIBusvPFz8fmx+T5Vi4BL8wEHGRYlweh+pdDbrBC4icVxFTk7OnRD4Gm6REV BHUOBDHtGh5pHFyPbLV9ZZT26rTj4MyTtW3aDR0Du4PWQXxtHtEg58su9k7/g55/9xF5 Z6TFswrJx+qLSJW7hFZ0JQTe5RqqRh0mk8ENOUwSP2YIprZEpvzDlF8HY6gcf32SIG6t XORbpIltcu45UEy4tMTr17TuDqcaL+I5dS+jooDQF0ODbwfi5FuKk2+zWiyeHGLHRdc2 FZPA== X-Gm-Message-State: AOAM533aE/a73+q/IDqku2xOKJZJhi89JGI+BFvaIFPK8MS8GB541bAP ThALFdvCMK6dF9qf2qD7Vw5AEA== X-Google-Smtp-Source: ABdhPJwX1oig3Sd2BKMa+NSB2oJFirbEMCAHUA9n6or6uumEdNCVp/iF2dNE22/9DrGViU4TkN7ohw== X-Received: by 2002:a6b:3bd8:: with SMTP id i207mr3005697ioa.150.1599852931974; Fri, 11 Sep 2020 12:35:31 -0700 (PDT) Received: from ?IPv6:2603:300b:6:5100:18db:d97a:14f0:179? ([2603:300b:6:5100:18db:d97a:14f0:179]) by smtp.gmail.com with ESMTPSA id m15sm1711488ild.8.2020.09.11.12.35.31 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 11 Sep 2020 12:35:31 -0700 (PDT) Sender: Warner Losh From: Warner Losh X-Google-Original-From: Warner Losh Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Integration Test, Unit Test, and head/tests in FreeBSD In-Reply-To: <20200911190238.GA39530@raichu> Date: Fri, 11 Sep 2020 13:35:30 -0600 Cc: Yoshihiro Ota , freebsd-hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <3E1A9477-A408-49E7-B1D7-B6389E3FA7CF@gmail.com> References: <20200908201352.e4e78f7aea8a2b081adfb57e@j.email.ne.jp> <20200911190238.GA39530@raichu> To: Mark Johnston X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Rspamd-Queue-Id: 4Bp5ZY2DYmz3W72 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=VgZQYcln; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::d29) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.26 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.97)[-0.966]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.20)[0.203]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d29:from]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 19:35:34 -0000 > On Sep 11, 2020, at 1:28 PM, Mark Johnston wrote: >=20 > On Tue, Sep 08, 2020 at 08:13:52PM -0400, Yoshihiro Ota wrote: >> Where should I put it and how do I set up so that review/phab can = verify as well? >=20 > For the purpose of review, you can submit a patch through phabricator > just as you would for code changes. As I noted there is currently no > mechanism to automatically run tests on your behalf; you'll have to = run > the tests yourself until they are committed, at which point they will = be > run regularly as part of the CI system. While not part of FreeBSD, per se, nor part of phabricator, people have = had good luck using cirrus-ci on GitHub to push a branch to do some = testing. It would take some work to take the current .cirrus-ci.yml file = and adapt it to your needs. It current builds FreeBSD on a 12.1 instance = and then boots the amd64 image using qemu to run a basic test. You can = setup Cirrus-CI to run on selected branches you push to GitHub. And if you do make improvements in the area you=E2=80=99d like to share, = please cc me on them. Thanks Warner