From owner-freebsd-testing@freebsd.org Sun Oct 25 02:19:54 2020 Return-Path: Delivered-To: freebsd-testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9ECC843E36C for ; Sun, 25 Oct 2020 02:19:54 +0000 (UTC) (envelope-from hrdept.careers@shell.us) Received: from ns5000173.ip-192-99-200.net (ns5000173.ip-192-99-200.net [192.99.200.60]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4CJhWG1z6Qz4RCY for ; Sun, 25 Oct 2020 02:19:54 +0000 (UTC) (envelope-from hrdept.careers@shell.us) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=blakeconstructions.com; s=default; h=Content-Type:MIME-Version:Message-ID: Date:Subject:To:From:Reply-To:Sender:Cc:Content-Transfer-Encoding:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:In-Reply-To:References:List-Id:List-Help:List-Unsubscribe: List-Subscribe:List-Post:List-Owner:List-Archive; bh=Gnu0KfcaN4fSZDuxi96hYlPDZ4d4opppJQJv+GTTxBA=; b=WbQqwPO2ybFFQ2acvuIaHweSVy iO0FoDtJe/fJdtUfrM0BkOAezHNkCzhVAonfSga57258lwmXBP00TcxEx4KG1llCQJu8agNd166U6 JCA6kpZ2RH6fla1l4gwhZP2reEoPInWlbQ6bl84PCeIP8KsQIFoNlCBbHmBVekT7VmdV3B2iEb5Vp w0c9dGSyvUziaaaiNrjbpxjjELyD2h/A+MjmjV8XVGP9QEE2UUY8vN9EV5cvjxLNHopt8Ck+wnEDD /Bk2hZPhMhhsjCLu/Ps/Z2qzmw8sHdO/p09pmVSe3lkPdw1WSGGgvkH3wrIApLLpktXpk701amQL8 a5vHBaMg==; Received: from [216.38.2.221] (port=51703 helo=shell.us) by server.blakeconstructions.com with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.93) (envelope-from ) id 1kWVdL-0003Kv-Q5 for freebsd-testing@freebsd.org; Sun, 25 Oct 2020 02:19:48 +0000 Reply-To: "George Wills - Shell Oil Company" From: "George Wills - Shell Oil Company" To: freebsd-testing@freebsd.org Subject: NEW EMPLOYMENT PROPOSITION : 24102020 Date: 25 Oct 2020 02:19:45 +0000 Message-ID: <20201025021945.E62801B2B3DACEC2@shell.us> X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - server.blakeconstructions.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - shell.us X-Get-Message-Sender-Via: server.blakeconstructions.com: authenticated_id: sales@blakeconstructions.com X-Authenticated-Sender: server.blakeconstructions.com: sales@blakeconstructions.com X-Source: X-Source-Args: X-Source-Dir: X-Rspamd-Queue-Id: 4CJhWG1z6Qz4RCY X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=blakeconstructions.com header.s=default header.b=WbQqwPO2; dmarc=none; spf=fail (mx1.freebsd.org: domain of hrdept.careers@shell.us does not designate 192.99.200.60 as permitted sender) smtp.mailfrom=hrdept.careers@shell.us X-Spamd-Result: default: False [5.31 / 15.00]; HAS_REPLYTO(0.00)[hr.dept@careers-shell.com]; RCVD_VIA_SMTP_AUTH(0.00)[]; REPLYTO_DN_EQ_FROM_DN(0.00)[]; HAS_X_SOURCE(0.00)[]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[blakeconstructions.com:+]; NEURAL_HAM_SHORT(-0.16)[-0.161]; SUBJ_ALL_CAPS(2.78)[37]; HAS_X_ANTIABUSE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:~,2:~]; ASN(0.00)[asn:16276, ipnet:192.99.0.0/16, country:FR]; MID_RHS_MATCH_FROM(0.00)[]; HAS_X_AS(0.00)[sales@blakeconstructions.com]; RWL_MAILSPIKE_NEUTRAL(0.00)[192.99.200.60:from]; ARC_NA(0.00)[]; R_SPF_FAIL(1.00)[-all:c]; R_DKIM_ALLOW(-0.20)[blakeconstructions.com:s=default]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/related]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; DMARC_NA(0.00)[shell.us]; NEURAL_SPAM_MEDIUM(0.77)[0.775]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_LONG(1.02)[1.021]; MIME_HTML_ONLY(0.20)[]; HAS_X_GMSV(0.00)[sales@blakeconstructions.com]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-testing] MIME-Version: 1.0 Content-Type: text/plain X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 25 Oct 2020 02:19:54 -0000 From owner-freebsd-testing@freebsd.org Wed Oct 28 23:10:34 2020 Return-Path: Delivered-To: freebsd-testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9CFA9452388 for ; Wed, 28 Oct 2020 23:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4CM46y3kCqz3SPj for ; Wed, 28 Oct 2020 23:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 7E14B452387; Wed, 28 Oct 2020 23:10:34 +0000 (UTC) Delivered-To: testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7DE18452386 for ; Wed, 28 Oct 2020 23:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CM46y2pB5z3S7d for ; Wed, 28 Oct 2020 23:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 3F93623B9B for ; Wed, 28 Oct 2020 23:10:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 09SNAYKE016340 for ; Wed, 28 Oct 2020 23:10:34 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 09SNAYDi016338 for testing@FreeBSD.org; Wed, 28 Oct 2020 23:10:34 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: testing@FreeBSD.org Subject: [Bug 250706] lib.libc.ssp.ssp_test.raw is broken without ASAN Date: Wed, 28 Oct 2020 23:10:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: brooks@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: testing@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2020 23:10:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250706 Bug ID: 250706 Summary: lib.libc.ssp.ssp_test.raw is broken without ASAN Product: Base System Version: CURRENT Hardware: Any OS: Any Status: New Severity: Affects Only Me Priority: --- Component: tests Assignee: testing@FreeBSD.org Reporter: brooks@FreeBSD.org The raw SSP test is broken without ASAN. Unfortunately, we can not reliably link ASAN support code in an external cross compiler (it might be for a new= er OS version and require new syscalls). We need to be linking against an ASAN library matching the version of FreeBSD being built. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-testing@freebsd.org Wed Oct 28 23:10:57 2020 Return-Path: Delivered-To: freebsd-testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id BF405452483 for ; Wed, 28 Oct 2020 23:10:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 4CM47P4G6Mz3SQ3 for ; Wed, 28 Oct 2020 23:10:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 8FC3C452392; Wed, 28 Oct 2020 23:10:57 +0000 (UTC) Delivered-To: testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8E375452391 for ; Wed, 28 Oct 2020 23:10:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CM47P2bxGz3SdT for ; Wed, 28 Oct 2020 23:10:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 2D61523862 for ; Wed, 28 Oct 2020 23:10:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 09SNAukb016683 for ; Wed, 28 Oct 2020 23:10:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 09SNAuMT016682 for testing@FreeBSD.org; Wed, 28 Oct 2020 23:10:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: testing@FreeBSD.org Subject: [Bug 250706] lib.libc.ssp.ssp_test.raw is broken without ASAN Date: Wed, 28 Oct 2020 23:10:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: testing@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2020 23:10:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D250706 --- Comment #1 from commit-hook@FreeBSD.org --- A commit references this bug: Author: brooks Date: Wed Oct 28 23:10:55 UTC 2020 New revision: 367121 URL: https://svnweb.freebsd.org/changeset/base/367121 Log: Disable ssp raw test without ASAN r366981 disabled ASAN when it might not be reliable (with an external compiler), but this test is broken without ASAN so disable it completely in that case. PR: 250706 Reviewed by: emaste, lwhsu Differential Revision: https://reviews.freebsd.org/D26982 Changes: head/lib/libc/tests/ssp/Makefile --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-testing@freebsd.org Thu Oct 29 00:23:15 2020 Return-Path: Delivered-To: freebsd-testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 04E6C453544; Thu, 29 Oct 2020 00:23:15 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pg1-x529.google.com (mail-pg1-x529.google.com [IPv6:2607:f8b0:4864:20::529]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CM5kp0QPgz3Wg1; Thu, 29 Oct 2020 00:23:13 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pg1-x529.google.com with SMTP id t14so911181pgg.1; Wed, 28 Oct 2020 17:23:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=gTPriKkDBs743Kd6p/2WnduW+quoeLNNqe4GX7yg9Jg=; b=uqU2VgoPVeH/lbJgOTtTH0hEJUKEfHWyEDc/gpvym8FS5v8EuZ64YL4LzbN8tYNDLq nviR8zN3aQiWEI8O914FqwNWNB8MU7YkTk8A+Vdaac5sgLHDxBIpDYWYswOweKsnVvzk 8e+XSOZaexCSuVD6Qw8VgvFx6GH+Kf7O4t8F3BIVP4sq1XU1M/7vY19KNGyh3l2GciYi zXC0aN3ogo6rgLzMhir6e5Fka0e5IzgML0uoXaVPA6sFwBqPbmoWVadtSuaj/X9FCND4 Cmxa0X9pjeyOD1n6KoPDu+t+GwDxaYCc6cJup+0dRwiQ0D/+SzYhSfSFUxWK2sykGyLo 7NGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=gTPriKkDBs743Kd6p/2WnduW+quoeLNNqe4GX7yg9Jg=; b=ANsshz7K3LsJ9bzzLcVbdntJLeOvn6tSzN8nfRyHyL/fM9p4GimrGd9xWzOVmd2qKa uG1oeUJ/y/YlGvB254m9VDaBmChgxU6l0ta7322HQEyKhdhRGhXjDiUiVnEqV9v7s4jn mN5SqwHQ0y7gYjM33rsbFJUs33nZZCUl1L9l+osPSP03+rXXbzhkeBJmrd3HKYxuikRm KOmhMO+LsawML2Vc7IZioW3SWOarh7rOSLiILmE70UrbFwNFSj+O7MhSVAIgSnA+fPqC xvWz6Gh4LPvsqc6SV40NW0TpHH6o8bpX60JMkwIO3CeJE6bKXwLOOxO3T6XlS/VERsaW q+ew== X-Gm-Message-State: AOAM533bFBbtg0xLs8biixZRNIFnppOUPdz0i8Xgr7WTAzmcW+BgniWu hW6VINwJlEbIXhus0doeFOlW9irAw/uz7g== X-Google-Smtp-Source: ABdhPJw87UBZoE1WSqvyYjno04Tmr9G/5/rUUEGTkfMldXdDL8W29d8Yab6eaZtS9LuzPjHbk47YPQ== X-Received: by 2002:a63:5644:: with SMTP id g4mr1772501pgm.145.1603930990409; Wed, 28 Oct 2020 17:23:10 -0700 (PDT) Received: from [192.168.20.26] (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id l3sm525891pju.28.2020.10.28.17.23.09 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 28 Oct 2020 17:23:09 -0700 (PDT) From: Enji Cooper Message-Id: <0217233F-9E0D-47EC-AAAA-1C19551C2FF9@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Testing with lua/atf-lua reviews Date: Wed, 28 Oct 2020 17:23:08 -0700 In-Reply-To: Cc: freebsd-testing@freebsd.org, FreeBSD Hackers To: Kyle Evans References: X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Rspamd-Queue-Id: 4CM5kp0QPgz3Wg1 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=uqU2VgoP; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::529 as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com X-Spamd-Result: default: False [-3.00 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.48)[-0.481]; RECEIVED_SPAMHAUS_PBL(0.00)[73.19.52.228:received]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.008]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.01)[-1.014]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::529:from]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-testing,freebsd-hackers] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2020 00:23:15 -0000 > On Oct 24, 2020, at 9:09 AM, Kyle Evans wrote: >=20 > Hello! >=20 > I've just put up for review some work I've done to allow us to write > tests in lua, primarily intended to test the lua libs we're writing. > Please feel free to add yourself or drop in for some commentary: >=20 > - https://reviews.freebsd.org/D26928 - atf-lua(1)/atf-lua(3) itself > - https://reviews.freebsd.org/D26929 - Build glue for atf-lua > - https://reviews.freebsd.org/D26930 - atf.tests.mk infrastructure for > adding tests > - https://reviews.freebsd.org/D26931 - Build glue for atf-lua tests > - https://reviews.freebsd.org/D26932 - jail(3lua) tests, as a sample >=20 > Note that D26932 has an additional hard dependency on the libjail > bindings and some additions I've made to them, notably: D26080, > D26756, and D26927. Hi Kyle, I realize that I haven=E2=80=99t been fully in the loop lately due to = time and focusing on other things, but I=E2=80=99m not fully onboard = with this approach. In particular, one of the things that jmmv was more onboard with was = limiting atf, not extending it, and I agree with his desire to not do = that. Furthermore, why isn=E2=80=99t this using the luaunit framework instead = and the support being added to kyua to support luaunit: = http://lua-users.org/wiki/UnitTesting = ? There are a ton of caveats = with ATF that I would rather not support longer than necessary and = having to teach folks how to use a homegrown test infrastructure instead = of leveraging an open source test infrastructure which is supported by = an external group. Doing the latter makes maintenance easy for us and = improves the utility of the support better. Thank you, -Enji= From owner-freebsd-testing@freebsd.org Thu Oct 29 00:43:31 2020 Return-Path: Delivered-To: freebsd-testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id B133C45410A; Thu, 29 Oct 2020 00:43:31 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CM6BC4KVjz3YMR; Thu, 29 Oct 2020 00:43:31 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-qt1-f176.google.com (mail-qt1-f176.google.com [209.85.160.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 735661D466; Thu, 29 Oct 2020 00:43:31 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-qt1-f176.google.com with SMTP id i7so882130qti.6; Wed, 28 Oct 2020 17:43:31 -0700 (PDT) X-Gm-Message-State: AOAM531i0akd20oITqNrlVwd62qh9JMMywRevMqsySo6cYPPAcHoIUB5 Fo1xV1VRICUG/FXzwIkovHF0XzI259pT4cEgpyQ= X-Google-Smtp-Source: ABdhPJzplWLEfkhjJKo3yPp6c9zZN9WiSgH+WTMjnrd6ozKttXfJwEmJfqq1o1tUnL58I26h4AxfrfIV+dVak8UbtD4= X-Received: by 2002:ac8:3975:: with SMTP id t50mr1503038qtb.53.1603932210998; Wed, 28 Oct 2020 17:43:30 -0700 (PDT) MIME-Version: 1.0 References: <0217233F-9E0D-47EC-AAAA-1C19551C2FF9@gmail.com> In-Reply-To: <0217233F-9E0D-47EC-AAAA-1C19551C2FF9@gmail.com> From: Kyle Evans Date: Wed, 28 Oct 2020 19:43:20 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Testing with lua/atf-lua reviews To: Enji Cooper Cc: freebsd-testing@freebsd.org, FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2020 00:43:31 -0000 On Wed, Oct 28, 2020 at 7:23 PM Enji Cooper wrote: > > > On Oct 24, 2020, at 9:09 AM, Kyle Evans wrote: > > Hello! > > I've just put up for review some work I've done to allow us to write > tests in lua, primarily intended to test the lua libs we're writing. > Please feel free to add yourself or drop in for some commentary: > > - https://reviews.freebsd.org/D26928 - atf-lua(1)/atf-lua(3) itself > - https://reviews.freebsd.org/D26929 - Build glue for atf-lua > - https://reviews.freebsd.org/D26930 - atf.tests.mk infrastructure for > adding tests > - https://reviews.freebsd.org/D26931 - Build glue for atf-lua tests > - https://reviews.freebsd.org/D26932 - jail(3lua) tests, as a sample > > Note that D26932 has an additional hard dependency on the libjail > bindings and some additions I've made to them, notably: D26080, > D26756, and D26927. > > > Hi Kyle, > > I realize that I haven=E2=80=99t been fully in the loop lately due to tim= e and focusing on other things, but I=E2=80=99m not fully onboard with this= approach. > > In particular, one of the things that jmmv was more onboard with was limi= ting atf, not extending it, and I agree with his desire to not do that. > Sure- > Furthermore, why isn=E2=80=99t this using the luaunit framework instead a= nd the support being added to kyua to support luaunit: http://lua-users.or= g/wiki/UnitTesting ? There are a ton of caveats with ATF that I would rathe= r not support longer than necessary and having to teach folks how to use a = homegrown test infrastructure instead of leveraging an open source test inf= rastructure which is supported by an external group. Doing the latter makes= maintenance easy for us and improves the utility of the support better. > I had actually considered this, but ruled it out due to a couple factors. The main one was that there's really no benefit with adopting yet another test framework for base -- I think we're much less likely to get people that are already familiar with luaunit contributing to our base tests than we are to get people in one of two other camps: 1. They already work with our vast array of other ATF !lua tests and would find themselves staring at a really familiar interface, or 2. They don't, they want to work on Lua stuff and Lua tests in base, then an ATF lua interface will be at least somewhat applicable to other areas of our test infrastructure I haven't dumped all that much time into this, though, so I have no problem taking another aerial glance at it. From owner-freebsd-testing@freebsd.org Thu Oct 29 01:03:12 2020 Return-Path: Delivered-To: freebsd-testing@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 7D1224543DA for ; Thu, 29 Oct 2020 01:03:12 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4CM6cw2qlFz3Z71 for ; Thu, 29 Oct 2020 01:03:12 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-qk1-f174.google.com (mail-qk1-f174.google.com [209.85.222.174]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 3A8AC1DD26 for ; Thu, 29 Oct 2020 01:03:12 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-qk1-f174.google.com with SMTP id q199so755853qke.10 for ; Wed, 28 Oct 2020 18:03:12 -0700 (PDT) X-Gm-Message-State: AOAM530T5sGAGae+boGbEzJhZeddXAhY008jeKoHpEdmTI8IOMkdKs6Y iogNL35kYQXJZY1+7gHzHvaYBZUZFyjWEZQhq5E= X-Received: by 2002:a37:6309:: with SMTP id x9mt678846qkb.493.1603933391820; Wed, 28 Oct 2020 18:03:11 -0700 (PDT) MIME-Version: 1.0 References: <0217233F-9E0D-47EC-AAAA-1C19551C2FF9@gmail.com> In-Reply-To: From: Kyle Evans Date: Wed, 28 Oct 2020 20:03:00 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Testing with lua/atf-lua reviews Cc: Enji Cooper , freebsd-testing@freebsd.org, FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Oct 2020 01:03:12 -0000 On Wed, Oct 28, 2020 at 7:43 PM Kyle Evans wrote: > > On Wed, Oct 28, 2020 at 7:23 PM Enji Cooper wrote= : > > > > > > On Oct 24, 2020, at 9:09 AM, Kyle Evans wrote: > > > > Hello! > > > > I've just put up for review some work I've done to allow us to write > > tests in lua, primarily intended to test the lua libs we're writing. > > Please feel free to add yourself or drop in for some commentary: > > > > - https://reviews.freebsd.org/D26928 - atf-lua(1)/atf-lua(3) itself > > - https://reviews.freebsd.org/D26929 - Build glue for atf-lua > > - https://reviews.freebsd.org/D26930 - atf.tests.mk infrastructure for > > adding tests > > - https://reviews.freebsd.org/D26931 - Build glue for atf-lua tests > > - https://reviews.freebsd.org/D26932 - jail(3lua) tests, as a sample > > > > Note that D26932 has an additional hard dependency on the libjail > > bindings and some additions I've made to them, notably: D26080, > > D26756, and D26927. > > > > > > Hi Kyle, > > > > I realize that I haven=E2=80=99t been fully in the loop lately due to t= ime and focusing on other things, but I=E2=80=99m not fully onboard with th= is approach. > > > > In particular, one of the things that jmmv was more onboard with was li= miting atf, not extending it, and I agree with his desire to not do that. > > > > Sure- > > > Furthermore, why isn=E2=80=99t this using the luaunit framework instead= and the support being added to kyua to support luaunit: http://lua-users.= org/wiki/UnitTesting ? There are a ton of caveats with ATF that I would rat= her not support longer than necessary and having to teach folks how to use = a homegrown test infrastructure instead of leveraging an open source test i= nfrastructure which is supported by an external group. Doing the latter mak= es maintenance easy for us and improves the utility of the support better. > > > > I had actually considered this, but ruled it out due to a couple > factors. The main one was that there's really no benefit with adopting > yet another test framework for base -- I think we're much less likely > to get people that are already familiar with luaunit contributing to > our base tests than we are to get people in one of two other camps: > > 1. They already work with our vast array of other ATF !lua tests and > would find themselves staring at a really familiar interface, or > 2. They don't, they want to work on Lua stuff and Lua tests in base, > then an ATF lua interface will be at least somewhat applicable to > other areas of our test infrastructure > > I haven't dumped all that much time into this, though, so I have no > problem taking another aerial glance at it. Oh, oh dear. luaunit already supports TAP output: https://luaunit.readthedocs.io/en/latest/#output-formats I kinda prefer the minimal verbosity text format that it defaults to, but as far as effort to get off the ground goes... that's likely impossible to beat.