From owner-freebsd-ports@freebsd.org Fri Dec 14 08:11:19 2018 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DB52E1324B05 for ; Fri, 14 Dec 2018 08:11:18 +0000 (UTC) (envelope-from koobs.freebsd@gmail.com) Received: from mail-pl1-x62d.google.com (mail-pl1-x62d.google.com [IPv6:2607:f8b0:4864:20::62d]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id DD06792372 for ; Fri, 14 Dec 2018 08:11:17 +0000 (UTC) (envelope-from koobs.freebsd@gmail.com) Received: by mail-pl1-x62d.google.com with SMTP id a14so2366592plm.12 for ; Fri, 14 Dec 2018 00:11:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:reply-to:subject:from:to:cc:references:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=5SF9MXaEyvRMQE+WdStCZjQEUG8whaevpJq33ydZkPw=; b=Mdlr/0167FODY1+04MfYhoSItJTrUaTzBqM7b2OMYvaozrHlnXpWgF27a1afUj3yJT wA8+ErtTTY0KyVts/LVrWPlNCT3yOVbzSgoWURF8YhD1uzrTNtc7tRJOAwR4SJ5BHHeB 8GsctSx8OT8uGFqTMbLe+xw/mlYI85OPVS02nJ2ko20Vsy9iIuIJxBJ6GGym2wSaHRas 7lXenwjb3sbQ+Ktj31OZiPF/nU+w+yAnvg9TQNLKvO8LEC/uXWKbaD/+UISNJT22X0Wt bJe7+0FmyhWDOnxvt/BFed2o75bgqFy40tdpQtSAVWnrO7g69gDtzkKezS1DR7WLKioO wQWQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:reply-to:subject:from:to:cc:references :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=5SF9MXaEyvRMQE+WdStCZjQEUG8whaevpJq33ydZkPw=; b=A3XPsnd7vGG8JXvWeBZmSw8L4mXXDBVBdqBlw07zjddSljMb/N4ZGZUaylmw9NgiMm wJlOyBnl7E3XGfYYeh+XJQm+YRe2WYKHVHWDHzKZdDYPTogoLzex4reGAX1oYX4BO/2M xRZ8eW7Tg+vlO8+vAEtyDp6yUHWhVQ2oOzhHf0Bce71X5j8r2D7dVDoxabsmk5KDU61x 2sTINGcUzskXwGVPEgq3GZR0EST4KrEtVXKxXlrT2IvBI0zw9859KR7vS0/5S6J+uaF2 IkqAseyH3ztWHMitRq2b3FBnFRQzcXKUHjY9/C4ZJ+UCGjBXVpdPxPZxczHYbxGASZ7V TWOQ== X-Gm-Message-State: AA+aEWYEFX89qfhJGoFrmVCBqIXsAitzpvhKOKxYfgyYe8Kol2bKZFmu euiBWsMy0duz2R3Y8f1vOtJ7sICc X-Google-Smtp-Source: AFSGD/UzgAfT9/a7+6Obe3G/KPAUtVrOXTgRxPXLprHhdD6rsU7adqOHw7hPh9xnKAIZg8R88u57TQ== X-Received: by 2002:a17:902:9b93:: with SMTP id y19mr2006772plp.336.1544775076827; Fri, 14 Dec 2018 00:11:16 -0800 (PST) Received: from [192.168.1.105] (119-18-15-55.cust.aussiebb.net. [119.18.15.55]) by smtp.gmail.com with ESMTPSA id z62sm6462543pfl.33.2018.12.14.00.11.14 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 14 Dec 2018 00:11:16 -0800 (PST) Sender: Kubilay Kocak Reply-To: koobs@FreeBSD.org Subject: Re: A potential new porter seeking some clarifications From: Kubilay Kocak To: Arthur Pirika Cc: Lars Engels , "freebsd-ports@freebsd.org" References: <5c126f7f.1c69fb81.88ea9.6a7a@mx.google.com> <20181213151151.GG37809@e.0x20.net> Message-ID: Date: Fri, 14 Dec 2018 19:11:12 +1100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:64.0) Gecko/20100101 Thunderbird/64.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: DD06792372 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=Mdlr/016; spf=pass (mx1.freebsd.org: domain of koobsfreebsd@gmail.com designates 2607:f8b0:4864:20::62d as permitted sender) smtp.mailfrom=koobsfreebsd@gmail.com X-Spamd-Result: default: False [-2.75 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; HAS_REPLYTO(0.00)[koobs@FreeBSD.org]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[gmail.com:+]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.94)[-0.942,0]; FORGED_SENDER(0.30)[koobs@FreeBSD.org,koobsfreebsd@gmail.com]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FROM_NEQ_ENVFROM(0.00)[koobs@FreeBSD.org,koobsfreebsd@gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.994,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; TAGGED_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-ports@freebsd.org]; DMARC_NA(0.00)[FreeBSD.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[d.2.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-0.60)[ipnet: 2607:f8b0::/32(-1.60), asn: 15169(-1.32), country: US(-0.09)] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 14 Dec 2018 08:11:19 -0000 On 14/12/2018 7:09 pm, Kubilay Kocak wrote: > While special targets (check-plist) can be and are useful, the only form > of QA we should be doing is 'all of it', and at the present moment, that > is: > >  1) portlint -AC (or better) >  2) poudriere testport (supported versions/archs, at least tier1 [1]) >  3) make test for run-time QA [2] I forgot: 4) DEVELOPER=yes in /etc/make.conf for extra sanity checks > > Even (1) and (2) alone, while being the making up the bulk of our QA, > which is notable not 'everything, everytime', is insufficient, as it > mostly picks up only 'our' errors, not the softwares issues, which > ultimately impact users. > > [1] non tier1 is not as trivial as it should be to setup in poudriere. > [2] if test suites exist, TEST_DEPENDS and test: target should be hooked up > > ./koobs