From owner-freebsd-git@freebsd.org Tue Aug 18 01:19:51 2020 Return-Path: Delivered-To: freebsd-git@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D5EF73A88E4 for ; Tue, 18 Aug 2020 01:19:51 +0000 (UTC) (envelope-from dan@langille.org) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BVtPL3PBkz4VwZ for ; Tue, 18 Aug 2020 01:19:50 +0000 (UTC) (envelope-from dan@langille.org) Received: from compute2.internal (compute2.nyi.internal [10.202.2.42]) by mailout.west.internal (Postfix) with ESMTP id D3F22A05 for ; Mon, 17 Aug 2020 21:19:47 -0400 (EDT) Received: from imap36 ([10.202.2.86]) by compute2.internal (MEProxy); Mon, 17 Aug 2020 21:19:47 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=langille.org; h= mime-version:message-id:date:from:to:subject:content-type; s= fm2; bh=KS/REdPmXAf4TQkA8wAP+XUvEp773doQhNR1Gztw4PU=; b=EpG8pUHs BPPBODwiYPm9eLcK4QAZeE53/ii0jc/URB9LBuG088qEbz2wwRKUmYw7SWtDuzM6 WgGZwKTwMNWrkCL71RDBmvhBdntKkKtQpNvqaeAWADykRMU3zXktqMoURlm0RYeT QXKMrEYmJjY/RAlAI24t0qjd1vfF66P6J93jiWqldgMh2CpTZE1xFEuZZOB4+fZc r5JMHHm0QaNAwsK3DZCMMNpYf/heAvziow7KiNhjrrFgFUVaPiwsQq5QhJzGH6k9 ILuMqUaZ8Tl31s2k4e8RhxUrFZajblMd/MZFV0oTQnCnFnuQzWXNDVmiyFVfz163 xeApQ6w2vIofmQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=KS/REdPmXAf4TQkA8wAP+XUvEp773 doQhNR1Gztw4PU=; b=hupTcdoBCOB59tnUk7crqGZ/3iEQRSEI23xzKbFJDaYLs Y5ze3hiO4+r4diT+4oq+ooLgsMtXczVMDkuC0pSZ2Q/8kczdhD2ifmgYO//Hr10z rQh2ep2oMU5cNwFCOhkkcHoCyCroLuhrAEZdoZI2f+mWEe7LmoqTN5KAwE9dTmvE lnp7/7DRD9B/GIwvBjseo7OmTNI4r8RiQF7pkIM9qRo58b09jjxZ3BpewsUtrgCw QBf62HLee3GBnkqNfNrRk5L+DMlXXdQ2UvfTycADvSp9uScw3Glwp//GkEnScVRQ szp8y2we9qnBnV6yHbtlxR6aKgXSy+9bnQciomk2A== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedruddthedggeefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefofgggkfffhffvufgtsehttdertd erredtnecuhfhrohhmpedfffgrnhcunfgrnhhgihhllhgvfdcuoegurghnsehlrghnghhi lhhlvgdrohhrgheqnecuggftrfgrthhtvghrnhepffdtuddtleejfefgvdeuteevkeettd eihedufffggeethedvudehfeehvefhveetnecuffhomhgrihhnpehfrhgvshhhphhorhht shdrohhrghdpghhithhhuhgsrdgtohhmnecuvehluhhsthgvrhfuihiivgeptdenucfrrg hrrghmpehmrghilhhfrhhomhepuggrnheslhgrnhhgihhllhgvrdhorhhg X-ME-Proxy: Received: by mailuser.nyi.internal (Postfix, from userid 501) id 28CFF188011B; Mon, 17 Aug 2020 21:19:47 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface User-Agent: Cyrus-JMAP/3.3.0-192-gd9d7a78-fm-20200816.001-gd9d7a786 Mime-Version: 1.0 Message-Id: Date: Mon, 17 Aug 2020 21:19:26 -0400 From: "Dan Langille" To: freebsd-git@freebsd.org Subject: FreshPorts & src commits to branches Content-Type: text/plain ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1597713591; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: dkim-signature; bh=KS/REdPmXAf4TQkA8wAP+XUvEp773doQhNR1Gztw4PU=; b=vwHWlAXbJi5qnHTs7f7jC0Nx588OpiEr7NQuch8e02U9BQREFLYNZgFbf419l47DhSXY/l zgOLDVBE7lji5kzMZ6V10yXgHrP6bMRKt5yGqYwr6EfucmFh3dTa2oI3WTdfr3ZZhX2s9k LXJS7pYVziIWJuwznBxhhLR0+6q93zchvEu/4m84Ije8GTGIhX7qdUFwa4YjL5xTs9VgzK 4IgFqzL1qDgwvaZex1lodtCD47vVIaNgZspsgTG+jeuKf/PWh1rpCP1TeHyN03yj0w/D0J M3SLcDD/WmlajoizV8itvbSswthRkjn5BunPORF3UmYigDQWic9ovYtiIbrIyA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1597713591; a=rsa-sha256; cv=none; b=eBKRhL2GQnxmPPV9PuduXQAlZUdTjRTPixmcGVq/oFo7ehurxbhzHUYc/psn9vwsIHkfCi xWr1oGIxg42EYYqakVit8lA0KgNNNZrQhlQGZDDZjqqUY8DWumfeWEEpQT/NF4isQyIvKO BzRX+iKBSay98hPhHfdtPS3gZDau7VWTQHFMzsTnzuED0+CnQYIufvCfo9iOZUoiIhSS30 FputxhNQUqT2ri8soEEsWajpss4XSy4x8XSOMTUQ/JTubUVQbEwk8GbYTpthxd2nM+hHxL 7D01Jn9qZbtqev/Oh9hwWOzLDyQiQCgpmEK8ElzvZsvf7cBztI0xiqdgg2Mj1w== ARC-Authentication-Results: i=1; mx1.freebsd.org; dkim=pass header.d=langille.org header.s=fm2 header.b=EpG8pUHs; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=hupTcdoB; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 64.147.123.19 as permitted sender) smtp.mailfrom=dan@langille.org X-Rspamd-Queue-Id: 4BVtPL3PBkz4VwZ X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=langille.org header.s=fm2 header.b=EpG8pUHs; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=hupTcdoB; dmarc=pass (policy=none) header.from=langille.org; spf=pass (mx1.freebsd.org: domain of dan@langille.org designates 64.147.123.19 as permitted sender) smtp.mailfrom=dan@langille.org X-Spamd-Result: default: False [-2.73 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[langille.org:s=fm2,messagingengine.com:s=fm3]; XM_UA_NO_VERSION(0.01)[]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[64.147.123.19:from]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-git@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.02)[-1.024]; RCVD_COUNT_THREE(0.00)[4]; ARC_SIGNED(0.00)[i=1]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19]; DKIM_TRACE(0.00)[langille.org:+,messagingengine.com:+]; DMARC_POLICY_ALLOW(-0.50)[langille.org,none]; NEURAL_HAM_SHORT(-0.62)[-0.620]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; MID_RHS_WWW(0.50)[]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from] X-BeenThere: freebsd-git@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussion of git use in the FreeBSD project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Aug 2020 01:19:51 -0000 Hello, I am quickly realizing that in order for FreshPorts to track src commits it needs to query every branch. There does not seem to be any other way to know that a commit ocurred on stable/12 without a checkout of stable/12 On that note, I'm not sure how far to go back. I see MFH commits into stable7, 8, 9, and 10. Is there a way to know a commit has occurred without having looking at the branch? Yes, use the GitHub API. I have been able to pull that information out, we can get the commit hash, but not the branch name. Regardless, I am hesitant to tie FreshPorts into Github, especially for its vital data: commits. How about those emails? Can we get the commit emails up and running for git? With an email, we can see a commit occurred on stable/7, we have the commit hash. Do we have stable/7 checked out? No, we can checkout that branch and use it. Similarly, a commit hook which passed along the commit hash and the branch, that would be enough. Actually, having both the emails and the commit hook would cover the bases well. For those unaware, FreshPorts has been using commit emails as its primary data point for 20 years.[1] Code has been developed to harvest commit information from git[2]. Knowing the commit hash, we can grab the data, convert it to XML, and load it into the database. But only if we also know the branch. [1] - https://docs.freshports.org/sample_message.1 [2] -https://github.com/FreshPorts/git_proc_commit/blob/master/git-to-freshports/git-to-freshports-xml.py -- Dan Langille dan@langille.org