From owner-freebsd-testing@FreeBSD.ORG Thu May 21 06:32:57 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8EB0E1E5; Thu, 21 May 2015 06:32:57 +0000 (UTC) Received: from mail-la0-x234.google.com (mail-la0-x234.google.com [IPv6:2a00:1450:4010:c03::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E792E16C1; Thu, 21 May 2015 06:32:56 +0000 (UTC) Received: by labbd9 with SMTP id bd9so96074665lab.2; Wed, 20 May 2015 23:32:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=rtXSFNE7zUQ2BIB2XwHG1WAQTR7hropsUsFmLV4fOes=; b=GaNIa4+ReU+BOB6H77bdF8LPP88wvdtYk/0CvADaN8QXnoG9Os41V68suPNjAilfWH gRtCj4SL1mFiU+FtholDTr8TbPRUenO9Yvgd2wKtPjiyFZwsQfZivXORABv1iAdQXQOc qxDPsbtCzlC91pMaLcHmBYhBxooHgjp9PF155yVlWMjkfU9S6Qkh8xI8c5n4XwqVzu3y bo/6+DW1R9bF//TzjNOR+FqREHKsd5sVEDqAHXVRLCFGKdpQGLlrf/DHkD3vTF/g/k4H wqohEi5OIOkt9yHoiHGUcXCdfkOmAocAWNNMoAqQBbIwJsLd2Yd4EglxTmsTyaM8LrLh bHUQ== MIME-Version: 1.0 X-Received: by 10.152.22.34 with SMTP id a2mr907516laf.59.1432189974825; Wed, 20 May 2015 23:32:54 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.164.38 with HTTP; Wed, 20 May 2015 23:32:54 -0700 (PDT) In-Reply-To: <56800B8F-E49D-4B8E-B975-EB16299C0028@gmail.com> References: <56800B8F-E49D-4B8E-B975-EB16299C0028@gmail.com> Date: Wed, 20 May 2015 23:32:54 -0700 X-Google-Sender-Auth: CPSXWE4RnYyLYWFPWz6iDzlhgrk Message-ID: Subject: Re: Create freebsd-testing-results@ list for Jenkins results? From: Craig Rodrigues To: "freebsd-testing@freebsd.org" Cc: "jenkins-admin@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2015 06:32:57 -0000 Hi, Yes, I am opposed to this. The minute you push these email notifications to a separate list, then the whole utility of Jenkins goes down, because most people won't be subscribe to the list. The whole point of running a CI system like Jenkins is to unfortunately be a bit annoying and "in your face". FreeBSD doesn't have a QA department to triage failures and notify developers, so sending e-mails to targeted lists is important. As it is, FreeBSD people don't subscribe to all the same lists, so no matter what, you can't make everyone happy. At this link: https://www.freebsd.org/doc/en/books/handbook/current-stable.html it mentions that bulletins about the state of the FreeBSD-CURRENT branch go to the freebsd-current@ list. So that's why it is OK for e-mail notifications from the old Tinderbox or Jenkins to go to that list. I have received e-mails privately thanking me for setting this stuff up. Some folks (who are not FreeBSD committers) monitor lists like freebsd-current@, and when they see Jenkins failure e-mails on the list, that gives them a clue that they should hold off on updating the tree. So freebsd-current@ is used to notifiy committers *and* non-committers about the state of the branch. jenkins is already configured to send e-mails to several lists, such as freebsd-current, freebsd-stable, freebsd-doc, freebsd-i386, depending on the build job, so we don't send every e-mail to freebsd-current for all the builds that we do. So Jenkins is doing its job, even if it annoys some people and makes some people like Steve Kargl unhappy. What we can consider doing is reducing the number of lines in the e-mall notification, to prevent very large e-mails from being sent to the list. There may be tunables in Jenkins that we can look at for this. That is worth exploring. No matter what, you can't make everyone happy with build break e-mails. However, pushing them off to the side is not the direction we should be going in. -- Craig On Wed, May 20, 2015 at 10:46 PM, Garrett Cooper wrote: > Hi all, > As some know who are subscribed to freebsd-current, the list gets > spammed a lot with test results (pass/fail transitions mostly) for the > Build_Image_and_Run_Tests_in_Bhyve_HEAD job. I was wondering if anyone > would be opposed to creating another list to capture the results, e.g. > freebsd-testing-results@FreeBSD.org, and if so, would you subscribe to > the list? > Thanks! > -NGie >