From owner-freebsd-testing@FreeBSD.ORG Tue Feb 10 21:00:11 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 25CDE9A; Tue, 10 Feb 2015 21:00:11 +0000 (UTC) Received: from mail-lb0-x232.google.com (mail-lb0-x232.google.com [IPv6:2a00:1450:4010:c04::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 99DEA7BA; Tue, 10 Feb 2015 21:00:10 +0000 (UTC) Received: by mail-lb0-f178.google.com with SMTP id w7so17673863lbi.9; Tue, 10 Feb 2015 13:00:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=Cw97CE40/qVVc5yGPzQ7Eg9SODH2TBEzg/9NVEECgLY=; b=A8Nj1f7p1CDXbYCovCP5pD5LEerU+hxGN9ZuZu9kC3JI5jNvzRsGsK1M0Rej4T9UFp 9oSlMfb7yIoNk5JMNHTF9PsfX3jRaO5nRif6qTEx+MM5gg6dHBjB2qAQ4ioZpzJpIRk/ 1BEpeTgdHW1ipvdWsvZiWP+IMx3LKPL9wsSXUpBqQ+EjTySFRWtbrfFzru3/Xmab4H4S 6XgSxlpQGFTHv2ekIUJ3hXI/CVh6M92AFNuStqQddGItgKxC/qd/aIOf5wX3A/Qx689r v8Hi4BYb1vlaDEVUrFELjBZYDBPlrhVl+FL6ACvPB1fy+vL03iwfGn4gHeTgjysasbtx lwPw== MIME-Version: 1.0 X-Received: by 10.152.1.170 with SMTP id 10mr6061239lan.89.1423602008278; Tue, 10 Feb 2015 13:00:08 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.28.40 with HTTP; Tue, 10 Feb 2015 13:00:08 -0800 (PST) Date: Tue, 10 Feb 2015 13:00:08 -0800 X-Google-Sender-Auth: CJ1zjS4Om0oJB-PoSxb8WQlEbMc Message-ID: Subject: scan-build and Jenkins From: Craig Rodrigues To: Li-Wen Hsu Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Feb 2015 21:00:11 -0000 Li-Wen, Can you provide the steps you did to create a clang scan-build setup under FreeBSD? I'm interested in what you did, in order to set that up for a project at work. I noticed that there is a scan-build Jenkins plugin: https://wiki.jenkins-ci.org/display/JENKINS/Clang+Scan-Build+Plugin Right now it only supports Xcode, but someone has submitted a github PR to support the scan-build command-line ( https://github.com/jenkinsci/clang-scanbuild-plugin/pull/2 ). That plugin doesn't look actively maintained, but it might be nice to fix it up and use it. -- Craig From owner-freebsd-testing@FreeBSD.ORG Wed Feb 11 15:05:18 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3FF6E7AC; Wed, 11 Feb 2015 15:05:18 +0000 (UTC) Received: from FreeBSD.cs.nctu.edu.tw (FreeBSD.cs.nctu.edu.tw [140.113.17.209]) by mx1.freebsd.org (Postfix) with ESMTP id 0A5CFC96; Wed, 11 Feb 2015 15:05:18 +0000 (UTC) Received: by FreeBSD.cs.nctu.edu.tw (Postfix, from userid 1058) id A31752BF4; Wed, 11 Feb 2015 23:05:15 +0800 (CST) Date: Wed, 11 Feb 2015 23:05:15 +0800 From: Li-Wen Hsu To: Craig Rodrigues Subject: Re: scan-build and Jenkins Message-ID: <20150211150515.GA22751@FreeBSD.cs.nctu.edu.tw> References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2015 15:05:18 -0000 Hi, On Tue, Feb 10, 2015 at 13:00:08 -0800, Craig Rodrigues wrote: > Li-Wen, > > Can you provide the steps you did to create a clang scan-build setup > under FreeBSD? > I'm interested in what you did, in order to set that up for a project at > work. The configurations are stored by your backup magic: https://github.com/freebsd/jenkins-config/tree/master/jobs/FreeBSD_HEAD-scan-build There are some tricky points: - "Multiple SCMs" plugin is used, for check out both scan-build scripts and source being checked - scan-build is build from LLVM & Clang trunk, which are also checked out by multiple SCMs plugin and built when job triggered. This is designed by uqs@ at the beginning because we want to use the latest tool to eliminate false results. The build process is straightforward, just copying necessary files and executing scan-build: https://github.com/freebsd/jenkins-config/blob/50f1336a04b039852b73780314c3967e5d6f9b07/jobs/FreeBSD_HEAD-scan-build/config.xml#L85-L107 The scripts are stored here, they are originally developed by uqs@. https://github.com/freebsd/freebsd-ci/tree/master/scan-build Perhaps we can split this to another repository in the future. > I noticed that there is a scan-build Jenkins plugin: > > https://wiki.jenkins-ci.org/display/JENKINS/Clang+Scan-Build+Plugin > > Right now it only supports Xcode, but someone has submitted > a github PR to support the scan-build command-line ( > https://github.com/jenkinsci/clang-scanbuild-plugin/pull/2 ). > > That plugin doesn't look actively maintained, but it might be nice > to fix it up and use it. This is interesting, I also want the clang-scan build plugin can support scan-build from command-line. I hope this can help to collect and publish the results. The way we publish scan-build results is a bit dirty. Li-Wen -- Li-Wen Hsu http://lwhsu.org From owner-freebsd-testing@FreeBSD.ORG Wed Feb 11 15:48:22 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 21C49EB8; Wed, 11 Feb 2015 15:48:22 +0000 (UTC) Received: from mail-lb0-x234.google.com (mail-lb0-x234.google.com [IPv6:2a00:1450:4010:c04::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 98FCC12B; Wed, 11 Feb 2015 15:48:21 +0000 (UTC) Received: by mail-lb0-f180.google.com with SMTP id z12so3952460lbi.11; Wed, 11 Feb 2015 07:48:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=4dpjy0JZ38cK8cGDU8nXL7/PFWgC0hKGOVBusMMFkgc=; b=WBYmarmxEBj/DNXHQ2FRBG4SqglN/GUC/PeLWtl09J/qnA1jS6lpYhdFaipY3JE4k6 47xIbzLTRCvYMJtdWUMbxNtsnCVBEGhh08726kElZcFKMHw5F2yonKcn7D9RljsZREfJ LV8FKyncQXOXymiYqmi63fP3ivoXdRpMeLkthsjhe82adEtbXVjh+Spbn0/kmRhiBFEe hPqUZjQPHlGNUaa0zQZAkfFwtGs8vOd9Kiz4vAxDXh6X6RNm1i37eimJ7MPE1TaQ0KeQ xFxa136fOeKmfzZSUZNthiGcLJrnYVJg6q2opl9lXA6Cs6UIv4C0P9uzeyVPaQOKuB1y 1tWw== MIME-Version: 1.0 X-Received: by 10.152.43.18 with SMTP id s18mr28492229lal.26.1423669699682; Wed, 11 Feb 2015 07:48:19 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.28.40 with HTTP; Wed, 11 Feb 2015 07:48:19 -0800 (PST) In-Reply-To: <20150211150515.GA22751@FreeBSD.cs.nctu.edu.tw> References: <20150211150515.GA22751@FreeBSD.cs.nctu.edu.tw> Date: Wed, 11 Feb 2015 07:48:19 -0800 X-Google-Sender-Auth: U4qii6wJWwo4QaSeUrkbxsQjATs Message-ID: Subject: Re: scan-build and Jenkins From: Craig Rodrigues To: Li-Wen Hsu Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2015 15:48:22 -0000 On Wed, Feb 11, 2015 at 7:05 AM, Li-Wen Hsu wrote: > Hi, > > - "Multiple SCMs" plugin is used, for check out both scan-build scripts > and source being checked > - scan-build is build from LLVM & Clang trunk, which are also checked out > by > multiple SCMs plugin and built when job triggered. This is designed > by uqs@ at the beginning because we want to use the latest tool to > eliminate false results. > Thanks, this was the part I was not sure about. I will look at the Jenkins job to see how to build scan-build. Where did you find out the steps to build scan-build? Since you are building LLVM & Clang from trunk, does that mean you are using the trunk version of Clang to build FreeBSD as well, or do you just run scan-build to run the static analysis without building the FreeBSD source tree? -- Craig From owner-freebsd-testing@FreeBSD.ORG Wed Feb 11 16:03:44 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DBA5A535; Wed, 11 Feb 2015 16:03:44 +0000 (UTC) Received: from FreeBSD.cs.nctu.edu.tw (FreeBSD.cs.nctu.edu.tw [140.113.17.209]) by mx1.freebsd.org (Postfix) with ESMTP id A434A36F; Wed, 11 Feb 2015 16:03:44 +0000 (UTC) Received: by FreeBSD.cs.nctu.edu.tw (Postfix, from userid 1058) id DD5B92C55; Thu, 12 Feb 2015 00:03:43 +0800 (CST) Date: Thu, 12 Feb 2015 00:03:43 +0800 From: Li-Wen Hsu To: Craig Rodrigues Subject: Re: scan-build and Jenkins Message-ID: <20150211160343.GA88635@FreeBSD.cs.nctu.edu.tw> References: <20150211150515.GA22751@FreeBSD.cs.nctu.edu.tw> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2015 16:03:45 -0000 On Wed, Feb 11, 2015 at 07:48:19 -0800, Craig Rodrigues wrote: > On Wed, Feb 11, 2015 at 7:05 AM, Li-Wen Hsu wrote: > > > Hi, > > > > - "Multiple SCMs" plugin is used, for check out both scan-build scripts > > and source being checked > > - scan-build is build from LLVM & Clang trunk, which are also checked out > > by > > multiple SCMs plugin and built when job triggered. This is designed > > by uqs@ at the beginning because we want to use the latest tool to > > eliminate false results. > > > > Thanks, this was the part I was not sure about. > I will look at the Jenkins job to see how to build scan-build. > Where did you find out the steps to build scan-build? I wrote a mail to uqs and he just threw me a tarball. :) The old repository is available here: https://github.com/lwhsu/freebsd-scan-build > Since you are building LLVM & Clang from trunk, does that > mean you are using the trunk version of Clang to build FreeBSD as well, > or do you just run scan-build to run the static analysis without building > the FreeBSD source tree? scan-build is just a wrapper, see this: https://github.com/freebsd/freebsd-ci/blob/66c7b75248de37546449b9df8c4e01d239d8e0b3/scan-build/scan-world#L45-L46 Li-Wen -- Li-Wen Hsu http://lwhsu.org From owner-freebsd-testing@FreeBSD.ORG Wed Feb 11 21:17:07 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A074A4EC; Wed, 11 Feb 2015 21:17:07 +0000 (UTC) Received: from mail-la0-f53.google.com (mail-la0-f53.google.com [209.85.215.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BFD2E9F; Wed, 11 Feb 2015 21:17:07 +0000 (UTC) Received: by labhz20 with SMTP id hz20so6066818lab.0; Wed, 11 Feb 2015 13:17:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:cc:content-type; bh=yUpFR5WUla835/Fm8Ed6khbNk5JO+fDw3+/EGxt1vE0=; b=Wad17CY3HdtiNLF4cYKV+CUJjSyc18/6BtuP8CNo/4TY6YsqyKvreD69JDa006omjQ Tsj6a6VcTl4XKzZSHj6pGsBWEjfi+FEBDtKfzuaCJDU5bbUHJn5imlTEdCytLxwkPfS7 HOT/di93jca0JfXxWbj1I0ySY4uJV6p3ZsEgYH6Up2jK2Ci7hLHBHtRT/TaGwP64790V Sv2/c5Jl4aqohYLI5V5bl3acduUKZNMqs57b4n9OvL/avlWFoam6e4N7rOAkWZ6N+AKU hu5JsuF9rfOn85JwGvzVDRllfDkWyfN84z08I8VwENbNqaIxMS0Jsa1mEC64xlCKXDcw LC7A== MIME-Version: 1.0 X-Received: by 10.112.126.98 with SMTP id mx2mr522112lbb.84.1423689425042; Wed, 11 Feb 2015 13:17:05 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.28.40 with HTTP; Wed, 11 Feb 2015 13:17:04 -0800 (PST) Date: Wed, 11 Feb 2015 13:17:04 -0800 X-Google-Sender-Auth: dqDFKjiRmqrK8NDUgeBWdhn9PcI Message-ID: Subject: clang and scanbuild From: Craig Rodrigues To: "freebsd-testing@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: freebsd-toolchain@freebsd.org X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2015 21:17:07 -0000 Hi, We currently have a Jenkins job which checks out llvm trunk and builds it like this: svn co http://llvm.org/svn/llvm-project/llvm/trunk llvm cd llvm ./configure --enable-optimized --disable-assertions --disable-docs --enable-targets=host \ --with-c-include-dirs=${WORKDIR}/obj${WORKDIR}/src/tmp/usr/include \ --with-cxx-include-root=${WORKDIR}/obj${WORKDIR}/src/tmp/usr/include gmake -j4 cp -p ./tools/clang/tools/scan-build/scan-build \ ./tools/clang/tools/scan-build/scanview.css \ ./tools/clang/tools/scan-build/sorttable.js \ Release/bin cp -p ./tools/clang/tools/scan-build/ccc-analyzer \ ./tools/clang/tools/scan-build/c++-analyzer \ Release/bin We then do this to invoke scan-build over the FreeBSD tree: /usr/bin/time -l \ env CCC_ANALYZER_CHECKER_DEADCODE=0 \ ${SCAN_BUILD} \ --use-cc ${OBJ}${SRCDIR}/tmp/usr/bin/cc \ --use-c++ ${OBJ}${SRCDIR}/tmp/usr/bin/c++ \ -k -o $output make ${JFLAG} $MYFLAGS \ CROSS_COMPILER_PREFIX=${OBJ}${SRCDIR}/tmp/usr/bin/ "$@" We can continue to do this, but I was wondering if: (1) is there a FreeBSD port which has this stuff? (2) is there enough llvm source in FreeBSD that we can build this in FreeBSD instead of checking out llvm source? -- Craig From owner-freebsd-testing@FreeBSD.ORG Wed Feb 11 21:43:17 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 637748E8; Wed, 11 Feb 2015 21:43:17 +0000 (UTC) Received: from tensor.andric.com (unknown [IPv6:2001:7b8:3a7:1:2d0:b7ff:fea0:8c26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tensor.andric.com", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1C39F184; Wed, 11 Feb 2015 21:43:17 +0000 (UTC) Received: from [IPv6:2001:7b8:3a7::9dec:c6e6:fdea:aaa9] (unknown [IPv6:2001:7b8:3a7:0:9dec:c6e6:fdea:aaa9]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 8DC595C2E; Wed, 11 Feb 2015 22:43:12 +0100 (CET) Subject: Re: clang and scanbuild Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2070.6\)) Content-Type: multipart/signed; boundary="Apple-Mail=_79B07EDB-D1FD-44AA-A02E-92B5BDCE6843"; protocol="application/pgp-signature"; micalg=pgp-sha1 X-Pgp-Agent: GPGMail 2.5b5 (769970b) From: Dimitry Andric In-Reply-To: Date: Wed, 11 Feb 2015 22:43:07 +0100 Message-Id: <08E18A70-59E0-441D-A705-0F3F3B7B9998@FreeBSD.org> References: To: Craig Rodrigues X-Mailer: Apple Mail (2.2070.6) Cc: "freebsd-testing@freebsd.org" , freebsd-toolchain@freebsd.org X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Feb 2015 21:43:17 -0000 --Apple-Mail=_79B07EDB-D1FD-44AA-A02E-92B5BDCE6843 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=us-ascii On 11 Feb 2015, at 22:17, Craig Rodrigues wrote: > > We currently have a Jenkins job which checks out llvm trunk and builds > it like this: > > svn co http://llvm.org/svn/llvm-project/llvm/trunk llvm > cd llvm > ./configure --enable-optimized --disable-assertions --disable-docs > --enable-targets=host \ > --with-c-include-dirs=${WORKDIR}/obj${WORKDIR}/src/tmp/usr/include \ > --with-cxx-include-root=${WORKDIR}/obj${WORKDIR}/src/tmp/usr/include > > gmake -j4 > > cp -p ./tools/clang/tools/scan-build/scan-build \ > ./tools/clang/tools/scan-build/scanview.css \ > ./tools/clang/tools/scan-build/sorttable.js \ > Release/bin > > cp -p ./tools/clang/tools/scan-build/ccc-analyzer \ > ./tools/clang/tools/scan-build/c++-analyzer \ > Release/bin > > We then do this to invoke scan-build over the FreeBSD tree: > > /usr/bin/time -l \ > env CCC_ANALYZER_CHECKER_DEADCODE=0 \ > ${SCAN_BUILD} \ > --use-cc ${OBJ}${SRCDIR}/tmp/usr/bin/cc \ > --use-c++ ${OBJ}${SRCDIR}/tmp/usr/bin/c++ \ > -k -o $output make ${JFLAG} $MYFLAGS \ > CROSS_COMPILER_PREFIX=${OBJ}${SRCDIR}/tmp/usr/bin/ "$@" > > > We can continue to do this, but I was wondering if: > (1) is there a FreeBSD port which has this stuff? Yes, choose either lang/clang-devel, or lang/clangXY, where XY is the version you are interested in. > (2) is there enough llvm source in FreeBSD that we can build this in > FreeBSD instead of checking out llvm source? You can already run the analyzers with the clang executable in base, unless you built your world using WITHOUT_CLANG_FULL. You do need perl installed, of course. -Dimitry --Apple-Mail=_79B07EDB-D1FD-44AA-A02E-92B5BDCE6843 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.26 iEYEARECAAYFAlTbzO8ACgkQsF6jCi4glqNQggCfTqmQOW91hK7rYwSmS9V17S5k ej8AoLq0QwUcWLKAiZCpcRqsFThKA39Z =YF3t -----END PGP SIGNATURE----- --Apple-Mail=_79B07EDB-D1FD-44AA-A02E-92B5BDCE6843-- From owner-freebsd-testing@FreeBSD.ORG Thu Feb 12 02:42:58 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E544DCCD for ; Thu, 12 Feb 2015 02:42:57 +0000 (UTC) Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by mx1.freebsd.org (Postfix) with SMTP id 92E0035D for ; Thu, 12 Feb 2015 02:42:56 +0000 (UTC) Received: (qmail 58170 invoked by uid 99); 12 Feb 2015 02:42:55 -0000 Received: from mail-relay.apache.org (HELO mail-relay.apache.org) (140.211.11.15) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Feb 2015 02:42:55 +0000 Received: from [192.168.0.103] (unknown [190.157.136.22]) by mail-relay.apache.org (ASF Mail Server at mail-relay.apache.org) with ESMTPSA id 4BC8C1A0041 for ; Thu, 12 Feb 2015 02:42:54 +0000 (UTC) From: Pedro Giffuni Subject: Coverity and jenkins Message-Id: <2DA5B479-3B44-4B51-84B3-54C43248A038@freebsd.org> Date: Wed, 11 Feb 2015 21:42:51 -0500 To: freebsd-testing@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2070.6\)) X-Mailer: Apple Mail (2.2070.6) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Feb 2015 02:42:58 -0000 Hello; I have been looking at how Coverity works and apparently there is a = bunch of features that we are not using. - it looks like one can define tests and the Coverity test advisor will = check if the code that was recently changed is exercised by some test. - Coverity will also know who committed the code and send the new = warnings directly to the committer. It would be interesting to check the Jenkins coverity plugin: https://wiki.jenkins-ci.org/display/JENKINS/Coverity+Plugin = While here, we should also run builds on i386 as that should have good = performance and should point out portability issues .. I would think = it=E2=80=99s just a matter of using the same bhyve configuration on an = i386 image (I know =E2=80=A6 probably easier said than done ;) ). In any case, huge thanks for keeping jenkins running! Pedro. From owner-freebsd-testing@FreeBSD.ORG Fri Feb 13 20:42:25 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 02DDA4E2 for ; Fri, 13 Feb 2015 20:42:25 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DCE608A9 for ; Fri, 13 Feb 2015 20:42:24 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t1DKgOdM099338 for ; Fri, 13 Feb 2015 20:42:24 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 197600] lib.libc.sys.poll_test:poll_3way timed out Date: Fri, 13 Feb 2015 20:42:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ngie@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Feb 2015 20:42:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197600 Bug ID: 197600 Summary: lib.libc.sys.poll_test:poll_3way timed out Product: Base System Version: 11.0-CURRENT Hardware: Any OS: Any Status: New Severity: Affects Some People Priority: --- Component: tests Assignee: freebsd-testing@freebsd.org Reporter: ngie@FreeBSD.org From https://jenkins.freebsd.org/job/FreeBSD_HEAD-tests2/689/testReport/junit/lib.libc.sys/poll_test/poll_3way/ : Error Message Test case body timed out Standard Error Test case metadata ------------------ allowed_architectures is empty allowed_platforms is empty description = Check for 3-way collision for descriptor. First child comes and polls on descriptor, second child comes and polls, first child times out and exits, third child comes and polls. When the wakeup event happens, the two remaining children should both be awaken. (kern/17517) has_cleanup = false required_configs is empty required_disk_space = 0 required_files is empty required_memory = 0 required_programs is empty required_user is empty timeout = 15 Original stderr --------------- Subprocess timed out; sending KILL signal... -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Fri Feb 13 20:42:31 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BD3FB4FB for ; Fri, 13 Feb 2015 20:42:31 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A330A8AA for ; Fri, 13 Feb 2015 20:42:31 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t1DKgV9E099381 for ; Fri, 13 Feb 2015 20:42:31 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 197600] lib.libc.sys.poll_test:poll_3way timed out Date: Fri, 13 Feb 2015 20:42:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ngie@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: ngie@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Feb 2015 20:42:31 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197600 Garrett Cooper,425-314-3911 changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|freebsd-testing@freebsd.org |ngie@FreeBSD.org -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 06:52:36 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C2DF4574 for ; Sat, 14 Feb 2015 06:52:36 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A90C39C8 for ; Sat, 14 Feb 2015 06:52:36 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t1E6qauI002566 for ; Sat, 14 Feb 2015 06:52:36 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 197612] usr.sbin.pw.pw_usernext:usernext* tests are broken (but pass sometimes...?) Date: Sat, 14 Feb 2015 06:52:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ngie@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 06:52:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197612 Bug ID: 197612 Summary: usr.sbin.pw.pw_usernext:usernext* tests are broken (but pass sometimes...?) Product: Base System Version: 11.0-CURRENT Hardware: Any OS: Any Status: New Severity: Affects Some People Priority: --- Component: tests Assignee: freebsd-testing@freebsd.org Reporter: ngie@FreeBSD.org - https://jenkins.freebsd.org/job/FreeBSD_HEAD-tests2/683/testReport/junit/usr.sbin.pw/pw_usernext/usernext/ - https://jenkins.freebsd.org/job/FreeBSD_HEAD-tests2/687/testReport/usr.sbin.pw/pw_usernext/usernext_assigned_group/ - :usernext_assigned_group has a dangling curly bracket, that appears to only fail part of the time. - The tests have some questionable assumptions about available GIDs, that might fail if the default available GID wasn't 1001. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 07:23:25 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 5F182D4D for ; Sat, 14 Feb 2015 07:23:25 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 41FA1C61 for ; Sat, 14 Feb 2015 07:23:25 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t1E7NPAb074623 for ; Sat, 14 Feb 2015 07:23:25 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 197060] Test failure: local.atf.atf-sh.atf_check_test.flush_stdout_on_timeout Date: Sat, 14 Feb 2015 07:23:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: ngie@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 07:23:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197060 --- Comment #2 from Garrett Cooper,425-314-3911 --- Pull request opened upstream to raise the timeout from 1 to 5 seconds when waiting for the command to fully form: https://github.com/jmmv/atf/pull/21 . -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 11:15:06 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 78BC48C3 for ; Sat, 14 Feb 2015 11:15:06 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5EC96288 for ; Sat, 14 Feb 2015 11:15:06 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t1EBF6VE037574 for ; Sat, 14 Feb 2015 11:15:06 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 197612] usr.sbin.pw.pw_usernext:usernext* tests are broken (but pass sometimes...?) Date: Sat, 14 Feb 2015 11:15:06 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: oneil.rs@gmail.com X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 11:15:06 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197612 oneil.rs@gmail.com changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |oneil.rs@gmail.com --- Comment #1 from oneil.rs@gmail.com --- Created attachment 152966 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=152966&action=edit gets rid of the misplaced closing curly bracket The test creates a ghost environment where the base user id is 1001. So that aspect should be a non issue. This should resolve the errors that are occurring related to the invalid curly bracket. -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 15:32:16 2015 Return-Path: Delivered-To: freebsd-testing@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BDDC3815 for ; Sat, 14 Feb 2015 15:32:16 +0000 (UTC) Received: from wonkity.com (wonkity.com [67.158.26.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "wonkity.com", Issuer "wonkity.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 6C4A4D67 for ; Sat, 14 Feb 2015 15:32:12 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.9/8.14.9) with ESMTP id t1EFW4jU070910 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Sat, 14 Feb 2015 08:32:04 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.9/8.14.9/Submit) with ESMTP id t1EFW4DC070907 for ; Sat, 14 Feb 2015 08:32:04 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Sat, 14 Feb 2015 08:32:04 -0700 (MST) From: Warren Block To: freebsd-testing@FreeBSD.org Subject: Doc tests: extra /head in links Message-ID: User-Agent: Alpine 2.11 (BSF 23 2013-08-11) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (wonkity.com [127.0.0.1]); Sat, 14 Feb 2015 08:32:04 -0700 (MST) X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 15:32:16 -0000 On https://jenkins.freebsd.org/job/FreeBSD_DOC/1023/changes The "Path in Repository" and "(diff)" links have a repeated "/head". So the first is http://svnweb.freebsd.org/doc/head/head/en_US.ISO8859-1/books/porters-handbook/versions/chapter.xml but should be http://svnweb.freebsd.org/doc/head/en_US.ISO8859-1/books/porters-handbook/versions/chapter.xml I can enter a PR for this if that is preferred. Thanks! From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 18:23:23 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C9F276B1 for ; Sat, 14 Feb 2015 18:23:23 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AFE61326 for ; Sat, 14 Feb 2015 18:23:23 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t1EINNVJ045670 for ; Sat, 14 Feb 2015 18:23:23 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 197612] usr.sbin.pw.pw_usernext:usernext* tests are broken (but pass sometimes...?) Date: Sat, 14 Feb 2015 18:23:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 18:23:23 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197612 --- Comment #2 from commit-hook@freebsd.org --- A commit references this bug: Author: brd Date: Sat Feb 14 18:22:32 UTC 2015 New revision: 278767 URL: https://svnweb.freebsd.org/changeset/base/278767 Log: Remove an extra curly bracket that was causing intermittent failures. PR: 197612 Submitted by: Robert O'Niel Approved by: will Changes: head/usr.sbin/pw/tests/pw_usernext.sh -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 18:27:48 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8FA8A750 for ; Sat, 14 Feb 2015 18:27:48 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7574934E for ; Sat, 14 Feb 2015 18:27:48 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id t1EIRmCP046926 for ; Sat, 14 Feb 2015 18:27:48 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 197612] usr.sbin.pw.pw_usernext:usernext* tests are broken (but pass sometimes...?) Date: Sat, 14 Feb 2015 18:27:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: tests X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: brd@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 18:27:48 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197612 Brad Davis changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|New |Closed --- Comment #3 from Brad Davis --- Committed, thanks! -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 18:43:17 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E18F5F8B for ; Sat, 14 Feb 2015 18:43:17 +0000 (UTC) Received: from mail-pd0-f171.google.com (mail-pd0-f171.google.com [209.85.192.171]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B5099758 for ; Sat, 14 Feb 2015 18:43:17 +0000 (UTC) Received: by pdbfl12 with SMTP id fl12so26142628pdb.4 for ; Sat, 14 Feb 2015 10:43:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:from:subject:date:to; bh=q9i2lJcXg7fyVorGDHkIP1m08NZ3ocUWz9HPkYm1t68=; b=THqWt/bwcK7R5+mPIr+aV2ZrL4wjijuZ6M8/ZA1JZssl5nJMgDcO1F7prhO/QEHlHj apj0rx0Lwz77Y2rX+7JI+txkV4PjXRWKvhWr5k+p1jtE+h2vVd/wAAhplgVf5lE0HwKN LgwnBUvSGdQR05tzf/G0LgWr9VhiOviAPBqShHKSuHjyX9uqNxV5mhHXxTR36aQ2cL+h HL5wgHnAR+5NnNIegqlqtGkbG/OWK3EJwG1sad6dmir+46jckcuZUWvvQFGhJgo5+uL3 4NYc2BsiVgrnuMcp5l3Cf3WpqYntPy2FmbmSA0PD748iIkaogGAxdxrm8jIEAxbQ7T6A zpXA== X-Received: by 10.68.237.2 with SMTP id uy2mr25637379pbc.72.1423939391178; Sat, 14 Feb 2015 10:43:11 -0800 (PST) Received: from ?IPv6:2601:8:ab80:7d6:2186:c3a2:e16a:bee1? ([2601:8:ab80:7d6:2186:c3a2:e16a:bee1]) by mx.google.com with ESMTPSA id f8sm7308245pdm.68.2015.02.14.10.43.10 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Sat, 14 Feb 2015 10:43:10 -0800 (PST) References: Mime-Version: 1.0 (1.0) In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: <822EB8A5-2DC6-408B-B7BF-DD301901D65C@gmail.com> X-Mailer: iPhone Mail (12B466) From: Garrett Cooper Subject: Re: Doc tests: extra /head in links Date: Sat, 14 Feb 2015 10:43:10 -0800 To: Warren Block Cc: "freebsd-testing@FreeBSD.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 18:43:18 -0000 > On Feb 14, 2015, at 07:32, Warren Block wrote: >=20 > On https://jenkins.freebsd.org/job/FreeBSD_DOC/1023/changes >=20 > The "Path in Repository" and "(diff)" links have a repeated "/head". So th= e first is >=20 > http://svnweb.freebsd.org/doc/head/head/en_US.ISO8859-1/books/porters-hand= book/versions/chapter.xml >=20 > but should be >=20 > http://svnweb.freebsd.org/doc/head/en_US.ISO8859-1/books/porters-handbook/= versions/chapter.xml >=20 > I can enter a PR for this if that is preferred. Thanks! Please do. Thanks :)..= From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 21:57:46 2015 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9C640225; Sat, 14 Feb 2015 21:57:46 +0000 (UTC) Received: from mail-pd0-f176.google.com (mail-pd0-f176.google.com [209.85.192.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6D153BE0; Sat, 14 Feb 2015 21:57:46 +0000 (UTC) Received: by pdev10 with SMTP id v10so26682688pde.7; Sat, 14 Feb 2015 13:57:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=D5ehDf7qjXNqUmbGvunj7dClD6kNzH6KrgqnvyWS1cM=; b=ykNPYMgzWWPpjIBPCnWY+tfriqFvrccBAc61oBI0q2SPOZc4F8pyXhb8blNUFxJpnJ 0lDEPQFK/luYKgO1krpMJVaxk0T7vCWFpqg6AKR9JSISOs+noxmhlJSTQb0nkl+gnRxz 1BO+7Ya/GiPtBqeNyHsVI2OC+Lv2F9Eh2gI1EixoUn6Ypq4tHWBaMthXCSTI61J5tqjW zHJdv2aIysJgW8bm4E4XLVgj1NF5BoDG4C8m0HN4Ckg8tJ3tNgJQSwLLuKJQw82nU7nq mtFDQsHJzIWZrDXVEuy0bTmtXU4jbjkfg4bpJcQnu16JMAsAcwXADEMRzs8wa5oFq53E Tyqw== X-Received: by 10.68.134.228 with SMTP id pn4mr234516pbb.31.1423951059395; Sat, 14 Feb 2015 13:57:39 -0800 (PST) Received: from rodrigc-laptop1 (c-24-6-186-207.hsd1.ca.comcast.net. [24.6.186.207]) by mx.google.com with ESMTPSA id w17sm10305313pdj.83.2015.02.14.13.57.36 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sat, 14 Feb 2015 13:57:37 -0800 (PST) Sender: Craig Rodrigues Date: Sat, 14 Feb 2015 13:57:50 -0800 From: Craig Rodrigues To: Alan Somers Subject: Re: Python unittest backend for Kyua Message-ID: <20150214215750.GA5065@rodrigc-laptop1> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="fUYQa+Pmc3FrFX/N" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.23 (2014-03-12) Cc: freebsd-testing@freebsd.org X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 21:57:46 -0000 --fUYQa+Pmc3FrFX/N Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Nov 26, 2013 at 09:47:29PM -0700, Alan Somers wrote: > I wrote a Kyua backend for Python programs that use the unittest > module from the standard library. It's incomplete (no man page, no > tests, no test case isolation, and no tested version of python other > than 2.7), but I'm posting it to discuss the approach. Do you think > it's a good start? >=20 > Rather than use unittest's CLI, I wrote the backend to dynamically > load the file under test and interrogate the test using unittest as a > library. This allowed more intimate access. For example, the > unittest CLI doesn't have a "list" command, but the backend can still > list tests. >=20 > Does it look good so far? >=20 > -Alan Alan, I saw this post of yours from a while back. I was just wondering, how far did you get with it? Do you use it in your company? I looked at three Python testing frameworks: (1) unittest https://docs.python.org/2/library/unittest.html (2) nose https://nose.readthedocs.org (3) pytest http://pytest.org I found that pytest was the easiest to set up and did what I needed: -> test discovery -> generate XML test result output compatible with Jenkins -> tests do not need to inherit from any base classes, and just requires a file with "test_*" methods The test discovery makes it somewhat "kyua-like". Do you have any opions/experience with this? My experience is that running the FreeBSD tests in kyua work great. However, for a full product, I've had a really hard time getting QA people to be able to get comfortable writing new ATF tests and Kyuafiles. I've had less problems withe the Python frameworks. -- Craig=20 --fUYQa+Pmc3FrFX/N Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlTfxN4ACgkQ0gqKKjmYR53a/QCgiJc0f3SrlB5FJ3JM/5DCFQDM z/kAoJwiTdg1v5DAnCA7eA/MDpjI3FQL =Ftmb -----END PGP SIGNATURE----- --fUYQa+Pmc3FrFX/N-- From owner-freebsd-testing@FreeBSD.ORG Sat Feb 14 22:11:03 2015 Return-Path: Delivered-To: freebsd-testing@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 039EA3B9 for ; Sat, 14 Feb 2015 22:11:03 +0000 (UTC) Received: from wonkity.com (wonkity.com [67.158.26.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "wonkity.com", Issuer "wonkity.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 9ABE2D5C for ; Sat, 14 Feb 2015 22:11:02 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.9/8.14.9) with ESMTP id t1EMB0kA068300 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 14 Feb 2015 15:11:00 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.9/8.14.9/Submit) with ESMTP id t1EMB0fq068297; Sat, 14 Feb 2015 15:11:00 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Sat, 14 Feb 2015 15:11:00 -0700 (MST) From: Warren Block To: Garrett Cooper Subject: Re: Doc tests: extra /head in links In-Reply-To: <822EB8A5-2DC6-408B-B7BF-DD301901D65C@gmail.com> Message-ID: References: <822EB8A5-2DC6-408B-B7BF-DD301901D65C@gmail.com> User-Agent: Alpine 2.11 (BSF 23 2013-08-11) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (wonkity.com [127.0.0.1]); Sat, 14 Feb 2015 15:11:00 -0700 (MST) Cc: "freebsd-testing@FreeBSD.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Feb 2015 22:11:03 -0000 On Sat, 14 Feb 2015, Garrett Cooper wrote: > >> On Feb 14, 2015, at 07:32, Warren Block wrote: >> >> On https://jenkins.freebsd.org/job/FreeBSD_DOC/1023/changes >> >> The "Path in Repository" and "(diff)" links have a repeated "/head". So the first is >> >> http://svnweb.freebsd.org/doc/head/head/en_US.ISO8859-1/books/porters-handbook/versions/chapter.xml >> >> but should be >> >> http://svnweb.freebsd.org/doc/head/en_US.ISO8859-1/books/porters-handbook/versions/chapter.xml >> >> I can enter a PR for this if that is preferred. Thanks! > > Please do. > Thanks :).. Done: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=197666