From owner-freebsd-testing@FreeBSD.ORG Sun Nov 23 00:29:12 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id A8463EDC for ; Sun, 23 Nov 2014 00:29:12 +0000 (UTC) Received: from mail-lb0-x231.google.com (mail-lb0-x231.google.com [IPv6:2a00:1450:4010:c04::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 28DBA911 for ; Sun, 23 Nov 2014 00:29:12 +0000 (UTC) Received: by mail-lb0-f177.google.com with SMTP id 10so2908475lbg.22 for ; Sat, 22 Nov 2014 16:29:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=Jk0J5mGRnT785LHv8N7/7YWeJ4KffuCOVhDMDmPCz4o=; b=ayVXQo7YtQep5gSUIS3weEgnqUQ20pSeyiGz/KZxHzLmEz7ZxhmV2tiwqjdH7amMVo PR6zUdP2eByXZbhL4ZXuYPrHeAvHUpIyjBrEXXB5LSX6Aj3gMzo6J0fsZQoP9Vww8sXi GvEbSHSnBKmfjRM4KcyLgxpLvYTEW9cHLFWtE9iGZCBLesrnR+sZMQ4Jpgsyhk8WXdcU HSTq3Fzo8qPzaUJMst1/TOrLJWKQCx07TXbIj0xQgpV0auphgqW7+DLy8hfp5P996UkO 5MG8o2IrTJGBdf55vtFJ6xqPHESQJ9vqeUaFTvD7vPQUkTvfeZHNxn5jTxtArUZbRX69 KKxA== MIME-Version: 1.0 X-Received: by 10.112.201.226 with SMTP id kd2mr2089344lbc.98.1416702550246; Sat, 22 Nov 2014 16:29:10 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.130.168 with HTTP; Sat, 22 Nov 2014 16:29:10 -0800 (PST) Date: Sat, 22 Nov 2014 16:29:10 -0800 X-Google-Sender-Auth: h_LWf0V3mmHEX6W72bGQXWOKqu0 Message-ID: Subject: Call for Help: openjdk8 tests under Continuous Integration From: Craig Rodrigues To: "freebsd-testing@freebsd.org" Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Nov 2014 00:29:12 -0000 Hi, Recently Kip Macy tried to get the openjdk8 tests working under FreeBSD. He struggled a bit: https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010928.html https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010929.html https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010930.html I think it would be good to get these tests running under FreeBSD continous integration. These tests stress things like threading, memory management, networking, and virtual memory. Running these tests would go a long way to improving Java support under FreeBSD, because it would give a better idea of what can be fixed in FreeBSD itself. I am a bit overstretched at the moment to take this on. I need scripts that can do the following: (1) Download the necessary packages, openjdk8, jtreg, etc. (2) Apply necessary patches to packages in (1) (3) Build the packages in (1) after patches applied (4) Run the tests I would also like: (A) Scripts should be committed to https://github.com/freebsd/freebsd-ci (B) Script should run under FreeBSD (C) Scripts should be easy to run under a Jenkins job at https://jenkins.freebsd.org (D) Followup status and discussion should happen on the freebsd-testing@freebsd.org mailing list Is anyone interested in helping out with this? Starting with some of the things that Kip did would be a good place to start. Thanks. -- Craig From owner-freebsd-testing@FreeBSD.ORG Sun Nov 23 01:57:57 2014 Return-Path: Delivered-To: freebsd-testing@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AE5151D8 for ; Sun, 23 Nov 2014 01:57:57 +0000 (UTC) Received: from mx1.scaleengine.net (beauharnois2.bhs1.scaleengine.net [142.4.218.15]) by mx1.freebsd.org (Postfix) with ESMTP id 878F1114 for ; Sun, 23 Nov 2014 01:57:56 +0000 (UTC) Received: from [192.168.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 3463272F59 for ; Sun, 23 Nov 2014 01:57:50 +0000 (UTC) Message-ID: <54713F35.9000209@freebsd.org> Date: Sat, 22 Nov 2014 20:58:13 -0500 From: Allan Jude User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-testing@FreeBSD.org Subject: Re: Call for Help: Flame Graphs and Continuous Integration References: In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Wi2IEXTl6hK9DihAGs2p7Rd1XUFVbUME3" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Nov 2014 01:57:57 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --Wi2IEXTl6hK9DihAGs2p7Rd1XUFVbUME3 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2014-11-22 17:23, Craig Rodrigues wrote: > FYI: >=20 > https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/00066= 7.html >=20 > Please send follow-ups to freebsd-testing@FreeBSD.org >=20 > -- > Craig I would be interested in working on this. It shares some requirements with another tool I am working on: https://wiki.freebsd.org/bvt What exactly are you looking to generate a flamegraph of? What do you want to profile? --=20 Allan Jude --Wi2IEXTl6hK9DihAGs2p7Rd1XUFVbUME3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJUcT84AAoJEJrBFpNRJZKfLjgP/2ULWeVI9AezZ3LsgWqaoGLs BaJCG69RkCVdy6YwLKFa+IcmUxYGvBcEdI4+XqptwbKQ9JALafBp2JRVNV3dmlFe z/zlu0LcHXOk1/cNYdIxlUCHWDkvwmMi9k6HuvAw0+owD/t8ZfSp9QTmscHTSMal VVNg/0r/qtjkZbwPKyulykNBxPRPWxnepCPuV615A2ijAgonGWlycuFd2IYTMBsQ QMf3zUpsSOefElQxRdMv4C9z2kuPxpfBsGqpVDGmoQjSdEu6mZwe0FzVmF3cvfNT 3fduntjjEX4G0ygfqXZU2kdi5Vbu1y1R1JdrDcGCj8TsFad+ZBYyayj2wMSLvIf9 kNHI04CpADoxFu3iPMTUkDc2aw1xvVXcqCiQqXCKbt7IDxHMoDrR/hsnZ5itrB4N UdwsbtUn/dvyOaBOfXaoJCnlr1in6R8TC77xRsF6MEvSxJGxhE/8fBbqr0hACge4 xwjEagVkwpfDBSAOFwNftwdozhx5tiFvWDYhTb7P7nvQtqCq8QWCmE0OXO5h9FTU Qi7M0TLQ8zlS174lhJPx4bkZoc9rs7925pbDgfhWS4gRpzqoYaD12tZPtE0M3s9X bK6AnIeUnx4qsblAqkT8P2kj+73TP/YSzkeNf1VzB7yjUL/1vUsr15bF/BMGPt6C 9Iw8+kjmkCCSBd6p/VPk =IQcN -----END PGP SIGNATURE----- --Wi2IEXTl6hK9DihAGs2p7Rd1XUFVbUME3-- From owner-freebsd-testing@FreeBSD.ORG Sun Nov 23 03:15:29 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3A641BDA; Sun, 23 Nov 2014 03:15:29 +0000 (UTC) Received: from mail-la0-x22e.google.com (mail-la0-x22e.google.com [IPv6:2a00:1450:4010:c03::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AA2D2AD8; Sun, 23 Nov 2014 03:15:28 +0000 (UTC) Received: by mail-la0-f46.google.com with SMTP id gd6so6184256lab.33 for ; Sat, 22 Nov 2014 19:15:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=zxEb4mxuyEo23HXITGgmJFOkJ/hImeXX5VZ/PLYWDws=; b=UREPJAdHa5jOoNFYlgW/aorjaN/mc/OBGi0AZTcMhV9dbTDprwZ5G1XmbIIZaTPRa8 b7vS/EChqFAxQdq4W/jNX1UDhp4rht22UmRzi6Kj5DQxzHYM5oUO79fWW2PdnB4JcY4i ph4UFZ0jmcCDSiFEh9kojVANjcnmtdv/+nNpzQW8k/m4UVRBNK7y1/imr3WVJpGiLLOF 5ErzWio/bw5tW1UhbfWsBaM7ya121pZJ5bBVZc2sWwMHAFx6SwznxuA1QB9qeRX2vVDZ d6iyEidDFeXYHaZzh/FwyxLDiNG+T1tVsoovEyK0qz0ldk4r2+BJqM8/Hcz4pR8UzfYI xAUg== MIME-Version: 1.0 X-Received: by 10.152.22.135 with SMTP id d7mr13333945laf.46.1416712526825; Sat, 22 Nov 2014 19:15:26 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.130.168 with HTTP; Sat, 22 Nov 2014 19:15:26 -0800 (PST) In-Reply-To: References: Date: Sat, 22 Nov 2014 19:15:26 -0800 X-Google-Sender-Auth: 4I5prz_VVkSn2IbHoLKCzdi5ZU8 Message-ID: Subject: Re: Documentation testing and textproc/igor From: Craig Rodrigues To: Li-Wen Hsu Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: Warren Block , "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Nov 2014 03:15:29 -0000 On Mon, Nov 17, 2014 at 12:34 PM, Li-Wen Hsu wrote: > The job is created: > > > https://jenkins.freebsd.org/jenkins/view/FreeBSD_doc/job/FreeBSD_Doc-igor/ > > Hi, If I navigate to the following page: https://jenkins.freebsd.org/jenkins/view/FreeBSD_doc/job/FreeBSD_Doc-igor/17/checkstyleResult/package.1151016489/ and click on "Details", I see a lot of this: No description available. Please upgrade to latest checkstyle version. Is there something more that needs to be done? Is the output of this Jenkins job meaningful to freebsd-doc@freebsd.org? Is anyone on that list monitoring this job and cleaning up the warnings? -- Craig From owner-freebsd-testing@FreeBSD.ORG Sun Nov 23 03:50:45 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CED131A1; Sun, 23 Nov 2014 03:50:45 +0000 (UTC) Received: from wonkity.com (wonkity.com [67.158.26.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "wonkity.com", Issuer "wonkity.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5BE78D3F; Sun, 23 Nov 2014 03:50:45 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.9/8.14.9) with ESMTP id sAN3ohZU016712 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sat, 22 Nov 2014 20:50:43 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.9/8.14.9/Submit) with ESMTP id sAN3oh0F016709; Sat, 22 Nov 2014 20:50:43 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Sat, 22 Nov 2014 20:50:43 -0700 (MST) From: Warren Block To: Craig Rodrigues Subject: Re: Documentation testing and textproc/igor In-Reply-To: Message-ID: References: User-Agent: Alpine 2.11 (BSF 23 2013-08-11) MIME-Version: 1.0 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (wonkity.com [127.0.0.1]); Sat, 22 Nov 2014 20:50:43 -0700 (MST) Content-Type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8BIT X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" , Li-Wen Hsu X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Nov 2014 03:50:45 -0000 On Sat, 22 Nov 2014, Craig Rodrigues wrote: > > > On Mon, Nov 17, 2014 at 12:34 PM, Li-Wen Hsu wrote: > The job is created: > >     https://jenkins.freebsd.org/jenkins/view/FreeBSD_doc/job/FreeBSD_Doc-igor/ > > > Hi, > > If I navigate to the following page: > > https://jenkins.freebsd.org/jenkins/view/FreeBSD_doc/job/FreeBSD_Doc-igor/17/checkstyleResult/package.1151016489/ > > and click on "Details", I see a lot of this: > > No description available. Please upgrade to latest checkstyle version. > > Is there something more that needs to be done? > > Is the output of this Jenkins job meaningful to > freebsd-doc@freebsd.org?  Is anyone on that list monitoring > this job and cleaning up the warnings? We only saw a private test version at BSDCan, so there was no official version to monitor. But the reaction was very positive. I was skeptical that it would be useful, but the test version surprised me. As far as the messages, igor is currently only including the generic error and not the specifics. The XML has message="wrap long line" rather than wrap long line: 10.0.0.138. The[ ]router's It would be helpful to have the rest of the specifics added, if I can that without messing up the XML output. I understand if we might want to wait on that until the rest is up and working. :) From owner-freebsd-testing@FreeBSD.ORG Sun Nov 23 23:19:48 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9D0B341D; Sun, 23 Nov 2014 23:19:48 +0000 (UTC) Received: from mail-la0-x22e.google.com (mail-la0-x22e.google.com [IPv6:2a00:1450:4010:c03::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 386A65F3; Sun, 23 Nov 2014 23:19:48 +0000 (UTC) Received: by mail-la0-f46.google.com with SMTP id gd6so6713298lab.5 for ; Sun, 23 Nov 2014 15:19:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=paCz96eUrd0/EI5bA5kAUenvMvbzlIx3QaIvoqKtZeA=; b=rOqy3+4SNO5olBhx977FY9JdCmo4tB2igTCp6Ieqnfv0PyPY2zKB42RyOsaSquYSYF 84r/5egnaokER0kKPFmyWZihIL+CnFE91F+2Z8u/NxnTyL9HZJmepM/TxrX07BBe7LMR V0JeaCtzBraajS77fU+BYGHAtjBhpZ9iLsjeiwHXMlXt46U1Aif7aY7ReB3KFWt1eHPZ bp/dEaGypM2Zyldw6IldSBXnRuMNMR8IorOnWuQd6WBHMF/utIzoDAa0DTLzIYnrk3Gu 7RNeyQBbiFogS8gYyphneMLiiwet21hQvFAU2rTEdj5lWkmxN6NYdarm6up57ROEXQNk F9pA== MIME-Version: 1.0 X-Received: by 10.112.199.40 with SMTP id jh8mr17518445lbc.5.1416784785901; Sun, 23 Nov 2014 15:19:45 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.130.168 with HTTP; Sun, 23 Nov 2014 15:19:45 -0800 (PST) In-Reply-To: References: Date: Sun, 23 Nov 2014 15:19:45 -0800 X-Google-Sender-Auth: 2kVibCJ8ijuLCRiuKo-Th2wkc3w Message-ID: Subject: Re: Documentation testing and textproc/igor From: Craig Rodrigues To: Warren Block Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" , Li-Wen Hsu X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Nov 2014 23:19:48 -0000 On Sat, Nov 22, 2014 at 7:50 PM, Warren Block wrote: > > We only saw a private test version at BSDCan, so there was no official > version to monitor. But the reaction was very positive. I was skeptical > that it would be useful, but the test version surprised me. > > As far as the messages, igor is currently only including the generic error > and not the specifics. The XML has message="wrap long line" rather than > > wrap long line: 10.0.0.138. > The[ ]router's > > It would be helpful to have the rest of the specifics added, if I can that > without messing up the XML output. I understand if we might want to wait > on that until the rest is up and working. :) Hi, I don't understand the sentence that you wrote. What are the action items left to finish off igor and get it working with Jenkins? Who is responsible for doing the work? It looks like you and Li-Wen are both looking at each other waiting for the other person to do some work, without telling the other person. BSDCan happened 6 months ago, so if this isn't a big deal to fix, I'd like to see the final bits of this completed so that we can have a working Jenkins igor job that is useful to the freebsd-doc@ team. Thanks. -- Craig From owner-freebsd-testing@FreeBSD.ORG Sun Nov 23 23:58:39 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9D631BBA; Sun, 23 Nov 2014 23:58:39 +0000 (UTC) Received: from wonkity.com (wonkity.com [67.158.26.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "wonkity.com", Issuer "wonkity.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5D7B795F; Sun, 23 Nov 2014 23:58:39 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.9/8.14.9) with ESMTP id sANNwVQp017436 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Sun, 23 Nov 2014 16:58:31 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.9/8.14.9/Submit) with ESMTP id sANNwUtM017433; Sun, 23 Nov 2014 16:58:31 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Sun, 23 Nov 2014 16:58:30 -0700 (MST) From: Warren Block To: Craig Rodrigues Subject: Re: Documentation testing and textproc/igor In-Reply-To: Message-ID: References: User-Agent: Alpine 2.11 (BSF 23 2013-08-11) MIME-Version: 1.0 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (wonkity.com [127.0.0.1]); Sun, 23 Nov 2014 16:58:31 -0700 (MST) Content-Type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8BIT X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" , Li-Wen Hsu X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Nov 2014 23:58:39 -0000 On Sun, 23 Nov 2014, Craig Rodrigues wrote: > On Sat, Nov 22, 2014 at 7:50 PM, Warren Block wrote: > > We only saw a private test version at BSDCan, so there was no official version to monitor.  But the reaction was very positive.  I was skeptical that it would be useful, but the > test version surprised me. > > As far as the messages, igor is currently only including the generic error and not the specifics.  The XML has message="wrap long line" rather than > >   wrap long line:        10.0.0.138. The[ ]router's > > It would be helpful to have the rest of the specifics added, if I can that without messing up the XML output.  I understand if we might want to wait on that until the rest is up > and working. :) > > I don't understand the sentence that you wrote.  What are > the action items left to finish off igor and get it working with Jenkins? > Who is responsible for doing the work? > > It looks like you and Li-Wen are both looking at each other > waiting for the other person to do some work, without telling > the other person.  BSDCan happened 6 months ago, > so if this isn't a big deal to fix, I'd like to see the final bits > of this completed so that we can have a working Jenkins igor job > that is useful to the freebsd-doc@ team. As far as I know, igor checkstyle output works now. I would like to expand on that later, but it can wait for the basic Jenkins doc test to be completed. If changes to igor are needed, possibly to silence those checkstyle warnings, please let me know. Beyond that, the Jenkins setup is out of my hands. I should point out that nothing formal was agreed at BSDCan. We saw a prototype of the Jenkins page using igor output and agreed that it would be useful. From owner-freebsd-testing@FreeBSD.ORG Mon Nov 24 05:15:47 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 09E9F12B; Mon, 24 Nov 2014 05:15:47 +0000 (UTC) Received: from mailA.getsnappy.com (mailA.getsnappy.com [72.29.186.40]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DFB529E3; Mon, 24 Nov 2014 05:15:46 +0000 (UTC) Received: from [192.168.0.2] (138-229-191-115.dhcp.snlo.ca.charter.com [138.229.191.115] (may be forged)) (authenticated bits=0) by mailA.getsnappy.com (8.14.9/8.14.7) with ESMTP id sAO5FW5H099350 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sun, 23 Nov 2014 21:15:37 -0800 (PST) (envelope-from openjdk@getsnappy.com) X-Authentication-Warning: mailA.getsnappy.com: Host 138-229-191-115.dhcp.snlo.ca.charter.com [138.229.191.115] (may be forged) claimed to be [192.168.0.2] Mime-Version: 1.0 (Mac OS X Mail 8.1 \(1993\)) Subject: Re: Call for Help: openjdk8 tests under Continuous Integration From: Brian Gardner In-Reply-To: Date: Sun, 23 Nov 2014 21:15:31 -0800 Message-Id: <5249371E-629C-4026-A220-60764A8B70C4@getsnappy.com> References: <3B1C0F30-6F75-4095-9347-9053F7F2A8A2@getsnappy.com> To: freebsd-testing@freebsd.org X-Mailer: Apple Mail (2.1993) Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Nov 2014 05:15:47 -0000 Hello, I=92d like to help. Sounds like those scripts would be fairly easy to = write. Would it be a good idea to try and decouple building of the = ports (using poudriere) from the actual running of the jtreg tests. In = this plan you=92d have a separate job that builds and maintains an = up-to-date repository of packages for the supported platforms (10.0 = amd64, 9.3 i386), then as part of running tests you=92d run pkg to = update the packages as the first step. I have some questions: 1) What platforms will be tested? 2) How often will tests run / What will trigger test runs? 3) How will results of the jtreg tests be presented on Jenkins? Brian Gardner In Response To: Hi, Recently Kip Macy tried to get the openjdk8 tests working under FreeBSD. He struggled a bit: = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010928.html = = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010929.html = = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010930.html = I think it would be good to get these tests running under FreeBSD continous integration. These tests stress things like threading, memory management, networking, and virtual memory. Running these tests would go a long way to improving Java support under FreeBSD, because it would give a better idea of what can be fixed in FreeBSD = itself. I am a bit overstretched at the moment to take this on. I need scripts that can do the following: (1) Download the necessary packages, openjdk8, jtreg, etc. (2) Apply necessary patches to packages in (1) (3) Build the packages in (1) after patches applied (4) Run the tests I would also like: (A) Scripts should be committed to = https://github.com/freebsd/freebsd-ci = (B) Script should run under FreeBSD (C) Scripts should be easy to run under a Jenkins job at https://jenkins.freebsd.org (D) Followup status and discussion should happen on the freebsd-testing at freebsd.org = mailing = list Is anyone interested in helping out with this? Starting with some of the things that Kip did would be a good place to start. Thanks. -- Craig > On Nov 23, 2014, at 8:49 PM, Craig Rodrigues = wrote: >=20 > Hi, >=20 > Read this: > = https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.h= tml = >=20 > and reply to that posting on freebsd-testing@freebsd.org = (subscribe to that list if you > are not on it) with the items that you think that you can > complete. >=20 > -- > Craig >=20 > On Sun, Nov 23, 2014 at 8:28 PM, Brian Gardner > wrote: > Hi Craig, > I would like to help. Let me know what I can do. >=20 > Brian Gardner >=20 > > On Nov 22, 2014, at 4:40 PM, Craig Rodrigues = wrote: > > > > FYI, > > > > = https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.h= tml = > > > > Please send followups to freebsd-testing@freebsd.org = . > > > > -- > > Craig > > _______________________________________________ > > freebsd-java@freebsd.org mailing = list > > http://lists.freebsd.org/mailman/listinfo/freebsd-java = > > To unsubscribe, send any mail to = "freebsd-java-unsubscribe@freebsd.org = " >=20 >=20 From owner-freebsd-testing@FreeBSD.ORG Mon Nov 24 08:00:23 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id E7124355 for ; Mon, 24 Nov 2014 08:00:23 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BCA5AB8B for ; Mon, 24 Nov 2014 08:00:23 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id sAO80N2v021246 for ; Mon, 24 Nov 2014 08:00:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Message-Id: <201411240800.sAO80N2v021246@kenobi.freebsd.org> From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [FreeBSD Bugzilla] Commit Needs MFC MIME-Version: 1.0 X-Bugzilla-Type: whine X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated Date: Mon, 24 Nov 2014 08:00:23 +0000 Content-Type: text/plain X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Nov 2014 08:00:24 -0000 Hi, You have a bug in the "Needs MFC" state which has not been touched in 7 or more days. This email serves as a reminder that you may want to MFC this bug or marked it as completed. In the event you have a longer MFC timeout you may update this bug with a comment and I won't remind you again for 7 days. This reminder is only sent on Mondays. Please file a bug about concerns you may have. This search was scheduled by eadler@FreeBSD.org. (1 bugs) Bug 193499: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193499 Severity: Affects Some People Priority: --- Hardware: Any Assignee: freebsd-testing@freebsd.org Status: New Resolution: Summary: [tests] usr.bin/yacc/err_syntax27.error failures with the latest kyua From owner-freebsd-testing@FreeBSD.ORG Mon Nov 24 09:03:33 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6B790810 for ; Mon, 24 Nov 2014 09:03:33 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5309F329 for ; Mon, 24 Nov 2014 09:03:33 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id sAO93X9b072724 for ; Mon, 24 Nov 2014 09:03:33 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 193499] [tests] usr.bin/yacc/err_syntax27.error failures with the latest kyua Date: Mon, 24 Nov 2014 09:03:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rodrigc@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Nov 2014 09:03:33 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193499 Craig Rodrigues changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Closed Resolution|--- |FIXED --- Comment #14 from Craig Rodrigues --- Fixed -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Mon Nov 24 09:04:15 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 45E6A837 for ; Mon, 24 Nov 2014 09:04:15 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2DD3D333 for ; Mon, 24 Nov 2014 09:04:15 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id sAO94FlM088107 for ; Mon, 24 Nov 2014 09:04:15 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 193499] [tests] usr.bin/yacc/err_syntax27.error failures with the latest kyua Date: Mon, 24 Nov 2014 09:04:15 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: rodrigc@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-testing@freebsd.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Nov 2014 09:04:15 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193499 --- Comment #15 from Craig Rodrigues --- Fix didn't make it into 10.1-RELEASE, but is in stable/10 branch -- You are receiving this mail because: You are the assignee for the bug. From owner-freebsd-testing@FreeBSD.ORG Mon Nov 24 17:50:45 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 66F341EE; Mon, 24 Nov 2014 17:50:45 +0000 (UTC) Received: from FreeBSD.cs.nctu.edu.tw (FreeBSD.cs.nctu.edu.tw [140.113.17.209]) by mx1.freebsd.org (Postfix) with ESMTP id F0D6478C; Mon, 24 Nov 2014 17:50:44 +0000 (UTC) Received: by FreeBSD.cs.nctu.edu.tw (Postfix, from userid 1058) id 1C11322D4; Tue, 25 Nov 2014 01:50:37 +0800 (CST) Date: Tue, 25 Nov 2014 01:50:37 +0800 From: Li-Wen Hsu To: Warren Block Subject: Re: Documentation testing and textproc/igor Message-ID: <20141124175036.GA17706@FreeBSD.cs.nctu.edu.tw> References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.22 (2013-10-16) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Nov 2014 17:50:45 -0000 On Sun, Nov 23, 2014 at 16:58:30 -0700, Warren Block wrote: > As far as I know, igor checkstyle output works now. I would like to > expand on that later, but it can wait for the basic Jenkins doc test to > be completed. If I understand this paragraph correctly, you want to have a basic jenkins doc test (checking if building is fine), which does exist: https://jenkins.freebsd.org/jenkins/job/FreeBSD_DOC/ and this jobs sends mail to freebsd-doc@ list. FreeBSD_Doc-igor job does a bit more, as a "downstream" job for FreeBSD_DOC, after each FreeBSD_DOC job finished successfully, it launches igor and check if the doc files are well-written. Then maintains a graph for tracking the "bad smell" counter. Do you guys think it's time to send those "updates" to freebsd-doc@ list? I thought it can send mail such as "" Checkstyle: 190 warnings from one analysis. 17 new warnings 13 fixed warnings Just like we see in: https://jenkins.freebsd.org/jenkins/job/FreeBSD_Doc-igor/20/ I would try if this can be done by job configuration. > If changes to igor are needed, possibly to silence those > checkstyle warnings, please let me know. Beyond that, the Jenkins setup > is out of my hands. > > I should point out that nothing formal was agreed at BSDCan. We saw a > prototype of the Jenkins page using igor output and agreed that it would > be useful. In BSDCan, I asked Warren if ci team can do anything for doc team, he suggested runing igor over the doc tree to produce the report. The first part (running igor) is easy as just one line of build script. The second part is somehow difficult to me, since it needs a plugin knows igor output, just like Jenkins treats JUnit output. And I thought of while developing Java project in my $job, we use checkstyle and its jenkins plugin for tracking the bad style in our code. So I did some quick hack in igor to make it generates checkstyle output. I also had some worries about the mesage: "No description available. Please upgrade to latest checkstyle version." And Warren encourages me that the idea worked and we can improve that later. That message is because checkstyle is designed for Java and of course if doesn't have rule descriptions for igor. That's why the warning message shown like this. I don't have a easy solution at this point, it seems we need to have build our own jenkins plugin, which might take checksytle plugin as base. That takes time, though. Possibly, there is a magic syntax in checkstyle output and can suppress that useless message. It also takes some (shorter) time for searching that. Or, there is another wonderful plugin we can use for generating igor report, we should change to that. So, what we have now is a proof of concept on jenkins.freebsd.org, just as have we had in BSDCan. I would like to listen to suggestions and hopefully receive some help from more people. :) Li-Wen -- Li-Wen Hsu http://lwhsu.org From owner-freebsd-testing@FreeBSD.ORG Mon Nov 24 18:45:14 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CD859C95; Mon, 24 Nov 2014 18:45:14 +0000 (UTC) Received: from wonkity.com (wonkity.com [67.158.26.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "wonkity.com", Issuer "wonkity.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 75A21EC3; Mon, 24 Nov 2014 18:45:14 +0000 (UTC) Received: from wonkity.com (localhost [127.0.0.1]) by wonkity.com (8.14.9/8.14.9) with ESMTP id sAOIjCnu005516 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Mon, 24 Nov 2014 11:45:12 -0700 (MST) (envelope-from wblock@wonkity.com) Received: from localhost (wblock@localhost) by wonkity.com (8.14.9/8.14.9/Submit) with ESMTP id sAOIjCTQ005513; Mon, 24 Nov 2014 11:45:12 -0700 (MST) (envelope-from wblock@wonkity.com) Date: Mon, 24 Nov 2014 11:45:12 -0700 (MST) From: Warren Block To: Li-Wen Hsu Subject: Re: Documentation testing and textproc/igor In-Reply-To: <20141124175036.GA17706@FreeBSD.cs.nctu.edu.tw> Message-ID: References: <20141124175036.GA17706@FreeBSD.cs.nctu.edu.tw> User-Agent: Alpine 2.11 (BSF 23 2013-08-11) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3 (wonkity.com [127.0.0.1]); Mon, 24 Nov 2014 11:45:12 -0700 (MST) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Nov 2014 18:45:14 -0000 On Tue, 25 Nov 2014, Li-Wen Hsu wrote: > On Sun, Nov 23, 2014 at 16:58:30 -0700, Warren Block wrote: >> As far as I know, igor checkstyle output works now. I would like to >> expand on that later, but it can wait for the basic Jenkins doc test to >> be completed. > > If I understand this paragraph correctly, you want to have a basic > jenkins doc test (checking if building is fine), which does exist: > > https://jenkins.freebsd.org/jenkins/job/FreeBSD_DOC/ > > and this jobs sends mail to freebsd-doc@ list. > > FreeBSD_Doc-igor job does a bit more, as a "downstream" job for > FreeBSD_DOC, after each FreeBSD_DOC job finished successfully, it > launches igor and check if the doc files are well-written. Then > maintains a graph for tracking the "bad smell" counter. > > Do you guys think it's time to send those "updates" to freebsd-doc@ > list? I thought it can send mail such as "" > > Checkstyle: 190 warnings from one analysis. > 17 new warnings > 13 fixed warnings > > Just like we see in: > > https://jenkins.freebsd.org/jenkins/job/FreeBSD_Doc-igor/20/ > > I would try if this can be done by job configuration. For now, how about we announce the FreeBSD_Doc-igor page on doc@ and and ask for feedback? From owner-freebsd-testing@FreeBSD.ORG Tue Nov 25 01:57:57 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1C4C2573; Tue, 25 Nov 2014 01:57:57 +0000 (UTC) Received: from mail-lb0-x22e.google.com (mail-lb0-x22e.google.com [IPv6:2a00:1450:4010:c04::22e]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8F6BB603; Tue, 25 Nov 2014 01:57:56 +0000 (UTC) Received: by mail-lb0-f174.google.com with SMTP id w7so8453384lbi.19 for ; Mon, 24 Nov 2014 17:57:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=S3gcKfp1HA8kZsTUkTGoiNnt5lV9vSUAB3t8oraljn4=; b=QnRKL9550qDeJuScah/cmz7dY+qa7a1QII21ickZe4MTPK0eZoVG3YCIr5AshSoPiD xgylaasehv+PzA3tAtecpLtyHsQNICFDp8Mu/pMTOsbMqqO4F0RNJ+7yKQngDNXwV2Jk j2syHxCwmbwkTSw7pAH7eyAzMoe59I7V1/XYo/cJUIgWSY6G3qxxZYj7bUdruwrMaZmR 7hL5V8SdtOpyo64zcmdLKHbkPUTvcU++Zva42FkvVd1OdnPDftfdubp7QpNoHPR5U4Zf m9tVKjHsYOwbEGgzpxkwxC4Q4zDq2UiuFJz7FgqBDphsuLGl6QukIuhutj6lRjfjdPwv Wj/A== MIME-Version: 1.0 X-Received: by 10.112.138.137 with SMTP id qq9mr23341088lbb.80.1416880673849; Mon, 24 Nov 2014 17:57:53 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.130.168 with HTTP; Mon, 24 Nov 2014 17:57:53 -0800 (PST) In-Reply-To: <54713F35.9000209@freebsd.org> References: <54713F35.9000209@freebsd.org> Date: Mon, 24 Nov 2014 17:57:53 -0800 X-Google-Sender-Auth: QHFCuUteSOMHsJ0Lw5Wi4ATVwoI Message-ID: Subject: Re: Call for Help: Flame Graphs and Continuous Integration From: Craig Rodrigues To: Allan Jude Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Nov 2014 01:57:57 -0000 On Sat, Nov 22, 2014 at 5:58 PM, Allan Jude wrote: > On 2014-11-22 17:23, Craig Rodrigues wrote: > > FYI: > > > > > https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000667.html > > > > Please send follow-ups to freebsd-testing@FreeBSD.org > > > > -- > > Craig > > I would be interested in working on this. It shares some requirements > with another tool I am working on: https://wiki.freebsd.org/bvt > > What exactly are you looking to generate a flamegraph of? > What do you want to profile? > Ahh, good. It looks like you are interested in similar things. We will make better progress if we work together and collaborate. I would like to focus on getting a working prototype going first, and then refine the test case and test environment later. There are a lot of software components to link together, so just going through the exercise of tying things together, and refining things over time is worth it. I would like to start with: (1) Take the existing scripts in the https://github.com/freebsd/freebsd-ci repo which boot and test bhyve VM with kyua. (2) Refactor/modify/copy/whatever the scripts so that we can generate a flamegraph instead of running kyua. (3) Pick some type of load to generate during the (4) Create a Jenkins job to boot the VM, generate the load, and generate the flamegraph If this is something you are interested in working on, it will be very helpful. Also, by accumulating various scripts in the https://github.com/freebsd/freebsd-ci repo, we will have reusable stuff that people can use in their own efforts to benchmark and test FreeBSD. Thanks. -- Craig From owner-freebsd-testing@FreeBSD.ORG Tue Nov 25 04:58:30 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9AA75CD2; Tue, 25 Nov 2014 04:58:30 +0000 (UTC) Received: from FreeBSD.cs.nctu.edu.tw (FreeBSD.cs.nctu.edu.tw [140.113.17.209]) by mx1.freebsd.org (Postfix) with ESMTP id 61CC4ACF; Tue, 25 Nov 2014 04:58:30 +0000 (UTC) Received: by FreeBSD.cs.nctu.edu.tw (Postfix, from userid 1058) id 5F98F299A; Tue, 25 Nov 2014 12:58:28 +0800 (CST) Date: Tue, 25 Nov 2014 12:58:28 +0800 From: Li-Wen Hsu To: Warren Block Subject: Re: Documentation testing and textproc/igor Message-ID: <20141125045828.GA11940@FreeBSD.cs.nctu.edu.tw> References: <20141124175036.GA17706@FreeBSD.cs.nctu.edu.tw> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.22 (2013-10-16) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Nov 2014 04:58:30 -0000 On Mon, Nov 24, 2014 at 11:45:12 -0700, Warren Block wrote: > For now, how about we announce the FreeBSD_Doc-igor page on doc@ and and > ask for feedback? Sounds good, could you help to write some words about this? And I'll try to config the notification emails. -- Li-Wen Hsu http://lwhsu.org From owner-freebsd-testing@FreeBSD.ORG Tue Nov 25 12:44:21 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 9A5E2413 for ; Tue, 25 Nov 2014 12:44:21 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 81FBC369 for ; Tue, 25 Nov 2014 12:44:21 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id sAPCiLxv081415 for ; Tue, 25 Nov 2014 12:44:21 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 194828] [test] lib.libc.sys.getcontext_test.setcontext_link fails on amd64, not i386 Date: Tue, 25 Nov 2014 12:44:21 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: commit-hook@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: ngie@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Nov 2014 12:44:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194828 --- Comment #17 from commit-hook@freebsd.org --- A commit references this bug: Author: jhb Date: Tue Nov 25 12:44:19 UTC 2014 New revision: 275033 URL: https://svnweb.freebsd.org/changeset/base/275033 Log: Only pass 6 arguments to the 'run' function on amd64. amd64's makecontext on FreeBSD only supports a maximum of 6 arguments. This fixes the setcontext_link test on amd64. PR: 194828 Changes: head/contrib/netbsd-tests/lib/libc/sys/t_getcontext.c -- You are receiving this mail because: You are on the CC list for the bug. From owner-freebsd-testing@FreeBSD.ORG Tue Nov 25 12:45:42 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DA6E28AB for ; Tue, 25 Nov 2014 12:45:42 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id C14DD37C for ; Tue, 25 Nov 2014 12:45:42 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id sAPCjgok010251 for ; Tue, 25 Nov 2014 12:45:42 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-testing@freebsd.org Subject: [Bug 194828] [test] lib.libc.sys.getcontext_test.setcontext_link fails on amd64, not i386 Date: Tue, 25 Nov 2014 12:45:42 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.0-CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: jhb@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: ngie@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status resolution Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Nov 2014 12:45:42 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=194828 John Baldwin changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |Closed Resolution|--- |FIXED --- Comment #18 from John Baldwin --- This is a comment. -- You are receiving this mail because: You are on the CC list for the bug. From owner-freebsd-testing@FreeBSD.ORG Tue Nov 25 20:12:02 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 34D7D504 for ; Tue, 25 Nov 2014 20:12:02 +0000 (UTC) Received: from mail-lb0-x236.google.com (mail-lb0-x236.google.com [IPv6:2a00:1450:4010:c04::236]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 8F255FFC for ; Tue, 25 Nov 2014 20:12:01 +0000 (UTC) Received: by mail-lb0-f182.google.com with SMTP id f15so1308047lbj.41 for ; Tue, 25 Nov 2014 12:11:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=Q/Gk0QWonXtsd62Gs2S//xr6xGoe2thCq+vzRS+aVTI=; b=WxbFoGKyMXBAf+NC4QMQEUHH2tf1crZo3yneqG/Ht2n0mGwDrM03tDmLqgRS9hJIYZ iv6SHIGsART4QJrkulbLoNWPKJOjJN4j/jxp4DF7bd5IhUIIQus/Ay8zfKf1Gnw7tKnY 1YP45vBCE/O3J9XuK5r9KOA8GD3BmI4dePOptCw9CCtTBKA0uXM8wuT0So0vWTJ971os qGaEtd0Djnp4zWs4/N+H+PG5DfC96AY7cH0zhWKG3QxO1WcGXM1qnnOx0zAYSwuH185Y 3tlv2kEKVBighLy9rI0Inp1j9r6tKY+JbWIcFqLfRpNqNmDA7DY80+sCmK46snfgF2tr WB1Q== MIME-Version: 1.0 X-Received: by 10.112.199.40 with SMTP id jh8mr30369252lbc.5.1416946319545; Tue, 25 Nov 2014 12:11:59 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.130.168 with HTTP; Tue, 25 Nov 2014 12:11:59 -0800 (PST) In-Reply-To: <5249371E-629C-4026-A220-60764A8B70C4@getsnappy.com> References: <3B1C0F30-6F75-4095-9347-9053F7F2A8A2@getsnappy.com> <5249371E-629C-4026-A220-60764A8B70C4@getsnappy.com> Date: Tue, 25 Nov 2014 12:11:59 -0800 X-Google-Sender-Auth: fSLaAuwX3eAwtvl6Ulx02pvrrF8 Message-ID: Subject: Re: Call for Help: openjdk8 tests under Continuous Integration From: Craig Rodrigues To: Brian Gardner Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Nov 2014 20:12:02 -0000 Hi, Thanks, Brian! Well, first of all, we need someone to figure out how to run the jtreg tests under FreeBSD, and make that process reproducible. Would you be willing to do the initial investigation for this? If you look at Kip Macy's postings on the freebsd-java list in October, you can see that he managed to get the tests to run, so hopefully Kip can answer any questions about what he did to get the tests to run. I'm not familiar with jtreg. What ports are you thinking that we need to build with poudriere in order to run it? Le me try to answer your questions: 1) Let's test on amd64 first, just to iron out all the issues. Once we get that working, we can add more platforms, such as i386. 2) For an initial effort, maybe we can schedule the tests to run once a week, via the Jenkins job scheduler. We can see if it makes sense to run the tests more or less frequently after that. 3) I don't know what format the jtreg test output produces. If it can produce JUnit XML output, that would be ideal because it can be imported directly into Jenkins. If it does not do that, then even if we make the text output of the test logs available online, that is a good start. -- Craig On Sun, Nov 23, 2014 at 9:15 PM, Brian Gardner wrote: > Hello, > I'd like to help. Sounds like those scripts would be fairly easy to > write. Would it be a good idea to try and decouple building of the ports > (using poudriere) from the actual running of the jtreg tests. In this plan > you'd have a separate job that builds and maintains an up-to-date > repository of packages for the supported platforms (10.0 amd64, 9.3 i386), > then as part of running tests you'd run pkg to update the packages as the > first step. > > I have some questions: > 1) What platforms will be tested? > 2) How often will tests run / What will trigger test runs? > 3) How will results of the jtreg tests be presented on Jenkins? > > Brian Gardner > > > In Response To: > > Hi, > > Recently Kip Macy tried to get the openjdk8 tests working > under FreeBSD. He struggled a bit: > https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010928.htmlhttps://lists.freebsd.org/pipermail/freebsd-java/2014-October/010929.htmlhttps://lists.freebsd.org/pipermail/freebsd-java/2014-October/010930.html > > I think it would be good to get these tests running under FreeBSD > continous integration. These tests stress things like threading, memory > management, networking, and virtual memory. Running these tests > would go a long way to improving Java support under FreeBSD, > because it would give a better idea of what can be fixed in FreeBSD itself. > > I am a bit overstretched at the moment to take this on. > > > I need scripts that can do the following: > > (1) Download the necessary packages, openjdk8, jtreg, etc. > (2) Apply necessary patches to packages in (1) > (3) Build the packages in (1) after patches applied > (4) Run the tests > > I would also like: > (A) Scripts should be committed to https://github.com/freebsd/freebsd-ci > (B) Script should run under FreeBSD > (C) Scripts should be easy to run under a Jenkins job at > https://jenkins.freebsd.org > (D) Followup status and discussion should happen on > the freebsd-testing at freebsd.org mailing list > > Is anyone interested in helping out with this? Starting with some > of the things that Kip did would be a good place to start. > > Thanks. > -- > Craig > > > > > On Nov 23, 2014, at 8:49 PM, Craig Rodrigues wrote: > > Hi, > > Read this: > > https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.html > > and reply to that posting on freebsd-testing@freebsd.org (subscribe to > that list if you > are not on it) with the items that you think that you can > complete. > > -- > Craig > > On Sun, Nov 23, 2014 at 8:28 PM, Brian Gardner > wrote: > >> Hi Craig, >> I would like to help. Let me know what I can do. >> >> Brian Gardner >> >> > On Nov 22, 2014, at 4:40 PM, Craig Rodrigues >> wrote: >> > >> > FYI, >> > >> > >> https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.html >> > >> > Please send followups to freebsd-testing@freebsd.org. >> > >> > -- >> > Craig >> > _______________________________________________ >> > freebsd-java@freebsd.org mailing list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-java >> > To unsubscribe, send any mail to "freebsd-java-unsubscribe@freebsd.org" >> >> > > From owner-freebsd-testing@FreeBSD.ORG Tue Nov 25 20:23:18 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CEEE677F; Tue, 25 Nov 2014 20:23:18 +0000 (UTC) Received: from mailA.getsnappy.com (mailA.getsnappy.com [72.29.186.40]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id ACD9F17A; Tue, 25 Nov 2014 20:23:18 +0000 (UTC) Received: from [192.168.0.2] (138-229-191-115.dhcp.snlo.ca.charter.com [138.229.191.115] (may be forged)) (authenticated bits=0) by mailA.getsnappy.com (8.14.9/8.14.7) with ESMTP id sAPKN3C5064789 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 25 Nov 2014 12:23:06 -0800 (PST) (envelope-from openjdk@getsnappy.com) X-Authentication-Warning: mailA.getsnappy.com: Host 138-229-191-115.dhcp.snlo.ca.charter.com [138.229.191.115] (may be forged) claimed to be [192.168.0.2] Mime-Version: 1.0 (Mac OS X Mail 8.1 \(1993\)) Subject: Re: Call for Help: openjdk8 tests under Continuous Integration From: Brian Gardner In-Reply-To: Date: Tue, 25 Nov 2014 12:23:01 -0800 Message-Id: <177951AE-71AD-4107-85A8-F8089D164514@getsnappy.com> References: <3B1C0F30-6F75-4095-9347-9053F7F2A8A2@getsnappy.com> <5249371E-629C-4026-A220-60764A8B70C4@getsnappy.com> To: Craig Rodrigues X-Mailer: Apple Mail (2.1993) Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Nov 2014 20:23:18 -0000 Hi Craig, I=92ll continue the investigation, I=92ve been following the openjdk8 = posts from Kit. I initially ported openjdk8 and was running jtreg tests = as part of the process. If I recall correctly the output was HTML but I = think this is configurable, worse case I probably can convert it into = supported xml format. I=92m thinking we can bake running tests into the = openjdk8 port Makefile, and use poudriere testport and pass in a script = that will upload the results into Jenkins. That should make it really = easy to run and maintain this on all supported platforms. =20 Brian > On Nov 25, 2014, at 12:11 PM, Craig Rodrigues = wrote: >=20 > Hi, >=20 > Thanks, Brian! >=20 > Well, first of all, we need someone to figure out how to run the jtreg = tests under FreeBSD, > and make that process reproducible. Would you be willing to do the = initial investigation for this? > If you look at Kip Macy's postings on the freebsd-java list in = October, you can see that he > managed to get the tests to run, so hopefully Kip can answer any = questions about what he did to get > the tests to run. >=20 > I'm not familiar with jtreg. What ports are you thinking that we need = to build with poudriere in order to run it? >=20 > Le me try to answer your questions: >=20 > 1) Let's test on amd64 first, just to iron out all the issues. Once = we get that working, we can add more platforms, such as i386. > 2) For an initial effort, maybe we can schedule the tests to run once = a week, via the Jenkins job scheduler. We can see if > it makes sense to run the tests more or less frequently after = that. > 3) I don't know what format the jtreg test output produces. If it = can produce JUnit XML output, that would be ideal because > it can be imported directly into Jenkins. If it does not do = that, then even if we make the text output of the test logs available = online, > that is a good start. >=20 > -- > Craig >=20 > On Sun, Nov 23, 2014 at 9:15 PM, Brian Gardner > wrote: > Hello, > I=92d like to help. Sounds like those scripts would be fairly easy to = write. Would it be a good idea to try and decouple building of the = ports (using poudriere) from the actual running of the jtreg tests. In = this plan you=92d have a separate job that builds and maintains an = up-to-date repository of packages for the supported platforms (10.0 = amd64, 9.3 i386), then as part of running tests you=92d run pkg to = update the packages as the first step. >=20 > I have some questions: > 1) What platforms will be tested? > 2) How often will tests run / What will trigger test runs? > 3) How will results of the jtreg tests be presented on Jenkins? >=20 > Brian Gardner >=20 >=20 > In Response To: >=20 > Hi, >=20 > Recently Kip Macy tried to get the openjdk8 tests working > under FreeBSD. He struggled a bit: >=20 > = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010928.html = > = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010929.html = > = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010930.html = >=20 > I think it would be good to get these tests running under FreeBSD > continous integration. These tests stress things like threading, = memory > management, networking, and virtual memory. Running these tests > would go a long way to improving Java support under FreeBSD, > because it would give a better idea of what can be fixed in FreeBSD = itself. >=20 > I am a bit overstretched at the moment to take this on. >=20 >=20 > I need scripts that can do the following: >=20 > (1) Download the necessary packages, openjdk8, jtreg, etc. > (2) Apply necessary patches to packages in (1) > (3) Build the packages in (1) after patches applied > (4) Run the tests >=20 > I would also like: > (A) Scripts should be committed to = https://github.com/freebsd/freebsd-ci = > (B) Script should run under FreeBSD > (C) Scripts should be easy to run under a Jenkins job at > https://jenkins.freebsd.org > (D) Followup status and discussion should happen on > the freebsd-testing at freebsd.org = mailing = list >=20 > Is anyone interested in helping out with this? Starting with some > of the things that Kip did would be a good place to start. >=20 > Thanks. > -- > Craig >=20 >=20 >=20 >> On Nov 23, 2014, at 8:49 PM, Craig Rodrigues > wrote: >>=20 >> Hi, >>=20 >> Read this: >> = https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.h= tml = >>=20 >> and reply to that posting on freebsd-testing@freebsd.org = (subscribe to that list if you >> are not on it) with the items that you think that you can >> complete. >>=20 >> -- >> Craig >>=20 >> On Sun, Nov 23, 2014 at 8:28 PM, Brian Gardner > wrote: >> Hi Craig, >> I would like to help. Let me know what I can do. >>=20 >> Brian Gardner >>=20 >> > On Nov 22, 2014, at 4:40 PM, Craig Rodrigues > wrote: >> > >> > FYI, >> > >> > = https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.h= tml = >> > >> > Please send followups to freebsd-testing@freebsd.org = . >> > >> > -- >> > Craig >> > _______________________________________________ >> > freebsd-java@freebsd.org mailing = list >> > http://lists.freebsd.org/mailman/listinfo/freebsd-java = >> > To unsubscribe, send any mail to = "freebsd-java-unsubscribe@freebsd.org = " >>=20 >>=20 >=20 >=20 From owner-freebsd-testing@FreeBSD.ORG Tue Nov 25 22:51:08 2014 Return-Path: Delivered-To: testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 25D321B9 for ; Tue, 25 Nov 2014 22:51:08 +0000 (UTC) Received: from mail-wg0-x230.google.com (mail-wg0-x230.google.com [IPv6:2a00:1450:400c:c00::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B20493A6 for ; Tue, 25 Nov 2014 22:51:04 +0000 (UTC) Received: by mail-wg0-f48.google.com with SMTP id y19so2159897wgg.21 for ; Tue, 25 Nov 2014 14:51:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:date:from:to:subject:message-id:mime-version:content-type :content-disposition:user-agent; bh=TTu2Or8rAL5zGOO6z9ULvXvK7Jr3kbeWBfSILR5lQDU=; b=sSumrMFnffTgf0S5Ryr7Nweh4JWcxufLIPeAgjHy9eY/idnB+TJYThwPUjCsLg4XnN XW36E2LdZ6IRdiS8VSvT6Emsr7e+w/w2xjdlGAiE0Mz9isgNi9W2yEywgymiQB4rd1Xr f93HOmN0MBHsqi+W+s0BhdX0V1m/QtDCGrEC3yetNFxCAojm6B5YHs71vstkBea6Ynrt oDh8uyWYC33CKQtgZgOyjN66bXu8RBG4ktUyZp9PU6hkuDhXD0Ct9PvttZB0it3Gd1cC m8uopU5czagYDynduIlqUar+cQzZ+Grjm59TxJ6sSTOQzfezti86HdFmMeMz40HOSStV LwpQ== X-Received: by 10.194.52.68 with SMTP id r4mr43378530wjo.82.1416955862828; Tue, 25 Nov 2014 14:51:02 -0800 (PST) Received: from ivaldir.etoilebsd.net ([2001:41d0:8:db4c::1]) by mx.google.com with ESMTPSA id bo1sm3813869wjc.18.2014.11.25.14.51.01 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 25 Nov 2014 14:51:01 -0800 (PST) Sender: Baptiste Daroussin Date: Tue, 25 Nov 2014 23:50:59 +0100 From: Baptiste Daroussin To: testing@FreeBSD.org Subject: LIBADD for the test framework Message-ID: <20141125225059.GA82931@ivaldir.etoilebsd.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="jI8keyz6grp/JLjh" Content-Disposition: inline User-Agent: Mutt/1.5.23 (2014-03-12) X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Nov 2014 22:51:08 -0000 --jI8keyz6grp/JLjh Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi all, I do not have time so far to dig into all the .mk files for the testing framework. I would really appreciate if one of you could dig, figure out all the DPADD.${something} LDADD.${something}, I think there is a need for a LIBADD.${something} as a replacement/complement. In particular the ones that add ${LDATF*} because that syntax is now deprecated, as it is properly handled by LIBADD. btw USEPRIVATELIB is also deprecated as it is automatically set by LIBADD when needed. Best regards, Bapt --jI8keyz6grp/JLjh Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iEYEARECAAYFAlR1B9MACgkQ8kTtMUmk6EytowCfXO/eip0X7IqxNq44/V8FbgyL UEcAoJV79zZtH6x+T1CaYxOjqQsUJuwg =kaFf -----END PGP SIGNATURE----- --jI8keyz6grp/JLjh-- From owner-freebsd-testing@FreeBSD.ORG Wed Nov 26 04:30:41 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id AE068F02; Wed, 26 Nov 2014 04:30:41 +0000 (UTC) Received: from mail-la0-x235.google.com (mail-la0-x235.google.com [IPv6:2a00:1450:4010:c03::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2E81BABE; Wed, 26 Nov 2014 04:30:41 +0000 (UTC) Received: by mail-la0-f53.google.com with SMTP id gm9so1746006lab.40 for ; Tue, 25 Nov 2014 20:30:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=TEW3E1hphjju9KhLHZIF8V0VxeD6ieyKbUGgkynlXPI=; b=RLoeLDIcSJUL1fU4Y/ijhqR6uCKzqpEqPqZhaR9Rs/x8Mc3u/kQDqdcECOqZ183gjN oboe4l9hr9gxxdYbMqOi6yDJd4QjBURlz35y4qmRwaqmtp2H4O/dvNY4RQVHMFw1PIx/ aciKWyNjA26oCtIs7AV0y4jVBKkyUWaRnpOtiZo1VQcNBOqVrx0i9EcwetyjexvSUw1B GHT0pGpZUMhh8ZsE/HRSZdWwHrowqFgxFkEUm4D2PG/bOqz82+oRiHefQfS2qTvuyYXG 3A6tCom7SFGrAm1P0mV7/2arGt8xGcR3yn6MjkIKQrkmD1bxJij0x55VEayDbQiw0+HS cQIw== MIME-Version: 1.0 X-Received: by 10.152.37.69 with SMTP id w5mr31279042laj.67.1416976239159; Tue, 25 Nov 2014 20:30:39 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.130.168 with HTTP; Tue, 25 Nov 2014 20:30:39 -0800 (PST) In-Reply-To: <5474FF3D.9020003@ShaneWare.Biz> References: <5474FF3D.9020003@ShaneWare.Biz> Date: Tue, 25 Nov 2014 20:30:39 -0800 X-Google-Sender-Auth: o8TQJIRURkFIfz_kMxnELtPKWRw Message-ID: Subject: Re: Testing 10.1 WITH_TESTS From: Craig Rodrigues To: Shane Ambler Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" , FreeBSD stable X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Nov 2014 04:30:41 -0000 +freebsd-testing On Tue, Nov 25, 2014 at 2:14 PM, Shane Ambler wrote: > > Test results can be found at http://shaneware.biz/kyua-tests/ > You might want to join the freebsd-testing@freebsd.org mailing list and report your findings there. That list has people who are more actively looking at the testing framework in FreeBSD. >From your test results: (1) The yacc tests failures are known. Those tests are broken in 10.1-RELEASE. I fixed them in the stable/10 branch: https://lists.freebsd.org/pipermail/svn-src-stable/2014-October/025836.html (2) Regarding the ATF macro test failures, I thought I fixed it with: https://lists.freebsd.org/pipermail/svn-src-stable/2014-September/025633.html I'm not sure if that made it into 10.1-RELEASE. In the stable/10 branch those are not there. For these tests which are failing: local/kyua/testers/run_test:fork_wait__unprivileged_group sbin/mdconfig/legacy_test:main bin/pkill/pgrep-j_test:main I'm not sure why those are failing. -- Craig From owner-freebsd-testing@FreeBSD.ORG Wed Nov 26 04:33:21 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 50E71B0; Wed, 26 Nov 2014 04:33:21 +0000 (UTC) Received: from mail-pa0-x22b.google.com (mail-pa0-x22b.google.com [IPv6:2607:f8b0:400e:c03::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 17362B75; Wed, 26 Nov 2014 04:33:21 +0000 (UTC) Received: by mail-pa0-f43.google.com with SMTP id kx10so2033552pab.30 for ; Tue, 25 Nov 2014 20:33:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=IgHtqef2e1CYaXnFqKu3oHD4jvAaVrEyjfDtusToZrQ=; b=PoC0ASmD33BLF9n6DCLk2Vso0QmkdUQtEA8aJmznGUZaO1luPXAm70K0xRqBEfz0SS 9zkOeHsJycpZxxwcVGHiz2e06dxXf/eLF+WNfPYSnG6kdVrbu25jFOjnVrwg8mGh6jQ3 q9d8ZOtj5kG/sh70dOtpg5oQSJ3K4dOpxrahkJgDzYKekB/ou5nAVS1FmG78rnDeYjRy +DPzFqZN02N8n8m69jSKuuWJ8x3iSzMns4ZTWHaP9mSvuNz6ux5HP5X4eHsl/n/n5iXI 0Nsa8zR4KUMSs2tF+4f3YzSU5+crpvMQVNyIg+7GEAXaWfipPcwBnJO8StM/c4Qw/kRs 5ykQ== X-Received: by 10.66.66.40 with SMTP id c8mr50393858pat.66.1416976400398; Tue, 25 Nov 2014 20:33:20 -0800 (PST) Received: from [192.168.242.58] (c-67-182-131-225.hsd1.wa.comcast.net. [67.182.131.225]) by mx.google.com with ESMTPSA id ju4sm2872567pbc.81.2014.11.25.20.33.19 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 25 Nov 2014 20:33:19 -0800 (PST) Content-Type: multipart/signed; boundary="Apple-Mail=_258FC23A-7A31-46BA-8E55-3254AA3D9626"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Testing 10.1 WITH_TESTS From: Garrett Cooper In-Reply-To: Date: Tue, 25 Nov 2014 20:33:17 -0800 Message-Id: References: <5474FF3D.9020003@ShaneWare.Biz> To: Craig Rodrigues X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-testing@freebsd.org" , FreeBSD stable , Shane Ambler X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Nov 2014 04:33:21 -0000 --Apple-Mail=_258FC23A-7A31-46BA-8E55-3254AA3D9626 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 On Nov 25, 2014, at 20:30, Craig Rodrigues wrote: > +freebsd-testing >=20 > On Tue, Nov 25, 2014 at 2:14 PM, Shane Ambler = wrote: >=20 >>=20 >> Test results can be found at http://shaneware.biz/kyua-tests/ >>=20 >=20 >=20 > You might want to join the freebsd-testing@freebsd.org mailing list = and > report your findings there. That list has people who are more > actively looking at the testing framework in FreeBSD. >=20 > =46rom your test results: > (1) The yacc tests failures are known. Those tests are broken in > 10.1-RELEASE. I fixed them in the stable/10 branch: >=20 > = https://lists.freebsd.org/pipermail/svn-src-stable/2014-October/025836.htm= l >=20 > (2) Regarding the ATF macro test failures, I thought I fixed it = with: >=20 > = https://lists.freebsd.org/pipermail/svn-src-stable/2014-September/025633.h= tml > I'm not sure if that made it into 10.1-RELEASE. > In the stable/10 branch those are not there. >=20 >=20 > For these tests which are failing: > local/kyua/testers/run_test:fork_wait__unprivileged_group I=92m not sure, but I run into this issue frequently (I haven=92t filed = a bug for this yet). > sbin/mdconfig/legacy_test:main Probably https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191191 = (I=92ll fix this tonight). > bin/pkill/pgrep-j_test:main The fix you provided before doesn=92t work 100% unfortunately (because = there=92s another bug in the base system causing this issue). I meant to = bring this up sooner, but I=92ve been busy (sorry :/..) > I'm not sure why those are failing. Cheers! --Apple-Mail=_258FC23A-7A31-46BA-8E55-3254AA3D9626 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUdVgNAAoJEMZr5QU6S73eQ9IH/jdWW8ARjFZohc2W97MBRB08 7rpK7ERYwgZ+ZobUGyewmBvE2GCKMIfDl6aYEo+uQwu8VXZurDAQ1TdYR9Jlg7wo 7DVMCUuSCig6w7RE31revInnXHyaikQVkrlsJOgTpUsnZRI09sVPi5P4U211VUQ3 PiX5JUFFj8X8KKEjPslXaXUAmDpNAVtudgXhXvt51GT1Ano7Z8zW9k+kEvTDvlj+ /2g9pV//i+FxowHgtgXmFAVg5zRZXy2e6VNYRKleZEt+B3vEo6debJVZBm4WsCew aFfwvyqbjAHbxGYqeLN84jhqbsiwofojr7bC/Jos4xpwmx3rulwMC96HI6euZi8= =gNml -----END PGP SIGNATURE----- --Apple-Mail=_258FC23A-7A31-46BA-8E55-3254AA3D9626-- From owner-freebsd-testing@FreeBSD.ORG Wed Nov 26 06:21:57 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 03D1BE9E for ; Wed, 26 Nov 2014 06:21:57 +0000 (UTC) Received: from ipmail06.adl6.internode.on.net (ipmail06.adl6.internode.on.net [150.101.137.145]) by mx1.freebsd.org (Postfix) with ESMTP id 951206C4 for ; Wed, 26 Nov 2014 06:21:56 +0000 (UTC) Received: from ppp14-2-30-215.lns21.adl2.internode.on.net (HELO leader.local) ([14.2.30.215]) by ipmail06.adl6.internode.on.net with ESMTP; 26 Nov 2014 16:51:54 +1030 Message-ID: <54757180.7020702@ShaneWare.Biz> Date: Wed, 26 Nov 2014 16:51:52 +1030 From: Shane Ambler User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.2.0 MIME-Version: 1.0 To: freebsd-testing@freebsd.org Subject: Testing 10.1 WITH_TESTS Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 26 Nov 2014 06:21:57 -0000 First sent to freebsd-stable but freebsd-testing was suggested. Hi there, I currently have two machines running with 10.1 that have been built having WITH_TESTS enabled and kyua installed. Both machines have 3 disks in a raidz zpool. The older machine is a pentium E2140 with 1GB ram and runs through all tests without trouble. My main machine is a corei5 with 8GB ram and does have trouble passing all tests. The local/kyua/integration tests fail to finish, the first run I was getting errors of maxproc limit exceeded, after increasing that to 25,000 I watched top display a process count of between 16,000 and 20,000 depending on the test and all free ram being used up, I saw several outputs like - broken: Test case body timed out [3300.0s], I saw one say failed due to an exception but as I cancelled after 6 hours it didn't save the test results. Test results can be found at http://shaneware.biz/kyua-tests/ (kyua/integration test disabled for the corei5) which also has a copy of src.conf and dmesg.boot as well as /var/log/messages content during tests as there are several entries of test processes exiting on signals 3, 6, 10 and 11 even though the tests pass. It was mentioned that the failing yacc tests have been fixed and the atf-macro tests were removed in stable/10. The tests within local/kyua/integration that fail are cmd_report_junit_test cmd_report_test cmd_test_test -- FreeBSD - the place to B...Software Developing Shane Ambler From owner-freebsd-testing@FreeBSD.ORG Fri Nov 28 18:36:53 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id F34F9E1E; Fri, 28 Nov 2014 18:36:52 +0000 (UTC) Received: from mailA.getsnappy.com (mailA.getsnappy.com [72.29.186.40]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id CEAAB238; Fri, 28 Nov 2014 18:36:52 +0000 (UTC) Received: from [192.168.0.2] (138-229-191-115.dhcp.snlo.ca.charter.com [138.229.191.115] (may be forged)) (authenticated bits=0) by mailA.getsnappy.com (8.14.9/8.14.7) with ESMTP id sASIabei065397 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 28 Nov 2014 10:36:40 -0800 (PST) (envelope-from openjdk@getsnappy.com) X-Authentication-Warning: mailA.getsnappy.com: Host 138-229-191-115.dhcp.snlo.ca.charter.com [138.229.191.115] (may be forged) claimed to be [192.168.0.2] Mime-Version: 1.0 (Mac OS X Mail 8.1 \(1993\)) Subject: Re: Call for Help: openjdk8 tests under Continuous Integration From: Brian Gardner In-Reply-To: <177951AE-71AD-4107-85A8-F8089D164514@getsnappy.com> Date: Fri, 28 Nov 2014 10:36:35 -0800 Message-Id: <8396AB70-4C1F-420A-9BC6-7B832EF91427@getsnappy.com> References: <3B1C0F30-6F75-4095-9347-9053F7F2A8A2@getsnappy.com> <5249371E-629C-4026-A220-60764A8B70C4@getsnappy.com> <177951AE-71AD-4107-85A8-F8089D164514@getsnappy.com> To: Craig Rodrigues X-Mailer: Apple Mail (2.1993) Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Nov 2014 18:36:53 -0000 Hi Craig, I=92ve have some scripts setup. The jtreg produces an xml file for each = jtreg test and a browsable html structure.=0D The process is made up a = two scripts that aren=92t very robust at the moment. The first script = starts up poudriere jail with the testport -I openjdk8 options, copies = the second script and jtreg into the jail, executes it inside the jail, = then shuts down the jail. The second script just executes jtreg for = each subsystem within openjdk that has tests with the appropriate = arguments. I might need to modify the scripts depending on how we integrate them = into Jenkins. Is there somewhere I should commit these too? What are = the next steps to integrating them? Below is an example jtreg xml file PASS JavaTest Message: Test complete. > On Nov 25, 2014, at 12:23 PM, Brian Gardner = wrote: >=20 > Hi Craig, > I=92ll continue the investigation, I=92ve been following the openjdk8 = posts from Kit. I initially ported openjdk8 and was running jtreg tests = as part of the process. If I recall correctly the output was HTML but I = think this is configurable, worse case I probably can convert it into = supported xml format. I=92m thinking we can bake running tests into the = openjdk8 port Makefile, and use poudriere testport and pass in a script = that will upload the results into Jenkins. That should make it really = easy to run and maintain this on all supported platforms. =20 >=20 > Brian >=20 >> On Nov 25, 2014, at 12:11 PM, Craig Rodrigues > wrote: >>=20 >> Hi, >>=20 >> Thanks, Brian! >>=20 >> Well, first of all, we need someone to figure out how to run the = jtreg tests under FreeBSD, >> and make that process reproducible. Would you be willing to do the = initial investigation for this? >> If you look at Kip Macy's postings on the freebsd-java list in = October, you can see that he >> managed to get the tests to run, so hopefully Kip can answer any = questions about what he did to get >> the tests to run. >>=20 >> I'm not familiar with jtreg. What ports are you thinking that we = need to build with poudriere in order to run it? >>=20 >> Le me try to answer your questions: >>=20 >> 1) Let's test on amd64 first, just to iron out all the issues. Once = we get that working, we can add more platforms, such as i386. >> 2) For an initial effort, maybe we can schedule the tests to run = once a week, via the Jenkins job scheduler. We can see if >> it makes sense to run the tests more or less frequently after = that. >> 3) I don't know what format the jtreg test output produces. If it = can produce JUnit XML output, that would be ideal because >> it can be imported directly into Jenkins. If it does not do = that, then even if we make the text output of the test logs available = online, >> that is a good start. >>=20 >> -- >> Craig >>=20 >> On Sun, Nov 23, 2014 at 9:15 PM, Brian Gardner > wrote: >> Hello, >> I=92d like to help. Sounds like those scripts would be fairly easy = to write. Would it be a good idea to try and decouple building of the = ports (using poudriere) from the actual running of the jtreg tests. In = this plan you=92d have a separate job that builds and maintains an = up-to-date repository of packages for the supported platforms (10.0 = amd64, 9.3 i386), then as part of running tests you=92d run pkg to = update the packages as the first step. >>=20 >> I have some questions: >> 1) What platforms will be tested? >> 2) How often will tests run / What will trigger test runs? >> 3) How will results of the jtreg tests be presented on Jenkins? >>=20 >> Brian Gardner >>=20 >>=20 >> In Response To: >>=20 >> Hi, >>=20 >> Recently Kip Macy tried to get the openjdk8 tests working >> under FreeBSD. He struggled a bit: >>=20 >> = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010928.html = >> = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010929.html = >> = https://lists.freebsd.org/pipermail/freebsd-java/2014-October/010930.html = >>=20 >> I think it would be good to get these tests running under FreeBSD >> continous integration. These tests stress things like threading, = memory >> management, networking, and virtual memory. Running these tests >> would go a long way to improving Java support under FreeBSD, >> because it would give a better idea of what can be fixed in FreeBSD = itself. >>=20 >> I am a bit overstretched at the moment to take this on. >>=20 >>=20 >> I need scripts that can do the following: >>=20 >> (1) Download the necessary packages, openjdk8, jtreg, etc. >> (2) Apply necessary patches to packages in (1) >> (3) Build the packages in (1) after patches applied >> (4) Run the tests >>=20 >> I would also like: >> (A) Scripts should be committed to = https://github.com/freebsd/freebsd-ci = >> (B) Script should run under FreeBSD >> (C) Scripts should be easy to run under a Jenkins job at >> https://jenkins.freebsd.org >> (D) Followup status and discussion should happen on >> the freebsd-testing at freebsd.org = mailing = list >>=20 >> Is anyone interested in helping out with this? Starting with some >> of the things that Kip did would be a good place to start. >>=20 >> Thanks. >> -- >> Craig >>=20 >>=20 >>=20 >>> On Nov 23, 2014, at 8:49 PM, Craig Rodrigues > wrote: >>>=20 >>> Hi, >>>=20 >>> Read this: >>> = https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.h= tml = >>>=20 >>> and reply to that posting on freebsd-testing@freebsd.org = (subscribe to that list if you >>> are not on it) with the items that you think that you can >>> complete. >>>=20 >>> -- >>> Craig >>>=20 >>> On Sun, Nov 23, 2014 at 8:28 PM, Brian Gardner = > wrote: >>> Hi Craig, >>> I would like to help. Let me know what I can do. >>>=20 >>> Brian Gardner >>>=20 >>> > On Nov 22, 2014, at 4:40 PM, Craig Rodrigues > wrote: >>> > >>> > FYI, >>> > >>> > = https://lists.freebsd.org/pipermail/freebsd-testing/2014-November/000668.h= tml = >>> > >>> > Please send followups to freebsd-testing@freebsd.org = . >>> > >>> > -- >>> > Craig >>> > _______________________________________________ >>> > freebsd-java@freebsd.org mailing = list >>> > http://lists.freebsd.org/mailman/listinfo/freebsd-java = >>> > To unsubscribe, send any mail to = "freebsd-java-unsubscribe@freebsd.org = " >>>=20 >>>=20 >>=20 >>=20 >=20 From owner-freebsd-testing@FreeBSD.ORG Fri Nov 28 19:32:43 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 22149A5D for ; Fri, 28 Nov 2014 19:32:43 +0000 (UTC) Received: from mail-la0-x22f.google.com (mail-la0-x22f.google.com [IPv6:2a00:1450:4010:c03::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B1BD79FF for ; Fri, 28 Nov 2014 19:32:42 +0000 (UTC) Received: by mail-la0-f47.google.com with SMTP id hz20so6180525lab.34 for ; Fri, 28 Nov 2014 11:32:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=z+JUc0UVK6OvRYb+EZANlRzF0XdunegivILo/PFfm1w=; b=BfjUPdRsM6dRznS9hs1hmbVF2be4o5FZDC/+V4A7EYFnzXj7wIyt4F/ZQcunDS6Sb9 Ot1cg48iShKrpiC2MsvrRshhNK5lP6cnKzWyd3lTf212vulIy8rMhPqVCpDzapLfZFS1 OxLGrMDDjduNOJ41MpHlVDo7RDUoQHyJ1uEW5uTRI7urhkrbOHBPOEQknYRpvB6F2rY7 U+lzyg0gxO2x6ldkFL0oi8ycG0NROGOeyzAzf8FWda29ZfoLUVyAqaM0/K6n1xA+z29v Tj7XWKyhq739zNpph5zASgH0r9Zh3t1lxv0+iW9DyeZN1kko906xfJMWHO9TNnODHCtC 6l8A== MIME-Version: 1.0 X-Received: by 10.152.23.9 with SMTP id i9mr23804824laf.81.1417203160720; Fri, 28 Nov 2014 11:32:40 -0800 (PST) Sender: crodr001@gmail.com Received: by 10.112.130.168 with HTTP; Fri, 28 Nov 2014 11:32:40 -0800 (PST) In-Reply-To: <8396AB70-4C1F-420A-9BC6-7B832EF91427@getsnappy.com> References: <3B1C0F30-6F75-4095-9347-9053F7F2A8A2@getsnappy.com> <5249371E-629C-4026-A220-60764A8B70C4@getsnappy.com> <177951AE-71AD-4107-85A8-F8089D164514@getsnappy.com> <8396AB70-4C1F-420A-9BC6-7B832EF91427@getsnappy.com> Date: Fri, 28 Nov 2014 11:32:40 -0800 X-Google-Sender-Auth: USVIBSLhWfc1xQpSdYRtMgi8WuQ Message-ID: Subject: Re: Call for Help: openjdk8 tests under Continuous Integration From: Craig Rodrigues To: Brian Gardner Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 28 Nov 2014 19:32:43 -0000 On Fri, Nov 28, 2014 at 10:36 AM, Brian Gardner wrote: > Hi Craig, > I've have some scripts setup. The jtreg produces an xml file for each > jtreg test and a browsable html structure. The process is made up a two > scripts that aren't very robust at the moment. The first script starts up > poudriere jail with the testport -I openjdk8 options, copies the second > script and jtreg into the jail, executes it inside the jail, then shuts > down the jail. The second script just executes jtreg for each subsystem > within openjdk that has tests with the appropriate arguments. > > I might need to modify the scripts depending on how we integrate them into > Jenkins. Is there somewhere I should commit these too? What are the next > steps to integrating them? > Thanks for working on this. I think that the XML output you posted looks like JUnit XML, so this will make it a lot easier to integrate into Jenkins. If you are familiar with how to fork a github repo and do a pull request, then the next steps would be: (1) Fork the https://github.com/freebsd/freebsd-ci repo. (2) Make a directory in this repo: scripts/java (3) Put your scripts in that directory (make sure that all your files have a copyright, preferably 2-clause BSD), and commit and push to github. (4) Do a pull request We can then integrate that into the main freebsd/freebsd-ci repository, and do the final work of integrating into Jenkins. -- Craig From owner-freebsd-testing@FreeBSD.ORG Sat Nov 29 01:08:59 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4987CF34 for ; Sat, 29 Nov 2014 01:08:59 +0000 (UTC) Received: from mail-pa0-x22b.google.com (mail-pa0-x22b.google.com [IPv6:2607:f8b0:400e:c03::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0D98DC94 for ; Sat, 29 Nov 2014 01:08:59 +0000 (UTC) Received: by mail-pa0-f43.google.com with SMTP id kx10so7580902pab.16 for ; Fri, 28 Nov 2014 17:08:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=cR78Z9Ufn+XeUzzePXmwm69YSqevuXKMn8+Tff4nxsU=; b=GaK6ifIiaMLBWS/1UcXhCpkKn8Lw3luotftyp3u0XvvtxDVhh7aE3QII0Qh/OpKZur oHgbGkT3nBTfRynv9sewHO4fe9HpqiAdNvh3nl3Pkc19gnXFIoB2rSzNqHhIQZ3bGnYz 90IQtCuh0eiPnOxmKl7BJddB+unD/tGE6fKzGKfyrbVUvRE6LZpeylC+wwWVeJCUdtt+ Xa4t8xe0kYmOpzTVcMrRLDm2DdtmRY7SKlBTy1A7Xg6w9qRIYgQzo6EtyBoxEGKcDk+S txy3BlPo+DZbGCHJOChWA7infXCe/tm8YG8YZjOg6LvdVstDloXa2p1DgBqpuM5WJNft pyAA== X-Received: by 10.67.13.38 with SMTP id ev6mr61901234pad.25.1417223338582; Fri, 28 Nov 2014 17:08:58 -0800 (PST) Received: from ?IPv6:2601:8:ab80:7d6:a454:2110:8cf9:73d4? ([2601:8:ab80:7d6:a454:2110:8cf9:73d4]) by mx.google.com with ESMTPSA id ir2sm10942841pbc.57.2014.11.28.17.08.57 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 28 Nov 2014 17:08:57 -0800 (PST) Content-Type: multipart/signed; boundary="Apple-Mail=_647261B9-98F7-41A6-B3DB-9283B3164409"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: help on testing for FreeBSD... From: Garrett Cooper In-Reply-To: <20141031222548.GR8852@funkthat.com> Date: Fri, 28 Nov 2014 17:08:54 -0800 Message-Id: <29868967-742C-4803-8F10-9642BDB359F0@gmail.com> References: <20141016001543.GD1852@funkthat.com> <69C71414-AE05-4AC2-B07D-23F5569C9FCA@gmail.com> <20141016003822.GE1852@funkthat.com> <20141016005248.GF1852@funkthat.com> <20141024230806.GO82214@funkthat.com> <35585EB9-21D0-4AFC-8BA5-F2DD4968590F@gmail.com> <20141031222548.GR8852@funkthat.com> To: John-Mark Gurney X-Mailer: Apple Mail (2.1878.6) Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 29 Nov 2014 01:08:59 -0000 --Apple-Mail=_647261B9-98F7-41A6-B3DB-9283B3164409 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Just wanted to close out this issue for the archives. John was looking for an example where a test script was being installed = and executed with inputs via files. I suggested the following items in = the tree: - = https://svnweb.freebsd.org/base/head/usr.bin/cut/tests/Makefile?revision=3D= 272783&view=3Dmarkup - = https://svnweb.freebsd.org/base/head/usr.bin/sed/tests/Makefile?revision=3D= 263388&view=3Dmarkup With these examples he was able to integrate the tests into the FreeBSD = *.test.mk framework. Cheers! --Apple-Mail=_647261B9-98F7-41A6-B3DB-9283B3164409 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUeRymAAoJEMZr5QU6S73e1QsIAKmioRWlIIOLk3CxSia73Xlb Bc/le6QxFlqb2WMCg0w8fW/NGuWXuqB6zR0kOVHZIFhp7bO7KCecWzQ9OYs5Ysul axksHTawNB1q1l8L2o7bE0kAqWrPf9M9aE1ZPvnipSMMG5pjIgaKuzmn9ffHW8Yd HUnq5WQ/GJfoT9CqmLz6+3B367z9rml5PS7ovsxeBNL9HdsBgUVbthO695YL8DWK oVF2geR6r31QV4U0jnikL7c3ELo6Pjift84yxLWfptpy1Ste5VB7XnMrOOpjJ2Ns G4nU92kbtdWXZHUjMil+S65vdc9p6yba9Qo15fYxSeJh+rhW/8hHqCtgLopc61M= =rzbP -----END PGP SIGNATURE----- --Apple-Mail=_647261B9-98F7-41A6-B3DB-9283B3164409--