From owner-freebsd-arch@FreeBSD.ORG Wed Dec 29 10:46:29 2010 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A80C31065670; Wed, 29 Dec 2010 10:46:29 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50]) by mx1.freebsd.org (Postfix) with ESMTP id DD1458FC16; Wed, 29 Dec 2010 10:46:28 +0000 (UTC) Received: by wwf26 with SMTP id 26so9742701wwf.31 for ; Wed, 29 Dec 2010 02:46:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:sender:received :in-reply-to:references:date:x-google-sender-auth:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=PByus0SLbpKY9gM+H5U0vAth/G3JMc+zIB2KOZKgde4=; b=ecl6oWQnMVNcDZ4/z5xkxUt6BLfxIcxHmClaeYuqMoTowjXJqnSoylP+5EFxvGE60w xyNOYVdtQFuRi8oqmGtuaNCXzm0duhue6x0zf0x7YMChLd5Y/4d900SlPNL8bnzMh+S3 O9Fz5cIJnYXRwbmiVVwdLilv3g8SQ3e7ukS/k= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=OcFysTD5sIGac89oRI4j2sXAvbVC4Srv/s5vULnxu9EGYx3KcEmPemxIAdIlgskowX pewd0fiZr14wnNIvTP+MPBy20SAtWqEEM209K3BhkskATPJRRCx3LxK+OYLa5KKf8tbm PMOha4Dq3qr2RFxeoCRg0eOKWteKDqA6CA/FU= MIME-Version: 1.0 Received: by 10.216.141.75 with SMTP id f53mr2489955wej.16.1293619587398; Wed, 29 Dec 2010 02:46:27 -0800 (PST) Sender: yanegomi@gmail.com Received: by 10.216.254.226 with HTTP; Wed, 29 Dec 2010 02:46:26 -0800 (PST) In-Reply-To: <20101229000412.000049ee@unknown> References: <201012211500.16131.jhb@freebsd.org> <20101229000412.000049ee@unknown> Date: Wed, 29 Dec 2010 02:46:26 -0800 X-Google-Sender-Auth: erwFATuu74GjpmQk4kb782qbPbw Message-ID: From: Garrett Cooper To: Alexander Leidinger Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: mdf@freebsd.org, Robert Watson , Erik Cederstrand , freebsd-arch@freebsd.org Subject: Re: Schedule for releases X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 29 Dec 2010 10:46:29 -0000 On Tue, Dec 28, 2010 at 3:04 PM, Alexander Leidinger wrote: > On Wed, 22 Dec 2010 08:21:56 +0100 Erik Cederstrand > wrote: > >> Den 21/12/2010 kl. 23.28 skrev Robert Watson: >> >> > >> > Looking at 7.x, I'm struck by how much it has slowed down. =A0There's >> > a significant user community, but not a significant developer >> > community. >> >> Which pretty much sums up a dilemma in the development of FreeBSD, I >> think. Developers want users to try out their new shiny stuff, but >> users don't want to spend time upgrading. >> >> I think one of many things that would be great to do is to improve >> the usability and coverage of the regression tests. This would take >> at least some of the burden off developers who want to MFC their >> work. We already have the tinderboxes, Coverity and Clang Static >> Analyzer, but apart from pho's stress tests we don't have any >> automated runtime testing (as far as I know). > > Your benchmark suite can not be used for something like this? With the > regression tests as the benchmarks? BTW: real benchmarks are also some > kind of regression tests, Sometimes, but we are lacking in the functional tests department in areas and that's something in coverage that needs to be filled out. Stress tests/benchmarks can exercise a lot or a little code and can create unnecessary results variance depending on how they're written, as I'm sure everyone posting on the list to this topic is aware. Thanks, -Garrett