From owner-freebsd-stable@freebsd.org Sun Aug 21 23:57:55 2016 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AEF93BC045F for ; Sun, 21 Aug 2016 23:57:55 +0000 (UTC) (envelope-from dewaynegeraghty@gmail.com) Received: from mail-it0-x22b.google.com (mail-it0-x22b.google.com [IPv6:2607:f8b0:4001:c0b::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7D5D319AF; Sun, 21 Aug 2016 23:57:55 +0000 (UTC) (envelope-from dewaynegeraghty@gmail.com) Received: by mail-it0-x22b.google.com with SMTP id e63so10765434ith.1; Sun, 21 Aug 2016 16:57:55 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=QI+TCIy7eKWM26xy4v9zdnoRksz/DBq0GiDAcbUzwuk=; b=d+gzPwWxLzbLzRiIX+Of/kKlNJwb+H3czTn24eys/yanYYROAkGnlZxKsbZp9yALa9 xarphRjPucI93fzMJ1U6/OsQFK4VLXMo24Ezfeu0421Gk27eeoAV+zEn3bHiXzI0nKbZ IRH/jUCgy+VGPQtyJ9Z/vVk5AGyZk53r9Wf0tF3T5PjPL4/6GIZcW46Wf0QPPRZBPwBU pdCsoEcZ61CGCXu2sz14dlw2BN/sHpfzWIojRGZUSCYd6o+PrZIhmGVFiBwnlekMG/FF vjg/6/64apuAk52jKYQaQ8IFhBNXHf18S/7BRYMpbUvvxEA5nxiEYT4yafDG8e9yZ2pa ZfRA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=QI+TCIy7eKWM26xy4v9zdnoRksz/DBq0GiDAcbUzwuk=; b=MXrdOY2iyp1X44iZFJgLWQ4+0UWrhLpHM0WdPWydbViBV9u+/cjHC25I9BiKN66CP+ VLXBM3xHNVaaAu4byHuehOOh6Pwhg1FdB+YCa7MzA38/5Fe9jAqNOctCtksHA+iRFoZR vd6u3/brX4n0PRv4uLQW7ub30sMOH6jtJ6qfVmn5NDJJIE31X3h4dD1laAm9vjJlO2LQ lA93lqCyh+fW/7bZTIu4Qc3V0a2QAsjEODkAv1pdRqeKW8gPQlFncy5LH1gqFCF43/hp hqu5InQAAcQAepH+jJph2o6/+8yYRUDK129UO7+gODpI4Sk52Lfd2b7OsaeVmhztHwR+ JdgQ== X-Gm-Message-State: AEkooutKcmYFz7nVJa7mPsp0geAvhunGCbuCg1mre9fc0O/3WpwcF/r5EKetPrtvXylb2+y7M2zQCQ3C4cKPjg== X-Received: by 10.36.28.203 with SMTP id c194mr17900092itc.95.1471823874800; Sun, 21 Aug 2016 16:57:54 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.104.133 with HTTP; Sun, 21 Aug 2016 16:57:24 -0700 (PDT) In-Reply-To: <20160821144505.27c0f55d@X220.alogt.com> References: <20160819073422.4292997b@X220.alogt.com> <20160821144505.27c0f55d@X220.alogt.com> From: Dewayne Geraghty Date: Mon, 22 Aug 2016 09:57:24 +1000 Message-ID: Subject: Re: Benchmarks results for FreeBSD 11 To: Erich Dollansky Cc: Kubilay Kocak , freebsd-stable Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 21 Aug 2016 23:57:55 -0000 Unfortunately people (customers, developers, hardward vendors) make decisions on the basis of bang-for-buck. FreeBSD is consistently underperforming on benchmarks. And regardless of real-world similarity, the contrived benchmarks are the best that is used. If clang (v3.4.1 on 10.3 Stable) really is the cause, then there should be an option to use "whatever" will let the source perform at its best and reflect the stability that we have with FreeBSD. We can criticise the test results or the test regime, but unless knowledgable people respond publicly and/or in the phoronix forums, such as https://www.phoronix.com/forums/forum/software/distributions/891660-benchmarks-2-bsds-vs-7-linux-distributions Then this interpretation of reality will be fixed in decision-makers' minds and consequently the uptake (and support) of FreeBSD. As I recall Michael's testing regime has been consistently criticised (by FreeBSD folks) since he started his website, unfortunately when someone is making public statements and comparisons we really need to have a relationship with them to ensure that FreeBSD's best position is put forward.