From owner-freebsd-testing@FreeBSD.ORG Mon Jul 28 21:18:56 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 7E49D3B3 for ; Mon, 28 Jul 2014 21:18:56 +0000 (UTC) Received: from mail-qg0-f53.google.com (mail-qg0-f53.google.com [209.85.192.53]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3B32C24B7 for ; Mon, 28 Jul 2014 21:18:55 +0000 (UTC) Received: by mail-qg0-f53.google.com with SMTP id q107so9172271qgd.40 for ; Mon, 28 Jul 2014 14:18:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc:content-type; bh=OXOVFajHaPw2iQinMBTIAzT+CqBxJXFbrcKvwcF5n6I=; b=O7ebxW+KpZJhOofatOTeQ/x2GYcU4kUlxx+nWenv5xMitIfcHamKwQSI+an7Oio/JX XYjlaNjJv36qcRkc5xwdZUcqxSC0P5qxjZV1Lj+5y+qX4IYg0PeD79fR9D3Bv9Tzo/m1 sH4wt4BwhR2XR3tsGd5Nk6uHGn5DLDPrznY1hXTU1Tx8WEHaFqmZzlzwCTJPyFMmc1oU 9YJYNRTLwKb79kg5AXpXCnSDKs16Q6jcXktIvCof1X+WUJ5/WnFzg0Kn2r3XPk/bj04/ 4jcBDZKCX5RSbLDGtkGawdc8TXkq8J9xDAC2CeTGzqyy+0wXv8HhMteAjDACtCLYCrI/ lTBA== X-Gm-Message-State: ALoCoQmrMS3UkUg/bdMSmJMARU4GP9k4xRuq+0q2SfDvpmcdhJ8iL+Y8gKprVZ/KcAGv8YDqHKRV X-Received: by 10.224.26.146 with SMTP id e18mr4148462qac.13.1406582328712; Mon, 28 Jul 2014 14:18:48 -0700 (PDT) MIME-Version: 1.0 Sender: jmmv@meroh.net Received: by 10.96.83.99 with HTTP; Mon, 28 Jul 2014 14:18:28 -0700 (PDT) X-Originating-IP: [2620:0:1008:100a:1cf4:b8ab:9755:55fa] In-Reply-To: References: <5ee51891.12b049e9@fabiankeil.de> <450da50a.02ce9897@fabiankeil.de> From: Julio Merino Date: Mon, 28 Jul 2014 14:18:28 -0700 X-Google-Sender-Auth: PJC_7-u1htxpm-LXGxiNWZ6GLuY Message-ID: Subject: Re: Missing atf-check output: example:failing_test -> failed: atf-check failed; see the output of the test for details To: Alan Somers Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2014 21:18:56 -0000 On Mon, Jul 28, 2014 at 9:11 AM, Alan Somers wrote: > On Sat, Jul 26, 2014 at 2:58 AM, Fabian Keil > wrote: >> Not showing test failures on the cli by default seems like a strange >> design decision to me, but I guess I'll get used to it or write a >> wrapper script that calls kyua debug for all tests. Test failures are shown on the CLI by default. What is not shown is the output of the test cases. It'd be too verbose and would prevent having any sense of progress of the execution. Making it an option to display the output during "make test" is a reasonable request but it's also non-trivial at the moment. Feel free to file a feature request for this. > I don't recommend calling "kyua debug" for all tests. The best > approach is to run "kyua test; kyua report-html ". The HTML > report will show you the full stdout and stderr output of each failing > test case. We should actually just make "kyua report" show the stdout and stderr, and this is easier to do. Having to resort to report-html is... just ugly. I just haven't thought about a UI for it. Maybe "kyua report --show-output [test cases]" would be good enough?