From owner-freebsd-testing@FreeBSD.ORG Mon Jul 28 21:27:09 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BD0BA5AE; Mon, 28 Jul 2014 21:27:09 +0000 (UTC) Received: from mail-wi0-x230.google.com (mail-wi0-x230.google.com [IPv6:2a00:1450:400c:c05::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 1078C259E; Mon, 28 Jul 2014 21:27:08 +0000 (UTC) Received: by mail-wi0-f176.google.com with SMTP id bs8so5147273wib.3 for ; Mon, 28 Jul 2014 14:27:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=SFDOXdDZ6H7EmmCF47KPF/Nle6ARgOJCFmYoOhKglzw=; b=ND+2gHysSwsRWxmYKBu6huVopg/PykKHf1p6/aEKtmR10f49peQrMS7C/lt8IWebgJ exGn1vOPi0iVVhXBIKnJ9jlvzbg/79t3yYakzBGe4jygUK8x2NrFqXR5J1qWSPWmI1TC DZ7kj8F9qF26KIqnooENrrqLURErz7NYxY070lXkRWF/Dp5NxEbWG48OgqdSTOrcr22p m38NxfkmRbIZkKVHETrtJ5DIcTit+dKAm+SHrXF4/VlC+LrVgt9/4dKxjH9HiEXoc8Jj 0HVRWEu6id5i6ob8rXB9WpyJDyYMxksDjxDoKgFCaNf1ALLtqHJtgBqmaYAWijqvneyl n+XA== MIME-Version: 1.0 X-Received: by 10.194.92.33 with SMTP id cj1mr4170844wjb.66.1406582826969; Mon, 28 Jul 2014 14:27:06 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.194.203.134 with HTTP; Mon, 28 Jul 2014 14:27:06 -0700 (PDT) In-Reply-To: References: <5ee51891.12b049e9@fabiankeil.de> <450da50a.02ce9897@fabiankeil.de> Date: Mon, 28 Jul 2014 15:27:06 -0600 X-Google-Sender-Auth: j7KUq6su8YMGQNUZykttE5qTHtE Message-ID: Subject: Re: Missing atf-check output: example:failing_test -> failed: atf-check failed; see the output of the test for details From: Alan Somers To: Julio Merino Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-testing@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Jul 2014 21:27:09 -0000 On Mon, Jul 28, 2014 at 3:18 PM, Julio Merino wrote: > On Mon, Jul 28, 2014 at 9:11 AM, Alan Somers wrote: >> On Sat, Jul 26, 2014 at 2:58 AM, Fabian Keil >> wrote: >>> Not showing test failures on the cli by default seems like a strange >>> design decision to me, but I guess I'll get used to it or write a >>> wrapper script that calls kyua debug for all tests. > > Test failures are shown on the CLI by default. What is not shown is > the output of the test cases. It'd be too verbose and would prevent > having any sense of progress of the execution. > > Making it an option to display the output during "make test" is a > reasonable request but it's also non-trivial at the moment. Feel free > to file a feature request for this. > >> I don't recommend calling "kyua debug" for all tests. The best >> approach is to run "kyua test; kyua report-html ". The HTML >> report will show you the full stdout and stderr output of each failing >> test case. > > We should actually just make "kyua report" show the stdout and stderr, > and this is easier to do. Having to resort to report-html is... just > ugly. > > I just haven't thought about a UI for it. Maybe "kyua report > --show-output [test cases]" would be good enough? How about "kyua report --verbose". Seems more conventional. -Alan