From owner-freebsd-testing@FreeBSD.ORG Wed Mar 5 12:33:10 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id C3D3346A for ; Wed, 5 Mar 2014 12:33:10 +0000 (UTC) Received: from relay00.pair.com (relay00.pair.com [209.68.5.9]) by mx1.freebsd.org (Postfix) with SMTP id 7DE6D25B for ; Wed, 5 Mar 2014 12:33:09 +0000 (UTC) Received: (qmail 93415 invoked from network); 5 Mar 2014 12:33:08 -0000 Received: from 87.58.146.155 (HELO x2.osted.lan) (87.58.146.155) by relay00.pair.com with SMTP; 5 Mar 2014 12:33:08 -0000 X-pair-Authenticated: 87.58.146.155 Received: from x2.osted.lan (localhost [127.0.0.1]) by x2.osted.lan (8.14.5/8.14.5) with ESMTP id s25CX7rV077902 for ; Wed, 5 Mar 2014 13:33:07 +0100 (CET) (envelope-from pho@x2.osted.lan) Received: (from pho@localhost) by x2.osted.lan (8.14.5/8.14.5/Submit) id s25CX7hb077901 for freebsd-testing@freebsd.org; Wed, 5 Mar 2014 13:33:07 +0100 (CET) (envelope-from pho) Date: Wed, 5 Mar 2014 13:33:07 +0100 From: Peter Holm To: freebsd-testing@freebsd.org Subject: A shell script test case Message-ID: <20140305123307.GA77355@x2.osted.lan> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.21 (2010-09-15) X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Mar 2014 12:33:10 -0000 I tried my hand with a test scenario for a current FreeBSD VM problem: At first I did not understand what I did wrong when I got: $ kyua test vm_pageout_test vm_pageout_test:__test_cases_list__ -> broken: Tester did not exit cleanly: kyua-atf-tester: Test program list did not return success [0.000s] 0/1 passed (1 failed) Committed action 15 $ but I figured it out. Now to the real question: Are regression tests like this one really ATF material? I would think that the long runtime could be prohibitive? $ kyua debug vm_pageout_test:basic FAIL UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND 0 662 1 0 52 0 10268 0 pause IWs - 0:00.00 nfsuserd: master (nfsuserd) 25 845 1 0 20 0 12796 0 pause IWs - 0:00.00 sendmail: Queue runner@00:30:00 for /var/spool/clientmqueue (sendmail) 0 850 1 0 20 0 10024 0 nanslp SWs - 0:00.00 /usr/sbin/cron -s 1001 4069 4068 0 20 0 11808 0 wait IWs 0 0:00.00 -bash (bash) 0 4115 4069 0 20 0 10496 0 wait IW 0 0:00.00 su 0 4116 4115 0 23 0 10772 0 pause IW 0 0:00.00 _su (csh) 1001 4354 4353 0 20 0 11808 0 wait IWs 1 0:00.00 -bash (bash) 0 4416 4354 0 20 0 10496 0 wait IW 1 0:00.00 su 0 4417 4416 0 23 0 10772 0 pause IW 1 0:00.00 _su (csh) 0 4419 4417 0 20 0 11808 0 wait IW 1 0:00.00 bash 0 6838 4419 0 52 0 13412 0 wait IW+ 1 0:00.00 kyua debug vm_pageout_test:basic 0 6857 6838 0 52 0 9900 0 wait IW 1 0:00.00 /usr/local/libexec/kyua-atf-tester -t1200 test -vhas.cleanup=false -vunprivileged-user=tests /usr/tests/sys/vm/vm_pageout_test basi vm_pageout_test:basic -> failed: Failed $ kyua test vm_pageout_test vm_pageout_test:basic -> failed: Failed [367.941s] 0/1 passed (1 failed) Committed action 14 $ -- Peter