From owner-freebsd-fs Mon Jan 24 16:31:55 2000 Delivered-To: freebsd-fs@freebsd.org Received: from smtp04.primenet.com (smtp04.primenet.com [206.165.6.134]) by hub.freebsd.org (Postfix) with ESMTP id 17E4C15285 for ; Mon, 24 Jan 2000 16:31:47 -0800 (PST) (envelope-from tlambert@usr06.primenet.com) Received: (from daemon@localhost) by smtp04.primenet.com (8.9.3/8.9.3) id RAA00734; Mon, 24 Jan 2000 17:10:49 -0700 (MST) Received: from usr06.primenet.com(206.165.6.206) via SMTP by smtp04.primenet.com, id smtpdAAAgHaWxb; Mon Jan 24 17:10:42 2000 Received: (from tlambert@localhost) by usr06.primenet.com (8.8.5/8.8.5) id RAA13267; Mon, 24 Jan 2000 17:11:00 -0700 (MST) From: Terry Lambert Message-Id: <200001250011.RAA13267@usr06.primenet.com> Subject: Re: File system tests To: fwmiller@macalpine.cornfed.com (Frank W. Miller) Date: Tue, 25 Jan 2000 00:10:59 +0000 (GMT) Cc: freebsd-fs@FreeBSD.ORG, fwmiller@macalpine.cornfed.com (Frank W. Miller) In-Reply-To: <200001240310.WAA12877@macalpine.cornfed.com> from "Frank W. Miller" at Jan 23, 2000 10:10:58 PM X-Mailer: ELM [version 2.5 PL2] MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-fs@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.org > What I'm looking for is a test suite that can be used to exercise a POSIX > file system interface. I'm looking for two kinds of tests: > > 1) Tests of individual routines to make sure they work correctly, i.e. > return the right values when various error conditions are thrown at them. > > 2) A test or set of tests that will exercise the file system over a long > period of time, perhaps throwing random operations at it or perhaps > using distributions to throw various operations at it. > > Anyone know of such a test suite? What sort of code is used to test the > FreeBSD file systems for things like regression testing? To answer the last question first, "release". For POSIX conformance testing, you will probably want to grab a copy of NIST/PCTS -- "National Institute of Standards and Technology POSIX Conformance Test Suite". It is available for download from the NIST FTP server. Historically, I've also used the SVID III validation suite, at least for SVR4 based systems. If your "other OS" is a UNIX OS, then you will probably be able to wrangle a copy of this under that license. You will also meed TET -- "Test Environment Toolkit"; it is a framework for running validation suites. If you are going to write your own branch-path validations, or unit tests, you may also want to grab ETET -- "Extended" TET. For unit validation under FreeBSD, you might want to check out my kernel memory leak detection code; it is a validation suite that combines the ability to do unit tests with the ability to see any resulting kernel memory leaks. It's not very up to date at present, but it comes with a validation set for path name buffer leak detection on FreeBSD, so it is probably a good example of a branch path validation tool for system call interfaces. You can find it at: http://www.freebsd.org/~terry/testset.txt http://www.freebsd.org/~terry/testset.tar.gz.uu Terry Lambert terry@lambert.org --- Any opinions in this posting are my own and not those of my present or previous employers. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-fs" in the body of the message