From owner-freebsd-ports@FreeBSD.ORG Tue May 25 07:43:50 2010 Return-Path: Delivered-To: ports@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 60788106566C for ; Tue, 25 May 2010 07:43:50 +0000 (UTC) (envelope-from susanin@ispras.ru) Received: from smtp.ispras.ru (smtp.ispras.ru [83.149.198.201]) by mx1.freebsd.org (Postfix) with ESMTP id C69678FC15 for ; Tue, 25 May 2010 07:43:49 +0000 (UTC) Received: from ispserv.ispras.ru (ispserv.ispras.ru [83.149.198.72]) by smtp.ispras.ru (Postfix) with ESMTP id 56AFF5D40B5; Tue, 25 May 2010 11:39:01 +0400 (MSD) Received: from [10.10.2.130] (winnie.ispras.ru [83.149.198.236]) by ispserv.ispras.ru (Postfix) with ESMTP id 7D2443FC48; Tue, 25 May 2010 11:43:48 +0400 (MSD) Message-ID: <4BFB7F25.2030205@ispras.ru> Date: Tue, 25 May 2010 11:41:25 +0400 From: Andrey Ponomarenko User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.9.1.8) Gecko/20100228 SUSE/3.0.3-1.1.1 Thunderbird/3.0.3 MIME-Version: 1.0 To: Garrett Cooper References: <4BF7C5EC.20500@ispras.ru> In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: ports@freebsd.org Subject: Re: new upstream tracker (linuxtesting.org) X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 May 2010 07:43:50 -0000 On 05/22/2010 11:30 PM, Garrett Cooper wrote: > On Sat, May 22, 2010 at 4:54 AM, Andrey Ponomarenko wrote: > >> Hello, I'm from ISPRAS and we have created an experimental system for >> monitoring and analyzing of upstream libraries development. It may be >> helpful for analyzing risks of updating one of the distribution >> components (shared libraries). The web page of upstream-tracker is: >> http://linuxtesting.org/upstream-tracker/ >> It now includes ABI changes analysis and API shallow test results for >> several versions of 60 popular open source libraries. >> Any bugs or feature requests are welcome. Thanks. >> > Just out of curiosity, is this a system for monitoring the 3rd > party libraries that have been imported into our base system, Yes, you are right > or is it > a generic tool for running testcases? No > I'll poke at it further, in the > meantime, but it would be helpful if an expert could comment on the > issue more :). > I ask because Linux in and of itself doesn't really have a base > system and everything's packages from the get-go, whereas *BSD has a > userland with some 3rd party packages all wrapped into one base > system. > Also, how do you `test' the applications -- using the runtime > tests produced in previous versions, Did you mean a regression tests? We do not run such tests now but have some plans on the future, because it is a very significant aspect of testing. > or by just executing applications > and observing whether or not the API calls pass or fail? > Yes, we just run many test cases (one test case for one particular interface) and searching for segmentation faults and other serious problems in the library API. All test cases are automatically generated straight from the library header files (so-called "header-driven" approach). Also we perform checks for ABI breakages in the sequential versions of the library. > Thanks! > -Garrett > _______________________________________________ > freebsd-ports@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-ports > To unsubscribe, send any mail to "freebsd-ports-unsubscribe@freebsd.org" > > -- Andrey Ponomarenko Linux Verification Center, ISPRAS web: http://www.linuxtesting.org