From owner-soc-status@freebsd.org Sun Jul 30 13:52:53 2017 Return-Path: Delivered-To: soc-status@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 777ABDBC365 for ; Sun, 30 Jul 2017 13:52:53 +0000 (UTC) (envelope-from shivanshrai84@gmail.com) Received: from mail-qt0-f172.google.com (mail-qt0-f172.google.com [209.85.216.172]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3655A72C48; Sun, 30 Jul 2017 13:52:52 +0000 (UTC) (envelope-from shivanshrai84@gmail.com) Received: by mail-qt0-f172.google.com with SMTP id s6so107043805qtc.1; Sun, 30 Jul 2017 06:52:52 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=BS/rLukAqVJEd/K0xnRfiq14WXeNpv2k5pN0Rs9+hZo=; b=k5QDp5ksDHXXVeGpSd/+1BBt1J7Px6ZDhfX2ZkW+2uHOLl42oJr1uxXZLSce7DmMgv ivYKwOK7Jxda1vHOlyZzOIOYSuxmFsUBclxv641ZMNKbobQcZtDA6Ob2kcTmZv/bU0uO OP3Z8A2xTbjHikDwIh5NgPM4in14m83nDnER00u62amkgBByr9HazHuTE0A9BQdrSKD9 77Xa8MX4PONSx3v80CrYLOYVmIVLzrxxbvyivYQXWjt+tZNNdqKzR1jam6RtbacNf97R 0XXMBcZKPKth3fkuLjD/Ijxyib6voXKsnSzmHIFqquW28thoiLGpmz+jhnEY5Oiwdwmw ML7Q== X-Gm-Message-State: AIVw1136C3mmSJdauzUSEFEbf2yZWucKWY1Cuw8pSqbBIxNk6u1R7WER n2A1tEt+hQfKChGN5s8= X-Received: by 10.200.47.93 with SMTP id k29mr18545169qta.18.1501422766459; Sun, 30 Jul 2017 06:52:46 -0700 (PDT) Received: from mail-qk0-f175.google.com (mail-qk0-f175.google.com. [209.85.220.175]) by smtp.gmail.com with ESMTPSA id 39sm15219955qtp.89.2017.07.30.06.52.45 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 30 Jul 2017 06:52:46 -0700 (PDT) Received: by mail-qk0-f175.google.com with SMTP id x191so70552192qka.5; Sun, 30 Jul 2017 06:52:45 -0700 (PDT) X-Received: by 10.55.93.197 with SMTP id r188mr17750520qkb.277.1501422765469; Sun, 30 Jul 2017 06:52:45 -0700 (PDT) MIME-Version: 1.0 From: Shivansh Rai Date: Sun, 30 Jul 2017 13:52:35 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: [GSOC17] Smoke testing of all base utilities - Week 8 To: "soc-status@freebsd.org" Cc: Alan Somers , Brooks Davis , "Ngie Cooper (yaneurabeya)" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: soc-status@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Summer of Code Status Reports and Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 30 Jul 2017 13:52:53 -0000 Hello all, I would have sent the progress report yesterday, but I was stuck on figuring out a segfault which was finally fixed today [1]. (I need to get back using gdb again). This is the progress made in this week - Summary of updates to the automation tool since last progress report [2]. I have made a new repository for collecting generated tests [3] which currently contains 57 (+/- 5) tests for utilities randomly selected from section 1 via the script "fetch_groff.sh" [4]. This repo will be updated with all the generated tests in future. Currently some of these tests are machine dependent, but after I implement the functionality to automate test runs [5] (and hence generate annotations), these testcases will go away. Generating these tests have made me come across many new cases (which was the intended purpose) which can be looked up in the issues which I keep marking (and fixing) [6]. Also, earlier all the options were not being properly parsed from the groff scripts, and with this fix [7] I was able to generate a few more testcases for the demo tests. Will reflect the updates via these in the test repo soon. Quoting an earlier mail regarding my current involvements which I previously shared with mentors - I am currently working on a functionality to stop execution of tests which hang after a certain duration (I am using boost::thread for the purpose) [8]. This will be helpful in generating a large number of tests without halting on failure while generating a single test. Although the problem is that after successful compilation, the execution step ends up giving a segmentation fault when I use boost libraries. I suspect the problem is due to improper linking of object files (inclusion of improper boost libs in Makefile) or probably I am not using proper compilation flags ; so trying figuring it out (experimenting with boost for the first time). [1]: https://github.com/shivansh/smoketestsuite/commit/878006372203304899da7d767efaeb2635a394b8#diff-8e67877206f06d959fc79bf00d0182a9R98 [2]: https://github.com/shivrai/smoketestsuite/compare/12d88b...efc325 [3]: https://github.com/shivansh/smoketests [4]: https://github.com/shivansh/smoketestsuite/blob/master/scripts/fetch_groff.sh [5]: https://lists.freebsd.org/pipermail/soc-status/2017-July/001094.html [6]: https://github.com/shivansh/smoketestsuite/issues?q=is%3Aissue+is%3Aclosed [7]: https://github.com/shivansh/smoketestsuite/commit/d180b365fb587a789ae1a30074e8808c22652390 [8]: https://github.com/shivansh/smoketestsuite/commit/6f0ce7950ca2c6d9265eb8933f9e50960b1c0e76 Thank you. With best regards, Shivansh Rai