From owner-soc-status@freebsd.org Sun Jul 23 10:14:02 2017 Return-Path: Delivered-To: soc-status@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A426ACFE033 for ; Sun, 23 Jul 2017 10:14:02 +0000 (UTC) (envelope-from kneit@pdx.edu) Received: from mail-oi0-x234.google.com (mail-oi0-x234.google.com [IPv6:2607:f8b0:4003:c06::234]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 754567FB6F for ; Sun, 23 Jul 2017 10:14:02 +0000 (UTC) (envelope-from kneit@pdx.edu) Received: by mail-oi0-x234.google.com with SMTP id a9so5150004oih.0 for ; Sun, 23 Jul 2017 03:14:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pdx-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=RF54nhgFRTH9SHHfiknGMIBl/XlrwGTs/38u0YORngI=; b=HGj/z3i679M9IUeTaut/F6m1l1KygrbVevsR3cEQBcg4KJUTzem8c9MwmLq4Fhe4NT bTrulU97OYG/0CKxpzydsPbhrqrICKl91qQpnYJuIR/Q1MOXMmvbkZbW8wYZi3I9WNea 5CRGkS2xx71QF44uqlvqY+OoJvKLH9V3Z0hfx9YgvVFu0jTKyQjzrwR8m7RvXxmTf/ZW fIptARZcqAICenRQii1UFWlzI9tfWDC3EFOukqn2GnigrvU8bcDY1V9FOu5I9I5o4aMu ja8zkMIzgqGG4wdoQTdd45nQbHyd7Lh8hG1c06kCp4sVcFhuow/merZgRQX6VWj8fnrZ 18cQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=RF54nhgFRTH9SHHfiknGMIBl/XlrwGTs/38u0YORngI=; b=O6IYLivRDiZFRRBiuyQoV0Y0QzcEWX8pfajvoM3TEuaHsh+w8W90H80XvVLk0UvEv2 b7CrFPWFCf33yoY1iJjJh/4UtJw46y2VpYTcL1J5abA/Fk9GYeR3V5DbifaQ7KtXTWFQ T2O8l20yXi55c4fnK4Ws/4k1RXaUc0sXXEE78C5aoZ6dOhe0hwiE/0aElUJWL3p/9VCB amSdNEUE+oqZ47b6UAUUe8UvHztroF8BVMa2E8G/4TQicb0IfJ5RY4hYBvH3a5N4iL2y hMEnolwpW1n/qcKOtMJl8sfPc2fwE9zmsrmrlaF6zmfdT8qR+lOKlN1AIJzZJbXiZZ7N GBww== X-Gm-Message-State: AIVw110XLz/FCFAfIs/rN2jy+1wPm9xcZfLeyhbV6B1Uejtitd583LiD enLj1A67hRZc/4Nc6wATvpqyJO2EnxGO X-Received: by 10.202.80.66 with SMTP id e63mr270175oib.110.1500804841042; Sun, 23 Jul 2017 03:14:01 -0700 (PDT) MIME-Version: 1.0 Received: by 10.202.80.211 with HTTP; Sun, 23 Jul 2017 03:14:00 -0700 (PDT) From: Kyle Kneitinger Date: Sun, 23 Jul 2017 03:14:00 -0700 Message-ID: Subject: Libbe/be Status Wk 7 To: soc-status@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: soc-status@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Summer of Code Status Reports and Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Jul 2017 10:14:02 -0000 Hello All! This week was a little slow in terms of progress due to some personal things, however I'm still content with the progress I made. I'm moving into the final phase of my project, the support for recursive boot environments, and spent this week improving my overall code quality of everything else. There is still a bit to due on that front, but I have a lot of internet-less travel ahead of me, which would be a perfect time to work on that and documentation. I cut out a ton of redundant error checking that is handled by libzfs, corrected a dependency error I had made (use of libbe in a userspace prog used to require cflags for including libzfs, which is not present outside of src). Except for pretty listing of boot env info and a couple little adjustments here and there, my `be` command is feature compatible with `beadm` now, which is exciting. I'm going to BSDCam on the 1st, and want to have a decent understanding of the current boot handling of boot envs and how to adapt them for children datasets before I get there, so this next week will be a lot of src-reading, asking Allan questions, and documenting my findings. Take care! Kyle From owner-soc-status@freebsd.org Sun Jul 23 13:36:10 2017 Return-Path: Delivered-To: soc-status@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9C2FDD7E8A7 for ; Sun, 23 Jul 2017 13:36:10 +0000 (UTC) (envelope-from shivanshrai84@gmail.com) Received: from mail-qt0-f173.google.com (mail-qt0-f173.google.com [209.85.216.173]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6044C209B; Sun, 23 Jul 2017 13:36:09 +0000 (UTC) (envelope-from shivanshrai84@gmail.com) Received: by mail-qt0-f173.google.com with SMTP id r14so25650567qte.4; Sun, 23 Jul 2017 06:36:09 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=MxLtcUKyznrvzyk/b+Kfinbp9IvK2cX0yj90kpNBp2M=; b=eJKsiXDxEAmReMgQvecqunu1ZIukUkBn9URG7fxTM5oNiZ55OsnPumRLyw19+4WYQq MXvnz+KwD2wo6oK0Pzh7xDc/RbRED7VhbtYoS14gsNDKs15ba6wIcKLBo9dg4QL2iaaL ud9sj2paTqqfmBVqvgCIdmAjSwL6It5nITMmmr2tkJaX7aqTa5FSel6daqfvBl4c+oUa 7hIJPJRGmthOiIqc06BQ9/lrizfGwyz/SxmHcdwBATsDurxJiiEWJCmpfnKokXVzolS0 lYZJCPryL0lrgtsf2cgiQTn3YIsrhu3lptA5Y2i1jl/wuo5p8RvOYjh5sj415IoMpWO0 TRww== X-Gm-Message-State: AIVw111UGglHQNd20/Xsm7Zxd3BSvTk8yGohKh/0VC6PG6/NkvXg1aW1 XqY3wDpHniFXZ1x3ZwY= X-Received: by 10.200.41.172 with SMTP id 41mr17520229qts.85.1500816646000; Sun, 23 Jul 2017 06:30:46 -0700 (PDT) Received: from mail-qk0-f173.google.com (mail-qk0-f173.google.com. [209.85.220.173]) by smtp.gmail.com with ESMTPSA id p52sm6923553qtc.74.2017.07.23.06.30.45 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 23 Jul 2017 06:30:45 -0700 (PDT) Received: by mail-qk0-f173.google.com with SMTP id d145so33757265qkc.2; Sun, 23 Jul 2017 06:30:45 -0700 (PDT) X-Received: by 10.233.235.132 with SMTP id b126mr17560813qkg.262.1500816645184; Sun, 23 Jul 2017 06:30:45 -0700 (PDT) MIME-Version: 1.0 From: Shivansh Rai Date: Sun, 23 Jul 2017 13:30:34 +0000 X-Gmail-Original-Message-ID: Message-ID: Subject: [GSOC17] Smoke testing of all base utilities - Week 7 To: "soc-status@freebsd.org" Cc: Alan Somers , Brooks Davis , "Ngie Cooper (yaneurabeya)" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: soc-status@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Summer of Code Status Reports and Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 23 Jul 2017 13:36:10 -0000 Hello all, My apologies for a late progress report (~3 days), I was involved in shifting my belongings to a new residence as final year is about to start. A brief summary of the updates made to the tooling in the past week is available here [1]. The tool can now generate annotations based on failed testcases during a test runtime. The annotation file contains the name of testcases which we don=E2=80=99t want to be added in the tests generated in future runs. An ex= ample for these kind of testcases are the ones produced previously in date(1) - since most testcases were time/timezone dependent, one would prefer not to include them in the generated test script. Hence, the annotation file for date [2] contains all those testcase names. The newly generated test for date(1) only has the successful testcases [3]. @brooks suggested that maintaining annotations in a separate file has an advantage of not disrupting the existing test scripts. For each generated test script in =E2=80=9Cgenerated_tests/*=E2=80=9D, we m= aintain a corresponding annotation file in =E2=80=9Cannotations/=E2=80=9C (in case th= ere are failing testcases). For e.g. the annotation file for =E2=80=9Cgenerated_tests/date_= test.sh=E2=80=9D is =E2=80=9Cannotations/date_test.annot=E2=80=9D. A brief pseudocode for generating annotations is as follows - for test_script in generated_tests/* run $test_script via `kyua test` # The above step is yet to be implemented as a # few things have to be kept in mind such as: # - placing the test_script in a correct destination # - if the makefile exists, updating it; if not, then generating it # - appropriately updating "etc/mtree/BSD.tests.dist" extract failing testcases via `kyua report` generate annotations for $test_script based on failed testcases if annotation file exists append newly found annotations end if I was unable to find a good interface for extracting exit statuses of individual testcases from a test run (need to search more), hence extracted the same from the output of kyua report. The current method will be updated if I come across a cleaner approach. Refactoring of the codebase is in progress alongside as I read C++11 guidelines and good practices. On a different note, my PR for adding the atf_check_not_equal function to atf-sh was merged [4]. Once the new version of atf(7) is released, corresponding updates will be made which led to the creation of this PR [5]= . The next task is to populate the annotation files pertaining to different architectures and test environments (will be automated). If a particular testcase fails in any case, we add a corresponding annotation as the generated tests should be architecture/environment independent. Also, the first step in the above pseudocode will be implemented. [1]: https://github.com/shivrai/smoketestsuite/compare/2bf499...12d88b [2]: https://github.com/shivrai/smoketestsuite/blob/master/tool/annotations/date= _test.annot [3]: https://github.com/shivrai/smoketestsuite/blob/master/tool/generated_tests/= date_test.sh [4]: https://github.com/jmmv/atf/commit/0824235a3bcb45f16e1dfae7dce347e2d8b10d26 [5]: https://reviews.freebsd.org/D11084?id=3D29301#inline-65206 Thank you. With best regards, Shivansh Rai =E2=80=8B From owner-soc-status@freebsd.org Mon Jul 24 14:49:40 2017 Return-Path: Delivered-To: soc-status@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 37535C7FB4D for ; Mon, 24 Jul 2017 14:49:40 +0000 (UTC) (envelope-from sux2mfgj@gmail.com) Received: from mail-wm0-x230.google.com (mail-wm0-x230.google.com [IPv6:2a00:1450:400c:c09::230]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id C415D6ABF4 for ; Mon, 24 Jul 2017 14:49:39 +0000 (UTC) (envelope-from sux2mfgj@gmail.com) Received: by mail-wm0-x230.google.com with SMTP id t201so21302140wmt.1 for ; Mon, 24 Jul 2017 07:49:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=xLgKr4X3OVML2N9Qvk71QyhiIjcX9+Sd2d2eHf5XVzw=; b=swehUOWJvILcRkegTIZVbelouuwK6TVeUDS3AHRz0r1ygmg3g/UF7rtvf/eV12c4mU BNIuEFa7pP8UYm+M0ICLQr+L0Okdhngp/qTbic/KsvcddAjBOr+we4W4yQaRntQFr5uo F8+jo/1jgoE6c+9FJtYcxknZVEkxkkFzWwbazdgxgS2dKNQmKVf5R+XG5OWukXi4WCdn WLtzUtiIt6VylVmU3i+jFLt9EGXKWDHiuvTISJ+Q6TOt+ubT4lGOfyyMIvdF/t82T4VV FVdo+IwwCmH/wVRAEAzsAv7LnlzZT58ZOx+Il/kLa2O+pFeU7nfZ5HpH1DvY9XZ8SlJh zgSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=xLgKr4X3OVML2N9Qvk71QyhiIjcX9+Sd2d2eHf5XVzw=; b=XQxRACe5LMCeyp4RyMCMBicrayRk85L0CTo+mflTJzVbj7EGdCmHqhZ8vxuClpzvh1 pXf/xrwp+Q1VT0q0IhFbqfHGldVW2Vv+x4FxoHsZAxS8aXOHLdkgm7lw7ftTZvt3SX5k NU8sl3OrrXLvLi4A+EGfDcQ22Cgx6o+f5QwuwGl+hvssPds9IEx1ez74t1o/NF8xXnwD SjkofOpiIytf2zh/2Ib2c8bV735J4UBMYyN7bhA5DGlK4iMrygL0AEu0Zo8sJH0WXKG8 dBE2iUbKCDRxKlgGMfieLDWStNjjbI8cG8jg6kObFIFRGHVSk8k6H/Q2qhPSi9qqeHXP wNgA== X-Gm-Message-State: AIVw113e+WTsqREh72P4LyOQS7WGGfam8rdccYCjzA/xqXwW9Ofp6Rtt nyrjrVRKml9OEGqQViD9+qDnzBSGPA== X-Received: by 10.28.138.194 with SMTP id m185mr902401wmd.116.1500907777256; Mon, 24 Jul 2017 07:49:37 -0700 (PDT) MIME-Version: 1.0 From: Shunsuke Mie Date: Mon, 24 Jul 2017 14:49:26 +0000 Message-ID: Subject: Week 7 and 8: NVMe controller emulator To: "soc-status@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: soc-status@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Summer of Code Status Reports and Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Jul 2017 14:49:40 -0000 Hello all, I forgot to send status report about work's between last week, so I make up one's these report into this e-mail. I'l take care about this. In this 2 week, I implemented NVM read and write command and bug fix of admin identify command, as a result, guest os can detect correct disk size and read value from backing file via the nvme controller emulator. The problem that I had in last week is solved, however, the write command has some problem, so that cannot work well. Next Friday (7/28), we have deadline of a second evaluation. a next midterm goal of my project is construct file system on backing file via own nvme controller emulator. I'll work for this in this week. regards, Shunsuke Mie From owner-soc-status@freebsd.org Mon Jul 24 21:42:01 2017 Return-Path: Delivered-To: soc-status@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 13ABFDA9097 for ; Mon, 24 Jul 2017 21:42:01 +0000 (UTC) (envelope-from milesfertel@college.harvard.edu) Received: from mail-wm0-x236.google.com (mail-wm0-x236.google.com [IPv6:2a00:1450:400c:c09::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B4F367DD2D for ; Mon, 24 Jul 2017 21:42:00 +0000 (UTC) (envelope-from milesfertel@college.harvard.edu) Received: by mail-wm0-x236.google.com with SMTP id c184so41991343wmd.0 for ; Mon, 24 Jul 2017 14:42:00 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=college-harvard-edu.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to:cc; bh=2Xbbmx7HJTNtzU96X/S6Dlisf9Av7MWjPk3d43lZEqE=; b=YtnOywwadmlCX1W1TA45JZxvAXRM5M65n35T1iWv9idhiJ+8VRvNQQl8LT/ryhyrML cMySkNlbSzMQRbL9BZKt8DLGbWtwiLns2dyvQE7vBqBLPa+Dh54dXzjv3BKcuvgV6PQa uU/rIV/klLqIUdCE1SNa8iEbCbDlL8L/CbaeHkugCr9ft0r1eVV6Bw9EYnniiFHPRY9s cB16ZRl3XQKKqSJOfNabULg0CI9YmFq149Re6hhldsTtYMocBBgs6zqRHtgjteaM5hBE r9PriJHycnGa2ydyUYv5ssvDSZekDEpxRHf/ACfXl2svzpHJmAlvZq0rg4YcG86gsMK+ Fg8A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=2Xbbmx7HJTNtzU96X/S6Dlisf9Av7MWjPk3d43lZEqE=; b=i006z12Z7htdyiR3dwtLT9W4SWhU5XurGJpP+DL4Xzgk++x4zmkn8NGbM2HB5UOcVd rIob2n2Ob28AG5o9Mh4aTL8keTWwNETTUtlbxNTA55uNKtXPykT3xXHFwcbf94p/V3s/ yBb/FHHGg8YzZuAUNhIvp4YZESCyfcI9V7EOJC2UERR2FHyRBeLGD+DVq3AekgyxtVH0 bWVM29o3sfCi1m3NlOW/xt9dkAXbWBoWzFxVS4IVqPyt7m5iKxktv7zE3bPImDSj3kDo m5SqUbsTzoEwFIJSXLETS/YyEtezJWq+LAyZE56s490MtQvKDc9pkKGL1CWO6MqIX7p8 pfnQ== X-Gm-Message-State: AIVw112AbLnJzEHtzm/8uY/Qax0edxIZaKEWYVou18F9Kg0L87HfmsiS xQZotkdtQIwJr9w0LM1duY2KuIdF0HTI X-Received: by 10.28.52.142 with SMTP id b136mr6104809wma.48.1500932519007; Mon, 24 Jul 2017 14:41:59 -0700 (PDT) MIME-Version: 1.0 Received: by 10.223.155.206 with HTTP; Mon, 24 Jul 2017 14:41:58 -0700 (PDT) From: Miles Fertel Date: Mon, 24 Jul 2017 23:41:58 +0200 Message-ID: Subject: Week 8 Update: Benchmarking and Tests improvement To: Brooks Davis Cc: soc-status@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: soc-status@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Summer of Code Status Reports and Discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Jul 2017 21:42:01 -0000 Hey Brooks, As you know, in the last week we've done design review and made improvements on the Mergesort Test-suite and Benchmarking code. My plan for this week is to have the Benchmark program and Test revamp checked into Phabricator early, and then get to work writing the shell driver program for benchmarking, as well as get back to work on WikiSort debugging. I look forward to checking in this code to head. I'd also appreciate if you could recommend what I might do about the style of WikiSort. I know it's a bit of an undertaking, as it seems to me the only way to make the code reasonably fit Style(9) would be to break it down into functions, as the logic results in some statements starting at the 70 column mark. - Miles