From owner-freebsd-testing@freebsd.org Wed Jul 1 12:34:20 2015 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8356098FCD7 for ; Wed, 1 Jul 2015 12:34:20 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: from mail-vn0-x22b.google.com (mail-vn0-x22b.google.com [IPv6:2607:f8b0:400c:c0f::22b]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3A0ED1234; Wed, 1 Jul 2015 12:34:20 +0000 (UTC) (envelope-from lwhsu.freebsd@gmail.com) Received: by vnbf190 with SMTP id f190so6231302vnb.10; Wed, 01 Jul 2015 05:34:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=ksOegDH2HY74cH9L2kUnGafSfqGZZV4kr8lDyHMOnWc=; b=MlKQi/DwjpDmw5oKijZeVMyVGqiboD2aCp9zs5TOar76HFWeG4E1vGFR5dPsxFnb/D Iyhl37Dsa6OFXFARG/+Yyw/SBIt/z3BeVFuWe9Uc9RslX1UD+ovvTizz79ffWyEmxS6a v/fW6PnWo6iaOgsqm4/VySET61va/t34Zr8CYXuYKYItfNLvE7F2tCLiTS/HXR99VJuh ADXr2ShO3JOuRGRxXQKHndN+9xjVW4tpBC/fyTguESJoHXKhKbU63mWn6/SYgeF76nSC ZEpAcdxhJxNMMh/ui2S8tgGeXss++sVhog2dFt5pZF/p/goDwG6FV+/5AIiTMQgC4Vi7 20Jw== MIME-Version: 1.0 X-Received: by 10.52.6.226 with SMTP id e2mr25125186vda.29.1435754059068; Wed, 01 Jul 2015 05:34:19 -0700 (PDT) Sender: lwhsu.freebsd@gmail.com Received: by 10.31.193.197 with HTTP; Wed, 1 Jul 2015 05:34:19 -0700 (PDT) In-Reply-To: <7326BFC6-045E-4175-8B90-19D8BA07303E@FreeBSD.org> References: <20150417152715.GA511@FreeBSD.cs.nctu.edu.tw> <20150418191316.GA90740@FreeBSD.cs.nctu.edu.tw> <7326BFC6-045E-4175-8B90-19D8BA07303E@FreeBSD.org> Date: Wed, 1 Jul 2015 20:34:19 +0800 X-Google-Sender-Auth: Azjzk4z0PC9dS9fvm278JJF11Xc Message-ID: Subject: Re: Adding FreeBSD/arm64 Jenkins build / QEMU job From: Li-Wen Hsu To: Julio Merino Cc: Ed Maste , "freebsd-testing@freebsd.org" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 01 Jul 2015 12:34:20 -0000 On Monday, June 29, 2015, Julio Merino wrote: > On Apr 18, 2015, at 15:13 , Li-Wen Hsu wrote: > > > > On Fri, Apr 17, 2015 at 16:47:45 -0400, Ed Maste wrote: > >> On 17 April 2015 at 11:27, Li-Wen Hsu > > wrote: > >>> > >>> That will be great. And I am interested to know what do you plan for > >>> booting QEMU machine, running test inside VM then getting results > >>> archived to outside. There are many approaches, and I wanted to know > >>> the most suitable one for us. > >> > >> Good question. Are we doing this for other targets today (QEMU, bhyve, > >> or metal)? > > > > Yes. > > > > For kuya/QEMU, it builds a image which executes tests upon launch: > > > > > https://svnweb.freebsd.org/base/user/jmmv/autotest/node/iterate.sh?view= =3Dmarkup&pathrev=3D271564#l154 > > > > and mounts the image to extract results: > > > > > https://svnweb.freebsd.org/base/user/jmmv/autotest/node/iterate.sh?view= =3Dmarkup&pathrev=3D271564#l284 > > I just came across this email and I=E2=80=99m wondering: are you currentl= y using > the autotest code within Jenkinsto perform regular test runs? (That=E2= =80=99d be > nice to hear!) > Unfortunately, not yet, but I think this is a good way, and we absolutely can do that in the future. For the arm64 tests, as I discussed with Ed in BSDCan, the first step we can do may just use QEMU for simple boot test. We cannot run full kyua tests at this point due to implementation is not complete. What I'm thinking about the test steps in the future might be: - Build the ISO/memstick image just as the same way we do the official release - Use the artifact from above to build or install the test VM image - Boot the machine, run tests - Extract results from the VM and feed to Jenkins to track the result Most of these steps already exist and are running on jenkins.freebsd.org. Only fist two steps are slightly different. I thought it would be good to also provide snapshot ISO/images for external users to do more tests. If anybody is interested in this and want to help. The easiest way is just write some scripts for doing these steps. And I am happy to convert them to a jenkins job to run periodically. Li-Wen --=20 Li-Wen Hsu http://lwhsu.org