From owner-freebsd-hackers@freebsd.org Sun Sep 6 13:23:04 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 154E63D0BBB; Sun, 6 Sep 2020 13:23:04 +0000 (UTC) (envelope-from thj@freebsd.org) Received: from forward4-smtp.messagingengine.com (forward4-smtp.messagingengine.com [66.111.4.238]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BksY36j7Rz3cHJ; Sun, 6 Sep 2020 13:23:03 +0000 (UTC) (envelope-from thj@freebsd.org) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailforward.nyi.internal (Postfix) with ESMTP id 8AA901942CA0; Sun, 6 Sep 2020 09:23:03 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute7.internal (MEProxy); Sun, 06 Sep 2020 09:23:03 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=pwJx5fk9qPUcfZx226TLtcQuGHS99 +DQDLxnEiT09u4=; b=j1NTd7XF6yk5OzLnXPwsmB/X+gDG7yuUb5a8Aw8QCEwjq uWd4nm7HsL1Yu4askBnrGlw1LbYhuzHAiedPwKt6fLJCCJiGSMmFCa5CUKUJ81Uq WGyByeRJ5GC3jsmsXv6mC2lQhFN/QoFcLSvkszW8MjWULZRlL7CxtIvqz8z4r1sR vuyXm47jCr+4DsEsQl4P39Z8cftuzX8iZ1GBEdEQnPGbSIzM+wzISa6CuK/yz3pu ErHB8j1bLtvifACY3dA0TpNSaE/gQ8dC7brZ2jNYvagnWMvOvVdIAx3A1MxdYutB TYYT2iGmqYL8zF4jV+11suRxyME/986QWswPkoEMQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudegjedgieegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepvfhomhculfhonhgvshcuoehthhhjsehfrhgvvggsshgurdhorhhg qeenucggtffrrghtthgvrhhnpeehhffhhfffveeihfeiteeuffduveevieefudfgheelie ekieevgfdtgeeuteeludenucffohhmrghinhepghhoohhglhgvrdgtohhmpdhfrhgvvggs shgurdhorhhgpdgrughvvghnthhurhhishhtrdhmvgenucfkphepudefjedrhedtrdduje druddvnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep thhhjhesfhhrvggvsghsugdrohhrgh X-ME-Proxy: Received: from tom-desk.erg.abdn.ac.uk (tom-desk.erg.abdn.ac.uk [137.50.17.12]) by mail.messagingengine.com (Postfix) with ESMTPA id BA225328005D; Sun, 6 Sep 2020 09:23:02 -0400 (EDT) Date: Sun, 6 Sep 2020 14:24:20 +0100 From: Tom Jones To: freebsd-hackers@freebsd.org Cc: freebsd-advocacy@freebsd.org Subject: FreeBSD Bugathon Setpember 19th 1400-2100UTC Message-ID: <20200906132420.GA82277@tom-desk.erg.abdn.ac.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Rspamd-Queue-Id: 4BksY36j7Rz3cHJ X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:11403, ipnet:66.111.4.0/24, country:US]; local_wl_from(0.00)[freebsd.org] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 06 Sep 2020 13:23:04 -0000 Hello Hackers, On the 19th September 2020 from 1400-2100 UTC we will be running a coordinated virtual Bugathon. FreeBSD has a Problem Report (PR) database[1] where users and developers are encouraged to file issues and regressions they find in both the base system and ports tree. A Bugathon is a focused session where we try to triage, process, fix and close as many reports as we can from the PR database. This will be our second Bugathon in 2020, the first was held in July[2] was very successful. I hope we can reproduce those great results. To help explain our bug tracking and squashing process I am looking for FreeBSD committers (one each from src, docs and ports) to speak for 10-15 minutes on their bug squashing workflow. Please contact me via email if you feel like talking about your workflow. We will host a google meet at the start of the Bug Squash to provide an introduction to the process and will use the #freebsd-bugs irc channel on freenode to coordinate work, triage and discuss PRs and patches. https://meet.google.com/zob-qoeu-fub We will use the google meet through out the day last time it proved to be a really helpful resource to get immediate answers to questions. I look forward to joining you to squash bugs and commit fixes to improve FreeBSD. - Tom [1]: https://bugs.freebsd.org [2]: https://lists.freebsd.org/pipermail/freebsd-hackers/2020-July/056297.html Some other links: https://wiki.freebsd.org/OfficeHours https://wiki.freebsd.org/MarkLinimon/BugbustingOfficeHours https://wiki.freebsd.org/Bugathons https://wiki.freebsd.org/MarkLinimon/KitchenerNotes https://wiki.freebsd.org/BugBusting https://adventurist.me/posts/00301 From owner-freebsd-hackers@freebsd.org Mon Sep 7 03:33:17 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9955D3E7FF3 for ; Mon, 7 Sep 2020 03:33:17 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (midget.dons.net.au [IPv6:2403:5800:5101:0:ea:1cff:fefa:f00]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "dons.net.au", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BlDQ31W9wz4pZT for ; Mon, 7 Sep 2020 03:33:13 +0000 (UTC) (envelope-from darius@dons.net.au) Received: from midget.dons.net.au (localhost [127.0.0.1]) by midget.dons.net.au (8.15.2/8.15.2) with ESMTPS id 0873Wr5g097127 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 7 Sep 2020 13:02:57 +0930 (ACST) (envelope-from darius@dons.net.au) Received: (from mailnull@localhost) by midget.dons.net.au (8.15.2/8.15.2/Submit) id 0873Weml097122 for ; Mon, 7 Sep 2020 13:02:40 +0930 (ACST) (envelope-from darius@dons.net.au) X-MIMEDefang-Relay-be813b1f1da6d6b27d681222cb70cc4f5b642383: 2001:44b8:1d2:8900:11d0:b44e:e90f:ccb7 Received: from [IPv6:2001:44b8:1d2:8900:11d0:b44e:e90f:ccb7] ([IPv6:2001:44b8:1d2:8900:11d0:b44e:e90f:ccb7] [2001:44b8:1d2:8900:11d0:b44e:e90f:ccb7]) by midget.dons.net.au (envelope-sender ) (MIMEDefang) with ESMTP id 0873WZId097120; Mon, 07 Sep 2020 13:02:40 +0930 From: "O'Connor, Daniel" Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Date: Mon, 7 Sep 2020 13:02:35 +0930 Subject: ASPEED video driver Message-Id: <8851FC7F-979D-4CDC-8513-CE893B2EF269@dons.net.au> To: FreeBSD Hackers X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Spam-Score: 0.2 () No, score=0.2 required=5.0 tests=HELO_MISC_IP, HELO_NO_DOMAIN, T_SPF_PERMERROR autolearn=no autolearn_force=no version=3.4.2 X-Scanned-By: MIMEDefang 2.83 on 10.0.2.1 X-Rspamd-Queue-Id: 4BlDQ31W9wz4pZT X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.31 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; R_DKIM_ALLOW(-0.20)[dons.net.au:s=default]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; NEURAL_HAM_LONG(-0.98)[-0.979]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[dons.net.au:+]; DMARC_POLICY_ALLOW(-0.50)[dons.net.au,quarantine]; NEURAL_HAM_SHORT(-0.84)[-0.839]; R_SPF_ALLOW(-0.20)[+mx]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:4764, ipnet:2403:5800:5000::/36, country:AU]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Sep 2020 03:33:17 -0000 Hi, Has anyone had success with the ASPEED Xorg driver? I have tried several = versions (in ports, from ASPEED directly, from freedesktop.org etc) and = they all hang trying to read DRAM information in ASTGetDRAMInfo. I am = running FreeBSD 12 on a Supermicro X11SSH-F. The hang is here: do { ; } while (*(volatile ULONG *) (pAST->MMIOVirtualAddr + 0x10000) !=3D = 0x01); I patched it to use some hard coded values I extracted from an old = system where it worked and it does run but the performance is quite = terrible. I've also tried scfb (performance is so so but it's stuck and 1024x768) = and VESA (runs at 1920x1080 but the performance is intolerable). I'm not expecting mind blowing performance but even the best performing = option above is quite painful to use. These systems are mostly = unattended but the bad performance does make the setup and test during = installation quite painful. Performance used to be tolerable but it seems to have gotten = significantly worse in newer BIOS versions. For now we are putting passively cooled GT710s in them but it would be = nice to fix it properly. I note that Linux has a DRM driver for these = https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/dr= ivers/gpu/drm/ast=20 However I'm not sure how that integrates with X.. If Linux doesn't = actually use the Xorg driver then I suppose that would explain why it's = rotted and useless. If that is the case, does anyone know difficult it would be to port the = Linux DRM driver? I did try contacting ASPEED and Supermicro but they pointed the finger = at each other and then blamed FreeBSD so I'm a bit stuck. Thanks. -- Daniel O'Connor "The nice thing about standards is that there are so many of them to choose from." -- Andrew Tanenbaum From owner-freebsd-hackers@freebsd.org Wed Sep 9 00:14:40 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6F2703DD343 for ; Wed, 9 Sep 2020 00:14:40 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from mail01.asahi-net.or.jp (mail01.asahi-net.or.jp [202.224.55.13]) by mx1.freebsd.org (Postfix) with ESMTP id 4BmMvw5fS1z4hPf for ; Wed, 9 Sep 2020 00:14:35 +0000 (UTC) (envelope-from ota@j.email.ne.jp) Received: from rv515.advok.com (cpe-184-152-96-96.nj.res.rr.com [184.152.96.96]) (Authenticated sender: NR2Y-OOT) by mail01.asahi-net.or.jp (Postfix) with ESMTPSA id DF51C10FB09 for ; Wed, 9 Sep 2020 09:14:31 +0900 (JST) Date: Tue, 8 Sep 2020 20:13:52 -0400 From: Yoshihiro Ota To: freebsd-hackers@freebsd.org Subject: Integration Test, Unit Test, and head/tests in FreeBSD Message-Id: <20200908201352.e4e78f7aea8a2b081adfb57e@j.email.ne.jp> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; i386-portbld-freebsd12.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4BmMvw5fS1z4hPf X-Spamd-Bar: +++ Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of ota@j.email.ne.jp designates 202.224.55.13 as permitted sender) smtp.mailfrom=ota@j.email.ne.jp X-Spamd-Result: default: False [3.86 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(0.00)[+ip4:202.224.55.0/24]; TO_DN_NONE(0.00)[]; RBL_MAILSPIKE_BAD(1.00)[202.224.55.13:from]; RCVD_NO_TLS_LAST(0.10)[]; RECEIVED_SPAMHAUS_PBL(0.00)[184.152.96.96:received]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:4685, ipnet:202.224.32.0/19, country:JP]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_IN_DNSWL_LOW(-0.10)[202.224.55.13:from]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_SPAM_SHORT(0.49)[0.494]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[email.ne.jp]; NEURAL_SPAM_MEDIUM(0.92)[0.920]; RCPT_COUNT_ONE(0.00)[1]; BAD_REP_POLICIES(0.10)[]; MIME_TRACE(0.00)[0:+]; NEURAL_SPAM_LONG(0.95)[0.950]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 00:14:40 -0000 Hi Hackers, How are FreeBSD unit tests, integration test, and CI pipe lines are connected? I found some documents from "man tests", tests/README, and few others. I also wasn't clear how unit tests and integration tests are organized in the tree well. Are all integration tests in shell script, for example? For example, I want to make a change to ggated/ggatec under sbin/ggate and would like to couple with unit tests. Will I create sbin/ggate/tests or sbin/ggate/ggated/tests and sbin/ggate/ggatec/tests or all of these 3 directories based on APIs? Where should I put it and how do I set up so that review/phab can verify as well? Thanks, Hiro From owner-freebsd-hackers@freebsd.org Thu Sep 10 14:57:23 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id F42113D99D8 for ; Thu, 10 Sep 2020 14:57:22 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: from mail-ej1-x630.google.com (mail-ej1-x630.google.com [IPv6:2a00:1450:4864:20::630]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnMS21XSTz46pY for ; Thu, 10 Sep 2020 14:57:21 +0000 (UTC) (envelope-from chuck@tuffli.net) Received: by mail-ej1-x630.google.com with SMTP id o8so9151529ejb.10 for ; Thu, 10 Sep 2020 07:57:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=tuffli-net.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ASyhl7QcHcbRv/AUN5I+SczpyRxMvrJ/Ck2vxA9WtjY=; b=1ZDZ0VWiDfOt1PGaj4LVDvJyN7Hs5GQKwjvgPJUF84da0HtT4TSUNi6ay/GOZ6apnt EhLQHXyD9PhxfAfWeK/hPL6DV775KcF20cUMSRaIy5PAEnT9TFcIYPHmbyoHFkXJXBPg wCwTGlhfAZgiQOVSU1Ai+Pe66YhVaREjqAWGbnIYW92RI2nVQoAeLMisszgU2wcz4l5U xn8dPC1sXPgUU/EpSAwwI2tKrYeqCouLPEAFOgBlxNCcPvrdNiAhZ+WjXOonHsQFrH9y VtF+Pg0Acnc0h8bwZ4ZD+pWMUA7W8bkQnLkIETItVxm2RKTvs0/wksxRnNRY14RZUn2q F5kw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ASyhl7QcHcbRv/AUN5I+SczpyRxMvrJ/Ck2vxA9WtjY=; b=RKYqvc/RFbHu62hYH88an12D9fUBnvDdLenwq9m+7KZONvxWwSEUk3LKGxBYKKHfiR hav0rzp+KCH3/JH6HHGSQ1HiXkt3hFsdSzXEPPBpPxgJPZwuNYV45+Ov6gYReFHCXVHf PO9oMw4NDyD9YS8vpqmZIHq8sQMX1AkqTHhNkzCyC+tsFmwa1Rzbni92YRw3oWafSi1v 5ksdh3qZkGqx5IyLJYdqnnyN741g2F0j98YNoF9cxRjq80gROLAbo4lFh1QzkbeV/Fhv A8F7Au6Uln3OY9b9yjkfPgZ97+siEa87ozrS6flEO6k47XyJ34Vrool2vvq2sJEWwlrU gzTw== X-Gm-Message-State: AOAM530Z8SGqYRFopD0OeCtHlX5DaoDDaqR9Sm95pFTUGjMHqGzRYS0d fWBhI2GtTxLMBy5Rv3UbDOJ0nrih1w0fmglHrApAa9Zqw5DXNQ== X-Google-Smtp-Source: ABdhPJzJLrvC8Lz3RiaK/hCbu7x1Fq0Pudh1K4XRstPevekJF+bJx0eLXnuMCrcldI+rhVUATaomIu9+jVAZdoRUo1A= X-Received: by 2002:a17:907:2173:: with SMTP id rl19mr9068171ejb.514.1599749840356; Thu, 10 Sep 2020 07:57:20 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Chuck Tuffli Date: Thu, 10 Sep 2020 07:57:09 -0700 Message-ID: Subject: Re: sendin raw scsi command To: Wojciech Puchar Cc: FreeBSD Hackers X-Rspamd-Queue-Id: 4BnMS21XSTz46pY X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=tuffli-net.20150623.gappssmtp.com header.s=20150623 header.b=1ZDZ0VWi; dmarc=none; spf=permerror (mx1.freebsd.org: domain of chuck@tuffli.net uses mechanism not recognized by this client) smtp.mailfrom=chuck@tuffli.net X-Spamd-Result: default: False [-2.50 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[tuffli-net.20150623.gappssmtp.com:s=20150623]; FREEFALL_USER(0.00)[chuck]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_MEDIUM(-1.01)[-1.011]; NEURAL_HAM_LONG(-0.99)[-0.991]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[tuffli.net]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; R_SPF_PERMFAIL(0.00)[empty SPF record]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::630:from]; DKIM_TRACE(0.00)[tuffli-net.20150623.gappssmtp.com:+]; NEURAL_HAM_SHORT(-0.20)[-0.198]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Sep 2020 14:57:23 -0000 On Thu, Sep 3, 2020 at 6:06 AM Wojciech Puchar wrote: > i already figured how to list SCSI devices in FreeBSD and find what > interest me from C language. > > After doing so - how can i send raw SCSI command? > > That's all i need. > > CAM layer userland interface is quite complex. > There are two approaches: camcontrol(8) and cam(3) You can send send arbitrary commands via camcontrol(8)'s cmd. An example of sending an ATA SMART READ command: # camcontrol cmd ada0 -a "B0 D0 00 4F C2 00 00 00 00 00 00 00" -i 512 - | od -tx1 The same can be done with SCSI devices, obviously with a different byte stream :) camcontrol(8) uses cam(3) (a.k.a. libcam) under the covers to send commands to devices via a C library. There are examples in the tree of how to do this. I've used this approach myself in a small project that collects SMART data from SCSI, ATA, and NVMe devices (see https://foss.heptapod.net/bsdutils/smart with most of the CAM related things in freebsd_dev.c). Hope that helps. --chuck From owner-freebsd-hackers@freebsd.org Thu Sep 10 18:53:43 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 55C293E12CA for ; Thu, 10 Sep 2020 18:53:43 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnShl1dX1z4VFq for ; Thu, 10 Sep 2020 18:53:43 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-vs1-f53.google.com (mail-vs1-f53.google.com [209.85.217.53]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 1631A1C8D8 for ; Thu, 10 Sep 2020 18:53:43 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-vs1-f53.google.com with SMTP id e14so3985726vsa.9 for ; Thu, 10 Sep 2020 11:53:43 -0700 (PDT) X-Gm-Message-State: AOAM533BK68dn1IHKA3Z4ccdRAr7cm+bNz8XLe7ynEJy58uDZRM8P8h0 21S54xOPYACo0frFnxvG7WFtrT36oLIzUv9PJKQ= X-Google-Smtp-Source: ABdhPJyL7tilcUyGDbWajd04yHw7iaupCbBzWUBlZpnf00gonM7ZPmo1dbOH11uSdeotQapyz2/zSwvx1HTPYjZCwTU= X-Received: by 2002:a67:ff18:: with SMTP id v24mr5671671vsp.11.1599764022602; Thu, 10 Sep 2020 11:53:42 -0700 (PDT) MIME-Version: 1.0 From: Kyle Evans Date: Thu, 10 Sep 2020 13:53:31 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Providing default WARNS To: FreeBSD Hackers Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Sep 2020 18:53:43 -0000 Hi, I have a proposal/review open for setting a default WARNS=6 for all builds within the src tree. This will provide coverage to deeper parts of the build that currently have 0 warnings added. It will also eliminate the need to worry about it unless we have warnings in new stuff that should be fixed, and improve the overall quality of the tree. I've added a couple people that I suspect may be interested, but please feel free to chime in: https://reviews.freebsd.org/D26397 Thanks, Kyle Evans From owner-freebsd-hackers@freebsd.org Fri Sep 11 11:07:12 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2F4733D55E1 for ; Fri, 11 Sep 2020 11:07:12 +0000 (UTC) (envelope-from shamanthkrishna23@gmail.com) Received: from mail-wr1-x42c.google.com (mail-wr1-x42c.google.com [IPv6:2a00:1450:4864:20::42c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BntHy61J1z4BGS for ; Fri, 11 Sep 2020 11:07:10 +0000 (UTC) (envelope-from shamanthkrishna23@gmail.com) Received: by mail-wr1-x42c.google.com with SMTP id z4so11088787wrr.4 for ; Fri, 11 Sep 2020 04:07:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=pXMvmePAmII/NiOpJY17bV8m2FFYgfVGiIE3xdtVi6Y=; b=AwcEmAyDpQ0o4daAy55gZ/cpVAG4S1yYNxMPVwWo5LFEc/2B1fHWwtVygVtUJ2aSyY s5topk5KfBsylBrVpyhxzo7syolXM7Li44wKUm63hTGds/klKl1i4mnCnB4sc84abUXS yb5PGaoRWctnBhAXIGKe54pHm1PGhCfXI2ak67SmYhzuRjTakSOThoN/ioeKhOiq2w7Y rYku4dywrfWoHF2Uop8ob8w/F0n06uf+DKI9I0Q9y5al3rgFwD1AIb4yCp9O1TvbxWR9 l5s8d3o0eT3PONFtuy528t0t4y0kbddWaYDn7jT/IlFWyIh0/vhJUXUbwDh1GvuffyEz Umiw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=pXMvmePAmII/NiOpJY17bV8m2FFYgfVGiIE3xdtVi6Y=; b=eC7JYe3Axn/gIdRHh2RScDjfQIsANbzQd/2H3jFlS0maBBCN0nGBFkGoMDWqTeGNZb zy/7o2Z4bt1aGiACHsOQ0DIsZpY2kpvIxSR4mMETlI+FwZu8drqtYRNWB3+AG0l0dX08 oaDKQAoaEtxA3sfHo8THr4RlBmRDN6KEdoqJ9X+1j/LFtd/jJZU6QzWQHVOCQXPrK95B PncSysQ+VjrceB7kAWeBUjkoQvCWPtxGQZSTBLU395tnJq6jbeICVuaogoj8tWe3l19X yRLI+UaTog2hzFtqSAxB22WXaqKwpMqurpcB5uVxTMcIc/jEwt5hBUYYvT5TI4MiKeMQ I7Dg== X-Gm-Message-State: AOAM533nGQ+tC6rKCSAe7KmUatTD3mZwwL1b0EuSpeNaJQkY+dxAGSjR j0qYx7zVbTMIGhjPk7o2h4zimVdUiIet+xXv/f36FPQvL1M= X-Google-Smtp-Source: ABdhPJzFFeUyApq3jNOmHBBy8x6myTViDV3dH1SsfSoeZ3Edhc4ELdJ2ITrxXhmwpHhwqZa2R12jD3XgFx4mWz0Lcxo= X-Received: by 2002:adf:f701:: with SMTP id r1mr1538158wrp.341.1599822428996; Fri, 11 Sep 2020 04:07:08 -0700 (PDT) MIME-Version: 1.0 From: SHAMANTHA KRISHNA K G Date: Fri, 11 Sep 2020 16:36:56 +0530 Message-ID: Subject: Determing Heap and stack size of running process. To: freebsd-hackers@freebsd.org X-Rspamd-Queue-Id: 4BntHy61J1z4BGS X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=AwcEmAyD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of shamanthkrishna23@gmail.com designates 2a00:1450:4864:20::42c as permitted sender) smtp.mailfrom=shamanthkrishna23@gmail.com X-Spamd-Result: default: False [-3.14 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.95)[-0.948]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.004]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42c:from]; NEURAL_HAM_SHORT(-0.19)[-0.189]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 11:07:12 -0000 Hello All, I want to know the *size of heap and stack for a running process* ,how it can be done, if I* don't *see any* [stack ] *or* [heap] *in the output of */proc/pid/map* and also the platform does not allow installing *third party freebsd utilities like valgrind.* Thank you, -Shamantha From owner-freebsd-hackers@freebsd.org Fri Sep 11 13:29:54 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E4FF83DA513 for ; Fri, 11 Sep 2020 13:29:54 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound2k.ore.mailhop.org (outbound2k.ore.mailhop.org [54.148.219.64]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BnxSf3JD9z4LMY for ; Fri, 11 Sep 2020 13:29:54 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1599830993; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=iAYOTdFc/d1SaKrPg9uRZAnYdcCQnQsF8EmJmpU/pciTQN8GU+uyzPxJikZJiO3QEgPHqCYHqmwy7 Xq+K4dmA1izHOpnM3UjdlNlhWvIu6XsokfaMArlsN6/P6PaG0qht93bGFAi3uPlTGXaQcTUd+JNUdL HFIpXlOX7Fz9VrELQfaClStHstcHtnKUSmMfiCpILpGJCqlqFKkYLh40Dkhpw7JrRXtPC+/ibe3QtK zpU2qnP7m+n7KKpvxZEh8wTi6mY3FVQ6sa95byVQX3vyN7QYKxk9tlkSmr2Sbr1T618dyJcGqqhqLc o+ejoyjJ3q1tmrdmNutfHL9AdjUtGiQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:dkim-signature:from; bh=B1MwtOZtlLulqs+uoQ0KnrbVIrF9hN/8cumfY2Z6ksw=; b=gaJHlKNwNpFVn86Xi23p/F4Ee4gwtXU8ST9PKLSG3HMGgEZsY2p/wCAkxOGTqM4iXzlaVd9DRe3Dx ODL+VdyZIAm1DClf2trZ15InO9eX2OzXxdt3WKdU7HaI43WxRsgzeV690tJaCcXprcj+WOcaim8Mmx 4w2VCGEX69Oe33b7hN9VnSMs0iFUvnNTgjvjWpye6myWOlRzQY0LXtBb9LAL8E33Qp0Xf7JTYwLkB2 QT6lelzHUbcpD0uaB6yl2y5bfX5SpGn3EMQ56yHDAl2t0WixLo4KWJYnIEJGaQ39Is1ADV4vLPWG4h Y0B9NAm4xatPXjkgcnzqUVoEwD55Zgg== ARC-Authentication-Results: i=1; outbound4.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:to:from:subject:message-id:from; bh=B1MwtOZtlLulqs+uoQ0KnrbVIrF9hN/8cumfY2Z6ksw=; b=etuHs7qi+chcbe5v6pb+S67Xww09y/7GwBZ0DAc1uLj4cPohN63E2PLxGFOXW5uPMR8/jyY1P91Gx iuuLa45LsYLsX/L4Cxu2XoC5OohJOnsvwZBJd54SBPwO/xlKhsl2cBrlqHLEGWT+5iFR9F5bdCpW2t OoLovc1QrribQkJ3uwrzNcw7pUyXi8XZcQqWrvNcI9wYJ1yUpAIpJzN40mB2LZF8XMqzymOhIcxDoI yVPAPYcNHGynMiHQqzm3Kuhl7dVSSflzhdm82MHIatx/x7W51dWM7fNA6MSwsyUQ5DnXRe0iGPbovK T/E/yJJCBRpTvJpYNLKMVbmgU7LnFyw== X-MHO-RoutePath: aGlwcGll X-MHO-User: deafb204-f432-11ea-9e11-df46ed8f892f X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (c-67-177-211-60.hsd1.co.comcast.net [67.177.211.60]) by outbound4.ore.mailhop.org (Halon) with ESMTPSA id deafb204-f432-11ea-9e11-df46ed8f892f; Fri, 11 Sep 2020 13:29:51 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id 08BDToI9080860; Fri, 11 Sep 2020 07:29:50 -0600 (MDT) (envelope-from ian@freebsd.org) Message-ID: <2db16d9822eab8fb536eaf705d6378487c7994ae.camel@freebsd.org> Subject: Re: Determing Heap and stack size of running process. From: Ian Lepore To: SHAMANTHA KRISHNA K G , freebsd-hackers@freebsd.org Date: Fri, 11 Sep 2020 07:29:50 -0600 In-Reply-To: References: Content-Type: text/plain; charset="ASCII" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4BnxSf3JD9z4LMY X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:16509, ipnet:54.148.0.0/15, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 13:29:55 -0000 On Fri, 2020-09-11 at 16:36 +0530, SHAMANTHA KRISHNA K G wrote: > Hello All, > I want to know the *size of heap and stack for a running > process* ,how > it can be done, if I* don't *see any* [stack ] *or* [heap] *in the > output > of */proc/pid/map* and also the platform does not allow installing > *third party > freebsd utilities like valgrind.* > > Thank you, > -Shamantha > Use procstat(1). For example "procstat -v " will show all the memory mappings for that process. If you need it from within a program you're writing, "man libprocstat" will get you some info on how procstat(1) does its work. -- Ian From owner-freebsd-hackers@freebsd.org Fri Sep 11 13:56:20 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9FFA73DAF54 for ; Fri, 11 Sep 2020 13:56:20 +0000 (UTC) (envelope-from shamanthkrishna23@gmail.com) Received: from mail-wm1-x32a.google.com (mail-wm1-x32a.google.com [IPv6:2a00:1450:4864:20::32a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bny374zz5z4N6S; Fri, 11 Sep 2020 13:56:19 +0000 (UTC) (envelope-from shamanthkrishna23@gmail.com) Received: by mail-wm1-x32a.google.com with SMTP id e17so4553218wme.0; Fri, 11 Sep 2020 06:56:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=poubo6X8MdSFSK78x4hD9fnZKIguZ+zGzcMKUdQtwys=; b=FH/j8TXM+k86RjgNGPmHRfX0vltVoQ5Ufk694C8Mqu8lGLt0GM0vMpPapGoaNx12o3 pvMcGNzmGCJ7aJPGO1tXecDMwt6ZN+O0yDQYe+ms4sGQY0B/30znCQkIh4trI9cGFNAx JWkUK4BMsld9oEOu7ApPtlm01rQ4NkWuZ5Dq9kcsKNHhMdqa8dVUWrOL3HXo5M7BN92V xiNp8xlnerZSOXSaoeqwSmSfPhX4XDvK7BIIt40o2ZseUXX/w23s0f4/mGUnggi9w9a3 QTNYCCO0aEi/EwNU0sUqnFKwkELiMGSwzdeMeFnR22Ic52d1HjAMP7fwpI/7DEXx1eTD kh0g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=poubo6X8MdSFSK78x4hD9fnZKIguZ+zGzcMKUdQtwys=; b=NX3inwtq4rjVpwo1+dhJvsD6QsD2aLQyVlSJQwlOCrAppQ/jZyrXmNjWI6bpnpKa57 NwVQSrb3qSY1JEreizO380njIwX50rVOzWBr/cZoQzfn4naib2l4I/9TRtllDn5tyOx9 rQHH4G+2teCaFWE55mQLO7YHIv4Ohw6fbX8o2UFffPoarASpNnKUZm2T+QViS/qtOCxR FCku7ZUGfWyE1TV7dmq/LITzxShsnH3gyPcI43XtBLTy6+bgFLbxrEEHHgdgvUgEy9ny PiLwEku4vFmAByfr/IjriCub6MIoP790+n6+jA7Ql11fN1LNZ+8+5zpe7CxVxLWSHDF1 +7SQ== X-Gm-Message-State: AOAM532Gs4m2RD7Ctr5htnFyY71+gP+ZM/flaAj06wM90chsPxsrMStl Ms3P1MaQCWriv9POvpJFsiwQgms+n/4TzEdIgBImDNmbRzc= X-Google-Smtp-Source: ABdhPJxsMev3qS6nirKaUUaZEB9jJ1f9BelwU4kCTAvhbiJVm1eGTCPx2ABUpzvqH/tVLiRqtVwVchFTIo62suYrfb0= X-Received: by 2002:a1c:2086:: with SMTP id g128mr2406337wmg.89.1599832577811; Fri, 11 Sep 2020 06:56:17 -0700 (PDT) MIME-Version: 1.0 References: <2db16d9822eab8fb536eaf705d6378487c7994ae.camel@freebsd.org> In-Reply-To: <2db16d9822eab8fb536eaf705d6378487c7994ae.camel@freebsd.org> From: SHAMANTHA KRISHNA K G Date: Fri, 11 Sep 2020 19:26:05 +0530 Message-ID: Subject: Re: Determing Heap and stack size of running process. To: Ian Lepore Cc: freebsd-hackers@freebsd.org X-Rspamd-Queue-Id: 4Bny374zz5z4N6S X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=FH/j8TXM; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of shamanthkrishna23@gmail.com designates 2a00:1450:4864:20::32a as permitted sender) smtp.mailfrom=shamanthkrishna23@gmail.com X-Spamd-Result: default: False [-3.21 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.97)[-0.973]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-0.997]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32a:from]; NEURAL_HAM_SHORT(-0.24)[-0.237]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 13:56:20 -0000 Thank you for the heads up, I had tried the output of procstat -v also ,there also I am not getting any information about heap usage . Thanks -Shamantha On Fri, 11 Sep 2020, 18:59 Ian Lepore, wrote: > On Fri, 2020-09-11 at 16:36 +0530, SHAMANTHA KRISHNA K G wrote: > > Hello All, > > I want to know the *size of heap and stack for a running > > process* ,how > > it can be done, if I* don't *see any* [stack ] *or* [heap] *in the > > output > > of */proc/pid/map* and also the platform does not allow installing > > *third party > > freebsd utilities like valgrind.* > > > > Thank you, > > -Shamantha > > > > Use procstat(1). For example "procstat -v " will show all the > memory mappings for that process. If you need it from within a program > you're writing, "man libprocstat" will get you some info on how > procstat(1) does its work. > > -- Ian > > From owner-freebsd-hackers@freebsd.org Fri Sep 11 14:01:52 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 22A5E3DB7A1 for ; Fri, 11 Sep 2020 14:01:52 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound5a.ore.mailhop.org (outbound5a.ore.mailhop.org [44.233.67.66]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bny9W4hVxz4Ndb for ; Fri, 11 Sep 2020 14:01:51 +0000 (UTC) (envelope-from ian@freebsd.org) ARC-Seal: i=1; a=rsa-sha256; t=1599832904; cv=none; d=outbound.mailhop.org; s=arc-outbound20181012; b=eHAMKDY4yW8hqp87/uiYcXPosf7eaQoTwaSZvkXkJENt2/rhNhzg9EjfRg0SivLRgpmL/ncK+x8MP uxrPtgGLX/MQw31PlQmPNSRAHisoXGdPPkA9gKjgAWvrRhXdW1/BXODyV+0gE/TmS1sqxRgcstMHMA 13kwfoGg+opOF3Lf4VO80uvGIGh1m3lFqGnGmRdXkDEvpxt9WrTBM88eMPqfcsOCCY/ZiSbDxGb7Zh Ta9rcykGL8ZNVW4k/fUoXHP2ublXugvHO0/WsXbSjFu1wh3dZ2rfb5pBRn+BzHl6npJ/e+1uUSq5QU V8j85mX+SACHPDE2ZRZjMLxiSk3FaKQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=arc-outbound20181012; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:dkim-signature:from; bh=7qfUH10LZUk80WtFgny4vR80CnOJ36uaDgulyey02xg=; b=WZSbnMTkEvwv82ZJZQhpWGpalKkN9ukO/ApYUx3eUPpng+QI/sW1P8ywFxakqO0tjiyTA8s5EpEDz fuXKN0x1mexrKxherhGRB84ia7NbIispVYdsjlyR4OINVVqPQfDGjhKbTk9II1gUOAmirt1CCOL690 o99oWjGYpy2QZ/Qc7lbuyxZ2JcDNcSpCf88UOl4VX/y6cNe5EEcBQ965yK/lVP3ttYZesN2mW8NGXk 2TjJC4jbEidqbTeWzFYUSJgLgMxbYiKgt5MLYKWNrhD3JRJRsuNzdkrJCg5U7OIu8aQsIaZPzbv8QU mzaIhy/aMG+0VSHJIw/USPQeBL8tf0A== ARC-Authentication-Results: i=1; outbound3.ore.mailhop.org; spf=softfail smtp.mailfrom=freebsd.org smtp.remote-ip=67.177.211.60; dmarc=none header.from=freebsd.org; arc=none header.oldest-pass=0; DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outbound.mailhop.org; s=dkim-high; h=content-transfer-encoding:mime-version:content-type:references:in-reply-to: date:cc:to:from:subject:message-id:from; bh=7qfUH10LZUk80WtFgny4vR80CnOJ36uaDgulyey02xg=; b=qleYk0krvNRYeq0hcwEqUGGhPt6g9nIBWaPLx8F4OclsnYauuTSYKL0NlV3axZUDAMUcuZJrU2yGc t4eSkE4AN9UravHRb5x6QtfjyJmV+izrNAdhEJy5cAypZkD8MPqnbCHntsNLDOj9emXkms7MAahhrf XVHrNsstknY3AxRMvsY7r1Ov8xWa0oVQ1kd37ynsi8nn1wAtrIkiV+ZGBIdsr1RaNcONThtPn/8jOE 7HYsl2Y0blGas5tJ4Hngp/t8xmcjqksZDsM54W3cNhSTqkHDcaZiPjBgrxvzHHzKF+V0LwHpPcL2z9 9f3AFgqghj1CyQbqucCZUvYlgQT4efg== X-MHO-RoutePath: aGlwcGll X-MHO-User: 51a8dc71-f437-11ea-8b38-614106969e8d X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (c-67-177-211-60.hsd1.co.comcast.net [67.177.211.60]) by outbound3.ore.mailhop.org (Halon) with ESMTPSA id 51a8dc71-f437-11ea-8b38-614106969e8d; Fri, 11 Sep 2020 14:01:42 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id 08BE1fU0080958; Fri, 11 Sep 2020 08:01:41 -0600 (MDT) (envelope-from ian@freebsd.org) Message-ID: Subject: Re: Determing Heap and stack size of running process. From: Ian Lepore To: SHAMANTHA KRISHNA K G Cc: freebsd-hackers@freebsd.org Date: Fri, 11 Sep 2020 08:01:41 -0600 In-Reply-To: References: <2db16d9822eab8fb536eaf705d6378487c7994ae.camel@freebsd.org> Content-Type: text/plain; charset="ASCII" X-Mailer: Evolution 3.28.5 FreeBSD GNOME Team Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bny9W4hVxz4Ndb X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; local_wl_from(0.00)[freebsd.org]; ASN(0.00)[asn:16509, ipnet:44.224.0.0/11, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 14:01:52 -0000 On Fri, 2020-09-11 at 19:26 +0530, SHAMANTHA KRISHNA K G wrote: > Thank you for the heads up, I had tried the output of procstat > -v also > ,there also I am not getting any information about heap usage . > > Thanks > -Shamantha > The output does tell you about heap usage, but you have to interpret the type and flags to figure out which mappings are heap allocations, and the RES count to figure out how many pages of those mappings are actually in use (i.e., backed by physical ram). Iirc, the mappings with type 'df' and no flags set are the heap allocations, but I'm not positive of that. Things with the D flag set are thread stacks. I remember the manpage wasn't all that helpful in figuring that stuff out last time I needed to know. -- Ian > On Fri, 11 Sep 2020, 18:59 Ian Lepore, wrote: > > > On Fri, 2020-09-11 at 16:36 +0530, SHAMANTHA KRISHNA K G wrote: > > > Hello All, > > > I want to know the *size of heap and stack for a running > > > process* ,how > > > it can be done, if I* don't *see any* [stack ] *or* [heap] > > > *in the > > > output > > > of */proc/pid/map* and also the platform does not allow > > > installing > > > *third party > > > freebsd utilities like valgrind.* > > > > > > Thank you, > > > -Shamantha > > > > > > > Use procstat(1). For example "procstat -v " will show all the > > memory mappings for that process. If you need it from within a > > program > > you're writing, "man libprocstat" will get you some info on how > > procstat(1) does its work. > > > > -- Ian > > > > > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to " > freebsd-hackers-unsubscribe@freebsd.org" From owner-freebsd-hackers@freebsd.org Fri Sep 11 14:29:16 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CCCD73DC5BD for ; Fri, 11 Sep 2020 14:29:16 +0000 (UTC) (envelope-from shamanthkrishna23@gmail.com) Received: from mail-wr1-x444.google.com (mail-wr1-x444.google.com [IPv6:2a00:1450:4864:20::444]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bnyn76qsrz4QFg; Fri, 11 Sep 2020 14:29:15 +0000 (UTC) (envelope-from shamanthkrishna23@gmail.com) Received: by mail-wr1-x444.google.com with SMTP id c18so11684468wrm.9; Fri, 11 Sep 2020 07:29:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=nJ4oogKTCytQLue7p04OOkrhxevkUeZIw9fMpFWC7OI=; b=rBXtaRThWnlucjOKEINRTi1z8Uorxdfc/colGHTqSRi6Y8iVKhrtQ9IclM9ZeyEMgz 7FbTjdO31UXjnvlVSqekAMJ6j44fHRwjHURHtSuCfsRhzki7Iw3UxQrva9qsTi0ywntA 1X1ThpxS1IWUrl9qA0W4rEK0ywV+ieT1hw5COY71lCzWB0R5Py1Nfcx4TdsJ93sCxnV9 7YS5TzLvHWoAI7k+Nyg0TvW8t55OdxdR1MylSZqj2Wv2CkJs7IFS+jSTzq7lJTwKHbC6 zq5vbIAPu7ko42JnTLdAnNou5pZczJHbCMJAhAI157XH3hHfxVi7bkffa1ENmV5Psn2e Eh9w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=nJ4oogKTCytQLue7p04OOkrhxevkUeZIw9fMpFWC7OI=; b=J7ZCUS0NzDzPnM4EfmjHnPy+cvPf8gbZ84kFpEwelTkhy42G9RPIMiVrk6Zb7wZ1is vhCI4B9Nw8KzTb0m4PXJI7pUW0YCwPaoipeoi8I2ikDHbjNgetVJJGO7zAfIgFMrUSrW uqANbdrJMXpdWX76s0102dSyzT1ShevD3ZBYQAXUUlLHGVZWXb0uuqn+61ezaNY9TkC6 3jEvmXY7yzjsxEO68thhr66XUGd0k0Ix15zL2xBJvdFIK0hbB1sC39sYbZaDCEOTB7hr lOvOSNVHDq8ZMhU+IWoNdRHN2SmBbF/kfd8irhnVJlAuPtMYNLL34xO3JeezmfpCZF7i o4mQ== X-Gm-Message-State: AOAM533Hw0egwquS3Q6HTCuq47rFTx3IQiqKOm2dCCLSenZehFgbxW6T KGh6lEoD880k17nvDt7kVDDq72Gq925LAMUn8zvoFen+uYM= X-Google-Smtp-Source: ABdhPJzDx1oRoO2md1fu9Z9FhbqTiAfUlj8WXNr1TDjihlzzdMubGoJ7oPJWrm07bTKhms/H9+SU67hUpPQlY+0TqiE= X-Received: by 2002:adf:fd12:: with SMTP id e18mr2472982wrr.96.1599834553928; Fri, 11 Sep 2020 07:29:13 -0700 (PDT) MIME-Version: 1.0 References: <2db16d9822eab8fb536eaf705d6378487c7994ae.camel@freebsd.org> In-Reply-To: From: SHAMANTHA KRISHNA K G Date: Fri, 11 Sep 2020 19:59:01 +0530 Message-ID: Subject: Re: Determing Heap and stack size of running process. To: Ian Lepore Cc: freebsd-hackers@freebsd.org X-Rspamd-Queue-Id: 4Bnyn76qsrz4QFg X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=rBXtaRTh; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of shamanthkrishna23@gmail.com designates 2a00:1450:4864:20::444 as permitted sender) smtp.mailfrom=shamanthkrishna23@gmail.com X-Spamd-Result: default: False [-3.77 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-0.97)[-0.969]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; NEURAL_HAM_LONG(-1.00)[-0.996]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::444:from]; NEURAL_HAM_SHORT(-0.81)[-0.805]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 14:29:16 -0000 Any idea about the fields which have no PRT( I mean no protections flag set --- no read no write no execute) and no flags and with mapping type 'df' ?. Thanks , -Shamantha. On Fri, 11 Sep 2020, 19:31 Ian Lepore, wrote: > On Fri, 2020-09-11 at 19:26 +0530, SHAMANTHA KRISHNA K G wrote: > > Thank you for the heads up, I had tried the output of procstat > > -v also > > ,there also I am not getting any information about heap usage . > > > > Thanks > > -Shamantha > > > > The output does tell you about heap usage, but you have to interpret > the type and flags to figure out which mappings are heap allocations, > and the RES count to figure out how many pages of those mappings are > actually in use (i.e., backed by physical ram). > > Iirc, the mappings with type 'df' and no flags set are the heap > allocations, but I'm not positive of that. Things with the D flag set > are thread stacks. I remember the manpage wasn't all that helpful in > figuring that stuff out last time I needed to know. > > -- Ian > > > > > > > > > > > > On Fri, 11 Sep 2020, 18:59 Ian Lepore, wrote: > > > > > On Fri, 2020-09-11 at 16:36 +0530, SHAMANTHA KRISHNA K G wrote: > > > > Hello All, > > > > I want to know the *size of heap and stack for a running > > > > process* ,how > > > > it can be done, if I* don't *see any* [stack ] *or* [heap] > > > > *in the > > > > output > > > > of */proc/pid/map* and also the platform does not allow > > > > installing > > > > *third party > > > > freebsd utilities like valgrind.* > > > > > > > > Thank you, > > > > -Shamantha > > > > > > > > > > Use procstat(1). For example "procstat -v " will show all the > > > memory mappings for that process. If you need it from within a > > > program > > > you're writing, "man libprocstat" will get you some info on how > > > procstat(1) does its work. > > > > > > -- Ian > > > > > > > > > > _______________________________________________ > > freebsd-hackers@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > To unsubscribe, send any mail to " > > freebsd-hackers-unsubscribe@freebsd.org" > > From owner-freebsd-hackers@freebsd.org Fri Sep 11 14:38:23 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0FE823DCD45 for ; Fri, 11 Sep 2020 14:38:23 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-qk1-x744.google.com (mail-qk1-x744.google.com [IPv6:2607:f8b0:4864:20::744]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bnyzf1sDKz4RRQ for ; Fri, 11 Sep 2020 14:38:22 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-qk1-x744.google.com with SMTP id p4so10090522qkf.0 for ; Fri, 11 Sep 2020 07:38:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd.org; s=google; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=TQl2Ea6pcaN+TmZjtAylXWl9iKvgFeDgaoNPUypUCi8=; b=fl4gPlnk09TbSMy4MR6UXtdu74l99oL30blUeHkVTBux2m6OJO8HlyAPQ21ClphQLX VM9StrfzIjBSIM9qy1SVeglPadz2QArPN/Gflba6GphtxlqScgPira2cElkB5iwZ6fF2 URqRHizhpLiauWa/2PlTZtItTLdcQtSWLuhzMT7dyv4KvB391ScaxeoyoUzjGnYoVzgo knvvyX+h3Dv+IJx+95IQA3qj15RA8ZuJEAFhfrE95K6AUFv3kdvRVmiBF8/NeP9bzYNH pn9eNKJa/4/jV7kjnSoZTf/wHarHnfMk/e9ei9PLVMJ7KgIJ10cLC//gmk4VnzUDZDUU pCAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=TQl2Ea6pcaN+TmZjtAylXWl9iKvgFeDgaoNPUypUCi8=; b=poZyLuQfmZulNd3OsdDA0JGv3F+o29/wE2E1b9SVLKFwJTYd9y9o5uxJ2pT5EcFny2 IEIiDYgYSWEYU1NzCEhRTd8jbxR7mgr0/r9ib0ETVCDfaj4Hf8PsE81vmBvsxig4NGqv Ih+xxmnzToqnT+iFxzwxYaiRaNECd963Sj2tjt5/u1cvwAGz/brLVhhzpa4vem7VkGbI pf0Zf1/8tWdorM292auODXnIMakkv+LFTNcbnuql0tcsILQ2GCnw/fZQowaWfmZ1fNI2 NGYlNvWoMdqhwTmQ2ZL9/feD4BeXchfyO5Rr5ZFFRu89rwFuoPV9C0xO2838ORdoMdDw fKzQ== X-Gm-Message-State: AOAM531EWgCvYFlGgvlll1ecSWGyO7FLzbn5Ag2N84aASus1i6W5g9Jm cY4pOfJuEPzQahFlGa9wuvVPzcx969zt3g== X-Google-Smtp-Source: ABdhPJy7o8v5zfREKB053JGEDFHDGm9OBIo8n+u182qOFI1SsCxUAf9bcfRzm+wAULyzE3fFUSxDXg== X-Received: by 2002:a37:5dc6:: with SMTP id r189mr1754179qkb.364.1599835101416; Fri, 11 Sep 2020 07:38:21 -0700 (PDT) Received: from mutt-hbsd (75-148-2-186-WashingtonDC.hfc.comcastbusiness.net. [75.148.2.186]) by smtp.gmail.com with ESMTPSA id 10sm2921786qkk.88.2020.09.11.07.38.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2020 07:38:19 -0700 (PDT) Date: Fri, 11 Sep 2020 10:38:15 -0400 From: Shawn Webb To: SHAMANTHA KRISHNA K G Cc: Ian Lepore , freebsd-hackers@freebsd.org Subject: Re: Determing Heap and stack size of running process. Message-ID: <20200911143815.77d675abityetbme@mutt-hbsd> X-Operating-System: FreeBSD mutt-hbsd 13.0-CURRENT-HBSD FreeBSD 13.0-CURRENT-HBSD X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0xFF2E67A277F8E1FA References: <2db16d9822eab8fb536eaf705d6378487c7994ae.camel@freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="yzybwqftyuawtm5t" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Bnyzf1sDKz4RRQ X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=hardenedbsd.org header.s=google header.b=fl4gPlnk; dmarc=none; spf=pass (mx1.freebsd.org: domain of shawn.webb@hardenedbsd.org designates 2607:f8b0:4864:20::744 as permitted sender) smtp.mailfrom=shawn.webb@hardenedbsd.org X-Spamd-Result: default: False [-5.14 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[hardenedbsd.org:s=google]; NEURAL_HAM_MEDIUM(-0.96)[-0.959]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[hardenedbsd.org]; NEURAL_HAM_LONG(-0.98)[-0.980]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[hardenedbsd.org:+]; NEURAL_HAM_SHORT(-1.10)[-1.099]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::744:from]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MID_RHS_NOT_FQDN(0.50)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 14:38:23 -0000 --yzybwqftyuawtm5t Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Given that jemalloc uses anonymous pages, it's not really possible to tell which anonymous pages come from jemalloc's calls to mmap. A number of applications, especially those with JITs, also create anonymous memory mappings. One could infer stack usage by the MAP_STACK flag. Pages marked with MAP_GUARD are definitely not pages destined for the heap (I doubt jemalloc makes use of the relatively new MAP_GUARD flag, though I haven't checked.) Thanks, --=20 Shawn Webb Cofounder / Security Engineer HardenedBSD GPG Key ID: 0xFF2E67A277F8E1FA GPG Key Fingerprint: D206 BB45 15E0 9C49 0CF9 3633 C85B 0AF8 AB23 0FB2 https://git-01.md.hardenedbsd.org/HardenedBSD/pubkeys/src/branch/master/Sha= wn_Webb/03A4CBEBB82EA5A67D9F3853FF2E67A277F8E1FA.pub.asc On Fri, Sep 11, 2020 at 07:59:01PM +0530, SHAMANTHA KRISHNA K G wrote: > Any idea about the fields which have no PRT( I mean no protections flag s= et > --- no read no write no execute) and no flags and with mapping type 'df' = ?. >=20 > Thanks , > -Shamantha. >=20 > On Fri, 11 Sep 2020, 19:31 Ian Lepore, wrote: >=20 > > On Fri, 2020-09-11 at 19:26 +0530, SHAMANTHA KRISHNA K G wrote: > > > Thank you for the heads up, I had tried the output of procstat > > > -v also > > > ,there also I am not getting any information about heap usage . > > > > > > Thanks > > > -Shamantha > > > > > > > The output does tell you about heap usage, but you have to interpret > > the type and flags to figure out which mappings are heap allocations, > > and the RES count to figure out how many pages of those mappings are > > actually in use (i.e., backed by physical ram). > > > > Iirc, the mappings with type 'df' and no flags set are the heap > > allocations, but I'm not positive of that. Things with the D flag set > > are thread stacks. I remember the manpage wasn't all that helpful in > > figuring that stuff out last time I needed to know. > > > > -- Ian > > > > > > > > > > > > > > > > > > > > > > > On Fri, 11 Sep 2020, 18:59 Ian Lepore, wrote: > > > > > > > On Fri, 2020-09-11 at 16:36 +0530, SHAMANTHA KRISHNA K G wrote: > > > > > Hello All, > > > > > I want to know the *size of heap and stack for a running > > > > > process* ,how > > > > > it can be done, if I* don't *see any* [stack ] *or* [heap] > > > > > *in the > > > > > output > > > > > of */proc/pid/map* and also the platform does not allow > > > > > installing > > > > > *third party > > > > > freebsd utilities like valgrind.* > > > > > > > > > > Thank you, > > > > > -Shamantha > > > > > > > > > > > > > Use procstat(1). For example "procstat -v " will show all the > > > > memory mappings for that process. If you need it from within a > > > > program > > > > you're writing, "man libprocstat" will get you some info on how > > > > procstat(1) does its work. > > > > > > > > -- Ian > > > > > > > > > > > > > > _______________________________________________ > > > freebsd-hackers@freebsd.org mailing list > > > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > > > To unsubscribe, send any mail to " > > > freebsd-hackers-unsubscribe@freebsd.org" > > > > > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.org" --yzybwqftyuawtm5t Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEA6TL67gupaZ9nzhT/y5nonf44foFAl9bi9QACgkQ/y5nonf4 4fpfDBAAn5lhCa9TcnttMUpuc9lxnCkhTRBDswahI5mooOO390O/zlPntMuhN1Af 1GmB3JBcQse7F/bA0Faya8qnLVOsh2Dag42YGo6KW0FfDB0aT6KIB9hBTXSal2TG heNTGoHIez51c6xU9D9/Yx25/F5XB4rj7kqqPrmiE8GfsGAuS9+xvHE4fLtyfiY1 9ZuJc1+4/qzFw9EaHrHxDsWZLH3pPxPWrkm335XBlt1SbyNE4YJ4m3AWCjplm6+H O8nExtQPk7+k1Octh6pqmz6qk9THNnyx652A6qsLbgBwEEoLIYOt1lo4MgJIJFdk ahCP8O5Q7vAeKyP5Trac7yPUDW8B5cZh1jbs0VBf4SHjIq0NWre7bDdFbnDqIJKl qfXO2Er8MflS4FiltsfuqcbyoLcxtLVls05MN0/wHZNXywkcAIR1Fsd2AqlULT23 Npm7fSDFVHd1UGADzPHTw6BpkDA5Ew4WQGtwb30ObQwMA5t29F3kV3ndGQMGBg9e 0XWJc7OHJzY60H9KGh6umQKZLustqYo4Jc+CbxHXLslhMfICPwg2w76C4TmyHQOV 0qmHPKwVnow3KUws2luHN8Gr1wEa9AwcP2rw1aBMg/z1TwPNnZT3azXJsTsJBhX4 NvupPLhf67bUOwsMH8OFyQYE1K0YJGK9RjXDhoxG7mQ2eHGtwV0= =dCFB -----END PGP SIGNATURE----- --yzybwqftyuawtm5t-- From owner-freebsd-hackers@freebsd.org Fri Sep 11 19:28:19 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 804103E3ECB for ; Fri, 11 Sep 2020 19:28:19 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qt1-x82f.google.com (mail-qt1-x82f.google.com [IPv6:2607:f8b0:4864:20::82f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp5QB2D4kz3VxZ for ; Fri, 11 Sep 2020 19:28:18 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-qt1-x82f.google.com with SMTP id k25so8801134qtu.4 for ; Fri, 11 Sep 2020 12:28:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=Db+PtTcBIpzJB84avVvcvPK1FL2qJ+FyoYYD7oX0L60=; b=THxj4HQJv/jqFWh7aFzj3z7oYnlW5PAcPoL7mwtRk3cZF9sBe9z9zRVVfMVU89510a 7k7tdXReE9Y5LihYgIouQ/NKnr2d2VwssxnUZMQ7msU7aPJlvkGut/pTMfVdJD0THhkj d+4xArbm4b8P4AGz+VfOE92IT5lI0tYs0hsko2/tXP+P8nqFfQ1QGT2Gwi6giatYFoiO i/+tMzAyIX/rV+FSzceEahzp6FHh0GCNow5jyBfVA1XDCW1/qFEojM3zN5ZR2QU3rDni 6bIrjqFGgQHq7LhRaN4fI4MGz0/DG8ibhmPj0fan3AuqZNqooda0jGf9KBg2tbDb/B7F 7wQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to; bh=Db+PtTcBIpzJB84avVvcvPK1FL2qJ+FyoYYD7oX0L60=; b=C2t750VkENJNGi/aQ13yjjbxxRd1/ThYhI+4gbZzZhKG8tqpcXG6ENApAtMQdJ+yIP 2wNu9Grcrl9JSBTmqlpDUYbgdf4Kp9AXoTsvCN9r6AFzYQM+h8ZB1xULE5bPJIcppTpa 8i0EJ+fKISyfrpsdYYl28SZzly6IbD0kRGH5Oicg8684bsIlRXvCeSBMA56nGKJFWT8j mpr15fjN9J4iSCJUwgJ+FuJYhOGcruP7mdO6NnMtaiR7ur9pPTrypa9kJ3nAvoKTYspN 4dAfXFCnjeSMQsuS+D/+sBmYECAcm9EF6bjqwFEBOQJ2/NxiTgZcBpPRWQ4ABLwqkfSj HYwA== X-Gm-Message-State: AOAM530s5ZRgeaOtDuX6S3W2buU5+GeyxTuukggDfsAJkinkhwxgDOPh OpGikAe1OWKCjPrbCfV1aGEwtJ3m5L1RWg== X-Google-Smtp-Source: ABdhPJzceFidSPrh9KzkZwGQR8oBKFnXeujtL/jB+j9Vx4v4VcnMALJcVkmNUYDIG38JEKgkzhquvw== X-Received: by 2002:ac8:5d14:: with SMTP id f20mr3494414qtx.104.1599852497113; Fri, 11 Sep 2020 12:28:17 -0700 (PDT) Received: from raichu (toroon0560w-lp130-08-67-71-176-35.dsl.bell.ca. [67.71.176.35]) by smtp.gmail.com with ESMTPSA id v131sm4167147qka.97.2020.09.11.12.28.15 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 11 Sep 2020 12:28:16 -0700 (PDT) Sender: Mark Johnston Date: Fri, 11 Sep 2020 15:28:08 -0400 From: Mark Johnston To: Yoshihiro Ota Cc: freebsd-hackers@freebsd.org Subject: Re: Integration Test, Unit Test, and head/tests in FreeBSD Message-ID: <20200911190238.GA39530@raichu> References: <20200908201352.e4e78f7aea8a2b081adfb57e@j.email.ne.jp> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20200908201352.e4e78f7aea8a2b081adfb57e@j.email.ne.jp> X-Rspamd-Queue-Id: 4Bp5QB2D4kz3VxZ X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=THxj4HQJ; dmarc=none; spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::82f as permitted sender) smtp.mailfrom=markjdb@gmail.com X-Spamd-Result: default: False [-1.28 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; NEURAL_HAM_LONG(-1.00)[-0.996]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; NEURAL_SPAM_SHORT(0.40)[0.405]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::82f:from]; NEURAL_HAM_MEDIUM(-0.98)[-0.984]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 19:28:19 -0000 On Tue, Sep 08, 2020 at 08:13:52PM -0400, Yoshihiro Ota wrote: > Hi Hackers, > > How are FreeBSD unit tests, integration test, and CI pipe lines are connected? We do not have a rigid separation between types of tests. Most tests for executable programs will use shell scripts to invoke the programs and verify that they behave as expected, i.e., no unit testing. Most tests for libraries are C code that link against the library and test its entry points. Some library tests will compile standalone helper programs that link against the library and test it that way. It depends a lot on the nature of the code being tested. Individual source files may be linked into a test program to provide some type of unit testing, but we do not have any framework for mocking, and most of the code in the base system is not very amenable to being unit-tested. sbin/dhclient/tests/option-domain-search.c links some code from dhclient, for example. The CI pipeline periodically builds the head branch, installs it into a VM image, and runs tests in a VM. There is currently no way to ask it to run tests against a patch. You would need to run the tests manually, by installing tests and running "kyua test" from whichever subdirectory of /usr/tests you are interested in. Running it from /usr/tests will run all tests. > I found some documents from "man tests", tests/README, and few others. > > I also wasn't clear how unit tests and integration tests are organized in the tree well. Are all integration tests in shell script, for example? In principle tests can be written in any language. We make use of a test framework called ATF which supports sh, C and C++ (and maybe some others, I'm not sure). The test runner is called kyua and can consume output from multiple test frameworks like TAP or ATF. Tests can be written in other languages, they just need to declare their dependencies in the Makefile. Some of our kernel tests are written in python for instance; DTrace tests are written in ksh and perl. The CI system installs some packages to ensure that these tests still get run. Tests for individual programs or libraries usually live next to the sources, in a directory called "tests". Tests for the kernel live in tests/sys/. > For example, I want to make a change to ggated/ggatec under sbin/ggate and would like to couple with unit tests. Will I create sbin/ggate/tests or sbin/ggate/ggated/tests and sbin/ggate/ggatec/tests or all of these 3 directories based on APIs? I would suggest putting them in sbin/ggate/tests. Tests for the client and server components could be placed in separate files if that ends up being useful. I don't see any real advantage in splitting up client and server tests into separate directories given that ggate is relatively simple, and it seems likely that they will share some code. > Where should I put it and how do I set up so that review/phab can verify as well? For the purpose of review, you can submit a patch through phabricator just as you would for code changes. As I noted there is currently no mechanism to automatically run tests on your behalf; you'll have to run the tests yourself until they are committed, at which point they will be run regularly as part of the CI system. From owner-freebsd-hackers@freebsd.org Fri Sep 11 19:35:34 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 10B263E3FAC for ; Fri, 11 Sep 2020 19:35:34 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-io1-xd29.google.com (mail-io1-xd29.google.com [IPv6:2607:f8b0:4864:20::d29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bp5ZY2DYmz3W72 for ; Fri, 11 Sep 2020 19:35:32 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-io1-xd29.google.com with SMTP id z25so12247317iol.10 for ; Fri, 11 Sep 2020 12:35:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=sender:from:mime-version:subject:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=c85G+W35JQyxGVEavyK23zpqyldtwP+bLK3n/+VjWls=; b=VgZQYclnH4W1XoSyqClTq4UTNbv9/hzlK3cmXCi0F1KY+YS9Soz/xPkKj+Zr2hfmLY XFpr/o0HqxZ1TbWwtWo95XNQtCZC8pJnxN4pVfwG1l2b2Ml/V46VDZCpN3VS/wjfonky i6AZFhL6QmZYCfwttTElIKVCuWTe3M/SDQqFSazWZaKyUibpg+u2RXDeTcQTlxAtwklm V0ru3r9zdl3+2+knxgEUlikUab+j86fAOZ3TX7DUIaL+cq7aqlChHEeeCRPTjBG/VpsE 2pUualqg3TYvOa+AHCmQD+a8pFPSCznIEHixRtnwUNtpL6ZU4q5Nb6mCy8yPKjEw3aJC IcLA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:from:mime-version:subject:in-reply-to :date:cc:content-transfer-encoding:message-id:references:to; bh=c85G+W35JQyxGVEavyK23zpqyldtwP+bLK3n/+VjWls=; b=LJG5XJs8Ulknz5WxhtH5ec8aHh/R8OfLcaRUyobNMrIo4MH9nz6Z663xwPoy9BMcCJ eQE0sqmxgIBusvPFz8fmx+T5Vi4BL8wEHGRYlweh+pdDbrBC4icVxFTk7OnRD4Gm6REV BHUOBDHtGh5pHFyPbLV9ZZT26rTj4MyTtW3aDR0Du4PWQXxtHtEg58su9k7/g55/9xF5 Z6TFswrJx+qLSJW7hFZ0JQTe5RqqRh0mk8ENOUwSP2YIprZEpvzDlF8HY6gcf32SIG6t XORbpIltcu45UEy4tMTr17TuDqcaL+I5dS+jooDQF0ODbwfi5FuKk2+zWiyeHGLHRdc2 FZPA== X-Gm-Message-State: AOAM533aE/a73+q/IDqku2xOKJZJhi89JGI+BFvaIFPK8MS8GB541bAP ThALFdvCMK6dF9qf2qD7Vw5AEA== X-Google-Smtp-Source: ABdhPJwX1oig3Sd2BKMa+NSB2oJFirbEMCAHUA9n6or6uumEdNCVp/iF2dNE22/9DrGViU4TkN7ohw== X-Received: by 2002:a6b:3bd8:: with SMTP id i207mr3005697ioa.150.1599852931974; Fri, 11 Sep 2020 12:35:31 -0700 (PDT) Received: from ?IPv6:2603:300b:6:5100:18db:d97a:14f0:179? ([2603:300b:6:5100:18db:d97a:14f0:179]) by smtp.gmail.com with ESMTPSA id m15sm1711488ild.8.2020.09.11.12.35.31 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 11 Sep 2020 12:35:31 -0700 (PDT) Sender: Warner Losh From: Warner Losh X-Google-Original-From: Warner Losh Content-Type: text/plain; charset=utf-8 Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Integration Test, Unit Test, and head/tests in FreeBSD In-Reply-To: <20200911190238.GA39530@raichu> Date: Fri, 11 Sep 2020 13:35:30 -0600 Cc: Yoshihiro Ota , freebsd-hackers@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <3E1A9477-A408-49E7-B1D7-B6389E3FA7CF@gmail.com> References: <20200908201352.e4e78f7aea8a2b081adfb57e@j.email.ne.jp> <20200911190238.GA39530@raichu> To: Mark Johnston X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Rspamd-Queue-Id: 4Bp5ZY2DYmz3W72 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=VgZQYcln; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::d29) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-1.26 / 15.00]; RCVD_TLS_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-0.97)[-0.966]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_DN_SOME(0.00)[]; NEURAL_SPAM_SHORT(0.20)[0.203]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d29:from]; NEURAL_HAM_MEDIUM(-0.99)[-0.994]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Sep 2020 19:35:34 -0000 > On Sep 11, 2020, at 1:28 PM, Mark Johnston wrote: >=20 > On Tue, Sep 08, 2020 at 08:13:52PM -0400, Yoshihiro Ota wrote: >> Where should I put it and how do I set up so that review/phab can = verify as well? >=20 > For the purpose of review, you can submit a patch through phabricator > just as you would for code changes. As I noted there is currently no > mechanism to automatically run tests on your behalf; you'll have to = run > the tests yourself until they are committed, at which point they will = be > run regularly as part of the CI system. While not part of FreeBSD, per se, nor part of phabricator, people have = had good luck using cirrus-ci on GitHub to push a branch to do some = testing. It would take some work to take the current .cirrus-ci.yml file = and adapt it to your needs. It current builds FreeBSD on a 12.1 instance = and then boots the amd64 image using qemu to run a basic test. You can = setup Cirrus-CI to run on selected branches you push to GitHub. And if you do make improvements in the area you=E2=80=99d like to share, = please cc me on them. Thanks Warner From owner-freebsd-hackers@freebsd.org Sat Sep 12 11:19:14 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0EA3E3D3DDD; Sat, 12 Sep 2020 11:19:14 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from mail.metricspace.net (static-108-31-38-18.washdc.fios.verizon.net [108.31.38.18]) by mx1.freebsd.org (Postfix) with ESMTP id 4BpVWN6N4Yz3Vjr; Sat, 12 Sep 2020 11:19:12 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f] (unknown [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: eric) by mail.metricspace.net (Postfix) with ESMTPSA id 7C5F111512; Sat, 12 Sep 2020 11:19:06 +0000 (UTC) To: freebsd-hackers@freebsd.org, freebsd-current From: Eric McCorkle Subject: Problem with zfs.ko: lockstat_enabled symbol Autocrypt: addr=eric@metricspace.net; prefer-encrypt=mutual; keydata= mDMEXonLJBYJKwYBBAHaRw8BAQdA4oHU11A8qtqD0EtRofyORHbGX1ZIT/mnk9eceKQx56q0 JEVyaWMgTWNDb3JrbGUgPGVyaWNAbWV0cmljc3BhY2UubmV0PoiZBBMWCABBAhsDBQkB4TOA BQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAFiEEPfuJobsx0Me4pIwLPOOjZtwQVqwFAl6JzIAC GQEACgkQPOOjZtwQVqy2DgD+IRCNNfb7C16fjEHazDMBwmBIMz+CTJUdhoz73P9iy0cA/ixK 83qOW46q1fpCpaZtPvv0FRpcZ5EppnNQ0Yuh40YLuDgEXonLJBIKKwYBBAGXVQEFAQEHQCxw rRXlvDoXgDGv2WMrLy9UaJ4fNWXIdlaiiKZIH7lBAwEIB4h+BBgWCAAmFiEEPfuJobsx0Me4 pIwLPOOjZtwQVqwFAl6JyyQCGwwFCQHhM4AACgkQPOOjZtwQVqxS7wD+JgzZC4995EL9j2iB qhPUZTIgs61IypLoDx+o1zsSfvkBALs+/jvkQL4plT0hGtfFaa0iMnLeIXKd/1FSNGSD9hQI Message-ID: <4140b983-3d61-e1a4-dd7f-90bce61c45cf@metricspace.net> Date: Sat, 12 Sep 2020 07:18:58 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="HHIPHTKIM47FDkXXToEkIMhRLQwwZNwzG" X-Rspamd-Queue-Id: 4BpVWN6N4Yz3Vjr X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of eric@metricspace.net has no SPF policy when checking 108.31.38.18) smtp.mailfrom=eric@metricspace.net X-Spamd-Result: default: False [-3.10 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eric]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; DMARC_NA(0.00)[metricspace.net]; AUTH_NA(1.00)[]; NEURAL_SPAM_SHORT(0.04)[0.037]; NEURAL_HAM_LONG(-0.99)[-0.994]; NEURAL_HAM_MEDIUM(-1.04)[-1.040]; RCPT_COUNT_TWO(0.00)[2]; SIGNED_PGP(-2.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; ASN(0.00)[asn:701, ipnet:108.31.0.0/16, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current,freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 11:19:14 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --HHIPHTKIM47FDkXXToEkIMhRLQwwZNwzG Content-Type: multipart/mixed; boundary="ChsWi0vN0mgx9mrQCfMRZR45G9vgO4CtM"; protected-headers="v1" From: Eric McCorkle To: freebsd-hackers@freebsd.org, freebsd-current Message-ID: <4140b983-3d61-e1a4-dd7f-90bce61c45cf@metricspace.net> Subject: Problem with zfs.ko: lockstat_enabled symbol --ChsWi0vN0mgx9mrQCfMRZR45G9vgO4CtM Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable I recently updated my other laptop, and now I'm getting a problem loading zfs.ko at boot, relating to the lockstat_enabled symbol not being defined (this happens during kernel boot and prevents mounting root, so I can't get an exact trace) Looking at the new kernel, it seems that only zfs.ko contains the symbol lockstat_enabled (notably, kernel does not). In my old kernel, zfs.ko does not contain a reference to that symbol. Has anyone else seen this? Is there a workaround, or was this a one-off bug? --ChsWi0vN0mgx9mrQCfMRZR45G9vgO4CtM-- --HHIPHTKIM47FDkXXToEkIMhRLQwwZNwzG Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQQ9+4mhuzHQx7ikjAs846Nm3BBWrAUCX1yupQAKCRA846Nm3BBW rDiXAP915n/mFCSx7GFT6rDGVqOWi2iZ615Hcrjcdg5tcz6bMQD/Tk86anZBgnc5 2Ue0vytCTYslao8cZzUqZrGJjS3CdwA= =15Wr -----END PGP SIGNATURE----- --HHIPHTKIM47FDkXXToEkIMhRLQwwZNwzG-- From owner-freebsd-hackers@freebsd.org Sat Sep 12 11:51:25 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9846D3D484A for ; Sat, 12 Sep 2020 11:51:25 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from wout3-smtp.messagingengine.com (wout3-smtp.messagingengine.com [64.147.123.19]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpWDX4nvbz3Xkh for ; Sat, 12 Sep 2020 11:51:24 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 659CA5A4 for ; Sat, 12 Sep 2020 07:45:47 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Sat, 12 Sep 2020 07:45:47 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h= date:from:to:subject:message-id:mime-version:content-type; s= fm3; bh=AJAwXpgKUfcKy9K2fWwXhtRHcS9u1fJ70S15hTgSNDI=; b=J4vKRdE0 ftWSGCwZnuszPUGmdT96zdVCBJFOxJnY0ZqCU6PZCxzbPI8xoj7/Quebr+75zOG4 417YuyC1ceoYCIW07r52XgeNUiw2/We1cb5cZvDcFH3j/unuKwIsL1ebokVfAoYX UBnCmgVusv8t51WK8PoF4hv9Od5ktwF5878jDOP7XRH4Lh7cF04MDU0A/VTvi5Ay pCJvJPviDFESTopYoQRJ2Ls7LHua0XRexe8k1SMlQ14fDkHdC5U4VJB9wGAII26g G8jf4OkN6ekRoWviw/rGjX+d236Df2T+76n+EAD4fbQ9DoTDAVMn6v/4iOtLW2gv U2fTey3E/u7Eag== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm3; bh=AJAwXpgKUfcKy9K2fWwXhtRHcS9u1 fJ70S15hTgSNDI=; b=BHTyg5r64SR1/AUNAxjwuAtLjuYJhTeq1XWGJg0ulpxhW GA502ubXFvuX6hC6a0NukKbGynLmjKVkYZOGGyV5sTYp/5UA4FF6MaDHBg1j+uqP Q3u3t6olg8/rUQj3Lm9FDpfGPfF6L5XKZ5ugtcLCDAtZ3jdCI0YhKMsyAsjh0W2S UAmENLcxJCjtAIeflQFfvR/rvuOlFVWB3hS4dBNggnmPUdGLaB2FTloXn22USIe7 VFUfSl1ZF9cD8kAzIQvy7aSxk+fL+jId0ig3JZZKmFZNmpm0TVVX6zPTSIXZkpZF lxvnZ5zjv6N8tRy34XlywKOn7wez154D3c4hNUVyQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduiedrudeiuddggeehucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesghdtreertd dtvdenucfhrhhomhepthgvtghhqdhlihhsthhsuceothgvtghhqdhlihhsthhsseiihiig shhtrdhnvghtqeenucggtffrrghtthgvrhhnpeevgffhffdtfeekleelhedtjeelvdfhvd egieejveffgfduvdfhteegjeeujeeuieenucfkphepkedvrdejtddrledurdelleenucev lhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehtvggthhdqlh hishhtshesiiihgihsthdrnhgvth X-ME-Proxy: Received: from bastion.zyxst.net (bastion.zyxst.net [82.70.91.99]) by mail.messagingengine.com (Postfix) with ESMTPA id 7B1D43280060 for ; Sat, 12 Sep 2020 07:45:46 -0400 (EDT) Date: Sat, 12 Sep 2020 12:45:17 +0100 From: tech-lists To: freebsd-hackers@freebsd.org Subject: cross-compile mips64 on aarch64 - possible? Message-ID: <20200912114517.GG91422@bastion.zyxst.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="6BvahUXLYAruDZOj" Content-Disposition: inline X-Rspamd-Queue-Id: 4BpWDX4nvbz3Xkh X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm3 header.b=J4vKRdE0; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=BHTyg5r6; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 64.147.123.19 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-4.67 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm3,messagingengine.com:s=fm3]; NEURAL_HAM_MEDIUM(-0.98)[-0.979]; FROM_HAS_DN(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[64.147.123.19:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:64.147.123.19]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.987]; RCVD_COUNT_THREE(0.00)[4]; DMARC_NA(0.00)[zyxst.net]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; SUBJECT_ENDS_QUESTION(1.00)[]; ASN(0.00)[asn:11403, ipnet:64.147.123.0/24, country:US]; RCVD_TLS_LAST(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers]; RCVD_IN_DNSWL_LOW(-0.10)[64.147.123.19:from] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 11:51:25 -0000 --6BvahUXLYAruDZOj Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, Is it possible to cross-compile mips64 ports on aarch64? QEMU=20 isn't for aarch64. The aarch64 is raspberry pi 4 What I'd like to be able to do is, on a rpi4, have poudriere [1] build port= s for a mips64 system (it's an edgerouter lite 3). If not possible on poudriere, wh= ich seems to want qemu , then some other means, probably involving binmiscctl. The reason i'd like to do this on the rpi4 is that it sips hardly any power and is on 24/7. So far it's been stable, running a patched (D26344) r365391= M. There's a 1Tb usb3 disk attached, which is zfs.=20 [1] poudriere-devel-3.3.99.20200326 thanks, --=20 J. --6BvahUXLYAruDZOj Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAl9ctN8ACgkQs8o7QhFz NAVPZBAAhhqOiLb1t8ycTNgQ6tRaxZW/8gSFCyHPmomjAGoXm5ikjrZwbdGvyn32 k8LPVzd7z7zmEqcNxU1mEM1dl5xz2w9kuFFWn4Ph6CeGFbo4y1CdqFKF+vRQQG+v A17gjEqNOkSPUfFBlFmYa7zlUAQ54m/e3iVFnV7aWiATpkbhPnwVW43kj3iQ2PTa 4Zy74f6pRQdoKOupWRsGDuZPTaaj6aglWB02vkx1okABzSM46bApK6mKI4RTGFUl ClPjOkUv3CIUWE/5i0HjJN7TxqWi63tI3w4fFW+85lDXq+QpjDGAUtnxVrD2qrHU H3FZNe1bAoq8wAWRITN28AqZIjCObRblF10G7uMJxTgqL1hVaTMiYC38i4DarpNw /FBmjHsb5QgZiO+Si10/8Qbufh2E9pTWrT5rWO1Y+wDg5X51yhZSGBTpnOr6RCE1 YnwgQ58JiiVuOVNNHLfxgPxzdfSZtMdctqauQOmEfbZv8MIoiKdOHX2UDExCx5b1 mznqvqGtNDTpT0NrC8X4r5vythqiZS0vUEvF8TI7LpqOC7UtcOrxx5VaEmOU/SVr cb5QgBjbsg/mF5kaWS8TLbCiUj6jhdbIOTjaS08kyZOVc5C7zuLiSxX0g+Rys7+j AjEV5WDDdd4JJEP0WytG4xj+61qr7q1JxbNs4zGT4UqRvy8dTKA= =kqgO -----END PGP SIGNATURE----- --6BvahUXLYAruDZOj-- From owner-freebsd-hackers@freebsd.org Sat Sep 12 12:55:17 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6E41D3D771A; Sat, 12 Sep 2020 12:55:17 +0000 (UTC) (envelope-from markm@FreeBSD.org) Received: from gromit.grondar.org (gromit.grondar.org [IPv6:2a01:348:e::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpXfD5P8Rz3gQr; Sat, 12 Sep 2020 12:55:16 +0000 (UTC) (envelope-from markm@FreeBSD.org) Received: from [2a02:8011:300b:42:2dd6:257a:24b4:89b1] by gromit.grondar.org with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94 (FreeBSD)) (envelope-from ) id 1kH53b-0000hR-7T; Sat, 12 Sep 2020 13:55:07 +0100 Content-Type: multipart/signed; boundary="Apple-Mail=_437A4B1A-D24C-432D-8916-77DB8E063BEE"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.120.23.2.1\)) Subject: Re: Problem with zfs.ko: lockstat_enabled symbol From: Mark Murray In-Reply-To: <4140b983-3d61-e1a4-dd7f-90bce61c45cf@metricspace.net> Date: Sat, 12 Sep 2020 13:55:05 +0100 Cc: freebsd-hackers@freebsd.org, freebsd-current Message-Id: References: <4140b983-3d61-e1a4-dd7f-90bce61c45cf@metricspace.net> To: Eric McCorkle X-Mailer: Apple Mail (2.3608.120.23.2.1) X-Rspamd-Queue-Id: 4BpXfD5P8Rz3gQr X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [0.00 / 15.00]; ASN(0.00)[asn:39326, ipnet:2a01:348::/32, country:GB]; local_wl_from(0.00)[FreeBSD.org] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 12:55:17 -0000 --Apple-Mail=_437A4B1A-D24C-432D-8916-77DB8E063BEE Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=us-ascii On 12 Sep 2020, at 12:18, Eric McCorkle wrote: > > I recently updated my other laptop, and now I'm getting a problem > loading zfs.ko at boot, relating to the lockstat_enabled symbol not > being defined (this happens during kernel boot and prevents mounting > root, so I can't get an exact trace) > > Looking at the new kernel, it seems that only zfs.ko contains the symbol > lockstat_enabled (notably, kernel does not). In my old kernel, zfs.ko > does not contain a reference to that symbol. > > Has anyone else seen this? Is there a workaround, or was this a one-off > bug? I had this, and I fixed it by adding options ZFS ... to my kernel config. I found this in a nearby NOTES file; perhaps it should be in GENERIC? M -- --Apple-Mail=_437A4B1A-D24C-432D-8916-77DB8E063BEE Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 Comment: GPGTools - http://gpgtools.org iQEzBAEBCgAdFiEEyzPHvybPbOpU9MCxQlsJDh9CUqAFAl9cxSkACgkQQlsJDh9C UqBWtggAq/ANx0rzt1myKHGT9lyDtoosa/P33BsbtN4IioKUIJjx7BUzuHQ6f9Ny vc1fpFW2TeUFG2E9C41iux8aYpzQ67itlf8B7jgglzkNJu25bmjeMUXZj2ldUC/P fjt75/GN9EJiL3HODKNyugDq9/utGf5nV7dGUN3YhzdOzA30ZD0G5WFSOWvhtgra Gzk0C2uBPi4HEkzKld8r8O8RD5LrCKKR93fu2Pl5vANFcBSbZyrVDcXPsYEjWzuk PmUmRnSk/h6z0I6ukSHELj+d/GIZZ686s15kQanQjHDITxJEDVfApey7kWGLaTJC uDyfB7E9yoanBzQGPJGZRP/J9mCo3g== =epPY -----END PGP SIGNATURE----- --Apple-Mail=_437A4B1A-D24C-432D-8916-77DB8E063BEE-- From owner-freebsd-hackers@freebsd.org Sat Sep 12 14:14:20 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 86CE33D919B; Sat, 12 Sep 2020 14:14:20 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BpZPS30b7z42cL; Sat, 12 Sep 2020 14:14:20 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-qk1-f170.google.com (mail-qk1-f170.google.com [209.85.222.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 458C32F638; Sat, 12 Sep 2020 14:14:20 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-qk1-f170.google.com with SMTP id g72so12736112qke.8; Sat, 12 Sep 2020 07:14:20 -0700 (PDT) X-Gm-Message-State: AOAM531Z/S2BAMcW+NCTDC3ebMxFo4jrtxuK+4uApD1th07Bf3zrS3o9 EZPXaRuRlZfSzZZe6nDh2Npp7j0qo96FGKU554k= X-Google-Smtp-Source: ABdhPJz7/6ss2U3SXKMHuSLRVmZBsCxOIIOY+iqQsDTxSBU2y368264Ln/zjfNPu2bpkqlU+YFICAqelP4bwz550B6I= X-Received: by 2002:a37:a189:: with SMTP id k131mr5687453qke.34.1599920059797; Sat, 12 Sep 2020 07:14:19 -0700 (PDT) MIME-Version: 1.0 References: <4140b983-3d61-e1a4-dd7f-90bce61c45cf@metricspace.net> In-Reply-To: From: Kyle Evans Date: Sat, 12 Sep 2020 09:14:08 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Problem with zfs.ko: lockstat_enabled symbol To: Mark Murray Cc: Eric McCorkle , "freebsd-hackers@freebsd.org" , freebsd-current Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 14:14:20 -0000 On Sat, Sep 12, 2020 at 7:55 AM Mark Murray wrote: > > On 12 Sep 2020, at 12:18, Eric McCorkle wrote: > > > > I recently updated my other laptop, and now I'm getting a problem > > loading zfs.ko at boot, relating to the lockstat_enabled symbol not > > being defined (this happens during kernel boot and prevents mounting > > root, so I can't get an exact trace) > > > > Looking at the new kernel, it seems that only zfs.ko contains the symbol > > lockstat_enabled (notably, kernel does not). In my old kernel, zfs.ko > > does not contain a reference to that symbol. > > > > Has anyone else seen this? Is there a workaround, or was this a one-off > > bug? > > I had this, and I fixed it by adding > > options ZFS > > ... to my kernel config. > > I found this in a nearby NOTES file; perhaps it should be in GENERIC? > This looks like a header bug, and the above fixes it by just compiling in ZFS so that the undefined symbol is not an issue. See the below patch, which moves the extern declaration of lockstat_enabled under KDTRACE_HOOKS (you must be missing this option). I haven't even build tested: diff --git a/sys/sys/lockstat.h b/sys/sys/lockstat.h index 6a5f79a2f15..d42026f9b2d 100644 --- a/sys/sys/lockstat.h +++ b/sys/sys/lockstat.h @@ -77,10 +77,10 @@ SDT_PROBE_DECLARE(lockstat, , , thread__spin); #define LOCKSTAT_WRITER 0 #define LOCKSTAT_READER 1 -extern volatile bool lockstat_enabled; - #ifdef KDTRACE_HOOKS +extern volatile bool lockstat_enabled; + #define LOCKSTAT_RECORD0(probe, lp) \ SDT_PROBE1(lockstat, , , probe, lp) From owner-freebsd-hackers@freebsd.org Sat Sep 12 18:24:18 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3DEE13DF37E; Sat, 12 Sep 2020 18:24:18 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bpgxs2myJz4LHJ; Sat, 12 Sep 2020 18:24:17 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail (mail [192.168.254.3]) by mail.madpilot.net (Postfix) with ESMTP id 4Bpgxk0lKVz6f9B; Sat, 12 Sep 2020 20:24:10 +0200 (CEST) Received: from mail.madpilot.net ([192.168.254.3]) by mail (mail.madpilot.net [192.168.254.3]) (amavisd-new, port 10026) with ESMTP id LQuLyx0AWPD2; Sat, 12 Sep 2020 20:24:07 +0200 (CEST) Subject: Re: Problem with zfs.ko: lockstat_enabled symbol To: Eric McCorkle , freebsd-hackers@freebsd.org, freebsd-current References: <4140b983-3d61-e1a4-dd7f-90bce61c45cf@metricspace.net> From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= mQENBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAG0Hkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PokBOQQTAQgAIwIbAwIeAQIXgAUL CQgHAwUVCgkICwQWAgMBBQJS79AgAhkBAAoJEBrmhg5Wy9KTc0kH/RO64ORBlTbTHaUaOj8F Je5O5NU2Pt9Cyt5ZWBRvxntr1zPTJGKRPS9ihlIfqT4ZvEngQGp57EUyFbCpI0UWasTerImM tt5WACnGmCzUTB39UXx8Oy4b1EgWeTJQ747e/F1mQLXTNa6ijRBE9fYlTb4gAkPN88/wVV9v 3PZozKLTg16ghBzHM/P7Lk8L7clPEZChX1FTa/6eSt3nvzfCuTMZbBPJF/ph+q1KyPqRgVfh tyhu5dvgMoPz/ni41IfeSrkJTD5RXzdyGR9q4Z1NYeBsLkRjC4LxKAP5KqUsvlOUjKvO1byj ApYdMarol+IGkaSk9e3zVYAJkWKjn/ni8Xa5Ag0EUxB7QQEQAKFhrDceoPdK/IHDSmoj6SQY isvM7VdhcleS7E9DoEAVt7yMbf6HbbMVTTY6ckvwTWQssywLBXNVqxgc4WLJjzfUhgef+WE7 5M3+WFYlOVQLGZY/zEVgma1raYnOHNAOzeHLDmEXjbZP6vGAeDyBbGfQPpE7qGYZ7ubeT3Xw QO+PklcCrvOPj2ZPcAxGNS2xVU/LzONqCrJqLMJSIcCdsbiSP4G5PnDFHtMokaTY6OEr8OEQ fOAerhcHUa/z7Uu8YtmaqKH+QGkE/WEgaRqSiTnv0JOTD+DxehaqvoKPPZ++2NpCZMHB2i6A /xifmQwEiIjEXtcueBRzkNUQkxhqZyS13SrhocL9ydtaVPBzZatAEjUDDEJmAMLVFs45qfyh MiNapHJo2n3MW/E5omqCvEkDdWX/en3P7CK2TemeaDghMsgkNKax/z0wNo5UZCkOPOz0xpNi UilOVbkuezZZNg65741qee2lfXhQIaZ66yT7hphc/N/z3PIAtLeze4u1VR2EXAuZ2sWAdlKC NTlJMsaU/x70BV11Wd/ypnVzM68dfdQIIAj1iMFAD/lXGlEUmKXg5Ov2VQDlTntQoanCYrAg +8CttPzjrydgLZFq3hrtQmfc0se5yv1WHS69+BsUOG09RvvawUDZxUjW19kyeN9THaNRgow3 kSuArUp6zSmJABEBAAGJAR8EGAEIAAkFAlMQe0ECGwwACgkQGuaGDlbL0pMN5wgA4bCkX/qw EVC06ToeR6C2putmSWQMgpDaqrv65Hubo+QGmg2P4ewTYQQ4g6oYWS03qHxqVVWhKz7FjfrV +dH8qbCLfSgIcvdBha7ayGZVrsiuMLKGbw36fcmkZPpSDOfHcP0XH8Z+u9CWj0xUkTxAlZ/7 i6gYSUpG2JWNtdmE/X8VVEyXusCLwy0K0BI60A/4dRTIX3C4QKrJ3ZbUXegz70ynjHf+lQMZ 9IZKASoRMuS5FozPQh6abvmwZEPdf5I9riUElzvHrqJ8Bx0t3Pujdoth+yNHpnBxrtO8LkQd rQ58P0SwcaIX33T2U9pG8bhu5YVR88FQ8OQ0cEsPBpDncrkBDQRPhvpdAQgAsd6mrOq1GSZw lzRscNQa9W2WB/3Tj4ON4PL2e9B+hc9lT/ny2zB3agXu5wbsXTzwxgJpQT7hNHkCSckW98h3 HRjFfhZPNCgInuUGsjcNyVguQh+/47ckhph0s7U+6B4yNuIiqQZk4mo8WgCNj1YIihVmGWEs gDOwMaajbDYZ0r1/3GkKlYjOXeUuT/WgourrSR5oZJVNA/k4X2H7M3JUr1BSc32L7BJt8M7A ntul6k17J0L8GmkvLvTUtQTO+p+DYQMna2ngD3PbAvQRcbEGnkg9ABrdEF0Wp4Gx+gGGWsyF KlHvPdMtgWAy3JsS+rQapG6LoW3yUJpwpEpA86KdBwARAQABiQEfBCgBCAAJBQJTEH0NAh0B AAoJEBrmhg5Wy9KTMZcIAMSsidGF4KpjGcKzhkNK0sEpevcelQ6DzgT7kcXuq6LQ6YOrbof2 /KPgGie9/ToFZfJXH8zE5GefqkKvHZbYssWilFvkI90F9n138kG205NB/2zlaQb74/v9ZMXJ XcipnIx+T2tOMCBgHJU41IMJmB+NfRt5A6CDytJdhWxqppsEo5jjy/7tJM1Nn47G87tAV8qV NUtzbS6zdnbHB4W2BJwCObbVv8epL3hu/L5efV2j2tSbVTmyvK/ClYMBqdtUo3uPX75GF/Ku YDCOP1BTA5zzmzp4PMVd+gmHcMgCZKY6lvcEtdi5FLI0we2kcY8ffPvM2d6MNhFsGLaVI95J 0oqJAR8EGAECAAkFAk+G+l0CGwwACgkQGuaGDlbL0pM18Qf9HTNNhu8N0ISKtmR8lgPhJuu8 9rOEa8KKEatr4fQ7gL+hmYOEqZ/yHLcPQvGxbAlLR7F0SheKvAEk4B1aFwGULPo0SzuO0d/W tVMEbGa95JTm/6mfiymWMlWf8UifD1MDKzzPR7Om0ybeoPM8S/RQTboUU1WLpwd4mg9pVJlK 0xr55GOSHNf4m7S+P1kvl3xgmEj14zVMq9yJBNWFlsQK5ciifh7sFpfuxWdEVbtgIdxpzImK LXSLA0vOroKAvxFTGBrBq3vxV6eUmaKyd5HbbWejmafY1ua5dcnew9lxpWKLdqkC27Vt0Cku +LtTY3325V+BChncwNcJJS7IMmBz6w== Message-ID: <4d7a830b-1413-2217-e5d5-c74a65d21219@madpilot.net> Date: Sat, 12 Sep 2020 20:24:07 +0200 In-Reply-To: <4140b983-3d61-e1a4-dd7f-90bce61c45cf@metricspace.net> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Bpgxs2myJz4LHJ X-Spamd-Bar: - X-Spamd-Result: default: False [-1.58 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.04)[-1.045]; R_DKIM_ALLOW(-0.20)[madpilot.net:s=bjowvop61wgh]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MISSING_MIME_VERSION(2.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; NEURAL_HAM_LONG(-1.00)[-0.997]; TO_DN_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[madpilot.net:+]; DMARC_POLICY_ALLOW(-0.50)[madpilot.net,quarantine]; NEURAL_HAM_SHORT(-0.54)[-0.543]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE]; MID_RHS_MATCH_FROM(0.00)[]; MAILMAN_DEST(0.00)[freebsd-current,freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 18:24:18 -0000 On 12/09/20 13:18, Eric McCorkle wrote: > I recently updated my other laptop, and now I'm getting a problem > loading zfs.ko at boot, relating to the lockstat_enabled symbol not > being defined (this happens during kernel boot and prevents mounting > root, so I can't get an exact trace) > > Looking at the new kernel, it seems that only zfs.ko contains the symbol > lockstat_enabled (notably, kernel does not). In my old kernel, zfs.ko > does not contain a reference to that symbol. > > Has anyone else seen this? Is there a workaround, or was this a one-off > bug? > I was getting this too, should be fixed by r365466. It can also be fixed by adding "options KDTRACE_HOOKS" to your kernel config, so that symbol gets defined. -- Guido Falsi From owner-freebsd-hackers@freebsd.org Sat Sep 12 22:46:33 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3AB443E49A4 for ; Sat, 12 Sep 2020 22:46:33 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from mail.metricspace.net (static-108-31-38-18.washdc.fios.verizon.net [108.31.38.18]) by mx1.freebsd.org (Postfix) with ESMTP id 4BpnmR5qwfz4bvW for ; Sat, 12 Sep 2020 22:46:31 +0000 (UTC) (envelope-from eric@metricspace.net) Received: from [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f] (unknown [IPv6:2001:470:1f11:617:3210:b3ff:fe77:ca3f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange ECDHE (P-384) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: eric) by mail.metricspace.net (Postfix) with ESMTPSA id 66AFB11478 for ; Sat, 12 Sep 2020 22:46:30 +0000 (UTC) To: freebsd-hackers@freebsd.org From: Eric McCorkle Subject: ZFS encryption and loader Autocrypt: addr=eric@metricspace.net; prefer-encrypt=mutual; keydata= mDMEXonLJBYJKwYBBAHaRw8BAQdA4oHU11A8qtqD0EtRofyORHbGX1ZIT/mnk9eceKQx56q0 JEVyaWMgTWNDb3JrbGUgPGVyaWNAbWV0cmljc3BhY2UubmV0PoiZBBMWCABBAhsDBQkB4TOA BQsJCAcCBhUKCQgLAgQWAgMBAh4BAheAFiEEPfuJobsx0Me4pIwLPOOjZtwQVqwFAl6JzIAC GQEACgkQPOOjZtwQVqy2DgD+IRCNNfb7C16fjEHazDMBwmBIMz+CTJUdhoz73P9iy0cA/ixK 83qOW46q1fpCpaZtPvv0FRpcZ5EppnNQ0Yuh40YLuDgEXonLJBIKKwYBBAGXVQEFAQEHQCxw rRXlvDoXgDGv2WMrLy9UaJ4fNWXIdlaiiKZIH7lBAwEIB4h+BBgWCAAmFiEEPfuJobsx0Me4 pIwLPOOjZtwQVqwFAl6JyyQCGwwFCQHhM4AACgkQPOOjZtwQVqxS7wD+JgzZC4995EL9j2iB qhPUZTIgs61IypLoDx+o1zsSfvkBALs+/jvkQL4plT0hGtfFaa0iMnLeIXKd/1FSNGSD9hQI Message-ID: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> Date: Sat, 12 Sep 2020 18:46:20 -0400 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.11.0 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="MdwR9JJrKKe9A9tlNeYTSgAXS5EodMik3" X-Rspamd-Queue-Id: 4BpnmR5qwfz4bvW X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=none (mx1.freebsd.org: domain of eric@metricspace.net has no SPF policy when checking 108.31.38.18) smtp.mailfrom=eric@metricspace.net X-Spamd-Result: default: False [-1.89 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[eric]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; HAS_ATTACHMENT(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; AUTH_NA(1.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.96)[-0.955]; TO_DN_NONE(0.00)[]; NEURAL_SPAM_SHORT(0.37)[0.375]; DMARC_NA(0.00)[metricspace.net]; NEURAL_HAM_MEDIUM(-0.21)[-0.211]; SIGNED_PGP(-2.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; ASN(0.00)[asn:701, ipnet:108.31.0.0/16, country:US]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-hackers] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 22:46:33 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --MdwR9JJrKKe9A9tlNeYTSgAXS5EodMik3 Content-Type: multipart/mixed; boundary="XOftPZwQwI7Ugj4pCklj4qbreuKZ4bOwF"; protected-headers="v1" From: Eric McCorkle To: freebsd-hackers@freebsd.org Message-ID: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> Subject: ZFS encryption and loader --XOftPZwQwI7Ugj4pCklj4qbreuKZ4bOwF Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable I'm thinking of migrating to ZFS encryption from GELI in the near future.= Does anyone know offhand what the state of support for ZFS encryption in loader looks like, and if there's support for passing keys to the kernel for boot-time loading? (I can look at adding these if they're missing) --XOftPZwQwI7Ugj4pCklj4qbreuKZ4bOwF-- --MdwR9JJrKKe9A9tlNeYTSgAXS5EodMik3 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQQ9+4mhuzHQx7ikjAs846Nm3BBWrAUCX11PvAAKCRA846Nm3BBW rAmYAP0dffylp5Qb1gBV+eg2LsuY1y1db0XwOxXl8YfV5ggDnwD9GgSuiJB6dhQ7 XzM3EAhXgNiJcctuRuCsd9TXnSspWA4= =gHeC -----END PGP SIGNATURE----- --MdwR9JJrKKe9A9tlNeYTSgAXS5EodMik3-- From owner-freebsd-hackers@freebsd.org Sat Sep 12 22:49:44 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 031053E4BB9 for ; Sat, 12 Sep 2020 22:49:44 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qv1-xf2d.google.com (mail-qv1-xf2d.google.com [IPv6:2607:f8b0:4864:20::f2d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bpnr66RLcz4c1q for ; Sat, 12 Sep 2020 22:49:42 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qv1-xf2d.google.com with SMTP id h1so7075658qvo.9 for ; Sat, 12 Sep 2020 15:49:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=RWXAuVdkN/4ait6oAKiUkGeqYZ44ev0ZfwLqtI+5pZk=; b=zjlBQVHrRlm8dsp2H15W1kUpC9TT7Kkn2FffMQ/em7/VR2LfvN3sUmr8RHUCRxURQP IiCxMoSkVAEMNtD2hsHNEJssONH7L/CWmCH5w8TsVpvvM/kxAUo1nkosaMPmqsLoWFZM oDrZFYH26KQfSe4T2+22r2lHtrNOLDYZ7ZkzW7Ww1JmD6VnJzEF6T+XwGCE4zCiu2Bzg wDA05IsToUVi8DU0YBJRjnOz+BO0AQTtG4r4HsEmyV+uhvbQ1R6VCdLomhgM6cnFqe+z QG39YUETMBQxoNlue3Jy8uvqEKcMl6F9hfaeiYh3dejj50lPJCXJezk4Ar2wWbecyWX9 SdwA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=RWXAuVdkN/4ait6oAKiUkGeqYZ44ev0ZfwLqtI+5pZk=; b=HISXt93Xm5m1J3RAtwMUGYxpN/YtIFoR3eBPufjLAfCIWBF7jMKxIb/MQTnDfKlmLZ MnWt3zvRRAKpXCHHPTsCagDhCv3cC58//hauSFhkW1uzj/a9hYbuOv4W3DXCskibOZRc uADTShiWEUEiU+0/0ZvE0AksC9u6/Rd0vS+dkdm/ChRh1HGkUaRk0yCSFk0RDYeyzwRf truOZHnwl39xm0a6CnfTCdzuJFnD4blXxxBNNtMObdJQrF6TrsCJht/EsOb1a3KTswlt sqE6TjqOX7LZQhIECJjb0hMhL6dpd69F79PHCjJt3S45BMKA3DINBL95bhyBt+5YLRyc Bkhw== X-Gm-Message-State: AOAM5303sMlnXvfEQR/NUBkUyTj3siCj8IaAeDJz9FjMxCy5ubBLwsQI 5GGYKL21i7zSuHuutfwRu/uhcZiUUU/tGsu2fPj4gqx50UqceA== X-Google-Smtp-Source: ABdhPJzQegV8plqjKU2G0qtcAjbrNmczpHA5zfaXcO6z7KN+0l37Rwa044C9xpin2BpbdGU4c8jrRz6r6MPZHrLPY5k= X-Received: by 2002:ad4:4891:: with SMTP id bv17mr7559226qvb.20.1599950981654; Sat, 12 Sep 2020 15:49:41 -0700 (PDT) MIME-Version: 1.0 References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> In-Reply-To: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> From: Warner Losh Date: Sat, 12 Sep 2020 16:49:30 -0600 Message-ID: Subject: Re: ZFS encryption and loader To: Eric McCorkle Cc: FreeBSD Hackers X-Rspamd-Queue-Id: 4Bpnr66RLcz4c1q X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=zjlBQVHr; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::f2d) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-2.39 / 15.00]; ARC_NA(0.00)[]; MAILMAN_DEST(0.00)[freebsd-hackers]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-0.98)[-0.983]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-0.995]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::f2d:from]; NEURAL_HAM_SHORT(-0.42)[-0.416]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 22:49:44 -0000 On Sat, Sep 12, 2020, 4:46 PM Eric McCorkle wrote: > I'm thinking of migrating to ZFS encryption from GELI in the near future. > > Does anyone know offhand what the state of support for ZFS encryption in > loader looks like, and if there's support for passing keys to the kernel > for boot-time loading? (I can look at adding these if they're missing) > Matt macey did an initial port. I've refined it to fit the stand env better. I need to upstream some things and got stalked there for unrelated reasons. Warner > From owner-freebsd-hackers@freebsd.org Sat Sep 12 22:52:45 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id DA7773E4C28 for ; Sat, 12 Sep 2020 22:52:45 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-qt1-x831.google.com (mail-qt1-x831.google.com [IPv6:2607:f8b0:4864:20::831]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Bpnvd1XKbz4cK0 for ; Sat, 12 Sep 2020 22:52:44 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-qt1-x831.google.com with SMTP id p65so10795489qtd.2 for ; Sat, 12 Sep 2020 15:52:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=cuZ6GMuq0Fzh6IBudu0Yr7Cj7tQlTrNH8OpyUAuqRv4=; b=ZAhP48sKh5SRJ89f3e1FMVDYUiwxlqNvkErpoOTpYWBH8XIivvSSpvT9Fz9KBlYNXs z2vukPGHaEE0DqzAmd6U9cjhd2os59xYq7YcIjY38gQF1kH0tPT13LJQC51LYSfMBzRY zpGpSyF68KwYZ28hU0NpXV1Zar978R+pBgOZFdQ85hcrmN8uZTM51hriks7bJgAYN/5f vqsnGNp+qLN0i/43iTx/tI8hXgx0ebH5GaiM5c8Jbw/7wsAw4AJegmIdhV4HOdBYWcor zTsJEg1fyYPIfIH+xPnlddCN4n0L86CIBmgPre7X92bF1t4xiq8W7JlMaA0GNWI+bdaD ON9A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=cuZ6GMuq0Fzh6IBudu0Yr7Cj7tQlTrNH8OpyUAuqRv4=; b=Lp46alZpMVvkg79A0GoNtdWdLTNbEqJ44wAuO01YKrNCMhacxgDZJnc0ciyOlmcO1A X8ShO3f5t8IJNLxfsA0U7h84l34jVdL1d3ZeQKKLwNjkzq9/wkilAXH0HW8L1ZawbuBZ c7a7W0msNfCTslNuHW128MRAhVJHYGjlXb5K9GAE6Zy5/s+ZX1XKptUnCqSG6593iYFV MdBdujoruoPMzOYRZr5w60wJtqYdcGIDFj5zByaEl4wkWNw48pQzuRUKV7i1ipRbnaLu WVWDhpujgg29wW0iUi3YKznXZ5ZXshXc4KdQG2r0ck4RkEcNfILf5r+hVZwFpBzp1+jP 0ECg== X-Gm-Message-State: AOAM532VAYlzT5fmr/sbA9FrLpNoSG7IJF9Wz9MyQVm1U2O4OaM5jCwO TTOxphDRYRhsVSx8ENLziShZTtuW1OhtRuXLtDaC7gnqgn2B1A== X-Google-Smtp-Source: ABdhPJwqLv8IP48d1ggnWUJO4La4PNyoE7iU81ziZqPQqnDpKzBNnB1PKGBZXQXaLXGH4lCziVazIRYYVqZXwXteypQ= X-Received: by 2002:ac8:7388:: with SMTP id t8mr7825380qtp.187.1599951164258; Sat, 12 Sep 2020 15:52:44 -0700 (PDT) MIME-Version: 1.0 References: <676dfde0-4202-1dc9-f90c-420fe9bbae27@metricspace.net> In-Reply-To: From: Warner Losh Date: Sat, 12 Sep 2020 16:52:32 -0600 Message-ID: Subject: Re: ZFS encryption and loader To: Eric McCorkle Cc: FreeBSD Hackers X-Rspamd-Queue-Id: 4Bpnvd1XKbz4cK0 X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20150623.gappssmtp.com header.s=20150623 header.b=ZAhP48sK; dmarc=none; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2607:f8b0:4864:20::831) smtp.mailfrom=wlosh@bsdimp.com X-Spamd-Result: default: False [-2.37 / 15.00]; RCVD_TLS_ALL(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20150623.gappssmtp.com:s=20150623]; NEURAL_HAM_MEDIUM(-0.97)[-0.974]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-0.99)[-0.992]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; DMARC_NA(0.00)[bsdimp.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20150623.gappssmtp.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::831:from]; NEURAL_HAM_SHORT(-0.40)[-0.401]; R_SPF_NA(0.00)[no SPF record]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com]; MAILMAN_DEST(0.00)[freebsd-hackers]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Sep 2020 22:52:45 -0000 On Sat, Sep 12, 2020, 4:49 PM Warner Losh wrote: > > > On Sat, Sep 12, 2020, 4:46 PM Eric McCorkle wrote: > >> I'm thinking of migrating to ZFS encryption from GELI in the near future. >> >> Does anyone know offhand what the state of support for ZFS encryption in >> loader looks like, and if there's support for passing keys to the kernel >> for boot-time loading? (I can look at adding these if they're missing) >> > > Matt macey did an initial port. I've refined it to fit the stand env > better. I need to upstream some things and got stalked there for unrelated > reasons. > Wait. I just got crypto and compression confused. The work is on compression.... Warner >