From owner-freebsd-arm@freebsd.org Wed Aug 8 20:48:50 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D88CE106A6ED for ; Wed, 8 Aug 2018 20:48:49 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-pg1-x529.google.com (mail-pg1-x529.google.com [IPv6:2607:f8b0:4864:20::529]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 497A2933A2 for ; Wed, 8 Aug 2018 20:48:49 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: by mail-pg1-x529.google.com with SMTP id z8-v6so1629272pgu.8 for ; Wed, 08 Aug 2018 13:48:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=a457n+teJwenzC2Gcvvl+5yJ9SFxzHa9zsCq8MZkGyA=; b=CSSbFmDl7cqaAQWvddFGuJc+5ngm7uj9ZAfptWujeC3prslTKOU/MGqYhasdSpzWUb uHwmjn0cOfDWRB2X3xEUwTVsQQr5k8HWERubGLISLO28UGhUCIiw/izbQQjpqYP2hGKx W5yfplFZ2pkQBHvvdPCMQwytqR3HRVrMb892tg5BXLmJUWJYmqsj5f4d5uQkVnlrDyUk OD60aSYU8qBTa2iPnnGJkXG9G9f5MhRQmoxmzjXqZwS1ZUJ3CC7ZGl0dvz3HY4Hp7Kb/ mbLI9NZWJSuqxlSSYFiCI2VXUXVY/gEnkPhUi7eonT4F+Tl9zhCNr8tcMO8ys6jlJo1b AIwA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :references:mime-version:content-disposition:in-reply-to:user-agent; bh=a457n+teJwenzC2Gcvvl+5yJ9SFxzHa9zsCq8MZkGyA=; b=BmovC0unhZyun5B5AA7oKP/lqybb1Bt7bTDKZaJN4Bki2HGZOKkF7zJm8Q3Xo7cWAM OlE2k3yXK8q6hvwq2LWbnIw+5P+b2c6FuGQF7woWUOIASKChJ5KROadl5MA9eJqr8IC9 FPWB/C74sgLyWzecGw+7/YzwUl+S/mcm1y5wMfz+2iYc9ldBATegG1+mgUOIqECqmxyd 69nY6JdrdMCGFLPAyG3S1QgR2rujM+wWdc3U2LXO/5MjaXpE2/RVufC2qJBvGtls8xEv tXtJVYjLRZQ/1L/ad/bk7kw4mSN3pyCWJGLvmrW5HQi/bxVb3rahfqn/Y3zZSPYH+bHo VXSA== X-Gm-Message-State: AOUpUlH48SdeV9eLiXlg2ZG/VHPzWrs4Vj5bUX0sfUScxLQaZ425ckGY GbS5DCGI//C4BqE4bse9Pf4= X-Google-Smtp-Source: AA+uWPyHfqWOmQ9O+gGxsmgQ33KGW4KQ+mSkxdT2OIQitxZlrWNG8SCyBIr88choAi04miniZ1JlIQ== X-Received: by 2002:a63:c114:: with SMTP id w20-v6mr3917143pgf.234.1533761328064; Wed, 08 Aug 2018 13:48:48 -0700 (PDT) Received: from raichu (toroon0560w-lp130-09-70-52-224-239.dsl.bell.ca. [70.52.224.239]) by smtp.gmail.com with ESMTPSA id r64-v6sm9719809pfk.157.2018.08.08.13.48.46 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 08 Aug 2018 13:48:46 -0700 (PDT) Sender: Mark Johnston Date: Wed, 8 Aug 2018 16:48:41 -0400 From: Mark Johnston To: bob prohaska Cc: Mark Millard , freebsd-arm@freebsd.org Subject: Re: RPI3 swap experiments ["was killed: out of swap space" with: "v_free_count: 5439, v_inactive_count: 1"] Message-ID: <20180808204841.GA19379@raichu> References: <20180731231912.GF94742@www.zefox.net> <2222ABBD-E689-4C3B-A7D3-50AECCC5E7B2@yahoo.com> <20180801034511.GA96616@www.zefox.net> <201808010405.w7145RS6086730@donotpassgo.dyslexicfish.net> <6BFE7B77-A0E2-4FAF-9C68-81951D2F6627@yahoo.com> <20180802002841.GB99523@www.zefox.net> <20180802015135.GC99523@www.zefox.net> <20180806155837.GA6277@raichu> <20180808153800.GF26133@www.zefox.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180808153800.GF26133@www.zefox.net> User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Aug 2018 20:48:50 -0000 On Wed, Aug 08, 2018 at 08:38:00AM -0700, bob prohaska wrote: > The patched kernel ran longer than default but OOMA still halted buildworld around > 13 MB. That's considerably farther than a default build world have run but less than > observed when setting vm.pageout_oom_seq=120 alone. Log files are at > http://www.zefox.net/~fbsd/rpi3/swaptests/r337226M/1gbsdflash_1gbusbflash/batchqueue/ > > Both changes are now in place and -j4 buildworld has been restarted. Looking through the gstat output, I'm seeing some pretty abysmal average write latencies for da0, the flash drive. I also realized that my reference to r329882 lowering the pagedaemon sleep period was wrong - things have been this way for much longer than that. Moreover, as you pointed out, bumping oom_seq to a much larger value wasn't quite sufficient. I'm curious as to what the worst case swap I/O latencies are in your test, since the average latencies reported in your logs are high enough to trigger OOM kills even with the increased oom_seq value. When the current test finishes, could you try repeating it with this patch applied on top? https://people.freebsd.org/~markj/patches/slow_swap.diff That is, keep the non-default oom_seq setting and modification to VM_BATCHQUEUE_SIZE, and apply this patch on top. It'll cause the kernel to print messages to the console under certain conditions, so a log of console output will be interesting.