From owner-freebsd-arm@freebsd.org Wed Aug 8 21:55:55 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 095F0106CE8E for ; Wed, 8 Aug 2018 21:55:55 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-io0-x232.google.com (mail-io0-x232.google.com [IPv6:2607:f8b0:4001:c06::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 88C3396934 for ; Wed, 8 Aug 2018 21:55:54 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: by mail-io0-x232.google.com with SMTP id o22-v6so3126783ioh.6 for ; Wed, 08 Aug 2018 14:55:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20150623.gappssmtp.com; s=20150623; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=8MCbMfbLFbhc5sCUF6YeL/6uB+jG3N0JaK3Q7pH4Dxk=; b=yWQcGfO4VR2nWSul9O2Fq2HDtnUWnQODewMf0PXFKzHXQz6tDA78jTq8FXS0Kq4TJd 8XaGuH2MdO19kGtc+0xCtGXfPWFRve1k0gAyw6b/V5SrJ995cSomBVnbCfvr5sNhxUqC SxyStE6xY1BbXJecrz7iQbVqOizY+73irHbSFfetyEBjo4nWPL7lrbPRf2M1OiZfEiN5 8d8bC1JvJNkTvxqZbvxIMGSwZWeXyhmM6O/EtqeWyYdllwqnFhg2Zq3tagPnIwbJXi+0 KggLryxtUOWN8ypbTOZCCA65rFB7pYb544dRF8Zl2f+p4KjGu3Yc0MwBL/qcRoyty6WD /FhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=8MCbMfbLFbhc5sCUF6YeL/6uB+jG3N0JaK3Q7pH4Dxk=; b=Kscpve8fuHsj7iKbg9TOiVdMaDbV7LWVJAwY1+GX93HO0/SipQgNbXm7z+bIUHEXX1 eQLusKjHU3yoZoigpnSp3Rl2a+6S0aYkAM/0yCggQic17gIDFVID+CLgUXEDNkf6A6Th vX5QJL3p6hjUVA2bWMKB0f/+4rlJ88kPTxt46jbY8qFZYI0s8WoD145F7AkY6Sho0sVk R1JrIt9KcFWx/U8sfKEu5ZHSfD5M9Aq1iKVFSqrHqI/kKe5SrJZCkqwyQ28gF+DjRJQe hIDvxiv1tiUHru57HBe7LE3WJdyYDFjQGBDs35+N2MX3NssYp1AU2MK7JpiGocYY7ARl KZhg== X-Gm-Message-State: AOUpUlGneBEOZ4zAGOpgn7ta3lKR5HG29i5tZy2jlK46VrmF7ngR22Mz JZEm/Wayw+Tndx4zbMFvU012JGjxt56FTNCnpgE9VLi3QQ7xWg== X-Google-Smtp-Source: AA+uWPzLct4ZMsA2pDEmYKEOuCY1Gan55qQOeJszSvdS9g67KDaT4OXNhJuAjMEcACQ1dalZYHJ0zTna/rRZ3fjc2vM= X-Received: by 2002:a6b:d004:: with SMTP id x4-v6mr3727724ioa.299.1533765353649; Wed, 08 Aug 2018 14:55:53 -0700 (PDT) MIME-Version: 1.0 Sender: wlosh@bsdimp.com Received: by 2002:a4f:381a:0:0:0:0:0 with HTTP; Wed, 8 Aug 2018 14:55:52 -0700 (PDT) X-Originating-IP: [2603:300b:6:5100:1052:acc7:f9de:2b6d] In-Reply-To: <20180808214224.GA29312@www.zefox.net> References: <23793AAA-A339-4DEC-981F-21C7CC4FE440@yahoo.com> <20180731231912.GF94742@www.zefox.net> <2222ABBD-E689-4C3B-A7D3-50AECCC5E7B2@yahoo.com> <20180801034511.GA96616@www.zefox.net> <201808010405.w7145RS6086730@donotpassgo.dyslexicfish.net> <6BFE7B77-A0E2-4FAF-9C68-81951D2F6627@yahoo.com> <20180802002841.GB99523@www.zefox.net> <20180802015135.GC99523@www.zefox.net> <20180806155837.GA6277@raichu> <20180808214224.GA29312@www.zefox.net> From: Warner Losh Date: Wed, 8 Aug 2018 15:55:52 -0600 X-Google-Sender-Auth: _NRvnjzhbDGzYq45LlN6nVPqSco Message-ID: Subject: Re: RPI3 swap experiments ["was killed: out of swap space" with: "v_free_count: 5439, v_inactive_count: 1"] To: bob prohaska Cc: Mark Johnston , "freebsd-arm@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Aug 2018 21:55:55 -0000 On Wed, Aug 8, 2018 at 3:42 PM, bob prohaska wrote: > On Mon, Aug 06, 2018 at 11:58:37AM -0400, Mark Johnston wrote: > > > > If the above suggestion doesn't help, the next thing to try would be to > > revert the oom_seq value to the default, apply this patch, and see if > > the problem continues to occur. If this doesn't help, please try > > applying both measures, i.e., set oom_seq to 120 _and_ apply the patch. > > > > Applying both measures resulted in a panic, not entirely unlike the effect > of deliberately running the machine out of swap on microSD. The first > obvious > sign of trouble was errors attributed to da0: > > (da0:umass-sim0:0:0:0): WRITE(10). CDB: 2a 00 00 25 bc b8 00 00 80 00 > (da0:umass-sim0:0:0:0): CAM status: CCB request completed with an error > (da0:umass-sim0:0:0:0): Retrying command, 3 more tries remain > So we're pushing so hard that the writes are actively failing... With the da driver there's some hope. Add options IOSCHED to the kernel config file and reboot. This will give you some detailed statistics, as well as power-of-two bucketized latency histograms. It may even be a vector forward to slow the writes / trims down, though there's some issues when you slow writes down TOO much, it helps *A*LOT* keep the system responsive. We do that at work to make our consumer SSDs not suck for serving content (reading) while we're doing some writes to them... The thumb drives are like the consumer SSDs we buy, only crappier... Warner