From owner-freebsd-hackers@freebsd.org Thu Oct 20 20:58:42 2016 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6A319C1BD7F for ; Thu, 20 Oct 2016 20:58:42 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-yb0-x233.google.com (mail-yb0-x233.google.com [IPv6:2607:f8b0:4002:c09::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2F8C3C90 for ; Thu, 20 Oct 2016 20:58:42 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by mail-yb0-x233.google.com with SMTP id 184so33291960yby.2 for ; Thu, 20 Oct 2016 13:58:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to; bh=Ei+xQfdWzvUXLEFpPM+x1cdQUnHLo62e4i9Q6xghoUc=; b=KTHQYKH0stqdqNlBvUqRDhrHx3SXKFIjWShk7oRD3ozr+JnQvAJPfa2X0kHW0g7UJ3 bdnGZ/JeX3BDaK4+rLakrKiTKkZNzx4u15ec4pN+LSKqK7ifFhM6DI63vcDnr2yk1DMk OnP4VIUdgvZsY5TBBJP0wMQugLrJogjgsPzVVpRG8brLGP67hiY+FGOt97ihi/PqYfbJ fH/TXleWR5GnRmyOzOs6ar7677u8+h1fMpi1qDWvr9ZddSb+wj4EWpH9tuLe9f6GeqLu 3+dxKkdK/9CjDn5xQfs6jpvKkcUhavdv9keJ4jlHlrPTNlk86qIt/qs1l4ydlco60UVh Oqpw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Ei+xQfdWzvUXLEFpPM+x1cdQUnHLo62e4i9Q6xghoUc=; b=O5kffZGTgFHWtfAMOrdLIBXwu8NX0sCVoV7ZnQknrlXsGw3aPbEjXjrJLXGc6632xE KCuA7cSo+TGEM1CcXOyW+DnIYaR0TodqHkCAFPFkDDahx/0moSjrJd7yv1DCNpg7JWYM AsSB0HwWCWHnWDUht0nr1KP2fsQCxtoQ0nF3VzfMcVmJeNES1A7dPXM569MOCdTtKC6R s7wJxXAKXFUckkayXjVFpx+BKabAl+XjiWCtKPhlRavLCDR0LX34RGEy6fCQYCPVfUaT qqpsZ8VjWX9XInjJJ4xEAXuTx9gJZEEVFybByQDDrVb4JKd7/6hTQMLlLu69qO+5jKD2 ttaw== X-Gm-Message-State: AA6/9RlATNRdPGZZS00p+qZW1lUbjuTDRS2X5Nv4UPP+EPcoPzWupOE3d86I8QLnJDKEjjWUzQZ3ipeSXK3QyQ== X-Received: by 10.37.5.19 with SMTP id 19mr4354748ybf.22.1476997121195; Thu, 20 Oct 2016 13:58:41 -0700 (PDT) MIME-Version: 1.0 Received: by 10.37.161.37 with HTTP; Thu, 20 Oct 2016 13:58:40 -0700 (PDT) From: Zaphod Beeblebrox Date: Thu, 20 Oct 2016 16:58:40 -0400 Message-ID: Subject: livelock without explaination. To: FreeBSD Hackers Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Oct 2016 20:58:42 -0000 I have a FreeBSD 10.3 server that houses a 16 disk ZFS array, runs samba, and runs a large torrent client (a few hundred torrents, but probably less than 50 of them active). Every so often it goes into a livelock. The pipe from the location is 50/10 ... and the torrents are limited to 15/5. Inside the building, GigE access through SMB or NFS isn't uncommon, but not terribly constant. Watching movies happens over SMB, but I hardly think that's a stretch. ... but every 3 to 5 days, I get livelock. Even the console locks, although ... often... after some minutes, I can get a CTRL-ALT-DEL to register and get it shut down properly. It's also true that stopping rtorrent will unfreeze the livelock, but it will return quickly if restarted. I've tried reducing the number of active torrents. I've also looked at the netstat -m 430/15965/16395 mbufs in use (current/cache/total) 21/2065/2086/2034610 mbuf clusters in use (current/cache/total/max) 21/2003 mbuf+clusters out of packet secondary zone in use (current/cache) 128/249/377/1017304 4k (page size) jumbo clusters in use (current/cache/total/max) 256/2775/3031/301423 9k jumbo clusters in use (current/cache/total/max) 0/0/0/169550 16k jumbo clusters in use (current/cache/total/max) 2965K/34092K/37057K bytes allocated to network (current/cache/total) 0/0/0 requests for mbufs denied (mbufs/clusters/mbuf+clusters) 0/0/0 requests for mbufs delayed (mbufs/clusters/mbuf+clusters) 0/0/0 requests for jumbo clusters delayed (4k/9k/16k) 0/0/0 requests for jumbo clusters denied (4k/9k/16k) 0 requests for sfbufs denied 0 requests for sfbufs delayed 0 requests for I/O initiated by sendfile ... now I'd like to increase mbufs there ... but: [1:5:305]root@vr:~> sysctl -a | grep nmb kern.ipc.nmbufs: 13021500 kern.ipc.nmbjumbo16: 678200 kern.ipc.nmbjumbo9: 904269 kern.ipc.nmbjumbop: 1017304 kern.ipc.nmbclusters: 2034610 ... so... odd... and why would this all effect typing on the keyboard ... unless there's some interaction between the disk controllers and this lot? The root is UFS on a SATA gmirrored with a PATA drive (legacy). This that really bad (tm)?