From owner-freebsd-stable@freebsd.org Fri Dec 27 17:10:24 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 730B21C8FBA for ; Fri, 27 Dec 2019 17:10:24 +0000 (UTC) (envelope-from thenomad@gmail.com) Received: from mail-pg1-x530.google.com (mail-pg1-x530.google.com [IPv6:2607:f8b0:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 47ktcb4fKnz4K31 for ; Fri, 27 Dec 2019 17:10:23 +0000 (UTC) (envelope-from thenomad@gmail.com) Received: by mail-pg1-x530.google.com with SMTP id b9so14692781pgk.12 for ; Fri, 27 Dec 2019 09:10:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:to:from:subject:message-id:date:user-agent:mime-version :content-language:content-transfer-encoding; bh=ikvwgyng90sFsRGAg+Ag0zph20EhEcxYqop9LDEcHfo=; b=GRvUi5tfZq5dlsCggNh8kaHXX5aKTzbA475UyqkoDCHTw/foPLBqp1s3KQHms5XvTS 2/9S/7iEAY6EE3twBTq/RmniIqHZB9y+1/Sd75Bn9Pv3Rm51LofTy89X7GPk8Bh3HEfl u3jwhOdGfJDcL/qV6iHnaczy7unuemlrzSwL3E0WBQnOGYE5gT0twdJYhumN3OaZorlZ 6uMreWKHXZvPpaUj48aIFPcpLYnmWdDljn7IyvUeIKY2EBYUg8txhWxQ5QZCCQQZju/d WWQG7G4sNWHE0Ky2DLTalnh2QC+d/tS6eaj88Bk8ZrjqCVmBEa+n/wfmROM3nRaiosvE b82Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:to:from:subject:message-id:date :user-agent:mime-version:content-language:content-transfer-encoding; bh=ikvwgyng90sFsRGAg+Ag0zph20EhEcxYqop9LDEcHfo=; b=ovJtT19/fQFkxyNWzR/2dta7VQyrYfK3grc8mTu6jbuoC1tFCyZ84Fp4/vSQq/LL5V ECU+rT3wRfb/NPg7VfnfGuz0ghJz4ctoVxJzjz1gpEuHqsLb/ovRiwYzSowVXC99AN0g gQxr+nO/aZ2yhOFeWZh3g6e2Q607YrkXZULv0tGPXLh5kdkVAk6qVQe01s3BnjFlqYvr 98EFOuABS0yDnfgqfN4+9i90cZe9O4pPsfej3awMeELjqx1TQhaAap1FAI8uEUTeq4/z lGV/r5jcuh/G7nFOC8uTk59SZ/ATTELfU9zrUzfDj9Za8W93DsFx+RdKIPQjNA1ai/2q 3vmw== X-Gm-Message-State: APjAAAUZJ/KTHtH2kXoAYpp93VRGRzEviFtBZjuScwWbqfrB1iCy2Dzj NglRnqixsdhMrCrr8dWM+HgsBaoe X-Google-Smtp-Source: APXvYqxFZW09B2IfdlBIs/n0Wym4PsXYcIpiTccT8JzMA0v8QP3IU2Lw7QqveGLb65OoVCdowoIpxg== X-Received: by 2002:a63:7705:: with SMTP id s5mr54472783pgc.379.1577466621336; Fri, 27 Dec 2019 09:10:21 -0800 (PST) Received: from vanyel.ee.washington.edu (vanyel.ee.washington.edu. [128.208.232.99]) by smtp.gmail.com with ESMTPSA id q6sm41573815pfh.127.2019.12.27.09.10.20 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 27 Dec 2019 09:10:20 -0800 (PST) Sender: Lee Damon To: freebsd-stable@freebsd.org From: Lee Damon Subject: ldapsearch stops working after ~4-12 hours (one host of 4) Message-ID: <23f18d16-7f86-8e94-8cd5-9bed61ea3405@castle.org> Date: Fri, 27 Dec 2019 09:10:20 -0800 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.3.1 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 47ktcb4fKnz4K31 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=GRvUi5tf; dmarc=none; spf=pass (mx1.freebsd.org: domain of thenomad@gmail.com designates 2607:f8b0:4864:20::530 as permitted sender) smtp.mailfrom=thenomad@gmail.com X-Spamd-Result: default: False [-4.84 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[castle.org]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_IN_DNSWL_NONE(0.00)[0.3.5.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; IP_SCORE(-2.64)[ip: (-9.10), ipnet: 2607:f8b0::/32(-2.16), asn: 15169(-1.88), country: US(-0.05)]; FORGED_SENDER(0.30)[nomad@castle.org,thenomad@gmail.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[nomad@castle.org,thenomad@gmail.com]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Dec 2019 17:10:24 -0000 I have four hosts all running 11.3-RELEASE-p5 on the same subnet. Yesterday I did the usual "freebsd-update fetch && freebsd-update install" on all four. They came back up fine but about 4 hours later one of them started reporting problems with ldap search. I poked at it a bit but it was struggling to do anything so I had to reboot it. It came back up clean but the problem resurfaced early this morning. from /var/log/messages: Dec 27 03:30:00 [redacted] root: 3:30AM up 11:16, 1 user, load averages: 0.04, 0.07, 0.08 Dec 27 03:35:00 [redacted] root: 3:35AM up 11:21, 1 user, load averages: 0.21, 0.23, 0.15 Dec 27 03:35:10 [redacted] chgrp: nss_ldap: could not search LDAP server - Server is unavailable Dec 27 03:35:12 [redacted] top: nss_ldap: could not search LDAP server - Server is unavailable Dec 27 03:35:35 [redacted] nrpe[76163]: nss_ldap: could not search LDAP server - Server is unavailable Both times I observed this: : ldapsearch -v -LLL -x -h [redacted].ee.washington.edu -b dc=ee,dc=washington,dc=edu uid=[redacted] ldap_initialize( ldap://[redacted].ee.washington.edu ) ldap_sasl_bind(SIMPLE): Can't contact LDAP server (-1) The other hosts on the same subnet have no such problems. I re-ran fetch & update but it said there was nothing to do. Any hints where I should start poking this? thanks, nomad