From owner-freebsd-questions@freebsd.org Wed Jun 6 13:17:59 2018 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 19B31FF5B05 for ; Wed, 6 Jun 2018 13:17:59 +0000 (UTC) (envelope-from jkeenan@pobox.com) Received: from pb-smtp2.pobox.com (pb-smtp2.pobox.com [64.147.108.71]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A627873B3E for ; Wed, 6 Jun 2018 13:17:58 +0000 (UTC) (envelope-from jkeenan@pobox.com) Received: from pb-smtp2.pobox.com (unknown [127.0.0.1]) by pb-smtp2.pobox.com (Postfix) with ESMTP id 8BB33E07CC; Wed, 6 Jun 2018 09:17:57 -0400 (EDT) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=subject:to :references:from:message-id:date:mime-version:in-reply-to :content-type:content-transfer-encoding; s=sasl; bh=RCiKHz2RMmDM tqOvT+V6c1/82AY=; b=Ax4W4jTXbhpw8/cV3ICvnX+WpT18fATXOpNE6AvskeZD ORndlRnr6T9wfb05tXnzyJkseTashR2jRcYBEtg/FNmgbE0skxO437jiYdxr1RWs Lvop9YdKt/xYE1TU+F8dxHek01/HOY3B6lot5F6AVOquIHGbTil+1Hs1zVYkIzo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=pobox.com; h=subject:to :references:from:message-id:date:mime-version:in-reply-to :content-type:content-transfer-encoding; q=dns; s=sasl; b=HsNaOn OxwT1RthGF1b308RmfH6jVMwfp+Y1gtlFt5eC1NChc2K3LKBgemIKR9mUR4n6t0t cdyE+HrufGCqWcEr3k6JyXRx5Wgzy+jENeE7djqMPE6zCrxtQGtqvn4D7c6k8kZV Ya4WUybkzhmi/hUgawM+q4HVB+szuSmphWoOk= Received: from pb-smtp2.nyi.icgroup.com (unknown [127.0.0.1]) by pb-smtp2.pobox.com (Postfix) with ESMTP id 84496E07CB; Wed, 6 Jun 2018 09:17:57 -0400 (EDT) Received: from [192.168.1.5] (unknown [24.185.115.142]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by pb-smtp2.pobox.com (Postfix) with ESMTPSA id 18017E07CA; Wed, 6 Jun 2018 09:17:57 -0400 (EDT) Subject: Re: Unable to kill processes using either Ctrl-C or 'kill' To: freebsd-questions@freebsd.org References: <9a7f62c4-80aa-7eea-91ec-6712612a0451@pobox.com> From: James E Keenan Message-ID: Date: Wed, 6 Jun 2018 09:17:55 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Pobox-Relay-ID: 072C227A-698C-11E8-B198-67830C78B957-57062903!pb-smtp2.pobox.com X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jun 2018 13:17:59 -0000 On 06/03/2018 03:03 PM, Michael Schuster wrote: > On Sun, Jun 3, 2018 at 8:47 PM, Duane Whitty wrote: > >> On Sun, Jun 3, 2018 at 1:20 PM, James E Keenan wrote: >> >>> On a FreeBSD-11 host, I am unable to kill processes using either Ctrl-C >> or >>> 'kill'. >>> >>> 1. The problem first became manifest when I was attempting to use Vagrant >>> to download a Vagrant box from vagrantup.com. The box in question was >> a >>> VirtualBox called 'generic/freebsd11'. I have successfully downloaded, >>> installed and used this box several times already, so I anticipated no >>> problems. >>> >>> ##### >>> $ vagrant init generic/freebsd11 >>> $ vagrant up --provision | tee vagrant-up-provision.log.20180603100900 >>> Bringing machine 'default' up with 'virtualbox' provider... >>> ==> default: Checking if box 'generic/freebsd11' is up to date... >>> ==> default: Clearing any previously set forwarded ports... >>> ==> default: Fixed port collision for 22 => 2222. Now on port 2202. >>> ==> default: Clearing any previously set network interfaces... >>> ==> default: Preparing network interfaces based on configuration... >>> default: Adapter 1: nat >>> ==> default: Forwarding ports... >>> default: 22 (guest) => 2202 (host) (adapter 1) >>> ==> default: Running 'pre-boot' VM customizations... >>> ==> default: Booting VM... >>> ==> default: Waiting for machine to boot. This may take a few minutes... >>> default: SSH address: 127.0.0.1:2202 >>> default: SSH username: vagrant >>> default: SSH auth method: private key >>> ##### >>> >>> Based on recent experience, I would have expected the "few minutes" to be >>> 1 or 2 minutes at most and possibly be accompanied by "retrying" methods. >>> >>> However, at this point, the screen hung indefinitely. I tried Ctrl-C; >>> that command was printed in my terminal but otherwise nothing happened. >>> >>> 2. I ssh-ed to the host in a fresh terminal and called >>> >>> ##### >>> tail -f vagrant-up-provision.log.20180603100900 >>> ##### >>> >>> That command displayed the output posted above and hung at the same >>> point. This process also could not be killed by Ctrl-C. >>> >>> 3. I then ssh-ed to the host in a third terminal, called 'ps aux', and >>> then tried to kill suspect processes with 'kill -9 '. Those >> processes >>> were not, in fact, killed; their status was changed to 'T' -- "Marks a >>> stopped process" according to 'man ps'. Some excerpts from 'ps auxwww': >>> >>> ##### >>> vmuser 7169 0.0 0.1 81356 4444 0 T+ 14:09 0:01.99 >>> /usr/local/bin/ruby24 /usr/local/bin/vagrant up --provision >>> ... >>> jkeenan 67787 0.0 0.0 6296 0 1 WW+ - 0:00.00 >>> tail -f /home/vmuser/vagrant-images/generic-freebsd11-201806030939/ >>> vagrant-up-provision.log.20180603100900 >>> ... >>> jkeenan 74119 0.0 0.0 7064 0 2 WW+ - 0:00.00 >>> /bin/sh /usr/bin/man ps >>> ##### >>> >>> 4. I have now opened quite a few connections to the host. If I issue a >>> command there such as 'man ps' or 'less' that entails paging, I can page >>> through the output, but the process does not close by itself and does not >>> respond to Ctrl-C. If I then try to kill that process from another >>> terminal, the best that happens is that its status gets changed to 'WW+' >> -- >>> "Marks an idle interrupt thread" and "The process is swapped out". >>> >>> Internet searches turn up links like this one, >>> https://forums.freebsd.org/threads/cant-kill-process-in-the- >>> stop-state.56319/, that suggest that there are certain processes that do >>> not respond to 'kill' signals. That seems to be what's happening here. >>> >>> Can anyone suggest the cause of the problem? >>> >>> Short of requesting that the sysadmin shut down and reboot the system, is >>> there anyway for a non-root user to solve this problem? >>> >>> Thank you very much. >>> Jim Keenan >>> _______________________________________________ >>> freebsd-questions@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-questions >>> To unsubscribe, send any mail to "freebsd-questions-unsubscribe >>> @freebsd.org" >>> >> >> >> Can you get added to sudoers? I realize that still implies a level of root >> access but I really don't know of any other way to kill processes which >> don't belong to you. I don't see why the sysadmin would need to reboot. >> > > most likely, being root or equivalent won't help in this case. If a > processes owner cannot kill it (using -9, which cannot be caught) that > implies that the process is hung in the kernel (signal delivery happens > when a process leaves kernel context). > > regards > Michael > Update: While some sysadmin intervention got the hangs cleared up on Sunday night, the problem recurred Tuesday morning. Once again, the hang occurred during 'vagrant up' at the "Waiting for machine to boot" point. Once again, that session refused to accept terminal input, so I could not Ctrl-C out of it. Once again, when I logged on from another terminal, any "vagrant xxx" command would hang -- even something as simple as "vagrant global-status". And once again, any command that entailed paging or interactivity would hang, e.g., 'less' would hang when it reached EOF. This output from 'top | cat' may support the "process is hung in the kernel" hypothesis: ##### $ top | cat last pid: 23582; load averages: 0.21, 0.15, 0.10 up 39+18:08:01 13:00:49 49 processes: 1 running, 25 sleeping, 3 stopped, 4 zombie, 16 waiting Mem: 4192K Active, 852K Inact, 56K Laundry, 7858M Wired, 42M Free ARC: 859M Total, 332M MFU, 161M MRU, 32K Anon, 12M Header, 353M Other 234M Compressed, 588M Uncompressed, 2.51:1 Ratio Swap: 4096M Total, 295M Used, 3801M Free, 7% Inuse PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 21147 vmuser 22 20 0 2483M 2336M select 3 32:36 0.00% VBoxHeadless 84461 jkeenan 13 20 0 61840K 6136K select 0 27:14 0.00% VBoxSVC 95384 jkeenan 3 20 0 2380M 2245M STOP 2 26:59 0.00% VBoxHeadless 45500 jkeenan 23 20 0 438M 301M select 0 19:31 0.00% VBoxHeadless 83727 jkeenan 1 20 0 20664K 4856K select 3 8:59 0.00% VBoxXPCOMIPCD 94095 jkeenan 3 20 0 1303M 1165M STOP 1 8:41 0.00% VBoxHeadless ... ##### Note the high value for Wired memory. "Memory in use by the Kernel. This memory cannot be swapped out." (https://unix.stackexchange.com/questions/134862/what-do-the-different-memory-counters-in-freebsd-mean#137254) I have not yet heard back from the sysadmin concerning this second occurrence, so any suggestions you might have would be appreciated. Thank you very much. Jim Keenan