From nobody Thu Jan 26 19:24:18 2023 X-Original-To: freebsd-questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4P2rHg3YSCz3bTd6 for ; Thu, 26 Jan 2023 19:24:31 +0000 (UTC) (envelope-from doug@safeport.com) Received: from fledge.watson.org (fledge.watson.org [147.160.157.40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "A1-48603", Issuer "A1-48603" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4P2rHg18xqz4GVn for ; Thu, 26 Jan 2023 19:24:31 +0000 (UTC) (envelope-from doug@safeport.com) Authentication-Results: mx1.freebsd.org; none Received: from fledge.watson.org (doug@localhost [127.0.0.1]) by fledge.watson.org (8.16.1/8.16.1) with ESMTPS id 30QJOJVn087452 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Thu, 26 Jan 2023 19:24:19 GMT (envelope-from doug@safeport.com) Received: from localhost (doug@localhost) by fledge.watson.org (8.16.1/8.16.1/Submit) with ESMTP id 30QJOI0r087447; Thu, 26 Jan 2023 19:24:19 GMT (envelope-from doug@safeport.com) X-Authentication-Warning: fledge.watson.org: doug owned process doing -bs Date: Thu, 26 Jan 2023 19:24:18 +0000 (UTC) From: doug@safeport.com Reply-To: doug@fledge.watson.org To: Korolev Sergey cc: Ioan Samarul , freebsd-questions@freebsd.org Subject: Re: rsync freezes FreeBSD machine In-Reply-To: <6F206B4F-4E61-4773-8122-C356E599F619@febras.net> Message-ID: References: <6F206B4F-4E61-4773-8122-C356E599F619@febras.net> List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Rspamd-Queue-Id: 4P2rHg18xqz4GVn X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_RCPT(0.00)[]; ASN(0.00)[asn:6405, ipnet:147.160.157.0/24, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Thu, 26 Jan 2023, Korolev Sergey wrote: > Hello, > my experience (not big, to be honest) says, that the possible reason of that type of freeze > (when nothing helps except hard reboot) is when processes hangs in ?zio? state. Some deadlock > arises when trying to access to a very busy FS. So, maybe monitoring with zfs-mon can help, > with simultaneous ?top? monitoring in separate console. > > On 26 Jan 2023, at 20:39, Ioan Samarul wrote: > > Hello to you all! > > I am doing a backup for some machines (OpenBSD and Linux) to a FreeBSD > machine (13.1-RELEASE-p5) with ZFS using rsync (usually with `-avhz`). > The problem I always encounter is that if I do an rsync to FreeBSD > everything is smooth, but the other way around, after some files > copied, the FreeBSD machine hangs. I tried even using > `--bwlimit=5000`, but it is the same. I can't ssh, nothing. Just hard > restart. > > I tried looking in the logs but I didn't get any useful information. > > Any hint? > If zfs is involved at all, no help from me. I use rsync over ssh to backup about 700GB. The souce system is in a jail. Both systems are FreeBSD. The command: rsync -vvain --numeric-ids -e ssh host1.com:/src-dir/ /home/user/host1_backup/target-dir/ The above is on one line. A couple of things. "n" is your friend. "vv" generates a line-by-line log of what was done with each file. I started with a base that was generated on a different system. I was never able to get rsync to recognize unchanged files. Eventually I gave up and started from scratch. Using "vvain:" on the direction that does not work might provide some information about the error. As no data is acutally transfered in this case, if that hangs the log may point to the issue.