From nobody Mon Jul 15 11:23:35 2024 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4WN0Kt3Rwzz5QjwL for ; Mon, 15 Jul 2024 11:27:30 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.org (uucp.dinoex.org [IPv6:2a0b:f840::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4WN0Ks1WZzz48PD for ; Mon, 15 Jul 2024 11:27:29 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of pmc@citylink.dinoex.sub.org designates 2a0b:f840::12 as permitted sender) smtp.mailfrom=pmc@citylink.dinoex.sub.org; arc=pass ("uucp.dinoex.org:s=M20221114:i=1") Received: from uucp.dinoex.org (uucp.dinoex.org [IPv6:2a0b:f840:0:0:0:0:0:12]) by uucp.dinoex.org (8.18.1/8.18.1) with ESMTPS id 46FBRAXj038636 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 15 Jul 2024 13:27:10 +0200 (CEST) (envelope-from pmc@citylink.dinoex.sub.org) ARC-Seal: i=1; a=rsa-sha256; d=uucp.dinoex.org; s=M20221114; t=1721042833; cv=none; b=Ioq7jpj0foPYbW9En4/+s5F9Wp63JV+Sgi+ufPdWB/nS6fwpYTJRz5cfWwkge3LKKck/JjxgFB7vFUGy0XEd0TAyCPOMAJRVGh6y5YM4bG1tjGK4itgU7J0/mRk+w+5NI99rYg5FOpvTFuyOPM7+fJKEoupKTsK2Ob4erYJkHiM= ARC-Message-Signature: i=1; a=rsa-sha256; d=uucp.dinoex.org; s=M20221114; t=1721042833; c=relaxed/simple; bh=sT7m4EC8er0jDpckzuG0pKPpgygc50yfSU9OFLIgcwc=; h=Received:Received:Received:Received:X-Authentication-Warning:Date: From:To:Subject:Message-ID:MIME-Version:Content-Type: Content-Disposition:X-Milter:X-Greylist; b=mFFxequRQ5IMwxYg6Lf8n9QnqoqnYz6H2Po2Ea3u3xhUuPefqqsrM6REs7+lv4SgGZB4EcelWg8F1ZDaxjsJme1GvQyq1S8VUgnWT+q7K8HQMAdQoSaswXPONbCJsfKmqSz0T5o53cHcTJ0cbPn1KtZK3Glw02FlqQT//eWLwZA= ARC-Authentication-Results: i=1; uucp.dinoex.org X-MDaemon-Deliver-To: Received: (from uucp@localhost) by uucp.dinoex.org (8.18.1/8.18.1/Submit) with UUCP id 46FBRAQF038635 for freebsd-fs@freebsd.org; Mon, 15 Jul 2024 13:27:10 +0200 (CEST) (envelope-from pmc@citylink.dinoex.sub.org) Received: from disp.intra.daemon.contact (disp-e.intra.daemon.contact [IPv6:fd00:0:0:0:0:0:0:112]) by admn.intra.daemon.contact (8.18.1/8.18.1) with ESMTPS id 46FBPub3097442 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=OK) for ; Mon, 15 Jul 2024 13:25:56 +0200 (CEST) (envelope-from pmc@citylink.dinoex.sub.org) Received: from disp.intra.daemon.contact (localhost [127.0.0.1]) by disp.intra.daemon.contact (8.18.1/8.18.1) with ESMTPS id 46FBNZTo062055 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 15 Jul 2024 13:23:35 +0200 (CEST) (envelope-from pmc@citylink.dinoex.sub.org) Received: (from pmc@localhost) by disp.intra.daemon.contact (8.18.1/8.18.1/Submit) id 46FBNZ9K062054 for freebsd-fs@freebsd.org; Mon, 15 Jul 2024 13:23:35 +0200 (CEST) (envelope-from pmc@citylink.dinoex.sub.org) X-Authentication-Warning: disp.intra.daemon.contact: pmc set sender to pmc@citylink.dinoex.sub.org using -f Date: Mon, 15 Jul 2024 13:23:35 +0200 From: Peter To: freebsd-fs@freebsd.org Subject: Can ZFS ARC be run with roundrobin policy? Message-ID: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline X-Milter: Spamilter (Reciever: uucp.dinoex.org; Sender-ip: 0:0:2a0b:f840::; Sender-helo: uucp.dinoex.org;) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (uucp.dinoex.org [IPv6:2a0b:f840:0:0:0:0:0:12]); Mon, 15 Jul 2024 13:27:13 +0200 (CEST) X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.82 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; ARC_ALLOW(-1.00)[uucp.dinoex.org:s=M20221114:i=1]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.52)[-0.525]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:205376, ipnet:2a0b:f840::/32, country:DE]; MISSING_XM_UA(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_NA(0.00)[sub.org]; HAS_XAW(0.00)[]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_FIVE(0.00)[5]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_DN_NONE(0.00)[]; MIME_TRACE(0.00)[0:+] X-Rspamd-Queue-Id: 4WN0Ks1WZzz48PD Hi, from what I perceive, the ZFS ARC allocates in firsttouch policy, like so: # cpuset -gp $$ pid 56305 mask: 6, 7, 8, 9 pid 56305 domain policy: prefer mask: 2 # cpuset -gd 0 domain 0 mask: 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 $ sysctl vm.domain | grep free_c vm.domain.3.stats.free_count: 2994244 vm.domain.2.stats.free_count: 3030568 vm.domain.1.stats.free_count: 2913977 vm.domain.0.stats.free_count: 5368353 << # find /media/sysimg -type f | xargs cat > /dev/null $ sysctl vm.domain | grep free_c vm.domain.3.stats.free_count: 2994297 vm.domain.2.stats.free_count: 3030217 vm.domain.1.stats.free_count: 2937179 vm.domain.0.stats.free_count: 884588 << This is not always to my liking. I would prefer roundrobin allocations here. But, I didn't easily find a switch, and, reading into the UMA allocator, it states that it can do roundrobin, but it is not so easily figured how that be made happen in practice. Pointers on where I might look into, are welcome. regards, PMc