From nobody Wed May 8 16:45:33 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4VZLcN3q7Tz5JVK6 for ; Wed, 08 May 2024 16:45:40 +0000 (UTC) (envelope-from bojan.novkovic@kset.org) Received: from mail-ej1-f45.google.com (mail-ej1-f45.google.com [209.85.218.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4VZLcM41wDz4tF4 for ; Wed, 8 May 2024 16:45:39 +0000 (UTC) (envelope-from bojan.novkovic@kset.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of bojan.novkovic@kset.org designates 209.85.218.45 as permitted sender) smtp.mailfrom=bojan.novkovic@kset.org Received: by mail-ej1-f45.google.com with SMTP id a640c23a62f3a-a59cdf7cd78so958463666b.0 for ; Wed, 08 May 2024 09:45:39 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1715186737; x=1715791537; h=content-transfer-encoding:in-reply-to:autocrypt:from:cc :content-language:references:to:subject:user-agent:mime-version:date :message-id:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=HZ14SRWTwctkGkBR5mrsLxdNA2KS57Eo4NnfqMbEkIs=; b=pOH9K83kEvO2cJuVYuZt4aa3uirY5Qqkx/VGW+xhZdOEE9mVc/nEccw0DVCPRRfnTw gLZzRV/cDCt3Ch6j7nE+3knExX6IyTpfojWn4J4AywQcfILotssWY1TSddpk2vMVe+Ro 5wf0+JFcgys0UEZnmsFrj/LpPGEIbaZy/whNIgoB7qpwjU/x29y3h489BRDxrNbUX07c nWQUBToGk0y+ZkBBOZJcBubg2Ky9XVIbIdM9LJP29FT/yv2LhJysf69qW32I0dsfrodp 7cCsxcblLkRUAHJIdsx5At58WrnkkkGMtzp2720pZpYu31HpIE0xxSnYj/cSxAyTj+oy AJ+Q== X-Gm-Message-State: AOJu0YwuNFmu0QBK3una+0h/6DUdRcswAn8oO3jx6zKAfJlbO1KtTfdA rjtA1aLAsbPiCsybOuqtDoWINhFa7bifjblXXomByFOIfR3uj9U5XIT42N6FtEU= X-Google-Smtp-Source: AGHT+IGhlz2jrNFE6K5aK2HdmfywCL3eua49kerO0ccBJgiohrSVeVzZH+8UG9H8d5EnIMnHRO2K0w== X-Received: by 2002:a17:906:b34b:b0:a59:c52b:9939 with SMTP id a640c23a62f3a-a59fb95a2dfmr163317066b.32.1715186736785; Wed, 08 May 2024 09:45:36 -0700 (PDT) Received: from [192.168.0.91] ([46.234.79.3]) by smtp.gmail.com with ESMTPSA id l1-20020a1709061c4100b00a599d994f88sm6268388ejg.117.2024.05.08.09.45.36 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 08 May 2024 09:45:36 -0700 (PDT) Message-ID: <5c7357c3-5a10-4a8e-9245-8a5787c57f35@freebsd.org> Date: Wed, 8 May 2024 18:45:33 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Graph of the FreeBSD memory fragmentation To: Alexander Leidinger References: <0a3ddc685e54a289ff5cff569a95cd29@Leidinger.net> Content-Language: en-US Cc: Current , alc@FreeBSD.org From: =?UTF-8?Q?Bojan_Novkovi=C4=87?= Autocrypt: addr=bnovkov@freebsd.org; keydata= xjMEZdIQsxYJKwYBBAHaRw8BAQdA/V2uVmdN7VY2Ps8wDgLlWU3b9+kPdg9bf+FHgEEX49TN JUJvamFuIE5vdmtvdmnEhyA8Ym5vdmtvdkBGcmVlQlNELm9yZz7CmQQTFgoAQRYhBLAb6L2d hfD6hKflVB43npi7IZ8rBQJl0hCzAhsDBQkFo5qABQsJCAcCAiICBhUKCQgLAgQWAgMBAh4H AheAAAoJEB43npi7IZ8rzb0A/0aY3c/XubbtQzNyA0xzyKNZlDc9zesxEMVi6rOAZNz/AQC2 QmBTBEcbyOKDfJ5m02LpudVi9thZxlrr2n0ZX9kgA844BGXSELMSCisGAQQBl1UBBQEBB0Dn 3m+8g7KTp3yC4CLICis/CIonFfNqQcJOVv6Gd73adQMBCAfCfgQYFgoAJhYhBLAb6L2dhfD6 hKflVB43npi7IZ8rBQJl0hCzAhsMBQkFo5qAAAoJEB43npi7IZ8ruPcBAJM5wq5j64RFu4sc zrryK4FeCTt/Xhfyn3UhT2hHuYkPAQDWHDN6XZ097C5wUkWUr8ywHDlMM5gWIDbr9TMUudoc Aw== In-Reply-To: <0a3ddc685e54a289ff5cff569a95cd29@Leidinger.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FORGED_SENDER(0.30)[bnovkov@freebsd.org,bojan.novkovic@kset.org]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[209.85.218.45:from]; XM_UA_NO_VERSION(0.01)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.218.45:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[bnovkov@freebsd.org,bojan.novkovic@kset.org]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3] X-Rspamd-Queue-Id: 4VZLcM41wDz4tF4 Hi, On 5/7/24 14:02, Alexander Leidinger wrote: > Hi, > > I created some graphs of the memory fragmentation. > https://www.leidinger.net/blog/2024/05/07/plotting-the-freebsd-memory-fragmentation/ > > My goal was not comparing a specific change on a given benchmark, but > to "have something which visualizes memory fragmentation". As part of > that, Bojans commit > https://cgit.freebsd.org/src/commit/?id=7a79d066976149349ecb90240d02eed0c4268737 > was just in the middle of my data collection. I have the impression > that it made a positive difference in my non deterministic workload. Thank you for working on this, the plots look great! They provide a really clean visual overview of what's happening. I'm working on another type of memory visualization which might interest you, I'll share it with you once its done. One small nit - the fragmentation index does not quantify fragmentation for UMA buckets, but for page allocator freelists. > Is there anything which prevents https://reviews.freebsd.org/D40575 to > be committed? D40575 is closely tied to the compaction patch (D40772) which is currently on hold until another issue is solved (see D45046 and related revisions for more details). I didn't consider landing D40575 because of that, but I guess it could be useful on its own. Bojan