From nobody Mon Jun 5 09:02:35 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QZSL25l56z4Yxtv for ; Mon, 5 Jun 2023 09:02:34 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QZSL11g4Mz45xW for ; Mon, 5 Jun 2023 09:02:33 +0000 (UTC) (envelope-from ml@netfence.it) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netfence.it header.s=202304 header.b=T0HCEeMQ; spf=pass (mx1.freebsd.org: domain of ml@netfence.it designates 78.134.96.152 as permitted sender) smtp.mailfrom=ml@netfence.it; dmarc=pass (policy=none) header.from=netfence.it Received: from [192.168.144.18] (46-44-233-122.ip.welcomeitalia.it [46.44.233.122] (may be forged)) (authenticated bits=0) by soth.netfence.it (8.17.1/8.17.1) with ESMTPSA id 35592LjA089330 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Mon, 5 Jun 2023 11:02:22 +0200 (CEST) (envelope-from ml@netfence.it) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netfence.it; s=202304; t=1685955744; bh=xxSWFQ38Y+GZe/CtS7Xxl5XqmFJrPFbU3NExozjUEj4=; h=Date:Subject:To:References:Cc:From:In-Reply-To; b=T0HCEeMQ2orRY+iAg3pTurrsSMNAZbICyfaJtJ3DqtGKH5YX9oOtXPXfQS3eDwoH6 7nl3riUXKb8dVEy/a826QSF4mutWsQvQQ2TiIUa6HyvkEAit2UysCI5QSdzhilUF5A xbrByIYTuyH+O9irt1wVzkjBs60kDrp1+R61r4bk= X-Authentication-Warning: soth.netfence.it: Host 46-44-233-122.ip.welcomeitalia.it [46.44.233.122] (may be forged) claimed to be [192.168.144.18] Message-ID: <28e13090-c943-1bad-6200-cf322bd74c50@netfence.it> Date: Mon, 5 Jun 2023 11:02:35 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Subject: Re: Periodic lag spike on FreeBSD 13.2-RELEASE (intel graphics / wayland) Content-Language: en-US To: Jonathan Vasquez References: Cc: "stable@freebsd.org" From: Andrea Venturoli In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.86 X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.988]; DMARC_POLICY_ALLOW(-0.50)[netfence.it,none]; R_DKIM_ALLOW(-0.20)[netfence.it:s=202304]; R_SPF_ALLOW(-0.20)[+ip4:78.134.96.152]; MIME_GOOD(-0.10)[text/plain]; BLOCKLISTDE_FAIL(0.00)[78.134.96.152:server fail,46.44.233.122:server fail]; MLMMJ_DEST(0.00)[stable@freebsd.org]; TO_DN_EQ_ADDR_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DKIM_TRACE(0.00)[netfence.it:+]; FROM_HAS_DN(0.00)[]; HAS_XAW(0.00)[]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4QZSL11g4Mz45xW X-Spamd-Bar: --- X-ThisMailContainsUnwantedMimeParts: N On 5/29/23 17:23, Jonathan Vasquez wrote: > Hello all, Hello. > I'm not sure if anyone is experiencing this, but on my framework laptop > running this graphic card... > I get periodic lag spikes. The lag spikes last about 2-3 seconds, almost Me too, on a Starlite laptop. vgapci0@pci0:0:2:0: class=0x030vgapci0@pci0:0:2:0: class=0x030000 rev=0x06 hdr=0x00 vendor=0x8086 device=0x3184 subvendor=0x0000 subdevice=0x0000 vendor = 'Intel Corporation' device = 'GeminiLake [UHD Graphics 605]' class = display subclass = VGA > I do notice these > messages in my dmesg and I think they may be related: > > drmn0: [drm] *ERROR* Atomic update failure on pipe D (start=20288 > end=20289) time 0 us, min 1073, max 1079, scanline start 1050, end 1081 I've got similar messages: drmn0: [drm] *ERROR* Atomic update failure on pipe A (start=293599 end=293600) time 0 us, min 1073, max 1079, scanline start 1070, end 1081 drmn0: [drm] *ERROR* Atomic update failure on pipe A (start=352658 end=352659) time 0 us, min 1073, max 1079, scanline start 1057, end 1058 drmn0: [drm] *ERROR* Atomic update failure on pipe A (start=401363 end=401364) time 1625 us, min 1073, max 1079, scanline start 1040, end 1147 drmn0: [drm] *ERROR* Atomic update failure on pipe A (start=875524 end=875525) time 1566 us, min 1073, max 1079, scanline start 997, end 997 So far I've been unable to correlate them with those lags. (Waiting for them to happen with an open windows with tail running, but, of course, it won't happen today :) > jon@leslie:~ $ pkg info drm-510-kmod > drm-510-kmod-5.10.163_7 > Name           : drm-510-kmod Same here. Further details differ, as I compile it myself. > I can't remember at the moment if it also happened with X11, but it may > have. I'not 100% sure, but I believe this started when I upgraded from 13.1 to 13.2 (with no other relevant change). > Please let me know if there is anything else I can provide to narrow > down the root cause. Thank you! No idea, really. If you want me to try something, collect other data, etc... I'll gladly comply. Perhaps a bug report should be opened? bye & Thanks av. From nobody Mon Jun 5 10:02:57 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QZTgz2hHFz4ZPr9 for ; Mon, 5 Jun 2023 10:03:11 +0000 (UTC) (envelope-from jon@xyinn.org) Received: from mail-4022.proton.ch (mail-4022.proton.ch [185.70.40.22]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QZTgy58MVz4LH5 for ; Mon, 5 Jun 2023 10:03:09 +0000 (UTC) (envelope-from jon@xyinn.org) Authentication-Results: mx1.freebsd.org; none Date: Mon, 05 Jun 2023 10:02:57 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xyinn.org; s=protonmail; t=1685959386; x=1686218586; bh=a+viKH79RBvJ6GGIBAjtP6FXdmPIa5qnwpc9yWViP9g=; h=Date:To:From:Cc:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=HBqHQ6NIPF+/69UFhSLvMzfAtUJ2WEQu93JkVwpPgvHRAhKrsgpCxGTGOGikITr3m tVeyEUtPHo8NYeSH1DquANyP2165hCeh5jiNXoCNLJlCOA3aJ793a7lheE+VO+6EpQ w9F+MbGsDrKsrwr6ib10DzPX82oX7d2jc3nwShEPYEcTKKqLidqSw3TVsJJvmkIU54 1vuUAhJle6OJg1H4xgaKG0YThk/b8XF8bJzbbRN1jotIr6eNWgHxJNvWey0BA/O+HC RsQguNNeAsuzD54e+2TAJY8hSxMyRTXWX4KqN0oPOQVqjLB5cghweutONR1M+TNcRK 7Pu6J6zpJphpw== To: ml@netfence.it From: Jonathan Vasquez Cc: stable@freebsd.org Subject: Re: Periodic lag spike on FreeBSD 13.2-RELEASE (intel graphics / wayland) Message-ID: In-Reply-To: <28e13090-c943-1bad-6200-cf322bd74c50@netfence.it> References: <28e13090-c943-1bad-6200-cf322bd74c50@netfence.it> Feedback-ID: 12351801:user:proton List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="b1_Ybpja4sTQoGjdOunjJQJg0l61K8kL72P14RgcXt33Uw" X-Rspamd-Queue-Id: 4QZTgy58MVz4LH5 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --b1_Ybpja4sTQoGjdOunjJQJg0l61K8kL72P14RgcXt33Uw Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 U21hbGwgdXBkYXRlLiBJJ3ZlIGJlZW4gdGVzdGluZyBYRkNFIDQuMTggd2l0aCBYb3JnIGFuZCBJ J3ZlIGJlZW4gbm90aWNpbmcgbm8gc3Bpa2VzIGhhdmUgaGFwcGVuZWQgKHRoZSBzYW1lIG1lc3Nh Z2VzIGRvIGNvbnRpbnVlIHRvIGFwcGVhciBpbiBkbWVzZywgYnV0IG5vIGxhZykuIFNvIGl0IHNl ZW1zIHRoaXMgb25seSBoYXBwZW5zIG9uIFdheWxhbmQuCgpKb25hdGhhbiBWYXNxdWV6ClBHUDog MzREQSA4NThDIDE0NDcgNTA5RSBDNzdBIEQ0OUYgRkI4NSA5MEI3IEM0Q0EgNTI3OQpTZW50IHdp dGggUHJvdG9uTWFpbCBTZWN1cmUgRW1haWwKClNlbnQgZnJvbSBQcm90b24gTWFpbCBtb2JpbGUK Ci0tLS0tLS0tIE9yaWdpbmFsIE1lc3NhZ2UgLS0tLS0tLS0KT24gSnVuIDUsIDIwMjMsIDA1OjAy LCBBbmRyZWEgVmVudHVyb2xpIHdyb3RlOgoKPiBPbiA1LzI5LzIzIDE3OjIzLCBKb25hdGhhbiBW YXNxdWV6IHdyb3RlOiA+IEhlbGxvIGFsbCwgSGVsbG8uID4gSSdtIG5vdCBzdXJlIGlmIGFueW9u ZSBpcyBleHBlcmllbmNpbmcgdGhpcywgYnV0IG9uIG15IGZyYW1ld29yayBsYXB0b3AgPiBydW5u aW5nIHRoaXMgZ3JhcGhpYyBjYXJkLi4uID4gSSBnZXQgcGVyaW9kaWMgbGFnIHNwaWtlcy4gVGhl IGxhZyBzcGlrZXMgbGFzdCBhYm91dCAyLTMgc2Vjb25kcywgYWxtb3N0IE1lIHRvbywgb24gYSBT dGFybGl0ZSBsYXB0b3AuIHZnYXBjaTBAcGNpMDowOjI6MDogY2xhc3M9MHgwMzB2Z2FwY2kwQHBj aTA6MDoyOjA6IGNsYXNzPTB4MDMwMDAwIHJldj0weDA2IGhkcj0weDAwIHZlbmRvcj0weDgwODYg ZGV2aWNlPTB4MzE4NCBzdWJ2ZW5kb3I9MHgwMDAwIHN1YmRldmljZT0weDAwMDAgdmVuZG9yID0g J0ludGVsIENvcnBvcmF0aW9uJyBkZXZpY2UgPSAnR2VtaW5pTGFrZSBbVUhEIEdyYXBoaWNzIDYw NV0nIGNsYXNzID0gZGlzcGxheSBzdWJjbGFzcyA9IFZHQSA+IEkgZG8gbm90aWNlIHRoZXNlID4g bWVzc2FnZXMgaW4gbXkgZG1lc2cgYW5kIEkgdGhpbmsgdGhleSBtYXkgYmUgcmVsYXRlZDogPiA+ IGRybW4wOiBbZHJtXSAqRVJST1IqIEF0b21pYyB1cGRhdGUgZmFpbHVyZSBvbiBwaXBlIEQgKHN0 YXJ0PTIwMjg4ID4gZW5kPTIwMjg5KSB0aW1lIDAgdXMsIG1pbiAxMDczLCBtYXggMTA3OSwgc2Nh bmxpbmUgc3RhcnQgMTA1MCwgZW5kIDEwODEgSSd2ZSBnb3Qgc2ltaWxhciBtZXNzYWdlczogZHJt bjA6IFtkcm1dICpFUlJPUiogQXRvbWljIHVwZGF0ZSBmYWlsdXJlIG9uIHBpcGUgQSAoc3RhcnQ9 MjkzNTk5IGVuZD0yOTM2MDApIHRpbWUgMCB1cywgbWluIDEwNzMsIG1heCAxMDc5LCBzY2FubGlu ZSBzdGFydCAxMDcwLCBlbmQgMTA4MSBkcm1uMDogW2RybV0gKkVSUk9SKiBBdG9taWMgdXBkYXRl IGZhaWx1cmUgb24gcGlwZSBBIChzdGFydD0zNTI2NTggZW5kPTM1MjY1OSkgdGltZSAwIHVzLCBt aW4gMTA3MywgbWF4IDEwNzksIHNjYW5saW5lIHN0YXJ0IDEwNTcsIGVuZCAxMDU4IGRybW4wOiBb ZHJtXSAqRVJST1IqIEF0b21pYyB1cGRhdGUgZmFpbHVyZSBvbiBwaXBlIEEgKHN0YXJ0PTQwMTM2 MyBlbmQ9NDAxMzY0KSB0aW1lIDE2MjUgdXMsIG1pbiAxMDczLCBtYXggMTA3OSwgc2NhbmxpbmUg c3RhcnQgMTA0MCwgZW5kIDExNDcgZHJtbjA6IFtkcm1dICpFUlJPUiogQXRvbWljIHVwZGF0ZSBm YWlsdXJlIG9uIHBpcGUgQSAoc3RhcnQ9ODc1NTI0IGVuZD04NzU1MjUpIHRpbWUgMTU2NiB1cywg bWluIDEwNzMsIG1heCAxMDc5LCBzY2FubGluZSBzdGFydCA5OTcsIGVuZCA5OTcgU28gZmFyIEkn dmUgYmVlbiB1bmFibGUgdG8gY29ycmVsYXRlIHRoZW0gd2l0aCB0aG9zZSBsYWdzLiAoV2FpdGlu ZyBmb3IgdGhlbSB0byBoYXBwZW4gd2l0aCBhbiBvcGVuIHdpbmRvd3Mgd2l0aCB0YWlsIHJ1bm5p bmcsIGJ1dCwgb2YgY291cnNlLCBpdCB3b24ndCBoYXBwZW4gdG9kYXkgOikgPiBqb25AbGVzbGll On4gJCBwa2cgaW5mbyBkcm0tNTEwLWttb2QgPiBkcm0tNTEwLWttb2QtNS4xMC4xNjNfNyA+IE5h bWUgOiBkcm0tNTEwLWttb2QgU2FtZSBoZXJlLiBGdXJ0aGVyIGRldGFpbHMgZGlmZmVyLCBhcyBJ IGNvbXBpbGUgaXQgbXlzZWxmLiA+IEkgY2FuJ3QgcmVtZW1iZXIgYXQgdGhlIG1vbWVudCBpZiBp dCBhbHNvIGhhcHBlbmVkIHdpdGggWDExLCBidXQgaXQgbWF5ID4gaGF2ZS4gSSdub3QgMTAwJSBz dXJlLCBidXQgSSBiZWxpZXZlIHRoaXMgc3RhcnRlZCB3aGVuIEkgdXBncmFkZWQgZnJvbSAxMy4x IHRvIDEzLjIgKHdpdGggbm8gb3RoZXIgcmVsZXZhbnQgY2hhbmdlKS4gPiBQbGVhc2UgbGV0IG1l IGtub3cgaWYgdGhlcmUgaXMgYW55dGhpbmcgZWxzZSBJIGNhbiBwcm92aWRlIHRvIG5hcnJvdyA+ IGRvd24gdGhlIHJvb3QgY2F1c2UuIFRoYW5rIHlvdSEgTm8gaWRlYSwgcmVhbGx5LiBJZiB5b3Ug d2FudCBtZSB0byB0cnkgc29tZXRoaW5nLCBjb2xsZWN0IG90aGVyIGRhdGEsIGV0Yy4uLiBJJ2xs IGdsYWRseSBjb21wbHkuIFBlcmhhcHMgYSBidWcgcmVwb3J0IHNob3VsZCBiZSBvcGVuZWQ/IGJ5 ZSAmIFRoYW5rcyBhdi4= --b1_Ybpja4sTQoGjdOunjJQJg0l61K8kL72P14RgcXt33Uw Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 U21hbGwgdXBkYXRlLiBJJ3ZlIGJlZW4gdGVzdGluZyBYRkNFIDQuMTggd2l0aCBYb3JnIGFuZCBJ J3ZlIGJlZW4gbm90aWNpbmcgbm8gc3Bpa2VzIGhhdmUgaGFwcGVuZWQgKHRoZSBzYW1lIG1lc3Nh Z2VzIGRvIGNvbnRpbnVlIHRvIGFwcGVhciBpbiBkbWVzZywgYnV0IG5vIGxhZykuIFNvIGl0IHNl ZW1zIHRoaXMgb25seSBoYXBwZW5zIG9uIFdheWxhbmQuPGJyPjxicj48YnI+PGRpdj5Kb25hdGhh biBWYXNxdWV6PGJyIC8+PC9kaXY+PGRpdj5QR1A6IDM0REEgODU4QyAxNDQ3IDUwOUUgQzc3QSAg RDQ5RiBGQjg1IDkwQjcgQzRDQSA1Mjc5PGJyIC8+PC9kaXY+PGRpdj5TZW50IHdpdGggUHJvdG9u TWFpbCBTZWN1cmUgRW1haWw8YnIgLz48L2Rpdj48ZGl2PjxiciAvPjwvZGl2Pjxicj48YnI+U2Vu dCBmcm9tIFByb3RvbiBNYWlsIG1vYmlsZTxicj48YnI+PGJyPjxicj4tLS0tLS0tLSBPcmlnaW5h bCBNZXNzYWdlIC0tLS0tLS0tPGJyPk9uIEp1biA1LCAyMDIzLCAwNTowMiwgQW5kcmVhIFZlbnR1 cm9saSA8IG1sQG5ldGZlbmNlLml0PiB3cm90ZTo8YmxvY2txdW90ZSBjbGFzcz0icHJvdG9ubWFp bF9xdW90ZSI+PGJyPk9uIDUvMjkvMjMgMTc6MjMsIEpvbmF0aGFuIFZhc3F1ZXogd3JvdGU6DQo+ IEhlbGxvIGFsbCwNCg0KSGVsbG8uDQoNCg0KDQo+IEknbSBub3Qgc3VyZSBpZiBhbnlvbmUgaXMg ZXhwZXJpZW5jaW5nIHRoaXMsIGJ1dCBvbiBteSBmcmFtZXdvcmsgbGFwdG9wDQo+IHJ1bm5pbmcg dGhpcyBncmFwaGljIGNhcmQuLi4NCj4gSSBnZXQgcGVyaW9kaWMgbGFnIHNwaWtlcy4gVGhlIGxh ZyBzcGlrZXMgbGFzdCBhYm91dCAyLTMgc2Vjb25kcywgYWxtb3N0DQoNCk1lIHRvbywgb24gYSBT dGFybGl0ZSBsYXB0b3AuDQp2Z2FwY2kwQHBjaTA6MDoyOjA6ICAgICBjbGFzcz0weDAzMHZnYXBj aTBAcGNpMDowOjI6MDoNCmNsYXNzPTB4MDMwMDAwIHJldj0weDA2IGhkcj0weDAwIHZlbmRvcj0w eDgwODYgZGV2aWNlPTB4MzE4NA0Kc3VidmVuZG9yPTB4MDAwMCBzdWJkZXZpY2U9MHgwMDAwDQog ICAgIHZlbmRvciAgICAgPSAnSW50ZWwgQ29ycG9yYXRpb24nDQogICAgIGRldmljZSAgICAgPSAn R2VtaW5pTGFrZSBbVUhEIEdyYXBoaWNzIDYwNV0nDQogICAgIGNsYXNzICAgICAgPSBkaXNwbGF5 DQogICAgIHN1YmNsYXNzICAgPSBWR0ENCg0KDQoNCj4gSSBkbyBub3RpY2UgdGhlc2UNCj4gbWVz c2FnZXMgaW4gbXkgZG1lc2cgYW5kIEkgdGhpbmsgdGhleSBtYXkgYmUgcmVsYXRlZDoNCj4NCj4g ZHJtbjA6IFtkcm1dICpFUlJPUiogQXRvbWljIHVwZGF0ZSBmYWlsdXJlIG9uIHBpcGUgRCAoc3Rh cnQ9MjAyODgNCj4gZW5kPTIwMjg5KSB0aW1lIDAgdXMsIG1pbiAxMDczLCBtYXggMTA3OSwgc2Nh bmxpbmUgc3RhcnQgMTA1MCwgZW5kIDEwODENCg0KSSd2ZSBnb3Qgc2ltaWxhciBtZXNzYWdlczoN Cg0KZHJtbjA6IFtkcm1dICpFUlJPUiogQXRvbWljIHVwZGF0ZSBmYWlsdXJlIG9uIHBpcGUgQSAo c3RhcnQ9MjkzNTk5DQplbmQ9MjkzNjAwKSB0aW1lIDAgdXMsIG1pbiAxMDczLCBtYXggMTA3OSwg c2NhbmxpbmUgc3RhcnQgMTA3MCwgZW5kIDEwODENCmRybW4wOiBbZHJtXSAqRVJST1IqIEF0b21p YyB1cGRhdGUgZmFpbHVyZSBvbiBwaXBlIEEgKHN0YXJ0PTM1MjY1OA0KZW5kPTM1MjY1OSkgdGlt ZSAwIHVzLCBtaW4gMTA3MywgbWF4IDEwNzksIHNjYW5saW5lIHN0YXJ0IDEwNTcsIGVuZCAxMDU4 DQpkcm1uMDogW2RybV0gKkVSUk9SKiBBdG9taWMgdXBkYXRlIGZhaWx1cmUgb24gcGlwZSBBIChz dGFydD00MDEzNjMNCmVuZD00MDEzNjQpIHRpbWUgMTYyNSB1cywgbWluIDEwNzMsIG1heCAxMDc5 LCBzY2FubGluZSBzdGFydCAxMDQwLCBlbmQgMTE0Nw0KZHJtbjA6IFtkcm1dICpFUlJPUiogQXRv bWljIHVwZGF0ZSBmYWlsdXJlIG9uIHBpcGUgQSAoc3RhcnQ9ODc1NTI0DQplbmQ9ODc1NTI1KSB0 aW1lIDE1NjYgdXMsIG1pbiAxMDczLCBtYXggMTA3OSwgc2NhbmxpbmUgc3RhcnQgOTk3LCBlbmQg OTk3DQoNClNvIGZhciBJJ3ZlIGJlZW4gdW5hYmxlIHRvIGNvcnJlbGF0ZSB0aGVtIHdpdGggdGhv c2UgbGFncy4NCihXYWl0aW5nIGZvciB0aGVtIHRvIGhhcHBlbiB3aXRoIGFuIG9wZW4gd2luZG93 cyB3aXRoIHRhaWwgcnVubmluZywgYnV0LA0Kb2YgY291cnNlLCBpdCB3b24ndCBoYXBwZW4gdG9k YXkgOikNCg0KDQoNCj4gam9uQGxlc2xpZTp+ICQgcGtnIGluZm8gZHJtLTUxMC1rbW9kDQo+IGRy bS01MTAta21vZC01LjEwLjE2M183DQo+IE5hbWUgwqAgwqAgwqAgwqAgwqAgOiBkcm0tNTEwLWtt b2QNCg0KU2FtZSBoZXJlLg0KRnVydGhlciBkZXRhaWxzIGRpZmZlciwgYXMgSSBjb21waWxlIGl0 IG15c2VsZi4NCg0KDQoNCj4gSSBjYW4ndCByZW1lbWJlciBhdCB0aGUgbW9tZW50IGlmIGl0IGFs c28gaGFwcGVuZWQgd2l0aCBYMTEsIGJ1dCBpdCBtYXkNCj4gaGF2ZS4NCg0KSSdub3QgMTAwJSBz dXJlLCBidXQgSSBiZWxpZXZlIHRoaXMgc3RhcnRlZCB3aGVuIEkgdXBncmFkZWQgZnJvbSAxMy4x IHRvDQoxMy4yICh3aXRoIG5vIG90aGVyIHJlbGV2YW50IGNoYW5nZSkuDQoNCg0KDQo+IFBsZWFz ZSBsZXQgbWUga25vdyBpZiB0aGVyZSBpcyBhbnl0aGluZyBlbHNlIEkgY2FuIHByb3ZpZGUgdG8g bmFycm93DQo+IGRvd24gdGhlIHJvb3QgY2F1c2UuIFRoYW5rIHlvdSENCg0KTm8gaWRlYSwgcmVh bGx5Lg0KSWYgeW91IHdhbnQgbWUgdG8gdHJ5IHNvbWV0aGluZywgY29sbGVjdCBvdGhlciBkYXRh LCBldGMuLi4gSSdsbCBnbGFkbHkNCmNvbXBseS4NClBlcmhhcHMgYSBidWcgcmVwb3J0IHNob3Vs ZCBiZSBvcGVuZWQ/DQoNCiAgYnllICYgVGhhbmtzDQoJYXYuDQo8L2Rpdj4= --b1_Ybpja4sTQoGjdOunjJQJg0l61K8kL72P14RgcXt33Uw-- From nobody Mon Jun 5 10:17:22 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QZV0C04mKz4ZSH7 for ; Mon, 5 Jun 2023 10:17:15 +0000 (UTC) (envelope-from ml@netfence.it) Received: from soth.netfence.it (mailserver.netfence.it [78.134.96.152]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mailserver.netfence.it", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4QZV0B50GVz4NMp for ; Mon, 5 Jun 2023 10:17:14 +0000 (UTC) (envelope-from ml@netfence.it) Authentication-Results: mx1.freebsd.org; none Received: from [192.168.144.18] (46-44-233-122.ip.welcomeitalia.it [46.44.233.122] (may be forged)) (authenticated bits=0) by soth.netfence.it (8.17.1/8.17.1) with ESMTPSA id 355AH9fa098243 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Mon, 5 Jun 2023 12:17:09 +0200 (CEST) (envelope-from ml@netfence.it) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netfence.it; s=202304; t=1685960231; bh=OMbxkriokSDMClkK4XmneHvDoEl2fwJr0YFbF2zl9Go=; h=Date:Subject:To:Cc:References:From:In-Reply-To; b=pDgR4QDo/946QUkgDeBoKDdLIorKPYGfH+hPHPlIwl2UYXAas+9hFHVhb/TH/mnuQ oiAienu2qlJoziOgGTsCQoR/7Faf+0vjedLX21ZFX5Z1zWIkm8+Z+Qtk7fS5WPH6mv AO312eRcLy6OJeYwuzayKwNBZGAW2VZcdtNS4hFA= X-Authentication-Warning: soth.netfence.it: Host 46-44-233-122.ip.welcomeitalia.it [46.44.233.122] (may be forged) claimed to be [192.168.144.18] Message-ID: Date: Mon, 5 Jun 2023 12:17:22 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Subject: Re: Periodic lag spike on FreeBSD 13.2-RELEASE (intel graphics / wayland) Content-Language: en-US To: Jonathan Vasquez Cc: stable@freebsd.org References: <28e13090-c943-1bad-6200-cf322bd74c50@netfence.it> From: Andrea Venturoli In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.86 X-Rspamd-Queue-Id: 4QZV0B50GVz4NMp X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:35612, ipnet:78.134.0.0/17, country:IT] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 6/5/23 12:02, Jonathan Vasquez wrote: > Small update. I've been testing XFCE 4.18 with Xorg and I've been > noticing no spikes have happened (the same messages do continue to > appear in dmesg, but no lag). So it seems this only happens on Wayland. Oh! I didn't get it! I'm using X11, not Wayland. OTOH, I'm not sure this is graphics related. I'll still try and see if the lags happen at the same time that message appears. bye av. From nobody Tue Jun 6 13:24:00 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QbB5t4N77z4bZd3; Tue, 6 Jun 2023 13:24:34 +0000 (UTC) (envelope-from karl@denninger.net) Received: from colo1.denninger.net (colo1.denninger.net [104.236.120.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QbB5s3yd7z3jBs; Tue, 6 Jun 2023 13:24:33 +0000 (UTC) (envelope-from karl@denninger.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of karl@denninger.net designates 104.236.120.189 as permitted sender) smtp.mailfrom=karl@denninger.net; dmarc=pass (policy=none) header.from=denninger.net Received: from denninger.net (096-033-195-197.res.spectrum.com [96.33.195.197]) by colo1.denninger.net (Postfix) with ESMTP id E457C2110CF; Tue, 6 Jun 2023 09:24:02 -0400 (EDT) Received: from [192.168.10.25] (D15.Denninger.Net [192.168.10.25]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by denninger.net (Postfix) with ESMTPSA id 786A029A7EE; Tue, 6 Jun 2023 09:24:02 -0400 (EDT) Message-ID: <220afa61-4508-5dbd-c870-e405aa23c895@denninger.net> Date: Tue, 6 Jun 2023 09:24:00 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.11.2 Content-Language: en-US To: freebsd-stable@freebsd.org, freebsd-scsi@freebsd.org From: Karl Denninger Subject: Camcontrol question related to Seagate disks Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-512; boundary="------------ms070302080207000105050102" X-Spamd-Result: default: False [-5.14 / 15.00]; SIGNED_SMIME(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-0.995]; NEURAL_HAM_SHORT(-0.94)[-0.943]; DMARC_POLICY_ALLOW(-0.50)[denninger.net,none]; NEURAL_HAM_MEDIUM(-0.30)[-0.298]; R_SPF_ALLOW(-0.20)[+mx:c]; MIME_GOOD(-0.20)[multipart/signed,multipart/alternative,text/plain]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-scsi@freebsd.org,freebsd-stable@freebsd.org]; ASN(0.00)[asn:14061, ipnet:104.236.64.0/18, country:US]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:~]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_THREE(0.00)[3]; RCVD_TLS_LAST(0.00)[]; FREEFALL_USER(0.00)[karl]; RCVD_VIA_SMTP_AUTH(0.00)[]; BLOCKLISTDE_FAIL(0.00)[96.33.195.197:server fail,104.236.120.189:server fail]; FROM_HAS_DN(0.00)[]; HAS_ATTACHMENT(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4QbB5s3yd7z3jBs X-Spamd-Bar: ----- X-ThisMailContainsUnwantedMimeParts: N This is a cryptographically signed message in MIME format. --------------ms070302080207000105050102 Content-Type: multipart/alternative; boundary="------------ycqhvkIXdHyAkOGLBahE0ovV" --------------ycqhvkIXdHyAkOGLBahE0ovV Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Certain "newer" Seagate drives have an EPC profile that doesn't interact as expected with the camcontrol "standard" way to tell spinning disks to go into an idle state. Specifically those that support this: https://www.seagate.com/files/docs/pdf/en-GB/whitepaper/tp608-powerchoice-tech-provides-gb.pdf The usual has been "camcontrol idle da{x} -t 600" has typically resulted in a 10 minute timeout, after which it goes into low power (sometimes you want "standby" rather than "idle" depending on the recovery time and power mode you're after and the specifics of the drive in question.) On these Seagate drives, however, you get this back after the time expires: root@NewFS:/home/karl # camcontrol epc da0 -c status APM: NOT Supported, NOT Enabled EPC: Supported, Enabled Low Power Standby NOT Supported Set EPC Power Source NOT Supported Current power state: PM0:Active or PM1:Idle(0xff) In other words it did NOT go into low-power mode even though it says it is supported, on said timer AND the "600 second" setting "took": root@NewFS:/home/karl # camcontrol epc da0 -c list ATA Power Conditions Log:   Idle power conditions page:     Idle A condition:       Flags: Supported, Saveable, Changeable, Default Timer Enabled,              Saved Timer Enabled, Current Timer Enabled       Default timer setting: 0.0 sec       Saved timer setting: 0.0 sec       Current timer setting: 0.0 sec       Nominal time to active: 0.0 sec       Minimum timer: 0.0 sec       Maximum timer: 1.0 sec       Number of transitions to power condition: 0       Hours in power condition: 0     Idle B condition:       Flags: Supported, Saveable, Changeable, Default Timer Enabled,              Saved Timer Enabled, Current Timer Enabled       Default timer setting: 120.0 sec       Saved timer setting: 120.0 sec       Current timer setting: 120.0 sec       Nominal time to active: 0.0 sec       Minimum timer: 0.0 sec       Maximum timer: 4294967.0 sec       Number of transitions to power condition: 0       Hours in power condition: 0     Idle C condition:       Flags: Supported, Saveable, Changeable       Default timer setting: 600.0 sec       Saved timer setting: 600.0 sec       Current timer setting: 0.0 sec       Nominal time to active: 6.0 sec       Minimum timer: 0.0 sec       Maximum timer: 4294967.0 sec       Number of transitions to power condition: 0       Hours in power condition: 0   Standby power conditions page:     Standby Y condition:       Flags: None       Default timer setting: 0.0 sec       Saved timer setting: 0.0 sec       Current timer setting: 0.0 sec       Nominal time to active: 0.0 sec       Minimum timer: 0.0 sec       Maximum timer: 0.0 sec       Number of transitions to power condition: 0       Hours in power condition: 0     Standby Z condition:       Flags: Supported, Saveable, Changeable, Current Timer Enabled       Default timer setting: 900.0 sec       Saved timer setting: 900.0 sec       Current timer setting: 600.0 sec       Nominal time to active: 22.0 sec       Minimum timer: 0.0 sec       Maximum timer: 4294967.0 sec       Number of transitions to power condition: 0       Hours in power condition: 0 The reason is that /it appears //these drives, on power-up, do not enable the timers /until and unless you send a SSU "START" with the correct power conditioning bits. Specifically, the power conditioning value of "7h" has to be specified.  If its not then the EPC timers are present but, it appears, they are not used. Does anyone know the proper camcontrol command to do this?  The "start" command sent when the system spins up does not appear to do so.  If I send an "idle" or "standby" to the drive with a timeout it takes effect immediately but any access to it spins it up (as expected) and it does not re-enter the lower-power mode on the timer, implying that the SSU command did not enable the timers, and thus they remain inactive even though they ARE set and camcontrol does report them. This would appear to be fixable with a line in /etc/rc.local aimed at said drives that sends a "start" with the correct bits set but camcontrol's man page is rather ambiguous on exactly how to do that. Thanks in advance! -- Karl Denninger karl@denninger.net /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ycqhvkIXdHyAkOGLBahE0ovV Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

Certain "newer" Seagate drives have an EPC profile that doesn't interact as expected with the camcontrol "standard" way to tell spinning disks to go into an idle state.

Specifically those that support this: https://www.seagate.com/files/docs/pdf/en-GB/whitepaper/tp608-powerchoice-tech-provides-gb.pdf

The usual has been "camcontrol idle da{x} -t 600" has typically resulted in a 10 minute timeout, after which it goes into low power (sometimes you want "standby" rather than "idle" depending on the recovery time and power mode you're after and the specifics of the drive in question.)

On these Seagate drives, however, you get this back after the time expires:

root@NewFS:/home/karl # camcontrol epc da0 -c status
APM: NOT Supported, NOT Enabled
EPC: Supported, Enabled
Low Power Standby NOT Supported
Set EPC Power Source NOT Supported
Current power state: PM0:Active or PM1:Idle(0xff)

In other words it did NOT go into low-power mode even though it says it is supported, on said timer AND the "600 second" setting "took":

root@NewFS:/home/karl # camcontrol epc da0 -c list
ATA Power Conditions Log:
  Idle power conditions page:
    Idle A condition:
      Flags: Supported, Saveable, Changeable, Default Timer Enabled,
             Saved Timer Enabled, Current Timer Enabled
      Default timer setting: 0.0 sec
      Saved timer setting: 0.0 sec
      Current timer setting: 0.0 sec
      Nominal time to active: 0.0 sec
      Minimum timer: 0.0 sec
      Maximum timer: 1.0 sec
      Number of transitions to power condition: 0
      Hours in power condition: 0
    Idle B condition:
      Flags: Supported, Saveable, Changeable, Default Timer Enabled,
             Saved Timer Enabled, Current Timer Enabled
      Default timer setting: 120.0 sec
      Saved timer setting: 120.0 sec
      Current timer setting: 120.0 sec
      Nominal time to active: 0.0 sec
      Minimum timer: 0.0 sec
      Maximum timer: 4294967.0 sec
      Number of transitions to power condition: 0
      Hours in power condition: 0
    Idle C condition:
      Flags: Supported, Saveable, Changeable
      Default timer setting: 600.0 sec
      Saved timer setting: 600.0 sec
      Current timer setting: 0.0 sec
      Nominal time to active: 6.0 sec
      Minimum timer: 0.0 sec
      Maximum timer: 4294967.0 sec
      Number of transitions to power condition: 0
      Hours in power condition: 0
  Standby power conditions page:
    Standby Y condition:
      Flags: None
      Default timer setting: 0.0 sec
      Saved timer setting: 0.0 sec
      Current timer setting: 0.0 sec
      Nominal time to active: 0.0 sec
      Minimum timer: 0.0 sec
      Maximum timer: 0.0 sec
      Number of transitions to power condition: 0
      Hours in power condition: 0
    Standby Z condition:
      Flags: Supported, Saveable, Changeable, Current Timer Enabled
      Default timer setting: 900.0 sec
      Saved timer setting: 900.0 sec
      Current timer setting: 600.0 sec
      Nominal time to active: 22.0 sec
      Minimum timer: 0.0 sec
      Maximum timer: 4294967.0 sec
      Number of transitions to power condition: 0
      Hours in power condition: 0

The reason is that it appears these drives, on power-up, do not enable the timers until and unless you send a SSU "START" with the correct power conditioning bits.  Specifically, the power conditioning value of "7h" has to be specified.  If its not then the EPC timers are present but, it appears, they are not used.

Does anyone know the proper camcontrol command to do this?  The "start" command sent when the system spins up does not appear to do so.  If I send an "idle" or "standby" to the drive with a timeout it takes effect immediately but any access to it spins it up (as expected) and it does not re-enter the lower-power mode on the timer, implying that the SSU command did not enable the timers, and thus they remain inactive even though they ARE set and camcontrol does report them.

This would appear to be fixable with a line in /etc/rc.local aimed at said drives that sends a "start" with the correct bits set but camcontrol's man page is rather ambiguous on exactly how to do that.

Thanks in advance!

--
Karl Denninger
karl@denninger.net
The Market Ticker
[S/MIME encrypted email preferred]
--------------ycqhvkIXdHyAkOGLBahE0ovV-- --------------ms070302080207000105050102 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DbowggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBxIwggT6oAMCAQICEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQsFADB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlk YTEZMBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENB MSUwIwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBMB4XDTIyMDYyOTE2MTYz NloXDTI3MDYyODE2MTYzNlowOjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEX MBUGA1UEAwwOS2FybCBEZW5uaW5nZXIwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoIC AQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvW ZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B 3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTgy+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYI XgVVPgfZZrbJJb5HWOQpvvhILpPCD3xsYJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMi WapsatKm8mxuOOGOEBhAoTVTwUHlMNTg6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMb NQm1mWREQhw3axgGLSntjjnznJr5vsvXSYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZM qa20JLAF1YagutDiMRURU23iWS7bA9tMcXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5 CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1l y+5ZOZbxBAZZMod4y4b4FiRUhRI97r9lCxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY 2BlA7ExM8XShMd9bRPZrNTokPQPUCWCgCdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEE MDAuMCwGCCsGAQUFBzABhiBodHRwOi8vb2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNV HRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIFoDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYI KwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCGSAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBD bGllbnQgQ2VydGlmaWNhdGUwHQYDVR0OBBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNV HSMEgcIwgb+AFF3AXsKnjdPND5+bxVECGKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQ MA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5 c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lz dGVtcyBMTEMgMjAxNyBDQYITAORIioIQzl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJs QGRlbm5pbmdlci5uZXQwDQYJKoZIhvcNAQELBQADggIBAKquc7cu0xc8FNtAQauZvocDzWQj 7HG9YvMbWnMi+ckhiA3rdW5NwWg0HBhBho1YlnqV+ntCVE2L8ezohHWm+KAdfXgpraL86Vsn 3ywNlZu/3COMpo2ALuHln8YQtH3Y8ebvzKMdlf2b5WB+7mOFIxXIr4AnNOLKCkq5ZhzC6JW6 Jvw3P0csiGa3UrfatYID5NvPgkaQvEgimEjG3psZqwQTL2Wxohvw783PrDt3wS0XeNhvQ61g 3QJFZKuv+bmGH3YBSPo1t6NUGAr+JozX5lDihB8JGkBt/NwdYec49a08uL0BbPaAJ7NjuIPG 7Y0Ak7PXZT37yx/Zla9PzLMJFgbelOkaatdzbblMZPDEVZ27l4lGMmV83Lm3YP17sdAyS/Wp mav7WmJUkQ9iuIKzSpdc82i9Mfujl1vbBtwtkHNPPtKuulIFM4ZwrPKjlVdLqTSqD8m9yHEi Y0PuAooq63OpJWF6hvMaiIPBWEAVIaDW9uG0MshLl9DnHnMyrJTfuC33Z9mOGMz7dRBjJd5Y W02xAzYnUuEBOpj+LQv5R8XIFMHFXktqEKvQrXeM2RU+PcZqKOBkTktxBLn3NI5VfA15Jk0c 5V5XcOqo3p2hvrwvXrinrb2pEREnoqmfrkXT3zOq5Y6ryRH8u734lGEF0dILXzoV4PM7XFit oTePoEjmMYIFBDCCBQACAQEwgZEwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGEx GTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTEl MCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQQISAsbzIfg9AV1t33FSCanO XWNfMA0GCWCGSAFlAwQCAwUAoIICQzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqG SIb3DQEJBTEPFw0yMzA2MDYxMzI0MDFaME8GCSqGSIb3DQEJBDFCBEBzUxhOpPSNJl7bOdnj CNgjH9j8tQ0SQBa2n6nYbpTRAniHi5bIKRdpIH6gfYLuuEp6OwzlCcsACo1uo6am3I3DMGwG CSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAO BggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw gaIGCSsGAQQBgjcQBDGBlDCBkTB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTEZ MBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENBMSUw IwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBAhICxvMh+D0BXW3fcVIJqc5d Y18wgaQGCyqGSIb3DQEJEAILMYGUoIGRMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9y aWRhMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMg Q0ExJTAjBgNVBAMMHEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0ECEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQEFAASCAgAatzg1K57o1/5rrNXwkmO4WEazVyQK57n6d8od opqv5+xEGtGAPBSDq/n4I+WApe6wnaTWcFsJQyqez2VFjrosIsDwX9BWEm5UWGt17lsPE2iI PQhrEulNOo794KBF/+hHBu1Szug74T0faRiOwHVUMTJBu8V8FvdEbOAqc4839g+5gQWvn7vt BQWWrqUxr0d/ZH7tEpcaeOgl6rqeWlt6PfnoGz9bu/KRKZTanB/2iWjEqTKW67xfiXPwryUK u42xIP0y/UeTjZF5qJT30W97ZU2RBPaUIvATwkepbJ58HPwmb+Xv3naan2iyh9kxDdj86L11 1FRaBm4NCpbAhD4avgWe/na6yvQchUtGkAoKXNBsRPwXwWEnX8/6464qyZZMYQy20Ag3YR/p NX0i3ci8dlx5jq/fxHiOoFYHwKUtj4e84tPIQKImsatnM+mq+Eb0PrON3M5iyr5ioYt1NWnH e03jKdMouKXYbrtMktDdQRyvNBjw1lRaPmpwdRvztcGFQ66gGLHSmI8dTshTNoWX9tu/PHEs XqW9GzVHjEKdEqUx3ioWy9mrMBf/6Z55FiA9Nqh77FxMIDhopaf/Dpfp8M2+eI5BSA/ZrbDK 0dC5ykyyV9Kpq7Mo682mVs87bo1QW7POocIqZHT/PPajT/Ca9qPNNaXvBwvkeOfq6Mz+XwAA AAAAAA== --------------ms070302080207000105050102--