From nobody Thu Feb 16 23:17:24 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PHrSz1R7Fz3qVqr for <freebsd-infiniband@mlmmj.nyi.freebsd.org>; Thu, 16 Feb 2023 23:17:39 +0000 (UTC) (envelope-from freebsd@igalic.co) Received: from mail-4018.proton.ch (mail-4018.proton.ch [185.70.40.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PHrSw2T04z4MCV for <freebsd-infiniband@freebsd.org>; Thu, 16 Feb 2023 23:17:36 +0000 (UTC) (envelope-from freebsd@igalic.co) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=igalic.co header.s=protonmail header.b=I0e85zvT; spf=pass (mx1.freebsd.org: domain of freebsd@igalic.co designates 185.70.40.18 as permitted sender) smtp.mailfrom=freebsd@igalic.co; dmarc=none Date: Thu, 16 Feb 2023 23:17:24 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=igalic.co; s=protonmail; t=1676589450; x=1676848650; bh=gEFOWQTObqIxchWiXQWuOqA5K2hUJwL0lskDLqHCU4I=; h=Date:To:From:Cc:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=I0e85zvTJGN3z3i9RyAQdnx4MogvnnvHiLwOb5nyw3erJO2l0MdDzacoDS2bbnAcL ORtGxff6so3BAQbsUEQprnn+P1TAevSyAaYE1jGT9zVeU7X/dn0Ea6BMTVqsB6kIio snCDZEl8neK3DWIjT6szVQ9xu+2x723Aq27GFBMZmNNy6TNSWUh2N5SQbSFugpj7M6 MhOh95HQWmAec0wm/if5J1DB9C4JoLAV18yeWQurQKe8IqIm9QSfZXoYonl2+uJcma lYSmXnERNOLAEKUJf/42LvLYMb6JnKAxEd1dYy8ZbMwgUylfp7B9lxhhEWNHKD/S7/ 4XG+LBz7XaaZw== To: "Sobczak, Bartosz" <bartosz.sobczak@intel.com> From: =?utf-8?Q?Mina_Gali=C4=87?= <freebsd@igalic.co> Cc: "freebsd-infiniband@freebsd.org" <freebsd-infiniband@freebsd.org> Subject: RE: Soliciting infiniband ifconfig output Message-ID: <dM_a-MaZlii-lIUfrkzpk8NRcloEIgWn_5N8Iw5hIiCEPrupfTuJWdEp27w6M0laUa0KGT13YqsvQIhpLJnl_eDdRDx5k_5O51fShOuNyF4=@igalic.co> In-Reply-To: <BL1PR11MB530117C30C58342C88B9027AEFD99@BL1PR11MB5301.namprd11.prod.outlook.com> References: <LI-raHphdhJi76QPWTSxOlAorIOt7v7D6BTbRQSutxkMupkIOgofxdoJwbqEI-cj2gD0TJFA8gX4KHEywzWyR58IN10WQV5zBdGXVjBxIe4=@igalic.co> <CAKAYmMJWL1+=C1z1wi2me9QF0rA3PBhBpdZ0+FHF-M7+nKCGBg@mail.gmail.com> <BL1PR11MB5301DFCD70161CBC30320FC3EFD99@BL1PR11MB5301.namprd11.prod.outlook.com> <Yh69IMigErEnFcnCh5kEPm-6GsNYf8gso_riuP6LPLGnxY_KTRa1V3vK5oocCDvv9dtXHaEPHnzmk3E9i4IZTzkMs28zZKUktbpgnNaE7_4=@igalic.co> <BL1PR11MB530117C30C58342C88B9027AEFD99@BL1PR11MB5301.namprd11.prod.outlook.com> Feedback-ID: 66573723:user:proton List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="b1_ljd9KvCobRroyMW26tVUtrUfpJvxZg0KtRrm7EVCA" X-Spamd-Result: default: False [-2.68 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_SHORT(-1.00)[-0.997]; R_MIXED_CHARSET(0.71)[subject]; R_DKIM_ALLOW(-0.20)[igalic.co:s=protonmail]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_BASE64_TEXT(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-infiniband@freebsd.org]; RCVD_COUNT_ZERO(0.00)[0]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[igalic.co:+]; TO_DN_SOME(0.00)[]; DMARC_NA(0.00)[igalic.co]; HAS_PHPMAILER_SIG(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4PHrSw2T04z4MCV X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --b1_ljd9KvCobRroyMW26tVUtrUfpJvxZg0KtRrm7EVCA Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 SGkgZm9sa3MsCgpCYXJ0ZWsgcnVpbmVkIG15IGh5cG90aGVzaXMgdGhhdCBhbGwgdGhlIGluZm8g aSBuZWVkIGNhbiBiZSBkZWR1Y2VkIGZyb20gaWZjb25maWcgLWHigIsuClNvIEkgbmVlZCB0byBj b21lIHdpdGggb3RoZXIgd2F5cyBvZiBxdWlja2x5IGFuZCBlYXNpbHkgaWRlbnRpZnlpbmcgYWxs IGluZmluaWJhbmQgaW50ZXJmYWNlcy4KCldvdWxkIHlvdSBiZSBzbyBraW5kIGFzIHRvIHNoYXJl IHdoYXQKCmlidl9kZXZpY2Vz4oCLCgphbmQKCmlidl9kZXZpbmZvIC1s4oCLCgpsb29rcyBsaWtl IG9uIHlvdXIgc3lzdGVtcz8KCkknbSBob3Bpbmcgb25lIG9mIHRoZXNlIGlzIGVhc2llciB0byBw YXJzZSwgb3IgcHJvdmlkZXMgdXNlZnVsIGluZm9ybWF0aW9uIHRvIGZpbGwgdGhlIGdhcHMgaW4g dGhlIGZ1bmN0aW9ucyBJJ20gdHJ5aW5nIHRvIHJlaW1wbGVtZW50LgoKS2luZCByZWdhcmRzLAoK TWluYSBHYWxpxIcKClRyeSBQa2dCYXNlOiBodHRwczovL2FscGhhLnBrZ2Jhc2UubGl2ZS8KCi0t LS0tLS0gT3JpZ2luYWwgTWVzc2FnZSAtLS0tLS0tCk9uIFRodXJzZGF5LCBGZWJydWFyeSA5dGgs IDIwMjMgYXQgMTM6MTcsIFNvYmN6YWssIEJhcnRvc3ogPGJhcnRvc3ouc29iY3pha0BpbnRlbC5j b20+IHdyb3RlOgoKPiBKdXN0IHByZXNlcnZpbmcgYW5vbnltaXR5LiBVbmRlciB0aGUgR0cgdGhl cmUgaXMgYSByZWd1bGFyIFswLTlhLWZdIGhleCBudW1iZXIKPgo+IEJhcnRlawo+Cj4gRnJvbTog b3duZXItZnJlZWJzZC1pbmZpbmliYW5kQGZyZWVic2Qub3JnIDxvd25lci1mcmVlYnNkLWluZmlu aWJhbmRAZnJlZWJzZC5vcmc+IE9uIEJlaGFsZiBPZiBNaW5hIEdhbGnEhwo+IFNlbnQ6IFRodXJz ZGF5LCBGZWJydWFyeSA5LCAyMDIzIDEyOjA3Cj4gVG86IFNvYmN6YWssIEJhcnRvc3ogPGJhcnRv c3ouc29iY3pha0BpbnRlbC5jb20+Cj4gQ2M6IGZyZWVic2QtaW5maW5pYmFuZEBmcmVlYnNkLm9y Zwo+IFN1YmplY3Q6IFJlOiBTb2xpY2l0aW5nIGluZmluaWJhbmQgaWZjb25maWcgb3V0cHV0Cj4K PiBIaSBCYXJ0ZWssCj4KPiB0aGFua3MgZm9yIHRoZSBwYXN0ZSEKPgo+IHF1aWNrIHF1ZXN0aW9u OiBpcyB0aGUgR0cgc29tZXRoaW5nIHRoYXQncyBhY3R1YWxseSBwcmludGVkIGJ5IGlmY29uZmln IGZvciB0aGVzZSBkcml2ZXJzLCBvciBpcyB0aGlzIHNvbWV0aGluZyB5b3UgcmVwbGFjZWQgZm9y IHByZXNlcnZpbmcgYW5vbnltaXR5Pwo+Cj4gS2luZCByZWdhcmRzLAo+Cj4gTWluYSBHYWxpxIcK Pgo+IFRyeSBQa2dCYXNlOiBodHRwczovL2FscGhhLnBrZ2Jhc2UubGl2ZS8KPgo+IC0tLS0tLS0t IE9yaWdpbmFsIE1lc3NhZ2UgLS0tLS0tLS0KPiBPbiA5IEZlYiAyMDIzLCAwOTo0NCwgU29iY3ph aywgQmFydG9zeiA8IGJhcnRvc3ouc29iY3pha0BpbnRlbC5jb20+IHdyb3RlOgo+Cj4+IEhpISBI ZXJl4oCZcyBhbiBleGFtcGxlIG9mIG91dHB1dCB1c2luZyBJbnRlbCBFODEwIGZhbWlseSBFdGhl cm5ldCBDb250cm9sbGVyICNpZmNvbmZpZyAtYSBpY2UwOiBmbGFncz04ODQzIG1ldHJpYyAwIG10 dSAxNTAwIG9wdGlvbnM9ZTUwN2JiIGV0aGVyIGI0Ojk2OjkxOkdHOkdHOkdHIGluZXQgMTAwLjAu MC44NCBuZXRtYXNrIDB4ZmZmZmZmMDAgYnJvYWRjYXN0IDEwMC4wLjAuMjU1IGluZXQ2IDEyMzQ6 Ojg0IHByZWZpeGxlbiA2NCBpbmV0NiBmZTgwOjpiNjk2OjkxZmY6ZmVHRzpHR2Q4JWljZTAgcHJl Zml4bGVuIDY0IHNjb3BlaWQgMHg0IG1lZGlhOiBFdGhlcm5ldCBhdXRvc2VsZWN0ICgyNUdCYXNl LUNSICkgc3RhdHVzOiBhY3RpdmUgbmQ2IG9wdGlvbnM9MjEgaWNlMTogZmxhZ3M9ODgwMiBtZXRy aWMgMCBtdHUgMTUwMCBvcHRpb25zPWU1MDdiYiBldGhlciBiNDo5Njo5MTpHRzpHRzpHRyBtZWRp YTogRXRoZXJuZXQgYXV0b3NlbGVjdCBzdGF0dXM6IG5vIGNhcnJpZXIgbmQ2IG9wdGlvbnM9Mjkg aWNlMjogZmxhZ3M9ODgwMiBtZXRyaWMgMCBtdHUgMTUwMCBvcHRpb25zPWU1MDdiYiBldGhlciBi NDo5Njo5MTpHRzpHRzpHRyBtZWRpYTogRXRoZXJuZXQgYXV0b3NlbGVjdCBzdGF0dXM6IG5vIGNh cnJpZXIgbmQ2IG9wdGlvbnM9MjkgaWNlMzogZmxhZ3M9ODgwMiBtZXRyaWMgMCBtdHUgMTUwMCBv cHRpb25zPWU1MDdiYiBldGhlciBiNDo5Njo5MTpHRzpHRzpHRyBtZWRpYTogRXRoZXJuZXQgYXV0 b3NlbGVjdCBzdGF0dXM6IG5vIGNhcnJpZXIgbmQ2IG9wdGlvbnM9MjkgIyBwY2ljb25mIC1sdmEg cGNpMDoxNzc6MDowIGljZTBAcGNpMDoxNzc6MDowOiBjbGFzcz0weDAyMDAwMCBjYXJkPTB4MDAw NTgwODYgY2hpcD0weDE1OTM4MDg2IHJldj0weDAyIGhkcj0weDAwIHZlbmRvciA9ICdJbnRlbCBD b3Jwb3JhdGlvbicgZGV2aWNlID0gJ0V0aGVybmV0IENvbnRyb2xsZXIgRTgxMC1DIGZvciBTRlAn IGNsYXNzID0gbmV0d29yayBzdWJjbGFzcyA9IGV0aGVybmV0ICMgaWJ2X2RldmluZm8gLWQgaXJk bWEtaWNlMCAtdiBoY2FfaWQ6IGlyZG1hLWljZTAgdHJhbnNwb3J0OiBJbmZpbmlCYW5kICgwKSBm d192ZXI6IDEuNjkgbm9kZV9ndWlkOiBiNjk2OjkxZmY6ZmVHRzpHR0dHIHN5c19pbWFnZV9ndWlk OiBiNjk2OjkxZmY6ZmVHRzpHR0dHIHZlbmRvcl9pZDogMHg4MDg2IHZlbmRvcl9wYXJ0X2lkOiA1 NTIzIGh3X3ZlcjogMHgyIHBoeXNfcG9ydF9jbnQ6IDEgbWF4X21yX3NpemU6IDB4MjAwMDAwMDAw MDAwIHBhZ2Vfc2l6ZV9jYXA6IDB4NDAyMDEwMDAgbWF4X3FwOiAxNjM4MCBtYXhfcXBfd3I6IDQw NjMgZGV2aWNlX2NhcF9mbGFnczogMHgwMTIyOTAwMCBSQ19STlJfTkFLX0dFTiBNRU1fV0lORE9X IE1FTV9NR1RfRVhURU5TSU9OUyBNRU1fV0lORE9XX1RZUEVfMkIgVW5rbm93biBmbGFnczogMHg4 MDAwIG1heF9zZ2U6IDEzIG1heF9zZ2VfcmQ6IDEzIG1heF9jcTogMzI3NjUgbWF4X2NxZTogMTA0 ODU3NCBtYXhfbXI6IDIwOTcxNTAgbWF4X3BkOiAyNjIxNDEgbWF4X3FwX3JkX2F0b206IDMyIG1h eF9lZV9yZF9hdG9tOiAwIG1heF9yZXNfcmRfYXRvbTogMCBtYXhfcXBfaW5pdF9yZF9hdG9tOiAz MiBtYXhfZWVfaW5pdF9yZF9hdG9tOiAwIGF0b21pY19jYXA6IEFUT01JQ19OT05FICgwKSBtYXhf ZWU6IDAgbWF4X3JkZDogMCBtYXhfbXc6IDIwOTcxNTAgbWF4X3Jhd19pcHY2X3FwOiAwIG1heF9y YXdfZXRoeV9xcDogMCBtYXhfbWNhc3RfZ3JwOiAxNjM4NCBtYXhfbWNhc3RfcXBfYXR0YWNoOiA4 IG1heF90b3RhbF9tY2FzdF9xcF9hdHRhY2g6IDEzMTA3MiBtYXhfYWg6IDEzMTA3MiBtYXhfZm1y OiAwIG1heF9zcnE6IDAgbWF4X3BrZXlzOiAxIGxvY2FsX2NhX2Fja19kZWxheTogMCBnZW5lcmFs X29kcF9jYXBzOiByY19vZHBfY2FwczogTk8gU1VQUE9SVCB1Y19vZHBfY2FwczogTk8gU1VQUE9S VCB1ZF9vZHBfY2FwczogTk8gU1VQUE9SVCBjb21wbGV0aW9uX3RpbWVzdGFtcF9tYXNrIG5vdCBz dXBwb3J0ZWQgY29yZSBjbG9jayBub3Qgc3VwcG9ydGVkIGRldmljZV9jYXBfZmxhZ3NfZXg6IDB4 MCB0c29fY2FwczogbWF4X3RzbzogMCByc3NfY2FwczogbWF4X3J3cV9pbmRpcmVjdGlvbl90YWJs ZXM6IDAgbWF4X3J3cV9pbmRpcmVjdGlvbl90YWJsZV9zaXplOiAwIHJ4X2hhc2hfZnVuY3Rpb246 IDB4MCByeF9oYXNoX2ZpZWxkc19tYXNrOiAweDAgbWF4X3dxX3R5cGVfcnE6IDAgcGFja2V0X3Bh Y2luZ19jYXBzOiBxcF9yYXRlX2xpbWl0X21pbjogMGticHMgcXBfcmF0ZV9saW1pdF9tYXg6IDBr YnBzIHBvcnQ6IDEgc3RhdGU6IFBPUlRfQUNUSVZFICg0KSBtYXhfbXR1OiA0MDk2ICg1KSBhY3Rp dmVfbXR1OiAxMDI0ICgzKSBzbV9saWQ6IDAgcG9ydF9saWQ6IDEgcG9ydF9sbWM6IDB4MDAgbGlu a19sYXllcjogRXRoZXJuZXQgbWF4X21zZ19zejogMHgxMDAwMSBwb3J0X2NhcF9mbGFnczogMHgw NDA1MDAwMCBtYXhfdmxfbnVtOiBpbnZhbGlkIHZhbHVlICgwKSBiYWRfcGtleV9jbnRyOiAweDAg cWtleV92aW9sX2NudHI6IDB4MCBzbV9zbDogMCBwa2V5X3RibF9sZW46IDEgZ2lkX3RibF9sZW46 IDMyIHN1Ym5ldF90aW1lb3V0OiAwIGluaXRfdHlwZV9yZXBseTogMCBhY3RpdmVfd2lkdGg6IDRY ICgyKSBhY3RpdmVfc3BlZWQ6IDI1LjAgR2JwcyAoMzIpIHBoeXNfc3RhdGU6IExJTktfVVAgKDUp IEdJRFsgMF06IGZlODA6MDAwMDowMDAwOjAwMDA6YjY5Njo5MWZmOmZlR0c6R0dHRyBHSURbIDFd OiAwMDAwOjAwMDA6MDAwMDowMDAwOjAwMDA6ZmZmZjo2NDAwOjAwNTQgR0lEWyAyXTogMTIzNDow MDAwOjAwMDA6MDAwMDowMDAwOjAwMDA6MDAwMDowMDg0ICMgaWJ2X2RldmluZm8gLWQgaXJkbWEt aWNlMSAtdiBoY2FfaWQ6IGlyZG1hLWljZTEgdHJhbnNwb3J0OiBpV0FSUCAoMSkgZndfdmVyOiAx LjY5IG5vZGVfZ3VpZDogYjY5Njo5MWZmOmZlR0c6R0dHRyBzeXNfaW1hZ2VfZ3VpZDogYjY5Njo5 MWZmOmZlR0c6R0dHRyB2ZW5kb3JfaWQ6IDB4ODA4NiB2ZW5kb3JfcGFydF9pZDogNTUyMyBod192 ZXI6IDB4MiBwaHlzX3BvcnRfY250OiAxIG1heF9tcl9zaXplOiAweDIwMDAwMDAwMDAwMCBwYWdl X3NpemVfY2FwOiAweDQwMjAxMDAwIG1heF9xcDogMTYzODAgbWF4X3FwX3dyOiA0MDYzIGRldmlj ZV9jYXBfZmxhZ3M6IDB4MDEyMjgwMDAgTUVNX1dJTkRPVyBNRU1fTUdUX0VYVEVOU0lPTlMgTUVN X1dJTkRPV19UWVBFXzJCIFVua25vd24gZmxhZ3M6IDB4ODAwMCBtYXhfc2dlOiAxMyBtYXhfc2dl X3JkOiAxMyBtYXhfY3E6IDMyNzY1IG1heF9jcWU6IDEwNDg1NzQgbWF4X21yOiAyMDk3MTUwIG1h eF9wZDogMjYyMTQxIG1heF9xcF9yZF9hdG9tOiAzMiBtYXhfZWVfcmRfYXRvbTogMCBtYXhfcmVz X3JkX2F0b206IDAgbWF4X3FwX2luaXRfcmRfYXRvbTogMzIgbWF4X2VlX2luaXRfcmRfYXRvbTog MCBhdG9taWNfY2FwOiBBVE9NSUNfTk9ORSAoMCkgbWF4X2VlOiAwIG1heF9yZGQ6IDAgbWF4X213 OiAyMDk3MTUwIG1heF9yYXdfaXB2Nl9xcDogMCBtYXhfcmF3X2V0aHlfcXA6IDAgbWF4X21jYXN0 X2dycDogMCBtYXhfbWNhc3RfcXBfYXR0YWNoOiAwIG1heF90b3RhbF9tY2FzdF9xcF9hdHRhY2g6 IDAgbWF4X2FoOiAwIG1heF9mbXI6IDAgbWF4X3NycTogMCBtYXhfcGtleXM6IDAgbG9jYWxfY2Ff YWNrX2RlbGF5OiAwIGdlbmVyYWxfb2RwX2NhcHM6IHJjX29kcF9jYXBzOiBOTyBTVVBQT1JUIHVj X29kcF9jYXBzOiBOTyBTVVBQT1JUIHVkX29kcF9jYXBzOiBOTyBTVVBQT1JUIGNvbXBsZXRpb25f dGltZXN0YW1wX21hc2sgbm90IHN1cHBvcnRlZCBjb3JlIGNsb2NrIG5vdCBzdXBwb3J0ZWQgZGV2 aWNlX2NhcF9mbGFnc19leDogMHgwIHRzb19jYXBzOiBtYXhfdHNvOiAwIHJzc19jYXBzOiBtYXhf cndxX2luZGlyZWN0aW9uX3RhYmxlczogMCBtYXhfcndxX2luZGlyZWN0aW9uX3RhYmxlX3NpemU6 IDAgcnhfaGFzaF9mdW5jdGlvbjogMHgwIHJ4X2hhc2hfZmllbGRzX21hc2s6IDB4MCBtYXhfd3Ff dHlwZV9ycTogMCBwYWNrZXRfcGFjaW5nX2NhcHM6IHFwX3JhdGVfbGltaXRfbWluOiAwa2JwcyBx cF9yYXRlX2xpbWl0X21heDogMGticHMgcG9ydDogMSBzdGF0ZTogUE9SVF9ET1dOICgxKSBtYXhf bXR1OiA0MDk2ICg1KSBhY3RpdmVfbXR1OiAxMDI0ICgzKSBzbV9saWQ6IDAgcG9ydF9saWQ6IDEg cG9ydF9sbWM6IDB4MDAgbGlua19sYXllcjogRXRoZXJuZXQgbWF4X21zZ19zejogMHgxMDAwMSBw b3J0X2NhcF9mbGFnczogMHgwMDA1MDAwMCBtYXhfdmxfbnVtOiBpbnZhbGlkIHZhbHVlICgwKSBi YWRfcGtleV9jbnRyOiAweDAgcWtleV92aW9sX2NudHI6IDB4MCBzbV9zbDogMCBwa2V5X3RibF9s ZW46IDAgZ2lkX3RibF9sZW46IDEgc3VibmV0X3RpbWVvdXQ6IDAgaW5pdF90eXBlX3JlcGx5OiAw IGFjdGl2ZV93aWR0aDogMVggKDEpIGFjdGl2ZV9zcGVlZDogMi41IEdicHMgKDEpIEhvcGUgdGhp cyBoZWxwcy4gQmFydGVrIC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tIEZyb206IG93bmVyLWZy ZWVic2QtaW5maW5pYmFuZEBmcmVlYnNkLm9yZyBPbiBCZWhhbGYgT2YgQ2h1Y2sgVHVmZmxpIFNl bnQ6IFdlZG5lc2RheSwgRmVicnVhcnkgOCwgMjAyMyAyMDozNSBUbzogTWluYSBHYWxpxIcgQ2M6 IGZyZWVic2QtaW5maW5pYmFuZEBmcmVlYnNkLm9yZyBTdWJqZWN0OiBSZTogU29saWNpdGluZyBp bmZpbmliYW5kIGlmY29uZmlnIG91dHB1dCBPbiBUaHUsIEZlYiAyLCAyMDIzIGF0IDI6MTAgQU0g TWluYSBHYWxpxIcgd3JvdGU6ID4gPiBIaSBmb2xrcywgPiA+IEknbSBjdXJyZW50bHkgd29ya2lu ZyBvbiBhIHByb2plY3Qgb2YgbWFraW5nIEZyZWVCU0QgYSBUaWVyIDEgY2xvdWQtaW5pdCBwbGF0 Zm9ybVsxXS4gPiA+IFRoYXQgaW52b2x2ZXMgYSBsb3Qgb2YgcmVmYWN0b3Jpbmcgb2YgdmVyeSBM aW51eCBzcGVjaWZpYyBjb2RlWzJdLCBhbmQgaW4gb3JkZXIgdG8gYmUgYWJsZSB0byBkbyB0aGF0 LCBJIG5lZWQgaW5mb3JtYXRpb24gYWJvdXQgaGFyZHdhcmUgdGhhdCBJIGRvbid0IGhhdmUgYWNj ZXNzIHRvLiA+ID4gSSdtIHN0aWxsIG9wZXJhdGluZyB1bmRlciB0aGUgYXNzdW1wdGlvbiB0aGF0 IGkgY2FuIGdldCAoYWxtb3N0KSBhbGwgaW5mb3JtYXRpb24gZnJvbSBhIG5ldHdvcmsgZGV2aWNl IHZpYSBpZmNvbmZpZ1szXS4gPiA+IENhbiB5b3Ugc2hhcmUgYW4gYGlmY29uZmlnIC1hYCBvdXRw dXQgd2l0aCBtZSBvbiB5b3VyIEZyZWVCU0Qgc3lzdGVtcyB0aGF0IGhhdmUgSW5maW5pYmFuZD8g QW5kIG1heWJlIGFueSBvdGhlciBjb21tYW5kcyB0aGF0IGFyZSBtb3JlIHVzZWZ1bCwgaWYgbXkg YWJvdmUgYXNzdW1wdGlvbiBpcyB3cm9uZy4gSSBkb24ndCB1c2UgSUIgYnV0IGhhdmUgaGFyZHdh cmUgdGhhdCBpcyBjYXBhYmxlLiBCZWxvdyBpcyB3aGF0IEkgdGhpbmsgeW91IHdhbnRlZC4gSWYg b3RoZXJzIGNhbiBwcm92aWRlIGluZm8gb24gaG93IHRvIGNvbmZpZ3VyZSB0aGlzLCBJJ20gaGFw cHkgdG8gZG8gc28uICMgZnJlZWJzZC12ZXJzaW9uIDEzLjEtUkVMRUFTRSAjIHBjaWNvbmYgLWx2 YSBwY2kwOjU1OjA6MCBtbHg1X2NvcmUwQHBjaTA6NTU6MDowOiBjbGFzcz0weDAyMDcwMCByZXY9 MHgwMCBoZHI9MHgwMCB2ZW5kb3I9MHgxNWIzIGRldmljZT0weDEwMWIgc3VidmVuZG9yPTB4MTVi MyBzdWJkZXZpY2U9MHgwMDA4IHZlbmRvciA9ICdNZWxsYW5veCBUZWNobm9sb2dpZXMnIGRldmlj ZSA9ICdNVDI4OTA4IEZhbWlseSBbQ29ubmVjdFgtNl0nIGNsYXNzID0gbmV0d29yayBzdWJjbGFz cyA9IEluZmluaUJhbmQgIyBwY2ljb25mIC1sdmEgcGNpMDo1NTowOjEgbWx4NV9jb3JlMUBwY2kw OjU1OjA6MTogY2xhc3M9MHgwMjA3MDAgcmV2PTB4MDAgaGRyPTB4MDAgdmVuZG9yPTB4MTViMyBk ZXZpY2U9MHgxMDFiIHN1YnZlbmRvcj0weDE1YjMgc3ViZGV2aWNlPTB4MDAwOCB2ZW5kb3IgPSAn TWVsbGFub3ggVGVjaG5vbG9naWVzJyBkZXZpY2UgPSAnTVQyODkwOCBGYW1pbHkgW0Nvbm5lY3RY LTZdJyBjbGFzcyA9IG5ldHdvcmsgc3ViY2xhc3MgPSBJbmZpbmlCYW5kICMgaWZjb25maWcgLWEg YmdlMDogZmxhZ3M9ODk0MyBtZXRyaWMgMCBtdHUgMTUwMCBvcHRpb25zPWMwMTliIGV0aGVyIDA4 OmYxOmVhOjk4OjYyOjgwIGluZXQgMTY5LjI1NC4yMzguNDMgbmV0bWFzayAweGZmZmZmODAwIGJy b2FkY2FzdCAxNjkuMjU0LjIzOS4yNTUgbWVkaWE6IEV0aGVybmV0IGF1dG9zZWxlY3QgKDEwMDBi YXNlVCApIHN0YXR1czogYWN0aXZlIG5kNiBvcHRpb25zPTI5IGJnZTE6IGZsYWdzPTg4MDIgbWV0 cmljIDAgbXR1IDE1MDAgb3B0aW9ucz1jMDE5YiBldGhlciAwODpmMTplYTo5ODo2Mjo4MSBtZWRp YTogRXRoZXJuZXQgYXV0b3NlbGVjdCBuZDYgb3B0aW9ucz0yOSBiZ2UyOiBmbGFncz04ODAyIG1l dHJpYyAwIG10dSAxNTAwIG9wdGlvbnM9YzAxOWIgZXRoZXIgMDg6ZjE6ZWE6OTg6NjI6ODIgbWVk aWE6IEV0aGVybmV0IGF1dG9zZWxlY3QgbmQ2IG9wdGlvbnM9MjkgYmdlMzogZmxhZ3M9ODgwMiBt ZXRyaWMgMCBtdHUgMTUwMCBvcHRpb25zPWMwMTliIGV0aGVyIDA4OmYxOmVhOjk4OjYyOjgzIG1l ZGlhOiBFdGhlcm5ldCBhdXRvc2VsZWN0IG5kNiBvcHRpb25zPTI5IGxvMDogZmxhZ3M9ODA0OSBt ZXRyaWMgMCBtdHUgMTYzODQgb3B0aW9ucz02ODAwMDMgaW5ldDYgOjoxIHByZWZpeGxlbiAxMjgg aW5ldDYgZmU4MDo6MSVsbzAgcHJlZml4bGVuIDY0IHNjb3BlaWQgMHg1IGluZXQgMTI3LjAuMC4x IG5ldG1hc2sgMHhmZjAwMDAwMCBncm91cHM6IGxvIG5kNiBvcHRpb25zPTIxIGliMDogZmxhZ3M9 ODAwMiBtZXRyaWMgMCBtdHUgNDA5MiBvcHRpb25zPTgwMDliIGxsYWRkciAwLjAuMS41LmZlLjgw LjAuMC4wLjAuMC4wLmI4LjU5LjlmLjMuMC5lYy41Ni5jYyBuZDYgb3B0aW9ucz0yOSBpYjE6IGZs YWdzPTgwMDIgbWV0cmljIDAgbXR1IDQwOTIgb3B0aW9ucz04MDA5YiBsbGFkZHIgMC4wLjkuNS5m ZS44MC4wLjAuMC4wLjAuMC5iOC41OS45Zi4zLjAuZWMuNTYuY2QgbmQ2IG9wdGlvbnM9MjkgLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tIEludGVsIFRlY2hub2xvZ3kgUG9sYW5kIHNwLiB6IG8uby4gdWwuIFNsb3dhY2tp ZWdvIDE3MyB8IDgwLTI5OCBHZGFuc2sgfCBTYWQgUmVqb25vd3kgR2RhbnNrIFBvbG5vYyB8IFZJ SSBXeWR6aWFsIEdvc3BvZGFyY3p5IEtyYWpvd2VnbyBSZWplc3RydSBTYWRvd2VnbyAtIEtSUyAx MDE4ODIgfCBOSVAgOTU3LTA3LTUyLTMxNiB8IEthcGl0YWwgemFrbGFkb3d5IDIwMC4wMDAgUExO LiBTcG9sa2Egb3N3aWFkY3phLCB6ZSBwb3NpYWRhIHN0YXR1cyBkdXplZ28gcHJ6ZWRzaWViaW9y Y3kgdyByb3p1bWllbml1IHVzdGF3eSB6IGRuaWEgOCBtYXJjYSAyMDEzIHIuIG8gcHJ6ZWNpd2R6 aWFsYW5pdSBuYWRtaWVybnltIG9wb3puaWVuaW9tIHcgdHJhbnNha2NqYWNoIGhhbmRsb3d5Y2gu IFRhIHdpYWRvbW9zYyB3cmF6IHogemFsYWN6bmlrYW1pIGplc3QgcHJ6ZXpuYWN6b25hIGRsYSBv a3Jlc2xvbmVnbyBhZHJlc2F0YSBpIG1vemUgemF3aWVyYWMgaW5mb3JtYWNqZSBwb3VmbmUuIFcg cmF6aWUgcHJ6eXBhZGtvd2VnbyBvdHJ6eW1hbmlhIHRlaiB3aWFkb21vc2NpLCBwcm9zaW15IG8g cG93aWFkb21pZW5pZSBuYWRhd2N5IG9yYXogdHJ3YWxlIGplaiB1c3VuaWVjaWU7IGpha2lla29s d2llayBwcnplZ2xhZGFuaWUgbHViIHJvenBvd3N6ZWNobmlhbmllIGplc3QgemFicm9uaW9uZS4g VGhpcyBlLW1haWwgYW5kIGFueSBhdHRhY2htZW50cyBtYXkgY29udGFpbiBjb25maWRlbnRpYWwg bWF0ZXJpYWwgZm9yIHRoZSBzb2xlIHVzZSBvZiB0aGUgaW50ZW5kZWQgcmVjaXBpZW50KHMpLiBJ ZiB5b3UgYXJlIG5vdCB0aGUgaW50ZW5kZWQgcmVjaXBpZW50LCBwbGVhc2UgY29udGFjdCB0aGUg c2VuZGVyIGFuZCBkZWxldGUgYWxsIGNvcGllczsgYW55IHJldmlldyBvciBkaXN0cmlidXRpb24g Ynkgb3RoZXJzIGlzIHN0cmljdGx5IHByb2hpYml0ZWQuCj4KPiAtLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KPiBJbnRlbCBUZWNo bm9sb2d5IFBvbGFuZCBzcC4geiBvLm8uICB1bC4gU8WCb3dhY2tpZWdvIDE3MyB8IDgwLTI5OCBH ZGHFhHNrIHwgU8SFZCBSZWpvbm93eSBHZGHFhHNrIFDDs8WCbm9jIHwgVklJIFd5ZHppYcWCIEdv c3BvZGFyY3p5IEtyYWpvd2VnbyBSZWplc3RydSBTxIVkb3dlZ28gLSBLUlMgMTAxODgyIHwgTklQ IDk1Ny0wNy01Mi0zMTYgfCBLYXBpdGHFgiB6YWvFgmFkb3d5IDIwMC4wMDAgUExOLgo+IFNww7PF gmthIG/Fm3dpYWRjemEsIMW8ZSBwb3NpYWRhIHN0YXR1cyBkdcW8ZWdvIHByemVkc2nEmWJpb3Jj eSB3IHJvenVtaWVuaXUgdXN0YXd5IHogZG5pYSA4IG1hcmNhIDIwMTMgci4gbyBwcnplY2l3ZHpp YcWCYW5pdSBuYWRtaWVybnltIG9ww7PFum5pZW5pb20gdyB0cmFuc2FrY2phY2ggaGFuZGxvd3lj aC4KPgo+IFRhIHdpYWRvbW/Fm8SHIHdyYXogeiB6YcWCxIVjem5pa2FtaSBqZXN0IHByemV6bmFj em9uYSBkbGEgb2tyZcWbbG9uZWdvIGFkcmVzYXRhIGkgbW/FvGUgemF3aWVyYcSHIGluZm9ybWFj amUgcG91Zm5lLiBXIHJhemllIHByenlwYWRrb3dlZ28gb3RyenltYW5pYSB0ZWogd2lhZG9tb8Wb Y2ksIHByb3NpbXkgbyBwb3dpYWRvbWllbmllIG5hZGF3Y3kgb3JheiB0cndhxYJlIGplaiB1c3Vu acSZY2llOyBqYWtpZWtvbHdpZWsgcHJ6ZWdsxIVkYW5pZSBsdWIgcm96cG93c3plY2huaWFuaWUg amVzdCB6YWJyb25pb25lLgo+IFRoaXMgZS1tYWlsIGFuZCBhbnkgYXR0YWNobWVudHMgbWF5IGNv bnRhaW4gY29uZmlkZW50aWFsIG1hdGVyaWFsIGZvciB0aGUgc29sZSB1c2Ugb2YgdGhlIGludGVu ZGVkIHJlY2lwaWVudChzKS4gSWYgeW91IGFyZSBub3QgdGhlIGludGVuZGVkIHJlY2lwaWVudCwg cGxlYXNlIGNvbnRhY3QgdGhlIHNlbmRlciBhbmQgZGVsZXRlIGFsbCBjb3BpZXM7IGFueSByZXZp ZXcgb3IgZGlzdHJpYnV0aW9uIGJ5IG90aGVycyBpcyBzdHJpY3RseSBwcm9oaWJpdGVkLg== --b1_ljd9KvCobRroyMW26tVUtrUfpJvxZg0KtRrm7EVCA Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0 cHg7Ij5IaSBmb2xrcyw8L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMt c2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWls eTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPkJhcnRlayBydWluZWQgbXkg aHlwb3RoZXNpcyB0aGF0IGFsbCB0aGUgaW5mbyBpIG5lZWQgY2FuIGJlIGRlZHVjZWQgZnJvbSA8 Y29kZT5pZmNvbmZpZyAtYTwvY29kZT7igIsuPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6 IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij5TbyBJIG5lZWQgdG8gY29tZSB3 aXRoIG90aGVyIHdheXMgb2YgcXVpY2tseSBhbmQgZWFzaWx5IGlkZW50aWZ5aW5nIGFsbCBpbmZp bmliYW5kIGludGVyZmFjZXMuPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBz YW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1m YW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij5Xb3VsZCB5b3UgYmUg c28ga2luZCBhcyB0byBzaGFyZSB3aGF0PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFy aWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48YnI+PC9kaXY+PGRpdiBzdHlsZT0i Zm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48Y29kZT5p YnZfZGV2aWNlczwvY29kZT7igIs8L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWws IHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250 LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPmFuZDwvZGl2Pjxk aXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4 OyI+PGJyPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsg Zm9udC1zaXplOiAxNHB4OyI+PGNvZGU+aWJ2X2RldmluZm8gLWw8L2NvZGU+4oCLPC9kaXY+PGRp diBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7 Ij48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBm b250LXNpemU6IDE0cHg7Ij5sb29rcyBsaWtlIG9uIHlvdXIgc3lzdGVtcz88L2Rpdj48ZGl2IHN0 eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxi cj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQt c2l6ZTogMTRweDsiPkknbSBob3Bpbmcgb25lIG9mIHRoZXNlIGlzIGVhc2llciB0byBwYXJzZSwg b3IgcHJvdmlkZXMgdXNlZnVsIGluZm9ybWF0aW9uIHRvIGZpbGwgdGhlIGdhcHMgaW4gdGhlIGZ1 bmN0aW9ucyBJJ20gdHJ5aW5nIHRvIHJlaW1wbGVtZW50LjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQt ZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+PGJyPjwvZGl2Pjxk aXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4 OyI+S2luZCByZWdhcmRzLDxicj48L2Rpdj48YnI+PGRpdiBjbGFzcz0icHJvdG9ubWFpbF9zaWdu YXR1cmVfYmxvY2siIHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQt c2l6ZTogMTRweDsiPg0KICAgIDxkaXYgY2xhc3M9InByb3Rvbm1haWxfc2lnbmF0dXJlX2Jsb2Nr LXVzZXIiPg0KICAgICAgICA8c3Bhbj5NaW5hIEdhbGnEhzwvc3Bhbj48ZGl2Pjxicj48L2Rpdj48 ZGl2PlRyeSBQa2dCYXNlOiA8YSB0aXRsZT0iaHR0cHM6Ly9hbHBoYS5wa2diYXNlLmxpdmUvIiBo cmVmPSJodHRwczovL2FscGhhLnBrZ2Jhc2UubGl2ZS8iIHJlbD0ibm9vcGVuZXIgbm9yZWZlcnJl ciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vYWxwaGEucGtnYmFzZS5saXZlLzwvYT48L2Rpdj48 c3Bhbj48L3NwYW4+DQogICAgPC9kaXY+DQogICAgDQogICAgICAgICAgICA8ZGl2IGNsYXNzPSJw cm90b25tYWlsX3NpZ25hdHVyZV9ibG9jay1wcm90b24gcHJvdG9ubWFpbF9zaWduYXR1cmVfYmxv Y2stZW1wdHkiPg0KICAgICAgICANCiAgICAgICAgICAgIDwvZGl2Pg0KPC9kaXY+DQo8ZGl2IHN0 eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxi cj48L2Rpdj48ZGl2IGNsYXNzPSJwcm90b25tYWlsX3F1b3RlIj4NCiAgICAgICAgLS0tLS0tLSBP cmlnaW5hbCBNZXNzYWdlIC0tLS0tLS08YnI+DQogICAgICAgIE9uIFRodXJzZGF5LCBGZWJydWFy eSA5dGgsIDIwMjMgYXQgMTM6MTcsIFNvYmN6YWssIEJhcnRvc3ogJmx0O2JhcnRvc3ouc29iY3ph a0BpbnRlbC5jb20mZ3Q7IHdyb3RlOjxicj48YnI+DQogICAgICAgIDxibG9ja3F1b3RlIGNsYXNz PSJwcm90b25tYWlsX3F1b3RlIiB0eXBlPSJjaXRlIj4NCiAgICAgICAgICAgIA0KPGRpdiBjbGFz cz0iV29yZFNlY3Rpb24xIj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPkp1c3QgcHJlc2VydmluZyBh bm9ueW1pdHkuIFVuZGVyIHRoZSBHRyB0aGVyZSBpcyBhIHJlZ3VsYXIgWzAtOWEtZl0gaGV4IG51 bWJlcjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPiZuYnNwOzwvcD4NCjxwIGNsYXNzPSJNc29O b3JtYWwiPkJhcnRlazwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPiZuYnNwOzwvcD4NCjxkaXYg c3R5bGU9ImJvcmRlcjpub25lO2JvcmRlci10b3A6c29saWQgI0UxRTFFMSAxLjBwdDtwYWRkaW5n OjMuMHB0IDBpbiAwaW4gMGluIj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxiPkZyb206PC9iPiBv d25lci1mcmVlYnNkLWluZmluaWJhbmRAZnJlZWJzZC5vcmcgJmx0O293bmVyLWZyZWVic2QtaW5m aW5pYmFuZEBmcmVlYnNkLm9yZyZndDsNCjxiPk9uIEJlaGFsZiBPZiA8L2I+TWluYSBHYWxpxIc8 YnI+DQo8Yj5TZW50OjwvYj4gVGh1cnNkYXksIEZlYnJ1YXJ5IDksIDIwMjMgMTI6MDc8YnI+DQo8 Yj5Ubzo8L2I+IFNvYmN6YWssIEJhcnRvc3ogJmx0O2JhcnRvc3ouc29iY3pha0BpbnRlbC5jb20m Z3Q7PGJyPg0KPGI+Q2M6PC9iPiBmcmVlYnNkLWluZmluaWJhbmRAZnJlZWJzZC5vcmc8YnI+DQo8 Yj5TdWJqZWN0OjwvYj4gUmU6IFNvbGljaXRpbmcgaW5maW5pYmFuZCBpZmNvbmZpZyBvdXRwdXQ8 L3A+DQo8L2Rpdj4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPiZuYnNwOzwvcD4NCjxwIGNsYXNzPSJN c29Ob3JtYWwiPkhpIEJhcnRlayw8YnI+DQo8YnI+DQp0aGFua3MgZm9yIHRoZSBwYXN0ZSE8YnI+ DQo8YnI+DQpxdWljayBxdWVzdGlvbjogaXMgdGhlIEdHIHNvbWV0aGluZyB0aGF0J3MgYWN0dWFs bHkgcHJpbnRlZCBieSBpZmNvbmZpZyBmb3IgdGhlc2UgZHJpdmVycywgb3IgaXMgdGhpcyBzb21l dGhpbmcgeW91IHJlcGxhY2VkIGZvciBwcmVzZXJ2aW5nIGFub255bWl0eT88YnI+DQo8YnI+DQpL aW5kIHJlZ2FyZHMsPGJyPg0KPGJyPg0KPGJyPg0KTWluYSBHYWxpxIc8L3A+DQo8ZGl2Pg0KPHAg Y2xhc3M9Ik1zb05vcm1hbCI+Jm5ic3A7PC9wPg0KPC9kaXY+DQo8ZGl2Pg0KPHAgY2xhc3M9Ik1z b05vcm1hbCI+VHJ5IFBrZ0Jhc2U6IDxhIHRpdGxlPSJodHRwczovL2FscGhhLnBrZ2Jhc2UubGl2 ZS8iIGhyZWY9Imh0dHBzOi8vYWxwaGEucGtnYmFzZS5saXZlLyIgcmVsPSJub3JlZmVycmVyIG5v Zm9sbG93IG5vb3BlbmVyIiB0YXJnZXQ9Il9ibGFuayI+DQpodHRwczovL2FscGhhLnBrZ2Jhc2Uu bGl2ZS88L2E+PC9wPg0KPC9kaXY+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48YnI+DQo8YnI+DQo8 YnI+DQo8YnI+DQo8YnI+DQo8YnI+DQotLS0tLS0tLSBPcmlnaW5hbCBNZXNzYWdlIC0tLS0tLS0t PGJyPg0KT24gOSBGZWIgMjAyMywgMDk6NDQsIFNvYmN6YWssIEJhcnRvc3ogJmx0OyA8YSBocmVm PSJtYWlsdG86YmFydG9zei5zb2JjemFrQGludGVsLmNvbSIgcmVsPSJub3JlZmVycmVyIG5vZm9s bG93IG5vb3BlbmVyIiB0YXJnZXQ9Il9ibGFuayI+DQpiYXJ0b3N6LnNvYmN6YWtAaW50ZWwuY29t PC9hPiZndDsgd3JvdGU6PC9wPg0KPGJsb2NrcXVvdGUgc3R5bGU9Im1hcmdpbi10b3A6NS4wcHQ7 bWFyZ2luLWJvdHRvbTo1LjBwdCI+DQo8cCBjbGFzcz0iTXNvTm9ybWFsIj48YnI+DQpIaSEgSGVy ZeKAmXMgYW4gZXhhbXBsZSBvZiBvdXRwdXQgdXNpbmcgSW50ZWwgRTgxMCBmYW1pbHkgRXRoZXJu ZXQgQ29udHJvbGxlciAjaWZjb25maWcgLWEgaWNlMDogZmxhZ3M9ODg0MyBtZXRyaWMgMCBtdHUg MTUwMCBvcHRpb25zPWU1MDdiYiBldGhlciBiNDo5Njo5MTpHRzpHRzpHRyBpbmV0IDEwMC4wLjAu ODQgbmV0bWFzayAweGZmZmZmZjAwIGJyb2FkY2FzdCAxMDAuMC4wLjI1NSBpbmV0NiAxMjM0Ojo4 NCBwcmVmaXhsZW4gNjQgaW5ldDYgZmU4MDo6YjY5Njo5MWZmOmZlR0c6R0dkOCVpY2UwDQogcHJl Zml4bGVuIDY0IHNjb3BlaWQgMHg0IG1lZGlhOiBFdGhlcm5ldCBhdXRvc2VsZWN0ICgyNUdCYXNl LUNSICkgc3RhdHVzOiBhY3RpdmUgbmQ2IG9wdGlvbnM9MjEgaWNlMTogZmxhZ3M9ODgwMiBtZXRy aWMgMCBtdHUgMTUwMCBvcHRpb25zPWU1MDdiYiBldGhlciBiNDo5Njo5MTpHRzpHRzpHRyBtZWRp YTogRXRoZXJuZXQgYXV0b3NlbGVjdCBzdGF0dXM6IG5vIGNhcnJpZXIgbmQ2IG9wdGlvbnM9Mjkg aWNlMjogZmxhZ3M9ODgwMiBtZXRyaWMgMA0KIG10dSAxNTAwIG9wdGlvbnM9ZTUwN2JiIGV0aGVy IGI0Ojk2OjkxOkdHOkdHOkdHIG1lZGlhOiBFdGhlcm5ldCBhdXRvc2VsZWN0IHN0YXR1czogbm8g Y2FycmllciBuZDYgb3B0aW9ucz0yOSBpY2UzOiBmbGFncz04ODAyIG1ldHJpYyAwIG10dSAxNTAw IG9wdGlvbnM9ZTUwN2JiIGV0aGVyIGI0Ojk2OjkxOkdHOkdHOkdHIG1lZGlhOiBFdGhlcm5ldCBh dXRvc2VsZWN0IHN0YXR1czogbm8gY2FycmllciBuZDYgb3B0aW9ucz0yOSAjIHBjaWNvbmYgLWx2 YQ0KIHBjaTA6MTc3OjA6MCBpY2UwQHBjaTA6MTc3OjA6MDogY2xhc3M9MHgwMjAwMDAgY2FyZD0w eDAwMDU4MDg2IGNoaXA9MHgxNTkzODA4NiByZXY9MHgwMiBoZHI9MHgwMCB2ZW5kb3IgPSAnSW50 ZWwgQ29ycG9yYXRpb24nIGRldmljZSA9ICdFdGhlcm5ldCBDb250cm9sbGVyIEU4MTAtQyBmb3Ig U0ZQJyBjbGFzcyA9IG5ldHdvcmsgc3ViY2xhc3MgPSBldGhlcm5ldCAjIGlidl9kZXZpbmZvIC1k IGlyZG1hLWljZTAgLXYgaGNhX2lkOiBpcmRtYS1pY2UwDQogdHJhbnNwb3J0OiBJbmZpbmlCYW5k ICgwKSBmd192ZXI6IDEuNjkgbm9kZV9ndWlkOiBiNjk2OjkxZmY6ZmVHRzpHR0dHIHN5c19pbWFn ZV9ndWlkOiBiNjk2OjkxZmY6ZmVHRzpHR0dHIHZlbmRvcl9pZDogMHg4MDg2IHZlbmRvcl9wYXJ0 X2lkOiA1NTIzIGh3X3ZlcjogMHgyIHBoeXNfcG9ydF9jbnQ6IDEgbWF4X21yX3NpemU6IDB4MjAw MDAwMDAwMDAwIHBhZ2Vfc2l6ZV9jYXA6IDB4NDAyMDEwMDAgbWF4X3FwOiAxNjM4MCBtYXhfcXBf d3I6IDQwNjMNCiBkZXZpY2VfY2FwX2ZsYWdzOiAweDAxMjI5MDAwIFJDX1JOUl9OQUtfR0VOIE1F TV9XSU5ET1cgTUVNX01HVF9FWFRFTlNJT05TIE1FTV9XSU5ET1dfVFlQRV8yQiBVbmtub3duIGZs YWdzOiAweDgwMDAgbWF4X3NnZTogMTMgbWF4X3NnZV9yZDogMTMgbWF4X2NxOiAzMjc2NSBtYXhf Y3FlOiAxMDQ4NTc0IG1heF9tcjogMjA5NzE1MCBtYXhfcGQ6IDI2MjE0MSBtYXhfcXBfcmRfYXRv bTogMzIgbWF4X2VlX3JkX2F0b206IDAgbWF4X3Jlc19yZF9hdG9tOg0KIDAgbWF4X3FwX2luaXRf cmRfYXRvbTogMzIgbWF4X2VlX2luaXRfcmRfYXRvbTogMCBhdG9taWNfY2FwOiBBVE9NSUNfTk9O RSAoMCkgbWF4X2VlOiAwIG1heF9yZGQ6IDAgbWF4X213OiAyMDk3MTUwIG1heF9yYXdfaXB2Nl9x cDogMCBtYXhfcmF3X2V0aHlfcXA6IDAgbWF4X21jYXN0X2dycDogMTYzODQgbWF4X21jYXN0X3Fw X2F0dGFjaDogOCBtYXhfdG90YWxfbWNhc3RfcXBfYXR0YWNoOiAxMzEwNzIgbWF4X2FoOiAxMzEw NzIgbWF4X2ZtcjogMA0KIG1heF9zcnE6IDAgbWF4X3BrZXlzOiAxIGxvY2FsX2NhX2Fja19kZWxh eTogMCBnZW5lcmFsX29kcF9jYXBzOiByY19vZHBfY2FwczogTk8gU1VQUE9SVCB1Y19vZHBfY2Fw czogTk8gU1VQUE9SVCB1ZF9vZHBfY2FwczogTk8gU1VQUE9SVCBjb21wbGV0aW9uX3RpbWVzdGFt cF9tYXNrIG5vdCBzdXBwb3J0ZWQgY29yZSBjbG9jayBub3Qgc3VwcG9ydGVkIGRldmljZV9jYXBf ZmxhZ3NfZXg6IDB4MCB0c29fY2FwczogbWF4X3RzbzogMCByc3NfY2FwczoNCiBtYXhfcndxX2lu ZGlyZWN0aW9uX3RhYmxlczogMCBtYXhfcndxX2luZGlyZWN0aW9uX3RhYmxlX3NpemU6IDAgcnhf aGFzaF9mdW5jdGlvbjogMHgwIHJ4X2hhc2hfZmllbGRzX21hc2s6IDB4MCBtYXhfd3FfdHlwZV9y cTogMCBwYWNrZXRfcGFjaW5nX2NhcHM6IHFwX3JhdGVfbGltaXRfbWluOiAwa2JwcyBxcF9yYXRl X2xpbWl0X21heDogMGticHMgcG9ydDogMSBzdGF0ZTogUE9SVF9BQ1RJVkUgKDQpIG1heF9tdHU6 IDQwOTYgKDUpIGFjdGl2ZV9tdHU6DQogMTAyNCAoMykgc21fbGlkOiAwIHBvcnRfbGlkOiAxIHBv cnRfbG1jOiAweDAwIGxpbmtfbGF5ZXI6IEV0aGVybmV0IG1heF9tc2dfc3o6IDB4MTAwMDEgcG9y dF9jYXBfZmxhZ3M6IDB4MDQwNTAwMDAgbWF4X3ZsX251bTogaW52YWxpZCB2YWx1ZSAoMCkgYmFk X3BrZXlfY250cjogMHgwIHFrZXlfdmlvbF9jbnRyOiAweDAgc21fc2w6IDAgcGtleV90YmxfbGVu OiAxIGdpZF90YmxfbGVuOiAzMiBzdWJuZXRfdGltZW91dDogMCBpbml0X3R5cGVfcmVwbHk6DQog MCBhY3RpdmVfd2lkdGg6IDRYICgyKSBhY3RpdmVfc3BlZWQ6IDI1LjAgR2JwcyAoMzIpIHBoeXNf c3RhdGU6IExJTktfVVAgKDUpIEdJRFsgMF06IGZlODA6MDAwMDowMDAwOjAwMDA6YjY5Njo5MWZm OmZlR0c6R0dHRyBHSURbIDFdOiAwMDAwOjAwMDA6MDAwMDowMDAwOjAwMDA6ZmZmZjo2NDAwOjAw NTQgR0lEWyAyXTogMTIzNDowMDAwOjAwMDA6MDAwMDowMDAwOjAwMDA6MDAwMDowMDg0ICMgaWJ2 X2RldmluZm8gLWQgaXJkbWEtaWNlMSAtdiBoY2FfaWQ6DQogaXJkbWEtaWNlMSB0cmFuc3BvcnQ6 IGlXQVJQICgxKSBmd192ZXI6IDEuNjkgbm9kZV9ndWlkOiBiNjk2OjkxZmY6ZmVHRzpHR0dHIHN5 c19pbWFnZV9ndWlkOiBiNjk2OjkxZmY6ZmVHRzpHR0dHIHZlbmRvcl9pZDogMHg4MDg2IHZlbmRv cl9wYXJ0X2lkOiA1NTIzIGh3X3ZlcjogMHgyIHBoeXNfcG9ydF9jbnQ6IDEgbWF4X21yX3NpemU6 IDB4MjAwMDAwMDAwMDAwIHBhZ2Vfc2l6ZV9jYXA6IDB4NDAyMDEwMDAgbWF4X3FwOiAxNjM4MCBt YXhfcXBfd3I6DQogNDA2MyBkZXZpY2VfY2FwX2ZsYWdzOiAweDAxMjI4MDAwIE1FTV9XSU5ET1cg TUVNX01HVF9FWFRFTlNJT05TIE1FTV9XSU5ET1dfVFlQRV8yQiBVbmtub3duIGZsYWdzOiAweDgw MDAgbWF4X3NnZTogMTMgbWF4X3NnZV9yZDogMTMgbWF4X2NxOiAzMjc2NSBtYXhfY3FlOiAxMDQ4 NTc0IG1heF9tcjogMjA5NzE1MCBtYXhfcGQ6IDI2MjE0MSBtYXhfcXBfcmRfYXRvbTogMzIgbWF4 X2VlX3JkX2F0b206IDAgbWF4X3Jlc19yZF9hdG9tOiAwIG1heF9xcF9pbml0X3JkX2F0b206DQog MzIgbWF4X2VlX2luaXRfcmRfYXRvbTogMCBhdG9taWNfY2FwOiBBVE9NSUNfTk9ORSAoMCkgbWF4 X2VlOiAwIG1heF9yZGQ6IDAgbWF4X213OiAyMDk3MTUwIG1heF9yYXdfaXB2Nl9xcDogMCBtYXhf cmF3X2V0aHlfcXA6IDAgbWF4X21jYXN0X2dycDogMCBtYXhfbWNhc3RfcXBfYXR0YWNoOiAwIG1h eF90b3RhbF9tY2FzdF9xcF9hdHRhY2g6IDAgbWF4X2FoOiAwIG1heF9mbXI6IDAgbWF4X3NycTog MCBtYXhfcGtleXM6IDAgbG9jYWxfY2FfYWNrX2RlbGF5Og0KIDAgZ2VuZXJhbF9vZHBfY2Fwczog cmNfb2RwX2NhcHM6IE5PIFNVUFBPUlQgdWNfb2RwX2NhcHM6IE5PIFNVUFBPUlQgdWRfb2RwX2Nh cHM6IE5PIFNVUFBPUlQgY29tcGxldGlvbl90aW1lc3RhbXBfbWFzayBub3Qgc3VwcG9ydGVkIGNv cmUgY2xvY2sgbm90IHN1cHBvcnRlZCBkZXZpY2VfY2FwX2ZsYWdzX2V4OiAweDAgdHNvX2NhcHM6 IG1heF90c286IDAgcnNzX2NhcHM6IG1heF9yd3FfaW5kaXJlY3Rpb25fdGFibGVzOiAwIG1heF9y d3FfaW5kaXJlY3Rpb25fdGFibGVfc2l6ZToNCiAwIHJ4X2hhc2hfZnVuY3Rpb246IDB4MCByeF9o YXNoX2ZpZWxkc19tYXNrOiAweDAgbWF4X3dxX3R5cGVfcnE6IDAgcGFja2V0X3BhY2luZ19jYXBz OiBxcF9yYXRlX2xpbWl0X21pbjogMGticHMgcXBfcmF0ZV9saW1pdF9tYXg6IDBrYnBzIHBvcnQ6 IDEgc3RhdGU6IFBPUlRfRE9XTiAoMSkgbWF4X210dTogNDA5NiAoNSkgYWN0aXZlX210dTogMTAy NCAoMykgc21fbGlkOiAwIHBvcnRfbGlkOiAxIHBvcnRfbG1jOiAweDAwIGxpbmtfbGF5ZXI6IEV0 aGVybmV0DQogbWF4X21zZ19zejogMHgxMDAwMSBwb3J0X2NhcF9mbGFnczogMHgwMDA1MDAwMCBt YXhfdmxfbnVtOiBpbnZhbGlkIHZhbHVlICgwKSBiYWRfcGtleV9jbnRyOiAweDAgcWtleV92aW9s X2NudHI6IDB4MCBzbV9zbDogMCBwa2V5X3RibF9sZW46IDAgZ2lkX3RibF9sZW46IDEgc3VibmV0 X3RpbWVvdXQ6IDAgaW5pdF90eXBlX3JlcGx5OiAwIGFjdGl2ZV93aWR0aDogMVggKDEpIGFjdGl2 ZV9zcGVlZDogMi41IEdicHMgKDEpIEhvcGUgdGhpcyBoZWxwcy4NCiBCYXJ0ZWsgLS0tLS1Pcmln aW5hbCBNZXNzYWdlLS0tLS0gRnJvbTogPGEgaHJlZj0ibWFpbHRvOm93bmVyLWZyZWVic2QtaW5m aW5pYmFuZEBmcmVlYnNkLm9yZyIgcmVsPSJub3JlZmVycmVyIG5vZm9sbG93IG5vb3BlbmVyIiB0 YXJnZXQ9Il9ibGFuayI+DQpvd25lci1mcmVlYnNkLWluZmluaWJhbmRAZnJlZWJzZC5vcmc8L2E+ IE9uIEJlaGFsZiBPZiBDaHVjayBUdWZmbGkgU2VudDogV2VkbmVzZGF5LCBGZWJydWFyeSA4LCAy MDIzIDIwOjM1IFRvOiBNaW5hIEdhbGnEhyBDYzoNCjxhIGhyZWY9Im1haWx0bzpmcmVlYnNkLWlu ZmluaWJhbmRAZnJlZWJzZC5vcmciIHJlbD0ibm9yZWZlcnJlciBub2ZvbGxvdyBub29wZW5lciIg dGFyZ2V0PSJfYmxhbmsiPmZyZWVic2QtaW5maW5pYmFuZEBmcmVlYnNkLm9yZzwvYT4gU3ViamVj dDogUmU6IFNvbGljaXRpbmcgaW5maW5pYmFuZCBpZmNvbmZpZyBvdXRwdXQgT24gVGh1LCBGZWIg MiwgMjAyMyBhdCAyOjEwIEFNIE1pbmEgR2FsacSHIHdyb3RlOiAmZ3Q7ICZndDsgSGkgZm9sa3Ms ICZndDsgJmd0OyBJJ20gY3VycmVudGx5IHdvcmtpbmcgb24gYSBwcm9qZWN0IG9mIG1ha2luZyBG cmVlQlNEIGEgVGllcg0KIDEgY2xvdWQtaW5pdCBwbGF0Zm9ybVsxXS4gJmd0OyAmZ3Q7IFRoYXQg aW52b2x2ZXMgYSBsb3Qgb2YgcmVmYWN0b3Jpbmcgb2YgdmVyeSBMaW51eCBzcGVjaWZpYyBjb2Rl WzJdLCBhbmQgaW4gb3JkZXIgdG8gYmUgYWJsZSB0byBkbyB0aGF0LCBJIG5lZWQgaW5mb3JtYXRp b24gYWJvdXQgaGFyZHdhcmUgdGhhdCBJIGRvbid0IGhhdmUgYWNjZXNzIHRvLiAmZ3Q7ICZndDsg SSdtIHN0aWxsIG9wZXJhdGluZyB1bmRlciB0aGUgYXNzdW1wdGlvbiB0aGF0IGkgY2FuIGdldA0K IChhbG1vc3QpIGFsbCBpbmZvcm1hdGlvbiBmcm9tIGEgbmV0d29yayBkZXZpY2UgdmlhIGlmY29u ZmlnWzNdLiAmZ3Q7ICZndDsgQ2FuIHlvdSBzaGFyZSBhbiBgaWZjb25maWcgLWFgIG91dHB1dCB3 aXRoIG1lIG9uIHlvdXIgRnJlZUJTRCBzeXN0ZW1zIHRoYXQgaGF2ZSBJbmZpbmliYW5kPyBBbmQg bWF5YmUgYW55IG90aGVyIGNvbW1hbmRzIHRoYXQgYXJlIG1vcmUgdXNlZnVsLCBpZiBteSBhYm92 ZSBhc3N1bXB0aW9uIGlzIHdyb25nLiBJIGRvbid0IHVzZQ0KIElCIGJ1dCBoYXZlIGhhcmR3YXJl IHRoYXQgaXMgY2FwYWJsZS4gQmVsb3cgaXMgd2hhdCBJIHRoaW5rIHlvdSB3YW50ZWQuIElmIG90 aGVycyBjYW4gcHJvdmlkZSBpbmZvIG9uIGhvdyB0byBjb25maWd1cmUgdGhpcywgSSdtIGhhcHB5 IHRvIGRvIHNvLiAjIGZyZWVic2QtdmVyc2lvbiAxMy4xLVJFTEVBU0UgIyBwY2ljb25mIC1sdmEg cGNpMDo1NTowOjAgbWx4NV9jb3JlMEBwY2kwOjU1OjA6MDogY2xhc3M9MHgwMjA3MDAgcmV2PTB4 MDAgaGRyPTB4MDANCiB2ZW5kb3I9MHgxNWIzIGRldmljZT0weDEwMWIgc3VidmVuZG9yPTB4MTVi MyBzdWJkZXZpY2U9MHgwMDA4IHZlbmRvciA9ICdNZWxsYW5veCBUZWNobm9sb2dpZXMnIGRldmlj ZSA9ICdNVDI4OTA4IEZhbWlseSBbQ29ubmVjdFgtNl0nIGNsYXNzID0gbmV0d29yayBzdWJjbGFz cyA9IEluZmluaUJhbmQgIyBwY2ljb25mIC1sdmEgcGNpMDo1NTowOjEgbWx4NV9jb3JlMUBwY2kw OjU1OjA6MTogY2xhc3M9MHgwMjA3MDAgcmV2PTB4MDAgaGRyPTB4MDANCiB2ZW5kb3I9MHgxNWIz IGRldmljZT0weDEwMWIgc3VidmVuZG9yPTB4MTViMyBzdWJkZXZpY2U9MHgwMDA4IHZlbmRvciA9 ICdNZWxsYW5veCBUZWNobm9sb2dpZXMnIGRldmljZSA9ICdNVDI4OTA4IEZhbWlseSBbQ29ubmVj dFgtNl0nIGNsYXNzID0gbmV0d29yayBzdWJjbGFzcyA9IEluZmluaUJhbmQgIyBpZmNvbmZpZyAt YSBiZ2UwOiBmbGFncz04OTQzIG1ldHJpYyAwIG10dSAxNTAwIG9wdGlvbnM9YzAxOWIgZXRoZXIg MDg6ZjE6ZWE6OTg6NjI6ODANCiBpbmV0IDE2OS4yNTQuMjM4LjQzIG5ldG1hc2sgMHhmZmZmZjgw MCBicm9hZGNhc3QgMTY5LjI1NC4yMzkuMjU1IG1lZGlhOiBFdGhlcm5ldCBhdXRvc2VsZWN0ICgx MDAwYmFzZVQgKSBzdGF0dXM6IGFjdGl2ZSBuZDYgb3B0aW9ucz0yOSBiZ2UxOiBmbGFncz04ODAy IG1ldHJpYyAwIG10dSAxNTAwIG9wdGlvbnM9YzAxOWIgZXRoZXIgMDg6ZjE6ZWE6OTg6NjI6ODEg bWVkaWE6IEV0aGVybmV0IGF1dG9zZWxlY3QgbmQ2IG9wdGlvbnM9MjkgYmdlMjoNCiBmbGFncz04 ODAyIG1ldHJpYyAwIG10dSAxNTAwIG9wdGlvbnM9YzAxOWIgZXRoZXIgMDg6ZjE6ZWE6OTg6NjI6 ODIgbWVkaWE6IEV0aGVybmV0IGF1dG9zZWxlY3QgbmQ2IG9wdGlvbnM9MjkgYmdlMzogZmxhZ3M9 ODgwMiBtZXRyaWMgMCBtdHUgMTUwMCBvcHRpb25zPWMwMTliIGV0aGVyIDA4OmYxOmVhOjk4OjYy OjgzIG1lZGlhOiBFdGhlcm5ldCBhdXRvc2VsZWN0IG5kNiBvcHRpb25zPTI5IGxvMDogZmxhZ3M9 ODA0OSBtZXRyaWMgMCBtdHUgMTYzODQNCiBvcHRpb25zPTY4MDAwMyBpbmV0NiA6OjEgcHJlZml4 bGVuIDEyOCBpbmV0NiBmZTgwOjoxJWxvMCBwcmVmaXhsZW4gNjQgc2NvcGVpZCAweDUgaW5ldCAx MjcuMC4wLjEgbmV0bWFzayAweGZmMDAwMDAwIGdyb3VwczogbG8gbmQ2IG9wdGlvbnM9MjEgaWIw OiBmbGFncz04MDAyIG1ldHJpYyAwIG10dSA0MDkyIG9wdGlvbnM9ODAwOWIgbGxhZGRyIDAuMC4x LjUuZmUuODAuMC4wLjAuMC4wLjAuYjguNTkuOWYuMy4wLmVjLjU2LmNjIG5kNiBvcHRpb25zPTI5 DQogaWIxOiBmbGFncz04MDAyIG1ldHJpYyAwIG10dSA0MDkyIG9wdGlvbnM9ODAwOWIgbGxhZGRy IDAuMC45LjUuZmUuODAuMC4wLjAuMC4wLjAuYjguNTkuOWYuMy4wLmVjLjU2LmNkIG5kNiBvcHRp b25zPTI5IC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLSBJbnRlbCBUZWNobm9sb2d5IFBvbGFuZCBzcC4geiBvLm8uIHVs LiBTbG93YWNraWVnbyAxNzMgfCA4MC0yOTggR2RhbnNrDQogfCBTYWQgUmVqb25vd3kgR2RhbnNr IFBvbG5vYyB8IFZJSSBXeWR6aWFsIEdvc3BvZGFyY3p5IEtyYWpvd2VnbyBSZWplc3RydSBTYWRv d2VnbyAtIEtSUyAxMDE4ODIgfCBOSVAgOTU3LTA3LTUyLTMxNiB8IEthcGl0YWwgemFrbGFkb3d5 IDIwMC4wMDAgUExOLiBTcG9sa2Egb3N3aWFkY3phLCB6ZSBwb3NpYWRhIHN0YXR1cyBkdXplZ28g cHJ6ZWRzaWViaW9yY3kgdyByb3p1bWllbml1IHVzdGF3eSB6IGRuaWEgOCBtYXJjYSAyMDEzIHIu IG8gcHJ6ZWNpd2R6aWFsYW5pdQ0KIG5hZG1pZXJueW0gb3Bvem5pZW5pb20gdyB0cmFuc2FrY2ph Y2ggaGFuZGxvd3ljaC4gVGEgd2lhZG9tb3NjIHdyYXogeiB6YWxhY3puaWthbWkgamVzdCBwcnpl em5hY3pvbmEgZGxhIG9rcmVzbG9uZWdvIGFkcmVzYXRhIGkgbW96ZSB6YXdpZXJhYyBpbmZvcm1h Y2plIHBvdWZuZS4gVyByYXppZSBwcnp5cGFka293ZWdvIG90cnp5bWFuaWEgdGVqIHdpYWRvbW9z Y2ksIHByb3NpbXkgbyBwb3dpYWRvbWllbmllIG5hZGF3Y3kgb3JheiB0cndhbGUgamVqDQogdXN1 bmllY2llOyBqYWtpZWtvbHdpZWsgcHJ6ZWdsYWRhbmllIGx1YiByb3pwb3dzemVjaG5pYW5pZSBq ZXN0IHphYnJvbmlvbmUuIFRoaXMgZS1tYWlsIGFuZCBhbnkgYXR0YWNobWVudHMgbWF5IGNvbnRh aW4gY29uZmlkZW50aWFsIG1hdGVyaWFsIGZvciB0aGUgc29sZSB1c2Ugb2YgdGhlIGludGVuZGVk IHJlY2lwaWVudChzKS4gSWYgeW91IGFyZSBub3QgdGhlIGludGVuZGVkIHJlY2lwaWVudCwgcGxl YXNlIGNvbnRhY3QgdGhlIHNlbmRlciBhbmQNCiBkZWxldGUgYWxsIGNvcGllczsgYW55IHJldmll dyBvciBkaXN0cmlidXRpb24gYnkgb3RoZXJzIGlzIHN0cmljdGx5IHByb2hpYml0ZWQuIA0KPC9w Pg0KPC9ibG9ja3F1b3RlPg0KPC9kaXY+DQo8cD4NCiAgICA8L3A+PGhyPg0KICAgIDxzdHJvbmcg c3R5bGU9ImxpbmUtaGVpZ2h0OiAxMS4yNXB0OyI+DQogICAgICAgIDxzcGFuIHN0eWxlPSJmb250 LXNpemU6IDlwdDsgY29sb3I6ICM1OTU5NTk7Ij4NCiAgICAgICAgICAgIDxzcGFuIHN0eWxlPSJm b250LWZhbWlseTogJ0FyaWFsIE5hcnJvdycsIHNhbnMtc2VyaWY7Ij5JbnRlbCBUZWNobm9sb2d5 IFBvbGFuZCBzcC4geiBvLm8uPGJyPg0KICAgICAgICAgICAgPC9zcGFuPg0KICAgICAgICA8L3Nw YW4+DQogICAgPC9zdHJvbmc+DQogICAgPHNwYW4gc3R5bGU9ImNvbG9yOiM1OTU5NTk7IGZvbnQt ZmFtaWx5OiAnQXJpYWwgTmFycm93Jywgc2Fucy1zZXJpZjsgZm9udC1zaXplOiA5cHQ7IGxpbmUt aGVpZ2h0OiAxMS4yNXB0OyI+DQogICAgICAgIHVsLiBTxYJvd2Fja2llZ28gMTczIHwgODAtMjk4 IEdkYcWEc2sgfCBTxIVkIFJlam9ub3d5IEdkYcWEc2sgUMOzxYJub2MgfCBWSUkgV3lkemlhxYIg R29zcG9kYXJjenkgS3Jham93ZWdvIFJlamVzdHJ1IFPEhWRvd2VnbyAtIEtSUyAxMDE4ODIgfCBO SVAgOTU3LTA3LTUyLTMxNiB8IEthcGl0YcWCIHpha8WCYWRvd3kgMjAwLjAwMCBQTE4uPGJyPg0K ICAgICAgICAgICAgICBTcMOzxYJrYSBvxZt3aWFkY3phLCDFvGUgcG9zaWFkYSBzdGF0dXMgZHXF vGVnbyBwcnplZHNpxJliaW9yY3kgdyByb3p1bWllbml1IHVzdGF3eSB6IGRuaWEgOCBtYXJjYSAy MDEzIHIuIG8gcHJ6ZWNpd2R6aWHFgmFuaXUgbmFkbWllcm55bSBvcMOzxbpuaWVuaW9tIHcgdHJh bnNha2NqYWNoIGhhbmRsb3d5Y2guDQogICAgPC9zcGFuPg0KPHA+PC9wPg0KPHA+DQogICAgPHNw YW4gc3R5bGU9ImZvbnQtc2l6ZTo4LjBwdDsgIGZvbnQtZmFtaWx5OidBcmlhbCBOYXJyb3cnLHNh bnMtc2VyaWY7IG1zby1mYXJlYXN0LWZvbnQtZmFtaWx5OiAnVGltZXMgTmV3IFJvbWFuJzttc28t YmlkaS1mb250LWZhbWlseTpBcmlhbDsgY29sb3I6IzU5NTk1OTsgbXNvLWFuc2ktbGFuZ3VhZ2U6 RU4tVVM7IG1zby1mYXJlYXN0LWxhbmd1YWdlOkVOLVVTOyBtc28tYmlkaS1sYW5ndWFnZTogUEwt UEwiPg0KICAgICAgICBUYSB3aWFkb21vxZvEhyB3cmF6IHogemHFgsSFY3puaWthbWkgamVzdCBw cnplem5hY3pvbmEgZGxhIG9rcmXFm2xvbmVnbyBhZHJlc2F0YSBpIG1vxbxlIHphd2llcmHEhyBp bmZvcm1hY2plIHBvdWZuZS4gVyByYXppZSBwcnp5cGFka293ZWdvIG90cnp5bWFuaWEgdGVqIHdp YWRvbW/Fm2NpLCBwcm9zaW15IG8gcG93aWFkb21pZW5pZSBuYWRhd2N5IG9yYXogdHJ3YcWCZSBq ZWogdXN1bmnEmWNpZTsgamFraWVrb2x3aWVrIHByemVnbMSFZGFuaWUgbHViIHJvenBvd3N6ZWNo bmlhbmllIGplc3QgemFicm9uaW9uZS48YnI+DQogICAgICAgIFRoaXMgZS1tYWlsIGFuZCBhbnkg YXR0YWNobWVudHMgbWF5IGNvbnRhaW4gY29uZmlkZW50aWFsIG1hdGVyaWFsIGZvciB0aGUgc29s ZSB1c2Ugb2YgdGhlIGludGVuZGVkIHJlY2lwaWVudChzKS4gSWYgeW91IGFyZSBub3QgdGhlIGlu dGVuZGVkIHJlY2lwaWVudCwgcGxlYXNlIGNvbnRhY3QgdGhlIHNlbmRlciBhbmQgZGVsZXRlIGFs bCBjb3BpZXM7IGFueSByZXZpZXcgb3IgZGlzdHJpYnV0aW9uIGJ5IG90aGVycyBpcyBzdHJpY3Rs eSBwcm9oaWJpdGVkLg0KICAgIDwvc3Bhbj4NCjwvcD4NCjxwIGNsYXNzPSJNc29Ob3JtYWwiPjwv cD4NCg0KDQoNCiAgICAgICAgPC9ibG9ja3F1b3RlPjxicj4NCiAgICA8L2Rpdj4= --b1_ljd9KvCobRroyMW26tVUtrUfpJvxZg0KtRrm7EVCA-- From nobody Mon Apr 17 22:49:20 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q0j0q3bNPz45JZW; Mon, 17 Apr 2023 22:49:31 +0000 (UTC) (envelope-from freebsd@igalic.co) Received: from mail-40136.proton.ch (mail-40136.proton.ch [185.70.40.136]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q0j0n5jR7z4MMT; Mon, 17 Apr 2023 22:49:29 +0000 (UTC) (envelope-from freebsd@igalic.co) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=igalic.co header.s=protonmail header.b=hOXjaEXS; spf=pass (mx1.freebsd.org: domain of freebsd@igalic.co designates 185.70.40.136 as permitted sender) smtp.mailfrom=freebsd@igalic.co; dmarc=none Date: Mon, 17 Apr 2023 22:49:20 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=igalic.co; s=protonmail; t=1681771765; x=1682030965; bh=9FTLZDd1ubXRSrmsAc/kWdHwe1lbl5Nc+cIxLCqIx3o=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector; b=hOXjaEXSBOBAcyJoTmjv+sTT5bqL2fy0mJs97Y54hoX7nMcmrJ4eGSkjviKbzhB6u APHXyL1jA/FLfuyFgwaGlOJkIz6musPG6UCHg6N+nwfC5/USOGWRyi9mxp+kfrGoJg /dh8kRRHd854/J13t9qacR5BcfX0oz7wotqA5byh+8cSUbcsgl3P8MRCtW62wMbtBw YI4I2vN3azcR2C8Apaa2HlzYEAulW/t7txHogDJcKe3EKb4D1uQ5gWGJ0g9brbrSzZ N7c+aye3ssYB5DfQ+jiSxbnU0jyDGq4udqQ9V0tWbxzOszn/HXjg2STGMvTnXSpPTS VoNfjBnQ2uzhQ== To: "freebsd-cloud@FreeBSD.org" <freebsd-cloud@FreeBSD.org>, "freebsd-infiniband@FreeBSD.org" <freebsd-infiniband@FreeBSD.org> From: =?utf-8?Q?Mina_Gali=C4=87?= <freebsd@igalic.co> Subject: Infiniband at Azure Message-ID: <zoC_l1up0-HvQDtdbAuQ50lt1rZeOr_xttprfXPbn9CpBfTUxFID6MzxKaylULEGSTxO03ONqx4Pj2hsjiyPGYXLF9nQO4uQstMm4sTDh2g=@igalic.co> Feedback-ID: 66573723:user:proton List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-2.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_MIXED_CHARSET(1.00)[subject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; R_DKIM_ALLOW(-0.20)[igalic.co:s=protonmail]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-cloud@FreeBSD.org,freebsd-infiniband@FreeBSD.org]; RCPT_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[igalic.co:+]; DMARC_NA(0.00)[igalic.co]; RWL_MAILSPIKE_POSSIBLE(0.00)[185.70.40.136:from] X-Rspamd-Queue-Id: 4Q0j0n5jR7z4MMT X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N Hi folks! cross-posting because it concerns both topics! recently a cloud-init colleague working on Azure got me access to an Azure HPC instance =E2=80=94 which comes with two Infiniband Nvidia / Mellanox controllers. These show up with ibstat(8), but not under ifconfig(8). Under Linux, WA Agent is responsible for bringing Infiniband devices up to a base-line configuration: https://learn.microsoft.com/en-us/azure/virtual-machines/extensions/enable-= infiniband On FreeBSD, WA Agent is rather poorly supported. So, how do I bring up these mlx5_0 devices? How do i make them show up in ifconfig? And is anyone interested in (me) fixing up WAAgent to work better on FreeBSD? Thank you for your help, Mina Gali=C4=87 Try PkgBase: https://alpha.pkgbase.live/ (as soon as i have a hardware sponsor again) From nobody Tue Apr 18 00:19:23 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q0l0r52GXz45Q0L; Tue, 18 Apr 2023 00:19:40 +0000 (UTC) (envelope-from freebsd@igalic.co) Received: from mail-40136.proton.ch (mail-40136.proton.ch [185.70.40.136]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q0l0p19Hdz3NW5; Tue, 18 Apr 2023 00:19:38 +0000 (UTC) (envelope-from freebsd@igalic.co) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=igalic.co header.s=protonmail header.b=v9tjJsCq; spf=pass (mx1.freebsd.org: domain of freebsd@igalic.co designates 185.70.40.136 as permitted sender) smtp.mailfrom=freebsd@igalic.co; dmarc=none Date: Tue, 18 Apr 2023 00:19:23 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=igalic.co; s=protonmail; t=1681777175; x=1682036375; bh=g/uMAdP8k6o4n6HdWq/1LO9FAKsPTIlCOczOMleme5Q=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector; b=v9tjJsCq2YRW4ON7bCDV2q+PxY6As86Vmkj9thrq7qW/YgUEeUmyoRFf+RBuyiS1A SGJfdCWSsIgi0+1jhZNRo/vDoA0umsNwruyxALq9w8OacphoUxYuZjN3iZ9QwCVQBX G6EoOH2TPDmTJLPEvpJdCY10epPnRHnGohyxJ1hr1Z0412OwhZUHTPwP9Ntm88V0MC JU9jLawsKu/R1lsWpY/cgi6Qz/edb5J7cygPBn1XCBZWlHG+O1E0wIB/UKNMLT+gx2 2avsaQwF3gZ/CV8N0VIEsAFgnXSlCG/Nz0kfU7RGdAfkaT3ByHBlBXVReIvCrGvf5i 5riOVLkVifxHg== To: "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>, "freebsd-infiniband@FreeBSD.org" <freebsd-infiniband@FreeBSD.org> From: =?utf-8?Q?Mina_Gali=C4=87?= <freebsd@igalic.co> Subject: Ifconfig limitations Message-ID: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> Feedback-ID: 66573723:user:proton List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-2.21 / 15.00]; R_MIXED_CHARSET(1.25)[subject]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.956]; R_SPF_ALLOW(-0.20)[+ip4:185.70.40.0/24]; R_DKIM_ALLOW(-0.20)[igalic.co:s=protonmail]; MIME_GOOD(-0.10)[text/plain]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.40.0/24, country:CH]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-infiniband@FreeBSD.org,freebsd-net@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[igalic.co:+]; DMARC_NA(0.00)[igalic.co]; RWL_MAILSPIKE_POSSIBLE(0.00)[185.70.40.136:from] X-Rspamd-Queue-Id: 4Q0l0p19Hdz3NW5 X-Spamd-Bar: -- X-ThisMailContainsUnwantedMimeParts: N Hi folks! I've been working on getting better FreeBSD support into cloud-init. My working thesis has been that all I really need to replicate what cloud-init on Linux is doing with ip addr/ip link and its reading of `/sys/class/net/<device>/*` files is BSD's ifconfig(8) This ifconfig parser is the implementation of that thesis: https://github.com/canonical/cloud-init/blob/main/cloudinit/distros/parsers= /ifconfig.py However, trying to port cloud-init's Infiniband code seems to have falsified my hypothesis. In some cases, it's easily possible to tell if an interface is an Infiniband interface: For example, it'll start with `ib`, or have a GUID as `lladdr`: https://github.com/canonical/cloud-init/pull/2003/files#diff-f143a014d8daaa= 1671a7feef90cc2b3f5c5759e234e5cd3382e438dde3703fd3 but in other cases, such as when the device is in Ethernet mode, it's impossible to tell. It means i would have to parse the highly verbose ibstat(8), then map the Infiniband device name to the ifconfig names and only then can I decide if the devices in ifconfig contain infiniband devices, which ones they are, and what state / mode they are in. (if they even show up in ifconfig to begin with! tho this might be a skill / knowledge issue, see: https://lists.freebsd.org/archives/freeb= sd-infiniband/2023-April/000011.html ) On Linux, cloud-init checks `/sys/net/mce0/type`. If that type is 32, it's infiniband, if it's 1, it's ethernet. We don't seem to have such a thing. Sometimes we have useful groups, but not as many useful groups as OpenBSD does, for instance. So I have determined that on FreeBSD, the absence of groups marks a physical device. But beyond that, there's not much overlap between Infiniband and ifconfig, and that's a real shame. Let's compare that to wlan! the actual wifi devices don't show up in ifconfig, but they can be easily found via `sysctl net.wlan.devices`. Once plumbed in, a wlanX device shows a parent device and belonging to the wlan group. How hard would it be to emulate that behaviour for Infiniband? What tooling do we have right now, that I may have missed? Kind regards, Mina Gali=C4=87 Don't Try *my* PkgBase Repository: https://alpha.pkgbase.live/ =E2=80=94 un= til i have a new hardware sponsor=E2=80=A6 From nobody Tue Apr 18 08:18:12 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q0xdP1x96z44jtD; Tue, 18 Apr 2023 08:18:33 +0000 (UTC) (envelope-from bartosz.sobczak@intel.com) Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "fmsmga103.fm.intel.com", Issuer "Sectigo RSA Organization Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q0xdN4c3Gz46TC; Tue, 18 Apr 2023 08:18:32 +0000 (UTC) (envelope-from bartosz.sobczak@intel.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1681805912; x=1713341912; h=from:to:subject:date:message-id:references:in-reply-to: mime-version:content-transfer-encoding; bh=iXsHKY5duZOa0ZqD9AcCZd6mY8Pz5wE3gqN0bUDeN44=; b=ke1Y3Ej6d072IYKyeD4YqXuU/iZe7KBuqAqz8kcsLSRZUBUxomZNbSU2 oXiVnNkJGsLyM7aDnGqUyKZlad7APkV5vzu4HnwgVj18eA0c8GDCLRSU/ 2HjbDW1r5uDwk/i4JN1paHPss2d0rPs/58Clg+3oT6QVhr7azcYvxvkmW HB/+XmrD50oBOu/rYSwzbJtrYXZSALk4hIobHRIjoLtdBjVwzaPLYTnQx HJOVPyvZ05FTDG/pPTGbmNZzfXb1cVgm5x1bghd/jm1ZpLfCbFKiVZ2Wl GSTEe7IWXwp9eQvxJDE6vE4+cletZF7fXhGOYDXCviJN/dTJAXpmrJjA9 g==; X-IronPort-AV: E=McAfee;i="6600,9927,10683"; a="345106660" X-IronPort-AV: E=Sophos;i="5.99,206,1677571200"; d="scan'208";a="345106660" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 18 Apr 2023 01:18:17 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10683"; a="834784735" X-IronPort-AV: E=Sophos;i="5.99,206,1677571200"; d="scan'208";a="834784735" Received: from orsmsx602.amr.corp.intel.com ([10.22.229.15]) by fmsmga001.fm.intel.com with ESMTP; 18 Apr 2023 01:18:16 -0700 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23; Tue, 18 Apr 2023 01:18:16 -0700 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23; Tue, 18 Apr 2023 01:18:15 -0700 Received: from ORSEDG601.ED.cps.intel.com (10.7.248.6) by orsmsx610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23 via Frontend Transport; Tue, 18 Apr 2023 01:18:15 -0700 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (104.47.56.170) by edgegateway.intel.com (134.134.137.102) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.23; Tue, 18 Apr 2023 01:18:15 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=h+o7fS4/WWJIDVrrwYNDgVckU0C2tgdqvNR3Ivdi3h1qpuZw4D1ReNZ2Qf6VFnUUGbkqDn4FPVFRE3NDY/neb3El8jYoOfdsYXF4Qb3+VoS049IZ56P/gvGnHpkPt60UWeUBXv3pXHoOmvgL+yGH/q61dQ9dXtz+rslI29Hoq/4vQIg1Gump5mZBq1Pnl4gR/iMdNBrYJb+CT+qXQTgP+A80D+VFkwoU8ZqM6xkpPYvNRvUiKPx3PcuxC45K4EvsfkDAyWFTp1RZG30xKL0U6e3yx7o+IMtu576CdHXhPcvNSbzl4PeY0/kSNZLkiJFkQo0bONZ20Wj17j4sZnATWQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=6rxq0nJtZMGBYkkfw4TyKMInxzECqceRX9goi634Ijw=; b=apKi9wsv/Ptw7/91mLU0Y3YUjyYiy1uS/3ZYx1pbnnTaDb52/WCHzs9BpmEVVv1zH4n7kClVJokiK55yh+ZgXb+awPgca0nPfLYLUYPLBRDVJpQV/2j99Qmi/VnCvUdBIFw/g+CddfBvO1EP30bQlIZWpjlPF4oC2UPBsGXWt3hxsYh1WOnGeLkRAjm2sRJKIbRCiG5Q+powUPMux0VeTvJbb6osWAlEwqUkRo+QpwiIDpzCqwbeD0/TC0hgb5+KZO3Lkcve3WnTB+LEMyOWpZ7srUabP09prLazF0i9ETIPrKo3K/MA4N2vLdb6CoPWtBOipMM/BxbjTYj/Ha+Fog== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from BL1PR11MB5301.namprd11.prod.outlook.com (2603:10b6:208:309::9) by IA1PR11MB6217.namprd11.prod.outlook.com (2603:10b6:208:3eb::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6298.45; Tue, 18 Apr 2023 08:18:13 +0000 Received: from BL1PR11MB5301.namprd11.prod.outlook.com ([fe80::86f5:5080:ba0:446b]) by BL1PR11MB5301.namprd11.prod.outlook.com ([fe80::86f5:5080:ba0:446b%7]) with mapi id 15.20.6298.045; Tue, 18 Apr 2023 08:18:13 +0000 From: "Sobczak, Bartosz" <bartosz.sobczak@intel.com> To: =?utf-8?B?TWluYSBHYWxpxIc=?= <freebsd@igalic.co>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>, "freebsd-infiniband@FreeBSD.org" <freebsd-infiniband@FreeBSD.org> Subject: RE: Ifconfig limitations Thread-Topic: Ifconfig limitations Thread-Index: AQHZcYuC073rfQgBD0aB7OBpLQzL068wsbJA Date: Tue, 18 Apr 2023 08:18:12 +0000 Message-ID: <BL1PR11MB5301FD0AE1237C0EC57031FCEF9D9@BL1PR11MB5301.namprd11.prod.outlook.com> References: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> In-Reply-To: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BL1PR11MB5301:EE_|IA1PR11MB6217:EE_ x-ms-office365-filtering-correlation-id: aab4e285-fc5e-430c-4e4b-08db3fe57408 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: QzM5f257fwX/FUE6U6OIyPFuhFu5hEQfye6mWjdszLGbZnouPuaRSqJrGxH0oVLgbmlVQdnib0/Va4Cw4CEOecGD8uXOqjKi2JQVUPzs/ErM3w1FPNFiMMkCaTCNIIaKbCZvv3zn6l0cgIhKtxFDmC1MwkvUrzDEWPi719lxhIY6TNaDAz1JzDKCdbpWVMI7LWqmFpF0eT61Ya1b/yrLPjfPqbX801kp02RMNPGthrF/UuxkGmwofdOu/1I0wkV/tqt3Rq4EJoWDGeQFc6uek4S8vJkOWezhva9kA14l7fTLGQo6czze0lmDxjFZ3j5DBX0jURi95rBPCEFQHjFeKDLTA1OOCMrG8hzwoC58gEKcb26mHQOcbU4obZ6WRk3mCkJz5TQodaR8wUvaxJf6BfWVFWWV8MZPkGCAP5+ATK3CpYWFRhViUcgW7M7C32pV17josGn2msurHx4XX0mPME4tE/IUfPu4v2IE4nG8gva2K7aTX1DBGbwMqKkQSklRGL695x0xnuiM8lJgAQ9AwWi1HltMjc04KWHipqGo1Cc6nQUlU1r2jpNFenmnhjEt8YcSmW6rXtQrAfASIX9j4YK6vgiyf4Fk06mDIZVX23972DUeq08EW442iNOcWaJhxV/XrDh1T6WSoHe68H4k6A== x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:BL1PR11MB5301.namprd11.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230028)(396003)(39860400002)(366004)(136003)(376002)(346002)(451199021)(478600001)(71200400001)(38100700002)(8936002)(8676002)(316002)(82960400001)(41300700001)(55016003)(76116006)(66446008)(66556008)(66946007)(122000001)(110136005)(66476007)(186003)(2906002)(53546011)(38070700005)(26005)(64756008)(9686003)(6506007)(86362001)(83380400001)(33656002)(5660300002)(52536014)(3480700007)(7116003)(966005)(7696005);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?VjFuWWNwRFRieTkvUk1tM2ZPbDBhcmlPVXc4anpVYWNDcW1CVjdrOHBMZXJS?= =?utf-8?B?K3JQUFQxMS9rOGVsd0xaMkx6M3oxeXJZL0FDV2R2UENsOHNlNDdVekJlKzV3?= =?utf-8?B?RkkvYW5NQkk0RjFZSE1tK2dHRmp4NHhuSUFFMDRIeStKK1RMSDQ4N3UxUitx?= =?utf-8?B?SVdtdWZjTjZvcmw4Kzl3eittTlVRZ1pmalFnc0dhS1I1L2hySTA0Rzl5RUp1?= =?utf-8?B?TDU2V3lubU1ES055Q0l5VFM5QkV5b1RZaWNxdUU4ODdROVdDbWVQRGYxNThL?= =?utf-8?B?UHhMbzdaRnJxbEFLc0x0Q3dER3lTS2dpY3dWZ29Bejc3blgzR2NGclFNYjJz?= =?utf-8?B?cURheVRMM240R3dmemROSmNpRG9nU0pxSW9FSTBpTkZKeXlFM3hpOEpVdk9R?= =?utf-8?B?MVVmNkh0MWhLeGRMNWxad0RPdThsb0FBam9BQU9sS0Vob0hPNGk0U3REWU1N?= =?utf-8?B?cUZlWlU5RHVQU3lUYzhBdHdJWVRKdFJJOHdJeHdnUjNkOFA5MDJlcHkzTU5Z?= =?utf-8?B?NmZPdEZsSm9LWnR0eTNGTDdrRDMrQ2hlZ092cjErdDg3bDNMQkc4OGNYQWZl?= =?utf-8?B?UEhnL3VUOWFyNnZuWW1OMnc2VTF4ditXNUJKZkR6MmdxSnJaNE5xOVNHcUtR?= =?utf-8?B?RUJ3NlNvZy9GMkJBMTFtMitkdnNuelFGd2ZtbjlsV1N1NEpVY1NqRFNEdDU4?= =?utf-8?B?Y1Q1dlBKdlFjKzY4UFNqdzh6RkVqRG5EZnlwYit2b3hWSkxDRWJjOVZWdC94?= =?utf-8?B?bERNcGZnckRNeGRxek5NZlVwOXlDbWxvMWxHa1RJUDlZYll5bFM2QlZsRW4z?= =?utf-8?B?QjZLWHAvbGZzcmhwVkl4YjZQUzlqWHNjcm5Pd1A2SFBsdHVBMzFMRzZ1TmZG?= =?utf-8?B?akRhWXAya1FVWXI3WGxaVXFVL0ZpTVU4ejhvU21pdDV2T2xobTdGTmc0SkJ2?= =?utf-8?B?ZWpOdkVtTnBvc24yOUc1TVFESGFQVWRhdXhUT1FrSmQxclU5NnFYaGs2NXN3?= =?utf-8?B?bFpWK29xVC85ajZMZ08yKzNHc2l4ZEtFeSthYkp6ZW1oc25XQTJIVFJia0Fl?= =?utf-8?B?bm5SQ2RDTloybzVadjJ1VUl3RmUxS0tIY3E4ZG1TMHd4T0VhcEtwdDVkVGlm?= =?utf-8?B?Q0FGakgvMXF0endoVHVyeTdhcHNkUjJRNTA3alp4bHQveWJtK1hXSit4Qmx4?= =?utf-8?B?SUVrbXgrQzcvVWE2K3E1aWRwbFFMcHZiZXdwTlNxL2ljdEUvYWZnRlpIcHJL?= =?utf-8?B?UmU5WWI3NWFYdFFucW1qNmJPREJoRGFhcXpoNGJUOTl2aFVaUml2dEVnc2pv?= =?utf-8?B?VTc5SWgrb2pGeENjZkZMMVI1cWRTZGhJUVVHUytIbi82MEYvUnJhNWw1VzVa?= =?utf-8?B?eHoyMUFuTVU4ekdOTW4wcSs5Q0NWWVBoTk01Y3o2M1YyQkNKRlVtVXdhRVlU?= =?utf-8?B?c0ltVEZXdDVoak5SbCtHMlBleHVoMkwybkZaWCs1Tm4xRC93L0w4c29VMW5C?= =?utf-8?B?WDNSeWRqMGNTQ2dFNm5UaSs4dE42NjlZYi9KU0pIdGdCbk9OT09NaHVlbCt4?= =?utf-8?B?NmV0bjFONi9mSk9HZ2RsQ3FqdVdyVXgvQmRLUG5QNkI5Ujk1SWJPV1JDQnU3?= =?utf-8?B?MTIwT1M5aG51U1pTZE56RTREQTZuSnEvbnlJYS9mWFVNd09mdUc5cWx0d1pJ?= =?utf-8?B?aVdUUmJtQ1NOVm1rRXNSb0RRNWpKNUxYQ0kzV1BocUNwdHA1aDg3Q1UvNS9L?= =?utf-8?B?Q0xCMHJaRnNZektPR0RCL1RPWGFGSzBBdllDbjczM2lRekp2OFVMazNkMUJp?= =?utf-8?B?MFJXaXNlZ2hKVDFsY1l1SWFkcE5nZ1owM3dXNGtlQisxMHMvank2S3YyTkpE?= =?utf-8?B?by9rMC9sY2pVRG5oaWRLQk42U2kxTFlzbzFNU05RMGpLN0VYUTFkL2FaU2xW?= =?utf-8?B?WHR0OHhtaEV2TjZrUUNBZHN2M3dsTW1ZZWd0WkNyQ0l6OEdVLzRkZWE5Tm5K?= =?utf-8?B?OTRxbnZJZzZkN1ZMR3U5TjFBVTV1R3R2dFdzVlowdXFQTkt6c3VudzRiaW5L?= =?utf-8?B?U1M3eEZkdHhCQmFnZlVCam1rczF1ZDBDTDdCTDZUWVJwakpvajZRb1Uxczkz?= =?utf-8?Q?ksXedUAWle6zuaSC6iHwh2tYg?= Content-Type: text/plain; charset="utf-8" List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BL1PR11MB5301.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: aab4e285-fc5e-430c-4e4b-08db3fe57408 X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Apr 2023 08:18:12.9475 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: UoBINBPl2+noAmG5P8veBOOFn3QbGohQgyA1/dCY6AT3mR0/2AJO/fHJFXWgcg/PicMUGia2SxYXxokSC2bOZjlZD6WLWKykvBHZvFYE4vQ= X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR11MB6217 X-OriginatorOrg: intel.com Content-Transfer-Encoding: base64 X-Rspamd-Queue-Id: 4Q0xdN4c3Gz46TC X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:4983, ipnet:192.55.52.0/24, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N SGkgTWluYSENCg0KSG93IGFib3V0IHVzaW5nIGp1c3QgaWJ2X2RldmljZXMgYW5kL29yIGlidl9k ZXZpbmZvPw0KDQpPbiB0aGUgb3RoZXIgaGFuZCwgaWYgeW91IGFyZSBvbmx5IGFmdGVyIFJvQ0Ug ZGV2aWNlcyAodGhvdWdoIHRoZXJlIGFyZSBhbHNvIGRldmljZXMgdGhhdCBzdXBwb3J0IGl3YXJw LCBvciBib3RoIGl3YXJwIGFuZCByb2NlKSwgeW91IG1heSBwcm9iYWJseSBtYXAgaWIgZGV2aWNl IHdpdGggaWZjb25maWcgZGV2aWNlIHVzaW5nIHN5c2N0bDoNCg0Kc3lzLmNsYXNzLmluZmluaWJh bmQue2liX2RldmljZX0ucG9ydHMuMS5naWRfYXR0cnMubmRldnMue2lkfToge2lmX25hbWV9DQoN CkZvciBJbnRlbCBFODEwIGNhcmQgaXQgbG9va3MgbGlrZSB0aGlzOg0Kc3lzY3RsIHN5cy5jbGFz cy5pbmZpbmliYW5kIHwgZ3JlcCBuZGV2DQpzeXMuY2xhc3MuaW5maW5pYmFuZC5pcmRtYS1pY2Uw LnBvcnRzLjEuZ2lkX2F0dHJzLm5kZXZzLjI6IGljZTANCnN5cy5jbGFzcy5pbmZpbmliYW5kLmly ZG1hLWljZTAucG9ydHMuMS5naWRfYXR0cnMubmRldnMuMTogaWNlMA0Kc3lzLmNsYXNzLmluZmlu aWJhbmQuaXJkbWEtaWNlMC5wb3J0cy4xLmdpZF9hdHRycy5uZGV2cy4wOiBpY2UwDQpJIGJlbGll dmUgZm9yIG1seDUgZGV2aWNlcyBpdCBzaG91bGQgd29yayB0aGUgc2FtZS4NCg0KTm90ZToNCkl0 IGRvZXMgbm90IHdvcmsgZm9yIEU4MTAgaW4gaXdhcnAgbW9kZS4gVGhlcmUgYXJlIDIgb3RoZXIg b3B0aW9ucyB0aGVuOg0KMSkgaWJfZGV2aWNlIG5hbWUgZm9yIGU4MTAgY29udGFpbnMgdGhlIGlm IG5hbWUgLSBpcmRtYS1pY2UwLCB3aGVyZSAnaXJkbWEnIHN0YW5kcyBmb3IgdGhlIGRyaXZlciwg YW5kIGljZTAgaXMgdGhlIGludGVyZmFjZSBuYW1lDQoyKSBpYnZfZGV2aWNlcyByZXR1cm4gbm9k ZSBHVUlEIHdoaWNoIGNvdWxkIGJlIGNvbnZlcnRlZCBiYWNrIHRvIG1hYyBhZGRyZXNzOiAgIHd3 Onl5Onp6OmZmOmZlOnNzOnR0OnV1IC0+ICh3d14weDAyKTp5eTp6ejpzczp0dDp1dSwgbWx4IG1p Z2h0IGhhdmUgZGlmZmVyZW50IHR5cGUgb2YgY29udmVyc2lvbi4NCg0KSG9wZSB0aGlzIGlzIGFj Y3VyYXRlIGFuZCBoZWxwcy4NCg0KQmFydGVrDQoNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0t DQpGcm9tOiBvd25lci1mcmVlYnNkLWluZmluaWJhbmRAZnJlZWJzZC5vcmcgPG93bmVyLWZyZWVi c2QtaW5maW5pYmFuZEBmcmVlYnNkLm9yZz4gT24gQmVoYWxmIE9mIE1pbmEgR2FsacSHDQpTZW50 OiBUdWVzZGF5LCBBcHJpbCAxOCwgMjAyMyAwMjoxOQ0KVG86IGZyZWVic2QtbmV0QGZyZWVic2Qu b3JnOyBmcmVlYnNkLWluZmluaWJhbmRARnJlZUJTRC5vcmcNClN1YmplY3Q6IElmY29uZmlnIGxp bWl0YXRpb25zDQoNCkhpIGZvbGtzIQ0KDQpJJ3ZlIGJlZW4gd29ya2luZyBvbiBnZXR0aW5nIGJl dHRlciBGcmVlQlNEIHN1cHBvcnQgaW50byBjbG91ZC1pbml0Lg0KTXkgd29ya2luZyB0aGVzaXMg aGFzIGJlZW4gdGhhdCBhbGwgSSByZWFsbHkgbmVlZCB0byByZXBsaWNhdGUgd2hhdCBjbG91ZC1p bml0IG9uIExpbnV4IGlzIGRvaW5nIHdpdGggaXAgYWRkci9pcCBsaW5rIGFuZCBpdHMgcmVhZGlu ZyBvZiBgL3N5cy9jbGFzcy9uZXQvPGRldmljZT4vKmAgZmlsZXMgaXMgQlNEJ3MgaWZjb25maWco OCkNCg0KVGhpcyBpZmNvbmZpZyBwYXJzZXIgaXMgdGhlIGltcGxlbWVudGF0aW9uIG9mIHRoYXQg dGhlc2lzOg0KaHR0cHM6Ly9naXRodWIuY29tL2Nhbm9uaWNhbC9jbG91ZC1pbml0L2Jsb2IvbWFp bi9jbG91ZGluaXQvZGlzdHJvcy9wYXJzZXJzL2lmY29uZmlnLnB5DQoNCkhvd2V2ZXIsIHRyeWlu ZyB0byBwb3J0IGNsb3VkLWluaXQncyBJbmZpbmliYW5kIGNvZGUgc2VlbXMgdG8gaGF2ZSBmYWxz aWZpZWQgbXkgaHlwb3RoZXNpcy4NCg0KSW4gc29tZSBjYXNlcywgaXQncyBlYXNpbHkgcG9zc2li bGUgdG8gdGVsbCBpZiBhbiBpbnRlcmZhY2UgaXMgYW4gSW5maW5pYmFuZCBpbnRlcmZhY2U6IEZv ciBleGFtcGxlLCBpdCdsbCBzdGFydCB3aXRoIGBpYmAsIG9yIGhhdmUgYSBHVUlEIGFzIGBsbGFk ZHJgOg0KDQpodHRwczovL2dpdGh1Yi5jb20vY2Fub25pY2FsL2Nsb3VkLWluaXQvcHVsbC8yMDAz L2ZpbGVzI2RpZmYtZjE0M2EwMTRkOGRhYWExNjcxYTdmZWVmOTBjYzJiM2Y1YzU3NTllMjM0ZTVj ZDMzODJlNDM4ZGRlMzcwM2ZkMw0KDQpidXQgaW4gb3RoZXIgY2FzZXMsIHN1Y2ggYXMgd2hlbiB0 aGUgZGV2aWNlIGlzIGluIEV0aGVybmV0IG1vZGUsIGl0J3MgaW1wb3NzaWJsZSB0byB0ZWxsLg0K DQpJdCBtZWFucyBpIHdvdWxkIGhhdmUgdG8gcGFyc2UgdGhlIGhpZ2hseSB2ZXJib3NlIGlic3Rh dCg4KSwgdGhlbiBtYXAgdGhlIEluZmluaWJhbmQgZGV2aWNlIG5hbWUgdG8gdGhlIGlmY29uZmln IG5hbWVzIGFuZCBvbmx5IHRoZW4gY2FuIEkgZGVjaWRlIGlmIHRoZSBkZXZpY2VzIGluIGlmY29u ZmlnIGNvbnRhaW4gaW5maW5pYmFuZCBkZXZpY2VzLCB3aGljaCBvbmVzIHRoZXkgYXJlLCBhbmQg d2hhdCBzdGF0ZSAvIG1vZGUgdGhleSBhcmUgaW4uDQoNCihpZiB0aGV5IGV2ZW4gc2hvdyB1cCBp biBpZmNvbmZpZyB0byBiZWdpbiB3aXRoISB0aG8gdGhpcyBtaWdodCBiZSBhIHNraWxsIC8ga25v d2xlZGdlIGlzc3VlLCBzZWU6IGh0dHBzOi8vbGlzdHMuZnJlZWJzZC5vcmcvYXJjaGl2ZXMvZnJl ZWJzZC1pbmZpbmliYW5kLzIwMjMtQXByaWwvMDAwMDExLmh0bWwgKQ0KDQpPbiBMaW51eCwgY2xv dWQtaW5pdCBjaGVja3MgYC9zeXMvbmV0L21jZTAvdHlwZWAuDQpJZiB0aGF0IHR5cGUgaXMgMzIs IGl0J3MgaW5maW5pYmFuZCwgaWYgaXQncyAxLCBpdCdzIGV0aGVybmV0Lg0KDQpXZSBkb24ndCBz ZWVtIHRvIGhhdmUgc3VjaCBhIHRoaW5nLg0KU29tZXRpbWVzIHdlIGhhdmUgdXNlZnVsIGdyb3Vw cywgYnV0IG5vdCBhcyBtYW55IHVzZWZ1bCBncm91cHMgYXMgT3BlbkJTRCBkb2VzLCBmb3IgaW5z dGFuY2UuIFNvIEkgaGF2ZSBkZXRlcm1pbmVkIHRoYXQgb24gRnJlZUJTRCwgdGhlIGFic2VuY2Ug b2YgZ3JvdXBzIG1hcmtzIGEgcGh5c2ljYWwgZGV2aWNlLg0KDQpCdXQgYmV5b25kIHRoYXQsIHRo ZXJlJ3Mgbm90IG11Y2ggb3ZlcmxhcCBiZXR3ZWVuIEluZmluaWJhbmQgYW5kIGlmY29uZmlnLCBh bmQgdGhhdCdzIGEgcmVhbCBzaGFtZS4NCg0KTGV0J3MgY29tcGFyZSB0aGF0IHRvIHdsYW4hDQp0 aGUgYWN0dWFsIHdpZmkgZGV2aWNlcyBkb24ndCBzaG93IHVwIGluIGlmY29uZmlnLCBidXQgdGhl eSBjYW4gYmUgZWFzaWx5IGZvdW5kIHZpYSBgc3lzY3RsIG5ldC53bGFuLmRldmljZXNgLg0KT25j ZSBwbHVtYmVkIGluLCBhIHdsYW5YIGRldmljZSBzaG93cyBhIHBhcmVudCBkZXZpY2UgYW5kIGJl bG9uZ2luZyB0byB0aGUgd2xhbiBncm91cC4NCg0KSG93IGhhcmQgd291bGQgaXQgYmUgdG8gZW11 bGF0ZSB0aGF0IGJlaGF2aW91ciBmb3IgSW5maW5pYmFuZD8NCldoYXQgdG9vbGluZyBkbyB3ZSBo YXZlIHJpZ2h0IG5vdywgdGhhdCBJIG1heSBoYXZlIG1pc3NlZD8NCg0KS2luZCByZWdhcmRzLA0K DQpNaW5hIEdhbGnEhw0KRG9uJ3QgVHJ5ICpteSogUGtnQmFzZSBSZXBvc2l0b3J5OiBodHRwczov L2FscGhhLnBrZ2Jhc2UubGl2ZS8g4oCUIHVudGlsIGkgaGF2ZSBhIG5ldyBoYXJkd2FyZSBzcG9u c29y4oCmDQoNCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLQpJbnRlbCBUZWNobm9sb2d5IFBvbGFuZCBzcC4geiBvLm8u CnVsLiBTbG93YWNraWVnbyAxNzMgfCA4MC0yOTggR2RhbnNrIHwgU2FkIFJlam9ub3d5IEdkYW5z ayBQb2xub2MgfCBWSUkgV3lkemlhbCBHb3Nwb2RhcmN6eSBLcmFqb3dlZ28gUmVqZXN0cnUgU2Fk b3dlZ28gLSBLUlMgMTAxODgyIHwgTklQIDk1Ny0wNy01Mi0zMTYgfCBLYXBpdGFsIHpha2xhZG93 eSAyMDAuMDAwIFBMTi4KU3BvbGthIG9zd2lhZGN6YSwgemUgcG9zaWFkYSBzdGF0dXMgZHV6ZWdv IHByemVkc2llYmlvcmN5IHcgcm96dW1pZW5pdSB1c3Rhd3kgeiBkbmlhIDggbWFyY2EgMjAxMyBy LiBvIHByemVjaXdkemlhbGFuaXUgbmFkbWllcm55bSBvcG96bmllbmlvbSB3IHRyYW5zYWtjamFj aCBoYW5kbG93eWNoLgoKVGEgd2lhZG9tb3NjIHdyYXogeiB6YWxhY3puaWthbWkgamVzdCBwcnpl em5hY3pvbmEgZGxhIG9rcmVzbG9uZWdvIGFkcmVzYXRhIGkgbW96ZSB6YXdpZXJhYyBpbmZvcm1h Y2plIHBvdWZuZS4gVyByYXppZSBwcnp5cGFka293ZWdvIG90cnp5bWFuaWEgdGVqIHdpYWRvbW9z Y2ksIHByb3NpbXkgbyBwb3dpYWRvbWllbmllIG5hZGF3Y3kgb3JheiB0cndhbGUgamVqIHVzdW5p ZWNpZTsgamFraWVrb2x3aWVrIHByemVnbGFkYW5pZSBsdWIgcm96cG93c3plY2huaWFuaWUgamVz dCB6YWJyb25pb25lLgpUaGlzIGUtbWFpbCBhbmQgYW55IGF0dGFjaG1lbnRzIG1heSBjb250YWlu IGNvbmZpZGVudGlhbCBtYXRlcmlhbCBmb3IgdGhlIHNvbGUgdXNlIG9mIHRoZSBpbnRlbmRlZCBy ZWNpcGllbnQocykuIElmIHlvdSBhcmUgbm90IHRoZSBpbnRlbmRlZCByZWNpcGllbnQsIHBsZWFz ZSBjb250YWN0IHRoZSBzZW5kZXIgYW5kIGRlbGV0ZSBhbGwgY29waWVzOyBhbnkgcmV2aWV3IG9y IGRpc3RyaWJ1dGlvbiBieSBvdGhlcnMgaXMgc3RyaWN0bHkgcHJvaGliaXRlZC4K From nobody Tue Apr 18 09:14:17 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q0yst0X9Dz44nKL; Tue, 18 Apr 2023 09:14:26 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [IPv6:2a01:4f8:c17:6c4b::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q0yss5Xp9z3CWh; Tue, 18 Apr 2023 09:14:24 +0000 (UTC) (envelope-from hps@selasky.org) Authentication-Results: mx1.freebsd.org; none Received: from [10.36.2.154] (unknown [46.212.121.255]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 580D72623A7; Tue, 18 Apr 2023 11:14:17 +0200 (CEST) Message-ID: <9c1e9474-e9e3-3adc-4d81-77de04d5f7d1@selasky.org> Date: Tue, 18 Apr 2023 11:14:17 +0200 List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 Subject: Re: Infiniband at Azure To: =?UTF-8?Q?Mina_Gali=c4=87?= <freebsd@igalic.co>, "freebsd-cloud@FreeBSD.org" <freebsd-cloud@FreeBSD.org>, "freebsd-infiniband@FreeBSD.org" <freebsd-infiniband@FreeBSD.org> References: <zoC_l1up0-HvQDtdbAuQ50lt1rZeOr_xttprfXPbn9CpBfTUxFID6MzxKaylULEGSTxO03ONqx4Pj2hsjiyPGYXLF9nQO4uQstMm4sTDh2g=@igalic.co> Content-Language: en-US From: Hans Petter Selasky <hps@selasky.org> In-Reply-To: <zoC_l1up0-HvQDtdbAuQ50lt1rZeOr_xttprfXPbn9CpBfTUxFID6MzxKaylULEGSTxO03ONqx4Pj2hsjiyPGYXLF9nQO4uQstMm4sTDh2g=@igalic.co> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Q0yss5Xp9z3CWh X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 4/18/23 00:49, Mina Galić wrote: > Hi folks! > > cross-posting because it concerns both topics! > > recently a cloud-init colleague working on Azure got me access to > an Azure HPC instance — which comes with two Infiniband Nvidia / > Mellanox controllers. > > These show up with ibstat(8), but not under ifconfig(8). > > Under Linux, WA Agent is responsible for bringing Infiniband devices > up to a base-line configuration: > https://learn.microsoft.com/en-us/azure/virtual-machines/extensions/enable-infiniband > > On FreeBSD, WA Agent is rather poorly supported. > > So, how do I bring up these mlx5_0 devices? How do i make them show > up in ifconfig? And is anyone interested in (me) fixing up WAAgent > to work better on FreeBSD? > > > Thank you for your help, > Hi, kldload ipoib Should do the trick! --HPS From nobody Tue Apr 18 09:32:26 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q0zGp2p3zz44ph2; Tue, 18 Apr 2023 09:32:34 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q0zGn4gZ8z41kt; Tue, 18 Apr 2023 09:32:33 +0000 (UTC) (envelope-from hps@selasky.org) Authentication-Results: mx1.freebsd.org; none Received: from [10.36.2.154] (unknown [46.212.121.255]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id E2E56262417; Tue, 18 Apr 2023 11:32:25 +0200 (CEST) Message-ID: <fff88b1b-8d61-3941-78a1-cfe9b24bad9f@selasky.org> Date: Tue, 18 Apr 2023 11:32:26 +0200 List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 Subject: Re: Ifconfig limitations Content-Language: en-US To: =?UTF-8?Q?Mina_Gali=c4=87?= <freebsd@igalic.co>, "freebsd-net@freebsd.org" <freebsd-net@freebsd.org>, "freebsd-infiniband@FreeBSD.org" <freebsd-infiniband@FreeBSD.org> References: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> From: Hans Petter Selasky <hps@selasky.org> In-Reply-To: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Q0zGn4gZ8z41kt X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N Hi, All the `/sys/class/net/<device>/*` entries are sysctl(8) entries, like Sobczak, pointed out. They are converted simply by replacing "/" with ".", and there are some helper functions in: contrib/ofed/libibumad/sysfs.c: if (sysctlbyname(PATH_TO_SYS(path), str, &len, NULL, 0) == -1) To do this conversion automagically. you specify the Linux equivalent as a "const char *" pointer, and then it looks up the value for you under FreeBSD. We may not have all the entries, but most you need is there, and some additions specific to FreeBSD. --HPS From nobody Tue Apr 18 09:44:16 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q0zXc6p7Yz44qjY for <freebsd-infiniband@mlmmj.nyi.freebsd.org>; Tue, 18 Apr 2023 09:44:32 +0000 (UTC) (envelope-from freebsd@igalic.co) Received: from mail-4317.proton.ch (mail-4317.proton.ch [185.70.43.17]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q0zXc1Ngrz4JWK for <freebsd-infiniband@FreeBSD.org>; Tue, 18 Apr 2023 09:44:32 +0000 (UTC) (envelope-from freebsd@igalic.co) Authentication-Results: mx1.freebsd.org; none Date: Tue, 18 Apr 2023 09:44:16 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=igalic.co; s=protonmail; t=1681811068; x=1682070268; bh=7uygYHIQvCgOtHJtMrLSeMw87IoY1Wsy0B5YcCKmGwo=; h=Date:To:From:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=tHbKsc324INgyrkbsMeE94oWYpYMkbp/3bKUi0Z2/uSPzguI9AdBGRhqQAAkg6LHr I8azXmNCiGPWw4/H2ZoODVczer8O+v6A+Mby0EA2wBVVo1mvRs/M927GG+bjzWONzT 7vZb5nTnlf7TELyQHD2DFn7OwvXjHQIXKc648ufEERHvDa0A3HI/4y3HmBumXAgO2d JZCb2KZa7mCGRNytxzFT0WuOGWNpwgMZZ7JS3jr4GQq0rtP1DaMujF3K1Wi0UEroHg I6WtvWfSTxoN4qOuOwx8eC8nb5yFG71pAv3mKmkPF4RPm4+AppKyzom3SuL+WwZYH8 5lh1CBAXB/B7g== To: hps@selasky.org, freebsd-net@freebsd.org, freebsd-infiniband@FreeBSD.org From: =?utf-8?Q?Mina_Gali=C4=87?= <freebsd@igalic.co> Subject: Re: Ifconfig limitations Message-ID: <fhp1gy5B7PavSt8LECZHjJyr_8yTa1e9iDID-bLO0iTxV9Jj8EX2Hlrok1kq_v0CC2KUVI36Nn4hfh7jHT9k3gN2f7z2WEtDsyDDqde0oDM=@igalic.co> In-Reply-To: <fff88b1b-8d61-3941-78a1-cfe9b24bad9f@selasky.org> References: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> <fff88b1b-8d61-3941-78a1-cfe9b24bad9f@selasky.org> Feedback-ID: 66573723:user:proton List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="b1_YbIu8UluALq4hAj0pJiRzoZoupm6Pv5wEIfp9cgKiE" X-Rspamd-Queue-Id: 4Q0zXc1Ngrz4JWK X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N This is a multi-part message in MIME format. --b1_YbIu8UluALq4hAj0pJiRzoZoupm6Pv5wEIfp9cgKiE Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 SGkgSFBTLAoKaSBkb24ndCBzZWUgdGhvc2Ugc3lzY3RsIGVudHJpZXMgZm9yIHJlZ3VsYXIgZGV2 aWNlcz8KaXMgdGhpcyBpbmZpbmliYW5kIHNwZWNpZmljPwpvciBpcyB0aGVyZSBhbnl0aGluZyBJ IG5lZWQgdG8gZW5hYmxlIHRvIGdldCB0aGVzZSBzeXNjdGxzPwoKS2luZCByZWdhcmRzLAoKTWlu YQotLS0tLS0tLSBPcmlnaW5hbCBNZXNzYWdlIC0tLS0tLS0tCk9uIDE4IEFwciAyMDIzLCAxMDoz MiwgSGFucyBQZXR0ZXIgU2VsYXNreSB3cm90ZToKCj4gSGksIEFsbCB0aGUgYC9zeXMvY2xhc3Mv bmV0Ly8qYCBlbnRyaWVzIGFyZSBzeXNjdGwoOCkgZW50cmllcywgbGlrZSBTb2JjemFrLCBwb2lu dGVkIG91dC4gVGhleSBhcmUgY29udmVydGVkIHNpbXBseSBieSByZXBsYWNpbmcgIi8iIHdpdGgg Ii4iLCBhbmQgdGhlcmUgYXJlIHNvbWUgaGVscGVyIGZ1bmN0aW9ucyBpbjogY29udHJpYi9vZmVk L2xpYmlidW1hZC9zeXNmcy5jOiBpZiAoc3lzY3RsYnluYW1lKFBBVEhfVE9fU1lTKHBhdGgpLCBz dHIsICZsZW4sIE5VTEwsIDApID09IC0xKSBUbyBkbyB0aGlzIGNvbnZlcnNpb24gYXV0b21hZ2lj YWxseS4geW91IHNwZWNpZnkgdGhlIExpbnV4IGVxdWl2YWxlbnQgYXMgYSAiY29uc3QgY2hhciAq IiBwb2ludGVyLCBhbmQgdGhlbiBpdCBsb29rcyB1cCB0aGUgdmFsdWUgZm9yIHlvdSB1bmRlciBG cmVlQlNELiBXZSBtYXkgbm90IGhhdmUgYWxsIHRoZSBlbnRyaWVzLCBidXQgbW9zdCB5b3UgbmVl ZCBpcyB0aGVyZSwgYW5kIHNvbWUgYWRkaXRpb25zIHNwZWNpZmljIHRvIEZyZWVCU0QuIC0tSFBT --b1_YbIu8UluALq4hAj0pJiRzoZoupm6Pv5wEIfp9cgKiE Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 SGkgSFBTLDxicj48YnI+aSBkb24ndCBzZWUgdGhvc2Ugc3lzY3RsIGVudHJpZXMgZm9yIHJlZ3Vs YXIgZGV2aWNlcz88YnI+aXMgdGhpcyBpbmZpbmliYW5kIHNwZWNpZmljPzxicj5vciBpcyB0aGVy ZSBhbnl0aGluZyBJIG5lZWQgdG8gZW5hYmxlIHRvIGdldCB0aGVzZSBzeXNjdGxzPzxicj48YnI+ S2luZCByZWdhcmRzLDxicj48YnI+PGJyPk1pbmE8YnI+LS0tLS0tLS0gT3JpZ2luYWwgTWVzc2Fn ZSAtLS0tLS0tLTxicj5PbiAxOCBBcHIgMjAyMywgMTA6MzIsIEhhbnMgUGV0dGVyIFNlbGFza3kg PCBocHNAc2VsYXNreS5vcmc+IHdyb3RlOjxibG9ja3F1b3RlIGNsYXNzPSJwcm90b25tYWlsX3F1 b3RlIj48YnI+SGksDQoNCkFsbCB0aGUgYC9zeXMvY2xhc3MvbmV0LzxkZXZpY2U+LypgIGVudHJp ZXMgYXJlIHN5c2N0bCg4KSBlbnRyaWVzLCBsaWtlDQpTb2JjemFrLCBwb2ludGVkIG91dC4gVGhl eSBhcmUgY29udmVydGVkIHNpbXBseSBieSByZXBsYWNpbmcgIi8iIHdpdGgNCiIuIiwgYW5kIHRo ZXJlIGFyZSBzb21lIGhlbHBlciBmdW5jdGlvbnMgaW46DQoNCmNvbnRyaWIvb2ZlZC9saWJpYnVt YWQvc3lzZnMuYzoJaWYgKHN5c2N0bGJ5bmFtZShQQVRIX1RPX1NZUyhwYXRoKSwgc3RyLA0KJmxl biwgTlVMTCwgMCkgPT0gLTEpDQoNClRvIGRvIHRoaXMgY29udmVyc2lvbiBhdXRvbWFnaWNhbGx5 LiB5b3Ugc3BlY2lmeSB0aGUgTGludXggZXF1aXZhbGVudCBhcw0KYSAiY29uc3QgY2hhciAqIiBw b2ludGVyLCBhbmQgdGhlbiBpdCBsb29rcyB1cCB0aGUgdmFsdWUgZm9yIHlvdSB1bmRlcg0KRnJl ZUJTRC4NCg0KV2UgbWF5IG5vdCBoYXZlIGFsbCB0aGUgZW50cmllcywgYnV0IG1vc3QgeW91IG5l ZWQgaXMgdGhlcmUsIGFuZCBzb21lDQphZGRpdGlvbnMgc3BlY2lmaWMgdG8gRnJlZUJTRC4NCg0K LS1IUFMNCjwvZGl2Pg== --b1_YbIu8UluALq4hAj0pJiRzoZoupm6Pv5wEIfp9cgKiE-- From nobody Tue Apr 18 10:04:09 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q0zzJ1XHvz44rwG; Tue, 18 Apr 2023 10:04:12 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q0zzH6hHrz3pGY; Tue, 18 Apr 2023 10:04:11 +0000 (UTC) (envelope-from hps@selasky.org) Authentication-Results: mx1.freebsd.org; none Received: from [10.36.2.154] (unknown [46.212.121.255]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id 3FB85260984; Tue, 18 Apr 2023 12:04:09 +0200 (CEST) Message-ID: <2c7b7432-f7ae-67e0-87a4-e556a26d981b@selasky.org> Date: Tue, 18 Apr 2023 12:04:09 +0200 List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 Subject: Re: Ifconfig limitations To: =?UTF-8?Q?Mina_Gali=c4=87?= <freebsd@igalic.co>, freebsd-net@freebsd.org, freebsd-infiniband@FreeBSD.org References: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> <fff88b1b-8d61-3941-78a1-cfe9b24bad9f@selasky.org> <fhp1gy5B7PavSt8LECZHjJyr_8yTa1e9iDID-bLO0iTxV9Jj8EX2Hlrok1kq_v0CC2KUVI36Nn4hfh7jHT9k3gN2f7z2WEtDsyDDqde0oDM=@igalic.co> Content-Language: en-US From: Hans Petter Selasky <hps@selasky.org> In-Reply-To: <fhp1gy5B7PavSt8LECZHjJyr_8yTa1e9iDID-bLO0iTxV9Jj8EX2Hlrok1kq_v0CC2KUVI36Nn4hfh7jHT9k3gN2f7z2WEtDsyDDqde0oDM=@igalic.co> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Q0zzH6hHrz3pGY X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 4/18/23 11:44, Mina Galić wrote: > Hi HPS, > > i don't see those sysctl entries for regular devices? > is this infiniband specific? > or is there anything I need to enable to get these sysctls? > > Kind regards, > Hi, The sysctl entries you are referring to are created by ibcore.ko . Unless the network card attaches to those API's like mlx5ib, no such entries exist. In upstream FreeBSD there is no software infiniband or RoCE support. --HPS From nobody Tue Apr 18 22:19:30 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q1JHx5h0vz45lsF; Tue, 18 Apr 2023 22:19:41 +0000 (UTC) (envelope-from freebsd@igalic.co) Received: from mail-4323.proton.ch (mail-4323.proton.ch [185.70.43.23]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q1JHw6WJ7z3rxX; Tue, 18 Apr 2023 22:19:40 +0000 (UTC) (envelope-from freebsd@igalic.co) Authentication-Results: mx1.freebsd.org; none Date: Tue, 18 Apr 2023 22:19:30 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=igalic.co; s=protonmail; t=1681856377; x=1682115577; bh=1rUd5nx8okNNtm5Hg5ICpC9uB9F19tzz+GsEGQSqT2o=; h=Date:To:From:Cc:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=WHkAWQr16VlPv2EA54zLR7auBWmCu3BrUfU06ZbDOokOO7LGF3aGhCaar33xipoQQ Rf3aj8yjugdNp6lcXcn6+Gpsbl7w3QtWyYo1SxP0vaQV7qkpEkyGNg4osZXd7/l3tL +hOPM+OCi2Y+PGZPmWePViXjvq+n5dWP1lOA8nE+fBxG8zRRaXq58DWVtoKt4t+0vX aTlhbJrff0yDFzcc9ZU35Oo1ZJWLTYcrtfo57Ggvc2W5hjitIDDJzsn4VQDq9ZcKT5 p6oLVa6/t3zxALBXx0kSH0r2lghVOxs1/ajse0sqRmBv1XziV4GOsyqrAQJoUUbETz e00pb4SYV8lbA== To: Hans Petter Selasky <hps@selasky.org> From: =?utf-8?Q?Mina_Gali=C4=87?= <freebsd@igalic.co> Cc: freebsd-net@freebsd.org, freebsd-infiniband@FreeBSD.org Subject: Re: Ifconfig limitations Message-ID: <yBUBIvQHx9Q8kcYn1QqMMOOZf2RstZLqYepRZw43jApzvlryqV8EI-5uyNh-oFsd2b4pUpwfBL78LqkJhl_Mdup0MsCLb-w7nzzBKHMsTdU=@igalic.co> In-Reply-To: <2c7b7432-f7ae-67e0-87a4-e556a26d981b@selasky.org> References: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> <fff88b1b-8d61-3941-78a1-cfe9b24bad9f@selasky.org> <fhp1gy5B7PavSt8LECZHjJyr_8yTa1e9iDID-bLO0iTxV9Jj8EX2Hlrok1kq_v0CC2KUVI36Nn4hfh7jHT9k3gN2f7z2WEtDsyDDqde0oDM=@igalic.co> <2c7b7432-f7ae-67e0-87a4-e556a26d981b@selasky.org> Feedback-ID: 66573723:user:proton List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4Q1JHw6WJ7z3rxX X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N > On 4/18/23 11:44, Mina Gali=C4=87 wrote: >=20 > > Hi HPS, > >=20 > > i don't see those sysctl entries for regular devices? > > is this infiniband specific? > > or is there anything I need to enable to get these sysctls? > >=20 > > Kind regards, >=20 >=20 > Hi, Hi > The sysctl entries you are referring to are created by ibcore.ko . > Unless the network card attaches to those API's > like mlx5ib, no such entries exist. Do you know how the sysctl entries interact with renaming an interface? I know that the dev. hierarchy is perfectly ignorant of renames. > In upstream FreeBSD there is no software infiniband or RoCE support. I'm not sure I know what that means. (aside from being quite ignorant of In= finiband and its modes) Does that mean that only special vendor supplied drivers and or software wo= uld expose that functionality? > --HPS Kind regards, Mina From nobody Wed Apr 19 09:12:17 2023 X-Original-To: freebsd-infiniband@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Q1Zn03pshz45D24; Wed, 19 Apr 2023 09:12:20 +0000 (UTC) (envelope-from hps@selasky.org) Received: from mail.turbocat.net (turbocat.net [88.99.82.50]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Q1Zmz5hBMz3C8x; Wed, 19 Apr 2023 09:12:19 +0000 (UTC) (envelope-from hps@selasky.org) Authentication-Results: mx1.freebsd.org; none Received: from [10.36.2.154] (unknown [46.212.121.255]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by mail.turbocat.net (Postfix) with ESMTPSA id EF2E62600DD; Wed, 19 Apr 2023 11:12:17 +0200 (CEST) Message-ID: <8de1eb97-3040-f33e-c2ec-86e826076b7d@selasky.org> Date: Wed, 19 Apr 2023 11:12:17 +0200 List-Id: Infiniband on FreeBSD <freebsd-infiniband.freebsd.org> List-Archive: https://lists.freebsd.org/archives/freebsd-infiniband List-Help: <mailto:freebsd-infiniband+help@freebsd.org> List-Post: <mailto:freebsd-infiniband@freebsd.org> List-Subscribe: <mailto:freebsd-infiniband+subscribe@freebsd.org> List-Unsubscribe: <mailto:freebsd-infiniband+unsubscribe@freebsd.org> Sender: owner-freebsd-infiniband@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.10.0 Subject: Re: Ifconfig limitations Content-Language: en-US To: =?UTF-8?Q?Mina_Gali=c4=87?= <freebsd@igalic.co> Cc: freebsd-net@freebsd.org, freebsd-infiniband@FreeBSD.org References: <IVmRoS9TeDkyGukaM0qZFV5cJHYqgRVSK9j6QcGojTxcZO5PIXxaXLWyoMNCyfwsjJDMtGJpRy0wQlbZFHej-eOh8zg_HFPI6urBrV8FB9I=@igalic.co> <fff88b1b-8d61-3941-78a1-cfe9b24bad9f@selasky.org> <fhp1gy5B7PavSt8LECZHjJyr_8yTa1e9iDID-bLO0iTxV9Jj8EX2Hlrok1kq_v0CC2KUVI36Nn4hfh7jHT9k3gN2f7z2WEtDsyDDqde0oDM=@igalic.co> <2c7b7432-f7ae-67e0-87a4-e556a26d981b@selasky.org> <yBUBIvQHx9Q8kcYn1QqMMOOZf2RstZLqYepRZw43jApzvlryqV8EI-5uyNh-oFsd2b4pUpwfBL78LqkJhl_Mdup0MsCLb-w7nzzBKHMsTdU=@igalic.co> From: Hans Petter Selasky <hps@selasky.org> In-Reply-To: <yBUBIvQHx9Q8kcYn1QqMMOOZf2RstZLqYepRZw43jApzvlryqV8EI-5uyNh-oFsd2b4pUpwfBL78LqkJhl_Mdup0MsCLb-w7nzzBKHMsTdU=@igalic.co> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: 4Q1Zmz5hBMz3C8x X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:88.99.0.0/16, country:DE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On 4/19/23 00:19, Mina Galić wrote: > Do you know how the sysctl entries interact with renaming an interface? Hi, I think there is no interaction there. We do have a sysctl_rename_oid() function, so it is technically possible. Feel free to work on it, if you find any issues! --HPS