From owner-freebsd-xen@freebsd.org Mon Feb 6 09:15:13 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ACCE0CD2FF5 for ; Mon, 6 Feb 2017 09:15:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9CA211EA2 for ; Mon, 6 Feb 2017 09:15:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v169FD0f035877 for ; Mon, 6 Feb 2017 09:15:13 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Mon, 06 Feb 2017 09:15:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Feb 2017 09:15:13 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #21 from rainer@ultra-secure.de --- Still a problem on FreeBSD 12: root@f12test:~ # dc3dd wipe=3D/dev/ada1 dc3dd 7.2.641 started at 2017-02-06 10:12:31 +0100 compiled options: command line: dc3dd wipe=3D/dev/ada1 device size: 104857600 sectors (probed), 53,687,091,200 bytes sector size: 512 bytes (probed) 1153433600 bytes ( 1.1 G ) copied ( 2% ), 131 s, 8.4 M/s=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20=20 input results for pattern `00': 2252800 sectors in output results for device `/dev/ada1': 2252800 sectors out dc3dd aborted at 2017-02-06 10:14:42 +0100 root@f12test:~ # uname -a FreeBSD f12test 12.0-CURRENT FreeBSD 12.0-CURRENT #0 r313113: Fri Feb 3 01:47:24 UTC 2017 root@releng3.nyi.freebsd.org:/usr/obj/usr/src/sys/GEN= ERIC amd64 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Mon Feb 6 13:56:14 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D972CCD21C9 for ; Mon, 6 Feb 2017 13:56:14 +0000 (UTC) (envelope-from liuyingdong@huawei.com) Received: from szxga01-in.huawei.com (szxga01-in.huawei.com [58.251.152.64]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "myname.my.domain", Issuer "www.mirapoint.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id A7024101C for ; Mon, 6 Feb 2017 13:56:09 +0000 (UTC) (envelope-from liuyingdong@huawei.com) Received: from 172.24.1.36 (EHLO szxema411-hub.china.huawei.com) ([172.24.1.36]) by szxrg01-dlp.huawei.com (MOS 4.3.7-GA FastPath queued) with ESMTP id DYR27704; Mon, 06 Feb 2017 21:54:37 +0800 (CST) Received: from SZXEMA506-MBS.china.huawei.com ([169.254.4.67]) by szxema411-hub.china.huawei.com ([10.82.72.70]) with mapi id 14.03.0235.001; Mon, 6 Feb 2017 21:54:29 +0800 From: Liuyingdong To: freebsd xen CC: "freebsd-xen@freebsd.org" , Suoben , "Zhaojun (Euler)" , Wanglinkai , chuzhaosong , "Wangchunfeng (Ivan)" , "Gaoxiaodong (Leo)" Subject: =?gb2312?B?tPC4tDogW1BBVENIXW5ldGZyb250OiBuZWVkIHJlbGVhc2UgYWxsIHJlc291?= =?gb2312?B?cmNlcyBhZnRlciBhZGRpbmcgYW5kIHJlbW92aW5nIE5JQ3MgdGltZSBhbmQg?= =?gb2312?Q?again?= Thread-Topic: [PATCH]netfront: need release all resources after adding and removing NICs time and again Thread-Index: AdJ9gxO2He9z8yhGRz6AxJrIQzYSiQC/GuqQ Date: Mon, 6 Feb 2017 13:54:28 +0000 Message-ID: <3655E9A8B903724782E1F75DCFD74E6B0122A336E3@szxema506-mbs.china.huawei.com> Accept-Language: zh-CN, en-US Content-Language: zh-CN X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-originating-ip: [10.52.7.180] Content-Type: multipart/mixed; boundary="_004_3655E9A8B903724782E1F75DCFD74E6B0122A336E3szxema506mbsc_" MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Mirapoint-Virus-RAPID-Raw: score=unknown(0), refid=str=0001.0A020206.58988025.02F8, ss=1, re=0.000, recu=0.000, reip=0.000, cl=1, cld=1, fgs=0, ip=169.254.4.67, so=2013-06-18 04:22:30, dmn=2013-03-21 17:37:32 X-Mirapoint-Loop-Id: 8f08058801c548b7b25efda11f281cdc X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Feb 2017 13:56:14 -0000 --_004_3655E9A8B903724782E1F75DCFD74E6B0122A336E3szxema506mbsc_ Content-Type: text/plain; charset="gb2312" Content-Transfer-Encoding: base64 SGVsbG8gUm9nZXIsDQoJSSB3YW50IHRvIGtub3cgd2hhdCBhYm91dCB0aGVzZSBwYXRjaCwgUGxl YXNlIGxldCBtZSBrbm93IGlmIHlvdSBoYXZlIGFueSBxdWVzdGlvbnMuIA0KCUlmIHlvdSB0aGlu ayB0aGVzZSBwYXRjaCBhcmUgZmluZSwgSSB3YW50IHRvIHlvdXIgY2hlY2tpbmctaW4gcGxhbi4g VGhhbmtzIQ0KDQotLS0tLdPKvP7Urbz+LS0tLS0NCreivP7IyzogTGl1eWluZ2RvbmcgDQq3osvN yrG85DogMjAxN8TqMtTCMsjVIDIxOjE1DQrK1bz+yMs6ICdmcmVlYnNkIHhlbicgPHJvZ2VyLnBh dUBjaXRyaXguY29tPg0Ks63LzTogZnJlZWJzZC14ZW5AZnJlZWJzZC5vcmc7IFN1b2JlbiA8c3Vv YmVuQGh1YXdlaS5jb20+OyBaaGFvanVuIChFdWxlcikgPHpoYW8uemhhb2p1bkBodWF3ZWkuY29t PjsgV2FuZ2xpbmthaSA8d2FuZ2xpbmthaUBodWF3ZWkuY29tPjsgY2h1emhhb3NvbmcgPGNodXpo YW9zb25nQGh1YXdlaS5jb20+OyBXYW5nY2h1bmZlbmcgKEl2YW4pIDxjaHVuZmVuZy53YW5nQGh1 YXdlaS5jb20+DQrW98ziOiBSZTogW1BBVENIXW5ldGZyb250OiBuZWVkIHJlbGVhc2UgYWxsIHJl c291cmNlcyBhZnRlciBhZGRpbmcgYW5kIHJlbW92aW5nIE5JQ3MgdGltZSBhbmQgYWdhaW4NCg0K SGVsbG8gUm9nZXIsDQoJVGhhbmsgeW91IGZvciB0aGUgdGltZSBhbmQgcGF0aWVuY2UgeW91IGRl dm90ZWQgdG8gcmVhZGluZyBteSBtZXNzYWdlcyBhbmQgZS1tYWlscy4gSSByZWFsbHkgYXBwcmVj aWF0ZSB0aGF0Lg0KCURlcGVuZCBvbiB5b3VyIHJlcGx5LCBJIHN1Ym1pdCB0aG9zZSBhZ2FpbnN0 IGN1cnJlbnQgSEVBRCAob3JpZ2luL21hc3RlcikuDQoNCjEuIDAwMDEgcGF0Y2g6IGludHJvZHVj ZSBzdXNwZW5kX2NhbmNlbCBtZWNoYW5pc20gZm9yIGZyb250ZW5kIGRldmljZXMuDQoxLjEgT24g YSBjYW5jZWxsZWQgc3VzcGVuZCwgeGVuIGZyb250ZW5kIGRldmljZXMgbmVlZCBrbm93IHRoZWly IHN0YXRlIGlzIGludmFyaWFudC4NCjEuMiBPbiBhIGNhbmNlbGxlZCBzdXNwZW5kIHRoZSB2Y3B1 X2luZm8gbG9jYXRpb24gZG9lcyBub3QgY2hhbmdlIChpdCdzIHN0aWxsIGluIHRoZSBwZXItY3B1 IGFyZWEgcmVnaXN0ZXJlZCBieSB4ZW5faHZtX2NwdV9pbml0KCkpLiBTbyBkbyBub3QgY2FsbCB4 ZW5faHZtX2luaXRfc2hhcmVkX2luZm9fcGFnZSgpIHdoaWNoIHdvdWxkIG1ha2UgdGhlIGtlcm5l bCB0aGluayBpdHMgYmFjayBpbiB0aGUgc2hhcmVkIGluZm8uIFdpdGggdGhlIHdyb25nIHZjcHVf aW5mbywgZXZlbnRzIGNhbm5vdCBiZSByZWNlaXZlZCBhbmQgdGhlIGRvbWFpbiB3aWxsIGhhbmcg YWZ0ZXIgYSBjYW5jZWxsZWQgc3VzcGVuZC4NCg0KSSBkZWNsYXJlIGEgZ2xvYmFsIHN1c3BlbmRf Y2FuY2VsbGVkIHZhcmlhYmxlIGluIHhlbi94ZW5idXMveGVuYnVzdmFyLmggYW5kIGV4cG9ydCB0 aGF0IHRvIGFsbCB0aGUgZnJvbnRlbmRzIHRoYXQgbmVlZCBpdC4gSXQgc2hvdWxkIGFsc28gYmUg YSBib29sIHR5cGUgaW5zdGVhZCBvZiBpbnQuIEkgbWVyZ2UgdG9nZXRoZXIgd2l0aCBhIF9zZXRf c3VzcGVuZF9jYW5jZWxsZWQoKSBmdW5jdGlvbi4NCg0KMi4gMDAwMiBwYXRjaDogYSB1c2Vyc3Bh Y2UgYXBwbGljYXRpb24gbmVlZCB3YWl0IHVudGlsIHN0b3BfYWxsX3Byb2MgaGFzIGZpbmlzaGVk IGR1cmluZyBsaXZlIG1pZ3JhdGlvbi4NCklmIHRoZXJlIGlzIGEgdXNlciBwcm9jZXNzIHdoaWNo IG1heWJlIG9mdGVuIHJlYWRzIGFuZCB3cml0ZXMgeGVuc3RvcmUsIHRoZSBhcHBsaWNhdGlvbiBo YXMgYmVlbiBzdXNwZW5kZWQgYWZ0ZXIgc3RvcF9hbGxfcHJvYyBpcyBjYWxsZWQuIEl0IGhlbGQg eHMucmVxdWVzdF9tdXRleCBsb2NrIGJ1dCBpbiB0aGUgeGN0cmxfc3VzcGVuZCgpIGZ1bmN0aW9u IHhzX3dyaXRlIGFuZCB4c19zdXNwZW5kIHdpbGwgbm90IG9idGFpbiB0aGlzIGxvY2suIFNvIHRo ZSBWTSB3aWxsIGhhbmcuIEluIG9yZGVyIHRvIHByZXZlbnQgdGhpcyBmcm9tIGhhcHBlbmluZywg dGhpcyBwcm9jZXNzIG5lZWQgd2FpdCB1bnRpbCBzdG9wX2FsbF9wcm9jIGhhcyBmaW5pc2hlZCBk dXJpbmcgbGl2ZSBtaWdyYXRpb24uDQoNCjMuIDAwMDMgcGF0Y2g6IHdyb25nIG9yZGVyIG9mIGRl dmljZSByZXN1bWUgY2F1c2VzIHZpcnR1YWwgbWFjaGluZSB0byBiZWNvbWUgdW5yZXNwb25zaXZl IGFmdGVyIGxpdmUgbWlncmF0aW9uLg0KQmVjYXVzZSB3cm9uZyBvcmRlciBvZiBkZXZpY2UgcmVz dW1lLCBWTSB3aWxsIGhhbmcgYWZ0ZXIgbGl2ZSBtaWdyYXRpb24uIGF0dGFjaCB0aGUgWGVuIFBW IHRpbWVyIHRvIHRoZSBuZXh1cyBkaXJlY3RseSBhcyBpdCB3YXMgZG9uZSBiZWZvcmUuDQoNCglJ biBteSBsYWJvcmF0b3J5LCBGcmVlQlNEIFZNcyB1bmRlciBubyBsb2FkIGFuZCBoaWdoIGxvYWQo Y3B1IDgwJSBhbmQgbWVtb3J5IDgwJSkgd2VyZSBhbGl2ZSBhZnRlciBtYWRlIHRoZSBsaXZlIG1p Z3JhdGlvbiBiYWNrIGFuZCBmb3J0aCAxMDAwIHRpbWVzLg0KCUkgd2FudCB0byBrbm93IHdoYXQg YWJvdXQgdGhlc2UgcGF0Y2gsIFBsZWFzZSBsZXQgbWUga25vdyBpZiB5b3UgaGF2ZSBhbnkgcXVl c3Rpb25zLiBUaGFua3MhDQoNCi0tLS0t08q8/tStvP4tLS0tLQ0Kt6K8/sjLOiBmcmVlYnNkIHhl biBbbWFpbHRvOnJvZ2VyLnBhdUBjaXRyaXguY29tXQ0Kt6LLzcqxvOQ6IDIwMTfE6jHUwjbI1SAx NDo0NA0KytW8/sjLOiBMaXV5aW5nZG9uZyA8bGl1eWluZ2RvbmdAaHVhd2VpLmNvbT4NCrOty806 IGZyZWVic2QteGVuQGZyZWVic2Qub3JnOyBaaGFvanVuIChFdWxlcikgPHpoYW8uemhhb2p1bkBo dWF3ZWkuY29tPjsgU3VvYmVuIDxzdW9iZW5AaHVhd2VpLmNvbT47IE91eWFuZ3poYW93ZWkgKENo YXJsZXMpIDxvdXlhbmd6aGFvd2VpQGh1YXdlaS5jb20+OyBjaHV6aGFvc29uZyA8Y2h1emhhb3Nv bmdAaHVhd2VpLmNvbT47IFdhbmdsaW5rYWkgPHdhbmdsaW5rYWlAaHVhd2VpLmNvbT4NCtb3zOI6 IFJlOiBbUEFUQ0hdbmV0ZnJvbnQ6IG5lZWQgcmVsZWFzZSBhbGwgcmVzb3VyY2VzIGFmdGVyIGFk ZGluZyBhbmQgcmVtb3ZpbmcgTklDcyB0aW1lIGFuZCBhZ2Fpbg0KDQpPbiBUaHUsIERlYyAxNSwg MjAxNiBhdCAwMjowMDo1M0FNICswMDAwLCBMaXV5aW5nZG9uZyB3cm90ZToNCj4gSGVsbG8gUm9n ZXIsDQo+IAlUaGFuayB5b3UgZm9yIHRoZSB0aW1lIGFuZCBwYXRpZW5jZSB5b3UgZGV2b3RlZCB0 byByZWFkaW5nIG15IG1lc3NhZ2VzIGFuZCBlLW1haWxzLiBJIHJlYWxseSBhcHByZWNpYXRlIHRo YXQuDQo+IAlJIGNhbid0IHVzZSBnaXQgc2VuZC1lbWFpbCBzbyBJIGF0dGFjaCB0aGUgcGF0Y2hl cyBkaXJlY3RseS4gSW4gdGhlIDAwMDEgcGF0Y2ggSSBpbnRyb2R1Y2Ugc3VzcGVuZF9jYW5jZWwg bWVjaGFuaXNtIGZvciBmcm9udGVuZCBkZXZpY2VzIGFuZCBpbiB0aGUgMDAwMiBwYXRjaCBJIHJl bGVhc2UgYWxsIHJlc291cmNlcyBhZnRlciBob3QgdW5wbHVnIE5JQ3MuDQo+IA0KPiAgICAgTm90 ZTogVGhlc2UgdHdvIHBhdGNoZXMgaXMgb24gdGhlIGJhc2Ugb2YgdGhlIG9yaWdpbi9yZWxlYXNl LzEwLjIuMCBicmFuY2ggYW5kIHRoZSAwMDAyIHBhdGNoIGlzIG1hZGUgYWZ0ZXIgdGhlIDAwMDEg cGF0Y2guDQoNCkhlbGxvLA0KDQpUaGFua3MgZm9yIHRoZSBwYXRjaGVzLCBub3cgdGhleSBsb29r IGZpbmUuIFlvdSB3aWxsIGhvd2V2ZXIgbmVlZCB0byBzdWJtaXQgdGhvc2UgYWdhaW5zdCBjdXJy ZW50IEhFQUQgKG9yaWdpbi9tYXN0ZXIpLCBhbmQgdGhlbiBJIHdpbGwgZG8gdGhlIGJhY2twb3J0 IHRvDQpzdGFibGUvMTAgYW5kIHN0YWJsZS8xMS4gSSBjYW5ub3QgYXBwbHkgYSBwYXRjaCBkaXJl Y3RseSB0byBzdGFibGUgYnJhbmNoZXMgd2l0aG91dCBpdCBiZWluZyBpbiBIRUFEIGZpcnN0IHVu bGVzcyB0aGVyZSdzIGEgZ29vZCByZWFzb24gZm9yIGl0Lg0KDQpSZXBseWluZyB0byBib3RoIHBh dGNoZXMgaGVyZSBpbmxpbmUuDQoNCi0tLTg8LS0tDQo+IEZyb20gZmM4NWFjN2ViYTU1YTVmMTRm NWY3ZDgxZjBlMWZjN2ZiZjZhNzQ0NyBNb24gU2VwIDE3IDAwOjAwOjAwIDIwMDENCj4gRnJvbTog WWluZ2RvbmcgTGl1IDxsaXV5aW5nZG9uZ0BodWF3ZWkuY29tPg0KPiBEYXRlOiBUdWUsIDEzIERl YyAyMDE2IDIxOjUzOjI1ICswODAwDQo+IFN1YmplY3Q6IFtQQVRDSF0gaW50cm9kdWNlIHN1c3Bl bmQgY2FuY2VsIG1lY2hhbmlzbSBmb3IgZnJvbnRlbmQgDQo+IGRldmljZXMNCj4gDQoNCkNhbiB5 b3UgZWxhYm9yYXRlIGEgbGl0dGxlIGJpdCBtb3JlIG9uIHRoZSBjb21taXQgbWVzc2FnZSBoZXJl PyBXaGF0IGlzc3VlcyBhcmUgeW91IHNlZWluZyB3aXRob3V0IHRoaXMgcGF0Y2ggYXBwbGllZD8g V2hhdCBpcyB0aGUgcmVzdWx0IGFmdGVyIGFwcGx5aW5nIHRoZSBwYXRjaD8NCg0KQ29tbWl0IG1l c3NhZ2VzIGFyZSB2ZXJ5IGltcG9ydGFudCBpbiBvcmRlciB0byBrbm93IHdoeSBhIGNoYW5nZSBp cyBuZWVkZWQsIHNwZWNpYWxseSB3aGVuIHlvdSBsb29rIGF0IHRoZW0gaW4gZm9yIGV4YW1wbGUg MyB5ZWFycyB0aW1lLg0KDQo+IC0tLQ0KPiAgc3lzL2Rldi94ZW4vYmxrZnJvbnQvYmxrZnJvbnQu YyB8IDEzICsrKysrKysrKysrDQo+ICBzeXMvZGV2L3hlbi9jb250cm9sL2NvbnRyb2wuYyAgIHwg IDkgKysrKysrLQ0KPiAgc3lzL2Rldi94ZW4vbmV0ZnJvbnQvbmV0ZnJvbnQuYyB8IDUyICsrKysr KysrKysrKysrKysrKysrKysrKysrKysrKy0tLS0tLS0tLS0tDQo+ICBzeXMveDg2L3hlbi9odm0u YyAgICAgICAgICAgICAgIHwgMTYgKysrKysrKystLS0tLQ0KPiAgc3lzL3hlbi94ZW5idXMveGVu YnVzYi5jICAgICAgICB8IDQ1ICsrKysrKysrKysrKysrKysrKysrKystLS0tLS0tLS0tLS0tDQo+ ICBzeXMveGVuL3hlbmJ1cy94ZW5idXN2YXIuaCAgICAgIHwgIDQgKysrKw0KPiAgNiBmaWxlcyBj aGFuZ2VkLCAxMDIgaW5zZXJ0aW9ucygrKSwgMzcgZGVsZXRpb25zKC0pDQo+IA0KPiBkaWZmIC0t Z2l0IGEvc3lzL2Rldi94ZW4vYmxrZnJvbnQvYmxrZnJvbnQuYyANCj4gYi9zeXMvZGV2L3hlbi9i bGtmcm9udC9ibGtmcm9udC5jIGluZGV4IGE3MTI1MWQuLjhkN2MzMmEgMTAwNjQ0DQo+IC0tLSBh L3N5cy9kZXYveGVuL2Jsa2Zyb250L2Jsa2Zyb250LmMNCj4gKysrIGIvc3lzL2Rldi94ZW4vYmxr ZnJvbnQvYmxrZnJvbnQuYw0KPiBAQCAtNjgsNiArNjgsOCBAQCBfX0ZCU0RJRCgiJEZyZWVCU0Qk Iik7DQo+ICANCj4gICNpbmNsdWRlICJ4ZW5idXNfaWYuaCINCj4gIA0KPiArc3RhdGljIGludCBi bGtmcm9udF9zdXNwZW5kX2NhbmNlbGxlZCA9IDA7DQoNCkkgc2VlIHRoYXQgeW91IGFkZCBvbmUg b2YgdGhvc2UgdG8gZWFjaCBmcm9udGVuZCB5b3UgYWRkIGNhbmNlbCBzdXNwZW5kIHN1cHBvcnQs IHRvZ2V0aGVyIHdpdGggYSAqX3NldF9zdXNwZW5kX2NhbmNlbCBmdW5jdGlvbi4gV291bGRuJ3Qg aXQgYmUgZWFzaWVyIHRvIGRlY2xhcmUgYSBnbG9iYWwgc3VzcGVuZF9jYW5jZWxsZWQgdmFyaWFi bGUgaW4geGVuL2NvbnRyb2wuYyBhbmQgZXhwb3J0IHRoYXQgdG8gYWxsIHRoZSBmcm9udGVuZHMg dGhhdCBuZWVkIGl0PyBJdCBzaG91bGQgYWxzbyBiZSBhIGJvb2wgdHlwZSBpbnN0ZWFkIG9mIGlu dC4NCg0KWW91IGNhbiBjbGVhciB0aGF0IHZhcmlhYmxlIGFmdGVyIERFVklDRV9SRVNVTUUgaGFz IGZpbmlzaGVkLg0KDQo+ICAvKi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSBGb3J3YXJkIERl Y2xhcmF0aW9ucyANCj4gLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tKi8gIHN0YXRpYyB2b2lk IHhiZF9jbG9zaW5nKGRldmljZV90KTsgDQo+IHN0YXRpYyB2b2lkIHhiZF9zdGFydGlvKHN0cnVj dCB4YmRfc29mdGMgKnNjKTsgQEAgLTE0MTcsMTAgKzE0MTksMjEgQEAgDQo+IHhiZF9zdXNwZW5k KGRldmljZV90IGRldikNCj4gIAlyZXR1cm4gKHJldHZhbCk7DQo+ICB9DQo+ICANCj4gK3ZvaWQg eGJkX3NldF9zdXNwZW5kX2NhbmNlbCh2b2lkKQ0KPiArew0KPiArCWJsa2Zyb250X3N1c3BlbmRf Y2FuY2VsbGVkID0gMTsNCj4gK30NCj4gKw0KPiAgc3RhdGljIGludA0KPiAgeGJkX3Jlc3VtZShk ZXZpY2VfdCBkZXYpDQo+ICB7DQo+ICAJc3RydWN0IHhiZF9zb2Z0YyAqc2MgPSBkZXZpY2VfZ2V0 X3NvZnRjKGRldik7DQo+ICsJDQoNClN0cmF5IHRhYi4NCg0KPiArCWlmKGJsa2Zyb250X3N1c3Bl bmRfY2FuY2VsbGVkID09IDEpIHsNCiAgICAgICAgICBeIG1pc3Npbmcgc3BhY2UgYmV0d2VlbiAi aWYiIGFuZCAiKCIuDQoNCj4gKwkJc2MtPnhiZF9zdGF0ZSA9IFhCRF9TVEFURV9DT05ORUNURUQ7 DQo+ICsJCWJsa2Zyb250X3N1c3BlbmRfY2FuY2VsbGVkID0gMDsNCj4gKwkJcmV0dXJuICgwKTsN Cj4gKwl9DQo+ICANCj4gIAlEUFJJTlRLKCJ4YmRfcmVzdW1lOiAlc1xuIiwgeGVuYnVzX2dldF9u b2RlKGRldikpOw0KPiAgDQo+IGRpZmYgLS1naXQgYS9zeXMvZGV2L3hlbi9jb250cm9sL2NvbnRy b2wuYyANCj4gYi9zeXMvZGV2L3hlbi9jb250cm9sL2NvbnRyb2wuYyBpbmRleCBiYzA2MDlkLi5i NTAwMTAwIDEwMDY0NA0KPiAtLS0gYS9zeXMvZGV2L3hlbi9jb250cm9sL2NvbnRyb2wuYw0KPiAr KysgYi9zeXMvZGV2L3hlbi9jb250cm9sL2NvbnRyb2wuYw0KPiBAQCAtNDAwLDcgKzQwMCw5IEBA IHhjdHJsX3N1c3BlbmQoKQ0KPiAgCS8qDQo+ICAJICogUmVzZXQgZ3JhbnQgdGFibGUgaW5mby4N Cj4gIAkgKi8NCj4gLQlnbnR0YWJfcmVzdW1lKCk7DQo+ICsJaWYoc3VzcGVuZF9jYW5jZWxsZWQg PT0gMCkgew0KICAgICAgICAgIF4gbWlzc2luZyBzcGFjZS4NCg0KPiArCQlnbnR0YWJfcmVzdW1l KCk7DQo+ICsJfQ0KPiAgDQo+ICAjaWZkZWYgU01QDQo+ICAJaWYgKHNtcF9zdGFydGVkICYmICFD UFVfRU1QVFkoJmNwdV9zdXNwZW5kX21hcCkpIHsgQEAgLTQxNiw2ICs0MTgsMTEgDQo+IEBAIHhj dHJsX3N1c3BlbmQoKQ0KPiAgCSAqIEZyZWVCU0QgcmVhbGx5IG5lZWRzIHRvIGFkZCBERVZJQ0Vf U1VTUEVORF9DQU5DRUwgb3INCj4gIAkgKiBzaW1pbGFyLg0KPiAgCSAqLw0KPiArCWlmKHN1c3Bl bmRfY2FuY2VsbGVkID09IDEpIHsNCj4gKwkJeGVuYnVzYl9zZXRfc3VzcGVuZF9jYW5jZWwoKTsN Cj4gKwkJeGJkX3NldF9zdXNwZW5kX2NhbmNlbCgpOw0KPiArCQl4bl9zZXRfc3VzcGVuZF9jYW5j ZWwoKTsNCj4gKwl9DQoNCklmIHlvdSBtYWtlIHN1c3BlbmRfY2FuY2VsbGVkIGdsb2JhbCB5b3Ug d291bGRuJ3QgbmVlZCB0byBjYWxsIGFsbCBvZiB0aG9zZSBmdW5jdGlvbnMuDQoNCj4gIAltdHhf bG9jaygmR2lhbnQpOw0KPiAgCURFVklDRV9SRVNVTUUocm9vdF9idXMpOw0KPiAgCW10eF91bmxv Y2soJkdpYW50KTsNCj4gZGlmZiAtLWdpdCBhL3N5cy9kZXYveGVuL25ldGZyb250L25ldGZyb250 LmMgDQo+IGIvc3lzL2Rldi94ZW4vbmV0ZnJvbnQvbmV0ZnJvbnQuYyBpbmRleCBkODljMGUwLi4w Y2FhYTJjIDEwMDY0NA0KPiAtLS0gYS9zeXMvZGV2L3hlbi9uZXRmcm9udC9uZXRmcm9udC5jDQo+ ICsrKyBiL3N5cy9kZXYveGVuL25ldGZyb250L25ldGZyb250LmMNCj4gQEAgLTk4LDYgKzk4LDgg QEAgX19GQlNESUQoIiRGcmVlQlNEJCIpOyAgI2RlZmluZSBORVRfVFhfUklOR19TSVpFIA0KPiBf X1JJTkdfU0laRSgobmV0aWZfdHhfc3JpbmdfdCAqKTAsIFBBR0VfU0laRSkgICNkZWZpbmUgDQo+ IE5FVF9SWF9SSU5HX1NJWkUgX19SSU5HX1NJWkUoKG5ldGlmX3J4X3NyaW5nX3QgKikwLCBQQUdF X1NJWkUpDQo+ICANCj4gK3N0YXRpYyBpbnQgbmV0ZnJvbnRfc3VzcGVuZF9jYW5jZWxsZWQgPSAw Ow0KPiArDQo+ICAjaWYgX19GcmVlQlNEX3ZlcnNpb24gPj0gNzAwMDAwDQo+ICAvKg0KPiAgICog U2hvdWxkIHRoZSBkcml2ZXIgZG8gTFJPIG9uIHRoZSBSWCBlbmQgQEAgLTE5Miw2ICsxOTQsMTAg QEAgc3RhdGljIA0KPiBpbnQgeGVubmV0X2dldF9yZXNwb25zZXMoc3RydWN0IG5ldGZyb250X2lu Zm8gKm5wLA0KPiAgCXN0cnVjdCBuZXRmcm9udF9yeF9pbmZvICpyaW5mbywgUklOR19JRFggcnAs IFJJTkdfSURYICpjb25zLA0KPiAgCXN0cnVjdCBtYnVmICoqbGlzdCwgaW50ICpwYWdlc19mbGlw cGVkX3ApOw0KPiAgDQo+ICsjaWZkZWYgSU5FVA0KPiArc3RhdGljIHZvaWQgbmV0ZnJvbnRfc2Vu ZF9mYWtlX2FycChkZXZpY2VfdCBkZXYsIHN0cnVjdCBuZXRmcm9udF9pbmZvIA0KPiArKmluZm8p OyAjZW5kaWYNCj4gKw0KPiAgI2RlZmluZSB2aXJ0X3RvX21mbih4KSAodnRvbWFjaCh4KSA+PiBQ QUdFX1NISUZUKQ0KPiAgDQo+ICAjZGVmaW5lIElOVkFMSURfUDJNX0VOVFJZICh+MFVMKQ0KPiBA QCAtNDkzLDYgKzQ5OSwxMSBAQCBuZXRmcm9udF9zdXNwZW5kKGRldmljZV90IGRldikNCj4gIAly ZXR1cm4gKDApOw0KPiAgfQ0KPiAgDQo+ICt2b2lkIHhuX3NldF9zdXNwZW5kX2NhbmNlbCh2b2lk KQ0KPiArew0KPiArCW5ldGZyb250X3N1c3BlbmRfY2FuY2VsbGVkID0gMTsNCj4gK30NCj4gKw0K PiAgLyoqDQo+ICAgKiBXZSBhcmUgcmVjb25uZWN0aW5nIHRvIHRoZSBiYWNrZW5kLCBkdWUgdG8g YSBzdXNwZW5kL3Jlc3VtZSwgb3IgYSBiYWNrZW5kDQo+ICAgKiBkcml2ZXIgcmVzdGFydC4gIFdl IHRlYXIgZG93biBvdXIgbmV0aWYgc3RydWN0dXJlIGFuZCByZWNyZWF0ZSBpdCwgDQo+IGJ1dCBA QCAtNTA0LDYgKzUxNSwxOSBAQCBuZXRmcm9udF9yZXN1bWUoZGV2aWNlX3QgZGV2KSAgew0KPiAg CXN0cnVjdCBuZXRmcm9udF9pbmZvICppbmZvID0gZGV2aWNlX2dldF9zb2Z0YyhkZXYpOw0KPiAg DQo+ICsJaWYobmV0ZnJvbnRfc3VzcGVuZF9jYW5jZWxsZWQgPT0gMSkgew0KPiArCQlpbmZvLT54 bl9yZXN1bWUgPSB0cnVlOw0KPiArCQlYTl9SWF9MT0NLKGluZm8pOw0KPiArCQlYTl9UWF9MT0NL KGluZm8pOw0KPiArCQluZXRmcm9udF9jYXJyaWVyX29uKGluZm8pOw0KPiArCQlYTl9UWF9VTkxP Q0soaW5mbyk7DQo+ICsJCVhOX1JYX1VOTE9DSyhpbmZvKTsNCj4gKyNpZmRlZiBJTkVUDQo+ICsJ CW5ldGZyb250X3NlbmRfZmFrZV9hcnAoZGV2LCBpbmZvKTsNCj4gKyNlbmRpZg0KDQpJIGRvbid0 IHRoaW5rIHlvdSBuZWVkIHRvIHNlbmQgYW4gQVJQIG9uIGEgY2FuY2VsbGVkIHN1c3BlbmQsIHRo ZSBicmlkZ2Ugc2hvdWxkIGFscmVhZHkgaGF2ZSB0aGUgbWFjIGFkZHJlc3Mgb2YgdGhlIHZpcnR1 YWwgaW50ZXJmYWNlIGluIGl0J3MgY2FjaGUgcmlnaHQ/DQoNCj4gKwkJbmV0ZnJvbnRfc3VzcGVu ZF9jYW5jZWxsZWQgPSAwOw0KPiArCQlyZXR1cm4gKDApOw0KPiArCX0NCj4gIAlpbmZvLT54bl9y ZXN1bWUgPSB0cnVlOw0KPiAgCW5ldGlmX2Rpc2Nvbm5lY3RfYmFja2VuZChpbmZvKTsNCj4gIAly ZXR1cm4gKDApOw0KPiBAQCAtMjEwOCwyNiArMjEzMiwyNiBAQCBjcmVhdGVfbmV0ZGV2KGRldmlj ZV90IGRldikNCj4gIAkNCj4gIAkvKiBTZXQgdXAgaWZuZXQgc3RydWN0dXJlICovDQo+ICAJaWZw ID0gbnAtPnhuX2lmcCA9IGlmX2FsbG9jKElGVF9FVEhFUik7DQo+IC0gICAgCWlmcC0+aWZfc29m dGMgPSBucDsNCj4gLSAgICAJaWZfaW5pdG5hbWUoaWZwLCAieG4iLCAgZGV2aWNlX2dldF91bml0 KGRldikpOw0KPiAtICAgIAlpZnAtPmlmX2ZsYWdzID0gSUZGX0JST0FEQ0FTVCB8IElGRl9TSU1Q TEVYIHwgSUZGX01VTFRJQ0FTVDsNCj4gLSAgICAJaWZwLT5pZl9pb2N0bCA9IHhuX2lvY3RsOw0K PiAtICAgIAlpZnAtPmlmX291dHB1dCA9IGV0aGVyX291dHB1dDsNCj4gLSAgICAJaWZwLT5pZl9z dGFydCA9IHhuX3N0YXJ0Ow0KPiArCWlmcC0+aWZfc29mdGMgPSBucDsNCj4gKwlpZl9pbml0bmFt ZShpZnAsICJ4biIsICBkZXZpY2VfZ2V0X3VuaXQoZGV2KSk7DQo+ICsJaWZwLT5pZl9mbGFncyA9 IElGRl9CUk9BRENBU1QgfCBJRkZfU0lNUExFWCB8IElGRl9NVUxUSUNBU1Q7DQo+ICsJaWZwLT5p Zl9pb2N0bCA9IHhuX2lvY3RsOw0KPiArCWlmcC0+aWZfb3V0cHV0ID0gZXRoZXJfb3V0cHV0Ow0K PiArCWlmcC0+aWZfc3RhcnQgPSB4bl9zdGFydDsNCj4gICNpZmRlZiBub3R5ZXQNCj4gLSAgICAJ aWZwLT5pZl93YXRjaGRvZyA9IHhuX3dhdGNoZG9nOw0KPiArCWlmcC0+aWZfd2F0Y2hkb2cgPSB4 bl93YXRjaGRvZzsNCj4gICNlbmRpZg0KPiAtICAgIAlpZnAtPmlmX2luaXQgPSB4bl9pZmluaXQ7 DQo+IC0gICAgCWlmcC0+aWZfc25kLmlmcV9tYXhsZW4gPSBORVRfVFhfUklOR19TSVpFIC0gMTsN Cj4gLQkNCj4gLSAgICAJaWZwLT5pZl9od2Fzc2lzdCA9IFhOX0NTVU1fRkVBVFVSRVM7DQo+IC0g ICAgCWlmcC0+aWZfY2FwYWJpbGl0aWVzID0gSUZDQVBfSFdDU1VNOw0KPiArCWlmcC0+aWZfaW5p dCA9IHhuX2lmaW5pdDsNCj4gKwlpZnAtPmlmX3NuZC5pZnFfbWF4bGVuID0gTkVUX1RYX1JJTkdf U0laRSAtIDE7DQo+ICsNCj4gKwlpZnAtPmlmX2h3YXNzaXN0ID0gWE5fQ1NVTV9GRUFUVVJFUzsN Cj4gKwlpZnAtPmlmX2NhcGFiaWxpdGllcyA9IElGQ0FQX0hXQ1NVTTsNCj4gIAlpZnAtPmlmX2h3 X3Rzb21heCA9IDY1NTM2IC0gKEVUSEVSX0hEUl9MRU4gKyBFVEhFUl9WTEFOX0VOQ0FQX0xFTik7 DQo+ICAJaWZwLT5pZl9od190c29tYXhzZWdjb3VudCA9IE1BWF9UWF9SRVFfRlJBR1M7DQo+ICAJ aWZwLT5pZl9od190c29tYXhzZWdzaXplID0gUEFHRV9TSVpFOw0KPiAgCQ0KPiAtICAgIAlldGhl cl9pZmF0dGFjaChpZnAsIG5wLT5tYWMpOw0KPiAtICAgIAljYWxsb3V0X2luaXQoJm5wLT54bl9z dGF0X2NoLCBDQUxMT1VUX01QU0FGRSk7DQo+ICsJZXRoZXJfaWZhdHRhY2goaWZwLCBucC0+bWFj KTsNCj4gKwljYWxsb3V0X2luaXQoJm5wLT54bl9zdGF0X2NoLCBDQUxMT1VUX01QU0FGRSk7DQo+ ICAJbmV0ZnJvbnRfY2Fycmllcl9vZmYobnApOw0KDQpUaGlzIGNodW5rIHNlZW1zIGNvbXBsZXRl bHkgdW5yZWxhdGVkIHRvIHRoZSBwYXRjaCBpdHNlbGYsIGlzIHRoaXMgc29tZSBraW5kIG9mIGNv ZGUgZm9ybWF0dGluZyBjbGVhbnVwPyBJZiBzbywgdGhpcyBzaG91bGQgYmUgc2VudCBpbiBhIHNl cGFyYXRlIHBhdGNoLg0KDQo+ICAJcmV0dXJuICgwKTsNCj4gZGlmZiAtLWdpdCBhL3N5cy94ODYv eGVuL2h2bS5jIGIvc3lzL3g4Ni94ZW4vaHZtLmMgaW5kZXggDQo+IGMzODY5NTMuLjFjMmJhOWQg MTAwNjQ0DQo+IC0tLSBhL3N5cy94ODYveGVuL2h2bS5jDQo+ICsrKyBiL3N5cy94ODYveGVuL2h2 bS5jDQo+IEBAIC01MTcsMTAgKzUxNyw5IEBAIHhlbl9odm1faW5pdChlbnVtIHhlbl9odm1faW5p dF90eXBlIGluaXRfdHlwZSkNCj4gIAlpbnQgZXJyb3I7DQo+ICAJaW50IGk7DQo+ICANCj4gLQlp ZiAoaW5pdF90eXBlID09IFhFTl9IVk1fSU5JVF9DQU5DRUxMRURfU1VTUEVORCkNCj4gLQkJcmV0 dXJuOw0KPiAtDQo+IC0JZXJyb3IgPSB4ZW5faHZtX2luaXRfaHlwZXJjYWxsX3N0dWJzKCk7DQo+ ICsJaWYgKGluaXRfdHlwZSAhPSBYRU5fSFZNX0lOSVRfQ0FOQ0VMTEVEX1NVU1BFTkQpIHsNCj4g KwkJZXJyb3IgPSB4ZW5faHZtX2luaXRfaHlwZXJjYWxsX3N0dWJzKCk7DQo+ICsJfQ0KPiAgDQo+ ICAJc3dpdGNoIChpbml0X3R5cGUpIHsNCj4gIAljYXNlIFhFTl9IVk1fSU5JVF9DT0xEOg0KPiBA QCAtNTQxLDEzICs1NDAsMTcgQEAgeGVuX2h2bV9pbml0KGVudW0geGVuX2h2bV9pbml0X3R5cGUg aW5pdF90eXBlKQ0KPiAgCQlDUFVfRk9SRUFDSChpKQ0KPiAgCQkJRFBDUFVfSURfU0VUKGksIHZj cHVfaW5mbywgTlVMTCk7DQo+ICAJCWJyZWFrOw0KPiArCWNhc2UgWEVOX0hWTV9JTklUX0NBTkNF TExFRF9TVVNQRU5EOg0KPiArCQlicmVhazsNCj4gIAlkZWZhdWx0Og0KPiAgCQlwYW5pYygiVW5z dXBwb3J0ZWQgSFZNIGluaXRpYWxpemF0aW9uIHR5cGUiKTsNCj4gIAl9DQo+ICANCj4gIAl4ZW5f dmVjdG9yX2NhbGxiYWNrX2VuYWJsZWQgPSAwOw0KPiAgCXhlbl9kb21haW5fdHlwZSA9IFhFTl9I Vk1fRE9NQUlOOw0KPiAtCXhlbl9odm1faW5pdF9zaGFyZWRfaW5mb19wYWdlKCk7DQo+ICsJaWYg KGluaXRfdHlwZSAhPSBYRU5fSFZNX0lOSVRfQ0FOQ0VMTEVEX1NVU1BFTkQpIHsNCj4gKwkJeGVu X2h2bV9pbml0X3NoYXJlZF9pbmZvX3BhZ2UoKTsNCj4gKwl9DQo+ICAJeGVuX2h2bV9zZXRfY2Fs bGJhY2soTlVMTCk7DQo+ICAJeGVuX2h2bV9kaXNhYmxlX2VtdWxhdGVkX2RldmljZXMoKTsNCg0K SSdtIG5vdCBzdXJlIEkgZm9sbG93IHdoeSB0aGlzIGNoYW5nZSB0byB4ZW5faHZtX2luaXQgaXMg bmVlZGVkLCBvbiBhIGNhbmNlbGxlZCBzdXNwZW5kIHlvdSBzaG91bGRuJ3QgbmVlZCB0byByZS1z ZXQgdGhlIGNhbGxiYWNrIHZlY3RvciBvciB1bnBsdWcgYW55IGVtdWxhdGVkIGRldmljZXMuDQoN Cj4gIH0NCj4gQEAgLTU2NSw3ICs1NjgsOCBAQCB4ZW5faHZtX3Jlc3VtZShib29sIHN1c3BlbmRf Y2FuY2VsbGVkKQ0KPiAgCSAgICBYRU5fSFZNX0lOSVRfQ0FOQ0VMTEVEX1NVU1BFTkQgOiBYRU5f SFZNX0lOSVRfUkVTVU1FKTsNCj4gIA0KPiAgCS8qIFJlZ2lzdGVyIHZjcHVfaW5mbyBhcmVhIGZv ciBDUFUjMC4gKi8NCj4gLQl4ZW5faHZtX2NwdV9pbml0KCk7DQo+ICsJaWYoIXN1c3BlbmRfY2Fu Y2VsbGVkKQ0KPiArCQl4ZW5faHZtX2NwdV9pbml0KCk7DQo+ICB9DQoNClNlZWluZyB0aGlzIGhl cmUsIHdoeSBkb24ndCB3ZSBqdXN0IGF2b2lkIGNhbGxpbmcgeGVuX2h2bV9yZXN1bWUgZnJvbSB4 Y3RybF9zdXNwZW5kIG9uIGEgY2FuY2VsbGVkIHN1c3BlbmQ/DQoNCj4gIHN0YXRpYyB2b2lkDQo+ IGRpZmYgLS1naXQgYS9zeXMveGVuL3hlbmJ1cy94ZW5idXNiLmMgYi9zeXMveGVuL3hlbmJ1cy94 ZW5idXNiLmMgaW5kZXggDQo+IDFmODQ3OTUuLmNjZTgzY2QgMTAwNjQ0DQo+IC0tLSBhL3N5cy94 ZW4veGVuYnVzL3hlbmJ1c2IuYw0KPiArKysgYi9zeXMveGVuL3hlbmJ1cy94ZW5idXNiLmMNCj4g QEAgLTc1LDYgKzc1LDggQEAgX19GQlNESUQoIiRGcmVlQlNEJCIpOyAgI2luY2x1ZGUgDQo+IDx4 ZW4veGVuYnVzL3hlbmJ1c2IuaD4gICNpbmNsdWRlIDx4ZW4veGVuYnVzL3hlbmJ1c3Zhci5oPg0K PiAgDQo+ICtzdGF0aWMgaW50IHhlbmJ1c2Jfc3VzcGVuZF9jYW5jZWxsZWQgPSAwOw0KPiArDQo+ ICAvKi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0gUHJpdmF0ZSBGdW5jdGlvbnMgDQo+IC0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tKi8NCj4gIC8qKg0KPiAgICogXGJyaWVmIERlYWxs b2NhdGUgWGVuQnVzIGRldmljZSBpbnN0YW5jZSB2YXJpYWJsZXMuDQo+IEBAIC03NzYsNiArNzc4 LDExIEBAIHhlbmJ1c2JfYXR0YWNoKGRldmljZV90IGRldiwgY2hhciAqYnVzX25vZGUsIHVfaW50 IGlkX2NvbXBvbmVudHMpDQo+ICAJcmV0dXJuICgwKTsNCj4gIH0NCj4gIA0KPiArdm9pZCB4ZW5i dXNiX3NldF9zdXNwZW5kX2NhbmNlbCh2b2lkKSB7DQo+ICsJeGVuYnVzYl9zdXNwZW5kX2NhbmNl bGxlZCA9IDE7DQo+ICt9DQo+ICsNCj4gIGludA0KPiAgeGVuYnVzYl9yZXN1bWUoZGV2aWNlX3Qg ZGV2KQ0KPiAgew0KPiBAQCAtNzkzLDI5ICs4MDAsMzIgQEAgeGVuYnVzYl9yZXN1bWUoZGV2aWNl X3QgZGV2KQ0KPiAgCQkJaWYgKGRldmljZV9nZXRfc3RhdGUoa2lkc1tpXSkgPT0gRFNfTk9UUFJF U0VOVCkNCj4gIAkJCQljb250aW51ZTsNCj4gIA0KPiAtCQkJaXZhcnMgPSBkZXZpY2VfZ2V0X2l2 YXJzKGtpZHNbaV0pOw0KPiArCQkJaWYoeGVuYnVzYl9zdXNwZW5kX2NhbmNlbGxlZCA9PSAwKSB7 DQo+ICsJCQkJaXZhcnMgPSBkZXZpY2VfZ2V0X2l2YXJzKGtpZHNbaV0pOw0KPiAgDQo+IC0JCQl4 c191bnJlZ2lzdGVyX3dhdGNoKCZpdmFycy0+eGRfb3RoZXJlbmRfd2F0Y2gpOw0KPiAtCQkJeGVu YnVzX3NldF9zdGF0ZShraWRzW2ldLCBYZW5idXNTdGF0ZUluaXRpYWxpc2luZyk7DQo+ICsJCQkJ eHNfdW5yZWdpc3Rlcl93YXRjaCgmaXZhcnMtPnhkX290aGVyZW5kX3dhdGNoKTsNCj4gKwkJCQl4 ZW5idXNfc2V0X3N0YXRlKGtpZHNbaV0sIFhlbmJ1c1N0YXRlSW5pdGlhbGlzaW5nKTsNCj4gIA0K PiAtCQkJLyoNCj4gLQkJCSAqIEZpbmQgdGhlIG5ldyBiYWNrZW5kIGRldGFpbHMgYW5kDQo+IC0J CQkgKiByZS1yZWdpc3RlciBvdXIgd2F0Y2guDQo+IC0JCQkgKi8NCj4gLQkJCWVycm9yID0gWEVO QlVTQl9HRVRfT1RIRVJFTkRfTk9ERShkZXYsIGl2YXJzKTsNCj4gLQkJCWlmIChlcnJvcikNCj4g LQkJCQlyZXR1cm4gKGVycm9yKTsNCj4gKwkJCQkvKg0KPiArCQkJCSAqIEZpbmQgdGhlIG5ldyBi YWNrZW5kIGRldGFpbHMgYW5kDQo+ICsJCQkJICogcmUtcmVnaXN0ZXIgb3VyIHdhdGNoLg0KPiAr CQkJCSAqLw0KPiArCQkJCWVycm9yID0gWEVOQlVTQl9HRVRfT1RIRVJFTkRfTk9ERShkZXYsIGl2 YXJzKTsNCj4gKwkJCQlpZiAoZXJyb3IpDQo+ICsJCQkJCXJldHVybiAoZXJyb3IpOw0KPiAgDQo+ IC0JCQlzdGF0ZXBhdGggPSBtYWxsb2MoaXZhcnMtPnhkX290aGVyZW5kX3BhdGhfbGVuDQo+IC0J CQkgICAgKyBzdHJsZW4oIi9zdGF0ZSIpICsgMSwgTV9YRU5CVVMsIE1fV0FJVE9LKTsNCj4gLQkJ CXNwcmludGYoc3RhdGVwYXRoLCAiJXMvc3RhdGUiLCBpdmFycy0+eGRfb3RoZXJlbmRfcGF0aCk7 DQo+ICsJCQkJc3RhdGVwYXRoID0gbWFsbG9jKGl2YXJzLT54ZF9vdGhlcmVuZF9wYXRoX2xlbg0K PiArCQkJCSAgICArIHN0cmxlbigiL3N0YXRlIikgKyAxLCBNX1hFTkJVUywgTV9XQUlUT0spOw0K PiArCQkJCXNwcmludGYoc3RhdGVwYXRoLCAiJXMvc3RhdGUiLCBpdmFycy0+eGRfb3RoZXJlbmRf cGF0aCk7DQo+ICANCj4gLQkJCWZyZWUoaXZhcnMtPnhkX290aGVyZW5kX3dhdGNoLm5vZGUsIE1f WEVOQlVTKTsNCj4gLQkJCWl2YXJzLT54ZF9vdGhlcmVuZF93YXRjaC5ub2RlID0gc3RhdGVwYXRo Ow0KPiArCQkJCWZyZWUoaXZhcnMtPnhkX290aGVyZW5kX3dhdGNoLm5vZGUsIE1fWEVOQlVTKTsN Cj4gKwkJCQlpdmFycy0+eGRfb3RoZXJlbmRfd2F0Y2gubm9kZSA9IHN0YXRlcGF0aDsNCj4gKwkJ CX0NCj4gIA0KPiAgCQkJREVWSUNFX1JFU1VNRShraWRzW2ldKTsNCj4gIA0KPiAtCQkJeHNfcmVn aXN0ZXJfd2F0Y2goJml2YXJzLT54ZF9vdGhlcmVuZF93YXRjaCk7DQo+ICsJCQlpZih4ZW5idXNi X3N1c3BlbmRfY2FuY2VsbGVkID09IDApDQo+ICsJCQkJeHNfcmVnaXN0ZXJfd2F0Y2goJml2YXJz LT54ZF9vdGhlcmVuZF93YXRjaCk7DQoNCldoeSBkb24ndCB5b3UganVzdCBhZGQ6DQoNCmlmICh4 ZW5idXNiX3N1c3BlbmRfY2FuY2VsbGVkID09IDEpIHsNCglERVZJQ0VfUkVTVU1FKGtpZHNbaV0p Ow0KCWNvbnRpbnVlOw0KfQ0KDQpUbyB0aGUgdG9wIG9mIHRoZSBsb29wPyBUaGlzIHdvdWxkIHBy ZXNlbnQgYWRkaW5nIGEgYnVuY2ggb2YgbmVzdGVkIGNvbmRpdGlvbmFscy4NCg0KPiAgI2lmIDAN Cj4gIAkJCS8qDQo+ICAJCQkgKiBDYW4ndCBkbyB0aGlzIHlldCBzaW5jZSB3ZSBhcmUgcnVubmlu ZyBpbiBAQCAtODM0LDYgKzg0NCw5IEBAIA0KPiB4ZW5idXNiX3Jlc3VtZShkZXZpY2VfdCBkZXYp DQo+ICAJCWZyZWUoa2lkcywgTV9URU1QKTsNCj4gIAl9DQo+ICANCj4gKwlpZih4ZW5idXNiX3N1 c3BlbmRfY2FuY2VsbGVkID09IDEpDQo+ICsJCXhlbmJ1c2Jfc3VzcGVuZF9jYW5jZWxsZWQgPSAw Ow0KPiArCQ0KPiAgCXJldHVybiAoMCk7DQo+ICB9DQo+ICANCj4gZGlmZiAtLWdpdCBhL3N5cy94 ZW4veGVuYnVzL3hlbmJ1c3Zhci5oIGIvc3lzL3hlbi94ZW5idXMveGVuYnVzdmFyLmggDQo+IGlu ZGV4IGFiNWQwMWYuLmFmZjNiNjAgMTAwNjQ0DQo+IC0tLSBhL3N5cy94ZW4veGVuYnVzL3hlbmJ1 c3Zhci5oDQo+ICsrKyBiL3N5cy94ZW4veGVuYnVzL3hlbmJ1c3Zhci5oDQo+IEBAIC0yNzIsNCAr MjcyLDggQEAgdm9pZCB4ZW5idXNfbG9jYWxlbmRfY2hhbmdlZChkZXZpY2VfdCBkZXYsIGNvbnN0 IA0KPiBjaGFyICpwYXRoKTsNCj4gIA0KPiAgI2luY2x1ZGUgInhlbmJ1c19pZi5oIg0KPiAgDQo+ ICt2b2lkIHhlbmJ1c2Jfc2V0X3N1c3BlbmRfY2FuY2VsKHZvaWQpOyB2b2lkIA0KPiAreGJkX3Nl dF9zdXNwZW5kX2NhbmNlbCh2b2lkKTsgdm9pZCB4bl9zZXRfc3VzcGVuZF9jYW5jZWwodm9pZCk7 DQo+ICsNCj4gICNlbmRpZiAvKiBfWEVOX1hFTkJVU19YRU5CVVNWQVJfSCAqLw0KPiAtLQ0KPiAx LjguMy40DQo+DQo+IEZyb20gNDIzYTk1OWEyNjhiMjA1YzA0ODQ4OWU2YWRkZWJhNWRiNDQ5ZTMy MiBNb24gU2VwIDE3IDAwOjAwOjAwIDIwMDENCj4gRnJvbTogWWluZ2RvbmcgTGl1IDxsaXV5aW5n ZG9uZ0BodWF3ZWkuY29tPg0KPiBEYXRlOiBUaHUsIDE1IERlYyAyMDE2IDA5OjA5OjE2ICswODAw DQo+IFN1YmplY3Q6IFtQQVRDSF0gW1BBVENIXW5ldGZyb250OiBuZWVkIHJlbGVhc2UgYWxsIHJl c291cmNlcyBhZnRlciANCj4gYWRkaW5nIGFuZCAgcmVtb3ZpbmcgTklDcyB0aW1lIGFuZCBhZ2Fp bg0KPiANCj4gLS0tDQo+ICBzeXMvZGV2L3hlbi9uZXRmcm9udC9uZXRmcm9udC5jIHwgNDYNCj4g KysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysNCj4gIDEgZmlsZSBjaGFu Z2VkLCA0NiBpbnNlcnRpb25zKCspDQo+IA0KPiBkaWZmIC0tZ2l0IGEvc3lzL2Rldi94ZW4vbmV0 ZnJvbnQvbmV0ZnJvbnQuYyANCj4gYi9zeXMvZGV2L3hlbi9uZXRmcm9udC9uZXRmcm9udC5jIGlu ZGV4IDBjYWFhMmMuLjViNjdlMTIgMTAwNjQ0DQo+IC0tLSBhL3N5cy9kZXYveGVuL25ldGZyb250 L25ldGZyb250LmMNCj4gKysrIGIvc3lzL2Rldi94ZW4vbmV0ZnJvbnQvbmV0ZnJvbnQuYw0KPiBA QCAtMjE5Niw2ICsyMTk2LDQ2IEBAIG5ldGZyb250X2RldGFjaChkZXZpY2VfdCBkZXYpICB9DQo+ ICANCj4gIHN0YXRpYyB2b2lkDQo+ICtuZXRpZl9yZWxlYXNlX3J4X2J1ZnNfY29weShzdHJ1Y3Qg bmV0ZnJvbnRfaW5mbyAqbnApIHsNCj4gKwlzdHJ1Y3QgbWJ1ZiAqbTsNCj4gKwlpbnQgaSwgcmVm Ow0KPiArCWludCBidXN5ID0gMCwgaW51c2UgPSAwOw0KPiArDQo+ICsJWE5fUlhfTE9DSyhucCk7 DQo+ICsNCj4gKwlmb3IgKGkgPSAwOyBpIDwgTkVUX1JYX1JJTkdfU0laRTsgaSsrKSB7DQo+ICsJ CXJlZiA9IG5wLT5ncmFudF9yeF9yZWZbaV07DQo+ICsNCj4gKwkJaWYgKHJlZiA9PSBHUkFOVF9S RUZfSU5WQUxJRCkNCj4gKwkJCWNvbnRpbnVlOw0KPiArDQo+ICsJCWludXNlKys7DQo+ICsNCj4g KwkJbSA9IG5wLT5yeF9tYnVmc1tpXTsNCj4gKw0KPiArCQlpZiAoIWdudHRhYl9lbmRfZm9yZWln bl9hY2Nlc3NfcmVmKHJlZikpDQo+ICsJCXsNCj4gKwkJCWJ1c3krKzsNCj4gKwkJCWNvbnRpbnVl Ow0KPiArCQl9DQo+ICsNCj4gKwkJZ250dGFiX3JlbGVhc2VfZ3JhbnRfcmVmZXJlbmNlKCZucC0+ Z3JlZl9yeF9oZWFkLCByZWYpOw0KPiArCQlucC0+Z3JhbnRfcnhfcmVmW2ldID0gR1JBTlRfUkVG X0lOVkFMSUQ7DQo+ICsJCWFkZF9pZF90b19mcmVlbGlzdChucC0+cnhfbWJ1ZnMsIGkpOw0KPiAr DQo+ICsJCW1fZnJlZW0obSk7DQo+ICsJfQ0KPiArDQo+ICsJaWYgKGJ1c3kpDQo+ICsJCWRldmlj ZV9wcmludGYobnAtPnhiZGV2LCAiVW5hYmxlIHRvIHJlbGVhc2UgJWQgb2YgJWQgIg0KPiArCQkJ ImludXNlIGdyYW50IHJlZmVyZW5jZXMgb3V0IG9mICVsZCB0b3RhbC5cbiIsDQo+ICsJCQlidXN5 LCBpbnVzZSwgTkVUX1JYX1JJTkdfU0laRSk7DQo+ICsJDQoNClN0cmF5IHRhYi4NCg0KPiArCVhO X1JYX1VOTE9DSyhucCk7DQo+ICt9DQo+ICsNCj4gK3N0YXRpYyB2b2lkDQo+ICBuZXRpZl9mcmVl KHN0cnVjdCBuZXRmcm9udF9pbmZvICppbmZvKSAgew0KPiAgCVhOX0xPQ0soaW5mbyk7DQo+IEBA IC0yMjA5LDYgKzIyNDksMTIgQEAgbmV0aWZfZnJlZShzdHJ1Y3QgbmV0ZnJvbnRfaW5mbyAqaW5m bykNCj4gIAkJaW5mby0+eG5faWZwID0gTlVMTDsNCj4gIAl9DQo+ICAJaWZtZWRpYV9yZW1vdmVh bGwoJmluZm8tPnNjX21lZGlhKTsNCj4gKwluZXRpZl9yZWxlYXNlX3R4X2J1ZnMoaW5mbyk7DQo+ ICsJaWYgKGluZm8tPmNvcHlpbmdfcmVjZWl2ZXIpDQo+ICsJCW5ldGlmX3JlbGVhc2VfcnhfYnVm c19jb3B5KGluZm8pOw0KPiArDQo+ICsJZ250dGFiX2ZyZWVfZ3JhbnRfcmVmZXJlbmNlcyhpbmZv LT5ncmVmX3R4X2hlYWQpOw0KPiArCWdudHRhYl9mcmVlX2dyYW50X3JlZmVyZW5jZXMoaW5mby0+ Z3JlZl9yeF9oZWFkKTsNCj4gIH0NCg0KVGhpcyBwYXRjaCBsb29rcyBmaW5lLCBidXQgaXQgbmVl ZHMgdG8gYmUgcmViYXNlZCBvbiB0b3Agb2YgSEVBRCBpbiBvcmRlciB0byBiZSBhcHBsaWVkLg0K DQpSb2dlci4NCg== --_004_3655E9A8B903724782E1F75DCFD74E6B0122A336E3szxema506mbsc_ Content-Type: application/octet-stream; name="0002-a userspace application need wait until stop_all_proc has finished during live migration.patch" Content-Description: 0002-a userspace application need wait until stop_all_proc has finished during live migration.patch Content-Disposition: attachment; filename="0002-a userspace application need wait until stop_all_proc has finished during live migration.patch"; size=3397; creation-date="Thu, 02 Feb 2017 17:57:58 GMT"; modification-date="Mon, 06 Feb 2017 11:20:59 GMT" Content-Transfer-Encoding: base64 RnJvbSBmNGEwNjYwY2U3N2Y3MmUwZDBjMDhmMzMxNmVkNGQ4Zjc4ZjFiOGFiIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQ0KRnJvbTogbGl1eWluZ2RvbmcgPGxpdXlpbmdkb25nQGh1YXdlaS5jb20+ DQpEYXRlOiBUaHUsIDIgRmViIDIwMTcgMTg6NTE6MDggKzAyMDANClN1YmplY3Q6IElmIHRoZXJl IGlzIGEgdXNlciBwcm9jZXNzIHdoaWNoIG1heWJlIG9mdGVuIHJlYWRzIGFuZCB3cml0ZXMgeGVu c3RvcmUsIHRoZSBhcHBsaWNhdGlvbiBoYXMgYmVlbiBzdXNwZW5kZWQgDQphZnRlciBzdG9wX2Fs bF9wcm9jIGlzIGNhbGxlZC4gSXQgaGVsZCB4cy5yZXF1ZXN0X211dGV4IGxvY2sgYnV0IGluIHRo ZSBmb2xsb3dpbmcgZnVuY3Rpb25zIA0KeHNfd3JpdGUgYW5kIHhzX3N1c3BlbmQgd2lsbCBub3Qg Z2V0IHRoZSBsb2NrLiBTbyB0aGUgVk0gd2lsbCBoYW5nLiANCkluIG9yZGVyIHRvIHByZXZlbnQg dGhpcyBmcm9tIGhhcHBlbmluZywgdGhpcyBwcm9jZXNzIG5lZWQgd2FpdCANCnVudGlsIHN0b3Bf YWxsX3Byb2MgaGFzIGZpbmlzaGVkIGR1cmluZyBsaXZlIG1pZ3JhdGlvbi4NCg0KLS0tDQogZGV2 L3hlbi9jb250cm9sL2NvbnRyb2wuYyAgICAgICAgfCAgMiArKw0KIGRldi94ZW4veGVuc3RvcmUv eGVuc3RvcmUuYyAgICAgIHwgMzEgKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKw0KIGRl di94ZW4veGVuc3RvcmUveGVuc3RvcmVfZGV2LmMgIHwgIDcgKysrKysrKw0KIHhlbi94ZW5zdG9y ZS94ZW5zdG9yZV9pbnRlcm5hbC5oIHwgIDQgKysrKw0KIDQgZmlsZXMgY2hhbmdlZCwgNDQgaW5z ZXJ0aW9ucygrKQ0KDQpkaWZmIC0tZ2l0IGEvZGV2L3hlbi9jb250cm9sL2NvbnRyb2wuYyBiL2Rl di94ZW4vY29udHJvbC9jb250cm9sLmMNCmluZGV4IGFlMTNjNmMuLjU4ZmVmY2MgMTAwNjQ0DQot LS0gYS9kZXYveGVuL2NvbnRyb2wvY29udHJvbC5jDQorKysgYi9kZXYveGVuL2NvbnRyb2wvY29u dHJvbC5jDQpAQCAtMTQ3LDYgKzE0Nyw3IEBAIF9fRkJTRElEKCIkRnJlZUJTRCQiKTsNCiAjaW5j bHVkZSA8eGVuL2ludGVyZmFjZS9ncmFudF90YWJsZS5oPg0KIA0KICNpbmNsdWRlIDx4ZW4veGVu YnVzL3hlbmJ1c3Zhci5oPg0KKyNpbmNsdWRlIDx4ZW4veGVuc3RvcmUveGVuc3RvcmVfaW50ZXJu YWwuaD4NCiANCiAvKi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSBGb3J3YXJkIERlY2xhcmF0 aW9ucyAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLSovDQogLyoqIEZ1bmN0aW9uIHNpZ25hdHVy ZSBmb3Igc2h1dGRvd24gZXZlbnQgaGFuZGxlcnMuICovDQpAQCAtMTk5LDcgKzE5OSw5IEBAIHhj dHJsX3N1c3BlbmQoKQ0KIAlpbnQgc3VzcGVuZF9jYW5jZWxsZWQ7DQogDQogCUVWRU5USEFORExF Ul9JTlZPS0UocG93ZXJfc3VzcGVuZF9lYXJseSk7DQorCXhzX2xvY2soKTsNCiAJc3RvcF9hbGxf cHJvYygpOw0KKwl4c191bmxvY2soKTsNCiAJRVZFTlRIQU5ETEVSX0lOVk9LRShwb3dlcl9zdXNw ZW5kKTsNCiANCiAjaWZkZWYgRUFSTFlfQVBfU1RBUlRVUA0KZGlmZiAtLWdpdCBhL2Rldi94ZW4v eGVuc3RvcmUveGVuc3RvcmUuYyBiL2Rldi94ZW4veGVuc3RvcmUveGVuc3RvcmUuYw0KaW5kZXgg NGY4OWI3NC4uZDQ0ZjA2NCAxMDA2NDQNCi0tLSBhL2Rldi94ZW4veGVuc3RvcmUveGVuc3RvcmUu Yw0KKysrIGIvZGV2L3hlbi94ZW5zdG9yZS94ZW5zdG9yZS5jDQpAQCAtMTI1NSw2ICsxMjU1LDM3 IEBAIHhzX3N1c3BlbmQoZGV2aWNlX3QgZGV2KQ0KIAlyZXR1cm4gKDApOw0KIH0NCiANCitpbnQN Cit4c190cnlfbG9jayh2b2lkKQ0KK3sNCisJLyoNCisJc3hfdHJ5X3Nsb2NrKCkgYW5kIHN4X3Ry eV94bG9jaygpIHdpbGwgcmV0dXJuIDAgaWYgdGhlIHNoYXJlZC9leGNsdXNpdmUNCisJCSBsb2Nr IGNhbm5vdCBiZSBhY3F1aXJlZCBpbW1lZGlhdGVseTsgb3RoZXJ3aXNlIHRoZSBzaGFyZWQvZXhj bHVzaXZlIGxvY2sNCisJCSB3aWxsIGJlIGFjcXVpcmVkIGFuZCBhIG5vbi16ZXJvIHZhbHVlIHdp bGwgYmUgcmV0dXJuZWQuDQorCSovDQorCXJldHVybiBzeF90cnlfeGxvY2soJnhzLnJlcXVlc3Rf bXV0ZXgpOw0KK30NCisNCisvKioNCisgeHNfbG9jayBiZWZvcmUgc3RvcF9hbGxfcHJvYw0KKyAq Lw0KK3ZvaWQNCit4c19sb2NrKHZvaWQpDQorew0KKwlzeF94bG9jaygmeHMucmVxdWVzdF9tdXRl eCk7DQorCXJldHVybjsNCit9DQorDQorLyoqDQorIHhzX3VubG9jayBhZnRlciBzdG9wX2FsbF9w cm9jDQorICovDQordm9pZA0KK3hzX3VubG9jayh2b2lkKQ0KK3sNCisJc3hfeHVubG9jaygmeHMu cmVxdWVzdF9tdXRleCk7DQorCXJldHVybjsNCit9DQorDQogLyoqDQogICogUmVzdW1lIFhlblN0 b3JlIG9wZXJhdGlvbnMgYWZ0ZXIgdGhpcyBWTSBpcyByZXN1bWVkLg0KICAqLw0KZGlmZiAtLWdp dCBhL2Rldi94ZW4veGVuc3RvcmUveGVuc3RvcmVfZGV2LmMgYi9kZXYveGVuL3hlbnN0b3JlL3hl bnN0b3JlX2Rldi5jDQppbmRleCBjZTYyMTQwLi5kNmI5N2MwIDEwMDY0NA0KLS0tIGEvZGV2L3hl bi94ZW5zdG9yZS94ZW5zdG9yZV9kZXYuYw0KKysrIGIvZGV2L3hlbi94ZW5zdG9yZS94ZW5zdG9y ZV9kZXYuYw0KQEAgLTEyOCw2ICsxMjgsMTMgQEAgeHNfZGV2X3dyaXRlKHN0cnVjdCBjZGV2ICpk ZXYsIHN0cnVjdCB1aW8gKnVpbywgaW50IGlvZmxhZykNCiAJaWYgKGVycm9yICE9IDApDQogCQly ZXR1cm4gKGVycm9yKTsNCiANCisJd2hpbGUoIXhzX3RyeV9sb2NrKCkpIHsNCisJCWVycm9yID0g dHNsZWVwKHUsIFBDQVRDSCwgInhzZHdyaXRlIiwgaHovMTApOw0KKwkJaWYgKGVycm9yICYmIGVy cm9yICE9IEVXT1VMREJMT0NLKQ0KKwkJCXJldHVybiAoZXJyb3IpOw0KKwl9DQorCXhzX3VubG9j aygpOw0KKw0KIAlpZiAoKGxlbiArIHUtPmxlbikgPiBzaXplb2YodS0+dS5idWZmZXIpKQ0KIAkJ cmV0dXJuIChFSU5WQUwpOw0KIA0KZGlmZiAtLWdpdCBhL3hlbi94ZW5zdG9yZS94ZW5zdG9yZV9p bnRlcm5hbC5oIGIveGVuL3hlbnN0b3JlL3hlbnN0b3JlX2ludGVybmFsLmgNCmluZGV4IDMzNTVj MjcuLjMxZGI5MzUgMTAwNjQ0DQotLS0gYS94ZW4veGVuc3RvcmUveGVuc3RvcmVfaW50ZXJuYWwu aA0KKysrIGIveGVuL3hlbnN0b3JlL3hlbnN0b3JlX2ludGVybmFsLmgNCkBAIC0zNCwzICszNCw3 IEBADQogDQogLyogVXNlZCBieSB0aGUgWGVuU3RvcmUgY2hhcmFjdGVyIGRldmljZSB0byBib3Jy b3cga2VybmVsJ3Mgc3RvcmUgY29ubmVjdGlvbi4gKi8NCiBpbnQgeHNfZGV2X3JlcXVlc3RfYW5k X3JlcGx5KHN0cnVjdCB4c2Rfc29ja21zZyAqbXNnLCB2b2lkICoqcmVzdWx0KTsNCisNCitpbnQg eHNfdHJ5X2xvY2sodm9pZCk7DQordm9pZCB4c19sb2NrKHZvaWQpOw0KK3ZvaWQgeHNfdW5sb2Nr KHZvaWQpOw0KLS0gDQoyLjExLjAud2luZG93cy4zDQoNCg== --_004_3655E9A8B903724782E1F75DCFD74E6B0122A336E3szxema506mbsc_ Content-Type: application/octet-stream; name="0003-wrong order of device resume causes virtual machine to become unresponsive after live migration.patch" Content-Description: 0003-wrong order of device resume causes virtual machine to become unresponsive after live migration.patch Content-Disposition: attachment; filename="0003-wrong order of device resume causes virtual machine to become unresponsive after live migration.patch"; size=886; creation-date="Thu, 02 Feb 2017 17:58:01 GMT"; modification-date="Thu, 02 Feb 2017 18:38:29 GMT" Content-Transfer-Encoding: base64 RnJvbSA3ODIxNWMwYjExN2ZiN2I2NTFjZjdlNTdhNmEzMjM0MDc0MTNkZGRlIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBsaXV5aW5nZG9uZyA8bGl1eWluZ2RvbmdAaHVhd2VpLmNvbT4K RGF0ZTogVGh1LCAyIEZlYiAyMDE3IDE5OjUyOjMzICswMjAwClN1YmplY3Q6IEJlY2F1c2Ugd3Jv bmcgb3JkZXIgb2YgZGV2aWNlIHJlc3VtZSwgVk0gd2lsbCBoYW5nIGFmdGVyIGxpdmUgbWlncmF0 aW9uLiAKYXR0YWNoIHRoZSBYZW4gUFYgdGltZXIgdG8gdGhlIG5leHVzIGRpcmVjdGx5IGFzIGl0 IHdhcyBkb25lIGJlZm9yZS4KCi0tLQogZGV2L3hlbi90aW1lci90aW1lci5jIHwgNCArKy0tCiAx IGZpbGUgY2hhbmdlZCwgMiBpbnNlcnRpb25zKCspLCAyIGRlbGV0aW9ucygtKQoKZGlmZiAtLWdp dCBhL2Rldi94ZW4vdGltZXIvdGltZXIuYyBiL2Rldi94ZW4vdGltZXIvdGltZXIuYwppbmRleCAw YjI2ODQ3Li5hZThmNjAzIDEwMDY0NAotLS0gYS9kZXYveGVuL3RpbWVyL3RpbWVyLmMKKysrIGIv ZGV2L3hlbi90aW1lci90aW1lci5jCkBAIC01NDYsNSArNTQ2LDUgQEAgc3RhdGljIGRyaXZlcl90 IHhlbnRpbWVyX2RyaXZlciA9IHsKIAlzaXplb2Yoc3RydWN0IHhlbnRpbWVyX3NvZnRjKSwKIH07 CiAKLURSSVZFUl9NT0RVTEUoeGVudGltZXIsIHhlbnB2LCB4ZW50aW1lcl9kcml2ZXIsIHhlbnRp bWVyX2RldmNsYXNzLCAwLCAwKTsKLU1PRFVMRV9ERVBFTkQoeGVudGltZXIsIHhlbnB2LCAxLCAx LCAxKTsKK0RSSVZFUl9NT0RVTEUoeGVudGltZXIsIG5leHVzLCB4ZW50aW1lcl9kcml2ZXIsIHhl bnRpbWVyX2RldmNsYXNzLCAwLCAwKTsKK01PRFVMRV9ERVBFTkQoeGVudGltZXIsIG5leHVzLCAx LCAxLCAxKTsKLS0gCjIuMTEuMC53aW5kb3dzLjMKCg== --_004_3655E9A8B903724782E1F75DCFD74E6B0122A336E3szxema506mbsc_ Content-Type: application/octet-stream; name="0001-introduce suspend_cancel mechanism for frontend devices.patch" Content-Description: 0001-introduce suspend_cancel mechanism for frontend devices.patch Content-Disposition: attachment; filename="0001-introduce suspend_cancel mechanism for frontend devices.patch"; size=6886; creation-date="Thu, 02 Feb 2017 17:58:05 GMT"; modification-date="Thu, 02 Feb 2017 18:43:43 GMT" Content-Transfer-Encoding: base64 RnJvbSAwYWYwNWFjMDFiZTg1MzM0MGIzYjUzODYyZGU5ODUzZDhkNDRjMGM2IE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBsaXV5aW5nZG9uZyA8bGl1eWluZ2RvbmdAaHVhd2VpLmNvbT4K RGF0ZTogVGh1LCAyIEZlYiAyMDE3IDE5OjQwOjQ4ICswMjAwClN1YmplY3Q6IGludHJvZHVjZSBz dXNwZW5kX2NhbmNlbCBtZWNoYW5pc20gZm9yIGZyb250ZW5kIGRldmljZXMuDQoxLjEgT24gYSBj YW5jZWxsZWQgc3VzcGVuZCwgeGVuIGZyb250ZW5kIGRldmljZXMgbmVlZCBrbm93IHRoZWlyIHN0 YXRlIGlzIGludmFyaWFudC4NCjEuMiBPbiBhIGNhbmNlbGxlZCBzdXNwZW5kIHRoZSB2Y3B1X2lu Zm8gbG9jYXRpb24gZG9lcyBub3QgY2hhbmdlIAooaXQncyBzdGlsbCBpbiB0aGUgcGVyLWNwdSBh cmVhIHJlZ2lzdGVyZWQgYnkgeGVuX2h2bV9jcHVfaW5pdCgpKS4gClNvIGRvIG5vdCBjYWxsIHhl bl9odm1faW5pdF9zaGFyZWRfaW5mb19wYWdlKCkgd2hpY2ggd291bGQgbWFrZSB0aGUga2VybmVs IHRoaW5rIGl0cyBiYWNrIGluIHRoZSBzaGFyZWQgaW5mby4gCldpdGggdGhlIHdyb25nIHZjcHVf aW5mbywgZXZlbnRzIGNhbm5vdCBiZSByZWNlaXZlZCBhbmQgdGhlIGRvbWFpbiB3aWxsIGhhbmcg YWZ0ZXIgYSBjYW5jZWxsZWQgc3VzcGVuZC4NCgotLS0KIGRldi94ZW4vYmxrZnJvbnQvYmxrZnJv bnQuYyB8ICA1ICsrKysrCiBkZXYveGVuL2NvbnRyb2wvY29udHJvbC5jICAgfCAxMSArKysrKysr KystLQogZGV2L3hlbi9uZXRmcm9udC9uZXRmcm9udC5jIHwgMjEgKysrKysrKysrKysrKysrKysr KysrCiB4ODYveGVuL2h2bS5jICAgICAgICAgICAgICAgfCAxNiArKysrKysrKysrLS0tLS0tCiB4 ZW4veGVuYnVzL3hlbmJ1c2IuYyAgICAgICAgfCAzNSArKysrKysrKysrKysrKysrKysrLS0tLS0t LS0tLS0tLS0tLQogeGVuL3hlbmJ1cy94ZW5idXN2YXIuaCAgICAgIHwgIDIgKysKIDYgZmlsZXMg Y2hhbmdlZCwgNjYgaW5zZXJ0aW9ucygrKSwgMjQgZGVsZXRpb25zKC0pCgpkaWZmIC0tZ2l0IGEv ZGV2L3hlbi9ibGtmcm9udC9ibGtmcm9udC5jIGIvZGV2L3hlbi9ibGtmcm9udC9ibGtmcm9udC5j CmluZGV4IDllY2EyMjAuLjQ3Y2Q4M2YgMTAwNjQ0Ci0tLSBhL2Rldi94ZW4vYmxrZnJvbnQvYmxr ZnJvbnQuYworKysgYi9kZXYveGVuL2Jsa2Zyb250L2Jsa2Zyb250LmMKQEAgLTE1MzcsNiArMTUz NywxMSBAQCB4YmRfcmVzdW1lKGRldmljZV90IGRldikKIHsKIAlzdHJ1Y3QgeGJkX3NvZnRjICpz YyA9IGRldmljZV9nZXRfc29mdGMoZGV2KTsKIAorCWlmKGdfc3VzcGVuZF9jYW5jZWxsZWQpIHsK KwkJc2MtPnhiZF9zdGF0ZSA9IFhCRF9TVEFURV9DT05ORUNURUQ7CisJCXJldHVybiAoMCk7CisJ fQorCiAJRFBSSU5USygieGJkX3Jlc3VtZTogJXNcbiIsIHhlbmJ1c19nZXRfbm9kZShkZXYpKTsK IAogCXhiZF9mcmVlKHNjKTsKZGlmZiAtLWdpdCBhL2Rldi94ZW4vY29udHJvbC9jb250cm9sLmMg Yi9kZXYveGVuL2NvbnRyb2wvY29udHJvbC5jCmluZGV4IDU4ZmVmY2MuLjRmODQ3MWYgMTAwNjQ0 Ci0tLSBhL2Rldi94ZW4vY29udHJvbC9jb250cm9sLmMKKysrIGIvZGV2L3hlbi9jb250cm9sL2Nv bnRyb2wuYwpAQCAtMTkwLDYgKzE5MCwxMSBAQCB4Y3RybF9yZWJvb3QoKQogCXNodXRkb3duX25p Y2UoMCk7CiB9CiAKK3N0YXRpYyB2b2lkIF9zZXRfc3VzcGVuZF9jYW5jZWxsZWQoYm9vbCBzdXNw ZW5kX2NhbmNlbGxlZCkKK3sKKwlnX3N1c3BlbmRfY2FuY2VsbGVkID0gc3VzcGVuZF9jYW5jZWxs ZWQ7Cit9CisKIHN0YXRpYyB2b2lkCiB4Y3RybF9zdXNwZW5kKCkKIHsKQEAgLTI3OCw3ICsyODMs OSBAQCB4Y3RybF9zdXNwZW5kKCkKIAkvKgogCSAqIFJlc2V0IGdyYW50IHRhYmxlIGluZm8uCiAJ ICovCi0JZ250dGFiX3Jlc3VtZShOVUxMKTsKKwlpZihzdXNwZW5kX2NhbmNlbGxlZCA9PSAwKSAg eworCQlnbnR0YWJfcmVzdW1lKE5VTEwpOworCX0KIAogI2lmZGVmIFNNUAogCWlmICghQ1BVX0VN UFRZKCZjcHVfc3VzcGVuZF9tYXApKSB7CkBAIC0yOTYsNiArMzAzLDcgQEAgeGN0cmxfc3VzcGVu ZCgpCiAJICogRnJlZUJTRCByZWFsbHkgbmVlZHMgdG8gYWRkIERFVklDRV9TVVNQRU5EX0NBTkNF TCBvcgogCSAqIHNpbWlsYXIuCiAJICovCisJX3NldF9zdXNwZW5kX2NhbmNlbGxlZChzdXNwZW5k X2NhbmNlbGxlZCAhPSAwKTsKIAlERVZJQ0VfUkVTVU1FKHJvb3RfYnVzKTsKIAltdHhfdW5sb2Nr KCZHaWFudCk7CiAKQEAgLTMxOSw3ICszMjcsNiBAQCB4Y3RybF9zdXNwZW5kKCkKICNlbmRpZgog CiAJcmVzdW1lX2FsbF9wcm9jKCk7Ci0KIAlFVkVOVEhBTkRMRVJfSU5WT0tFKHBvd2VyX3Jlc3Vt ZSk7CiAKIAlpZiAoYm9vdHZlcmJvc2UpCmRpZmYgLS1naXQgYS9kZXYveGVuL25ldGZyb250L25l dGZyb250LmMgYi9kZXYveGVuL25ldGZyb250L25ldGZyb250LmMKaW5kZXggNDU5NzEyYS4uNTM3 MDE4YSAxMDA2NDQKLS0tIGEvZGV2L3hlbi9uZXRmcm9udC9uZXRmcm9udC5jCisrKyBiL2Rldi94 ZW4vbmV0ZnJvbnQvbmV0ZnJvbnQuYwpAQCAtMTUzLDYgKzE1MywxMCBAQCBzdGF0aWMgaW50IHhu X2dldF9yZXNwb25zZXMoc3RydWN0IG5ldGZyb250X3J4cSAqLAogICAgIHN0cnVjdCBuZXRmcm9u dF9yeF9pbmZvICosIFJJTkdfSURYLCBSSU5HX0lEWCAqLAogICAgIHN0cnVjdCBtYnVmICoqKTsK IAorI2lmZGVmIElORVQKK3N0YXRpYyB2b2lkIG5ldGZyb250X3NlbmRfZmFrZV9hcnAoZGV2aWNl X3QgZGV2LCBzdHJ1Y3QgbmV0ZnJvbnRfaW5mbyAqaW5mbyk7CisjZW5kaWYKKwogI2RlZmluZSB2 aXJ0X3RvX21mbih4KSAodnRvcGh5cyh4KSA+PiBQQUdFX1NISUZUKQogCiAjZGVmaW5lIElOVkFM SURfUDJNX0VOVFJZICh+MFVMKQpAQCAtNDQwLDYgKzQ0NCwyMyBAQCBuZXRmcm9udF9yZXN1bWUo ZGV2aWNlX3QgZGV2KQogewogCXN0cnVjdCBuZXRmcm9udF9pbmZvICppbmZvID0gZGV2aWNlX2dl dF9zb2Z0YyhkZXYpOwogCisJaWYoZ19zdXNwZW5kX2NhbmNlbGxlZCkgeworCQl1X2ludCBpOwor CQlmb3IgKGkgPSAwOyBpIDwgaW5mby0+bnVtX3F1ZXVlczsgaSsrKSB7CisJCSAgICBYTl9SWF9M T0NLKCZpbmZvLT5yeHFbaV0pOworCQkgICAgWE5fVFhfTE9DSygmaW5mby0+dHhxW2ldKTsKKwkJ fQorCQluZXRmcm9udF9jYXJyaWVyX29uKGluZm8pOworCQlmb3IgKGkgPSAwOyBpIDwgaW5mby0+ bnVtX3F1ZXVlczsgaSsrKSB7CisJCSAgICBYTl9SWF9VTkxPQ0soJmluZm8tPnJ4cVtpXSk7CisJ CSAgICBYTl9UWF9VTkxPQ0soJmluZm8tPnR4cVtpXSk7CisJCX0KKyNpZmRlZiBJTkVUCisJCW5l dGZyb250X3NlbmRfZmFrZV9hcnAoZGV2LCBpbmZvKTsKKyNlbmRpZgorCQlyZXR1cm4gKDApOwor CX0KKwogCW5ldGlmX2Rpc2Nvbm5lY3RfYmFja2VuZChpbmZvKTsKIAlyZXR1cm4gKDApOwogfQpk aWZmIC0tZ2l0IGEveDg2L3hlbi9odm0uYyBiL3g4Ni94ZW4vaHZtLmMKaW5kZXggZTEwNjU5ZS4u Yzk2YjdiZSAxMDA2NDQKLS0tIGEveDg2L3hlbi9odm0uYworKysgYi94ODYveGVuL2h2bS5jCkBA IC0yOTcsMTAgKzI5Nyw5IEBAIHhlbl9odm1faW5pdChlbnVtIHhlbl9odm1faW5pdF90eXBlIGlu aXRfdHlwZSkKIAlpbnQgZXJyb3I7CiAJaW50IGk7CiAKLQlpZiAoaW5pdF90eXBlID09IFhFTl9I Vk1fSU5JVF9DQU5DRUxMRURfU1VTUEVORCkKLQkJcmV0dXJuOwotCi0JZXJyb3IgPSB4ZW5faHZt X2luaXRfaHlwZXJjYWxsX3N0dWJzKGluaXRfdHlwZSk7CisJaWYgKGluaXRfdHlwZSAhPSBYRU5f SFZNX0lOSVRfQ0FOQ0VMTEVEX1NVU1BFTkQpIHsKKwkJZXJyb3IgPSB4ZW5faHZtX2luaXRfaHlw ZXJjYWxsX3N0dWJzKGluaXRfdHlwZSk7CisJfQogCiAJc3dpdGNoIChpbml0X3R5cGUpIHsKIAlj YXNlIFhFTl9IVk1fSU5JVF9DT0xEOgpAQCAtMzMxLDYgKzMzMCw4IEBAIHhlbl9odm1faW5pdChl bnVtIHhlbl9odm1faW5pdF90eXBlIGluaXRfdHlwZSkKIAkJQ1BVX0ZPUkVBQ0goaSkKIAkJCURQ Q1BVX0lEX1NFVChpLCB2Y3B1X2luZm8sIE5VTEwpOwogCQlicmVhazsKKwljYXNlIFhFTl9IVk1f SU5JVF9DQU5DRUxMRURfU1VTUEVORDoKKwkJYnJlYWs7CiAJZGVmYXVsdDoKIAkJcGFuaWMoIlVu c3VwcG9ydGVkIEhWTSBpbml0aWFsaXphdGlvbiB0eXBlIik7CiAJfQpAQCAtMzQ0LDcgKzM0NSw5 IEBAIHhlbl9odm1faW5pdChlbnVtIHhlbl9odm1faW5pdF90eXBlIGluaXRfdHlwZSkKIAkgKiBp cyBwYXNzZWQgaW5zaWRlIHRoZSBzdGFydF9pbmZvIHN0cnVjdCBhbmQgaXMgYWxyZWFkeSBzZXQs IHNvIHRoaXMKIAkgKiBmdW5jdGlvbnMgYXJlIG5vLW9wcy4KIAkgKi8KLQl4ZW5faHZtX2luaXRf c2hhcmVkX2luZm9fcGFnZSgpOworCWlmIChpbml0X3R5cGUgIT0gWEVOX0hWTV9JTklUX0NBTkNF TExFRF9TVVNQRU5EKSB7CisJCXhlbl9odm1faW5pdF9zaGFyZWRfaW5mb19wYWdlKCk7CisJfQog CXhlbl9odm1fZGlzYWJsZV9lbXVsYXRlZF9kZXZpY2VzKCk7CiB9IAogCkBAIC0zNjEsNyArMzY0 LDggQEAgeGVuX2h2bV9yZXN1bWUoYm9vbCBzdXNwZW5kX2NhbmNlbGxlZCkKIAkgICAgWEVOX0hW TV9JTklUX0NBTkNFTExFRF9TVVNQRU5EIDogWEVOX0hWTV9JTklUX1JFU1VNRSk7CiAKIAkvKiBS ZWdpc3RlciB2Y3B1X2luZm8gYXJlYSBmb3IgQ1BVIzAuICovCi0JeGVuX2h2bV9jcHVfaW5pdCgp OworCWlmKCFzdXNwZW5kX2NhbmNlbGxlZCkKKwkJeGVuX2h2bV9jcHVfaW5pdCgpOwogfQogIAog c3RhdGljIHZvaWQKZGlmZiAtLWdpdCBhL3hlbi94ZW5idXMveGVuYnVzYi5jIGIveGVuL3hlbmJ1 cy94ZW5idXNiLmMKaW5kZXggM2EwZTU0My4uZmE5YmE2MSAxMDA2NDQKLS0tIGEveGVuL3hlbmJ1 cy94ZW5idXNiLmMKKysrIGIveGVuL3hlbmJ1cy94ZW5idXNiLmMKQEAgLTc5MSwyOSArNzkxLDMy IEBAIHhlbmJ1c2JfcmVzdW1lKGRldmljZV90IGRldikKIAkJCWlmIChkZXZpY2VfZ2V0X3N0YXRl KGtpZHNbaV0pID09IERTX05PVFBSRVNFTlQpCiAJCQkJY29udGludWU7CiAKLQkJCWl2YXJzID0g ZGV2aWNlX2dldF9pdmFycyhraWRzW2ldKTsKKwkJCWlmKCFnX3N1c3BlbmRfY2FuY2VsbGVkKSB7 CisJCQkJaXZhcnMgPSBkZXZpY2VfZ2V0X2l2YXJzKGtpZHNbaV0pOwogCi0JCQl4c191bnJlZ2lz dGVyX3dhdGNoKCZpdmFycy0+eGRfb3RoZXJlbmRfd2F0Y2gpOwotCQkJeGVuYnVzX3NldF9zdGF0 ZShraWRzW2ldLCBYZW5idXNTdGF0ZUluaXRpYWxpc2luZyk7CisJCQkJeHNfdW5yZWdpc3Rlcl93 YXRjaCgmaXZhcnMtPnhkX290aGVyZW5kX3dhdGNoKTsKKwkJCQl4ZW5idXNfc2V0X3N0YXRlKGtp ZHNbaV0sIFhlbmJ1c1N0YXRlSW5pdGlhbGlzaW5nKTsKIAotCQkJLyoKLQkJCSAqIEZpbmQgdGhl IG5ldyBiYWNrZW5kIGRldGFpbHMgYW5kCi0JCQkgKiByZS1yZWdpc3RlciBvdXIgd2F0Y2guCi0J CQkgKi8KLQkJCWVycm9yID0gWEVOQlVTQl9HRVRfT1RIRVJFTkRfTk9ERShkZXYsIGl2YXJzKTsK LQkJCWlmIChlcnJvcikKLQkJCQlyZXR1cm4gKGVycm9yKTsKKwkJCQkvKgorCQkJCSAqIEZpbmQg dGhlIG5ldyBiYWNrZW5kIGRldGFpbHMgYW5kCisJCQkJICogcmUtcmVnaXN0ZXIgb3VyIHdhdGNo LgorCQkJCSAqLworCQkJCWVycm9yID0gWEVOQlVTQl9HRVRfT1RIRVJFTkRfTk9ERShkZXYsIGl2 YXJzKTsKKwkJCQlpZiAoZXJyb3IpCisJCQkJCXJldHVybiAoZXJyb3IpOwogCi0JCQlzdGF0ZXBh dGggPSBtYWxsb2MoaXZhcnMtPnhkX290aGVyZW5kX3BhdGhfbGVuCi0JCQkgICAgKyBzdHJsZW4o Ii9zdGF0ZSIpICsgMSwgTV9YRU5CVVMsIE1fV0FJVE9LKTsKLQkJCXNwcmludGYoc3RhdGVwYXRo LCAiJXMvc3RhdGUiLCBpdmFycy0+eGRfb3RoZXJlbmRfcGF0aCk7CisJCQkJc3RhdGVwYXRoID0g bWFsbG9jKGl2YXJzLT54ZF9vdGhlcmVuZF9wYXRoX2xlbgorCQkJCSAgICArIHN0cmxlbigiL3N0 YXRlIikgKyAxLCBNX1hFTkJVUywgTV9XQUlUT0spOworCQkJCXNwcmludGYoc3RhdGVwYXRoLCAi JXMvc3RhdGUiLCBpdmFycy0+eGRfb3RoZXJlbmRfcGF0aCk7CiAKLQkJCWZyZWUoaXZhcnMtPnhk X290aGVyZW5kX3dhdGNoLm5vZGUsIE1fWEVOQlVTKTsKLQkJCWl2YXJzLT54ZF9vdGhlcmVuZF93 YXRjaC5ub2RlID0gc3RhdGVwYXRoOworCQkJCWZyZWUoaXZhcnMtPnhkX290aGVyZW5kX3dhdGNo Lm5vZGUsIE1fWEVOQlVTKTsKKwkJCQlpdmFycy0+eGRfb3RoZXJlbmRfd2F0Y2gubm9kZSA9IHN0 YXRlcGF0aDsKKwkJCX0KIAogCQkJREVWSUNFX1JFU1VNRShraWRzW2ldKTsKIAotCQkJeHNfcmVn aXN0ZXJfd2F0Y2goJml2YXJzLT54ZF9vdGhlcmVuZF93YXRjaCk7CisJCQlpZighZ19zdXNwZW5k X2NhbmNlbGxlZCkKKwkJCQl4c19yZWdpc3Rlcl93YXRjaCgmaXZhcnMtPnhkX290aGVyZW5kX3dh dGNoKTsKICNpZiAwCiAJCQkvKgogCQkJICogQ2FuJ3QgZG8gdGhpcyB5ZXQgc2luY2Ugd2UgYXJl IHJ1bm5pbmcgaW4KZGlmZiAtLWdpdCBhL3hlbi94ZW5idXMveGVuYnVzdmFyLmggYi94ZW4veGVu YnVzL3hlbmJ1c3Zhci5oCmluZGV4IDM3N2Q2MGMuLjAyYTViZmEgMTAwNjQ0Ci0tLSBhL3hlbi94 ZW5idXMveGVuYnVzdmFyLmgKKysrIGIveGVuL3hlbmJ1cy94ZW5idXN2YXIuaApAQCAtOTksNiAr OTksOCBAQCBYRU5CVVNfQUNDRVNTT1Ioc3RhdGUsCQlTVEFURSwJCQllbnVtIHhlbmJ1c19zdGF0 ZSkKIFhFTkJVU19BQ0NFU1NPUihvdGhlcmVuZF9pZCwJT1RIRVJFTkRfSUQsCQlpbnQpCiBYRU5C VVNfQUNDRVNTT1Iob3RoZXJlbmRfcGF0aCwJT1RIRVJFTkRfUEFUSCwJCWNvbnN0IGNoYXIgKikK IAorYm9vbCBnX3N1c3BlbmRfY2FuY2VsbGVkOworCiAvKioKICAqIFJldHVybiB0aGUgc3RhdGUg b2YgYSBYZW5CdXMgZGV2aWNlLgogICoKLS0gCjIuMTEuMC53aW5kb3dzLjMKCg== --_004_3655E9A8B903724782E1F75DCFD74E6B0122A336E3szxema506mbsc_-- From owner-freebsd-xen@freebsd.org Tue Feb 7 15:37:10 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A59A1CD57F1 for ; Tue, 7 Feb 2017 15:37:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9551C36D for ; Tue, 7 Feb 2017 15:37:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17Fb9ca031554 for ; Tue, 7 Feb 2017 15:37:10 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 15:37:09 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 15:37:10 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #22 from Roger Pau Monn=C3=83=C2=A9 --- Hello, I don't have much time to look into this right now, could you try to create= a flamegraph [0] of this workload, this way we might be able to identify the bottleneck(s). If possible you should create the flamegraph with pmcstat instead of dtrace, the result is going to be much more accurate (specially = when running inside of a VM). [0] http://www.brendangregg.com/blog/2015-03-10/freebsd-flame-graphs.html --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Feb 7 16:44:12 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B5E29CD59FF for ; Tue, 7 Feb 2017 16:44:12 +0000 (UTC) (envelope-from prvs=20456f7be=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.ctxuk.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 33DA21123 for ; Tue, 7 Feb 2017 16:44:11 +0000 (UTC) (envelope-from prvs=20456f7be=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.33,346,1477958400"; d="scan'208";a="40322478" Date: Tue, 7 Feb 2017 16:35:27 +0000 From: freebsd xen To: Liuyingdong CC: "freebsd-xen@freebsd.org" , Suoben , "Zhaojun (Euler)" , Wanglinkai , chuzhaosong , "Wangchunfeng (Ivan)" , "Gaoxiaodong (Leo)" Subject: Re: =?utf-8?B?562U5aSNOiBbUEFUQ0hdbmV0ZnJv?= =?utf-8?Q?nt=3A_need_releas?= =?utf-8?Q?e?= all resources after adding and removing NICs time and again Message-ID: <20170207163527.ba6fgn5kpzjuc7ml@dhcp-3-221.uk.xensource.com> References: <3655E9A8B903724782E1F75DCFD74E6B0122A336E3@szxema506-mbs.china.huawei.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <3655E9A8B903724782E1F75DCFD74E6B0122A336E3@szxema506-mbs.china.huawei.com> User-Agent: NeoMutt/20170128 (1.7.2) X-ClientProxiedBy: AMSPEX02CAS02.citrite.net (10.69.22.113) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 16:44:12 -0000 On Mon, Feb 06, 2017 at 01:54:28PM +0000, Liuyingdong wrote: > Hello Roger, > I want to know what about these patch, Please let me know if you have any questions. > If you think these patch are fine, I want to your checking-in plan. Thanks! Hello, Which patches should I look at? You have sent two emails with patches attached, and I'm confused about which ones should I review: https://lists.freebsd.org/pipermail/freebsd-xen/2017-February/002952.html https://lists.freebsd.org/pipermail/freebsd-xen/2017-February/002957.html Can you also fix your email client to add quotes on replies to emails, and please avoid top-posting. Roger. From owner-freebsd-xen@freebsd.org Tue Feb 7 16:57:08 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9D77DCD5D8D for ; Tue, 7 Feb 2017 16:57:08 +0000 (UTC) (envelope-from liuyingdong@huawei.com) Received: from szxga02-in.huawei.com (szxga02-in.huawei.com [119.145.14.65]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "myname.my.domain", Issuer "www.mirapoint.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 965171AD9 for ; Tue, 7 Feb 2017 16:57:06 +0000 (UTC) (envelope-from liuyingdong@huawei.com) Received: from 172.24.1.60 (EHLO szxema411-hub.china.huawei.com) ([172.24.1.60]) by szxrg02-dlp.huawei.com (MOS 4.3.7-GA FastPath queued) with ESMTP id DUF26426; Wed, 08 Feb 2017 00:55:43 +0800 (CST) Received: from SZXEMA506-MBS.china.huawei.com ([169.254.4.67]) by szxema411-hub.china.huawei.com ([10.82.72.70]) with mapi id 14.03.0235.001; Wed, 8 Feb 2017 00:55:35 +0800 From: Liuyingdong To: "roger.pau@citrix.com" CC: "freebsd-xen@freebsd.org" , Suoben , "Zhaojun (Euler)" , Wanglinkai , chuzhaosong , "Wangchunfeng (Ivan)" , "Gaoxiaodong (Leo)" Subject: =?utf-8?B?562U5aSNOiDnrZTlpI06IFtQQVRDSF1uZXRmcm9udDogbmVlZCByZWxlYXNl?= =?utf-8?B?IGFsbCByZXNvdXJjZXMgYWZ0ZXIgYWRkaW5nIGFuZCByZW1vdmluZyBOSUNz?= =?utf-8?Q?_time_and_again?= Thread-Topic: =?utf-8?B?562U5aSNOiBbUEFUQ0hdbmV0ZnJvbnQ6IG5lZWQgcmVsZWFzZSBhbGwgcmVz?= =?utf-8?B?b3VyY2VzIGFmdGVyIGFkZGluZyBhbmQgcmVtb3ZpbmcgTklDcyB0aW1lIGFu?= =?utf-8?Q?d_again?= Thread-Index: AdKBYv/WHe9z8yhGRz6AxJrIQzYSiQ== Date: Tue, 7 Feb 2017 16:55:34 +0000 Message-ID: Accept-Language: zh-CN, en-US Content-Language: zh-CN X-MS-Has-Attach: X-MS-TNEF-Correlator: MIME-Version: 1.0 X-CFilter-Loop: Reflected X-Mirapoint-Virus-RAPID-Raw: score=unknown(0), refid=str=0001.0A020203.5899FC13.02F3, ss=1, re=0.000, recu=0.000, reip=0.000, cl=1, cld=1, fgs=0, ip=169.254.4.67, so=2013-06-18 04:22:30, dmn=2013-03-21 17:37:32 X-Mirapoint-Loop-Id: 2a736311ff48a22e8d5d1005eb073443 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 16:57:08 -0000 SGkgUm9nZXIsDQogICAgICAgICBJIGFtIHNvIHNvcnJ5IGFuZCBwbGVhc2UgcmV2aWV3IHRuZSBi ZWxvdyBVUkw6DQpodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL3BpcGVybWFpbC9mcmVlYnNkLXhl bi8yMDE3LUZlYnJ1YXJ5LzAwMjk1Ny5odG1sDQoNCuWPkeS7tuS6uu+8mmZyZWVic2QgeGVuDQrm lLbku7bkurrvvJrliJjov47lhqwNCuaKhOmAge+8mmZyZWVic2QteGVuQGZyZWVic2Qub3JnLOe0 ouWllCzotbXlhpss546L5p6X5YevLOWCqOWPrOadviznjovmmKXpo44s6auY5pmT5LicDQrml7bp l7TvvJoyMDE3LTAyLTA3IDE4OjQ0OjE2DQrkuLvpopg6UmU6IOetlOWkjTogW1BBVENIXW5ldGZy b250OiBuZWVkIHJlbGVhc2UgYWxsIHJlc291cmNlcyBhZnRlciBhZGRpbmcgYW5kIHJlbW92aW5n IE5JQ3MgdGltZSBhbmQgYWdhaW4NCg0KT24gTW9uLCBGZWIgMDYsIDIwMTcgYXQgMDE6NTQ6MjhQ TSArMDAwMCwgTGl1eWluZ2Rvbmcgd3JvdGU6DQo+IEhlbGxvIFJvZ2VyLA0KPiAgICAgICAgSSB3 YW50IHRvIGtub3cgd2hhdCBhYm91dCB0aGVzZSBwYXRjaCwgUGxlYXNlIGxldCBtZSBrbm93IGlm IHlvdSBoYXZlIGFueSBxdWVzdGlvbnMuDQo+ICAgICAgICBJZiB5b3UgdGhpbmsgdGhlc2UgcGF0 Y2ggYXJlIGZpbmUsIEkgd2FudCB0byB5b3VyIGNoZWNraW5nLWluIHBsYW4uIFRoYW5rcyENCg0K SGVsbG8sDQoNCldoaWNoIHBhdGNoZXMgc2hvdWxkIEkgbG9vayBhdD8gWW91IGhhdmUgc2VudCB0 d28gZW1haWxzIHdpdGggcGF0Y2hlcyBhdHRhY2hlZCwNCmFuZCBJJ20gY29uZnVzZWQgYWJvdXQg d2hpY2ggb25lcyBzaG91bGQgSSByZXZpZXc6DQoNCmh0dHBzOi8vbGlzdHMuZnJlZWJzZC5vcmcv cGlwZXJtYWlsL2ZyZWVic2QteGVuLzIwMTctRmVicnVhcnkvMDAyOTUyLmh0bWwNCmh0dHBzOi8v bGlzdHMuZnJlZWJzZC5vcmcvcGlwZXJtYWlsL2ZyZWVic2QteGVuLzIwMTctRmVicnVhcnkvMDAy OTU3Lmh0bWwNCg0KQ2FuIHlvdSBhbHNvIGZpeCB5b3VyIGVtYWlsIGNsaWVudCB0byBhZGQgcXVv dGVzIG9uIHJlcGxpZXMgdG8gZW1haWxzLCBhbmQNCnBsZWFzZSBhdm9pZCB0b3AtcG9zdGluZy4N Cg0KUm9nZXIuDQo= From owner-freebsd-xen@freebsd.org Tue Feb 7 17:01:13 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DD0BBCD5FB0 for ; Tue, 7 Feb 2017 17:01:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 668C51C8F for ; Tue, 7 Feb 2017 17:01:13 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17H1CIY071430 for ; Tue, 7 Feb 2017 17:01:13 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 17:01:13 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 17:01:14 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #23 from rainer@ultra-secure.de --- Which event specifier should I use? I can't even run the sample: (freebsd11 ) 0 # pmcstat =E2=80=93S RESOURCE_STALLS.ANY -O out.pmcst= at sleep 10 pmcstat: [options] [commandline] Measure process and/or system performance using hardware performance monitoring counters. Options include: -C (toggle) show cumulative counts -D path create profiles in directory "path" -E (toggle) show counts at process exit -F file write a system-wide callgraph (Kcachegrind format)= to "file" -G file write a system-wide callgraph to "file" -M file print executable/gmon file map to "file" -N (toggle) capture callchains -O file send log output to "file" -P spec allocate a process-private sampling PMC -R file read events from "file" -S spec allocate a system-wide sampling PMC -T start in top mode -W (toggle) show counts per context switch -a file print sampled PCs and callgraph to "file" -c cpu-list set cpus for subsequent system-wide PMCs -d (toggle) track descendants -e use wide history counter for gprof(1) output -f spec pass "spec" to as plugin option -g produce gprof(1) compatible profiles -k dir set the path to the kernel -l secs set duration time -m file print sampled PCs to "file" -n rate set sampling rate -o file send print output to "file" -p spec allocate a process-private counting PMC -q suppress verbosity -r fsroot specify FS root directory -s spec allocate a system-wide counting PMC -t process-spec attach to running processes matching "process-spec" -v increase verbosity -w secs set printing time interval -z depth limit callchain display depth --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Feb 7 17:15:03 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 25059CD54AB for ; Tue, 7 Feb 2017 17:15:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 14C25CEC for ; Tue, 7 Feb 2017 17:15:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17HF2wR014663 for ; Tue, 7 Feb 2017 17:15:02 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 17:15:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 17:15:03 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #24 from rainer@ultra-secure.de --- ok, (freebsd11 ) 64 # pmccontrol -L SOFT CLOCK.PROF CLOCK.HARD CLOCK.STAT LOCK.FAILED PAGE_FAULT.ALL PAGE_FAULT.READ PAGE_FAULT.WRITE Is there a way to get virtualized hardware performance counters in a DomU? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Feb 7 17:19:20 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9D7B7CD554B for ; Tue, 7 Feb 2017 17:19:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8D1B9F1A for ; Tue, 7 Feb 2017 17:19:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17HJKwi022312 for ; Tue, 7 Feb 2017 17:19:20 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 17:19:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 17:19:20 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #25 from Roger Pau Monn=C3=83=C2=A9 --- IIRC this was working fine last time I've tried. Have you loaded the pmc mo= dule (kldload pmc), and which CPU are you using? Note that you also need to enab= le the PMU support in Xen [0] by passing vpmu=3D1 on the Xen command line. PMC.HASWELL(3) lists RESOURCE_STALLS.ANY as a valid event. If that doesn't = work (or is too complicated to setup) I would try with dtrace, and let's see wha= t we get. [0] http://xenbits.xenproject.org/docs/unstable/misc/xen-command-line.html --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Feb 7 17:25:45 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 20BF0CD5769 for ; Tue, 7 Feb 2017 17:25:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 104E91382 for ; Tue, 7 Feb 2017 17:25:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17HPioN040401 for ; Tue, 7 Feb 2017 17:25:44 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 17:25:45 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 17:25:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #26 from rainer@ultra-secure.de --- Created attachment 179716 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D179716&action= =3Dedit flamegraph dtrace This is running the example on Brendan's page with dtrace.=20 While the VM was processing a dc3dd wipe command. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Feb 7 17:30:12 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D3FD9CD582F for ; Tue, 7 Feb 2017 17:30:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A9FEB15DF for ; Tue, 7 Feb 2017 17:30:12 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17HUCHU048376 for ; Tue, 7 Feb 2017 17:30:12 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 17:30:12 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 17:30:12 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #27 from rainer@ultra-secure.de --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #25) (freebsd11 ) 0 # kldload pmc kldload: can't load pmc: module already loaded or in kernel (freebsd11 ) 1 # kldstat=20 Id Refs Address Size Name 1 49 0xffffffff80200000 1fa7c38 kernel 2 1 0xffffffff821a9000 30aec0 zfs.ko 3 11 0xffffffff824b4000 adc0 opensolaris.ko 4 1 0xffffffff824bf000 1620 accf_data.ko 5 1 0xffffffff824c1000 2710 accf_http.ko 6 1 0xffffffff824c4000 3a78 cc_htcp.ko 7 1 0xffffffff82619000 587b fdescfs.ko 8 1 0xffffffff8261f000 3710 ums.ko 9 1 0xffffffff82623000 665d nullfs.ko 10 1 0xffffffff8262a000 adec tmpfs.ko 11 1 0xffffffff82635000 1bb42 hwpmc.ko 12 1 0xffffffff82651000 848 dtraceall.ko 13 9 0xffffffff82652000 3d890 dtrace.ko 14 1 0xffffffff82690000 4860 dtmalloc.ko 15 1 0xffffffff82695000 5aef dtnfscl.ko 16 1 0xffffffff8269b000 6832 fbt.ko 17 1 0xffffffff826a2000 585be fasttrap.ko 18 1 0xffffffff826fb000 172e sdt.ko 19 1 0xffffffff826fd000 cf3d systrace.ko 20 1 0xffffffff8270a000 cd44 systrace_freebsd32.ko 21 1 0xffffffff82717000 535e profile.ko Do you have an idea what has to be done on XenServer to enable PMU? In any case, I cannot do any configuration on Dom0. My coworker would have = to do that tomorrow (CET) Best Regards Rainer --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Feb 7 18:19:46 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0E426CD5710 for ; Tue, 7 Feb 2017 18:19:46 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F235A19DA for ; Tue, 7 Feb 2017 18:19:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17IJjgt093403 for ; Tue, 7 Feb 2017 18:19:45 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 18:19:46 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 18:19:46 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #28 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to rainer from comment #26) Thanks! This shows that the guest is mostly inactive (low CPU load), is this correc= t? I'm attaching a patch to add some debug to blkfront, please be aware that things might get noisy. Can you post the dmesg after running your workload = with this patch? Thanks, Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Tue Feb 7 18:20:36 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D5A9BCD5761 for ; Tue, 7 Feb 2017 18:20:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BE59B1A30 for ; Tue, 7 Feb 2017 18:20:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v17IKaBr094927 for ; Tue, 7 Feb 2017 18:20:36 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Tue, 07 Feb 2017 18:20:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Feb 2017 18:20:36 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #29 from Roger Pau Monn=C3=83=C2=A9 --- Created attachment 179717 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D179717&action= =3Dedit Initial debug patch --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Feb 8 08:28:18 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 521F6CD4150 for ; Wed, 8 Feb 2017 08:28:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 41E841781 for ; Wed, 8 Feb 2017 08:28:18 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v188SHCG077818 for ; Wed, 8 Feb 2017 08:28:18 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Wed, 08 Feb 2017 08:28:18 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 08:28:18 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #30 from rainer@ultra-secure.de --- Hi, I compiled a new kernel with this. Where would the messages show up? Anything special I need to add to GENERIC? Or a flag at booting? Sorry to sound so dumb. I stopped paying attention to building FreeBSD once binary patches became available... --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Feb 8 09:41:49 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id A80E3CD5B79 for ; Wed, 8 Feb 2017 09:41:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8D586C2C for ; Wed, 8 Feb 2017 09:41:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v189flOX077689 for ; Wed, 8 Feb 2017 09:41:49 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Wed, 08 Feb 2017 09:41:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 09:41:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #31 from Roger Pau Monn=C3=83=C2=A9 --- You should see the messages in dmesg (if any), just execute: # dmesg As root from the console after having run your workload. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Wed Feb 8 12:05:19 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7349BCD5D9D for ; Wed, 8 Feb 2017 12:05:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 496562ED for ; Wed, 8 Feb 2017 12:05:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v18C5JZc077297 for ; Wed, 8 Feb 2017 12:05:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Wed, 08 Feb 2017 12:05:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Feb 2017 12:05:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #32 from rainer@ultra-secure.de --- No, can't see anything. I believe I compiled the kernel correctly: (freebsd11 ) 0 # strings /boot/kernel/kernel|grep Freez Sequencer On QFreeze and Complete list:=20 Chan %d Freeze simq (loopdown) %s: Freezing devq for target ID %d Freezing with flag: %d count: %d used ring slots: %u from dmesg xn0: at device/vif/0 on xenbusb_front0 xn0: bpf attached xn0: Ethernet address: 02:00:2b:42:00:12 random: harvesting attach, 8 bytes (4 bits) from xn0 random: harvesting attach, 8 bytes (4 bits) from xenbusb_front0 xenbusb_back0: on xenstore0 random: harvesting attach, 8 bytes (4 bits) from xenbusb_back0 xbd1: 51200MB at device/vbd/832 on xenbusb_front0 xbd1: attaching as ada1 xbd1: features: write_barrier xbd1: synchronize cache commands enabled. xbd2: 25600MB at device/vbd/768 on xenbusb_front0 xbd2: attaching as ada0 xbd2: features: write_barrier xbd2: synchronize cache commands enabled. xn0: backend features: feature-sg feature-gso-tcp4 lapic2: CMCI unmasked SMP: AP CPU #1 Launched! cpu1 AP: ID: 0x02000000 VER: 0x00050014 LDR: 0x00000000 DFR: 0xffffffff x2API= C: 0 lint0: 0x00010700 lint1: 0x00000400 TPR: 0x00000000 SVR: 0x000001ff timer: 0x000100ef therm: 0x00010000 err: 0x000000f0 pmc: 0x00010400 ioapic0: routing intpin 1 (ISA IRQ 1) to lapic 2 vector 48 ioapic0: routing intpin 7 (ISA IRQ 7) to lapic 2 vector 49 ioapic0: routing intpin 12 (ISA IRQ 12) to lapic 2 vector 50 ioapic0: routing intpin 15 (ISA IRQ 15) to lapic 2 vector 51 TSC timecounter discards lower 1 bit(s) Timecounter "TSC-low" frequency 1296782624 Hz quality -100 Trying to mount root from zfs:zroot/ROOT/default []... GEOM: new disk ada1 GEOM: new disk ada0 ugen0.2: at usbus0 start_init: trying /sbin/init xn0: 2 link states coalesced xn0: link state changed to UP ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=3D0 random: harvesting attach, 8 bytes (4 bits) from ums0 hwpc_core: unknown PMC architecture: 0 hwpmc: SOFT/16/64/0x67 --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 14:17:59 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ED53CCD8396 for ; Fri, 10 Feb 2017 14:17:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D246BBB2 for ; Fri, 10 Feb 2017 14:17:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AEHxOW085962 for ; Fri, 10 Feb 2017 14:17:59 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 14:18:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 14:18:00 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #33 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to rainer from comment #32) That was a possible outcome. I have a box half-setup for this, I will try to reproduce it tomorrow (Saturday), and see if I can get any useful data. As a last thing, could you post the output of `vmstat -ai` just after running yo= ur workload? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 15:12:33 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BD35ECD8D51 for ; Fri, 10 Feb 2017 15:12:33 +0000 (UTC) (envelope-from prvs=2075b848f=roger.pau@citrix.com) Received: from SMTP.EU.CITRIX.COM (smtp.eu.citrix.com [185.25.65.24]) (using TLSv1.2 with cipher RC4-SHA (128/128 bits)) (Client CN "mail.citrix.com", Issuer "DigiCert SHA2 Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0D4771CAF for ; Fri, 10 Feb 2017 15:12:32 +0000 (UTC) (envelope-from prvs=2075b848f=roger.pau@citrix.com) X-IronPort-AV: E=Sophos;i="5.35,141,1484006400"; d="scan'208";a="40556442" Date: Fri, 10 Feb 2017 15:12:25 +0000 From: "roger.pau@citrix.com" To: Liuyingdong CC: "freebsd-xen@freebsd.org" , Suoben , "Zhaojun (Euler)" , Wanglinkai , chuzhaosong , "Wangchunfeng (Ivan)" , "Gaoxiaodong (Leo)" Subject: Multiple patch review (was: =?utf-8?B?UmU6?= =?utf-8?B?IOetlOWkjTog562U5aSNOiBbUEFUQ0hdbmV0ZnJvbnQ6IG5lZWQgcmVsZWFz?= =?utf-8?Q?e?= all resources) after adding and removing NICs time and again Message-ID: <20170210151225.ez2upgqws3pfjxa2@dhcp-3-221.uk.xensource.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: NeoMutt/20170206 (1.7.2) X-ClientProxiedBy: AMSPEX02CAS01.citrite.net (10.69.22.112) To AMSPEX02CL02.citrite.net (10.69.22.126) X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 15:12:33 -0000 On Tue, Feb 07, 2017 at 04:55:34PM +0000, Liuyingdong wrote: > Hi Roger, > I am so sorry and please review tne below URL: > https://lists.freebsd.org/pipermail/freebsd-xen/2017-February/002957.html Hello, Thanks for the patches, and sorry for the delay. It seems like you have not applied some of my comments, so I will have to re-post them here. If some of the comments don't apply for whatever reason, please reply back and explain why, or else this is not going to progress in an useful way for any of us. I would also request you to look into using `git send-email`, reviewing your patches as attachments is not very comfortable. Or else, you could create an account to https://reviews.freebsd.org/ and upload the patches there assigning me as a reviewer. When replying, can you also make sure that you reply in-line to my comments, or else it's very hard to follow the conversation. --- > From 0af05ac01be853340b3b53862de9853d8d44c0c6 Mon Sep 17 00:00:00 2001 > From: liuyingdong > Date: Thu, 2 Feb 2017 19:40:48 +0200 > Subject: introduce suspend_cancel mechanism for frontend devices. > 1.1 On a cancelled suspend, xen frontend devices need know their state is invariant. > 1.2 On a cancelled suspend the vcpu_info location does not change > (it's still in the per-cpu area registered by xen_hvm_cpu_init()). > So do not call xen_hvm_init_shared_info_page() which would make the kernel think its back in the shared info. > With the wrong vcpu_info, events cannot be received and the domain will hang after a cancelled suspend. > > --- > dev/xen/blkfront/blkfront.c | 5 +++++ > dev/xen/control/control.c | 11 +++++++++-- > dev/xen/netfront/netfront.c | 21 +++++++++++++++++++++ > x86/xen/hvm.c | 16 ++++++++++------ > xen/xenbus/xenbusb.c | 35 +++++++++++++++++++---------------- > xen/xenbus/xenbusvar.h | 2 ++ > 6 files changed, 66 insertions(+), 24 deletions(-) > > diff --git a/dev/xen/blkfront/blkfront.c b/dev/xen/blkfront/blkfront.c > index 9eca220..47cd83f 100644 > --- a/dev/xen/blkfront/blkfront.c > +++ b/dev/xen/blkfront/blkfront.c > @@ -1537,6 +1537,11 @@ xbd_resume(device_t dev) > { > struct xbd_softc *sc = device_get_softc(dev); > > + if(g_suspend_cancelled) { > + sc->xbd_state = XBD_STATE_CONNECTED; > + return (0); > + } > + > DPRINTK("xbd_resume: %s\n", xenbus_get_node(dev)); > > xbd_free(sc); > diff --git a/dev/xen/control/control.c b/dev/xen/control/control.c > index 58fefcc..4f8471f 100644 > --- a/dev/xen/control/control.c > +++ b/dev/xen/control/control.c > @@ -190,6 +190,11 @@ xctrl_reboot() > shutdown_nice(0); > } > > +static void _set_suspend_cancelled(bool suspend_cancelled) > +{ > + g_suspend_cancelled = suspend_cancelled; > +} > + > static void > xctrl_suspend() > { > @@ -278,7 +283,9 @@ xctrl_suspend() > /* > * Reset grant table info. > */ > - gnttab_resume(NULL); > + if(suspend_cancelled == 0) { > + gnttab_resume(NULL); > + } > > #ifdef SMP > if (!CPU_EMPTY(&cpu_suspend_map)) { > @@ -296,6 +303,7 @@ xctrl_suspend() > * FreeBSD really needs to add DEVICE_SUSPEND_CANCEL or > * similar. > */ > + _set_suspend_cancelled(suspend_cancelled != 0); No need for this helper, you can just s/suspend_cancelled/xen_suspend_called/ and make it global. > DEVICE_RESUME(root_bus); > mtx_unlock(&Giant); > > @@ -319,7 +327,6 @@ xctrl_suspend() > #endif > > resume_all_proc(); > - Stray change. > EVENTHANDLER_INVOKE(power_resume); > > if (bootverbose) > diff --git a/dev/xen/netfront/netfront.c b/dev/xen/netfront/netfront.c > index 459712a..537018a 100644 > --- a/dev/xen/netfront/netfront.c > +++ b/dev/xen/netfront/netfront.c > @@ -153,6 +153,10 @@ static int xn_get_responses(struct netfront_rxq *, > struct netfront_rx_info *, RING_IDX, RING_IDX *, > struct mbuf **); > > +#ifdef INET > +static void netfront_send_fake_arp(device_t dev, struct netfront_info *info); > +#endif > + > #define virt_to_mfn(x) (vtophys(x) >> PAGE_SHIFT) > > #define INVALID_P2M_ENTRY (~0UL) > @@ -440,6 +444,23 @@ netfront_resume(device_t dev) > { > struct netfront_info *info = device_get_softc(dev); > > + if(g_suspend_cancelled) { > + u_int i; > + for (i = 0; i < info->num_queues; i++) { > + XN_RX_LOCK(&info->rxq[i]); > + XN_TX_LOCK(&info->txq[i]); Bad indentation, you should use tabs (not spaces). > + } > + netfront_carrier_on(info); > + for (i = 0; i < info->num_queues; i++) { > + XN_RX_UNLOCK(&info->rxq[i]); > + XN_TX_UNLOCK(&info->txq[i]); Bad indentation, you should use tabs (not spaces). > + } > +#ifdef INET > + netfront_send_fake_arp(dev, info); > +#endif I don't think you need to send an ARP on a cancelled suspend, the bridge should already have the mac address of the virtual interface in it's cache right? > + return (0); > + } > + > netif_disconnect_backend(info); > return (0); > } > diff --git a/x86/xen/hvm.c b/x86/xen/hvm.c > index e10659e..c96b7be 100644 > --- a/x86/xen/hvm.c > +++ b/x86/xen/hvm.c > @@ -297,10 +297,9 @@ xen_hvm_init(enum xen_hvm_init_type init_type) > int error; > int i; > > - if (init_type == XEN_HVM_INIT_CANCELLED_SUSPEND) > - return; > - > - error = xen_hvm_init_hypercall_stubs(init_type); > + if (init_type != XEN_HVM_INIT_CANCELLED_SUSPEND) { > + error = xen_hvm_init_hypercall_stubs(init_type); > + } > > switch (init_type) { > case XEN_HVM_INIT_COLD: > @@ -331,6 +330,8 @@ xen_hvm_init(enum xen_hvm_init_type init_type) > CPU_FOREACH(i) > DPCPU_ID_SET(i, vcpu_info, NULL); > break; > + case XEN_HVM_INIT_CANCELLED_SUSPEND: > + break; > default: > panic("Unsupported HVM initialization type"); > } > @@ -344,7 +345,9 @@ xen_hvm_init(enum xen_hvm_init_type init_type) > * is passed inside the start_info struct and is already set, so this > * functions are no-ops. > */ > - xen_hvm_init_shared_info_page(); > + if (init_type != XEN_HVM_INIT_CANCELLED_SUSPEND) { > + xen_hvm_init_shared_info_page(); > + } > xen_hvm_disable_emulated_devices(); I'm not sure I follow why this change to xen_hvm_init is needed, on a cancelled suspend you shouldn't need to re-set the callback vector or unplug any emulated devices. > > @@ -361,7 +364,8 @@ xen_hvm_resume(bool suspend_cancelled) > XEN_HVM_INIT_CANCELLED_SUSPEND : XEN_HVM_INIT_RESUME); > > /* Register vcpu_info area for CPU#0. */ > - xen_hvm_cpu_init(); > + if(!suspend_cancelled) > + xen_hvm_cpu_init(); Seeing this here, why don't we just avoid calling xen_hvm_resume from xctrl_suspend on a cancelled suspend? > > static void > diff --git a/xen/xenbus/xenbusb.c b/xen/xenbus/xenbusb.c > index 3a0e543..fa9ba61 100644 > --- a/xen/xenbus/xenbusb.c > +++ b/xen/xenbus/xenbusb.c > @@ -791,29 +791,32 @@ xenbusb_resume(device_t dev) > if (device_get_state(kids[i]) == DS_NOTPRESENT) > continue; > > - ivars = device_get_ivars(kids[i]); > + if(!g_suspend_cancelled) { > + ivars = device_get_ivars(kids[i]); > > - xs_unregister_watch(&ivars->xd_otherend_watch); > - xenbus_set_state(kids[i], XenbusStateInitialising); > + xs_unregister_watch(&ivars->xd_otherend_watch); > + xenbus_set_state(kids[i], XenbusStateInitialising); > > - /* > - * Find the new backend details and > - * re-register our watch. > - */ > - error = XENBUSB_GET_OTHEREND_NODE(dev, ivars); > - if (error) > - return (error); > + /* > + * Find the new backend details and > + * re-register our watch. > + */ > + error = XENBUSB_GET_OTHEREND_NODE(dev, ivars); > + if (error) > + return (error); > > - statepath = malloc(ivars->xd_otherend_path_len > - + strlen("/state") + 1, M_XENBUS, M_WAITOK); > - sprintf(statepath, "%s/state", ivars->xd_otherend_path); > + statepath = malloc(ivars->xd_otherend_path_len > + + strlen("/state") + 1, M_XENBUS, M_WAITOK); > + sprintf(statepath, "%s/state", ivars->xd_otherend_path); > > - free(ivars->xd_otherend_watch.node, M_XENBUS); > - ivars->xd_otherend_watch.node = statepath; > + free(ivars->xd_otherend_watch.node, M_XENBUS); > + ivars->xd_otherend_watch.node = statepath; > + } > > DEVICE_RESUME(kids[i]); > > - xs_register_watch(&ivars->xd_otherend_watch); > + if(!g_suspend_cancelled) > + xs_register_watch(&ivars->xd_otherend_watch); > #if 0 Why don't you just add: if (xenbusb_suspend_cancelled == 1) { DEVICE_RESUME(kids[i]); continue; } To the top of the loop? This would prevent adding a bunch of nested conditionals. > /* > * Can't do this yet since we are running in > diff --git a/xen/xenbus/xenbusvar.h b/xen/xenbus/xenbusvar.h > index 377d60c..02a5bfa 100644 > --- a/xen/xenbus/xenbusvar.h > +++ b/xen/xenbus/xenbusvar.h > @@ -99,6 +99,8 @@ XENBUS_ACCESSOR(state, STATE, enum xenbus_state) > XENBUS_ACCESSOR(otherend_id, OTHEREND_ID, int) > XENBUS_ACCESSOR(otherend_path, OTHEREND_PATH, const char *) > > +bool g_suspend_cancelled; This should be called xen_suspend_cancelled, and it would be better to place it in xen/xen-os.h instead. Also I'm not sure how that even compiles, isn't this missing an "extern" keyword in front? > + > /** > * Return the state of a XenBus device. > * > -- > 2.11.0.windows.3 --- > From f4a0660ce77f72e0d0c08f3316ed4d8f78f1b8ab Mon Sep 17 00:00:00 2001 > From: liuyingdong > Date: Thu, 2 Feb 2017 18:51:08 +0200 > Subject: If there is a user process which maybe often reads and writes xenstore, the application has been suspended > after stop_all_proc is called. It held xs.request_mutex lock but in the following functions > xs_write and xs_suspend will not get the lock. So the VM will hang. > In order to prevent this from happening, this process need wait > until stop_all_proc has finished during live migration. > > --- > dev/xen/control/control.c | 2 ++ > dev/xen/xenstore/xenstore.c | 31 +++++++++++++++++++++++++++++++ > dev/xen/xenstore/xenstore_dev.c | 7 +++++++ > xen/xenstore/xenstore_internal.h | 4 ++++ > 4 files changed, 44 insertions(+) > > diff --git a/dev/xen/control/control.c b/dev/xen/control/control.c > index ae13c6c..58fefcc 100644 > --- a/dev/xen/control/control.c > +++ b/dev/xen/control/control.c > @@ -147,6 +147,7 @@ __FBSDID("$FreeBSD$"); > #include > > #include > +#include > > /*--------------------------- Forward Declarations --------------------------*/ > /** Function signature for shutdown event handlers. */ > @@ -199,7 +199,9 @@ xctrl_suspend() > int suspend_cancelled; > > EVENTHANDLER_INVOKE(power_suspend_early); > + xs_lock(); > stop_all_proc(); > + xs_unlock(); This seems fine, although I think that a better solution would be to simply don't use such kind of locks, and allow concurrent access to the ring by properly using the xenstore ids, but that involves a non-trivial amount of code. > EVENTHANDLER_INVOKE(power_suspend); > > #ifdef EARLY_AP_STARTUP > diff --git a/dev/xen/xenstore/xenstore.c b/dev/xen/xenstore/xenstore.c > index 4f89b74..d44f064 100644 > --- a/dev/xen/xenstore/xenstore.c > +++ b/dev/xen/xenstore/xenstore.c > @@ -1255,6 +1255,37 @@ xs_suspend(device_t dev) > return (0); > } > > +int > +xs_try_lock(void) > +{ > + /* > + sx_try_slock() and sx_try_xlock() will return 0 if the shared/exclusive > + lock cannot be acquired immediately; otherwise the shared/exclusive lock > + will be acquired and a non-zero value will be returned. > + */ > + return sx_try_xlock(&xs.request_mutex); > +} I don't think you need this at all, see below... [...] > diff --git a/dev/xen/xenstore/xenstore_dev.c b/dev/xen/xenstore/xenstore_dev.c > index ce62140..d6b97c0 100644 > --- a/dev/xen/xenstore/xenstore_dev.c > +++ b/dev/xen/xenstore/xenstore_dev.c > @@ -128,6 +128,13 @@ xs_dev_write(struct cdev *dev, struct uio *uio, int ioflag) > if (error != 0) > return (error); > > + while(!xs_try_lock()) { > + error = tsleep(u, PCATCH, "xsdwrite", hz/10); > + if (error && error != EWOULDBLOCK) > + return (error); > + } > + xs_unlock(); Why do you need this try_lock/unlock construction here? It is not protecting you against anything, the more that you don't perform any actual work with the lock held. > if ((len + u->len) > sizeof(u->u.buffer)) > return (EINVAL); > > diff --git a/xen/xenstore/xenstore_internal.h b/xen/xenstore/xenstore_internal.h > index 3355c27..31db935 100644 > --- a/xen/xenstore/xenstore_internal.h > +++ b/xen/xenstore/xenstore_internal.h > @@ -34,3 +34,7 @@ > > /* Used by the XenStore character device to borrow kernel's store connection. */ > int xs_dev_request_and_reply(struct xsd_sockmsg *msg, void **result); > + > +int xs_try_lock(void); > +void xs_lock(void); > +void xs_unlock(void); > -- > 2.11.0.windows.3 --- > From 78215c0b117fb7b651cf7e57a6a323407413ddde Mon Sep 17 00:00:00 2001 > From: liuyingdong > Date: Thu, 2 Feb 2017 19:52:33 +0200 > Subject: Because wrong order of device resume, VM will hang after live migration. > attach the Xen PV timer to the nexus directly as it was done before. > > --- > dev/xen/timer/timer.c | 4 ++-- > 1 file changed, 2 insertions(+), 2 deletions(-) > > diff --git a/dev/xen/timer/timer.c b/dev/xen/timer/timer.c > index 0b26847..ae8f603 100644 > --- a/dev/xen/timer/timer.c > +++ b/dev/xen/timer/timer.c > @@ -546,5 +546,5 @@ static driver_t xentimer_driver = { > sizeof(struct xentimer_softc), > }; > > -DRIVER_MODULE(xentimer, xenpv, xentimer_driver, xentimer_devclass, 0, 0); > -MODULE_DEPEND(xentimer, xenpv, 1, 1, 1); > +DRIVER_MODULE(xentimer, nexus, xentimer_driver, xentimer_devclass, 0, 0); > +MODULE_DEPEND(xentimer, nexus, 1, 1, 1); No, this is not how this should be solved. I understand that you might not want to implement the full solution proposed in freebsd-arch [0], but going back to Xen devices attaching directly to the nexus is also not an option IMHO. What I would accept is marking the Xen time-counter as not safe for suspension, so that FreeBSD itself will switch to a different timer when suspending. This simply means removing the TC_FLAGS_SUSPEND_SAFE from the timecounter flags. Please add a "FIXME" comment, explaining why this is disabled, and when it could be enabled again. Could you please test that, and see if it solves your issues? Thanks, Roger [0] https://lists.freebsd.org/pipermail/freebsd-arch/2016-December/018041.html From owner-freebsd-xen@freebsd.org Fri Feb 10 16:35:09 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 09CDFCD90EB for ; Fri, 10 Feb 2017 16:35:09 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id ED89F1E80 for ; Fri, 10 Feb 2017 16:35:08 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AGZ7LL073914 for ; Fri, 10 Feb 2017 16:35:08 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 16:35:07 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 16:35:09 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #34 from rainer@ultra-secure.de --- Created attachment 179837 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D179837&action= =3Dedit vmstat -ai before running dc3dd --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 16:35:34 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 717E0CD9116 for ; Fri, 10 Feb 2017 16:35:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 612641EC5 for ; Fri, 10 Feb 2017 16:35:34 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AGZYWb074621 for ; Fri, 10 Feb 2017 16:35:34 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 16:35:34 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 16:35:34 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #35 from rainer@ultra-secure.de --- Created attachment 179838 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D179838&action= =3Dedit vmstat -ai while running dc3dd --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 16:36:36 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E144ECD9145 for ; Fri, 10 Feb 2017 16:36:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D11C21F0F for ; Fri, 10 Feb 2017 16:36:36 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AGaaDG076453 for ; Fri, 10 Feb 2017 16:36:36 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 16:36:36 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 16:36:37 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #36 from rainer@ultra-secure.de --- Hi, I added the output. As I said, I could give ssh access to the box, if you want. I would need your ssh key. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 16:42:01 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D3E7CD92F6 for ; Fri, 10 Feb 2017 16:42:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4412C188 for ; Fri, 10 Feb 2017 16:42:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AGg0e2091733 for ; Fri, 10 Feb 2017 16:42:01 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 16:42:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 16:42:01 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #37 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #33) So I've run the dc3dd test on a FreeBSD VM, with 4 vCPUs and 4GB of RAM, against a block device on a spinning disk, nothing fancy, and this is what I get: (FreeBSD guest) # dc3dd wipe=3D/dev/ada1 dc3dd 7.2.641 started at 2017-02-10 16:19:54 +0000 compiled options: command line: dc3dd wipe=3D/dev/ada1 device size: 20971520 sectors (probed), 10,737,418,240 bytes sector size: 512 bytes (probed) 10737418240 bytes ( 10 G ) copied ( 100% ), 125 s, 82 M/s input results for pattern `00': 20971520 sectors in output results for device `/dev/ada1': 20971520 sectors out dc3dd completed at 2017-02-10 16:21:58 +0000 Then I shut down the guest, and ran the same test from Dom0 (Debian Linux 3= .16) against the same exact block device, and this is what I get: (Linux Dom0) # dc3dd wipe=3D/dev/dt51-vg/test dc3dd 7.2.641 started at 2017-02-10 16:31:34 +0000 compiled options: command line: dc3dd wipe=3D/dev/dt51-vg/test device size: 20971520 sectors (probed), 10,737,418,240 bytes sector size: 512 bytes (probed) 10737418240 bytes ( 10 G ) copied ( 100% ), 114 s, 90 M/s input results for pattern `00': 20971520 sectors in output results for device `/dev/dt51-vg/test': 20971520 sectors out dc3dd completed at 2017-02-10 16:33:28 +0000 So there's a < 10M/s difference, which I think it's fine (at the end there's always some overhead). I cannot really explain the results that you get, but I cannot also reprodu= ce your entire setup here. This is using the 12.0-CURRENT snapshot from 201702= 03. I'm afraid that unless we find a way for me to reproduce this, there's no w= ay that I can try to fix it. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 17:01:19 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B0091CD9A00 for ; Fri, 10 Feb 2017 17:01:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9E962E54 for ; Fri, 10 Feb 2017 17:01:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AH1Jvf047130 for ; Fri, 10 Feb 2017 17:01:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 17:01:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 17:01:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #38 from rainer@ultra-secure.de --- Well, for some it works, for some it doesn't. The 10% I also see when writing to a RAM-disk. I'd just like to know how I can determine where all the performance is lost. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 17:05:19 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 68E14CD9C05 for ; Fri, 10 Feb 2017 17:05:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 58B7810DD for ; Fri, 10 Feb 2017 17:05:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AH5IoR058761 for ; Fri, 10 Feb 2017 17:05:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 17:05:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 17:05:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #39 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to rainer from comment #36) There's clearly something wrong there, you are not receiving as many interr= upts as you should be, this is what I usually see when running dc3dd: irq808: xen_et0:c0 17545 93 irq809: xen_et0:c1 73460 391 irq810: xen_et0:c2 65527 349 irq811: xen_et0:c3 73980 394 irq814: xbd1 314436 1674 (note that xbd1 is the disk against which the dc3dd is run) In your case this is: irq768: xen_et0:c0 4061306 20 irq769: xen_et0:c1 1951430 10 irq773: xbd0 1652038 8 irq774: xbd1 29 0 irq775: xbd2 159503 1 Note the difference in the rate of interrupts (from 1674 in my case). Can you also post the results of running `sysctl -a | grep xbd` inside the FreeBSD guest? Thanks! --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 17:12:39 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 792B3CD9DC8 for ; Fri, 10 Feb 2017 17:12:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 506E71506 for ; Fri, 10 Feb 2017 17:12:39 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AHCdeE079828 for ; Fri, 10 Feb 2017 17:12:39 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 17:12:39 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 17:12:39 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #40 from rainer@ultra-secure.de --- Here: (freebsd11 ) 1 # sysctl -a |grep xbd hw.xbd.xbd_enable_indirect: 0 dev.xbd.2.xenstore_peer_path: /local/domain/0/backend/vbd3/13/768 dev.xbd.2.xenbus_peer_domid: 0 dev.xbd.2.xenbus_connection_state: Connected dev.xbd.2.xenbus_dev_type: vbd dev.xbd.2.xenstore_path: device/vbd/768 dev.xbd.2.features: write_barrier dev.xbd.2.ring_pages: 1 dev.xbd.2.max_request_size: 40960 dev.xbd.2.max_request_segments: 11 dev.xbd.2.max_requests: 32 dev.xbd.2.%parent: xenbusb_front0 dev.xbd.2.%pnpinfo:=20 dev.xbd.2.%location:=20 dev.xbd.2.%driver: xbd dev.xbd.2.%desc: Virtual Block Device dev.xbd.1.xenstore_peer_path: /local/domain/0/backend/vbd3/13/832 dev.xbd.1.xenbus_peer_domid: 0 dev.xbd.1.xenbus_connection_state: Connected dev.xbd.1.xenbus_dev_type: vbd dev.xbd.1.xenstore_path: device/vbd/832 dev.xbd.1.features: write_barrier dev.xbd.1.ring_pages: 1 dev.xbd.1.max_request_size: 40960 dev.xbd.1.max_request_segments: 11 dev.xbd.1.max_requests: 32 dev.xbd.1.%parent: xenbusb_front0 dev.xbd.1.%pnpinfo:=20 dev.xbd.1.%location:=20 dev.xbd.1.%driver: xbd dev.xbd.1.%desc: Virtual Block Device dev.xbd.0.xenstore_peer_path: /local/domain/0/backend/vbd3/13/5632 dev.xbd.0.xenbus_peer_domid: 0 dev.xbd.0.xenbus_connection_state: Connected dev.xbd.0.xenbus_dev_type: vbd dev.xbd.0.xenstore_path: device/vbd/5632 dev.xbd.0.features: write_barrier dev.xbd.0.ring_pages: 1 dev.xbd.0.max_request_size: 40960 dev.xbd.0.max_request_segments: 11 dev.xbd.0.max_requests: 32 dev.xbd.0.%parent: xenbusb_front0 dev.xbd.0.%pnpinfo:=20 dev.xbd.0.%location:=20 dev.xbd.0.%driver: xbd dev.xbd.0.%desc: Virtual Block Device dev.xbd.%parent: --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 17:56:21 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 012C6CD8BC6 for ; Fri, 10 Feb 2017 17:56:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id E48E8153F for ; Fri, 10 Feb 2017 17:56:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AHuKtr091588 for ; Fri, 10 Feb 2017 17:56:20 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 17:56:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 17:56:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #41 from Roger Pau Monn=C3=83=C2=A9 --- Can you try to change the event timer and the time counter to a different o= ne than the Xen one: # sysctl -w kern.timecounter.hardware=3DACPI-fast # sysctl -w kern.eventtimer.timer=3DLAPIC And finally I'm also attaching a patch that actually disables all the fancy= PV stuff completely, could you also patch your kernel with it (if the above th= ings don't make a difference) and see if that makes a difference? Thanks, Roger. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 17:56:57 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 59F7DCD8C1D for ; Fri, 10 Feb 2017 17:56:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49B2D1667 for ; Fri, 10 Feb 2017 17:56:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1AHuu7c092655 for ; Fri, 10 Feb 2017 17:56:57 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 17:56:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 17:56:57 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #42 from Roger Pau Monn=C3=83=C2=A9 --- Created attachment 179844 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D179844&action= =3Dedit Disable all the Xen enlightments --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 23:10:20 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E6FACCD983E for ; Fri, 10 Feb 2017 23:10:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D6B0A691 for ; Fri, 10 Feb 2017 23:10:20 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1ANAK1e075791 for ; Fri, 10 Feb 2017 23:10:20 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 23:10:20 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 23:10:21 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #43 from rainer@ultra-secure.de --- # sysctl -w kern.timecounter.hardware=3DACPI-fast Already had that. IIRC, it's mentioned in the bug about moving a VM freezing it... # sysctl -w kern.eventtimer.timer=3DLAPIC and that freezes the machine. The patch - it leads to the machine freezing rather early in the boot-proce= ss. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Fri Feb 10 23:11:30 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9EDF9CD988F for ; Fri, 10 Feb 2017 23:11:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8E75E949 for ; Fri, 10 Feb 2017 23:11:30 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1ANBUmh083039 for ; Fri, 10 Feb 2017 23:11:30 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Fri, 10 Feb 2017 23:11:30 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 Feb 2017 23:11:30 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #44 from rainer@ultra-secure.de --- Created attachment 179858 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D179858&action= =3Dedit Screenshot of panic --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Sat Feb 11 08:55:53 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6B2CFCDAC02 for ; Sat, 11 Feb 2017 08:55:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 54F371671 for ; Sat, 11 Feb 2017 08:55:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1B8trui018438 for ; Sat, 11 Feb 2017 08:55:53 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Sat, 11 Feb 2017 08:55:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Feb 2017 08:55:53 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #45 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to rainer from comment #43) Hm, that's certainly not good, switching to the LAPIC timer shouldn't cause= the VM to freeze, I've tried it and it works just fine. Do you see anything in = the console when the VM freezes? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Sat Feb 11 09:11:49 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BC550CD92A9 for ; Sat, 11 Feb 2017 09:11:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 9D2FE1CD8 for ; Sat, 11 Feb 2017 09:11:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1B9Bn5U031544 for ; Sat, 11 Feb 2017 09:11:49 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Sat, 11 Feb 2017 09:11:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Feb 2017 09:11:49 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #46 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to rainer from comment #44) This panic trace is very disturbing, I'm a little bit confused. Which kind = of guest are you running? The trace shows xen_start -> hammer_time_xen and this path should _never_ be used by a HVM guest, this is only used by PVH guests. Can you install addr2= line from ports (it's in binutils) and run the following inside of the VM: # /usr/local/bin/addr2line -e /usr/lib/debug/boot/kernel/kernel.debug 0xffffffff81109cbb Is also any change that you could get the full boot output from the VM by connecting to it's serial console (and setting up the console inside of the guest). See https://www.freebsd.org/doc/handbook/serialconsole-setup.html Thanks. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Sat Feb 11 09:50:28 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D05BDCD9B77 for ; Sat, 11 Feb 2017 09:50:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BFC71EBD for ; Sat, 11 Feb 2017 09:50:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1B9oSV7061426 for ; Sat, 11 Feb 2017 09:50:28 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Sat, 11 Feb 2017 09:50:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.isobsolete attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Feb 2017 09:50:28 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 Roger Pau Monn=C3=83=C2=A9 changed: What |Removed |Added ---------------------------------------------------------------------------- Attachment #179844|0 |1 is obsolete| | --- Comment #47 from Roger Pau Monn=C3=83=C2=A9 --- Created attachment 179869 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D179869&action= =3Dedit Disable all the Xen enlightments Pathc to disable all Xen enlightenments, this time tested. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Sat Feb 11 09:51:25 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BCAA9CD9BB7 for ; Sat, 11 Feb 2017 09:51:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AC60B10AB for ; Sat, 11 Feb 2017 09:51:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1B9pPSR064761 for ; Sat, 11 Feb 2017 09:51:25 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Sat, 11 Feb 2017 09:51:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: royger@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Feb 2017 09:51:25 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #48 from Roger Pau Monn=C3=83=C2=A9 --- (In reply to Roger Pau Monn=C3=83=C2=A9 from comment #46) OK, I've re-done the patch to disable the Xen enlightenments, could you ple= ase try it again? Although the LAPIC timer issue is also concerning. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-xen@freebsd.org Sat Feb 11 14:29:58 2017 Return-Path: Delivered-To: freebsd-xen@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C27ACCDA906 for ; Sat, 11 Feb 2017 14:29:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B1FE214DF for ; Sat, 11 Feb 2017 14:29:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id v1BETvW3016879 for ; Sat, 11 Feb 2017 14:29:58 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-xen@FreeBSD.org Subject: [Bug 212681] I/O is slow for FreeBSD DOMu on XenServer Date: Sat, 11 Feb 2017 14:29:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.3-RELEASE X-Bugzilla-Keywords: performance X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: rainer@ultra-secure.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-xen@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-xen@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion of the freebsd port to xen - implementation and usage List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Feb 2017 14:29:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D212681 --- Comment #49 from rainer@ultra-secure.de --- I switched back the OS-type to FreeBSD 10 64bit. I also booted back into a stock kernel and then the XENTIMER-LAPIC change w= ent through without a freeze. I recompiled (a clean source-tree) with your patch and now I get about 26MB= /s. dmesg: Copyright (c) 1992-2016 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.0-RELEASE-p7 #2: Sat Feb 11 14:46:26 CET 2017 root@freebsd11:/usr/obj/usr/src/sys/GENERIC amd64 FreeBSD clang version 3.8.0 (tags/RELEASE_380/final 262564) (based on LLVM 3.8.0) VT(vga): text 80x25 CPU: Intel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz (2593.55-MHz K8-class CPU) Origin=3D"GenuineIntel" Id=3D0x306e4 Family=3D0x6 Model=3D0x3e Steppi= ng=3D4 =20 Features=3D0x783fbff =20 Features2=3D0xc3ba2203 AMD Features=3D0x28100800 AMD Features2=3D0x1 Structured Extended Features=3D0x200 Hypervisor: Origin =3D "XenVMMXenVMM" real memory =3D 8585740288 (8188 MB) avail memory =3D 8265371648 (7882 MB) Event timer "LAPIC" quality 400 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 2 package(s) random: unblocking device. ioapic0: Changing APIC ID to 1 MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-47 on motherboard random: entropy device external interface kbd1 at kbdmux0 netmap: loaded module module_register_init: MOD_LOAD (vesa, 0xffffffff8101c970, 0) error 19 random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" vtvga0: on motherboard cryptosoft0: on motherboard acpi0: on motherboard acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) cpu0: on acpi0 cpu1: on acpi0 hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 62500000 Hz quality 950 attimer0: port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: port 0x70-0x71 irq 8 on acpi0 Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0xb008-0xb00b on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 isab0: at device 1.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xc220-0xc22f at device 1.1 on pci0 ata0: at channel 0 on atapci0 ata1: at channel 1 on atapci0 uhci0: port 0xc200-0xc21f irq 23 at device 1.2 on pci0 usbus0: controller did not stop usbus0 on uhci0 pci0: at device 1.3 (no driver attached) vgapci0: mem 0xf0000000-0xf1ffffff,0xf3000000-0xf3000fff irq 24 at device 2.0 on pci0 vgapci0: Boot video device pci0: at device 3.0 (no driver attached) re0: port 0xc100-0xc1ff mem 0xf3001000-0xf300= 10ff irq 32 at device 4.0 on pci0 re0: Chip rev. 0x74800000 re0: MAC rev. 0x00000000 miibus0: on re0 rlphy0: PHY 0 on miibus0 rlphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto, auto-flow re0: Using defaults for TSO: 65518/35/2048 re0: Ethernet address: 02:00:2b:42:00:12 re0: netmap queues/slots: TX 1/64, RX 1/64 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse Explorer, device ID 4 fdc0: port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: does not respond device_attach: fdc0 attach returned 6 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 ppc0: port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: on ppc0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 fdc0: No FDOUT register! ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 1.000 msec nvme cam probe device init usbus0: 12Mbps Full Speed USB v1.0 ugen0.1: at usbus0 uhub0: on usbus0 ada0 at ata0 bus 0 scbus0 target 0 lun 0 ada0: ATA-7 device ada0: Serial Number QM00001 ada0: 16.700MB/s transfers (WDMA2, PIO 8192bytes) ada0: 25600MB (52428800 512 byte sectors) uhub0: 2 ports with 2 removable, self powered ada1 at ata0 bus 0 scbus0 target 1 lun 0 ada1: ATA-7 device ada1: Serial Number QM00002 ada1: 16.700MB/s transfers (WDMA2, PIO 8192bytes) ada1: 51200MB (104857600 512 byte sectors) ada2 at ata1 bus 0 scbus1 target 0 lun 0 ada2: ATA-7 device ada2: Serial Number QM00003 ada2: 16.700MB/s transfers (WDMA2, PIO 8192bytes) ada2: 51200MB (104857600 512 byte sectors) cd0 at ata1 bus 0 scbus1 target 1 lun 0 cd0: Removable CD-ROM SCSI device SMP: AP CPU #1 Launched! cd0: Serial Number QM00004 cd0: 16.700MB/s transfers (WDMA2, ATAPI 12bytes, PIO 65534bytes) cd0: Attempt to query device size failed: NOT READY, Medium not present Trying to mount root from zfs:zroot/ROOT/default []... Root mount waiting for: usbus0 ugen0.2: at usbus0 re0: link state changed to UP ums0: on usbus0 ums0: 3 buttons and [Z] coordinates ID=3D0 >From what I know, there is no configuration-file for the guests in XenServe= r - it's stored in a DB. Is there still a way to extract how the VM is configur= ed on the Dom0-side? --=20 You are receiving this mail because: You are the assignee for the bug.=