From owner-freebsd-performance@FreeBSD.ORG Sun Nov 4 05:22:11 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C7CDB16A469 for ; Sun, 4 Nov 2007 05:22:11 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.179]) by mx1.freebsd.org (Postfix) with ESMTP id 76FAE13C48E for ; Sun, 4 Nov 2007 05:22:11 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so2459942pyb for ; Sat, 03 Nov 2007 22:21:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=5ep1M1cMHd+Lxp36P+KS3gtdEx9UL3aVXh3BKJtEYWg=; b=j+gw1xsD8nBxuJfImcNHvEsDbRVQmHG/O2LZxVTGzYgGxHlhZt6mwYmCivkgyAMiNU/rg+us13NDRiR5+nz18ckfrPMwop0TIDkmDpU+UzZktJX9llfepBZJYEGL3KI7ENtb4Bkrqug5Qwpe3AU7JAcEM0oOdjXeW2r65Vj81K8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=mNUBGqdY+hOY9JQIqDLszWqmuuRlzs9P1wMOkGxqVjRJ3ipl/dLMPy52g0IgMqu+uLH6jqALDaCoWJ/hNwdQAJJEIycDyV7BpIiJEDWvFyurnEZ0h2KqA87nyagh9wTsUJS9Apj0VugpQ8dZHlfV7A6brQEIEnI9NFqgeFV/wTI= Received: by 10.35.116.12 with SMTP id t12mr4298032pym.1194153714064; Sat, 03 Nov 2007 22:21:54 -0700 (PDT) Received: by 10.35.110.17 with HTTP; Sat, 3 Nov 2007 22:21:53 -0700 (PDT) Message-ID: <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> Date: Sun, 4 Nov 2007 01:21:53 -0400 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071103133711.Q544@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0710251925s2db0117cvcb67321b08d7b2a1@mail.gmail.com> <20071102102331.G544@10.0.0.1> <8cb6106e0711021306w10c48a15s99eab526064ac814@mail.gmail.com> <20071102150028.R544@10.0.0.1> <8cb6106e0711021839i4714bdfbh74d412b3e14e808@mail.gmail.com> <8cb6106e0711031227t1e829969s2e6062e1db5167af@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2007 05:22:11 -0000 > Josh, thanks for your help so far. This has been very useful. You're welcome, glad to help! Thanks for the effort and the patch. > Any testing you can run this through is appreciated. Anyone else lurking > in this thread who would like to is also welcome to report back findings. Here are a few benchmarks comparing ULE and the patched ULE. I experimented in changing the slice_min value from 2 to 4, in case that might be useful info for you. Hopefully that helps a bit, but if not it's just a few minutes of CPU time wasted :) Sysbench results: # threads slice=7 slice=13 slice_min=4 slice_min=2 4 2265.67 2250.36 2261.71 2297.08 8 2300.25 2310.02 2306.79 2313.61 12 2269.54 2304.04 2296.54 2279.73 16 2249.26 2252.04 2260.53 2245.76 It looks like with the default minimum (2), the performance for systat is better with 4 and 8 threads (on a 4 core system), but worse for 12 and 16 threads. Here are the results for ffmpeg (-threads 8): slice=7 slice=13 slice_min=4 slice_min=2 1:37.00 1:39.09 1:38.12 1:38.06 The patch definitely improves things there, though not quite as good as using a slice value of 7. But it does improve things. So it slightly improves things for ffmpeg and also slightly increases the performance of sysbench/MySQL (with 8 threads). I also ran through buildworld for both slice_min of 2 and 4, and here are the results, again with ULE as a base line: slice=7 slice=13 slice_min=4 slice_min=2 13:40.56 13:44.28 13:46.64 13:45.80 So buildworld performance is about the same as with the default ULE and default slice value. Thanks, Josh From owner-freebsd-performance@FreeBSD.ORG Sun Nov 4 20:28:04 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9C4E616A417 for ; Sun, 4 Nov 2007 20:28:04 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from webaccess-cl.virtdom.com (webaccess-cl.virtdom.com [216.240.101.25]) by mx1.freebsd.org (Postfix) with ESMTP id 020D413C48A for ; Sun, 4 Nov 2007 20:28:03 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from [192.168.1.100] (cpe-24-94-75-93.hawaii.res.rr.com [24.94.75.93]) (authenticated bits=0) by webaccess-cl.virtdom.com (8.13.6/8.13.6) with ESMTP id lA4KRcte017822 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Sun, 4 Nov 2007 15:27:40 -0500 (EST) (envelope-from jroberson@chesapeake.net) Date: Sun, 4 Nov 2007 12:29:36 -0800 (PST) From: Jeff Roberson X-X-Sender: jroberson@10.0.0.1 To: Josh Carroll In-Reply-To: <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> Message-ID: <20071104122546.S544@10.0.0.1> References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0710251925s2db0117cvcb67321b08d7b2a1@mail.gmail.com> <20071102102331.G544@10.0.0.1> <8cb6106e0711021306w10c48a15s99eab526064ac814@mail.gmail.com> <20071102150028.R544@10.0.0.1> <8cb6106e0711021839i4714bdfbh74d412b3e14e808@mail.gmail.com> <8cb6106e0711031227t1e829969s2e6062e1db5167af@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-799710710-1194208176=:544" Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2007 20:28:04 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-799710710-1194208176=:544 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed On Sun, 4 Nov 2007, Josh Carroll wrote: >> Josh, thanks for your help so far. This has been very useful. > > You're welcome, glad to help! Thanks for the effort and the patch. > >> Any testing you can run this through is appreciated. Anyone else lurking >> in this thread who would like to is also welcome to report back findings. > > Here are a few benchmarks comparing ULE and the patched ULE. I > experimented in changing the slice_min value from 2 to 4, in case that > might be useful info for you. Hopefully that helps a bit, but if not > it's just a few minutes of CPU time wasted :) Josh, I included one too many changes in the diff and it made the results ambiguous. I've scaled it back slightly by removing the changes to sched_pickcpu() and included the patch in this email again. Can you run through your tests once more? I'd like to commit this part soon as it helps in other cases. I'm most interested in the buildworld numbers for now. Thanks, Jeff > > Sysbench results: > # threads slice=7 slice=13 slice_min=4 slice_min=2 > 4 2265.67 2250.36 2261.71 2297.08 > 8 2300.25 2310.02 2306.79 2313.61 > 12 2269.54 2304.04 2296.54 2279.73 > 16 2249.26 2252.04 2260.53 2245.76 > > It looks like with the default minimum (2), the performance for systat > is better with 4 and 8 threads (on a 4 core system), but worse for 12 > and 16 threads. > > Here are the results for ffmpeg (-threads 8): > > slice=7 slice=13 slice_min=4 slice_min=2 > 1:37.00 1:39.09 1:38.12 1:38.06 > > The patch definitely improves things there, though not quite as good > as using a slice value of 7. But it does improve things. So it > slightly improves things for ffmpeg and also slightly increases the > performance of sysbench/MySQL (with 8 threads). > > I also ran through buildworld for both slice_min of 2 and 4, and here > are the results, again with ULE as a base line: > > slice=7 slice=13 slice_min=4 slice_min=2 > 13:40.56 13:44.28 13:46.64 13:45.80 > > So buildworld performance is about the same as with the default ULE > and default slice value. > > Thanks, > Josh > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > --0-799710710-1194208176=:544 Content-Type: TEXT/x-diff; charset=US-ASCII; name=uleslice.diff Content-Transfer-Encoding: BASE64 Content-ID: <20071104122936.D544@10.0.0.1> Content-Description: Content-Disposition: attachment; filename=uleslice.diff SW5kZXg6IHNjaGVkX3VsZS5jDQo9PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09DQpS Q1MgZmlsZTogL2hvbWUvbmN2cy9zcmMvc3lzL2tlcm4vc2NoZWRfdWxlLmMs dg0KcmV0cmlldmluZyByZXZpc2lvbiAxLjIxNg0KZGlmZiAtdSAtcjEuMjE2 IHNjaGVkX3VsZS5jDQotLS0gc2NoZWRfdWxlLmMJMjMgT2N0IDIwMDcgMDA6 NTI6MjQgLTAwMDAJMS4yMTYNCisrKyBzY2hlZF91bGUuYwkzIE5vdiAyMDA3 IDIxOjM2OjI3IC0wMDAwDQpAQCAtODgsNyArODgsOCBAQA0KIAlzaG9ydAkJ dHNfZmxhZ3M7CS8qIFRTRl8qIGZsYWdzLiAqLw0KIAl1X2NoYXIJCXRzX3Jx aW5kZXg7CS8qIFJ1biBxdWV1ZSBpbmRleC4gKi8NCiAJdV9jaGFyCQl0c19j cHU7CQkvKiBDUFUgdGhhdCB3ZSBoYXZlIGFmZmluaXR5IGZvci4gKi8NCi0J aW50CQl0c19zbGljZTsJLyogVGlja3Mgb2Ygc2xpY2UgcmVtYWluaW5nLiAq Lw0KKwlpbnQJCXRzX3NsaWNlOwkvKiBUaWNrcyBvZiBzbGljZSB1c2VkLiAq Lw0KKwlpbnQJCXRzX3Njb3JlOwkvKiBJbnRlcmFjdGl2aXR5IHNjb3JlLiAq Lw0KIAl1X2ludAkJdHNfc2xwdGltZTsJLyogTnVtYmVyIG9mIHRpY2tzIHdl IHZvbC4gc2xlcHQgKi8NCiAJdV9pbnQJCXRzX3J1bnRpbWU7CS8qIE51bWJl ciBvZiB0aWNrcyB3ZSB3ZXJlIHJ1bm5pbmcgKi8NCiAJLyogVGhlIGZvbGxv d2luZyB2YXJpYWJsZXMgYXJlIG9ubHkgdXNlZCBmb3IgcGN0Y3B1IGNhbGN1 bGF0aW9uICovDQpAQCAtMTAyLDYgKzEwMyw3IEBADQogLyogZmxhZ3Mga2Vw dCBpbiB0c19mbGFncyAqLw0KICNkZWZpbmUJVFNGX0JPVU5ECTB4MDAwMQkJ LyogVGhyZWFkIGNhbiBub3QgbWlncmF0ZS4gKi8NCiAjZGVmaW5lCVRTRl9Y RkVSQUJMRQkweDAwMDIJCS8qIFRocmVhZCB3YXMgYWRkZWQgYXMgdHJhbnNm ZXJhYmxlLiAqLw0KKyNkZWZpbmUJVFNGX0lOVEVSTE9BRAkweDAwMDQJCS8q IEludGVyYWN0aXZlIGxvYWQgb24gcnVucS4gKi8NCiANCiBzdGF0aWMgc3Ry dWN0IHRkX3NjaGVkIHRkX3NjaGVkMDsNCiANCkBAIC0xNjcsMTMgKzE2OSwx NSBAQA0KICAqCQkJdGhlIHNoaWZ0IGZhY3Rvci4gIFdpdGhvdXQgdGhlIHNo aWZ0IHRoZSBlcnJvciByYXRlDQogICoJCQlkdWUgdG8gcm91bmRpbmcgd291 bGQgYmUgdW5hY2NlcHRhYmx5IGhpZ2guDQogICogcmVhbHN0YXRoejoJCXN0 YXRoeiBpcyBzb21ldGltZXMgMCBhbmQgcnVuIG9mZiBvZiBoei4NCi0gKiBz Y2hlZF9zbGljZToJCVJ1bnRpbWUgb2YgZWFjaCB0aHJlYWQgYmVmb3JlIHJl c2NoZWR1bGluZy4NCisgKiBzY2hlZF9zbGljZV9tYXg6CU1heGltdW0gcnVu dGltZSBvZiBlYWNoIHRocmVhZCBiZWZvcmUgcmVzY2hlZHVsaW5nLg0KKyAq IHNjaGVkX3NsaWNlX21pbjoJTWluaW11bSBydW50aW1lIG9mIGVhY2ggdGhy ZWFkIGJlZm9yZSByZXNjaGVkdWxpbmcuDQogICogcHJlZW1wdF90aHJlc2g6 CVByaW9yaXR5IHRocmVzaG9sZCBmb3IgcHJlZW1wdGlvbiBhbmQgcmVtb3Rl IElQSXMuDQogICovDQogc3RhdGljIGludCBzY2hlZF9pbnRlcmFjdCA9IFND SEVEX0lOVEVSQUNUX1RIUkVTSDsNCiBzdGF0aWMgaW50IHJlYWxzdGF0aHo7 DQogc3RhdGljIGludCB0aWNraW5jcjsNCi1zdGF0aWMgaW50IHNjaGVkX3Ns aWNlOw0KK3N0YXRpYyBpbnQgc2NoZWRfc2xpY2VfbWF4ID0gMTsNCitzdGF0 aWMgaW50IHNjaGVkX3NsaWNlX21pbiA9IDE7DQogI2lmZGVmIFBSRUVNUFRJ T04NCiAjaWZkZWYgRlVMTF9QUkVFTVBUSU9ODQogc3RhdGljIGludCBwcmVl bXB0X3RocmVzaCA9IFBSSV9NQVhfSURMRTsNCkBAIC0xOTQsNiArMTk4LDcg QEANCiAJc3RydWN0IHJ1bnEJdGRxX3JlYWx0aW1lOwkJLyogcmVhbC10aW1l IHJ1biBxdWV1ZS4gKi8NCiAJc3RydWN0IHJ1bnEJdGRxX3RpbWVzaGFyZTsJ CS8qIHRpbWVzaGFyZSBydW4gcXVldWUuICovDQogCXN0cnVjdCBydW5xCXRk cV9pZGxlOwkJLyogUXVldWUgb2YgSURMRSB0aHJlYWRzLiAqLw0KKwl1bnNp Z25lZCBpbnQJdGRxX2ludGVybG9hZDsJCS8qIEludGVyYWN0aXZlIGxvYWQu ICovDQogCWludAkJdGRxX2xvYWQ7CQkvKiBBZ2dyZWdhdGUgbG9hZC4gKi8N CiAJdV9jaGFyCQl0ZHFfaWR4OwkJLyogQ3VycmVudCBpbnNlcnQgaW5kZXgu ICovDQogCXVfY2hhcgkJdGRxX3JpZHg7CQkvKiBDdXJyZW50IHJlbW92YWwg aW5kZXguICovDQpAQCAtMjM5LDcgKzI0NCw2IEBADQogc3RhdGljIGludCBi YWxhbmNlX2ludGVydmFsID0gMTI4OwkvKiBEZWZhdWx0IHNldCBpbiBzY2hl ZF9pbml0dGlja3MoKS4gKi8NCiBzdGF0aWMgaW50IHBpY2tfcHJpID0gMTsN CiBzdGF0aWMgaW50IGFmZmluaXR5Ow0KLXN0YXRpYyBpbnQgdHJ5c2VsZiA9 IDE7DQogc3RhdGljIGludCBzdGVhbF9odHQgPSAxOw0KIHN0YXRpYyBpbnQg c3RlYWxfaWRsZSA9IDE7DQogc3RhdGljIGludCBzdGVhbF90aHJlc2ggPSAy Ow0KQEAgLTI4OCwxMCArMjkyLDEyIEBADQogc3RhdGljIHZvaWQgdGRxX3Nl dHVwKHN0cnVjdCB0ZHEgKik7DQogc3RhdGljIHZvaWQgdGRxX2xvYWRfYWRk KHN0cnVjdCB0ZHEgKiwgc3RydWN0IHRkX3NjaGVkICopOw0KIHN0YXRpYyB2 b2lkIHRkcV9sb2FkX3JlbShzdHJ1Y3QgdGRxICosIHN0cnVjdCB0ZF9zY2hl ZCAqKTsNCitzdGF0aWMgaW50IHRkcV9zbGljZShzdHJ1Y3QgdGRxICopOw0K IHN0YXRpYyBfX2lubGluZSB2b2lkIHRkcV9ydW5xX2FkZChzdHJ1Y3QgdGRx ICosIHN0cnVjdCB0ZF9zY2hlZCAqLCBpbnQpOw0KIHN0YXRpYyBfX2lubGlu ZSB2b2lkIHRkcV9ydW5xX3JlbShzdHJ1Y3QgdGRxICosIHN0cnVjdCB0ZF9z Y2hlZCAqKTsNCi12b2lkIHRkcV9wcmludChpbnQgY3B1KTsNCi1zdGF0aWMg dm9pZCBydW5xX3ByaW50KHN0cnVjdCBydW5xICpycSk7DQordm9pZCB0ZHFf cHJpbnQoaW50KTsNCit2b2lkIHNjaGVkX3ByaW50KHN0cnVjdCB0aHJlYWQg Kik7DQorc3RhdGljIHZvaWQgcnVucV9wcmludChzdHJ1Y3QgcnVucSAqKTsN CiBzdGF0aWMgdm9pZCB0ZHFfYWRkKHN0cnVjdCB0ZHEgKiwgc3RydWN0IHRo cmVhZCAqLCBpbnQpOw0KICNpZmRlZiBTTVANCiBzdGF0aWMgdm9pZCB0ZHFf bW92ZShzdHJ1Y3QgdGRxICosIHN0cnVjdCB0ZHEgKik7DQpAQCAtMzQ1LDYg KzM1MSwyNiBAQA0KIAl9DQogfQ0KIA0KK3ZvaWQNCitzY2hlZF9wcmludChz dHJ1Y3QgdGhyZWFkICp0ZCkNCit7DQorCXN0cnVjdCB0ZF9zY2hlZCAqdHM7 DQorDQorCWlmICh0ZCA9PSBOVUxMKQ0KKwkJdGQgPSBjdXJ0aHJlYWQ7DQor CXRzID0gdGQtPnRkX3NjaGVkOw0KKwlwcmludGYoImZsYWdzOiAgICAweCVY XG4iLCB0cy0+dHNfZmxhZ3MpOw0KKwlwcmludGYoInJxaW5kZXg6ICAlZFxu IiwgdHMtPnRzX3JxaW5kZXgpOw0KKwlwcmludGYoImNwdTogICAgICAlZFxu IiwgdHMtPnRzX2NwdSk7DQorCXByaW50Zigic2xpY2U6ICAgICVkXG4iLCB0 cy0+dHNfc2xpY2UpOw0KKwlwcmludGYoInNjb3JlOiAgICAlZFxuIiwgdHMt PnRzX3Njb3JlKTsNCisJcHJpbnRmKCJzbHB0aW1lOiAgJWRcbiIsIHRzLT50 c19zbHB0aW1lKTsNCisJcHJpbnRmKCJydW50aW1lOiAgJWRcbiIsIHRzLT50 c19ydW50aW1lKTsNCisJcHJpbnRmKCJsdGljazogICAgJWRcbiIsIHRzLT50 c19sdGljayk7DQorCXByaW50ZigiZnRpY2s6ICAgICVkXG4iLCB0cy0+dHNf ZnRpY2spOw0KKwlwcmludGYoInRpY2tzOiAgICAlZFxuIiwgdHMtPnRzX3Rp Y2tzKTsNCit9DQorDQogLyoNCiAgKiBQcmludCB0aGUgc3RhdHVzIG9mIGEg cGVyLWNwdSB0aHJlYWQgcXVldWUuICBTaG91bGQgYmUgYSBkZGIgc2hvdyBj bWQuDQogICovDQpAQCAtMzU3LDcgKzM4Myw5IEBADQogDQogCXByaW50Zigi dGRxICVkOlxuIiwgVERRX0lEKHRkcSkpOw0KIAlwcmludGYoIlx0bG9ja3B0 ciAgICAgICAgICVwXG4iLCBURFFfTE9DS1BUUih0ZHEpKTsNCisJcHJpbnRm KCJcdGludGVybG9hZDoJICAlZFxuIiwgdGRxLT50ZHFfaW50ZXJsb2FkKTsN CiAJcHJpbnRmKCJcdGxvYWQ6ICAgICAgICAgICAlZFxuIiwgdGRxLT50ZHFf bG9hZCk7DQorCXByaW50ZigiXHRzbGljZTogICAgICAgICAgJWRcbiIsIHRk cV9zbGljZSh0ZHEpKTsNCiAJcHJpbnRmKCJcdHRpbWVzaGFyZSBpZHg6ICAl ZFxuIiwgdGRxLT50ZHFfaWR4KTsNCiAJcHJpbnRmKCJcdHRpbWVzaGFyZSBy aWR4OiAlZFxuIiwgdGRxLT50ZHFfcmlkeCk7DQogCXByaW50ZigiXHRyZWFs dGltZSBydW5xOlxuIik7DQpAQCAtMzgzLDggKzQxMSwxMiBAQA0KIHN0YXRp YyBfX2lubGluZSB2b2lkDQogdGRxX3J1bnFfYWRkKHN0cnVjdCB0ZHEgKnRk cSwgc3RydWN0IHRkX3NjaGVkICp0cywgaW50IGZsYWdzKQ0KIHsNCisJdV9j aGFyIHByaTsNCisNCisJcHJpID0gdHMtPnRzX3RocmVhZC0+dGRfcHJpb3Jp dHk7DQogCVREUV9MT0NLX0FTU0VSVCh0ZHEsIE1BX09XTkVEKTsNCiAJVEhS RUFEX0xPQ0tfQVNTRVJUKHRzLT50c190aHJlYWQsIE1BX09XTkVEKTsNCisJ VERfU0VUX1JVTlEodHMtPnRzX3RocmVhZCk7DQogI2lmZGVmIFNNUA0KIAlp ZiAoVEhSRUFEX0NBTl9NSUdSQVRFKHRzLT50c190aHJlYWQpKSB7DQogCQl0 ZHEtPnRkcV90cmFuc2ZlcmFibGUrKzsNCkBAIC0zOTIsMTUgKzQyNCwxNSBA QA0KIAkJdHMtPnRzX2ZsYWdzIHw9IFRTRl9YRkVSQUJMRTsNCiAJfQ0KICNl bmRpZg0KLQlpZiAodHMtPnRzX3J1bnEgPT0gJnRkcS0+dGRxX3RpbWVzaGFy ZSkgew0KLQkJdV9jaGFyIHByaTsNCi0NCi0JCXByaSA9IHRzLT50c190aHJl YWQtPnRkX3ByaW9yaXR5Ow0KKwlpZiAocHJpIDw9IFBSSV9NQVhfUkVBTFRJ TUUpIHsNCisJCXRzLT50c19ydW5xID0gJnRkcS0+dGRxX3JlYWx0aW1lOw0K Kwl9IGVsc2UgaWYgKHByaSA8PSBQUklfTUFYX1RJTUVTSEFSRSkgew0KKwkJ dHMtPnRzX3J1bnEgPSAmdGRxLT50ZHFfdGltZXNoYXJlOw0KIAkJS0FTU0VS VChwcmkgPD0gUFJJX01BWF9USU1FU0hBUkUgJiYgcHJpID49IFBSSV9NSU5f VElNRVNIQVJFLA0KIAkJCSgiSW52YWxpZCBwcmlvcml0eSAlZCBvbiB0aW1l c2hhcmUgcnVucSIsIHByaSkpOw0KIAkJLyoNCiAJCSAqIFRoaXMgcXVldWUg Y29udGFpbnMgb25seSBwcmlvcml0aWVzIGJldHdlZW4gTUlOIGFuZCBNQVgN Ci0JCSAqIHJlYWx0aW1lLiAgVXNlIHRoZSB3aG9sZSBxdWV1ZSB0byByZXBy ZXNlbnQgdGhlc2UgdmFsdWVzLg0KKwkJICogdGltZXNoYXJlLiAgVXNlIHRo ZSB3aG9sZSBxdWV1ZSB0byByZXByZXNlbnQgdGhlc2UgdmFsdWVzLg0KIAkJ ICovDQogCQlpZiAoKGZsYWdzICYgKFNSUV9CT1JST1dJTkd8U1JRX1BSRUVN UFRFRCkpID09IDApIHsNCiAJCQlwcmkgPSAocHJpIC0gUFJJX01JTl9USU1F U0hBUkUpIC8gVFNfUlFfUFBROw0KQEAgLTQxNiw4ICs0NDgsMTAgQEANCiAJ CX0gZWxzZQ0KIAkJCXByaSA9IHRkcS0+dGRxX3JpZHg7DQogCQlydW5xX2Fk ZF9wcmkodHMtPnRzX3J1bnEsIHRzLCBwcmksIGZsYWdzKTsNCisJCXJldHVy bjsNCiAJfSBlbHNlDQotCQlydW5xX2FkZCh0cy0+dHNfcnVucSwgdHMsIGZs YWdzKTsNCisJCXRzLT50c19ydW5xID0gJnRkcS0+dGRxX2lkbGU7DQorCXJ1 bnFfYWRkKHRzLT50c19ydW5xLCB0cywgZmxhZ3MpOw0KIH0NCiANCiAvKiAN CkBAIC00NDMsMTMgKzQ3Nyw2IEBADQogCQkJcnVucV9yZW1vdmVfaWR4KHRz LT50c19ydW5xLCB0cywgJnRkcS0+dGRxX3JpZHgpOw0KIAkJZWxzZQ0KIAkJ CXJ1bnFfcmVtb3ZlX2lkeCh0cy0+dHNfcnVucSwgdHMsIE5VTEwpOw0KLQkJ LyoNCi0JCSAqIEZvciB0aW1lc2hhcmUgdGhyZWFkcyB3ZSB1cGRhdGUgdGhl IHByaW9yaXR5IGhlcmUgc28NCi0JCSAqIHRoZSBwcmlvcml0eSByZWZsZWN0 cyB0aGUgdGltZSB3ZSd2ZSBiZWVuIHNsZWVwaW5nLg0KLQkJICovDQotCQl0 cy0+dHNfbHRpY2sgPSB0aWNrczsNCi0JCXNjaGVkX3BjdGNwdV91cGRhdGUo dHMpOw0KLQkJc2NoZWRfcHJpb3JpdHkodHMtPnRzX3RocmVhZCk7DQogCX0g ZWxzZQ0KIAkJcnVucV9yZW1vdmUodHMtPnRzX3J1bnEsIHRzKTsNCiB9DQpA QCAtNDY2LDYgKzQ5Myw4IEBADQogCVREUV9MT0NLX0FTU0VSVCh0ZHEsIE1B X09XTkVEKTsNCiAJVEhSRUFEX0xPQ0tfQVNTRVJUKHRzLT50c190aHJlYWQs IE1BX09XTkVEKTsNCiAJY2xhc3MgPSBQUklfQkFTRSh0cy0+dHNfdGhyZWFk LT50ZF9wcmlfY2xhc3MpOw0KKwl0ZHEtPnRkcV9pbnRlcmxvYWQgKz0gdHMt PnRzX3Njb3JlOw0KKwl0cy0+dHNfZmxhZ3MgfD0gVFNGX0lOVEVSTE9BRDsN CiAJdGRxLT50ZHFfbG9hZCsrOw0KIAlDVFIyKEtUUl9TQ0hFRCwgImNwdSAl ZCBsb2FkOiAlZCIsIFREUV9JRCh0ZHEpLCB0ZHEtPnRkcV9sb2FkKTsNCiAJ aWYgKGNsYXNzICE9IFBSSV9JVEhEICYmDQpAQCAtNDk4LDkgKzUyNywzNyBA QA0KICNlbmRpZg0KIAlLQVNTRVJUKHRkcS0+dGRxX2xvYWQgIT0gMCwNCiAJ ICAgICgidGRxX2xvYWRfcmVtOiBSZW1vdmluZyB3aXRoIDAgbG9hZCBvbiBx dWV1ZSAlZCIsIFREUV9JRCh0ZHEpKSk7DQorCXRzLT50c19mbGFncyAmPSB+ VFNGX0lOVEVSTE9BRDsNCisJdHMtPnRzX3J1bnEgPSBOVUxMOw0KKwl0ZHEt PnRkcV9pbnRlcmxvYWQgLT0gdHMtPnRzX3Njb3JlOw0KIAl0ZHEtPnRkcV9s b2FkLS07DQogCUNUUjEoS1RSX1NDSEVELCAibG9hZDogJWQiLCB0ZHEtPnRk cV9sb2FkKTsNCi0JdHMtPnRzX3J1bnEgPSBOVUxMOw0KK30NCisNCisvKg0K KyAqIENvbXB1dGUgdGhlIG1heGltdW0gc2xpY2Ugd2hlbiB0aGUgaW50ZXJs b2FkIGNoYW5nZXMuICBUaGlzIGdpdmVzIGEgc29mdA0KKyAqIHVwcGVyIGJv dW5kIG9uIGxhdGVuY3kgYXMgdGhlIGxvYWQgaW5jcmVhc2VzLg0KKyAqLw0K K3N0YXRpYyBpbnQNCit0ZHFfc2xpY2Uoc3RydWN0IHRkcSAqdGRxKQ0KK3sN CisJaW50IHNsaWNlOw0KKwlpbnQgbG9hZDsNCisNCisJVERRX0xPQ0tfQVNT RVJUKHRkcSwgTUFfT1dORUQpOw0KKwlpZiAodGRxLT50ZHFfaW50ZXJsb2Fk ID09IDApDQorCQlyZXR1cm4gKHNjaGVkX3NsaWNlX21heCk7DQorCS8qDQor CSAqIEFuIGludGVybG9hZCBvZiAxMDAgaXMgcm91Z2hseSBlcXVpdmFsZW50 IHRvIDEwMCUgY3B1IHV0aWxpemF0aW9uDQorCSAqIHJlcXVlc3RlZC4gIENh bGN1bGF0ZSBob3cgbWFueSB0aW1lcyBvdmVybG9hZGVkIHdlIGFyZSBhbmQg dGhlbg0KKwkgKiBkaXZpZGUgdGhlIGxhdGVuY3kgdGFyZ2V0IGJ5IHRoaXMg bnVtYmVyLiAgTm9uZSBvZiB0aGlzIGlzIHByZWNpc2UNCisJICogYnV0IGl0 IGRvZXMgeWllbGQgZGVjcmVhc2luZyBzbGljZSB2YWx1ZXMgd2l0aGluIHRo ZSBbbWluLCBtYXhdDQorCSAqIHJhbmdlIGFzIGxvYWQgaW5jcmVhc2VzLg0K KwkgKi8NCisJbG9hZCA9ICh0ZHEtPnRkcV9pbnRlcmxvYWQgKyA5OSkgLyAx MDA7DQorCXNsaWNlID0gc2NoZWRfc2xpY2VfbWF4IC8gbG9hZDsNCisJc2xp Y2UgPSBtYXgoc2xpY2UsIHNjaGVkX3NsaWNlX21pbik7DQorCXJldHVybiAo c2xpY2UpOw0KIH0NCiANCiAjaWZkZWYgU01QDQpAQCAtMTA3MCwxNCArMTEy Nyw2IEBADQogCWNwdSA9IHNlbGYgPSBQQ1BVX0dFVChjcHVpZCk7DQogCWlm IChzbXBfc3RhcnRlZCA9PSAwKQ0KIAkJcmV0dXJuIChzZWxmKTsNCi0JLyoN Ci0JICogRG9uJ3QgbWlncmF0ZSBhIHJ1bm5pbmcgdGhyZWFkIGZyb20gc2No ZWRfc3dpdGNoKCkuDQotCSAqLw0KLQlpZiAoZmxhZ3MgJiBTUlFfT1VSU0VM Rikgew0KLQkJQ1RSMShLVFJfVUxFLCAiWUlFTERJTkcgJWQiLA0KLQkJICAg IGN1cnRocmVhZC0+dGRfcHJpb3JpdHkpOw0KLQkJcmV0dXJuIChzZWxmKTsN Ci0JfQ0KIAlwcmkgPSB0cy0+dHNfdGhyZWFkLT50ZF9wcmlvcml0eTsNCiAJ Y3B1ID0gdHMtPnRzX2NwdTsNCiAJLyoNCkBAIC0xMTc1LDYgKzEyMjUsNyBA QA0KIAlydW5xX2luaXQoJnRkcS0+dGRxX3RpbWVzaGFyZSk7DQogCXJ1bnFf aW5pdCgmdGRxLT50ZHFfaWRsZSk7DQogCXRkcS0+dGRxX2xvYWQgPSAwOw0K Kwl0ZHEtPnRkcV9pbnRlcmxvYWQgPSAwOw0KIH0NCiANCiAjaWZkZWYgU01Q DQpAQCAtMTMyNCwxMiArMTM3NSwxMiBAQA0KIAkgKiBpbiBjYXNlIHdoaWNo IHNjaGVkX2Nsb2NrKCkgY2FsbGVkIGJlZm9yZSBzY2hlZF9pbml0dGlja3Mo KS4NCiAJICovDQogCXJlYWxzdGF0aHogPSBoejsNCi0Jc2NoZWRfc2xpY2Ug PSAocmVhbHN0YXRoei8xMCk7CS8qIH4xMDBtcyAqLw0KIAl0aWNraW5jciA9 IDEgPDwgU0NIRURfVElDS19TSElGVDsNCiANCiAJLyogQWRkIHRocmVhZDAn cyBsb2FkIHNpbmNlIGl0J3MgcnVubmluZy4gKi8NCiAJVERRX0xPQ0sodGRx KTsNCiAJdGhyZWFkMC50ZF9sb2NrID0gVERRX0xPQ0tQVFIoVERRX1NFTEYo KSk7DQorCXRkX3NjaGVkMC50c19zY29yZSA9IDA7DQogCXRkcV9sb2FkX2Fk ZCh0ZHEsICZ0ZF9zY2hlZDApOw0KIAlURFFfVU5MT0NLKHRkcSk7DQogfQ0K QEAgLTEzNDQsNyArMTM5NSw4IEBADQogCWludCBpbmNyOw0KIA0KIAlyZWFs c3RhdGh6ID0gc3RhdGh6ID8gc3RhdGh6IDogaHo7DQotCXNjaGVkX3NsaWNl ID0gKHJlYWxzdGF0aHovMTApOwkvKiB+MTAwbXMgKi8NCisJc2NoZWRfc2xp Y2VfbWF4ID0gcmVhbHN0YXRoeiAvIDE1OwkvKiB+NjZtcyAqLw0KKwlzY2hl ZF9zbGljZV9taW4gPSByZWFsc3RhdGh6IC8gNTA7CS8qIH4yMG1zICovDQog DQogCS8qDQogCSAqIHRpY2tpbmNyIGlzIHNoaWZ0ZWQgb3V0IGJ5IDEwIHRv IGF2b2lkIHJvdW5kaW5nIGVycm9ycyBkdWUgdG8NCkBAIC0xMzc0LDcgKzE0 MjYsNiBAQA0KICNlbmRpZg0KIH0NCiANCi0NCiAvKg0KICAqIFRoaXMgaXMg dGhlIGNvcmUgb2YgdGhlIGludGVyYWN0aXZpdHkgYWxnb3JpdGhtLiAgRGV0 ZXJtaW5lcyBhIHNjb3JlIGJhc2VkDQogICogb24gcGFzdCBiZWhhdmlvci4g IEl0IGlzIHRoZSByYXRpbyBvZiBzbGVlcCB0aW1lIHRvIHJ1biB0aW1lIHNj YWxlZCB0bw0KQEAgLTEzODksMTUgKzE0NDAsNiBAQA0KIAlpbnQgZGl2Ow0K IA0KIAl0cyA9IHRkLT50ZF9zY2hlZDsNCi0JLyoNCi0JICogVGhlIHNjb3Jl IGlzIG9ubHkgbmVlZGVkIGlmIHRoaXMgaXMgbGlrZWx5IHRvIGJlIGFuIGlu dGVyYWN0aXZlDQotCSAqIHRhc2suICBEb24ndCBnbyB0aHJvdWdoIHRoZSBl eHBlbnNlIG9mIGNvbXB1dGluZyBpdCBpZiB0aGVyZSdzDQotCSAqIG5vIGNo YW5jZS4NCi0JICovDQotCWlmIChzY2hlZF9pbnRlcmFjdCA8PSBTQ0hFRF9J TlRFUkFDVF9IQUxGICYmDQotCQl0cy0+dHNfcnVudGltZSA+PSB0cy0+dHNf c2xwdGltZSkNCi0JCQlyZXR1cm4gKFNDSEVEX0lOVEVSQUNUX0hBTEYpOw0K LQ0KIAlpZiAodHMtPnRzX3J1bnRpbWUgPiB0cy0+dHNfc2xwdGltZSkgew0K IAkJZGl2ID0gbWF4KDEsIHRzLT50c19ydW50aW1lIC8gU0NIRURfSU5URVJB Q1RfSEFMRik7DQogCQlyZXR1cm4gKFNDSEVEX0lOVEVSQUNUX0hBTEYgKw0K QEAgLTE0NDMsNyArMTQ4NSw3IEBADQogCSAqIHNjb3JlLiAgTmVnYXRpdmUg bmljZSB2YWx1ZXMgbWFrZSBpdCBlYXNpZXIgZm9yIGEgdGhyZWFkIHRvIGJl DQogCSAqIGNvbnNpZGVyZWQgaW50ZXJhY3RpdmUuDQogCSAqLw0KLQlzY29y ZSA9IGltYXgoMCwgc2NoZWRfaW50ZXJhY3Rfc2NvcmUodGQpIC0gdGQtPnRk X3Byb2MtPnBfbmljZSk7DQorCXNjb3JlID0gaW1heCgwLCB0ZC0+dGRfc2No ZWQtPnRzX3Njb3JlIC0gdGQtPnRkX3Byb2MtPnBfbmljZSk7DQogCWlmIChz Y29yZSA8IHNjaGVkX2ludGVyYWN0KSB7DQogCQlwcmkgPSBQUklfTUlOX1JF QUxUSU1FOw0KIAkJcHJpICs9ICgoUFJJX01BWF9SRUFMVElNRSAtIFBSSV9N SU5fUkVBTFRJTUUpIC8gc2NoZWRfaW50ZXJhY3QpDQpAQCAtMTQ3NywxMiAr MTUxOSwxNSBAQA0KIHNjaGVkX2ludGVyYWN0X3VwZGF0ZShzdHJ1Y3QgdGhy ZWFkICp0ZCkNCiB7DQogCXN0cnVjdCB0ZF9zY2hlZCAqdHM7DQorCXN0cnVj dCB0ZHEgKnRkcTsNCiAJdV9pbnQgc3VtOw0KKwlpbnQgc2NvcmU7DQogDQor CVRIUkVBRF9MT0NLX0FTU0VSVCh0ZCwgTUFfT1dORUQpOw0KIAl0cyA9IHRk LT50ZF9zY2hlZDsNCiAJc3VtID0gdHMtPnRzX3J1bnRpbWUgKyB0cy0+dHNf c2xwdGltZTsNCiAJaWYgKHN1bSA8IFNDSEVEX1NMUF9SVU5fTUFYKQ0KLQkJ cmV0dXJuOw0KKwkJZ290byBzY29yZTsNCiAJLyoNCiAJICogVGhpcyBvbmx5 IGhhcHBlbnMgZnJvbSB0d28gcGxhY2VzOg0KIAkgKiAxKSBXZSBoYXZlIGFk ZGVkIGFuIHVudXN1YWwgYW1vdW50IG9mIHJ1biB0aW1lIGZyb20gZm9ya19l eGl0Lg0KQEAgLTE0OTAsMTMgKzE1MzUsMTMgQEANCiAJICovDQogCWlmIChz dW0gPiBTQ0hFRF9TTFBfUlVOX01BWCAqIDIpIHsNCiAJCWlmICh0cy0+dHNf cnVudGltZSA+IHRzLT50c19zbHB0aW1lKSB7DQotCQkJdHMtPnRzX3J1bnRp bWUgPSBTQ0hFRF9TTFBfUlVOX01BWDsNCisJCQl0cy0+dHNfcnVudGltZSA9 IFNDSEVEX1NMUF9SVU5fTUFYIC8gMjsNCiAJCQl0cy0+dHNfc2xwdGltZSA9 IDE7DQogCQl9IGVsc2Ugew0KLQkJCXRzLT50c19zbHB0aW1lID0gU0NIRURf U0xQX1JVTl9NQVg7DQorCQkJdHMtPnRzX3NscHRpbWUgPSBTQ0hFRF9TTFBf UlVOX01BWCAvIDI7DQogCQkJdHMtPnRzX3J1bnRpbWUgPSAxOw0KIAkJfQ0K LQkJcmV0dXJuOw0KKwkJZ290byBzY29yZTsNCiAJfQ0KIAkvKg0KIAkgKiBJ ZiB3ZSBoYXZlIGV4Y2VlZGVkIGJ5IG1vcmUgdGhhbiAxLzV0aCB0aGVuIHRo ZSBhbGdvcml0aG0gYmVsb3cNCkBAIC0xNTA2LDEwICsxNTUxLDE5IEBADQog CWlmIChzdW0gPiAoU0NIRURfU0xQX1JVTl9NQVggLyA1KSAqIDYpIHsNCiAJ CXRzLT50c19ydW50aW1lIC89IDI7DQogCQl0cy0+dHNfc2xwdGltZSAvPSAy Ow0KLQkJcmV0dXJuOw0KKwkJZ290byBzY29yZTsNCiAJfQ0KIAl0cy0+dHNf cnVudGltZSA9ICh0cy0+dHNfcnVudGltZSAvIDUpICogNDsNCiAJdHMtPnRz X3NscHRpbWUgPSAodHMtPnRzX3NscHRpbWUgLyA1KSAqIDQ7DQorc2NvcmU6 DQorCXNjb3JlID0gc2NoZWRfaW50ZXJhY3Rfc2NvcmUodGQpOw0KKwlpZiAo dHMtPnRzX2ZsYWdzICYgVFNGX0lOVEVSTE9BRCkgew0KKwkJdGRxID0gVERR X0NQVSh0cy0+dHNfY3B1KTsNCisJCVREUV9MT0NLX0FTU0VSVCh0ZHEsIE1B X09XTkVEKTsNCisJCXRkcS0+dGRxX2ludGVybG9hZCAtPSB0cy0+dHNfc2Nv cmU7DQorCQl0ZHEtPnRkcV9pbnRlcmxvYWQgKz0gc2NvcmU7DQorCX0NCisJ dHMtPnRzX3Njb3JlID0gc2NvcmU7DQogfQ0KIA0KIC8qDQpAQCAtMTU1OSw3 ICsxNjEzLDcgQEANCiB7DQogDQogCS8qIENvbnZlcnQgc2NoZWRfc2xpY2Ug dG8gaHogKi8NCi0JcmV0dXJuIChoei8ocmVhbHN0YXRoei9zY2hlZF9zbGlj ZSkpOw0KKwlyZXR1cm4gKGh6LyhyZWFsc3RhdGh6L3NjaGVkX3NsaWNlX21h eCkpOw0KIH0NCiANCiAvKg0KQEAgLTE1OTgsMTYgKzE2NTIsMTkgQEANCiBz Y2hlZF90aHJlYWRfcHJpb3JpdHkoc3RydWN0IHRocmVhZCAqdGQsIHVfY2hh ciBwcmlvKQ0KIHsNCiAJc3RydWN0IHRkX3NjaGVkICp0czsNCisJc3RydWN0 IHRkcSAqdGRxOw0KIA0KIAlDVFI2KEtUUl9TQ0hFRCwgInNjaGVkX3ByaW86 ICVwKCVzKSBwcmlvICVkIG5ld3ByaW8gJWQgYnkgJXAoJXMpIiwNCiAJICAg IHRkLCB0ZC0+dGRfcHJvYy0+cF9jb21tLCB0ZC0+dGRfcHJpb3JpdHksIHBy aW8sIGN1cnRocmVhZCwNCiAJICAgIGN1cnRocmVhZC0+dGRfcHJvYy0+cF9j b21tKTsNCiAJdHMgPSB0ZC0+dGRfc2NoZWQ7DQorCXRkcSA9IFREUV9DUFUo dHMtPnRzX2NwdSk7DQogCVRIUkVBRF9MT0NLX0FTU0VSVCh0ZCwgTUFfT1dO RUQpOw0KLQlpZiAodGQtPnRkX3ByaW9yaXR5ID09IHByaW8pDQorCWlmICh0 ZC0+dGRfcHJpb3JpdHkgPD0gcHJpbykgew0KKwkJdGQtPnRkX3ByaW9yaXR5 ID0gcHJpbzsNCiAJCXJldHVybjsNCi0NCi0JaWYgKFREX09OX1JVTlEodGQp ICYmIHByaW8gPCB0ZC0+dGRfcHJpb3JpdHkpIHsNCisJfQ0KKwlpZiAoVERf T05fUlVOUSh0ZCkpIHsNCiAJCS8qDQogCQkgKiBJZiB0aGUgcHJpb3JpdHkg aGFzIGJlZW4gZWxldmF0ZWQgZHVlIHRvIHByaW9yaXR5DQogCQkgKiBwcm9w YWdhdGlvbiwgd2UgbWF5IGhhdmUgdG8gbW92ZSBvdXJzZWx2ZXMgdG8gYSBu ZXcNCkBAIC0xNjE3LDE2ICsxNjc0LDE0IEBADQogCQlzY2hlZF9yZW0odGQp Ow0KIAkJdGQtPnRkX3ByaW9yaXR5ID0gcHJpbzsNCiAJCXNjaGVkX2FkZCh0 ZCwgU1JRX0JPUlJPV0lORyk7DQotCX0gZWxzZSB7DQogI2lmZGVmIFNNUA0K LQkJc3RydWN0IHRkcSAqdGRxOw0KLQ0KLQkJdGRxID0gVERRX0NQVSh0cy0+ dHNfY3B1KTsNCisJfSBlbHNlIGlmIChURF9JU19SVU5OSU5HKHRkKSkgew0K IAkJaWYgKHByaW8gPCB0ZHEtPnRkcV9sb3dwcmkpDQogCQkJdGRxLT50ZHFf bG93cHJpID0gcHJpbzsNCisJCXRkLT50ZF9wcmlvcml0eSA9IHByaW87DQog I2VuZGlmDQorCX0gZWxzZQ0KIAkJdGQtPnRkX3ByaW9yaXR5ID0gcHJpbzsN Ci0JfQ0KIH0NCiANCiAvKg0KQEAgLTE3NzIsNiArMTgyNyw4IEBADQogDQog CXRkbiA9IFREUV9DUFUodGQtPnRkX3NjaGVkLT50c19jcHUpOw0KICNpZmRl ZiBTTVANCisJLyogVGhlIGxvYWQgaXMgYmVpbmcgcmVtb3ZlZCBmcm9tIHRo ZSBjdXJyZW50IGNwdS4gKi8NCisJdGRxX2xvYWRfcmVtKHRkcSwgdGQtPnRk X3NjaGVkKTsNCiAJLyoNCiAJICogRG8gdGhlIGxvY2sgZGFuY2UgcmVxdWly ZWQgdG8gYXZvaWQgTE9SLiAgV2UgZ3JhYiBhbiBleHRyYQ0KIAkgKiBzcGlu bG9jayBuZXN0aW5nIHRvIHByZXZlbnQgcHJlZW1wdGlvbiB3aGlsZSB3ZSdy ZQ0KQEAgLTE4NjMsMTIgKzE5MjAsMTEgQEANCiAJCVREX1NFVF9DQU5fUlVO KHRkKTsNCiAJfSBlbHNlIGlmIChURF9JU19SVU5OSU5HKHRkKSkgew0KIAkJ TVBBU1ModGQtPnRkX2xvY2sgPT0gVERRX0xPQ0tQVFIodGRxKSk7DQotCQl0 ZHFfbG9hZF9yZW0odGRxLCB0cyk7DQogCQlzcnFmbGFnID0gKGZsYWdzICYg U1dfUFJFRU1QVCkgPw0KIAkJICAgIFNSUV9PVVJTRUxGfFNSUV9ZSUVMRElO R3xTUlFfUFJFRU1QVEVEIDoNCiAJCSAgICBTUlFfT1VSU0VMRnxTUlFfWUlF TERJTkc7DQogCQlpZiAodHMtPnRzX2NwdSA9PSBjcHVpZCkNCi0JCQl0ZHFf YWRkKHRkcSwgdGQsIHNycWZsYWcpOw0KKwkJCXRkcV9ydW5xX2FkZCh0ZHEs IHRzLCBzcnFmbGFnKTsNCiAJCWVsc2UNCiAJCQltdHggPSBzY2hlZF9zd2l0 Y2hfbWlncmF0ZSh0ZHEsIHRkLCBzcnFmbGFnKTsNCiAJfSBlbHNlIHsNCkBA IC0xOTcwLDIyICsyMDI2LDE4IEBADQogCVRIUkVBRF9MT0NLX0FTU0VSVCh0 ZCwgTUFfT1dORUQpOw0KIAl0cyA9IHRkLT50ZF9zY2hlZDsNCiAJLyoNCi0J ICogSWYgd2Ugc2xlcHQgZm9yIG1vcmUgdGhhbiBhIHRpY2sgdXBkYXRlIG91 ciBpbnRlcmFjdGl2aXR5IGFuZA0KLQkgKiBwcmlvcml0eS4NCisJICogVXBk YXRlIGludGVyYWN0aXZpdHkgYW5kIHByaW9yaXR5IGFmdGVyIGEgc2xlZXAu DQogCSAqLw0KIAlzbHB0aWNrID0gdGQtPnRkX3NscHRpY2s7DQogCXRkLT50 ZF9zbHB0aWNrID0gMDsNCi0JaWYgKHNscHRpY2sgJiYgc2xwdGljayAhPSB0 aWNrcykgew0KLQkJdV9pbnQgaHp0aWNrczsNCi0NCi0JCWh6dGlja3MgPSAo dGlja3MgLSBzbHB0aWNrKSA8PCBTQ0hFRF9USUNLX1NISUZUOw0KLQkJdHMt PnRzX3NscHRpbWUgKz0gaHp0aWNrczsNCisJaWYgKHNscHRpY2sgJiYgc2xw dGljayAhPSB0aWNrcykgIHsNCisJCXRzLT50c19zbHB0aW1lICs9ICh0aWNr cyAtIHNscHRpY2spIDw8IFNDSEVEX1RJQ0tfU0hJRlQ7DQogCQlzY2hlZF9p bnRlcmFjdF91cGRhdGUodGQpOw0KIAkJc2NoZWRfcGN0Y3B1X3VwZGF0ZSh0 cyk7DQogCQlzY2hlZF9wcmlvcml0eSh0ZCk7DQorCQkvKiBSZXNldCB0aGUg c2xpY2UgdmFsdWUgYWZ0ZXIgd2Ugc2xlZXAuICovDQorCQl0cy0+dHNfc2xp Y2UgPSAwOw0KIAl9DQotCS8qIFJlc2V0IHRoZSBzbGljZSB2YWx1ZSBhZnRl ciB3ZSBzbGVlcC4gKi8NCi0JdHMtPnRzX3NsaWNlID0gc2NoZWRfc2xpY2U7 DQogCXNjaGVkX2FkZCh0ZCwgU1JRX0JPUklORyk7DQogfQ0KIA0KQEAgLTIw NDAsNyArMjA5Miw2IEBADQogCSAqLw0KIAl0czItPnRzX3NscHRpbWUgPSB0 cy0+dHNfc2xwdGltZTsNCiAJdHMyLT50c19ydW50aW1lID0gdHMtPnRzX3J1 bnRpbWU7DQotCXRzMi0+dHNfc2xpY2UgPSAxOwkvKiBBdHRlbXB0IHRvIHF1 aWNrbHkgbGVhcm4gaW50ZXJhY3Rpdml0eS4gKi8NCiB9DQogDQogLyoNCkBA IC0yMTg4LDI1ICsyMjM5LDI2IEBADQogCX0NCiAJdHMgPSB0ZC0+dGRfc2No ZWQ7DQogCS8qDQotCSAqIFdlIG9ubHkgZG8gc2xpY2luZyBjb2RlIGZvciBU SU1FU0hBUkUgdGhyZWFkcy4NCi0JICovDQotCWlmICh0ZC0+dGRfcHJpX2Ns YXNzICE9IFBSSV9USU1FU0hBUkUpDQotCQlyZXR1cm47DQotCS8qDQogCSAq IFdlIHVzZWQgYSB0aWNrOyBjaGFyZ2UgaXQgdG8gdGhlIHRocmVhZCBzbyB0 aGF0IHdlIGNhbiBjb21wdXRlIG91cg0KIAkgKiBpbnRlcmFjdGl2aXR5Lg0K IAkgKi8NCiAJdGQtPnRkX3NjaGVkLT50c19ydW50aW1lICs9IHRpY2tpbmNy Ow0KIAlzY2hlZF9pbnRlcmFjdF91cGRhdGUodGQpOw0KIAkvKg0KKwkgKiBX ZSBvbmx5IGRvIHNsaWNpbmcgY29kZSBmb3IgVElNRVNIQVJFIHRocmVhZHMu DQorCSAqLw0KKwlpZiAodGQtPnRkX3ByaV9jbGFzcyAhPSBQUklfVElNRVNI QVJFKQ0KKwkJcmV0dXJuOw0KKwlzY2hlZF9wcmlvcml0eSh0ZCk7DQorCS8q DQogCSAqIFdlIHVzZWQgdXAgb25lIHRpbWUgc2xpY2UuDQogCSAqLw0KLQlp ZiAoLS10cy0+dHNfc2xpY2UgPiAwKQ0KKwlpZiAoKyt0cy0+dHNfc2xpY2Ug PCB0ZHFfc2xpY2UodGRxKSkNCiAJCXJldHVybjsNCiAJLyoNCi0JICogV2Un cmUgb3V0IG9mIHRpbWUsIHJlY29tcHV0ZSBwcmlvcml0aWVzIGFuZCByZXF1 ZXVlLg0KKwkgKiBXZSdyZSBvdXQgb2YgdGltZSwgZm9yY2UgYSByZXF1ZXVl IGxhdGVyLg0KIAkgKi8NCi0Jc2NoZWRfcHJpb3JpdHkodGQpOw0KKwl0cy0+ dHNfc2xpY2UgPSAwOw0KIAl0ZC0+dGRfZmxhZ3MgfD0gVERGX05FRURSRVND SEVEOw0KIH0NCiANCkBAIC0yMzI4LDExICsyMzgwLDEwIEBADQogdGRxX2Fk ZChzdHJ1Y3QgdGRxICp0ZHEsIHN0cnVjdCB0aHJlYWQgKnRkLCBpbnQgZmxh Z3MpDQogew0KIAlzdHJ1Y3QgdGRfc2NoZWQgKnRzOw0KLQlpbnQgY2xhc3M7 DQogI2lmZGVmIFNNUA0KKwlpbnQgY2xhc3M7DQogCWludCBjcHVtYXNrOw0K ICNlbmRpZg0KLQ0KIAlURFFfTE9DS19BU1NFUlQodGRxLCBNQV9PV05FRCk7 DQogCUtBU1NFUlQoKHRkLT50ZF9pbmhpYml0b3JzID09IDApLA0KIAkgICAg KCJzY2hlZF9hZGQ6IHRyeWluZyB0byBydW4gaW5oaWJpdGVkIHRocmVhZCIp KTsNCkBAIC0yMzQyLDIwICsyMzkzLDEwIEBADQogCSAgICAoInNjaGVkX2Fk ZDogdGhyZWFkIHN3YXBwZWQgb3V0IikpOw0KIA0KIAl0cyA9IHRkLT50ZF9z Y2hlZDsNCi0JY2xhc3MgPSBQUklfQkFTRSh0ZC0+dGRfcHJpX2NsYXNzKTsN Ci0gICAgICAgIFREX1NFVF9SVU5RKHRkKTsNCi0JaWYgKHRzLT50c19zbGlj ZSA9PSAwKQ0KLQkJdHMtPnRzX3NsaWNlID0gc2NoZWRfc2xpY2U7DQotCS8q DQotCSAqIFBpY2sgdGhlIHJ1biBxdWV1ZSBiYXNlZCBvbiBwcmlvcml0eS4N Ci0JICovDQotCWlmICh0ZC0+dGRfcHJpb3JpdHkgPD0gUFJJX01BWF9SRUFM VElNRSkNCi0JCXRzLT50c19ydW5xID0gJnRkcS0+dGRxX3JlYWx0aW1lOw0K LQllbHNlIGlmICh0ZC0+dGRfcHJpb3JpdHkgPD0gUFJJX01BWF9USU1FU0hB UkUpDQotCQl0cy0+dHNfcnVucSA9ICZ0ZHEtPnRkcV90aW1lc2hhcmU7DQot CWVsc2UNCi0JCXRzLT50c19ydW5xID0gJnRkcS0+dGRxX2lkbGU7DQorCXRk cV9ydW5xX2FkZCh0ZHEsIHRzLCBmbGFncyk7DQorCXRkcV9sb2FkX2FkZCh0 ZHEsIHRzKTsNCiAjaWZkZWYgU01QDQorCWNsYXNzID0gUFJJX0JBU0UodGQt PnRkX3ByaV9jbGFzcyk7DQogCWNwdW1hc2sgPSAxIDw8IHRzLT50c19jcHU7 DQogCS8qDQogCSAqIElmIHdlIGhhZCBiZWVuIGlkbGUsIGNsZWFyIG91ciBi aXQgaW4gdGhlIGdyb3VwIGFuZCBwb3RlbnRpYWxseQ0KQEAgLTIzNzgsOCAr MjQxOSw2IEBADQogCWlmICh0ZC0+dGRfcHJpb3JpdHkgPCB0ZHEtPnRkcV9s b3dwcmkpDQogCQl0ZHEtPnRkcV9sb3dwcmkgPSB0ZC0+dGRfcHJpb3JpdHk7 DQogI2VuZGlmDQotCXRkcV9ydW5xX2FkZCh0ZHEsIHRzLCBmbGFncyk7DQot CXRkcV9sb2FkX2FkZCh0ZHEsIHRzKTsNCiB9DQogDQogLyoNCkBAIC0yNjYw LDggKzI2OTksMTAgQEANCiAgICAgIlNjaGVkdWxlciIpOw0KIFNZU0NUTF9T VFJJTkcoX2tlcm5fc2NoZWQsIE9JRF9BVVRPLCBuYW1lLCBDVExGTEFHX1JE LCAiVUxFIiwgMCwNCiAgICAgIlNjaGVkdWxlciBuYW1lIik7DQotU1lTQ1RM X0lOVChfa2Vybl9zY2hlZCwgT0lEX0FVVE8sIHNsaWNlLCBDVExGTEFHX1JX LCAmc2NoZWRfc2xpY2UsIDAsDQotICAgICJTbGljZSBzaXplIGZvciB0aW1l c2hhcmUgdGhyZWFkcyIpOw0KK1NZU0NUTF9JTlQoX2tlcm5fc2NoZWQsIE9J RF9BVVRPLCBzbGljZSwgQ1RMRkxBR19SVywgJnNjaGVkX3NsaWNlX21heCwg MCwNCisgICAgIk1heGltdW0gc2xpY2Ugc2l6ZSBmb3IgdGltZXNoYXJlIHRo cmVhZHMiKTsNCitTWVNDVExfSU5UKF9rZXJuX3NjaGVkLCBPSURfQVVUTywg c2xpY2VfbWluLCBDVExGTEFHX1JXLCAmc2NoZWRfc2xpY2VfbWluLCAwLA0K KyAgICAiTWluaW11bSBzbGljZSBzaXplIGZvciB0aW1lc2hhcmUgdGhyZWFk cyIpOw0KIFNZU0NUTF9JTlQoX2tlcm5fc2NoZWQsIE9JRF9BVVRPLCBpbnRl cmFjdCwgQ1RMRkxBR19SVywgJnNjaGVkX2ludGVyYWN0LCAwLA0KICAgICAg IkludGVyYWN0aXZpdHkgc2NvcmUgdGhyZXNob2xkIik7DQogU1lTQ1RMX0lO VChfa2Vybl9zY2hlZCwgT0lEX0FVVE8sIHByZWVtcHRfdGhyZXNoLCBDVExG TEFHX1JXLCAmcHJlZW1wdF90aHJlc2gsDQpAQCAtMjY3MSw3ICsyNzEyLDYg QEANCiAgICAgIlBpY2sgdGhlIHRhcmdldCBjcHUgYmFzZWQgb24gcHJpb3Jp dHkgcmF0aGVyIHRoYW4gbG9hZC4iKTsNCiBTWVNDVExfSU5UKF9rZXJuX3Nj aGVkLCBPSURfQVVUTywgYWZmaW5pdHksIENUTEZMQUdfUlcsICZhZmZpbml0 eSwgMCwNCiAgICAgIk51bWJlciBvZiBoeiB0aWNrcyB0byBrZWVwIHRocmVh ZCBhZmZpbml0eSBmb3IiKTsNCi1TWVNDVExfSU5UKF9rZXJuX3NjaGVkLCBP SURfQVVUTywgdHJ5c2VsZiwgQ1RMRkxBR19SVywgJnRyeXNlbGYsIDAsICIi KTsNCiBTWVNDVExfSU5UKF9rZXJuX3NjaGVkLCBPSURfQVVUTywgYmFsYW5j ZSwgQ1RMRkxBR19SVywgJnJlYmFsYW5jZSwgMCwNCiAgICAgIkVuYWJsZXMg dGhlIGxvbmctdGVybSBsb2FkIGJhbGFuY2VyIik7DQogU1lTQ1RMX0lOVChf a2Vybl9zY2hlZCwgT0lEX0FVVE8sIGJhbGFuY2VfaW50ZXJ2YWwsIENUTEZM QUdfUlcsDQo= --0-799710710-1194208176=:544-- From owner-freebsd-performance@FreeBSD.ORG Sun Nov 4 20:43:57 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2D6DB16A417 for ; Sun, 4 Nov 2007 20:43:57 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.178]) by mx1.freebsd.org (Postfix) with ESMTP id CB8FF13C480 for ; Sun, 4 Nov 2007 20:43:56 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so2755649pyb for ; Sun, 04 Nov 2007 12:43:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=fcSwyCPlBLaehdxEHJbCYnK8U2CEx1DAfHZAav8DDCw=; b=M8MgTa+Q6PwDbWbVwOE0j4BmO61HmsZNTbmB2ebbuwDFWUyq6AEbHCTfOOkzaL8MLhp9PYO85dU+05sOdMIxccYNKLvvmAEpOu/Ow28izbp7ZX8nJoRihz+M2vPmD8CURf6c5l85NTrCgTbRNqpYdoPac7eaOJQ3odDJ50w7YfM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=J359Nho2wpyT6ljMO6yKbjzhuEXpBc4Hyj/f+Oy0HJpsaC3QyMLOki7svA/GXV+zrNXYSnKhY6+iaqrRN/FCCbWfBO4pN8lQSA7y1ODw2WYQwChTdFOcsblPWUHzWTGHfoUtD8ZEIB/L7o1JjoeWbsdGIrbJUDW4J4V0VnIHSM0= Received: by 10.35.115.18 with SMTP id s18mr5148331pym.1194209034137; Sun, 04 Nov 2007 12:43:54 -0800 (PST) Received: by 10.35.110.17 with HTTP; Sun, 4 Nov 2007 12:43:54 -0800 (PST) Message-ID: <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> Date: Sun, 4 Nov 2007 15:43:54 -0500 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071104122546.S544@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711021306w10c48a15s99eab526064ac814@mail.gmail.com> <20071102150028.R544@10.0.0.1> <8cb6106e0711021839i4714bdfbh74d412b3e14e808@mail.gmail.com> <8cb6106e0711031227t1e829969s2e6062e1db5167af@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2007 20:43:57 -0000 > Josh, I included one too many changes in the diff and it made the results > ambiguous. I've scaled it back slightly by removing the changes to > sched_pickcpu() and included the patch in this email again. Can you run > through your tests once more? I'd like to commit this part soon as it > helps in other cases. I'm most interested in the buildworld numbers for > now. Sure, I can run through them. Should I change the slice_min value at all during testing to compare different values? Or is that part of the other patch that is not included in this (haven't fetched and grep'd it yet). :) I'll get the benchmark numbers as soon as I can. Thanks, Josh From owner-freebsd-performance@FreeBSD.ORG Sun Nov 4 21:25:39 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 803FC16A474 for ; Sun, 4 Nov 2007 21:25:39 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from webaccess-cl.virtdom.com (webaccess-cl.virtdom.com [216.240.101.25]) by mx1.freebsd.org (Postfix) with ESMTP id 461AA13C491 for ; Sun, 4 Nov 2007 21:25:39 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from [192.168.1.100] (cpe-24-94-75-93.hawaii.res.rr.com [24.94.75.93]) (authenticated bits=0) by webaccess-cl.virtdom.com (8.13.6/8.13.6) with ESMTP id lA4LPQAv027031 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Sun, 4 Nov 2007 16:25:28 -0500 (EST) (envelope-from jroberson@chesapeake.net) Date: Sun, 4 Nov 2007 13:27:24 -0800 (PST) From: Jeff Roberson X-X-Sender: jroberson@10.0.0.1 To: "Gelsema, P (Patrick) - FreeBSD" In-Reply-To: <1698.10.202.77.103.1194211291.squirrel@webmail.superhero.nl> Message-ID: <20071104132540.S544@10.0.0.1> References: <1698.10.202.77.103.1194211291.squirrel@webmail.superhero.nl> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2007 21:25:39 -0000 On Sun, 4 Nov 2007, Gelsema, P (Patrick) - FreeBSD wrote: > Hi Jeff, > > I tried your patch. Ran a buildkernel, timed. Recompiled kernel including > your patch, rebooted and reran. Please find results below. > > w/o patch > hulk# time make -j8 buildkernel > 837.808u 138.167s 10:28.96 155.1% 6349+1349k 2873+7780io 303pf+0w > > w patch > hulk# time make -j8 buildkernel > 838.554u 168.316s 10:52.10 154.4% 6263+1332k 6489+7791io 11pf+0w > > I only understand the 10:52 seconds thing, but it looks like it's > stressing less and still getting things done. > Well this doesn't look very good at all. System time increased by 30 seconds! Must be too many extra context switches. The minimum slice value is probably too small and you've got an average of 4 threads per-core. Can you try re-running with kern.sched.slice_min = 4 and kern.sched.slice = 12 ? Can you tell me how 4BSD does on this machine? Thanks, Jeff > System is AMD Athlon X264 2.2Ghz > > Kernel is GENERIC. > hulk# uname -a > FreeBSD hulk.superhero.nl 7.0-BETA2 FreeBSD 7.0-BETA2 #0: Sun Nov 4 > 20:30:23 UTC 2007 root@hulk.superhero.nl:/usr/obj/usr/src/sys/GENERIC > amd64 > > I see you have a new patch. Could you send that to me? When I download it > from the mailman site I get weird characters in the downloaded file :( > > Cheers > > Patrick > From owner-freebsd-performance@FreeBSD.ORG Sun Nov 4 21:48:37 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 4901616A41B for ; Sun, 4 Nov 2007 21:48:37 +0000 (UTC) (envelope-from freebsd@superhero.nl) Received: from superman.superhero.nl (superhero.nl [82.95.198.17]) by mx1.freebsd.org (Postfix) with ESMTP id 6EF4113C4A3 for ; Sun, 4 Nov 2007 21:48:36 +0000 (UTC) (envelope-from freebsd@superhero.nl) Received: (qmail 31728 invoked by uid 80); 4 Nov 2007 21:21:31 -0000 Received: from robin.ad.superhero.nl ([10.202.77.103]) (SquirrelMail authenticated user gelsemap) by webmail.superhero.nl with HTTP; Sun, 4 Nov 2007 22:21:31 +0100 (CET) Message-ID: <1698.10.202.77.103.1194211291.squirrel@webmail.superhero.nl> Date: Sun, 4 Nov 2007 22:21:31 +0100 (CET) From: "Gelsema, P \(Patrick\) - FreeBSD" To: freebsd-performance@freebsd.org User-Agent: SquirrelMail/1.4.8 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Mailman-Approved-At: Sun, 04 Nov 2007 21:56:04 +0000 Cc: jroberson@chesapeake.net Subject: ULE vs 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2007 21:48:37 -0000 Hi Jeff, I tried your patch. Ran a buildkernel, timed. Recompiled kernel including your patch, rebooted and reran. Please find results below. w/o patch hulk# time make -j8 buildkernel 837.808u 138.167s 10:28.96 155.1% 6349+1349k 2873+7780io 303pf+0w w patch hulk# time make -j8 buildkernel 838.554u 168.316s 10:52.10 154.4% 6263+1332k 6489+7791io 11pf+0w I only understand the 10:52 seconds thing, but it looks like it's stressing less and still getting things done. System is AMD Athlon X264 2.2Ghz Kernel is GENERIC. hulk# uname -a FreeBSD hulk.superhero.nl 7.0-BETA2 FreeBSD 7.0-BETA2 #0: Sun Nov 4 20:30:23 UTC 2007 root@hulk.superhero.nl:/usr/obj/usr/src/sys/GENERIC amd64 I see you have a new patch. Could you send that to me? When I download it from the mailman site I get weird characters in the downloaded file :( Cheers Patrick From owner-freebsd-performance@FreeBSD.ORG Sun Nov 4 23:30:57 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A0C9A16A419 for ; Sun, 4 Nov 2007 23:30:57 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from webaccess-cl.virtdom.com (webaccess-cl.virtdom.com [216.240.101.25]) by mx1.freebsd.org (Postfix) with ESMTP id E8E6213C4B6 for ; Sun, 4 Nov 2007 23:30:56 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from [192.168.1.100] (cpe-24-94-75-93.hawaii.res.rr.com [24.94.75.93]) (authenticated bits=0) by webaccess-cl.virtdom.com (8.13.6/8.13.6) with ESMTP id lA4NHZgM047526 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Sun, 4 Nov 2007 18:17:36 -0500 (EST) (envelope-from jroberson@chesapeake.net) Date: Sun, 4 Nov 2007 15:19:32 -0800 (PST) From: Jeff Roberson X-X-Sender: jroberson@10.0.0.1 To: Josh Carroll In-Reply-To: <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> Message-ID: <20071104151722.M544@10.0.0.1> References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711021306w10c48a15s99eab526064ac814@mail.gmail.com> <20071102150028.R544@10.0.0.1> <8cb6106e0711021839i4714bdfbh74d412b3e14e808@mail.gmail.com> <8cb6106e0711031227t1e829969s2e6062e1db5167af@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-603731913-1194218372=:544" Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2007 23:30:57 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-603731913-1194218372=:544 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed On Sun, 4 Nov 2007, Josh Carroll wrote: >> Josh, I included one too many changes in the diff and it made the results >> ambiguous. I've scaled it back slightly by removing the changes to >> sched_pickcpu() and included the patch in this email again. Can you run >> through your tests once more? I'd like to commit this part soon as it >> helps in other cases. I'm most interested in the buildworld numbers for >> now. > > Sure, I can run through them. Should I change the slice_min value at > all during testing to compare different values? Or is that part of the > other patch that is not included in this (haven't fetched and grep'd > it yet). :) > > I'll get the benchmark numbers as soon as I can. Turns out the last patch I posted had a small compile error because I edited it by hand to remove one section. Here's an updated patch that fixes that and changes the min/max slice values to something more reasonable. Slice min should be around 4 with a max of 12. Also looks like 4BSD's slice handling got more precise recently as well. jhb changed it from using a callout to an actual counter based on runtime. Thanks, Jeff > > Thanks, > Josh > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > --0-603731913-1194218372=:544 Content-Type: TEXT/x-diff; charset=US-ASCII; name=uleslice.diff Content-Transfer-Encoding: BASE64 Content-ID: <20071104151932.T544@10.0.0.1> Content-Description: Content-Disposition: attachment; filename=uleslice.diff SW5kZXg6IHNjaGVkX3VsZS5jDQo9PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09DQpS Q1MgZmlsZTogL2hvbWUvbmN2cy9zcmMvc3lzL2tlcm4vc2NoZWRfdWxlLmMs dg0KcmV0cmlldmluZyByZXZpc2lvbiAxLjIxNg0KZGlmZiAtdSAtcjEuMjE2 IHNjaGVkX3VsZS5jDQotLS0gc2NoZWRfdWxlLmMJMjMgT2N0IDIwMDcgMDA6 NTI6MjQgLTAwMDAJMS4yMTYNCisrKyBzY2hlZF91bGUuYwk0IE5vdiAyMDA3 IDIzOjE2OjMwIC0wMDAwDQpAQCAtODgsNyArODgsOCBAQA0KIAlzaG9ydAkJ dHNfZmxhZ3M7CS8qIFRTRl8qIGZsYWdzLiAqLw0KIAl1X2NoYXIJCXRzX3Jx aW5kZXg7CS8qIFJ1biBxdWV1ZSBpbmRleC4gKi8NCiAJdV9jaGFyCQl0c19j cHU7CQkvKiBDUFUgdGhhdCB3ZSBoYXZlIGFmZmluaXR5IGZvci4gKi8NCi0J aW50CQl0c19zbGljZTsJLyogVGlja3Mgb2Ygc2xpY2UgcmVtYWluaW5nLiAq Lw0KKwlpbnQJCXRzX3NsaWNlOwkvKiBUaWNrcyBvZiBzbGljZSB1c2VkLiAq Lw0KKwlpbnQJCXRzX3Njb3JlOwkvKiBJbnRlcmFjdGl2aXR5IHNjb3JlLiAq Lw0KIAl1X2ludAkJdHNfc2xwdGltZTsJLyogTnVtYmVyIG9mIHRpY2tzIHdl IHZvbC4gc2xlcHQgKi8NCiAJdV9pbnQJCXRzX3J1bnRpbWU7CS8qIE51bWJl ciBvZiB0aWNrcyB3ZSB3ZXJlIHJ1bm5pbmcgKi8NCiAJLyogVGhlIGZvbGxv d2luZyB2YXJpYWJsZXMgYXJlIG9ubHkgdXNlZCBmb3IgcGN0Y3B1IGNhbGN1 bGF0aW9uICovDQpAQCAtMTAyLDYgKzEwMyw3IEBADQogLyogZmxhZ3Mga2Vw dCBpbiB0c19mbGFncyAqLw0KICNkZWZpbmUJVFNGX0JPVU5ECTB4MDAwMQkJ LyogVGhyZWFkIGNhbiBub3QgbWlncmF0ZS4gKi8NCiAjZGVmaW5lCVRTRl9Y RkVSQUJMRQkweDAwMDIJCS8qIFRocmVhZCB3YXMgYWRkZWQgYXMgdHJhbnNm ZXJhYmxlLiAqLw0KKyNkZWZpbmUJVFNGX0lOVEVSTE9BRAkweDAwMDQJCS8q IEludGVyYWN0aXZlIGxvYWQgb24gcnVucS4gKi8NCiANCiBzdGF0aWMgc3Ry dWN0IHRkX3NjaGVkIHRkX3NjaGVkMDsNCiANCkBAIC0xNjcsMTMgKzE2OSwx NSBAQA0KICAqCQkJdGhlIHNoaWZ0IGZhY3Rvci4gIFdpdGhvdXQgdGhlIHNo aWZ0IHRoZSBlcnJvciByYXRlDQogICoJCQlkdWUgdG8gcm91bmRpbmcgd291 bGQgYmUgdW5hY2NlcHRhYmx5IGhpZ2guDQogICogcmVhbHN0YXRoejoJCXN0 YXRoeiBpcyBzb21ldGltZXMgMCBhbmQgcnVuIG9mZiBvZiBoei4NCi0gKiBz Y2hlZF9zbGljZToJCVJ1bnRpbWUgb2YgZWFjaCB0aHJlYWQgYmVmb3JlIHJl c2NoZWR1bGluZy4NCisgKiBzY2hlZF9zbGljZV9tYXg6CU1heGltdW0gcnVu dGltZSBvZiBlYWNoIHRocmVhZCBiZWZvcmUgcmVzY2hlZHVsaW5nLg0KKyAq IHNjaGVkX3NsaWNlX21pbjoJTWluaW11bSBydW50aW1lIG9mIGVhY2ggdGhy ZWFkIGJlZm9yZSByZXNjaGVkdWxpbmcuDQogICogcHJlZW1wdF90aHJlc2g6 CVByaW9yaXR5IHRocmVzaG9sZCBmb3IgcHJlZW1wdGlvbiBhbmQgcmVtb3Rl IElQSXMuDQogICovDQogc3RhdGljIGludCBzY2hlZF9pbnRlcmFjdCA9IFND SEVEX0lOVEVSQUNUX1RIUkVTSDsNCiBzdGF0aWMgaW50IHJlYWxzdGF0aHo7 DQogc3RhdGljIGludCB0aWNraW5jcjsNCi1zdGF0aWMgaW50IHNjaGVkX3Ns aWNlOw0KK3N0YXRpYyBpbnQgc2NoZWRfc2xpY2VfbWF4ID0gMTsNCitzdGF0 aWMgaW50IHNjaGVkX3NsaWNlX21pbiA9IDE7DQogI2lmZGVmIFBSRUVNUFRJ T04NCiAjaWZkZWYgRlVMTF9QUkVFTVBUSU9ODQogc3RhdGljIGludCBwcmVl bXB0X3RocmVzaCA9IFBSSV9NQVhfSURMRTsNCkBAIC0xOTQsNiArMTk4LDcg QEANCiAJc3RydWN0IHJ1bnEJdGRxX3JlYWx0aW1lOwkJLyogcmVhbC10aW1l IHJ1biBxdWV1ZS4gKi8NCiAJc3RydWN0IHJ1bnEJdGRxX3RpbWVzaGFyZTsJ CS8qIHRpbWVzaGFyZSBydW4gcXVldWUuICovDQogCXN0cnVjdCBydW5xCXRk cV9pZGxlOwkJLyogUXVldWUgb2YgSURMRSB0aHJlYWRzLiAqLw0KKwl1bnNp Z25lZCBpbnQJdGRxX2ludGVybG9hZDsJCS8qIEludGVyYWN0aXZlIGxvYWQu ICovDQogCWludAkJdGRxX2xvYWQ7CQkvKiBBZ2dyZWdhdGUgbG9hZC4gKi8N CiAJdV9jaGFyCQl0ZHFfaWR4OwkJLyogQ3VycmVudCBpbnNlcnQgaW5kZXgu ICovDQogCXVfY2hhcgkJdGRxX3JpZHg7CQkvKiBDdXJyZW50IHJlbW92YWwg aW5kZXguICovDQpAQCAtMjM5LDcgKzI0NCw2IEBADQogc3RhdGljIGludCBi YWxhbmNlX2ludGVydmFsID0gMTI4OwkvKiBEZWZhdWx0IHNldCBpbiBzY2hl ZF9pbml0dGlja3MoKS4gKi8NCiBzdGF0aWMgaW50IHBpY2tfcHJpID0gMTsN CiBzdGF0aWMgaW50IGFmZmluaXR5Ow0KLXN0YXRpYyBpbnQgdHJ5c2VsZiA9 IDE7DQogc3RhdGljIGludCBzdGVhbF9odHQgPSAxOw0KIHN0YXRpYyBpbnQg c3RlYWxfaWRsZSA9IDE7DQogc3RhdGljIGludCBzdGVhbF90aHJlc2ggPSAy Ow0KQEAgLTI4OCwxMCArMjkyLDEyIEBADQogc3RhdGljIHZvaWQgdGRxX3Nl dHVwKHN0cnVjdCB0ZHEgKik7DQogc3RhdGljIHZvaWQgdGRxX2xvYWRfYWRk KHN0cnVjdCB0ZHEgKiwgc3RydWN0IHRkX3NjaGVkICopOw0KIHN0YXRpYyB2 b2lkIHRkcV9sb2FkX3JlbShzdHJ1Y3QgdGRxICosIHN0cnVjdCB0ZF9zY2hl ZCAqKTsNCitzdGF0aWMgaW50IHRkcV9zbGljZShzdHJ1Y3QgdGRxICopOw0K IHN0YXRpYyBfX2lubGluZSB2b2lkIHRkcV9ydW5xX2FkZChzdHJ1Y3QgdGRx ICosIHN0cnVjdCB0ZF9zY2hlZCAqLCBpbnQpOw0KIHN0YXRpYyBfX2lubGlu ZSB2b2lkIHRkcV9ydW5xX3JlbShzdHJ1Y3QgdGRxICosIHN0cnVjdCB0ZF9z Y2hlZCAqKTsNCi12b2lkIHRkcV9wcmludChpbnQgY3B1KTsNCi1zdGF0aWMg dm9pZCBydW5xX3ByaW50KHN0cnVjdCBydW5xICpycSk7DQordm9pZCB0ZHFf cHJpbnQoaW50KTsNCit2b2lkIHNjaGVkX3ByaW50KHN0cnVjdCB0aHJlYWQg Kik7DQorc3RhdGljIHZvaWQgcnVucV9wcmludChzdHJ1Y3QgcnVucSAqKTsN CiBzdGF0aWMgdm9pZCB0ZHFfYWRkKHN0cnVjdCB0ZHEgKiwgc3RydWN0IHRo cmVhZCAqLCBpbnQpOw0KICNpZmRlZiBTTVANCiBzdGF0aWMgdm9pZCB0ZHFf bW92ZShzdHJ1Y3QgdGRxICosIHN0cnVjdCB0ZHEgKik7DQpAQCAtMzQ1LDYg KzM1MSwyNiBAQA0KIAl9DQogfQ0KIA0KK3ZvaWQNCitzY2hlZF9wcmludChz dHJ1Y3QgdGhyZWFkICp0ZCkNCit7DQorCXN0cnVjdCB0ZF9zY2hlZCAqdHM7 DQorDQorCWlmICh0ZCA9PSBOVUxMKQ0KKwkJdGQgPSBjdXJ0aHJlYWQ7DQor CXRzID0gdGQtPnRkX3NjaGVkOw0KKwlwcmludGYoImZsYWdzOiAgICAweCVY XG4iLCB0cy0+dHNfZmxhZ3MpOw0KKwlwcmludGYoInJxaW5kZXg6ICAlZFxu IiwgdHMtPnRzX3JxaW5kZXgpOw0KKwlwcmludGYoImNwdTogICAgICAlZFxu IiwgdHMtPnRzX2NwdSk7DQorCXByaW50Zigic2xpY2U6ICAgICVkXG4iLCB0 cy0+dHNfc2xpY2UpOw0KKwlwcmludGYoInNjb3JlOiAgICAlZFxuIiwgdHMt PnRzX3Njb3JlKTsNCisJcHJpbnRmKCJzbHB0aW1lOiAgJWRcbiIsIHRzLT50 c19zbHB0aW1lKTsNCisJcHJpbnRmKCJydW50aW1lOiAgJWRcbiIsIHRzLT50 c19ydW50aW1lKTsNCisJcHJpbnRmKCJsdGljazogICAgJWRcbiIsIHRzLT50 c19sdGljayk7DQorCXByaW50ZigiZnRpY2s6ICAgICVkXG4iLCB0cy0+dHNf ZnRpY2spOw0KKwlwcmludGYoInRpY2tzOiAgICAlZFxuIiwgdHMtPnRzX3Rp Y2tzKTsNCit9DQorDQogLyoNCiAgKiBQcmludCB0aGUgc3RhdHVzIG9mIGEg cGVyLWNwdSB0aHJlYWQgcXVldWUuICBTaG91bGQgYmUgYSBkZGIgc2hvdyBj bWQuDQogICovDQpAQCAtMzU3LDcgKzM4Myw5IEBADQogDQogCXByaW50Zigi dGRxICVkOlxuIiwgVERRX0lEKHRkcSkpOw0KIAlwcmludGYoIlx0bG9ja3B0 ciAgICAgICAgICVwXG4iLCBURFFfTE9DS1BUUih0ZHEpKTsNCisJcHJpbnRm KCJcdGludGVybG9hZDoJICAlZFxuIiwgdGRxLT50ZHFfaW50ZXJsb2FkKTsN CiAJcHJpbnRmKCJcdGxvYWQ6ICAgICAgICAgICAlZFxuIiwgdGRxLT50ZHFf bG9hZCk7DQorCXByaW50ZigiXHRzbGljZTogICAgICAgICAgJWRcbiIsIHRk cV9zbGljZSh0ZHEpKTsNCiAJcHJpbnRmKCJcdHRpbWVzaGFyZSBpZHg6ICAl ZFxuIiwgdGRxLT50ZHFfaWR4KTsNCiAJcHJpbnRmKCJcdHRpbWVzaGFyZSBy aWR4OiAlZFxuIiwgdGRxLT50ZHFfcmlkeCk7DQogCXByaW50ZigiXHRyZWFs dGltZSBydW5xOlxuIik7DQpAQCAtMzgzLDggKzQxMSwxMiBAQA0KIHN0YXRp YyBfX2lubGluZSB2b2lkDQogdGRxX3J1bnFfYWRkKHN0cnVjdCB0ZHEgKnRk cSwgc3RydWN0IHRkX3NjaGVkICp0cywgaW50IGZsYWdzKQ0KIHsNCisJdV9j aGFyIHByaTsNCisNCisJcHJpID0gdHMtPnRzX3RocmVhZC0+dGRfcHJpb3Jp dHk7DQogCVREUV9MT0NLX0FTU0VSVCh0ZHEsIE1BX09XTkVEKTsNCiAJVEhS RUFEX0xPQ0tfQVNTRVJUKHRzLT50c190aHJlYWQsIE1BX09XTkVEKTsNCisJ VERfU0VUX1JVTlEodHMtPnRzX3RocmVhZCk7DQogI2lmZGVmIFNNUA0KIAlp ZiAoVEhSRUFEX0NBTl9NSUdSQVRFKHRzLT50c190aHJlYWQpKSB7DQogCQl0 ZHEtPnRkcV90cmFuc2ZlcmFibGUrKzsNCkBAIC0zOTIsMTUgKzQyNCwxNSBA QA0KIAkJdHMtPnRzX2ZsYWdzIHw9IFRTRl9YRkVSQUJMRTsNCiAJfQ0KICNl bmRpZg0KLQlpZiAodHMtPnRzX3J1bnEgPT0gJnRkcS0+dGRxX3RpbWVzaGFy ZSkgew0KLQkJdV9jaGFyIHByaTsNCi0NCi0JCXByaSA9IHRzLT50c190aHJl YWQtPnRkX3ByaW9yaXR5Ow0KKwlpZiAocHJpIDw9IFBSSV9NQVhfUkVBTFRJ TUUpIHsNCisJCXRzLT50c19ydW5xID0gJnRkcS0+dGRxX3JlYWx0aW1lOw0K Kwl9IGVsc2UgaWYgKHByaSA8PSBQUklfTUFYX1RJTUVTSEFSRSkgew0KKwkJ dHMtPnRzX3J1bnEgPSAmdGRxLT50ZHFfdGltZXNoYXJlOw0KIAkJS0FTU0VS VChwcmkgPD0gUFJJX01BWF9USU1FU0hBUkUgJiYgcHJpID49IFBSSV9NSU5f VElNRVNIQVJFLA0KIAkJCSgiSW52YWxpZCBwcmlvcml0eSAlZCBvbiB0aW1l c2hhcmUgcnVucSIsIHByaSkpOw0KIAkJLyoNCiAJCSAqIFRoaXMgcXVldWUg Y29udGFpbnMgb25seSBwcmlvcml0aWVzIGJldHdlZW4gTUlOIGFuZCBNQVgN Ci0JCSAqIHJlYWx0aW1lLiAgVXNlIHRoZSB3aG9sZSBxdWV1ZSB0byByZXBy ZXNlbnQgdGhlc2UgdmFsdWVzLg0KKwkJICogdGltZXNoYXJlLiAgVXNlIHRo ZSB3aG9sZSBxdWV1ZSB0byByZXByZXNlbnQgdGhlc2UgdmFsdWVzLg0KIAkJ ICovDQogCQlpZiAoKGZsYWdzICYgKFNSUV9CT1JST1dJTkd8U1JRX1BSRUVN UFRFRCkpID09IDApIHsNCiAJCQlwcmkgPSAocHJpIC0gUFJJX01JTl9USU1F U0hBUkUpIC8gVFNfUlFfUFBROw0KQEAgLTQxNiw4ICs0NDgsMTAgQEANCiAJ CX0gZWxzZQ0KIAkJCXByaSA9IHRkcS0+dGRxX3JpZHg7DQogCQlydW5xX2Fk ZF9wcmkodHMtPnRzX3J1bnEsIHRzLCBwcmksIGZsYWdzKTsNCisJCXJldHVy bjsNCiAJfSBlbHNlDQotCQlydW5xX2FkZCh0cy0+dHNfcnVucSwgdHMsIGZs YWdzKTsNCisJCXRzLT50c19ydW5xID0gJnRkcS0+dGRxX2lkbGU7DQorCXJ1 bnFfYWRkKHRzLT50c19ydW5xLCB0cywgZmxhZ3MpOw0KIH0NCiANCiAvKiAN CkBAIC00NDMsMTMgKzQ3Nyw2IEBADQogCQkJcnVucV9yZW1vdmVfaWR4KHRz LT50c19ydW5xLCB0cywgJnRkcS0+dGRxX3JpZHgpOw0KIAkJZWxzZQ0KIAkJ CXJ1bnFfcmVtb3ZlX2lkeCh0cy0+dHNfcnVucSwgdHMsIE5VTEwpOw0KLQkJ LyoNCi0JCSAqIEZvciB0aW1lc2hhcmUgdGhyZWFkcyB3ZSB1cGRhdGUgdGhl IHByaW9yaXR5IGhlcmUgc28NCi0JCSAqIHRoZSBwcmlvcml0eSByZWZsZWN0 cyB0aGUgdGltZSB3ZSd2ZSBiZWVuIHNsZWVwaW5nLg0KLQkJICovDQotCQl0 cy0+dHNfbHRpY2sgPSB0aWNrczsNCi0JCXNjaGVkX3BjdGNwdV91cGRhdGUo dHMpOw0KLQkJc2NoZWRfcHJpb3JpdHkodHMtPnRzX3RocmVhZCk7DQogCX0g ZWxzZQ0KIAkJcnVucV9yZW1vdmUodHMtPnRzX3J1bnEsIHRzKTsNCiB9DQpA QCAtNDY2LDYgKzQ5Myw4IEBADQogCVREUV9MT0NLX0FTU0VSVCh0ZHEsIE1B X09XTkVEKTsNCiAJVEhSRUFEX0xPQ0tfQVNTRVJUKHRzLT50c190aHJlYWQs IE1BX09XTkVEKTsNCiAJY2xhc3MgPSBQUklfQkFTRSh0cy0+dHNfdGhyZWFk LT50ZF9wcmlfY2xhc3MpOw0KKwl0ZHEtPnRkcV9pbnRlcmxvYWQgKz0gdHMt PnRzX3Njb3JlOw0KKwl0cy0+dHNfZmxhZ3MgfD0gVFNGX0lOVEVSTE9BRDsN CiAJdGRxLT50ZHFfbG9hZCsrOw0KIAlDVFIyKEtUUl9TQ0hFRCwgImNwdSAl ZCBsb2FkOiAlZCIsIFREUV9JRCh0ZHEpLCB0ZHEtPnRkcV9sb2FkKTsNCiAJ aWYgKGNsYXNzICE9IFBSSV9JVEhEICYmDQpAQCAtNDk4LDkgKzUyNywzNyBA QA0KICNlbmRpZg0KIAlLQVNTRVJUKHRkcS0+dGRxX2xvYWQgIT0gMCwNCiAJ ICAgICgidGRxX2xvYWRfcmVtOiBSZW1vdmluZyB3aXRoIDAgbG9hZCBvbiBx dWV1ZSAlZCIsIFREUV9JRCh0ZHEpKSk7DQorCXRzLT50c19mbGFncyAmPSB+ VFNGX0lOVEVSTE9BRDsNCisJdHMtPnRzX3J1bnEgPSBOVUxMOw0KKwl0ZHEt PnRkcV9pbnRlcmxvYWQgLT0gdHMtPnRzX3Njb3JlOw0KIAl0ZHEtPnRkcV9s b2FkLS07DQogCUNUUjEoS1RSX1NDSEVELCAibG9hZDogJWQiLCB0ZHEtPnRk cV9sb2FkKTsNCi0JdHMtPnRzX3J1bnEgPSBOVUxMOw0KK30NCisNCisvKg0K KyAqIENvbXB1dGUgdGhlIG1heGltdW0gc2xpY2Ugd2hlbiB0aGUgaW50ZXJs b2FkIGNoYW5nZXMuICBUaGlzIGdpdmVzIGEgc29mdA0KKyAqIHVwcGVyIGJv dW5kIG9uIGxhdGVuY3kgYXMgdGhlIGxvYWQgaW5jcmVhc2VzLg0KKyAqLw0K K3N0YXRpYyBpbnQNCit0ZHFfc2xpY2Uoc3RydWN0IHRkcSAqdGRxKQ0KK3sN CisJaW50IHNsaWNlOw0KKwlpbnQgbG9hZDsNCisNCisJVERRX0xPQ0tfQVNT RVJUKHRkcSwgTUFfT1dORUQpOw0KKwlpZiAodGRxLT50ZHFfaW50ZXJsb2Fk IDwgMTAwKQ0KKwkJcmV0dXJuIChzY2hlZF9zbGljZV9tYXgpOw0KKwkvKg0K KwkgKiBBbiBpbnRlcmxvYWQgb2YgMTAwIGlzIHJvdWdobHkgZXF1aXZhbGVu dCB0byAxMDAlIGNwdSB1dGlsaXphdGlvbg0KKwkgKiByZXF1ZXN0ZWQuICBD YWxjdWxhdGUgaG93IG1hbnkgdGltZXMgb3ZlcmxvYWRlZCB3ZSBhcmUgYW5k IHRoZW4NCisJICogZGl2aWRlIHRoZSBtYXhpbXVtIHNsaWNlIGJ5IHRoaXMg bnVtYmVyLiAgTm9uZSBvZiB0aGlzIGlzIHByZWNpc2UNCisJICogYnV0IGl0 IGRvZXMgeWllbGQgZGVjcmVhc2luZyBzbGljZSB2YWx1ZXMgd2l0aGluIHRo ZSBbbWluLCBtYXhdDQorCSAqIHJhbmdlIGFzIGxvYWQgaW5jcmVhc2VzLg0K KwkgKi8NCisJbG9hZCA9ICh0ZHEtPnRkcV9pbnRlcmxvYWQgKyA5OSkgLyAx MDA7DQorCXNsaWNlID0gc2NoZWRfc2xpY2VfbWF4IC8gbG9hZDsNCisJc2xp Y2UgPSBtYXgoc2xpY2UsIHNjaGVkX3NsaWNlX21pbik7DQorCXJldHVybiAo c2xpY2UpOw0KIH0NCiANCiAjaWZkZWYgU01QDQpAQCAtMTA3MCwxNCArMTEy Nyw2IEBADQogCWNwdSA9IHNlbGYgPSBQQ1BVX0dFVChjcHVpZCk7DQogCWlm IChzbXBfc3RhcnRlZCA9PSAwKQ0KIAkJcmV0dXJuIChzZWxmKTsNCi0JLyoN Ci0JICogRG9uJ3QgbWlncmF0ZSBhIHJ1bm5pbmcgdGhyZWFkIGZyb20gc2No ZWRfc3dpdGNoKCkuDQotCSAqLw0KLQlpZiAoZmxhZ3MgJiBTUlFfT1VSU0VM Rikgew0KLQkJQ1RSMShLVFJfVUxFLCAiWUlFTERJTkcgJWQiLA0KLQkJICAg IGN1cnRocmVhZC0+dGRfcHJpb3JpdHkpOw0KLQkJcmV0dXJuIChzZWxmKTsN Ci0JfQ0KIAlwcmkgPSB0cy0+dHNfdGhyZWFkLT50ZF9wcmlvcml0eTsNCiAJ Y3B1ID0gdHMtPnRzX2NwdTsNCiAJLyoNCkBAIC0xMTEzLDkgKzExNjIsOCBA QA0KIAkgKiBUaGlzIG1heSBpbXByb3ZlIGxvY2FsaXR5IGFtb25nIHNsZWVw ZXJzIGFuZCB3YWtlcnMgd2hlbiB0aGVyZQ0KIAkgKiBpcyBzaGFyZWQgZGF0 YS4NCiAJICovDQotCWlmICh0cnlzZWxmICYmIHByaSA8IGN1cnRocmVhZC0+ dGRfcHJpb3JpdHkpIHsNCi0JCUNUUjEoS1RSX1VMRSwgInRyeXNlbGYgJWQi LA0KLQkJICAgIGN1cnRocmVhZC0+dGRfcHJpb3JpdHkpOw0KKwlpZiAocHJp IDwgY3VydGhyZWFkLT50ZF9wcmlvcml0eSkgew0KKwkJQ1RSMShLVFJfVUxF LCAidHJ5c2VsZiAlZCIsIGN1cnRocmVhZC0+dGRfcHJpb3JpdHkpOw0KIAkJ cmV0dXJuIChzZWxmKTsNCiAJfQ0KIAkvKg0KQEAgLTExNzUsNiArMTIyMyw3 IEBADQogCXJ1bnFfaW5pdCgmdGRxLT50ZHFfdGltZXNoYXJlKTsNCiAJcnVu cV9pbml0KCZ0ZHEtPnRkcV9pZGxlKTsNCiAJdGRxLT50ZHFfbG9hZCA9IDA7 DQorCXRkcS0+dGRxX2ludGVybG9hZCA9IDA7DQogfQ0KIA0KICNpZmRlZiBT TVANCkBAIC0xMzI0LDEyICsxMzczLDEyIEBADQogCSAqIGluIGNhc2Ugd2hp Y2ggc2NoZWRfY2xvY2soKSBjYWxsZWQgYmVmb3JlIHNjaGVkX2luaXR0aWNr cygpLg0KIAkgKi8NCiAJcmVhbHN0YXRoeiA9IGh6Ow0KLQlzY2hlZF9zbGlj ZSA9IChyZWFsc3RhdGh6LzEwKTsJLyogfjEwMG1zICovDQogCXRpY2tpbmNy ID0gMSA8PCBTQ0hFRF9USUNLX1NISUZUOw0KIA0KIAkvKiBBZGQgdGhyZWFk MCdzIGxvYWQgc2luY2UgaXQncyBydW5uaW5nLiAqLw0KIAlURFFfTE9DSyh0 ZHEpOw0KIAl0aHJlYWQwLnRkX2xvY2sgPSBURFFfTE9DS1BUUihURFFfU0VM RigpKTsNCisJdGRfc2NoZWQwLnRzX3Njb3JlID0gMDsNCiAJdGRxX2xvYWRf YWRkKHRkcSwgJnRkX3NjaGVkMCk7DQogCVREUV9VTkxPQ0sodGRxKTsNCiB9 DQpAQCAtMTM0NCw3ICsxMzkzLDggQEANCiAJaW50IGluY3I7DQogDQogCXJl YWxzdGF0aHogPSBzdGF0aHogPyBzdGF0aHogOiBoejsNCi0Jc2NoZWRfc2xp Y2UgPSAocmVhbHN0YXRoei8xMCk7CS8qIH4xMDBtcyAqLw0KKwlzY2hlZF9z bGljZV9tYXggPSByZWFsc3RhdGh6IC8gMTA7CS8qIH4xMDBtcyAqLw0KKwlz Y2hlZF9zbGljZV9taW4gPSByZWFsc3RhdGh6IC8gMjU7CS8qIH40MG1zICov DQogDQogCS8qDQogCSAqIHRpY2tpbmNyIGlzIHNoaWZ0ZWQgb3V0IGJ5IDEw IHRvIGF2b2lkIHJvdW5kaW5nIGVycm9ycyBkdWUgdG8NCkBAIC0xMzc0LDcg KzE0MjQsNiBAQA0KICNlbmRpZg0KIH0NCiANCi0NCiAvKg0KICAqIFRoaXMg aXMgdGhlIGNvcmUgb2YgdGhlIGludGVyYWN0aXZpdHkgYWxnb3JpdGhtLiAg RGV0ZXJtaW5lcyBhIHNjb3JlIGJhc2VkDQogICogb24gcGFzdCBiZWhhdmlv ci4gIEl0IGlzIHRoZSByYXRpbyBvZiBzbGVlcCB0aW1lIHRvIHJ1biB0aW1l IHNjYWxlZCB0bw0KQEAgLTEzODksMTUgKzE0MzgsNiBAQA0KIAlpbnQgZGl2 Ow0KIA0KIAl0cyA9IHRkLT50ZF9zY2hlZDsNCi0JLyoNCi0JICogVGhlIHNj b3JlIGlzIG9ubHkgbmVlZGVkIGlmIHRoaXMgaXMgbGlrZWx5IHRvIGJlIGFu IGludGVyYWN0aXZlDQotCSAqIHRhc2suICBEb24ndCBnbyB0aHJvdWdoIHRo ZSBleHBlbnNlIG9mIGNvbXB1dGluZyBpdCBpZiB0aGVyZSdzDQotCSAqIG5v IGNoYW5jZS4NCi0JICovDQotCWlmIChzY2hlZF9pbnRlcmFjdCA8PSBTQ0hF RF9JTlRFUkFDVF9IQUxGICYmDQotCQl0cy0+dHNfcnVudGltZSA+PSB0cy0+ dHNfc2xwdGltZSkNCi0JCQlyZXR1cm4gKFNDSEVEX0lOVEVSQUNUX0hBTEYp Ow0KLQ0KIAlpZiAodHMtPnRzX3J1bnRpbWUgPiB0cy0+dHNfc2xwdGltZSkg ew0KIAkJZGl2ID0gbWF4KDEsIHRzLT50c19ydW50aW1lIC8gU0NIRURfSU5U RVJBQ1RfSEFMRik7DQogCQlyZXR1cm4gKFNDSEVEX0lOVEVSQUNUX0hBTEYg Kw0KQEAgLTE0NDMsNyArMTQ4Myw3IEBADQogCSAqIHNjb3JlLiAgTmVnYXRp dmUgbmljZSB2YWx1ZXMgbWFrZSBpdCBlYXNpZXIgZm9yIGEgdGhyZWFkIHRv IGJlDQogCSAqIGNvbnNpZGVyZWQgaW50ZXJhY3RpdmUuDQogCSAqLw0KLQlz Y29yZSA9IGltYXgoMCwgc2NoZWRfaW50ZXJhY3Rfc2NvcmUodGQpIC0gdGQt PnRkX3Byb2MtPnBfbmljZSk7DQorCXNjb3JlID0gaW1heCgwLCB0ZC0+dGRf c2NoZWQtPnRzX3Njb3JlIC0gdGQtPnRkX3Byb2MtPnBfbmljZSk7DQogCWlm IChzY29yZSA8IHNjaGVkX2ludGVyYWN0KSB7DQogCQlwcmkgPSBQUklfTUlO X1JFQUxUSU1FOw0KIAkJcHJpICs9ICgoUFJJX01BWF9SRUFMVElNRSAtIFBS SV9NSU5fUkVBTFRJTUUpIC8gc2NoZWRfaW50ZXJhY3QpDQpAQCAtMTQ3Nywx MiArMTUxNywxNSBAQA0KIHNjaGVkX2ludGVyYWN0X3VwZGF0ZShzdHJ1Y3Qg dGhyZWFkICp0ZCkNCiB7DQogCXN0cnVjdCB0ZF9zY2hlZCAqdHM7DQorCXN0 cnVjdCB0ZHEgKnRkcTsNCiAJdV9pbnQgc3VtOw0KKwlpbnQgc2NvcmU7DQog DQorCVRIUkVBRF9MT0NLX0FTU0VSVCh0ZCwgTUFfT1dORUQpOw0KIAl0cyA9 IHRkLT50ZF9zY2hlZDsNCiAJc3VtID0gdHMtPnRzX3J1bnRpbWUgKyB0cy0+ dHNfc2xwdGltZTsNCiAJaWYgKHN1bSA8IFNDSEVEX1NMUF9SVU5fTUFYKQ0K LQkJcmV0dXJuOw0KKwkJZ290byBzY29yZTsNCiAJLyoNCiAJICogVGhpcyBv bmx5IGhhcHBlbnMgZnJvbSB0d28gcGxhY2VzOg0KIAkgKiAxKSBXZSBoYXZl IGFkZGVkIGFuIHVudXN1YWwgYW1vdW50IG9mIHJ1biB0aW1lIGZyb20gZm9y a19leGl0Lg0KQEAgLTE0OTAsMTMgKzE1MzMsMTMgQEANCiAJICovDQogCWlm IChzdW0gPiBTQ0hFRF9TTFBfUlVOX01BWCAqIDIpIHsNCiAJCWlmICh0cy0+ dHNfcnVudGltZSA+IHRzLT50c19zbHB0aW1lKSB7DQotCQkJdHMtPnRzX3J1 bnRpbWUgPSBTQ0hFRF9TTFBfUlVOX01BWDsNCisJCQl0cy0+dHNfcnVudGlt ZSA9IFNDSEVEX1NMUF9SVU5fTUFYIC8gMjsNCiAJCQl0cy0+dHNfc2xwdGlt ZSA9IDE7DQogCQl9IGVsc2Ugew0KLQkJCXRzLT50c19zbHB0aW1lID0gU0NI RURfU0xQX1JVTl9NQVg7DQorCQkJdHMtPnRzX3NscHRpbWUgPSBTQ0hFRF9T TFBfUlVOX01BWCAvIDI7DQogCQkJdHMtPnRzX3J1bnRpbWUgPSAxOw0KIAkJ fQ0KLQkJcmV0dXJuOw0KKwkJZ290byBzY29yZTsNCiAJfQ0KIAkvKg0KIAkg KiBJZiB3ZSBoYXZlIGV4Y2VlZGVkIGJ5IG1vcmUgdGhhbiAxLzV0aCB0aGVu IHRoZSBhbGdvcml0aG0gYmVsb3cNCkBAIC0xNTA2LDEwICsxNTQ5LDE5IEBA DQogCWlmIChzdW0gPiAoU0NIRURfU0xQX1JVTl9NQVggLyA1KSAqIDYpIHsN CiAJCXRzLT50c19ydW50aW1lIC89IDI7DQogCQl0cy0+dHNfc2xwdGltZSAv PSAyOw0KLQkJcmV0dXJuOw0KKwkJZ290byBzY29yZTsNCiAJfQ0KIAl0cy0+ dHNfcnVudGltZSA9ICh0cy0+dHNfcnVudGltZSAvIDUpICogNDsNCiAJdHMt PnRzX3NscHRpbWUgPSAodHMtPnRzX3NscHRpbWUgLyA1KSAqIDQ7DQorc2Nv cmU6DQorCXNjb3JlID0gc2NoZWRfaW50ZXJhY3Rfc2NvcmUodGQpOw0KKwlp ZiAodHMtPnRzX2ZsYWdzICYgVFNGX0lOVEVSTE9BRCkgew0KKwkJdGRxID0g VERRX0NQVSh0cy0+dHNfY3B1KTsNCisJCVREUV9MT0NLX0FTU0VSVCh0ZHEs IE1BX09XTkVEKTsNCisJCXRkcS0+dGRxX2ludGVybG9hZCAtPSB0cy0+dHNf c2NvcmU7DQorCQl0ZHEtPnRkcV9pbnRlcmxvYWQgKz0gc2NvcmU7DQorCX0N CisJdHMtPnRzX3Njb3JlID0gc2NvcmU7DQogfQ0KIA0KIC8qDQpAQCAtMTU1 OSw3ICsxNjExLDcgQEANCiB7DQogDQogCS8qIENvbnZlcnQgc2NoZWRfc2xp Y2UgdG8gaHogKi8NCi0JcmV0dXJuIChoei8ocmVhbHN0YXRoei9zY2hlZF9z bGljZSkpOw0KKwlyZXR1cm4gKGh6LyhyZWFsc3RhdGh6L3NjaGVkX3NsaWNl X21heCkpOw0KIH0NCiANCiAvKg0KQEAgLTE1OTgsMTYgKzE2NTAsMTkgQEAN CiBzY2hlZF90aHJlYWRfcHJpb3JpdHkoc3RydWN0IHRocmVhZCAqdGQsIHVf Y2hhciBwcmlvKQ0KIHsNCiAJc3RydWN0IHRkX3NjaGVkICp0czsNCisJc3Ry dWN0IHRkcSAqdGRxOw0KIA0KIAlDVFI2KEtUUl9TQ0hFRCwgInNjaGVkX3By aW86ICVwKCVzKSBwcmlvICVkIG5ld3ByaW8gJWQgYnkgJXAoJXMpIiwNCiAJ ICAgIHRkLCB0ZC0+dGRfcHJvYy0+cF9jb21tLCB0ZC0+dGRfcHJpb3JpdHks IHByaW8sIGN1cnRocmVhZCwNCiAJICAgIGN1cnRocmVhZC0+dGRfcHJvYy0+ cF9jb21tKTsNCiAJdHMgPSB0ZC0+dGRfc2NoZWQ7DQorCXRkcSA9IFREUV9D UFUodHMtPnRzX2NwdSk7DQogCVRIUkVBRF9MT0NLX0FTU0VSVCh0ZCwgTUFf T1dORUQpOw0KLQlpZiAodGQtPnRkX3ByaW9yaXR5ID09IHByaW8pDQorCWlm ICh0ZC0+dGRfcHJpb3JpdHkgPD0gcHJpbykgew0KKwkJdGQtPnRkX3ByaW9y aXR5ID0gcHJpbzsNCiAJCXJldHVybjsNCi0NCi0JaWYgKFREX09OX1JVTlEo dGQpICYmIHByaW8gPCB0ZC0+dGRfcHJpb3JpdHkpIHsNCisJfQ0KKwlpZiAo VERfT05fUlVOUSh0ZCkpIHsNCiAJCS8qDQogCQkgKiBJZiB0aGUgcHJpb3Jp dHkgaGFzIGJlZW4gZWxldmF0ZWQgZHVlIHRvIHByaW9yaXR5DQogCQkgKiBw cm9wYWdhdGlvbiwgd2UgbWF5IGhhdmUgdG8gbW92ZSBvdXJzZWx2ZXMgdG8g YSBuZXcNCkBAIC0xNjE3LDE2ICsxNjcyLDE0IEBADQogCQlzY2hlZF9yZW0o dGQpOw0KIAkJdGQtPnRkX3ByaW9yaXR5ID0gcHJpbzsNCiAJCXNjaGVkX2Fk ZCh0ZCwgU1JRX0JPUlJPV0lORyk7DQotCX0gZWxzZSB7DQogI2lmZGVmIFNN UA0KLQkJc3RydWN0IHRkcSAqdGRxOw0KLQ0KLQkJdGRxID0gVERRX0NQVSh0 cy0+dHNfY3B1KTsNCisJfSBlbHNlIGlmIChURF9JU19SVU5OSU5HKHRkKSkg ew0KIAkJaWYgKHByaW8gPCB0ZHEtPnRkcV9sb3dwcmkpDQogCQkJdGRxLT50 ZHFfbG93cHJpID0gcHJpbzsNCisJCXRkLT50ZF9wcmlvcml0eSA9IHByaW87 DQogI2VuZGlmDQorCX0gZWxzZQ0KIAkJdGQtPnRkX3ByaW9yaXR5ID0gcHJp bzsNCi0JfQ0KIH0NCiANCiAvKg0KQEAgLTE3NzIsNiArMTgyNSw4IEBADQog DQogCXRkbiA9IFREUV9DUFUodGQtPnRkX3NjaGVkLT50c19jcHUpOw0KICNp ZmRlZiBTTVANCisJLyogVGhlIGxvYWQgaXMgYmVpbmcgcmVtb3ZlZCBmcm9t IHRoZSBjdXJyZW50IGNwdS4gKi8NCisJdGRxX2xvYWRfcmVtKHRkcSwgdGQt PnRkX3NjaGVkKTsNCiAJLyoNCiAJICogRG8gdGhlIGxvY2sgZGFuY2UgcmVx dWlyZWQgdG8gYXZvaWQgTE9SLiAgV2UgZ3JhYiBhbiBleHRyYQ0KIAkgKiBz cGlubG9jayBuZXN0aW5nIHRvIHByZXZlbnQgcHJlZW1wdGlvbiB3aGlsZSB3 ZSdyZQ0KQEAgLTE4NjMsMTIgKzE5MTgsMTEgQEANCiAJCVREX1NFVF9DQU5f UlVOKHRkKTsNCiAJfSBlbHNlIGlmIChURF9JU19SVU5OSU5HKHRkKSkgew0K IAkJTVBBU1ModGQtPnRkX2xvY2sgPT0gVERRX0xPQ0tQVFIodGRxKSk7DQot CQl0ZHFfbG9hZF9yZW0odGRxLCB0cyk7DQogCQlzcnFmbGFnID0gKGZsYWdz ICYgU1dfUFJFRU1QVCkgPw0KIAkJICAgIFNSUV9PVVJTRUxGfFNSUV9ZSUVM RElOR3xTUlFfUFJFRU1QVEVEIDoNCiAJCSAgICBTUlFfT1VSU0VMRnxTUlFf WUlFTERJTkc7DQogCQlpZiAodHMtPnRzX2NwdSA9PSBjcHVpZCkNCi0JCQl0 ZHFfYWRkKHRkcSwgdGQsIHNycWZsYWcpOw0KKwkJCXRkcV9ydW5xX2FkZCh0 ZHEsIHRzLCBzcnFmbGFnKTsNCiAJCWVsc2UNCiAJCQltdHggPSBzY2hlZF9z d2l0Y2hfbWlncmF0ZSh0ZHEsIHRkLCBzcnFmbGFnKTsNCiAJfSBlbHNlIHsN CkBAIC0xOTcwLDIyICsyMDI0LDE4IEBADQogCVRIUkVBRF9MT0NLX0FTU0VS VCh0ZCwgTUFfT1dORUQpOw0KIAl0cyA9IHRkLT50ZF9zY2hlZDsNCiAJLyoN Ci0JICogSWYgd2Ugc2xlcHQgZm9yIG1vcmUgdGhhbiBhIHRpY2sgdXBkYXRl IG91ciBpbnRlcmFjdGl2aXR5IGFuZA0KLQkgKiBwcmlvcml0eS4NCisJICog VXBkYXRlIGludGVyYWN0aXZpdHkgYW5kIHByaW9yaXR5IGFmdGVyIGEgc2xl ZXAuDQogCSAqLw0KIAlzbHB0aWNrID0gdGQtPnRkX3NscHRpY2s7DQogCXRk LT50ZF9zbHB0aWNrID0gMDsNCi0JaWYgKHNscHRpY2sgJiYgc2xwdGljayAh PSB0aWNrcykgew0KLQkJdV9pbnQgaHp0aWNrczsNCi0NCi0JCWh6dGlja3Mg PSAodGlja3MgLSBzbHB0aWNrKSA8PCBTQ0hFRF9USUNLX1NISUZUOw0KLQkJ dHMtPnRzX3NscHRpbWUgKz0gaHp0aWNrczsNCisJaWYgKHNscHRpY2sgJiYg c2xwdGljayAhPSB0aWNrcykgIHsNCisJCXRzLT50c19zbHB0aW1lICs9ICh0 aWNrcyAtIHNscHRpY2spIDw8IFNDSEVEX1RJQ0tfU0hJRlQ7DQogCQlzY2hl ZF9pbnRlcmFjdF91cGRhdGUodGQpOw0KIAkJc2NoZWRfcGN0Y3B1X3VwZGF0 ZSh0cyk7DQogCQlzY2hlZF9wcmlvcml0eSh0ZCk7DQorCQkvKiBSZXNldCB0 aGUgc2xpY2UgdmFsdWUgYWZ0ZXIgd2Ugc2xlZXAuICovDQorCQl0cy0+dHNf c2xpY2UgPSAwOw0KIAl9DQotCS8qIFJlc2V0IHRoZSBzbGljZSB2YWx1ZSBh ZnRlciB3ZSBzbGVlcC4gKi8NCi0JdHMtPnRzX3NsaWNlID0gc2NoZWRfc2xp Y2U7DQogCXNjaGVkX2FkZCh0ZCwgU1JRX0JPUklORyk7DQogfQ0KIA0KQEAg LTIwNDAsNyArMjA5MCw2IEBADQogCSAqLw0KIAl0czItPnRzX3NscHRpbWUg PSB0cy0+dHNfc2xwdGltZTsNCiAJdHMyLT50c19ydW50aW1lID0gdHMtPnRz X3J1bnRpbWU7DQotCXRzMi0+dHNfc2xpY2UgPSAxOwkvKiBBdHRlbXB0IHRv IHF1aWNrbHkgbGVhcm4gaW50ZXJhY3Rpdml0eS4gKi8NCiB9DQogDQogLyoN CkBAIC0yMTg4LDI1ICsyMjM3LDI2IEBADQogCX0NCiAJdHMgPSB0ZC0+dGRf c2NoZWQ7DQogCS8qDQotCSAqIFdlIG9ubHkgZG8gc2xpY2luZyBjb2RlIGZv ciBUSU1FU0hBUkUgdGhyZWFkcy4NCi0JICovDQotCWlmICh0ZC0+dGRfcHJp X2NsYXNzICE9IFBSSV9USU1FU0hBUkUpDQotCQlyZXR1cm47DQotCS8qDQog CSAqIFdlIHVzZWQgYSB0aWNrOyBjaGFyZ2UgaXQgdG8gdGhlIHRocmVhZCBz byB0aGF0IHdlIGNhbiBjb21wdXRlIG91cg0KIAkgKiBpbnRlcmFjdGl2aXR5 Lg0KIAkgKi8NCiAJdGQtPnRkX3NjaGVkLT50c19ydW50aW1lICs9IHRpY2tp bmNyOw0KIAlzY2hlZF9pbnRlcmFjdF91cGRhdGUodGQpOw0KIAkvKg0KKwkg KiBXZSBvbmx5IGRvIHNsaWNpbmcgY29kZSBmb3IgVElNRVNIQVJFIHRocmVh ZHMuDQorCSAqLw0KKwlpZiAodGQtPnRkX3ByaV9jbGFzcyAhPSBQUklfVElN RVNIQVJFKQ0KKwkJcmV0dXJuOw0KKwlzY2hlZF9wcmlvcml0eSh0ZCk7DQor CS8qDQogCSAqIFdlIHVzZWQgdXAgb25lIHRpbWUgc2xpY2UuDQogCSAqLw0K LQlpZiAoLS10cy0+dHNfc2xpY2UgPiAwKQ0KKwlpZiAoKyt0cy0+dHNfc2xp Y2UgPCB0ZHFfc2xpY2UodGRxKSkNCiAJCXJldHVybjsNCiAJLyoNCi0JICog V2UncmUgb3V0IG9mIHRpbWUsIHJlY29tcHV0ZSBwcmlvcml0aWVzIGFuZCBy ZXF1ZXVlLg0KKwkgKiBXZSdyZSBvdXQgb2YgdGltZSwgZm9yY2UgYSByZXF1 ZXVlIGxhdGVyLg0KIAkgKi8NCi0Jc2NoZWRfcHJpb3JpdHkodGQpOw0KKwl0 cy0+dHNfc2xpY2UgPSAwOw0KIAl0ZC0+dGRfZmxhZ3MgfD0gVERGX05FRURS RVNDSEVEOw0KIH0NCiANCkBAIC0yMjkwLDM1ICsyMzQwLDYgQEANCiAjZW5k aWYNCiAJcmV0dXJuIChQQ1BVX0dFVChpZGxldGhyZWFkKSk7DQogfQ0KLQ0K LS8qDQotICogU2V0IG93ZXByZWVtcHQgaWYgbmVjZXNzYXJ5LiAgUHJlZW1w dGlvbiBuZXZlciBoYXBwZW5zIGRpcmVjdGx5IGluIFVMRSwNCi0gKiB3ZSBh bHdheXMgcmVxdWVzdCBpdCBvbmNlIHdlIGV4aXQgYSBjcml0aWNhbCBzZWN0 aW9uLg0KLSAqLw0KLXN0YXRpYyBpbmxpbmUgdm9pZA0KLXNjaGVkX3NldHBy ZWVtcHQoc3RydWN0IHRocmVhZCAqdGQpDQotew0KLQlzdHJ1Y3QgdGhyZWFk ICpjdGQ7DQotCWludCBjcHJpOw0KLQlpbnQgcHJpOw0KLQ0KLQljdGQgPSBj dXJ0aHJlYWQ7DQotCXByaSA9IHRkLT50ZF9wcmlvcml0eTsNCi0JY3ByaSA9 IGN0ZC0+dGRfcHJpb3JpdHk7DQotCWlmICh0ZC0+dGRfcHJpb3JpdHkgPCBj dGQtPnRkX3ByaW9yaXR5KQ0KLQkJY3VydGhyZWFkLT50ZF9mbGFncyB8PSBU REZfTkVFRFJFU0NIRUQ7DQotCWlmIChwYW5pY3N0ciAhPSBOVUxMIHx8IHBy aSA+PSBjcHJpIHx8IGNvbGQgfHwgVERfSVNfSU5ISUJJVEVEKGN0ZCkpDQot CQlyZXR1cm47DQotCS8qDQotCSAqIEFsd2F5cyBwcmVlbXB0IElETEUgdGhy ZWFkcy4gIE90aGVyd2lzZSBvbmx5IGlmIHRoZSBwcmVlbXB0aW5nDQotCSAq IHRocmVhZCBpcyBhbiBpdGhyZWFkLg0KLQkgKi8NCi0JaWYgKHByaSA+IHBy ZWVtcHRfdGhyZXNoICYmIGNwcmkgPCBQUklfTUlOX0lETEUpDQotCQlyZXR1 cm47DQotCWN0ZC0+dGRfb3dlcHJlZW1wdCA9IDE7DQotCXJldHVybjsNCi19 DQotDQogLyoNCiAgKiBBZGQgYSB0aHJlYWQgdG8gYSB0aHJlYWQgcXVldWUu ICBJbml0aWFsaXplcyBwcmlvcml0eSwgc2xpY2UsIHJ1bnEsIGFuZA0KICAq IGFkZCBpdCB0byB0aGUgYXBwcm9wcmlhdGUgcXVldWUuICBUaGlzIGlzIHRo ZSBpbnRlcm5hbCBmdW5jdGlvbiBjYWxsZWQNCkBAIC0yMzI4LDExICsyMzQ5 LDEwIEBADQogdGRxX2FkZChzdHJ1Y3QgdGRxICp0ZHEsIHN0cnVjdCB0aHJl YWQgKnRkLCBpbnQgZmxhZ3MpDQogew0KIAlzdHJ1Y3QgdGRfc2NoZWQgKnRz Ow0KLQlpbnQgY2xhc3M7DQogI2lmZGVmIFNNUA0KKwlpbnQgY2xhc3M7DQog CWludCBjcHVtYXNrOw0KICNlbmRpZg0KLQ0KIAlURFFfTE9DS19BU1NFUlQo dGRxLCBNQV9PV05FRCk7DQogCUtBU1NFUlQoKHRkLT50ZF9pbmhpYml0b3Jz ID09IDApLA0KIAkgICAgKCJzY2hlZF9hZGQ6IHRyeWluZyB0byBydW4gaW5o aWJpdGVkIHRocmVhZCIpKTsNCkBAIC0yMzQyLDIwICsyMzYyLDEwIEBADQog CSAgICAoInNjaGVkX2FkZDogdGhyZWFkIHN3YXBwZWQgb3V0IikpOw0KIA0K IAl0cyA9IHRkLT50ZF9zY2hlZDsNCi0JY2xhc3MgPSBQUklfQkFTRSh0ZC0+ dGRfcHJpX2NsYXNzKTsNCi0gICAgICAgIFREX1NFVF9SVU5RKHRkKTsNCi0J aWYgKHRzLT50c19zbGljZSA9PSAwKQ0KLQkJdHMtPnRzX3NsaWNlID0gc2No ZWRfc2xpY2U7DQotCS8qDQotCSAqIFBpY2sgdGhlIHJ1biBxdWV1ZSBiYXNl ZCBvbiBwcmlvcml0eS4NCi0JICovDQotCWlmICh0ZC0+dGRfcHJpb3JpdHkg PD0gUFJJX01BWF9SRUFMVElNRSkNCi0JCXRzLT50c19ydW5xID0gJnRkcS0+ dGRxX3JlYWx0aW1lOw0KLQllbHNlIGlmICh0ZC0+dGRfcHJpb3JpdHkgPD0g UFJJX01BWF9USU1FU0hBUkUpDQotCQl0cy0+dHNfcnVucSA9ICZ0ZHEtPnRk cV90aW1lc2hhcmU7DQotCWVsc2UNCi0JCXRzLT50c19ydW5xID0gJnRkcS0+ dGRxX2lkbGU7DQorCXRkcV9ydW5xX2FkZCh0ZHEsIHRzLCBmbGFncyk7DQor CXRkcV9sb2FkX2FkZCh0ZHEsIHRzKTsNCiAjaWZkZWYgU01QDQorCWNsYXNz ID0gUFJJX0JBU0UodGQtPnRkX3ByaV9jbGFzcyk7DQogCWNwdW1hc2sgPSAx IDw8IHRzLT50c19jcHU7DQogCS8qDQogCSAqIElmIHdlIGhhZCBiZWVuIGlk bGUsIGNsZWFyIG91ciBiaXQgaW4gdGhlIGdyb3VwIGFuZCBwb3RlbnRpYWxs eQ0KQEAgLTIzNzgsOCArMjM4OCw2IEBADQogCWlmICh0ZC0+dGRfcHJpb3Jp dHkgPCB0ZHEtPnRkcV9sb3dwcmkpDQogCQl0ZHEtPnRkcV9sb3dwcmkgPSB0 ZC0+dGRfcHJpb3JpdHk7DQogI2VuZGlmDQotCXRkcV9ydW5xX2FkZCh0ZHEs IHRzLCBmbGFncyk7DQotCXRkcV9sb2FkX2FkZCh0ZHEsIHRzKTsNCiB9DQog DQogLyoNCkBAIC0yMzkwLDYgKzIzOTgsNyBAQA0KIHNjaGVkX2FkZChzdHJ1 Y3QgdGhyZWFkICp0ZCwgaW50IGZsYWdzKQ0KIHsNCiAJc3RydWN0IHRkX3Nj aGVkICp0czsNCisJc3RydWN0IHRocmVhZCAqY3RkOw0KIAlzdHJ1Y3QgdGRx ICp0ZHE7DQogI2lmZGVmIFNNUA0KIAlpbnQgY3B1aWQ7DQpAQCAtMjQzNCw4 ICsyNDQzLDE5IEBADQogCXRocmVhZF9sb2NrX3NldCh0ZCwgVERRX0xPQ0tQ VFIodGRxKSk7DQogCXRkcV9hZGQodGRxLCB0ZCwgZmxhZ3MpOw0KICNlbmRp Zg0KLQlpZiAoIShmbGFncyAmIFNSUV9ZSUVMRElORykpDQotCQlzY2hlZF9z ZXRwcmVlbXB0KHRkKTsNCisJaWYgKGNvbGQgfHwgcGFuaWNzdHIpDQorCQly ZXR1cm47DQorCS8qDQorCSAqIEFsd2F5cyBwcmVlbXB0IElETEUgdGhyZWFk cy4gIE90aGVyd2lzZSBvbmx5IGlmIHRoZSBwcmVlbXB0aW5nDQorCSAqIHRo cmVhZCBpcyBhbiBpdGhyZWFkLg0KKwkgKi8NCisJY3RkID0gY3VydGhyZWFk Ow0KKwlpZiAodGQtPnRkX3ByaW9yaXR5IDwgY3RkLT50ZF9wcmlvcml0eSkg ew0KKwkJY3RkLT50ZF9mbGFncyB8PSBUREZfTkVFRFJFU0NIRUQ7DQorCQlp ZiAodGQtPnRkX3ByaW9yaXR5IDw9IHByZWVtcHRfdGhyZXNoIHx8DQorCQkg ICAgY3RkLT50ZF9wcmlvcml0eSA+IFBSSV9NSU5fSURMRSkNCisJCQljdGQt PnRkX293ZXByZWVtcHQgPSAxOw0KKwl9DQogfQ0KIA0KIC8qDQpAQCAtMjY2 MCw4ICsyNjgwLDEwIEBADQogICAgICJTY2hlZHVsZXIiKTsNCiBTWVNDVExf U1RSSU5HKF9rZXJuX3NjaGVkLCBPSURfQVVUTywgbmFtZSwgQ1RMRkxBR19S RCwgIlVMRSIsIDAsDQogICAgICJTY2hlZHVsZXIgbmFtZSIpOw0KLVNZU0NU TF9JTlQoX2tlcm5fc2NoZWQsIE9JRF9BVVRPLCBzbGljZSwgQ1RMRkxBR19S VywgJnNjaGVkX3NsaWNlLCAwLA0KLSAgICAiU2xpY2Ugc2l6ZSBmb3IgdGlt ZXNoYXJlIHRocmVhZHMiKTsNCitTWVNDVExfSU5UKF9rZXJuX3NjaGVkLCBP SURfQVVUTywgc2xpY2UsIENUTEZMQUdfUlcsICZzY2hlZF9zbGljZV9tYXgs IDAsDQorICAgICJNYXhpbXVtIHNsaWNlIHNpemUgZm9yIHRpbWVzaGFyZSB0 aHJlYWRzIik7DQorU1lTQ1RMX0lOVChfa2Vybl9zY2hlZCwgT0lEX0FVVE8s IHNsaWNlX21pbiwgQ1RMRkxBR19SVywgJnNjaGVkX3NsaWNlX21pbiwgMCwN CisgICAgIk1pbmltdW0gc2xpY2Ugc2l6ZSBmb3IgdGltZXNoYXJlIHRocmVh ZHMiKTsNCiBTWVNDVExfSU5UKF9rZXJuX3NjaGVkLCBPSURfQVVUTywgaW50 ZXJhY3QsIENUTEZMQUdfUlcsICZzY2hlZF9pbnRlcmFjdCwgMCwNCiAgICAg ICJJbnRlcmFjdGl2aXR5IHNjb3JlIHRocmVzaG9sZCIpOw0KIFNZU0NUTF9J TlQoX2tlcm5fc2NoZWQsIE9JRF9BVVRPLCBwcmVlbXB0X3RocmVzaCwgQ1RM RkxBR19SVywgJnByZWVtcHRfdGhyZXNoLA0KQEAgLTI2NzEsNyArMjY5Myw2 IEBADQogICAgICJQaWNrIHRoZSB0YXJnZXQgY3B1IGJhc2VkIG9uIHByaW9y aXR5IHJhdGhlciB0aGFuIGxvYWQuIik7DQogU1lTQ1RMX0lOVChfa2Vybl9z Y2hlZCwgT0lEX0FVVE8sIGFmZmluaXR5LCBDVExGTEFHX1JXLCAmYWZmaW5p dHksIDAsDQogICAgICJOdW1iZXIgb2YgaHogdGlja3MgdG8ga2VlcCB0aHJl YWQgYWZmaW5pdHkgZm9yIik7DQotU1lTQ1RMX0lOVChfa2Vybl9zY2hlZCwg T0lEX0FVVE8sIHRyeXNlbGYsIENUTEZMQUdfUlcsICZ0cnlzZWxmLCAwLCAi Iik7DQogU1lTQ1RMX0lOVChfa2Vybl9zY2hlZCwgT0lEX0FVVE8sIGJhbGFu Y2UsIENUTEZMQUdfUlcsICZyZWJhbGFuY2UsIDAsDQogICAgICJFbmFibGVz IHRoZSBsb25nLXRlcm0gbG9hZCBiYWxhbmNlciIpOw0KIFNZU0NUTF9JTlQo X2tlcm5fc2NoZWQsIE9JRF9BVVRPLCBiYWxhbmNlX2ludGVydmFsLCBDVExG TEFHX1JXLA0K --0-603731913-1194218372=:544-- From owner-freebsd-performance@FreeBSD.ORG Sun Nov 4 23:51:23 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 49EBF16A421 for ; Sun, 4 Nov 2007 23:51:23 +0000 (UTC) (envelope-from freebsd@superhero.nl) Received: from superman.superhero.nl (superhero.nl [82.95.198.17]) by mx1.freebsd.org (Postfix) with ESMTP id 9171613C49D for ; Sun, 4 Nov 2007 23:51:22 +0000 (UTC) (envelope-from freebsd@superhero.nl) Received: (qmail 37409 invoked by uid 80); 4 Nov 2007 23:50:46 -0000 Received: from robin.ad.superhero.nl ([10.202.77.103]) (SquirrelMail authenticated user gelsemap) by webmail.superhero.nl with HTTP; Mon, 5 Nov 2007 00:50:46 +0100 (CET) Message-ID: <3769.10.202.77.103.1194220246.squirrel@webmail.superhero.nl> In-Reply-To: <20071104132540.S544@10.0.0.1> References: <1698.10.202.77.103.1194211291.squirrel@webmail.superhero.nl> <20071104132540.S544@10.0.0.1> Date: Mon, 5 Nov 2007 00:50:46 +0100 (CET) From: "Gelsema, P \(Patrick\) - FreeBSD" To: "Jeff Roberson" User-Agent: SquirrelMail/1.4.8 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Mailman-Approved-At: Mon, 05 Nov 2007 01:36:18 +0000 Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 04 Nov 2007 23:51:23 -0000 On Sun, November 4, 2007 22:27, Jeff Roberson wrote: > On Sun, 4 Nov 2007, Gelsema, P (Patrick) - FreeBSD wrote: > >> Hi Jeff, >> >> I tried your patch. Ran a buildkernel, timed. Recompiled kernel >> including >> your patch, rebooted and reran. Please find results below. >> >> w/o patch >> hulk# time make -j8 buildkernel >> 837.808u 138.167s 10:28.96 155.1% 6349+1349k 2873+7780io 303pf+0w >> >> w patch >> hulk# time make -j8 buildkernel >> 838.554u 168.316s 10:52.10 154.4% 6263+1332k 6489+7791io 11pf+0w >> >> I only understand the 10:52 seconds thing, but it looks like it's >> stressing less and still getting things done. >> > > Well this doesn't look very good at all. System time increased by 30 > seconds! Must be too many extra context switches. The minimum slice > value is probably too small and you've got an average of 4 threads > per-core. > > Can you try re-running with kern.sched.slice_min = 4 and kern.sched.slice > = 12 ? > > Can you tell me how 4BSD does on this machine? ULE w/o patch hulk# time make -j8 buildkernel 837.808u 138.167s 10:28.96 155.1% 6349+1349k 2873+7780io 303pf+0w ULE w latest patch hulk# time make -j8 buildkernel 846.008u 144.377s 10:41.28 154.4% 6364+1354k 7131+7890io 216pf+0w kern.sched.interact: 30 kern.sched.slice_min: 2 kern.sched.slice: 8 kern.sched.name: ULE ULE w latest patch (changed slice) hulk# time make -j8 buildkernel 840.783u 159.639s 10:37.41 156.9% 6280+1338k 656+8025io 0pf+0w kern.sched.slice_min: 4 kern.sched.slice: 12 kern.sched.name: ULE 4BSD hulk# time make -j8 buildkernel 823.898u 136.524s 9:50.61 162.6% 6263+1334k 7098+7774io 216pf+0w Seems 4BSD wins when it compares to buildkernel. Please let me know if you want me to run other tests. System is: Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 4800+ (2511.47-MHz K8-class CPU) Origin = "AuthenticAMD" Id = 0x60fb1 Stepping = 1 Features=0x178bfbff Features2=0x2001 AMD Features=0xea500800 AMD Features2=0x11f Cores per package: 2 usable memory = 3527241728 (3363 MB) avail memory = 3411648512 (3253 MB) Cheers Patrick > > Thanks, > Jeff > > >> System is AMD Athlon X264 2.2Ghz >> >> Kernel is GENERIC. >> hulk# uname -a >> FreeBSD hulk.superhero.nl 7.0-BETA2 FreeBSD 7.0-BETA2 #0: Sun Nov 4 >> 20:30:23 UTC 2007 >> root@hulk.superhero.nl:/usr/obj/usr/src/sys/GENERIC >> amd64 >> >> I see you have a new patch. Could you send that to me? When I download >> it >> from the mailman site I get weird characters in the downloaded file :( >> >> Cheers >> >> Patrick >> > From owner-freebsd-performance@FreeBSD.ORG Mon Nov 5 09:42:02 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DCE8116A419 for ; Mon, 5 Nov 2007 09:42:02 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.179]) by mx1.freebsd.org (Postfix) with ESMTP id 8E1F013C48E for ; Mon, 5 Nov 2007 09:42:02 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so3081307pyb for ; Mon, 05 Nov 2007 01:41:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=OPCdtrGq3LrKa1KTK97Te5Dm+DSDgeYa6gC/lmLhNuI=; b=VnhHECgnYxRu1P/vztAt5kdQorkUgOE38kdiIbOZFfN56vOg1jF7Aj66u4Wpf60jgOFxhf4zbvm7yM4ERE5Ynx6niGDbfO7voNt5iTUDK+rG5R/1GcB851n+k8zQ8nBPhG/IRxRmyyLVpwJP+A62M3A5/BvFhOglVgq3UIdlRHs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=NuCPOUIuNapueZdyfRbJ4oFpW5mBz6GEkxv+ZAe5C0ilOTyEXaGLgl8vAAxqrFFRH8rxPWkw7tCz9hGq9k47nphVxQMEhOoN0cLUqA1OyZmhQEKI84pO47xyDgGEjrgfsrJ9elZ/dBW5DqJbMFEWoV1swnx3Do4hBJmpwO+SK7A= Received: by 10.35.38.17 with SMTP id q17mr5886844pyj.1194255713875; Mon, 05 Nov 2007 01:41:53 -0800 (PST) Received: by 10.35.110.17 with HTTP; Mon, 5 Nov 2007 01:41:53 -0800 (PST) Message-ID: <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> Date: Mon, 5 Nov 2007 01:41:53 -0800 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071104151722.M544@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711021839i4714bdfbh74d412b3e14e808@mail.gmail.com> <8cb6106e0711031227t1e829969s2e6062e1db5167af@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2007 09:42:02 -0000 > Turns out the last patch I posted had a small compile error because I > edited it by hand to remove one section. Here's an updated patch that > fixes that and changes the min/max slice values to something more > reasonable. Slice min should be around 4 with a max of 12. > > Also looks like 4BSD's slice handling got more precise recently as well. > jhb changed it from using a callout to an actual counter based on runtime. ffmpeg runtime with the new patch: 1:39.09 buildworld: 13:55.689 Looks like things got a little worse with this patch. One thing of note, the slice_min and slice values are: kern.sched.slice_min: 5 kern.sched.slice: 13 Did I do something wrong to cause the slice min to be 5 instead of 4 and the max to be 13 instead of 12? Thanks, Josh From owner-freebsd-performance@FreeBSD.ORG Mon Nov 5 11:31:22 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C142516A469 for ; Mon, 5 Nov 2007 11:31:22 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id 83A6313C4B8 for ; Mon, 5 Nov 2007 11:31:22 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id D824E1F132B; Fri, 2 Nov 2007 19:13:17 +0100 (CET) Date: Fri, 2 Nov 2007 19:13:17 +0100 From: Nico -telmich- Schottelius To: freebsd-performance@freebsd.org Message-ID: <20071102181317.GB6577@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="+pHx0qQiF2pBVqBT" Content-Disposition: inline User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.23.1-denkbrett on i686 Subject: NFS: Linux Server, FreeBSD clients X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2007 11:31:22 -0000 --+pHx0qQiF2pBVqBT Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello! I'm doing some tests on a Linux 2.6 kernel nfsd with freebsd clients. I want to use a cluster of 2 servers with heartbeat as failover and use the linux server as nfsd. Currently I am testing with iozone, which gives pretty bad performance results for standard connection (about 1/10 of what the disks deliver under linux locally, although connected via copper gbit/s). Has someone some test / performance tuning hints for this situation? Sincerly Nico P.S.: Linux as server because running on dell 1955 makes the blade unmonitorable under fbsd. P.P.S.: The main usage will be mailserver, so many small files. --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --+pHx0qQiF2pBVqBT Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHK2i9uL75KpiFGIwRAlbdAKDUdPwgD80yN96FlWdTsfkJx/ENCACfcxKK rqxepv/QiKLtpK70MnbV59w= =oeA2 -----END PGP SIGNATURE----- --+pHx0qQiF2pBVqBT-- From owner-freebsd-performance@FreeBSD.ORG Mon Nov 5 15:00:13 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9C6FF16A417 for ; Mon, 5 Nov 2007 15:00:13 +0000 (UTC) (envelope-from brde@optusnet.com.au) Received: from fallbackmx02.syd.optusnet.com.au (fallbackmx02.syd.optusnet.com.au [211.29.133.72]) by mx1.freebsd.org (Postfix) with ESMTP id B341613C4C5 for ; Mon, 5 Nov 2007 15:00:12 +0000 (UTC) (envelope-from brde@optusnet.com.au) Received: from mail02.syd.optusnet.com.au (mail02.syd.optusnet.com.au [211.29.132.183]) by fallbackmx02.syd.optusnet.com.au (8.12.11.20060308/8.12.11) with ESMTP id lA56twJU020144 for ; Mon, 5 Nov 2007 17:55:58 +1100 Received: from c211-30-219-213.carlnfd3.nsw.optusnet.com.au (c211-30-219-213.carlnfd3.nsw.optusnet.com.au [211.30.219.213]) by mail02.syd.optusnet.com.au (8.13.1/8.13.1) with ESMTP id lA56sg0E011570 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 5 Nov 2007 17:54:47 +1100 Date: Mon, 5 Nov 2007 17:54:41 +1100 (EST) From: Bruce Evans X-X-Sender: bde@delplex.bde.org To: Jeff Roberson In-Reply-To: <20071104132540.S544@10.0.0.1> Message-ID: <20071105171941.C19146@delplex.bde.org> References: <1698.10.202.77.103.1194211291.squirrel@webmail.superhero.nl> <20071104132540.S544@10.0.0.1> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-performance@freebsd.org, "Gelsema, P \(Patrick\) - FreeBSD" Subject: Re: ULE vs 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Nov 2007 15:00:13 -0000 On Sun, 4 Nov 2007, Jeff Roberson wrote: > On Sun, 4 Nov 2007, Gelsema, P (Patrick) - FreeBSD wrote: >> w/o patch >> hulk# time make -j8 buildkernel >> 837.808u 138.167s 10:28.96 155.1% 6349+1349k 2873+7780io 303pf+0w >> >> w patch >> hulk# time make -j8 buildkernel >> 838.554u 168.316s 10:52.10 154.4% 6263+1332k 6489+7791io 11pf+0w >> >> I only understand the 10:52 seconds thing, but it looks like it's >> stressing less and still getting things done. > > Well this doesn't look very good at all. System time increased by 30 > seconds! Must be too many extra context switches. The minimum slice value > is probably too small and you've got an average of 4 threads per-core. 838 seconds for a kernel build! I'm unhappy with ~32 seconds for a kernel build on a system with 1/2 or 1/4 as much CPU here, with ULE still taking an extra 0.5 seconds. Mine is not an equivalent kernel build since it is for ~4.10 with ~5.2 userland (so that the benchmark isn't affected by anything except the kernel). 4BSD: "make depend": 8.12 real 5.09 user 1.34 sys "make": 31.94 real 56.18 user 4.49 sys ULE: "make depend": 8.09 real 5.16 user 1.19 sys "make": 32.12 real 55.72 user 4.91 sys The kernel is about 2/3 as large as GENERIC, with no acpi and no modules. The machine is a Turion X2 2GHz in i386 mode. The buffer cache was 100% warm. All makes normal ones (no buildkernel or modules pessimizations) with -j4. Before recent vm changes, the real times were about 0.20 seconds smaller for "make". Building on a local file system gives real times about 2 seconds smaller for "make". Building a ~5.2 kernel on a local file system on this machine takes about 10 seconds longer (~42 seconds for 4BSD and ~43 seconds for ULE). Building a ~5.2 world over nfs (with a cold cache) on this machine takes about 825 seconds with 4BSD and 833 seconds with ULE. -current building itself is much slower due to source bloat and gcc bloat: For build a -current kernel with the same features on an Opteron X2 1.8GHz in amd64 mode over an untuned nfs with an untuned (INVARIANTS) kernel: 4BSD (several months ago), gcc-3.4.6: "make depend": 110.32 real 15.83 user 10.20 sys "make": 86.43 real 128.17 user 19.05 sys ULE, gcc-4.2.1: "make depend": 83.34 real 15.39 user 8.67 sys "make": 108.03 real 170.77 user 23.83 sys The "make depend" times are not directly comparable. The untuned nfs is so slow that "make -j4 depend" takes 50-100 seconds no matter how many kernels are built in parallel, due to dead time waiting for nfs, so I build 6 kernels in parallel ("make depend" itself is mostly serial) on the slow machine but not normally. The "make" times are directly comparable (they are for "make -j4" of a single kernel on 2-way SMP systems). Bruce From owner-freebsd-performance@FreeBSD.ORG Tue Nov 6 05:22:15 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D66CA16A417 for ; Tue, 6 Nov 2007 05:22:15 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.176]) by mx1.freebsd.org (Postfix) with ESMTP id 7A11713C494 for ; Tue, 6 Nov 2007 05:22:15 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so3682401pyb for ; Mon, 05 Nov 2007 21:22:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=yQJlHTTPOKRrcZ2NeGx1M0pNAjSYDWQiJuHtt6WTI7M=; b=VuFi+8Z0pPiQr8NuGychgmI5mfQx9SjrzfZuhi1x8gJoEHsRF3JqZX4K5QMt/5umBLyQF1myUsSuAAyDXtzXOBjsy2nTxlcRF0eHAL0lBpmcGzSxEnh/jZK5sgTCfGNR8VFpRSsQ+a2VYDu2AFB4p2s6ddkMyCOTyByhVsXlO3M= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=aMd1Wx4Mhlv1EAmhLDpaj4rE73IE7tVnnPAd4/9nxkuCLvFDVHT3pu92R7603HGVDNeutktBoxeHWSyrsF3t5H2s+Z6KkENg+eHmHYb3YTaaFmw+llmdGIvDY9Z+KblM12XerEJrlt++DasuCzsCxxvf29jhoNxtQTg29C4O50E= Received: by 10.35.92.18 with SMTP id u18mr7027248pyl.1194326524310; Mon, 05 Nov 2007 21:22:04 -0800 (PST) Received: by 10.35.110.17 with HTTP; Mon, 5 Nov 2007 21:22:04 -0800 (PST) Message-ID: <8cb6106e0711052122j5d39a0a8nd072992a8278e5bf@mail.gmail.com> Date: Mon, 5 Nov 2007 21:22:04 -0800 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071102102331.G544@10.0.0.1> <8cb6106e0711021306w10c48a15s99eab526064ac814@mail.gmail.com> <20071102150028.R544@10.0.0.1> <8cb6106e0711021839i4714bdfbh74d412b3e14e808@mail.gmail.com> <8cb6106e0711031227t1e829969s2e6062e1db5167af@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2007 05:22:15 -0000 > Sysbench results: > # threads slice=7 slice=13 slice_min=4 slice_min=2 > 4 2265.67 2250.36 2261.71 2297.08 > 8 2300.25 2310.02 2306.79 2313.61 > 12 2269.54 2304.04 2296.54 2279.73 > 16 2249.26 2252.04 2260.53 2245.76 Sorry, forgot the sysbench results with the new patch. Here they are: 4 2228.99 8 2314.31 12 2272.53 16 2254.07 Thanks, Josh From owner-freebsd-performance@FreeBSD.ORG Tue Nov 6 12:28:10 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 062CF16A418 for ; Tue, 6 Nov 2007 12:28:10 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id B34E313C4B7 for ; Tue, 6 Nov 2007 12:28:09 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id AB35413351D; Tue, 6 Nov 2007 13:28:20 +0100 (CET) Date: Tue, 6 Nov 2007 13:28:20 +0100 From: Nico -telmich- Schottelius To: freebsd-performance@freebsd.org Message-ID: <20071106122820.GA28254@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="SLDf9lqlvOQaIe6s" Content-Disposition: inline User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.23.1-denkbrett on i686 Subject: Performance of disk i/o with 3ware X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2007 12:28:10 -0000 --SLDf9lqlvOQaIe6s Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello! I've the problem that sometimes there are many disk waiting processes (sysctl -n vm.vmtotal), but systat -vmstat shows da0 and da1 busy with 0-10%. I guess that the disk i/o is at about 100%, but wondering why I see those strange values. System Information: - Disks are attached to 07:01.0 RAID bus controller: 3ware Inc 9550SX SATA-= RAID u0216# uname -a = =20 FreeBSD u0216.nshq.netstream.com 6.2-RELEASE FreeBSD 6.2-RELEASE #0: Wed Oc= t 31 14:53:00 CET 2007 root@u0216.nshq.netstream.com:/usr/obj/usr/src/sys/S= MPPAEQUOTA i386 =3D> kernel contains 3ware patches from CVS, marked for inclusion in 6.3, because we've seen many times a freeze on that system before - Disks are 10k rpm sata disks. - Board is a Supermicro X7DB8, processor is a quad core Xeon, E5345@2.33GHz. Anyone an idea, a) why systat -vmstat shows so small busy values? b) how to debug it further? Sincerly Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --SLDf9lqlvOQaIe6s Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHMF3kuL75KpiFGIwRApMAAJ47e9Vtx5WDrhFYz0TU2/00pyoTYACg1PD5 F+Ii3B6ZjEIom7/KS29Xyc4= =3bQz -----END PGP SIGNATURE----- --SLDf9lqlvOQaIe6s-- From owner-freebsd-performance@FreeBSD.ORG Tue Nov 6 17:54:10 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id E72D816A417 for ; Tue, 6 Nov 2007 17:54:10 +0000 (UTC) (envelope-from mgowda82@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.177]) by mx1.freebsd.org (Postfix) with ESMTP id B7E6013C4B9 for ; Tue, 6 Nov 2007 17:54:10 +0000 (UTC) (envelope-from mgowda82@gmail.com) Received: by wa-out-1112.google.com with SMTP id k17so2612579waf for ; Tue, 06 Nov 2007 09:54:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; bh=/7QaR4xRYUL58qdBUFd4R2YJcU/nG5ekz095UvboOqM=; b=DAqjH5DS3MpuiaIVzK980eGlbUIVhfrGd0DK4hS0PFNmqaq8CxFPnaqFW5HnQjpXgaaEwHkpql6AlW9LezdBHiEDWA0SHx7fFJJHMF2qTqaVx/R+2wYa5XotBAdOPgkGNAwGNS8lrz2xqJ1Z4sAAttYhyWSpc5D5YsBmXT+mfQk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=oTTFn67OYjq8/cBZ5/iNaqaEb1iUuJxZ/+a28T2UCWwXWs/QGnXUcpDtaArD8HO6OHdyzgGOl4kxyMUEOdnpriJdaGHJCYWe4dquU+aF6v6L9/1y3+LNXRAtuTzsCUPwhnF75RXr57DZrwLJN76hh28aHn/z4VM4vfS3Z/4dfZY= Received: by 10.114.27.20 with SMTP id a20mr504695waa.1194371649388; Tue, 06 Nov 2007 09:54:09 -0800 (PST) Received: by 10.114.123.4 with HTTP; Tue, 6 Nov 2007 09:54:09 -0800 (PST) Message-ID: Date: Tue, 6 Nov 2007 09:54:09 -0800 From: "Manjunath R Gowda" To: "Nico -telmich- Schottelius" In-Reply-To: <20071106122820.GA28254@schottelius.org> MIME-Version: 1.0 References: <20071106122820.GA28254@schottelius.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-performance@freebsd.org Subject: Re: Performance of disk i/o with 3ware X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2007 17:54:11 -0000 On 11/6/07, Nico -telmich- Schottelius < nico-freebsd-performance@schottelius.org> wrote: > > Hello! > > I've the problem that sometimes there are many disk waiting processes > (sysctl -n vm.vmtotal), but systat -vmstat shows da0 and da1 busy with > 0-10%. I woudn't worry about how many are sleeping. But, How long they sleep would be interesting data. I guess that the disk i/o is at about 100%, but wondering why I see > those strange values. Why do you think it should be 100%? Are you running any disk I/O intense application? System Information: > > - Disks are attached to 07:01.0 RAID bus controller: 3ware Inc 9550SX > SATA-RAID > > u0216# uname -a > FreeBSD u0216.nshq.netstream.com 6.2-RELEASE FreeBSD 6.2-RELEASE #0: Wed > Oct 31 14:53:00 CET 2007 root@u0216.nshq.netstream.com > :/usr/obj/usr/src/sys/SMPPAEQUOTA i386 > > => kernel contains 3ware patches from CVS, marked for inclusion in 6.3, > because we've seen many times a freeze on that system before > > - Disks are 10k rpm sata disks. > - Board is a Supermicro X7DB8, processor is a quad core Xeon, > E5345@2.33GHz. > > Anyone an idea, > a) why systat -vmstat shows so small busy values? > b) how to debug it further? You can try experimenting with diffrent I/O loads to make sure that there is a problem before start debugging it. -Manjunath From owner-freebsd-performance@FreeBSD.ORG Tue Nov 6 19:32:40 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 294A916A419 for ; Tue, 6 Nov 2007 19:32:40 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id B50A813C4A3 for ; Tue, 6 Nov 2007 19:32:39 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 80DC72072D3; Tue, 6 Nov 2007 20:33:05 +0100 (CET) Date: Tue, 6 Nov 2007 20:33:05 +0100 From: Nico -telmich- Schottelius To: Manjunath R Gowda Message-ID: <20071106193305.GJ15790@schottelius.org> References: <20071106122820.GA28254@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="AXxEqdD4tcVTjWte" Content-Disposition: inline In-Reply-To: User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.23.1-denkbrett on i686 Cc: freebsd-performance@freebsd.org Subject: Re: Performance of disk i/o with 3ware X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2007 19:32:40 -0000 --AXxEqdD4tcVTjWte Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Manjunath R Gowda [Tue, Nov 06, 2007 at 09:54:09AM -0800]: > On 11/6/07, Nico -telmich- Schottelius < > nico-freebsd-performance@schottelius.org> wrote: > > > > Hello! > > > > I've the problem that sometimes there are many disk waiting processes > > (sysctl -n vm.vmtotal), but systat -vmstat shows da0 and da1 busy with > > 0-10%. >=20 > I woudn't worry about how many are sleeping. But, How long they sleep wou= ld > be interesting data. And also why they sleep. Having about 700 processes in sleep state plus 400 processes in diskwait state makes me wonder somehow. There are also some processes from cron, which are older and also in state "I" (as shown by ps). > > I guess that the disk i/o is at about 100%, but wondering why I see > > those strange values. >=20 > Why do you think it should be 100%? Are you running any disk I/O intense > application? Because it's the well known bottleneck in that server: - it has 4 cpus, which are about 30-50% idle - it has 4 GiB ram, of which 2GiB is mostly inactive - it has 4 10k rpm hds in 2 raid1 disk arrays, one for the mailboxes + root and one for the qmail-queue Normally systat -vmstat shows 80-100% busy state on the disk arrays, but currently it's at about 10%, which cannot be right. I think I'll have a look closer look at the patch we used from CVS to patch= the 3ware twa driver. > > Anyone an idea, > > a) why systat -vmstat shows so small busy values? > > b) how to debug it further? >=20 > You can try experimenting with diffrent I/O loads to make sure that there > is a problem before start debugging it. There is a big problem, that even results in taking about 30 seconds until the '220' messages comes from qmail when connecting via telnet =66rom outside to it. To summarise, what runs on the server: - qmail + patches =3D> has /var/qmail/queue on it's own disk-array - courier imapd - vpopmail (pop3 auth) - mysql (needed by vpopmail) - clamd - spamassassin - Webmail (horde on apache) So it's mainly a customer mailserver, with nothing special installed, which may have some load, but not in the way it's not explainable. So I'm still hoping somebody with similar problems reads this mail ;-) Sincerly Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --AXxEqdD4tcVTjWte Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHMMFxuL75KpiFGIwRAoKxAKDjh7aN8n/b7B3YPqcdKuqMPv9CGACgsGuf lI6wV4jUuP8GnUhd37oW/mQ= =4Yn4 -----END PGP SIGNATURE----- --AXxEqdD4tcVTjWte-- From owner-freebsd-performance@FreeBSD.ORG Wed Nov 7 00:11:00 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 858B816A46E for ; Wed, 7 Nov 2007 00:11:00 +0000 (UTC) (envelope-from mgowda82@gmail.com) Received: from nz-out-0506.google.com (nz-out-0506.google.com [64.233.162.229]) by mx1.freebsd.org (Postfix) with ESMTP id 3715E13C4B2 for ; Wed, 7 Nov 2007 00:10:59 +0000 (UTC) (envelope-from mgowda82@gmail.com) Received: by nz-out-0506.google.com with SMTP id l8so1361215nzf for ; Tue, 06 Nov 2007 16:10:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; bh=vuoXq75rmc/KM8JlgF5K9ce6ozXZShNNRp14ONNVoYA=; b=LiWyrhtkamMcYOgpwQo0p+SW/ZJ+INFK1y5iUhM7jlFAL4iADjUzcbZZqLucwaKhSObAFBsw7W+7ZZ1U/9ga9AB67+3cczcPFOa1SOW3++NriE5LmoO4suptnRFsBclzYH7fVi/EstkBb2DDVbmCU/P7WqPzJgpYhKlVog3lbd4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=jbPNMpxuoaswRn1aWStMDiDg7mZF41vHl25DOYG1naS7Jqi3uuzgtR5slLKHtg7zWbnLK3UIJycfZn9PfgCcTKlBXHgWdF53jFd/CLvkOahr9AcNhO8W731UEXGR6ZSsU3BI4hGnh0rCSapjwSmyk0KnHmeIzvLQBAVuJ9HI7wY= Received: by 10.142.148.7 with SMTP id v7mr551090wfd.1194394256198; Tue, 06 Nov 2007 16:10:56 -0800 (PST) Received: by 10.142.13.10 with HTTP; Tue, 6 Nov 2007 16:10:56 -0800 (PST) Message-ID: Date: Tue, 6 Nov 2007 16:10:56 -0800 From: "Manjunath R Gowda" To: "Nico -telmich- Schottelius" In-Reply-To: <20071106193305.GJ15790@schottelius.org> MIME-Version: 1.0 References: <20071106122820.GA28254@schottelius.org> <20071106193305.GJ15790@schottelius.org> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-performance@freebsd.org Subject: Re: Performance of disk i/o with 3ware X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2007 00:11:00 -0000 On 11/6/07, Nico -telmich- Schottelius < nico-freebsd-performance@schottelius.org> wrote: > > Manjunath R Gowda [Tue, Nov 06, 2007 at 09:54:09AM -0800]: > > On 11/6/07, Nico -telmich- Schottelius < > > nico-freebsd-performance@schottelius.org> wrote: > > > > > > Hello! > > > > > > I've the problem that sometimes there are many disk waiting processes > > > (sysctl -n vm.vmtotal), but systat -vmstat shows da0 and da1 busy with > > > 0-10%. > > > > I woudn't worry about how many are sleeping. But, How long they sleep > would > > be interesting data. > > And also why they sleep. Having about 700 processes in sleep state plus > 400 processes in diskwait state makes me wonder somehow. At a given time only few can run, remaining once will sleep which is an expected behavior. There are also some processes from cron, which are older and also in > state "I" (as shown by ps). You have to dig deep and see what those cron jobs do. > > I guess that the disk i/o is at about 100%, but wondering why I see > > > those strange values. > > > > Why do you think it should be 100%? Are you running any disk I/O intense > > application? > > Because it's the well known bottleneck in that server: > > - it has 4 cpus, which are about 30-50% idle > - it has 4 GiB ram, of which 2GiB is mostly inactive > - it has 4 10k rpm hds in 2 raid1 disk arrays, one for > the mailboxes + root and one for the qmail-queue > > Normally systat -vmstat shows 80-100% busy state on the disk arrays, > but currently it's at about 10%, which cannot be right. > > I think I'll have a look closer look at the patch we used from CVS to > patch the > 3ware twa driver. Looks like your blaming the twa driver based on your experience. OS is a complex piece of software and involves many components, scheduler, vm, scsi-stack, driver, problem could be any where in this. That's why specific data would be useful. Something like on 6.2 running x takes y and on 6.2+patch it takes z would be useful. > > Anyone an idea, > > > a) why systat -vmstat shows so small busy values? > > > b) how to debug it further? > > > > You can try experimenting with diffrent I/O loads to make sure that > there > > is a problem before start debugging it. > > There is a big problem, that even results in taking about 30 seconds > until the '220' messages comes from qmail when connecting via telnet > from outside to it. Your adding one more variable, network here. Verify that when you did cvsup the network driver was not updated. To summarise, what runs on the server: > > - qmail + patches => has /var/qmail/queue on it's own disk-array > - courier imapd > - vpopmail (pop3 auth) > - mysql (needed by vpopmail) > - clamd > - spamassassin > - Webmail (horde on apache) > > So it's mainly a customer mailserver, with nothing special installed, > which may have some load, but not in the way it's not explainable. > > So I'm still hoping somebody with similar problems reads this mail ;-) > > Sincerly > > Nico > > -- > Think about Free and Open Source Software (FOSS). > http://nico.schottelius.org/documentations/foss/the-term-foss/ > > PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.6 (GNU/Linux) > > iD8DBQFHMMFxuL75KpiFGIwRAoKxAKDjh7aN8n/b7B3YPqcdKuqMPv9CGACgsGuf > lI6wV4jUuP8GnUhd37oW/mQ= > =4Yn4 > -----END PGP SIGNATURE----- > > From owner-freebsd-performance@FreeBSD.ORG Wed Nov 7 01:10:17 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 520A416A418 for ; Wed, 7 Nov 2007 01:10:17 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from webaccess-cl.virtdom.com (webaccess-cl.virtdom.com [216.240.101.25]) by mx1.freebsd.org (Postfix) with ESMTP id 152E913C49D for ; Wed, 7 Nov 2007 01:10:16 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from [192.168.1.100] (cpe-24-94-75-93.hawaii.res.rr.com [24.94.75.93]) (authenticated bits=0) by webaccess-cl.virtdom.com (8.13.6/8.13.6) with ESMTP id lA71AAgS073046 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Tue, 6 Nov 2007 20:10:12 -0500 (EST) (envelope-from jroberson@chesapeake.net) Date: Tue, 6 Nov 2007 17:12:02 -0800 (PST) From: Jeff Roberson X-X-Sender: jroberson@10.0.0.1 To: Josh Carroll In-Reply-To: <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> Message-ID: <20071106171059.M544@10.0.0.1> References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711021839i4714bdfbh74d412b3e14e808@mail.gmail.com> <8cb6106e0711031227t1e829969s2e6062e1db5167af@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2007 01:10:17 -0000 On Mon, 5 Nov 2007, Josh Carroll wrote: >> Turns out the last patch I posted had a small compile error because I >> edited it by hand to remove one section. Here's an updated patch that >> fixes that and changes the min/max slice values to something more >> reasonable. Slice min should be around 4 with a max of 12. >> >> Also looks like 4BSD's slice handling got more precise recently as well. >> jhb changed it from using a callout to an actual counter based on runtime. > > ffmpeg runtime with the new patch: 1:39.09 > > buildworld: 13:55.689 > > Looks like things got a little worse with this patch. One thing of > note, the slice_min and slice values are: > > kern.sched.slice_min: 5 > kern.sched.slice: 13 That's expected due to the fuzzy rounding of 128 / 10, etc. Can you set slice_min and slice both equal to 7 and see if the numbers come out better than without the patch but with a slice value of 7? Basically I'm trying to isolate the effects of the different slice handling in this patch from the other changes. Thanks, Jeff > > Did I do something wrong to cause the slice min to be 5 instead of 4 > and the max to be 13 instead of 12? > > Thanks, > Josh > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > From owner-freebsd-performance@FreeBSD.ORG Wed Nov 7 01:24:48 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5465516A473 for ; Wed, 7 Nov 2007 01:24:48 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.183]) by mx1.freebsd.org (Postfix) with ESMTP id 08E4913C4A5 for ; Wed, 7 Nov 2007 01:24:47 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so4279592pyb for ; Tue, 06 Nov 2007 17:24:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=8+8wd0l2Y83ZeKSrajFDEK127hFSs5EhsAVvuXBzRVE=; b=bX4l42oBen5edR+powrA1nv3QvPduufyVDCmYrPdyr8pnF69DPcMWF4yY9i8YlBYGpbdXtWuH5re4trMH0yuOP6uBSR8K7b8FZzxUhwVMmrpKQYCYuMtM/zyH7ya+i3EUKn9iKWVa0/d1ERzJd73BzsOctjSn2tMiHNNww9FWL8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=WHhgsPPU4q9egsysIAgNg08vjZ7DOdISbkf6/7rN2nZosSTX7vNY++eWILlxJjIWKt2v08nqGINSKXn468j4kiXc7hiYmbSNIQw7RY0ISDKRLNn5IrGMeY+826Xxsgq6bnaz1LKk+yLb0lSnNznj85i47eVnNd2IHrNhgaQWfp0= Received: by 10.35.129.19 with SMTP id g19mr8177290pyn.1194398683025; Tue, 06 Nov 2007 17:24:43 -0800 (PST) Received: by 10.35.110.17 with HTTP; Tue, 6 Nov 2007 17:24:42 -0800 (PST) Message-ID: <8cb6106e0711061724n16d95766q1c352aeb9584c0c7@mail.gmail.com> Date: Tue, 6 Nov 2007 17:24:42 -0800 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071106171059.M544@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2007 01:24:48 -0000 > That's expected due to the fuzzy rounding of 128 / 10, etc. Can you set > slice_min and slice both equal to 7 and see if the numbers come out > better than without the patch but with a slice value of 7? Basically I'm > trying to isolate the effects of the different slice handling in this > patch from the other changes. So are you expecting the same performance out of this patch with slice_min and slice set to 7 as I was seeing without the patch with the slice value set to 7? I'll get the benchmarks running now with those settings, and report back soon. Josh From owner-freebsd-performance@FreeBSD.ORG Wed Nov 7 05:36:34 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F1E3016A419 for ; Wed, 7 Nov 2007 05:36:34 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.182]) by mx1.freebsd.org (Postfix) with ESMTP id A06EC13C4AA for ; Wed, 7 Nov 2007 05:36:34 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so4378381pyb for ; Tue, 06 Nov 2007 21:36:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=LEk9/nfCxQNt5bCTWq9afrHYZ8Zvt363DX/saL+VtHk=; b=tByvllE+cN6tGDsu8XoYXsaRJsk5TPVaYasEsbML9Jd9ypl44e7FYoIZFs8jruutbJiqSBqG20yBcr5NfeiAgKe8YPIgCvnauqUkTTB3hraXFYbjbI+dR3MaLG2J1U7zabvicHWmBw6zedV2ycSNBtqeHwHHdqmLy36scPF2S+U= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=kHgU6MSuOWWk2AxbJ1MrsADtmNVXOSMXYdBU1ry1nE0qzqtPF2eytlclJBKEBA2jGNrBAhw6+UIdsJQtYxOJESabdYUjS7vsXNgZxGvx+mJEWEXMQvu3ekVZhBAKNZd4cuKw6by5CBCSytVEw5Od4Bb4ejlb/BuS6u4Cl3CgsIk= Received: by 10.35.128.1 with SMTP id f1mr8418394pyn.1194413784960; Tue, 06 Nov 2007 21:36:24 -0800 (PST) Received: by 10.35.110.17 with HTTP; Tue, 6 Nov 2007 21:36:24 -0800 (PST) Message-ID: <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> Date: Tue, 6 Nov 2007 21:36:24 -0800 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071106171059.M544@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Nov 2007 05:36:35 -0000 > That's expected due to the fuzzy rounding of 128 / 10, etc. Can you set > slice_min and slice both equal to 7 and see if the numbers come out > better than without the patch but with a slice value of 7? Basically I'm > trying to isolate the effects of the different slice handling in this > patch from the other changes. Here are the results. Looks like setting slice_min and slice to 7 degraded performance for all work loads. Should I try any other settings for slice and slice_min? ffmpeg: 1:39.91 sysbench (4, 8, 12, 16 threads respectively): 2013.78 2157.6 2175.91 2184.16 And buildworld time: 14m7.517s Thanks! Josh From owner-freebsd-performance@FreeBSD.ORG Fri Nov 9 23:01:17 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F3E4A16A417 for ; Fri, 9 Nov 2007 23:01:16 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from webaccess-cl.virtdom.com (webaccess-cl.virtdom.com [216.240.101.25]) by mx1.freebsd.org (Postfix) with ESMTP id C550613C4B6 for ; Fri, 9 Nov 2007 23:01:16 +0000 (UTC) (envelope-from jroberson@chesapeake.net) Received: from [192.168.1.100] (cpe-24-94-75-93.hawaii.res.rr.com [24.94.75.93]) (authenticated bits=0) by webaccess-cl.virtdom.com (8.13.6/8.13.6) with ESMTP id lA9N0scH090967 (version=TLSv1/SSLv3 cipher=DHE-DSS-AES256-SHA bits=256 verify=NO); Fri, 9 Nov 2007 18:00:56 -0500 (EST) (envelope-from jroberson@chesapeake.net) Date: Fri, 9 Nov 2007 15:02:39 -0800 (PST) From: Jeff Roberson X-X-Sender: jroberson@10.0.0.1 To: Josh Carroll In-Reply-To: <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> Message-ID: <20071109145827.W639@10.0.0.1> References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071103121921.M544@10.0.0.1> <8cb6106e0711031416l4183e2beueb87fade0d56f504@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> MIME-Version: 1.0 Content-Type: MULTIPART/MIXED; BOUNDARY="0-308221192-1194649359=:639" Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Nov 2007 23:01:17 -0000 This message is in MIME format. The first part should be readable text, while the remaining parts are likely unreadable without MIME-aware tools. --0-308221192-1194649359=:639 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed On Tue, 6 Nov 2007, Josh Carroll wrote: >> That's expected due to the fuzzy rounding of 128 / 10, etc. Can you set >> slice_min and slice both equal to 7 and see if the numbers come out >> better than without the patch but with a slice value of 7? Basically I'm >> trying to isolate the effects of the different slice handling in this >> patch from the other changes. > > Here are the results. Looks like setting slice_min and slice to 7 > degraded performance for all work loads. Should I try any other > settings for slice and slice_min? Josh, I had an interesting thought today. What if the reason 4BSD is faster is because it distributes load more evenly across all packages because it distributes randomly? ULE distributed across cores evenly but not packages. Can you try the attached patch? This also turns the default slice size down but does not contain the other context switch performance improvements. Thanks, Jeff > > ffmpeg: 1:39.91 > > sysbench (4, 8, 12, 16 threads respectively): > > 2013.78 > 2157.6 > 2175.91 > 2184.16 > > And buildworld time: 14m7.517s > > Thanks! > Josh > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" > --0-308221192-1194649359=:639 Content-Type: TEXT/x-diff; charset=US-ASCII; name=ule.diff Content-Transfer-Encoding: BASE64 Content-ID: <20071109150239.R639@10.0.0.1> Content-Description: Content-Disposition: attachment; filename=ule.diff SW5kZXg6IHNjaGVkX3VsZS5jDQo9PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09DQpS Q1MgZmlsZTogL2hvbWUvbmN2cy9zcmMvc3lzL2tlcm4vc2NoZWRfdWxlLmMs dg0KcmV0cmlldmluZyByZXZpc2lvbiAxLjIxNg0KZGlmZiAtdSAtcjEuMjE2 IHNjaGVkX3VsZS5jDQotLS0gc2NoZWRfdWxlLmMJMjMgT2N0IDIwMDcgMDA6 NTI6MjQgLTAwMDAJMS4yMTYNCisrKyBzY2hlZF91bGUuYwk5IE5vdiAyMDA3 IDIzOjAxOjIxIC0wMDAwDQpAQCAtMTEwNSw2ICsxMTA1LDkgQEANCiAJICog TG9vayBmb3IgYW4gaWRsZSBncm91cC4NCiAJICovDQogCUNUUjEoS1RSX1VM RSwgInRkcV9pZGxlICVYIiwgdGRxX2lkbGUpOw0KKwljcHUgPSBmZnModGRx X2lkbGUgJiAweDVhNWE1YTVhKTsNCisJaWYgKGNwdSkNCisJCXJldHVybiAo LS1jcHUpOw0KIAljcHUgPSBmZnModGRxX2lkbGUpOw0KIAlpZiAoY3B1KQ0K IAkJcmV0dXJuICgtLWNwdSk7DQpAQCAtMTMyNCw3ICsxMzI3LDcgQEANCiAJ ICogaW4gY2FzZSB3aGljaCBzY2hlZF9jbG9jaygpIGNhbGxlZCBiZWZvcmUg c2NoZWRfaW5pdHRpY2tzKCkuDQogCSAqLw0KIAlyZWFsc3RhdGh6ID0gaHo7 DQotCXNjaGVkX3NsaWNlID0gKHJlYWxzdGF0aHovMTApOwkvKiB+MTAwbXMg Ki8NCisJc2NoZWRfc2xpY2UgPSAocmVhbHN0YXRoei8xNSk7DQogCXRpY2tp bmNyID0gMSA8PCBTQ0hFRF9USUNLX1NISUZUOw0KIA0KIAkvKiBBZGQgdGhy ZWFkMCdzIGxvYWQgc2luY2UgaXQncyBydW5uaW5nLiAqLw0K --0-308221192-1194649359=:639-- From owner-freebsd-performance@FreeBSD.ORG Sat Nov 10 03:02:31 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 96A8F16A419 for ; Sat, 10 Nov 2007 03:02:31 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.181]) by mx1.freebsd.org (Postfix) with ESMTP id 0C71813C48A for ; Sat, 10 Nov 2007 03:02:30 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so30619pyb for ; Fri, 09 Nov 2007 19:02:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=mDWWmZnjqrKw2vLBGt8K3h7ttqzvhSM7tUmopi9geAM=; b=oMYLQPdP9NUOQG8k+k/+FOAEHaUxlOAk06xw60xHlO2V5AZXqNYzooLVQrYe4HYN8x6IO69uU2/URM5YXLGMcYavROAABWH9clsI58pms4n79s35w+xEPmSlIq98msMtZFJ3WQ8k6hHU0MDqB2dTmn2dQMu8t1+ZtthKsAz4W7s= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=SDRtDhGpTSLdFowQclmu7fzYlXSJRjNxZlPsnRrQdyJbyQYYHJJEa9SURTMa9LLgC1nPpZHBdkDE/Lxds8cbSr4D8zbr84CJzAK52br8jpxdJFWX+jzjTrwMPNPVfNZp2xoPGiWyJelw8BAF/azbWpJPLF2JtzFX7piFAc0W7xs= Received: by 10.35.65.17 with SMTP id s17mr2837079pyk.1194663319839; Fri, 09 Nov 2007 18:55:19 -0800 (PST) Received: by 10.35.57.12 with HTTP; Fri, 9 Nov 2007 18:55:19 -0800 (PST) Message-ID: <8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com> Date: Fri, 9 Nov 2007 18:55:19 -0800 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071109145827.W639@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Nov 2007 03:02:31 -0000 > Josh, I had an interesting thought today. What if the reason 4BSD is > faster is because it distributes load more evenly across all packages > because it distributes randomly? ULE distributed across cores evenly but > not packages. Can you try the attached patch? This also turns the > default slice size down but does not contain the other context switch > performance improvements. Hi Jeff, here are the results: ffmpeg: 1:38.885 sysbench: (4,8,12,16 threads respectively): 2221.93 2327.87 2292.49 2269.29 And buildworld: 13m47.052s Much improved! :) Josh From owner-freebsd-performance@FreeBSD.ORG Sat Nov 10 15:19:15 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 03AB916A41A for ; Sat, 10 Nov 2007 15:19:15 +0000 (UTC) (envelope-from freebsd@superhero.nl) Received: from superman.superhero.nl (superhero.nl [82.95.198.17]) by mx1.freebsd.org (Postfix) with ESMTP id 40CBD13C48E for ; Sat, 10 Nov 2007 15:19:13 +0000 (UTC) (envelope-from freebsd@superhero.nl) Received: (qmail 47649 invoked by uid 80); 10 Nov 2007 15:18:49 -0000 Received: from robin.ad.superhero.nl ([10.202.77.103]) (SquirrelMail authenticated user gelsemap) by webmail.superhero.nl with HTTP; Sat, 10 Nov 2007 16:18:49 +0100 (CET) Message-ID: <1663.10.202.77.103.1194707929.squirrel@webmail.superhero.nl> In-Reply-To: <3769.10.202.77.103.1194220246.squirrel@webmail.superhero.nl> References: <1698.10.202.77.103.1194211291.squirrel@webmail.superhero.nl> <20071104132540.S544@10.0.0.1> <3769.10.202.77.103.1194220246.squirrel@webmail.superhero.nl> Date: Sat, 10 Nov 2007 16:18:49 +0100 (CET) From: "Gelsema, P \(Patrick\) - FreeBSD" To: "Gelsema, P \(Patrick\) - FreeBSD" User-Agent: SquirrelMail/1.4.8 MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Mailman-Approved-At: Sat, 10 Nov 2007 15:47:17 +0000 Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: ULE vs 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Nov 2007 15:19:15 -0000 On Mon, November 5, 2007 00:50, Gelsema, P (Patrick) - FreeBSD wrote: > On Sun, November 4, 2007 22:27, Jeff Roberson wrote: >> On Sun, 4 Nov 2007, Gelsema, P (Patrick) - FreeBSD wrote: >> >>> Hi Jeff, >>> >>> I tried your patch. Ran a buildkernel, timed. Recompiled kernel >>> including >>> your patch, rebooted and reran. Please find results below. >>> >>> w/o patch >>> hulk# time make -j8 buildkernel >>> 837.808u 138.167s 10:28.96 155.1% 6349+1349k 2873+7780io 303pf+0w >>> >>> w patch >>> hulk# time make -j8 buildkernel >>> 838.554u 168.316s 10:52.10 154.4% 6263+1332k 6489+7791io 11pf+0w >>> >>> I only understand the 10:52 seconds thing, but it looks like it's >>> stressing less and still getting things done. >>> >> >> Well this doesn't look very good at all. System time increased by 30 >> seconds! Must be too many extra context switches. The minimum slice >> value is probably too small and you've got an average of 4 threads >> per-core. >> >> Can you try re-running with kern.sched.slice_min = 4 and >> kern.sched.slice >> = 12 ? >> >> Can you tell me how 4BSD does on this machine? > > ULE w/o patch > hulk# time make -j8 buildkernel > 837.808u 138.167s 10:28.96 155.1% 6349+1349k 2873+7780io 303pf+0w > > ULE w latest patch > hulk# time make -j8 buildkernel > 846.008u 144.377s 10:41.28 154.4% 6364+1354k 7131+7890io 216pf+0w > kern.sched.interact: 30 > kern.sched.slice_min: 2 > kern.sched.slice: 8 > kern.sched.name: ULE > > ULE w latest patch (changed slice) > hulk# time make -j8 buildkernel > 840.783u 159.639s 10:37.41 156.9% 6280+1338k 656+8025io 0pf+0w > kern.sched.slice_min: 4 > kern.sched.slice: 12 > kern.sched.name: ULE > > 4BSD > hulk# time make -j8 buildkernel > 823.898u 136.524s 9:50.61 162.6% 6263+1334k 7098+7774io 216pf+0w Hi Jeff, With your latest patch applied to RELENG_7 (the one that takes packages into consideration when distributing over cores), I get the following result. ULE hulk# time make -j8 buildkernel 838.774u 147.212s 10:38.59 154.3% 6295+1341k 7139+7880io 214pf+0w hulk# sysctl kern | grep sched kern.sched.preemption: 1 kern.sched.topology: 0 kern.sched.steal_thresh: 1 kern.sched.steal_idle: 1 kern.sched.steal_htt: 1 kern.sched.balance_interval: 133 kern.sched.balance: 1 kern.sched.tryself: 1 kern.sched.affinity: 3 kern.sched.pick_pri: 1 kern.sched.preempt_thresh: 64 kern.sched.interact: 30 kern.sched.slice: 13 kern.sched.name: ULE Rgds, Patrick > > Seems 4BSD wins when it compares to buildkernel. Please let me know if you > want me to run other tests. > > System is: > > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: AMD Athlon(tm) 64 X2 Dual Core Processor 4800+ (2511.47-MHz K8-class > CPU) > Origin = "AuthenticAMD" Id = 0x60fb1 Stepping = 1 > Features=0x178bfbff CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> > Features2=0x2001 > AMD Features=0xea500800 > AMD Features2=0x11f > Cores per package: 2 > usable memory = 3527241728 (3363 MB) > avail memory = 3411648512 (3253 MB) > > Cheers > > Patrick > >> >> Thanks, >> Jeff >> >> >>> System is AMD Athlon X264 2.2Ghz >>> >>> Kernel is GENERIC. >>> hulk# uname -a >>> FreeBSD hulk.superhero.nl 7.0-BETA2 FreeBSD 7.0-BETA2 #0: Sun Nov 4 >>> 20:30:23 UTC 2007 >>> root@hulk.superhero.nl:/usr/obj/usr/src/sys/GENERIC >>> amd64 >>> >>> I see you have a new patch. Could you send that to me? When I download >>> it >>> from the mailman site I get weird characters in the downloaded file :( >>> >>> Cheers >>> >>> Patrick >>> >> > > From owner-freebsd-performance@FreeBSD.ORG Sat Nov 10 19:58:53 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 91E9016A41B for ; Sat, 10 Nov 2007 19:58:53 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.183]) by mx1.freebsd.org (Postfix) with ESMTP id 4419D13C4BA for ; Sat, 10 Nov 2007 19:58:53 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so378264pyb for ; Sat, 10 Nov 2007 11:58:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=joSPRLD1IgKKEszU9i9T0ThRNwLVLMsp98X5dTfcDbU=; b=iRTnrbR89c8IjsHuJo6wszWiM0rWrXQLZcfzbrxlNGuk3zDrbxoTMPX53y/H8h0XFVASsjIeGZOXVX74bWOm/Mo5+HfyF9q7zeiYam9B5zZg+67L0UCnSoSHZSJw4bSB9SX8iIl6g85xVDnvA3mLumeplPSHrjAa3cjHQBbqy1g= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=lGQhRIi7tffpu3SJFdihueLsRjUKZqbyItU9DkALvYyvCoILXP8iv+eTvRWshuehpdgDz3sTJrcZ6M8Q9fG2AAErkGnjJUucBjkVpfRsV2fcVf9AaUIVJtNmOyVX006dLL4CcOTAjy9m5O5mDxd58M5Hm4Ukhdyr/XyhWkfjwwQ= Received: by 10.35.106.15 with SMTP id i15mr3782546pym.1194724725082; Sat, 10 Nov 2007 11:58:45 -0800 (PST) Received: by 10.35.57.12 with HTTP; Sat, 10 Nov 2007 11:58:44 -0800 (PST) Message-ID: <8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com> Date: Sat, 10 Nov 2007 14:58:44 -0500 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Nov 2007 19:58:53 -0000 > ffmpeg: 1:38.885 > > sysbench: (4,8,12,16 threads respectively): > 2221.93 > 2327.87 > 2292.49 > 2269.29 > > And buildworld: 13m47.052s I ran these after changing the slice value to 7 as well with this patch. ffmpeg: 1:38.547 sysbench: 2236.55 2321.02 2271.76 2254.85 buildworld: 13m44.792s So it looks like it makes very little difference with the new patch. It slightly increases performance of 4 and 8 thread sysbench, and very slightly the buildworld time, but not nearly as significant a change as with the release ULE changing the slice value. Is the other half of the context switch enhancements compatible with this patch? The performance numbers are now very close for the other benchmarks, and still quite a bit better for MySQL, so hopefully this will help out for 7.1-RELEASE (I imagine it's too late for 7.0-RELEASE, right?). Stability wise, I have had zero problems (with all the patches you've provided). :) So at least on this box, the patch is stable and a great improvement. Thanks again for all your efforts Jeff! Josh From owner-freebsd-performance@FreeBSD.ORG Sat Nov 10 20:14:51 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1282716A468 for ; Sat, 10 Nov 2007 20:14:51 +0000 (UTC) (envelope-from kris@FreeBSD.org) Received: from weak.local (pointyhat.freebsd.org [IPv6:2001:4f8:fff6::2b]) by mx1.freebsd.org (Postfix) with ESMTP id D602213C4CB; Sat, 10 Nov 2007 20:14:44 +0000 (UTC) (envelope-from kris@FreeBSD.org) Message-ID: <47361134.3050301@FreeBSD.org> Date: Sat, 10 Nov 2007 21:14:44 +0100 From: Kris Kennaway User-Agent: Thunderbird 2.0.0.6 (Macintosh/20070728) MIME-Version: 1.0 To: josh.carroll@gmail.com References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com> <8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com> In-Reply-To: <8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Nov 2007 20:14:51 -0000 Josh Carroll wrote: >> ffmpeg: 1:38.885 >> >> sysbench: (4,8,12,16 threads respectively): >> 2221.93 >> 2327.87 >> 2292.49 >> 2269.29 >> >> And buildworld: 13m47.052s > > I ran these after changing the slice value to 7 as well with this patch. > > ffmpeg: 1:38.547 BTW, it doesn't make much sense to be measuring to millisecond precision a quantity which has variation that is unknown but probably much larger :) When trying to make comparisons to identify performance changes, a careful statistical approach is necessary. Try the /usr/src/tools/tools/ministat utility for a simple and effective way to compare these kinds of noisy measurements and extract reliable comparisons. Kris From owner-freebsd-performance@FreeBSD.ORG Sat Nov 10 20:18:31 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 453EB16A41B for ; Sat, 10 Nov 2007 20:18:31 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.180]) by mx1.freebsd.org (Postfix) with ESMTP id 8330B13C4D9 for ; Sat, 10 Nov 2007 20:18:30 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so386148pyb for ; Sat, 10 Nov 2007 12:18:25 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=8RZhtvNMTxR32h5oGU77qSGb+vpb9vw717Qvr9GiK+c=; b=d6UnhlPFt7Io+xYaFX0hy9g9Z/EHC+DAq9WidkSGMdKsz/KJvxc2x6TPUffgmWK0JAqe7WJKPsOPWH3kKaCR2HZnWNRi+lJ3vy9yZYcceNc2HJn0lKw492BUMWtgbVH+2E+LBPa81abLW8TEgMduZ+/ST7Ur+aUr0t07IIRqG4o= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=PnFtJqPVUySIHsIquCsdJ2FE7rqa2pS372vbnwiHMSy+AKIRSpz4j+HTIuAhOpJSErgq5hqDz7c7arGg7n1Cp9XbGMfZ+6DB3B+CwjVENXtaei9Yzj+OKkr2vhqzKiXPJ38wx930dcS8984Ag4doizorr30Rh2ecJJoIxTbvEEs= Received: by 10.35.90.1 with SMTP id s1mr3776492pyl.1194725903794; Sat, 10 Nov 2007 12:18:23 -0800 (PST) Received: by 10.35.57.12 with HTTP; Sat, 10 Nov 2007 12:18:23 -0800 (PST) Message-ID: <8cb6106e0711101218l532fbd27xb21a03f71cb85975@mail.gmail.com> Date: Sat, 10 Nov 2007 15:18:23 -0500 From: "Josh Carroll" To: "Kris Kennaway" In-Reply-To: <47361134.3050301@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com> <8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com> <47361134.3050301@FreeBSD.org> Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Nov 2007 20:18:31 -0000 > BTW, it doesn't make much sense to be measuring to millisecond precision > a quantity which has variation that is unknown but probably much larger > :) When trying to make comparisons to identify performance changes, a > careful statistical approach is necessary. > > Try the /usr/src/tools/tools/ministat utility for a simple and effective > way to compare these kinds of noisy measurements and extract reliable > comparisons. Thanks Kris! I have been taking an average of 3 values, but this looks extremely useful. I'll go ahead and build the necessary input files for ministat for stock 4BSD and stock ULE from RELENG_7, so I can generate something like the ministat README for future benchmark runs. I'll also increase my number of runs to 5 to provide a better statistical set of data. Appreciate the pointer, I wasn't aware of ministat. :) Thanks! Josh