Date: Thu, 12 Sep 2019 18:50:02 -0000 From: "Scheffenegger, Richard" <Richard.Scheffenegger@netapp.com> To: Randall Stewart <rrs@netflix.com>, Michael Tuexen <tuexen@FreeBSD.org> Cc: Lawrence Stewart <lstewart@netflix.com>, Jonathan Looney <jtl@netflix.com>, "freebsd-transport@freebsd.org" <freebsd-transport@freebsd.org>, "Cui, Cheng" <Cheng.Cui@netapp.com>, Tom Jones <thj@freebsd.org>, "bz@freebsd.org" <bz@freebsd.org>, "Eggert, Lars" <lars@netapp.com> Subject: RE: reno cwnd growth while app limited... Message-ID: <SN4PR0601MB37282B52C38205880B02A81D86B00@SN4PR0601MB3728.namprd06.prod.outlook.com> In-Reply-To: <E86A08A0-CFB6-4292-ADBD-AEB2E1DAF64C@netflix.com> References: <CY4PR0601MB3715561F17C9C213ACFBB61586B10@CY4PR0601MB3715.namprd06.prod.outlook.com> <E86A08A0-CFB6-4292-ADBD-AEB2E1DAF64C@netflix.com>
next in thread | previous in thread | raw e-mail | index | archive | help
TWljaGFlbCwNCg0KDQoNClRoYW5rcyBhIGxvdCBmb3IgcG9pbnRpbmcgb3V0IHRoZSB1cGVyZiB1 dGlsaXR5IC0gdGhpcyBjb3VsZCBiZSBjb25maWd1cmVkIGV4YWN0bHkgaW4gdGhlIHdheSBJIHdh bnRlZCB0byBkZW1vbnN0cmF0ZSB0aGlzLi4uDQoNCg0KDQpJbiB0aGUgYmVsb3cgZ3JhcGhzLCBJ IHRyYWNlZCB0aGUgZXZvbHV0aW9uIG9mIGN3bmQgZm9yIGEgZmxvdyBhY3Jvc3MgdGhlIGxvb3Bi YWNrIGluIGEgVk0uDQoNCg0KDQpUaGUgYXBwbGljYXRpb24gaXMgZG9pbmcgMzA2MCB0aW1lcyAx MGtCIHdyaXRlcywgMTBtcyBwYXVzaW5nICh3ZWxsIGJlbG93IHRoZSAyMzBtcyBtaW5pbXVtIFRD UCBpZGxlIHBlcmlvZCksIGFuZCBvbmNlIHRoYXQgcGhhc2UgaXMgb3ZlciwgZmxvb2RzIHRoZSBz ZXNzaW9uIHdpdGggOHggd3JpdGVzIG9mIDEwTUIgZWFjaC4NCg0KDQoNCkN1cnJlbnRseSwgdGhl IHN0YWNrIHdpbGwgaW5pdGlhbGx5IGdyb3cgY3duZCB1cCB0byB0aGUgbGltaXQgc2V0IGJ5IHRo ZSByZWNlaXZlcidzIHdpbmRvdyAoc2V0IHRvIDEuMiBNQikgLSBkdXJpbmcgdGhlIGxvdyBiYW5k d2lkdGggcmF0ZSBwaGFzZSwgd2hlcmUgbm8gbG9zcyBvY2N1cnMuLi4NCg0KDQoNClRodXMgdGhl IGFwcGxpY2F0aW9uIGNhbiBzZW5kIG91dCBhIG1hc3NpdmUgYnVyc3Qgb2YgZGF0YSBpbiBhIHNp bmdsZSBSVFQgKG9yIGF0IGxpbmVyYXRlKSB3aGVuIGl0IGNob29zZXMgdG8gZG8gc28uLi4NCg0K DQoNCg0KDQpVc2luZyB0aGUgZ3VpZGFuY2UgZ2l2ZW4gYnkgTmV3Q1dWIChSRkM3NjYxKSwgYW5k IGdyb3dpbmcgY3duZCBvbmx5LCB3aGVuIGZsaWdodHNpemUgaXMgbGFyZ2VyIHRoYW4gaGFsZiBv ZiBjd25kLCB0aGUgY29uZ2VzdGlvbiB3aW5kb3cgcmVtYWlucyBpbiBtb3JlIHJlYXNvbmFibGUg cmFuZ2VzIGR1cmluZyB0aGUgYXBwbGljYXRpb24gbGltaXRlZCBwaGFzZSwgdGh1cyBsaW1pdGlu ZyB0aGUgbWF4aW11bSBidXJzdCBzaXplLg0KDQoNCg0KR3Jvd3RoIG9mIGN3bmQgaW4gU1Mgb3Ig Q0Egb3RoZXJ3aXNlIGlzIG5vcm1hbCwgYnV0IHRoZSBpbnZlcnNlIGNhc2UgKGFwcGxpY2F0aW9u IHRyYW5zaXNpb25pbmcgZnJvbSBoaWdoIHRocm91Z2hwdXQgdG8gbG93KSBpcyBub3QgYWRkcmVz c2VkOyBidXQgSSB3b25kZXIgaWYgYSByZWR1Y3Rpb24gY291bGQgYmUgYWNoaWV2ZWQgd2l0aG91 dCB0aGUgdGltZXIgaW5mcmFzdHJ1Y3R1cmUgZGVzY3JpYmVkIGluIDc2NjEgKGUuZy4gcmVkdWNp bmcgY3duZCBieSAxIG1zcywgd2hlbiBmbGlnaHRzaXplIGlzIDwgwr0gY3duZCwgd2hpbGUgbm90 IGRvaW5nIHJlY292ZXJ54oCmDQoNCg0KDQpbY2lkOmltYWdlMDA0LnBuZ0AwMUQ1NjlBQi5BMTBC RDkxMF0NCg0KVW5saW1pdGVkIHNzdGhyZXNoOg0KDQpbY2lkOmltYWdlMDA1LnBuZ0AwMUQ1NjlB Qi5BMTBCRDkxMF0NCg0KDQoNCg0KDQpbY2lkOmltYWdlMDA5LnBuZ0AwMUQ1NjlBQi5BMTBCRDkx MF0NCg0KDQoNCg0KDQpSaWNoYXJkIFNjaGVmZmVuZWdnZXINCg0KQ29uc3VsdGluZyBTb2x1dGlv biBBcmNoaXRlY3QNCg0KTkFTICYgTmV0d29ya2luZw0KDQoNCg0KTmV0QXBwDQoNCis0MyAxIDM2 NzYgODExIDMxNTcgRGlyZWN0IFBob25lDQoNCis0MyA2NjQgODg2NiAxODU3IE1vYmlsZSBQaG9u ZQ0KDQpSaWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNvbQ0KDQoNCg0KaHR0cHM6Ly90cy5s YS9yaWNoYXJkNDk4OTINCg0KDQoNCg0KDQotLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KRnJv bTogUmFuZGFsbCBTdGV3YXJ0IDxycnNAbmV0ZmxpeC5jb20+DQpTZW50OiBNaXR0d29jaCwgMTEu IFNlcHRlbWJlciAyMDE5IDE0OjE4DQpUbzogU2NoZWZmZW5lZ2dlciwgUmljaGFyZCA8UmljaGFy ZC5TY2hlZmZlbmVnZ2VyQG5ldGFwcC5jb20+DQpDYzogTGF3cmVuY2UgU3Rld2FydCA8bHN0ZXdh cnRAbmV0ZmxpeC5jb20+OyBNaWNoYWVsIFR1ZXhlbiA8dHVleGVuQEZyZWVCU0Qub3JnPjsgSm9u YXRoYW4gTG9vbmV5IDxqdGxAbmV0ZmxpeC5jb20+OyBmcmVlYnNkLXRyYW5zcG9ydEBmcmVlYnNk Lm9yZzsgQ3VpLCBDaGVuZyA8Q2hlbmcuQ3VpQG5ldGFwcC5jb20+OyBUb20gSm9uZXMgPHRoakBm cmVlYnNkLm9yZz47IGJ6QGZyZWVic2Qub3JnOyBFZ2dlcnQsIExhcnMgPGxhcnNAbmV0YXBwLmNv bT4NClN1YmplY3Q6IFJlOiByZW5vIGN3bmQgZ3Jvd3RoIHdoaWxlIGFwcCBsaW1pdGVkLi4uDQoN Cg0KDQpOZXRBcHAgU2VjdXJpdHkgV0FSTklORzogVGhpcyBpcyBhbiBleHRlcm5hbCBlbWFpbC4g RG8gbm90IGNsaWNrIGxpbmtzIG9yIG9wZW4gYXR0YWNobWVudHMgdW5sZXNzIHlvdSByZWNvZ25p emUgdGhlIHNlbmRlciBhbmQga25vdyB0aGUgY29udGVudCBpcyBzYWZlLg0KDQoNCg0KDQoNCg0K DQoNCg0KSW50ZXJlc3RpbmcgZ3JhcGggOikNCg0KDQoNCg0KDQpJIGtub3cgdGhhdCB5ZWFycyBh Z28gSSBoYWQgYSBkaXNjdXNzaW9uIGFsb25nIHRoZXNlIGxpbmVzICh0YWxraW5nIGFib3V0IGJ1 cnN0LWxpbWl0cykgd2l0aA0KDQpLYWNoZW9uZyBQb29uIGFuZCBNYXJrIEFsbG1hbi4gSUlSUiBL YWNoZW9uZyBzYWlkLCBhdCB0aGF0IHRpbWUsIHN1biBsaW1pdGVkIHRoZSBjd25kIHRvDQoNCnNv bWV0aGluZyBsaWtlIDRNU1MgbW9yZSB0aGFuIHRoZSBmbGlnaHQgc2l6ZSAoSSBjb3VsZCBoYXZl IHRoYXQgbWl4ZWQgdXAgdGhvdWdoIGFuZCBpdCBtaWdodA0KDQpoYXZlIGJlZW4gTWFyayBwcm9w b3NpbmcgdGhhdC4uIGl0cyBiZWVuIGEgd2hpbGUgc3VuIHdhcyBzdGlsbCBhIGNvbXBhbnkgdGhl biA6RCkuDQoNCg0KDQpPbiB0aGUgb3RoZXIgaGFuZCBJIGFtIG5vdCBzdXJlIHRoYXQgc3VjaCBh IHRpZ2h0IGxpbWl0IHRha2VzIGludG8gYWNjb3VudCBhbGwgb2YgdGhlIGFjay1hcnRpZmFjdHMg dGhhdA0KDQpzZWVtIHRvIGJlIHJhYmlkIGluIHRoZSBpbnRlcm5ldCBub3cuLiAgQkJSIHRvb2sg dGhlIGFwcHJvYWNoIG9mIGxpbWl0aW5nIGl0cyBjd25kIHRvIDJ4QkRQIChvciBhdA0KDQpsZWFz dCB3aGF0IGl0IHRob3VnaHQgd2FzIHRoZSBCRFApLi4gd2hpY2ggaXMgbW9yZSBhbG9uZyB0aGUg bGluZXMgb2YgeW91ciAuNSBpZiBJIGFtIHJlYWRpbmcgeW91IHJpZ2h0Lg0KDQoNCg0KSXQgbWln aHQgYmUgc29tZXRoaW5nIHdvcnRoIGxvb2tpbmcgaW50byBidXQgSSB3b3VsZCB3YW50IHRvIGNv bnRlbXBsYXRlIGl0IGZvciBhIHdoaWxlIDopDQoNCg0KDQpSDQoNCg0KDQo+IE9uIFNlcCAxMSwg MjAxOSwgYXQgODowNCBBTSwgU2NoZWZmZW5lZ2dlciwgUmljaGFyZCA8UmljaGFyZC5TY2hlZmZl bmVnZ2VyQG5ldGFwcC5jb20+IHdyb3RlOg0KDQo+DQoNCj4gSGksDQoNCj4NCg0KPiBJIHdhcyBq dXN0IGxvb2tpbmcgYXQgc29tZSBncmFwaCBkYXRhIHJ1bm5pbmcgdHdvIHBhcmFsbGVsIGRjdGNw IGZsb3dzIGFnYWluc3QgYSBjdWJpYyByZWNlaXZlciAoc29tZSBpbnRlcm5hbCB2YWxpZGF0aW9u KSB3aXRoIHRyYWRpdGlvbmFsIGVjbiBmZWVkYmFjay4NCg0KPg0KDQo+IDxpbWFnZTAwMi5qcGc+ DQoNCj4NCg0KPg0KDQo+IE5vdywgaW4gdGhlIGJlZ2lubmluZywgYSBzaW5nbGUgZmxvdyBjYW4g bm90IG92ZXJ1dGlsaXplIHRoZSBsaW5rIGNhcGFjaXR5LCBhbmQgbmV2ZXIgcnVucyBpbnRvIGFu eSBsb3NzL21hcmvigKYgYnV0IHRoZSBzbmRfY3duZCBncm93cyB1bmJvdW5kZWQgKHNpbmNlIERD VENQIGlzIHVzaW5nIHRoZSBuZXdyZW5vIOKAnGNjX2Fja19yZWNlaXZlZOKAnSBtZWNoYW5pc20p Lg0KDQo+DQoNCj4gSG93ZXZlciwgbmV3cmVub19hY2tfcmVjZWl2ZWQgaXMgb25seSB0byBncm93 IHNuZF9jd25kLCB3aGVuIENDRl9DV05EX0xJTUlURUQgaXMgc2V0LCB3aGljaCByZW1haW5zIHNl dCBhcyBsb25nIGFzIHNuZF9jd25kIDwgc25kX3duZCAodGhlIHJlY2VpdmVyIHNpZ25hbGVkIHJl Y2VpdmUtd2luZG93KS4NCg0KPg0KDQo+IEJ1dCBpcyB0aGlzIHN0aWxsKiB0aGUgY29ycmVjdCBi ZWhhdmlvcj8NCg0KPg0KDQo+IFNheSwgdGhlIGRhdGEgZmxvdyByYXRlIGlzIGFwcGxpY2F0aW9u IGxpbWl0ZWQgKGV2ZXIgbiBtaWxsaXNlY29uZHMsIGEgZmV3IGtCKSwgYW5kIHRoZSByZWNlaXZl ciBoYXMgYSBsYXJnZSB3aW5kb3cgc2lnbmFsbGVkIOKAkyBjd25kIHdpbGwgZ3JvdyB1bnRpbCBp dCBtYXRjaGVzIHRoZSByZWNlaXZlcnMgd2luZG93LiBJZiB0aGVuIHRoZSBhcHBsaWNhdGlvbiBj aG9vc2VzIHRvIG5vIGxvbmdlciByZXN0cmljdCBpdHNlbGYsIGl0IHdvdWxkIHBvc3NpYmx5IGJ1 cnN0IG91dCBzaWduaWZpY2FudGx5IG1vcmUgZGF0YSB0aGFuIHRoZSBxdWV1aW5nIG9mIHRoZSBw YXRoIGNhbiBoYW5kbGXigKYNCg0KPg0KDQo+IFNvLCBzaG91bGRu4oCZdCB0aGVyZSBiZSBhIHNl Y29uZCBjb25kaXRpb24gZm9yIGN3bmQgZ3Jvd3RoLCB0aGF0IGUuZy4gcGlwZSAoZmxpZ2h0c2l6 ZSkgaXMgY2xvc2UgdG8gY3duZCAoZmFjdG9yIDAuNSBkdXJpbmcgc2xvdyBzdGFydCwgYW5kIHNh eSAwLjg1IGR1cmluZyBjb25nZXN0aW9uIGF2b2lkYW5jZSksIHRvIHByZXZlbnQgc3VkZGVuIGxh cmdlIGJ1cnN0cyB3aGVuIGEgZmxvdyBjb21lcyBvdXQgb2YgYmVpbmcgYXBwbGljYXRpb24gbGlt aXRlZD8gVGhlIGludGVudGlvbiBoZXJlIHdvdWxkIGJlIHRvIHJlc3RyaWN0IHRoZSB3b3JzdCBj YXNlIGJ1cnN0IHRoYXQgY291bGQgYmUgc2VudCBvdXQgKHdoaWNoIGlzIGRlYWx0IHdpbGwgZGlm ZmVyZW50bHkgaW4gb3RoZXIgc3RhY2tzKSwgdG8gaWRlYWxseSBzdGlsbCBmaXQgaW50byB0aGUg cGF0aOKAmXMgcXVldWVz4oCmDQoNCj4NCg0KPiBSRkM1NjgxIGlzIHNpbGVudCBvbiBhcHBsaWNh dGlvbiBsaW1pdGVkIGZsb3dzIHRob3VnaCAoYnV0IG9uZSBjb3VsZCB0aGluZyBvZiBhcHBsaWNh dGlvbiBsaW1pdGluZyBhIGZsb3cgYmVpbmcgYW5vdGhlciBmb3JtIG9mIGNvbmdlc3Rpb24sIGR1 cmluZyB3aGljaCBjd25kIHNob3VsZG7igJl0IGdyb3figKYpDQoNCj4NCg0KPiBJbiB0aGUgZXhh bXBsZSBhYm92ZSwgZ3Jvd2luZyBjd25kIHVwIHRvIGFib3V0IDUwMCBrQiBhbmQgdGhlbiByZW1h aW5pbmcgdGhlcmUgc2hvdWxkIGJlIGFwcHJveGltYXRlbHkgdGhlIGV4cGVjdGVkIHNldHRpbmcg 4oCTIGJhc2VkIG9uIHRoZSBhdmVyYWdlIG9mIHR3byBjb21wZXRpbmcgZmxvd3MgaG92ZXJpbmcg YXQgYXJvdWQgMjAwLTI1MCBrQuKApg0KDQo+DQoNCj4gKikgSeKAmW0gcmVmZXJyaW5nIHRvIHRo ZSBtdWNoIGhpZ2hlciBsaWtlbGlob29kIG5vd2FkYXlzLCB0aGF0IHRoZSBhcHBsaWNhdGlvbiBp dHNlbGYgcGFjaW5nIGFuZCB0cmFuc2ZlciB2b2x1bWUgdmlvbGF0ZXMgdGhlIGRlc2lnbiBwcmlu Y2lwbGUgb2YgVENQLCB3aGVyZSB0aGUgaW1wbGljaXQgYXNzdW1wdGlvbiB3YXMgdGhhdCB0aGUg c2VuZGVyIGhhcyB1bmxpbWl0ZWQgZGF0YSB0byBzZW5kLCB3aXRoIHRoZSB0aW1pbmcgY29udHJv bGxlZCBhdCB0aGUgZnVsbCBkaXNncmVzc2lvbiBvZiBUQ1AuDQoNCj4NCg0KPg0KDQo+IFJpY2hh cmQgU2NoZWZmZW5lZ2dlcg0KDQo+IENvbnN1bHRpbmcgU29sdXRpb24gQXJjaGl0ZWN0DQoNCj4g TkFTICYgTmV0d29ya2luZw0KDQo+DQoNCj4gTmV0QXBwDQoNCj4gKzQzIDEgMzY3NiA4MTEgMzE1 NyBEaXJlY3QgUGhvbmUNCg0KPiArNDMgNjY0IDg4NjYgMTg1NyBNb2JpbGUgUGhvbmUNCg0KPiBS aWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNvbQ0KDQo+DQoNCj4NCg0KPiA8aW1hZ2UwMDQu anBnPg0KDQo+DQoNCj4gPGltYWdlMDA2LmpwZz4gPGltYWdlMDEyLmpwZz4NCg0KPiAgI0RhdGFE cml2ZW4NCg0KPg0KDQo+IGh0dHBzOi8vdHMubGEvcmljaGFyZDQ5ODkyDQoNCg0KDQotLS0tLS0N Cg0KUmFuZGFsbCBTdGV3YXJ0DQoNCnJyc0BuZXRmbGl4LmNvbQ0KDQoNCg0KDQoNCg0K
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?SN4PR0601MB37282B52C38205880B02A81D86B00>