Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 12 Sep 2019 18:50:02 -0000
From:      "Scheffenegger, Richard" <Richard.Scheffenegger@netapp.com>
To:        Randall Stewart <rrs@netflix.com>, Michael Tuexen <tuexen@FreeBSD.org>
Cc:        Lawrence Stewart <lstewart@netflix.com>, Jonathan Looney <jtl@netflix.com>, "freebsd-transport@freebsd.org" <freebsd-transport@freebsd.org>, "Cui, Cheng" <Cheng.Cui@netapp.com>, Tom Jones <thj@freebsd.org>, "bz@freebsd.org" <bz@freebsd.org>, "Eggert, Lars" <lars@netapp.com>
Subject:   RE: reno cwnd growth while app limited...
Message-ID:  <SN4PR0601MB37282B52C38205880B02A81D86B00@SN4PR0601MB3728.namprd06.prod.outlook.com>
In-Reply-To: <E86A08A0-CFB6-4292-ADBD-AEB2E1DAF64C@netflix.com>
References:  <CY4PR0601MB3715561F17C9C213ACFBB61586B10@CY4PR0601MB3715.namprd06.prod.outlook.com> <E86A08A0-CFB6-4292-ADBD-AEB2E1DAF64C@netflix.com>

next in thread | previous in thread | raw e-mail | index | archive | help
TWljaGFlbCwNCg0KDQoNClRoYW5rcyBhIGxvdCBmb3IgcG9pbnRpbmcgb3V0IHRoZSB1cGVyZiB1
dGlsaXR5IC0gdGhpcyBjb3VsZCBiZSBjb25maWd1cmVkIGV4YWN0bHkgaW4gdGhlIHdheSBJIHdh
bnRlZCB0byBkZW1vbnN0cmF0ZSB0aGlzLi4uDQoNCg0KDQpJbiB0aGUgYmVsb3cgZ3JhcGhzLCBJ
IHRyYWNlZCB0aGUgZXZvbHV0aW9uIG9mIGN3bmQgZm9yIGEgZmxvdyBhY3Jvc3MgdGhlIGxvb3Bi
YWNrIGluIGEgVk0uDQoNCg0KDQpUaGUgYXBwbGljYXRpb24gaXMgZG9pbmcgMzA2MCB0aW1lcyAx
MGtCIHdyaXRlcywgMTBtcyBwYXVzaW5nICh3ZWxsIGJlbG93IHRoZSAyMzBtcyBtaW5pbXVtIFRD
UCBpZGxlIHBlcmlvZCksIGFuZCBvbmNlIHRoYXQgcGhhc2UgaXMgb3ZlciwgZmxvb2RzIHRoZSBz
ZXNzaW9uIHdpdGggOHggd3JpdGVzIG9mIDEwTUIgZWFjaC4NCg0KDQoNCkN1cnJlbnRseSwgdGhl
IHN0YWNrIHdpbGwgaW5pdGlhbGx5IGdyb3cgY3duZCB1cCB0byB0aGUgbGltaXQgc2V0IGJ5IHRo
ZSByZWNlaXZlcidzIHdpbmRvdyAoc2V0IHRvIDEuMiBNQikgLSBkdXJpbmcgdGhlIGxvdyBiYW5k
d2lkdGggcmF0ZSBwaGFzZSwgd2hlcmUgbm8gbG9zcyBvY2N1cnMuLi4NCg0KDQoNClRodXMgdGhl
IGFwcGxpY2F0aW9uIGNhbiBzZW5kIG91dCBhIG1hc3NpdmUgYnVyc3Qgb2YgZGF0YSBpbiBhIHNp
bmdsZSBSVFQgKG9yIGF0IGxpbmVyYXRlKSB3aGVuIGl0IGNob29zZXMgdG8gZG8gc28uLi4NCg0K
DQoNCg0KDQpVc2luZyB0aGUgZ3VpZGFuY2UgZ2l2ZW4gYnkgTmV3Q1dWIChSRkM3NjYxKSwgYW5k
IGdyb3dpbmcgY3duZCBvbmx5LCB3aGVuIGZsaWdodHNpemUgaXMgbGFyZ2VyIHRoYW4gaGFsZiBv
ZiBjd25kLCB0aGUgY29uZ2VzdGlvbiB3aW5kb3cgcmVtYWlucyBpbiBtb3JlIHJlYXNvbmFibGUg
cmFuZ2VzIGR1cmluZyB0aGUgYXBwbGljYXRpb24gbGltaXRlZCBwaGFzZSwgdGh1cyBsaW1pdGlu
ZyB0aGUgbWF4aW11bSBidXJzdCBzaXplLg0KDQoNCg0KR3Jvd3RoIG9mIGN3bmQgaW4gU1Mgb3Ig
Q0Egb3RoZXJ3aXNlIGlzIG5vcm1hbCwgYnV0IHRoZSBpbnZlcnNlIGNhc2UgKGFwcGxpY2F0aW9u
IHRyYW5zaXNpb25pbmcgZnJvbSBoaWdoIHRocm91Z2hwdXQgdG8gbG93KSBpcyBub3QgYWRkcmVz
c2VkOyBidXQgSSB3b25kZXIgaWYgYSByZWR1Y3Rpb24gY291bGQgYmUgYWNoaWV2ZWQgd2l0aG91
dCB0aGUgdGltZXIgaW5mcmFzdHJ1Y3R1cmUgZGVzY3JpYmVkIGluIDc2NjEgKGUuZy4gcmVkdWNp
bmcgY3duZCBieSAxIG1zcywgd2hlbiBmbGlnaHRzaXplIGlzIDwgwr0gY3duZCwgd2hpbGUgbm90
IGRvaW5nIHJlY292ZXJ54oCmDQoNCg0KDQpbY2lkOmltYWdlMDA0LnBuZ0AwMUQ1NjlBQi5BMTBC
RDkxMF0NCg0KVW5saW1pdGVkIHNzdGhyZXNoOg0KDQpbY2lkOmltYWdlMDA1LnBuZ0AwMUQ1NjlB
Qi5BMTBCRDkxMF0NCg0KDQoNCg0KDQpbY2lkOmltYWdlMDA5LnBuZ0AwMUQ1NjlBQi5BMTBCRDkx
MF0NCg0KDQoNCg0KDQpSaWNoYXJkIFNjaGVmZmVuZWdnZXINCg0KQ29uc3VsdGluZyBTb2x1dGlv
biBBcmNoaXRlY3QNCg0KTkFTICYgTmV0d29ya2luZw0KDQoNCg0KTmV0QXBwDQoNCis0MyAxIDM2
NzYgODExIDMxNTcgRGlyZWN0IFBob25lDQoNCis0MyA2NjQgODg2NiAxODU3IE1vYmlsZSBQaG9u
ZQ0KDQpSaWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNvbQ0KDQoNCg0KaHR0cHM6Ly90cy5s
YS9yaWNoYXJkNDk4OTINCg0KDQoNCg0KDQotLS0tLU9yaWdpbmFsIE1lc3NhZ2UtLS0tLQ0KRnJv
bTogUmFuZGFsbCBTdGV3YXJ0IDxycnNAbmV0ZmxpeC5jb20+DQpTZW50OiBNaXR0d29jaCwgMTEu
IFNlcHRlbWJlciAyMDE5IDE0OjE4DQpUbzogU2NoZWZmZW5lZ2dlciwgUmljaGFyZCA8UmljaGFy
ZC5TY2hlZmZlbmVnZ2VyQG5ldGFwcC5jb20+DQpDYzogTGF3cmVuY2UgU3Rld2FydCA8bHN0ZXdh
cnRAbmV0ZmxpeC5jb20+OyBNaWNoYWVsIFR1ZXhlbiA8dHVleGVuQEZyZWVCU0Qub3JnPjsgSm9u
YXRoYW4gTG9vbmV5IDxqdGxAbmV0ZmxpeC5jb20+OyBmcmVlYnNkLXRyYW5zcG9ydEBmcmVlYnNk
Lm9yZzsgQ3VpLCBDaGVuZyA8Q2hlbmcuQ3VpQG5ldGFwcC5jb20+OyBUb20gSm9uZXMgPHRoakBm
cmVlYnNkLm9yZz47IGJ6QGZyZWVic2Qub3JnOyBFZ2dlcnQsIExhcnMgPGxhcnNAbmV0YXBwLmNv
bT4NClN1YmplY3Q6IFJlOiByZW5vIGN3bmQgZ3Jvd3RoIHdoaWxlIGFwcCBsaW1pdGVkLi4uDQoN
Cg0KDQpOZXRBcHAgU2VjdXJpdHkgV0FSTklORzogVGhpcyBpcyBhbiBleHRlcm5hbCBlbWFpbC4g
RG8gbm90IGNsaWNrIGxpbmtzIG9yIG9wZW4gYXR0YWNobWVudHMgdW5sZXNzIHlvdSByZWNvZ25p
emUgdGhlIHNlbmRlciBhbmQga25vdyB0aGUgY29udGVudCBpcyBzYWZlLg0KDQoNCg0KDQoNCg0K
DQoNCg0KSW50ZXJlc3RpbmcgZ3JhcGggOikNCg0KDQoNCg0KDQpJIGtub3cgdGhhdCB5ZWFycyBh
Z28gSSBoYWQgYSBkaXNjdXNzaW9uIGFsb25nIHRoZXNlIGxpbmVzICh0YWxraW5nIGFib3V0IGJ1
cnN0LWxpbWl0cykgd2l0aA0KDQpLYWNoZW9uZyBQb29uIGFuZCBNYXJrIEFsbG1hbi4gSUlSUiBL
YWNoZW9uZyBzYWlkLCBhdCB0aGF0IHRpbWUsIHN1biBsaW1pdGVkIHRoZSBjd25kIHRvDQoNCnNv
bWV0aGluZyBsaWtlIDRNU1MgbW9yZSB0aGFuIHRoZSBmbGlnaHQgc2l6ZSAoSSBjb3VsZCBoYXZl
IHRoYXQgbWl4ZWQgdXAgdGhvdWdoIGFuZCBpdCBtaWdodA0KDQpoYXZlIGJlZW4gTWFyayBwcm9w
b3NpbmcgdGhhdC4uIGl0cyBiZWVuIGEgd2hpbGUgc3VuIHdhcyBzdGlsbCBhIGNvbXBhbnkgdGhl
biA6RCkuDQoNCg0KDQpPbiB0aGUgb3RoZXIgaGFuZCBJIGFtIG5vdCBzdXJlIHRoYXQgc3VjaCBh
IHRpZ2h0IGxpbWl0IHRha2VzIGludG8gYWNjb3VudCBhbGwgb2YgdGhlIGFjay1hcnRpZmFjdHMg
dGhhdA0KDQpzZWVtIHRvIGJlIHJhYmlkIGluIHRoZSBpbnRlcm5ldCBub3cuLiAgQkJSIHRvb2sg
dGhlIGFwcHJvYWNoIG9mIGxpbWl0aW5nIGl0cyBjd25kIHRvIDJ4QkRQIChvciBhdA0KDQpsZWFz
dCB3aGF0IGl0IHRob3VnaHQgd2FzIHRoZSBCRFApLi4gd2hpY2ggaXMgbW9yZSBhbG9uZyB0aGUg
bGluZXMgb2YgeW91ciAuNSBpZiBJIGFtIHJlYWRpbmcgeW91IHJpZ2h0Lg0KDQoNCg0KSXQgbWln
aHQgYmUgc29tZXRoaW5nIHdvcnRoIGxvb2tpbmcgaW50byBidXQgSSB3b3VsZCB3YW50IHRvIGNv
bnRlbXBsYXRlIGl0IGZvciBhIHdoaWxlIDopDQoNCg0KDQpSDQoNCg0KDQo+IE9uIFNlcCAxMSwg
MjAxOSwgYXQgODowNCBBTSwgU2NoZWZmZW5lZ2dlciwgUmljaGFyZCA8UmljaGFyZC5TY2hlZmZl
bmVnZ2VyQG5ldGFwcC5jb20+IHdyb3RlOg0KDQo+DQoNCj4gSGksDQoNCj4NCg0KPiBJIHdhcyBq
dXN0IGxvb2tpbmcgYXQgc29tZSBncmFwaCBkYXRhIHJ1bm5pbmcgdHdvIHBhcmFsbGVsIGRjdGNw
IGZsb3dzIGFnYWluc3QgYSBjdWJpYyByZWNlaXZlciAoc29tZSBpbnRlcm5hbCB2YWxpZGF0aW9u
KSB3aXRoIHRyYWRpdGlvbmFsIGVjbiBmZWVkYmFjay4NCg0KPg0KDQo+IDxpbWFnZTAwMi5qcGc+
DQoNCj4NCg0KPg0KDQo+IE5vdywgaW4gdGhlIGJlZ2lubmluZywgYSBzaW5nbGUgZmxvdyBjYW4g
bm90IG92ZXJ1dGlsaXplIHRoZSBsaW5rIGNhcGFjaXR5LCBhbmQgbmV2ZXIgcnVucyBpbnRvIGFu
eSBsb3NzL21hcmvigKYgYnV0IHRoZSBzbmRfY3duZCBncm93cyB1bmJvdW5kZWQgKHNpbmNlIERD
VENQIGlzIHVzaW5nIHRoZSBuZXdyZW5vIOKAnGNjX2Fja19yZWNlaXZlZOKAnSBtZWNoYW5pc20p
Lg0KDQo+DQoNCj4gSG93ZXZlciwgbmV3cmVub19hY2tfcmVjZWl2ZWQgaXMgb25seSB0byBncm93
IHNuZF9jd25kLCB3aGVuIENDRl9DV05EX0xJTUlURUQgaXMgc2V0LCB3aGljaCByZW1haW5zIHNl
dCBhcyBsb25nIGFzIHNuZF9jd25kIDwgc25kX3duZCAodGhlIHJlY2VpdmVyIHNpZ25hbGVkIHJl
Y2VpdmUtd2luZG93KS4NCg0KPg0KDQo+IEJ1dCBpcyB0aGlzIHN0aWxsKiB0aGUgY29ycmVjdCBi
ZWhhdmlvcj8NCg0KPg0KDQo+IFNheSwgdGhlIGRhdGEgZmxvdyByYXRlIGlzIGFwcGxpY2F0aW9u
IGxpbWl0ZWQgKGV2ZXIgbiBtaWxsaXNlY29uZHMsIGEgZmV3IGtCKSwgYW5kIHRoZSByZWNlaXZl
ciBoYXMgYSBsYXJnZSB3aW5kb3cgc2lnbmFsbGVkIOKAkyBjd25kIHdpbGwgZ3JvdyB1bnRpbCBp
dCBtYXRjaGVzIHRoZSByZWNlaXZlcnMgd2luZG93LiBJZiB0aGVuIHRoZSBhcHBsaWNhdGlvbiBj
aG9vc2VzIHRvIG5vIGxvbmdlciByZXN0cmljdCBpdHNlbGYsIGl0IHdvdWxkIHBvc3NpYmx5IGJ1
cnN0IG91dCBzaWduaWZpY2FudGx5IG1vcmUgZGF0YSB0aGFuIHRoZSBxdWV1aW5nIG9mIHRoZSBw
YXRoIGNhbiBoYW5kbGXigKYNCg0KPg0KDQo+IFNvLCBzaG91bGRu4oCZdCB0aGVyZSBiZSBhIHNl
Y29uZCBjb25kaXRpb24gZm9yIGN3bmQgZ3Jvd3RoLCB0aGF0IGUuZy4gcGlwZSAoZmxpZ2h0c2l6
ZSkgaXMgY2xvc2UgdG8gY3duZCAoZmFjdG9yIDAuNSBkdXJpbmcgc2xvdyBzdGFydCwgYW5kIHNh
eSAwLjg1IGR1cmluZyBjb25nZXN0aW9uIGF2b2lkYW5jZSksIHRvIHByZXZlbnQgc3VkZGVuIGxh
cmdlIGJ1cnN0cyB3aGVuIGEgZmxvdyBjb21lcyBvdXQgb2YgYmVpbmcgYXBwbGljYXRpb24gbGlt
aXRlZD8gVGhlIGludGVudGlvbiBoZXJlIHdvdWxkIGJlIHRvIHJlc3RyaWN0IHRoZSB3b3JzdCBj
YXNlIGJ1cnN0IHRoYXQgY291bGQgYmUgc2VudCBvdXQgKHdoaWNoIGlzIGRlYWx0IHdpbGwgZGlm
ZmVyZW50bHkgaW4gb3RoZXIgc3RhY2tzKSwgdG8gaWRlYWxseSBzdGlsbCBmaXQgaW50byB0aGUg
cGF0aOKAmXMgcXVldWVz4oCmDQoNCj4NCg0KPiBSRkM1NjgxIGlzIHNpbGVudCBvbiBhcHBsaWNh
dGlvbiBsaW1pdGVkIGZsb3dzIHRob3VnaCAoYnV0IG9uZSBjb3VsZCB0aGluZyBvZiBhcHBsaWNh
dGlvbiBsaW1pdGluZyBhIGZsb3cgYmVpbmcgYW5vdGhlciBmb3JtIG9mIGNvbmdlc3Rpb24sIGR1
cmluZyB3aGljaCBjd25kIHNob3VsZG7igJl0IGdyb3figKYpDQoNCj4NCg0KPiBJbiB0aGUgZXhh
bXBsZSBhYm92ZSwgZ3Jvd2luZyBjd25kIHVwIHRvIGFib3V0IDUwMCBrQiBhbmQgdGhlbiByZW1h
aW5pbmcgdGhlcmUgc2hvdWxkIGJlIGFwcHJveGltYXRlbHkgdGhlIGV4cGVjdGVkIHNldHRpbmcg
4oCTIGJhc2VkIG9uIHRoZSBhdmVyYWdlIG9mIHR3byBjb21wZXRpbmcgZmxvd3MgaG92ZXJpbmcg
YXQgYXJvdWQgMjAwLTI1MCBrQuKApg0KDQo+DQoNCj4gKikgSeKAmW0gcmVmZXJyaW5nIHRvIHRo
ZSBtdWNoIGhpZ2hlciBsaWtlbGlob29kIG5vd2FkYXlzLCB0aGF0IHRoZSBhcHBsaWNhdGlvbiBp
dHNlbGYgcGFjaW5nIGFuZCB0cmFuc2ZlciB2b2x1bWUgdmlvbGF0ZXMgdGhlIGRlc2lnbiBwcmlu
Y2lwbGUgb2YgVENQLCB3aGVyZSB0aGUgaW1wbGljaXQgYXNzdW1wdGlvbiB3YXMgdGhhdCB0aGUg
c2VuZGVyIGhhcyB1bmxpbWl0ZWQgZGF0YSB0byBzZW5kLCB3aXRoIHRoZSB0aW1pbmcgY29udHJv
bGxlZCBhdCB0aGUgZnVsbCBkaXNncmVzc2lvbiBvZiBUQ1AuDQoNCj4NCg0KPg0KDQo+IFJpY2hh
cmQgU2NoZWZmZW5lZ2dlcg0KDQo+IENvbnN1bHRpbmcgU29sdXRpb24gQXJjaGl0ZWN0DQoNCj4g
TkFTICYgTmV0d29ya2luZw0KDQo+DQoNCj4gTmV0QXBwDQoNCj4gKzQzIDEgMzY3NiA4MTEgMzE1
NyBEaXJlY3QgUGhvbmUNCg0KPiArNDMgNjY0IDg4NjYgMTg1NyBNb2JpbGUgUGhvbmUNCg0KPiBS
aWNoYXJkLlNjaGVmZmVuZWdnZXJAbmV0YXBwLmNvbQ0KDQo+DQoNCj4NCg0KPiA8aW1hZ2UwMDQu
anBnPg0KDQo+DQoNCj4gPGltYWdlMDA2LmpwZz4gPGltYWdlMDEyLmpwZz4NCg0KPiAgI0RhdGFE
cml2ZW4NCg0KPg0KDQo+IGh0dHBzOi8vdHMubGEvcmljaGFyZDQ5ODkyDQoNCg0KDQotLS0tLS0N
Cg0KUmFuZGFsbCBTdGV3YXJ0DQoNCnJyc0BuZXRmbGl4LmNvbQ0KDQoNCg0KDQoNCg0K



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?SN4PR0601MB37282B52C38205880B02A81D86B00>