From owner-freebsd-infiniband@freebsd.org Sun Nov 13 13:58:22 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F35CDC3FA7D for ; Sun, 13 Nov 2016 13:58:22 +0000 (UTC) (envelope-from menyy@mellanox.com) Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0043.outbound.protection.outlook.com [104.47.1.43]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "Microsoft IT SSL SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 41B301704 for ; Sun, 13 Nov 2016 13:58:21 +0000 (UTC) (envelope-from menyy@mellanox.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=c2zpg9gpm2x706bG0lqbnCtzFM9G3VB3XOFkdS1O8QE=; b=ggE45QJH5I3YO7H9pyPN2v8k1mK4508p5CDzv6ZKgcrxBjJfBhg/vyXnypzUMVBJUDX7P1v2ZOOVoB7XigqOc7aCFdeOSfVsYCE1t470iDnGJ5Z++3RkloHhbUbfXBaoaBH69ncYlGsUoh6AKg4fezMUswa+3GpB+KK2jUfLNu4= Received: from DB5PR05MB1765.eurprd05.prod.outlook.com (10.165.7.23) by DB5PR05MB1381.eurprd05.prod.outlook.com (10.162.157.27) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.707.6; Sun, 13 Nov 2016 13:42:08 +0000 Received: from DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) by DB5PR05MB1765.eurprd05.prod.outlook.com ([10.165.7.23]) with mapi id 15.01.0721.010; Sun, 13 Nov 2016 13:42:08 +0000 From: Meny Yossefi To: =?utf-8?B?Vmluw61jaXVzIEZlcnLDo28=?= , "freebsd-infiniband@freebsd.org" CC: Mark Bloch , Yuval Bason , "Hans Petter Selasky" Subject: RE: Device hints to put mlx4 on IB mode Thread-Topic: Device hints to put mlx4 on IB mode Thread-Index: AQHSOdz2Pcf6O3BBuEK/HEBs92tmQ6DQjJuWgAGWlvCAADpoAIAEj1Zw Date: Sun, 13 Nov 2016 13:42:07 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=menyy@mellanox.com; x-originating-ip: [193.47.165.251] x-microsoft-exchange-diagnostics: 1; DB5PR05MB1381; 7:k79c6xhi+W8wItYBwmHe35J/gdvUMPxpXSHnBbp78MpMVAFzJOrYvsh2jdydN+PAsRdgdYYTs6J0S8ETCz+wCo1kAGh5GpWerR4kJnstcTS4MASQoiAPuJMlvu7hbAOpXtUJ9t7PFGhqEpiNFVeONZPF9DPFutDiAT6fTfyaNDlGHnQZBCwj1M1tYe5TKAOGf88QGxhUie3zfGwW60zJlwu6DBI649u1WFJruj6E4RIJD1lAUlfsdpVjpQYdOddSICbtV0PRX/E7Ba9bJrF5OAIkJsInjMQ4bSyQvn+aoZqgV/yMaGyGpLTSa3cub6z0/tPZfMFIfDmEHRVRtWN+0hagxBTyel+dEtWf7p78tFE= x-ms-office365-filtering-correlation-id: 7139d076-9eb8-43ed-1fb3-08d40bcadcc5 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:(22001);SRVR:DB5PR05MB1381; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(166494164430575)(75325880899374); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046)(6055026); SRVR:DB5PR05MB1381; BCL:0; PCL:0; RULEID:; SRVR:DB5PR05MB1381; x-forefront-prvs: 012570D5A0 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(7916002)(336003)(24454002)(51914003)(51874003)(377454003)(189002)(13464003)(199003)(7846002)(76176999)(54356999)(7696004)(305945005)(66066001)(189998001)(97736004)(50986999)(7736002)(5660300001)(5001770100001)(8676002)(81166006)(74316002)(81156014)(2950100002)(93886004)(3846002)(87936001)(8936002)(105586002)(92566002)(106356001)(4001430100002)(106116001)(33656002)(86362001)(229853002)(76576001)(3660700001)(2501003)(4326007)(2900100001)(77096005)(101416001)(122556002)(3900700001)(68736007)(586003)(107886002)(102836003)(6116002)(9686002)(3280700002)(2906002); DIR:OUT; SFP:1101; SCL:1; SRVR:DB5PR05MB1381; H:DB5PR05MB1765.eurprd05.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Nov 2016 13:42:07.9696 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR05MB1381 X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Nov 2016 13:58:23 -0000 SGksIA0KDQpUaGVyZSdzIGEgdG9vbCBjYWxsZWQgJ21seGNvbmZpZycgd2hpY2ggY2FuIGNoYW5n ZSBwb3J0J3MgdHlwZSwgYnV0IEkgdGhpbmsgaXQgcmVxdWlyZXMgdGhlIGRyaXZlciB0byBiZSBs b2FkZWQsIHNvIG5vIHJlYWwgaGVscCBoZXJlLg0KWW91IGNhbiB0cnkgY29udGFjdGluZyBvdXIg c3VwcG9ydCB0ZWFtIChzdXBwb3J0QG1lbGxhbm94LmNvbSkgYWJvdXQgdGhlIHRvb2wuDQoNCldo aWNoIGtlcm5lbCB2ZXJzaW9uIGFyZSB5b3UgdXNpbmc/IA0KSW4gcmVjZW50IHZlcnNpb25zLCB3 ZSBhZGRlZCBhIHBhdGNoIHRoZSBmb3JjZXMgcG9ydCB0eXBlIHRvIGNvbWUgdXAgYXMgRVRILiAN CkluIHRoYXQgY2FzZSwgY2hhbmdpbmcgaXQgdG8gSUIgd2lsbCBqdXN0IGJlIGEgb25lIGxpbmVy IHRvIG1haW50YWluLiANCg0KDQotTWVueQ0KDQoNCi0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0t DQpGcm9tOiBWaW7DrWNpdXMgRmVycsOjbyBbbWFpbHRvOmZlcnJhb0B2bWlvLmNvbS5icl0gDQpT ZW50OiBUaHVyc2RheSwgTm92ZW1iZXIgMTAsIDIwMTYgNTo0MCBQTQ0KVG86IE1lbnkgWW9zc2Vm aSA8bWVueXlAbWVsbGFub3guY29tPg0KQ2M6IGZyZWVic2QtaW5maW5pYmFuZEBmcmVlYnNkLm9y ZzsgTWFyayBCbG9jaCA8bWFya2JAbWVsbGFub3guY29tPjsgWXV2YWwgQmFzb24gPHl1dmFsYmFA bWVsbGFub3guY29tPjsgSGFucyBQZXR0ZXIgU2VsYXNreSA8aGFuc3NAbWVsbGFub3guY29tPg0K U3ViamVjdDogUmU6IERldmljZSBoaW50cyB0byBwdXQgbWx4NCBvbiBJQiBtb2RlDQoNCkhlbGxv IE1lbnksDQoNClRoYW5rcyBmb3IgdGhlIGlucHV0LiBZb3XigJlyZSByZWNvbW1lbmRpbmcgYSBk cml2ZXIgY29kZSBjaGFuZ2UgdG8gc3RhcnQgYWx3YXlzIG9uIElCIG1vZGUuIFRoaXMgYXBwZWFy cyB0byBiZSBPSywgYnV0IGl0J3MgbGl0dGxlIGRhbmdlcm91cy4gSSB3aWxsIG5lZWQgdG8ga2Vl cCB0aGUgcGF0Y2hlcyBmb3IgdGhlIGRyaXZlcnMvbW9kdWxlcyBpZiBhbnl0aGluZyBjaGFuZ2Vz LCByaWdodD8NCg0KQW5vdGhlciBxdWVzdGlvbiwgY2hhbmdpbmcgdGhlIHN0YXJ0aW5nIG1vZGUg Y2Fubm90IGJlIGRvbmUgaW4gb3RoZXIgcGxhY2U/IExpa2UgdGhlIENvbm5lY3QtWDMgZmlybXdh cmU/IElmIG5vdCwgc2luY2UgeW914oCZcmUgb24gTWVsbGFub3ggY2FuIHdlIHJlY29tbWVuZCBh IGJldHRlciBhcHByb2FjaCBmcm9tIHRoZSB1cHN0cmVhbSAobWx4KSBvciB0aGlzIHdvdWxkIGJl IGludmlhYmxlPw0KDQpUaGFua3MgZm9yIHlvdXIgYXR0ZW50aW9uIGFuZCB0aW1lLCBpdCB3YXMg cmVhbGx5IGhlbHBmdWwuDQoNClYuDQoNCj4gT24gMTAgTm92IDIwMTYsIGF0IDEwOjIxLCBNZW55 IFlvc3NlZmkgPG1lbnl5QG1lbGxhbm94LmNvbT4gd3JvdGU6DQo+IA0KPiBIaSwNCj4gDQo+IEkn bSBub3QgZmFtaWxpYXIgb2YgYW55IGhpbnRzIHBhc3NlZCBmcm9tIHRoZSBib290bG9hZGVyLg0K PiANCj4gV2UgZG8gaGF2ZSBzb21lIEZXIHRvb2xzIHRvIGlkZW50aWZ5IG51bWJlciBvZiBOSUMg cG9ydHMsIGJ1dCBJIGd1ZXNzIHRoYXQgd29uJ3Qgc2VydmUgeW91ciBwdXJwb3NlLg0KPiANCj4g VGhlIG9ubHkgb3B0aW9uIEkgY2FuIHRoaW5rIG9mIGF0IHRoZSBtb21lbnQgaXMgdG8gZm9yY2Ug YWxsIHBvcnRzIHRvIGNvbWUgdXAgaW4gSUIgbW9kZS4NCj4gDQo+IFRyeSB1c2luZyB0aGlzIGFz IHJlZmVyZW5jZTogDQo+IA0KPiBzeXMvb2ZlZC9kcml2ZXJzL25ldC9tbHg0L21haW4uYzoNCj4g DQo+IA0KPiBzdGF0aWMgc3RydWN0IHBhcmFtX2RhdGEgcG9ydF90eXBlX2FycmF5ID0gew0KPiAg ICAgICAgLmRiZGYydmFsID0gew0KPiAgICAgICAgICAgICAgICAubmFtZSAgICAgICAgICAgPSAi cG9ydF90eXBlX2FycmF5IHBhcmFtIiwNCj4gICAgICAgICAgICAgICAgLm51bV92YWxzICAgICAg ID0gMiwNCj4gLSAgICAgICAgICAgLmRlZl92YWwgICAgICAgID0ge01MWDRfUE9SVF9UWVBFX05P TkUsIE1MWDRfUE9SVF9UWVBFX05PTkV9LA0KPiArICAgICAgICAgLmRlZl92YWwgICAgPSB7TUxY NF9QT1JUX1RZUEVfSUIsIE1MWDRfUE9SVF9UWVBFX0lCfSwNCj4gICAgICAgICAgICAgICAgLnJh bmdlICAgICAgICAgID0ge01MWDRfUE9SVF9UWVBFX0lCLCBNTFg0X1BPUlRfVFlQRV9OQX0NCj4g ICAgICAgIH0NCj4gfTsNCj4gQEAgLTc1OSw2ICs3NTksOSBAQCBzdGF0aWMgaW50IG1seDRfZGV2 X2NhcChzdHJ1Y3QgbWx4NF9kZXYgKmRldiwgc3RydWN0IG1seDRfZGV2X2NhcCAqZGV2X2NhcCkN Cj4gICAgICAgICAgICAgICAgICAgICAgICAgKGRldi0+Y2Fwcy5mbGFncyAmIE1MWDRfREVWX0NB UF9GTEFHX0RQRFApICYmDQo+ICAgICAgICAgICAgICAgICAgICAgICAgIChkZXYtPmNhcHMuZmxh Z3MgJiANCj4gTUxYNF9ERVZfQ0FQX0ZMQUdfU0VOU0VfU1VQUE9SVCkpOw0KPiANCj4gKyAgICAg ICAgIC8qIE1ZOiBkaXNhYmxsaW5nIGF1dG8gc2Vuc2UgZm9yIGRlZmF1bHQgSUIvRXRoIHBvcnRz IHN1cHBvcnQgKi8NCj4gKyAgICAgICAgIG1seDRfcHJpdihkZXYpLT5zZW5zZS5zZW5zZV9hbGxv d2VkW2ldID0gMDsNCj4gKw0KPiAgICAgICAgICAgICAgICAvKg0KPiAgICAgICAgICAgICAgICAg KiBJZiAiZGVmYXVsdF9zZW5zZSIgYml0IGlzIHNldCwgd2UgbW92ZSB0aGUgcG9ydCB0byAiQVVU TyIgbW9kZQ0KPiAgICAgICAgICAgICAgICAgKiBhbmQgcGVyZm9ybSBzZW5zZV9wb3J0IEZXIGNv bW1hbmQgdG8gdHJ5IGFuZCBzZXQgdGhlIA0KPiBjb3JyZWN0DQo+IA0KPiAtTWVueQ0KPiANCj4g DQo+IC0tLS0tT3JpZ2luYWwgTWVzc2FnZS0tLS0tDQo+IEZyb206IGZyZWVic2QtY29tbWl0cy10 cmFja2VyDQo+IFNlbnQ6IFdlZG5lc2RheSwgTm92ZW1iZXIgMDksIDIwMTYgMTo1NSBQTQ0KPiBU bzogTWFyayBCbG9jaCA8bWFya2JAbWVsbGFub3guY29tPjsgTWVueSBZb3NzZWZpIA0KPiA8bWVu eXlAbWVsbGFub3guY29tPjsgWXV2YWwgQmFzb24gPHl1dmFsYmFAbWVsbGFub3guY29tPg0KPiBT dWJqZWN0OiBGVzogRGV2aWNlIGhpbnRzIHRvIHB1dCBtbHg0IG9uIElCIG1vZGUNCj4gDQo+IA0K PiANCj4gDQo+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCj4gRnJv bTogb3duZXItZnJlZWJzZC1pbmZpbmliYW5kQGZyZWVic2Qub3JnT24gQmVoYWxmIE9mVmluw61j aXVzIEZlcnLDo28NCj4gU2VudDogVHVlc2RheSwgTm92ZW1iZXIgOCwgMjAxNiA0OjI3OjEzIFBN IChVVEMrMDA6MDApIE1vbnJvdmlhLCANCj4gUmV5a2phdmlrDQo+IFRvOiBmcmVlYnNkLWluZmlu aWJhbmRAZnJlZWJzZC5vcmcNCj4gU3ViamVjdDogRGV2aWNlIGhpbnRzIHRvIHB1dCBtbHg0IG9u IElCIG1vZGUNCj4gDQo+IEhlbGxvIGd1eXMsDQo+IA0KPiBJIHdvdWxkIGxpa2UgdG8gcHV0IG15 IENvbm5lY3QtWDMgY2FyZCBpbiBJQiBtb2RlIGR1cmluZyBib290IHRpbWUgdXNpbmcgZGV2aWNl IGhpbnRzIGluc3RlYWQgb2Ygc3lzY3RsJ3MuDQo+IA0KPiBUb2RheSB3ZSBoYXZlIHRoaXMgZGly dHkgd29ya2Fycm91bmQgb24gL2V0Yy9zeXNjdGwuY29uZjoNCj4gc3lzLmRldmljZS5tbHg0X2Nv cmUwLm1seDRfcG9ydDE9aWINCj4gc3lzLmRldmljZS5tbHg0X2NvcmUwLm1seDRfcG9ydDI9aWIN Cj4gDQo+IEl0J3MgZmluZSB3aGVuIHdlIHVzZSBhIENvbm5lY3QtWDMgY2FyZCB3aXRoIHR3byBJ bmZpbmliYW5kIGludGVyZmFjZXMsIGJ1dCBpZiBhIENvbm5lY3RYLTMgY2FyZCB3aXRoIG9ubHkg b25lIGludGVyZmFjZSBpcyB1c2VkIGFuIGVycm9yIG1lc3NhZ2UgaXMgZHVtcGVkIG9uIHRoZSBj b25zb2xlIGFib3V0IGZhaWxpbmcgdG8gc2V0IHRoZSAic3lzLmRldmljZS5tbHg0X2NvcmUwLm1s eDRfcG9ydDI9aWIiIHN5c2N0bC4NCj4gDQo+IFRvIHNvbHZlIHRoaXMgSSB3b3VsZCBsaWtlIHRv IHVzZSBkZXZpY2UgaGludHMgcGFzc2VkIGZyb20gdGhlIEdSVUIyIGJvb3Rsb2FkZXIsIGJ1dCBJ IHdhcyB1bmFibGUgdG8gZmluZCB3aGljaCBoaW50cyBJIHNob3VsZCB1c2UgZm9yIHRoZSBtbHg0 IGRyaXZlcnMuIEkgZG9uJ3QgZXZlbiBrbm93IGlmIHRoaXMgaXMgc3VwcG9ydGVkLg0KPiANCj4g VGhlIHByb2JsZW0gaXMgcHVyZWx5IGNvc21ldGljLCBJIGp1c3Qgd2FudCB0byBnZXQgcmlkIG9m IHRoZSBlcnJvciBtZXNzYWdlIGR1cmluZyB0aGUgYm9vdCBwcm9jZXNzLg0KPiANCj4gVGhhbmtz IGluIGFkdmFuY2UsDQo+IFYuDQo+IA0KPiANCj4gDQo+IA0KPiBfX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fXw0KPiBmcmVlYnNkLWluZmluaWJhbmRAZnJlZWJz ZC5vcmcgbWFpbGluZyBsaXN0IA0KPiBodHRwczovL2xpc3RzLmZyZWVic2Qub3JnL21haWxtYW4v bGlzdGluZm8vZnJlZWJzZC1pbmZpbmliYW5kDQo+IFRvIHVuc3Vic2NyaWJlLCBzZW5kIGFueSBt YWlsIHRvICJmcmVlYnNkLWluZmluaWJhbmQtdW5zdWJzY3JpYmVAZnJlZWJzZC5vcmciDQo+IF9f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fDQo+IGZyZWVic2Qt aW5maW5pYmFuZEBmcmVlYnNkLm9yZyBtYWlsaW5nIGxpc3QgDQo+IGh0dHBzOi8vbGlzdHMuZnJl ZWJzZC5vcmcvbWFpbG1hbi9saXN0aW5mby9mcmVlYnNkLWluZmluaWJhbmQNCj4gVG8gdW5zdWJz Y3JpYmUsIHNlbmQgYW55IG1haWwgdG8gImZyZWVic2QtaW5maW5pYmFuZC11bnN1YnNjcmliZUBm cmVlYnNkLm9yZyINCg0K From owner-freebsd-infiniband@freebsd.org Sun Nov 13 14:22:36 2016 Return-Path: Delivered-To: freebsd-infiniband@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 607D6C3F22E for ; Sun, 13 Nov 2016 14:22:36 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from meldrar.postgresql.org (meldrar.postgresql.org [IPv6:2a02:c0:301:0:ffff::31]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (Client CN "*.postgresql.org", Issuer "Gandi Standard SSL CA 2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 2392A14DE for ; Sun, 13 Nov 2016 14:22:35 +0000 (UTC) (envelope-from justin@postgresql.org) Received: from 82-69-92-196.dsl.in-addr.zen.co.uk ([82.69.92.196] helo=mac-mini-server.lan) by meldrar.postgresql.org with esmtpsa (TLS1.0:ECDHE_RSA_AES_256_CBC_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1c5vfy-00054N-3y; Sun, 13 Nov 2016 14:22:32 +0000 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: Device hints to put mlx4 on IB mode From: Justin Clift In-Reply-To: Date: Sun, 13 Nov 2016 14:22:26 +0000 Cc: =?utf-8?Q?Vin=C3=ADcius_Ferr=C3=A3o?= , "freebsd-infiniband@freebsd.org" , Mark Bloch , Yuval Bason , Hans Petter Selasky Content-Transfer-Encoding: quoted-printable Message-Id: <5391E407-3C0B-4BD8-990F-4985C18C077A@postgresql.org> References: To: Meny Yossefi X-Mailer: Apple Mail (2.3124) X-Pg-Spam-Score: -2.9 (--) X-BeenThere: freebsd-infiniband@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Infiniband on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 13 Nov 2016 14:22:36 -0000 On 13 Nov 2016, at 13:42, Meny Yossefi wrote: >=20 > Hi,=20 >=20 > There's a tool called 'mlxconfig' which can change port's type, but I = think it requires the driver to be loaded, so no real help here. > You can try contacting our support team (support@mellanox.com) about = the tool. >=20 > Which kernel version are you using?=20 > In recent versions, we added a patch the forces port type to come up = as ETH.=20 > In that case, changing it to IB will just be a one liner to maintain.=20= Another option may be to add a new sysctl. Something to change "all the = ports" instead of changing them one-by-one. Maybe named like: sys.device.mlx4_core0.mlx4_ports=3D"ib" If that would be acceptable for the main FreeBSD source, it wouldn't = have to be manually applied to every build. + Justin -- "My grandfather once told me that there are two kinds of people: those who work and those who take the credit. He told me to try to be in the first group; there was less competition there." - Indira Gandhi