From owner-freebsd-hackers@freebsd.org Fri Sep 21 04:02:42 2018 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E1F1D108A14E for ; Fri, 21 Sep 2018 04:02:41 +0000 (UTC) (envelope-from steevanxperia@gmail.com) Received: from mail-oi0-x235.google.com (mail-oi0-x235.google.com [IPv6:2607:f8b0:4003:c06::235]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 741388CCB7 for ; Fri, 21 Sep 2018 04:02:41 +0000 (UTC) (envelope-from steevanxperia@gmail.com) Received: by mail-oi0-x235.google.com with SMTP id b15-v6so10277529oib.10 for ; Thu, 20 Sep 2018 21:02:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=Oms0VjEDflM2eIybsHGp5516CrAmnHagJBJ2su/Bxyg=; b=HGpjS6FOzk8KWhhRlqPCbuXNh61GsxxVVdG4MP8LVzgR91kpITEcmT8NekeXMXR99a +Rt9HqrP+vI2LzUtTZYwsVGZQQ4Pay9U9a1WMeH6o2Ky5eMbFuha3dEXfRIIno1psZAc 0KjjCeEFv5YrsBUOgvxf9ZnbJkMSq0ar82Equdt+3XZbj04wFn/RXHmwwXG45lu60P4A TXhSBgYEj0sL7NVP0T/gaSackwtA0z8C83Tl6jF5ES2emoV5od3PVNQasWm7439IsgRc n/wHfE8aujNPOQ9YEYcq03T+cj9qgvTo+evTZ961cVive7PLg+8Dv/1nJOc2SMKLREhT tDaQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=Oms0VjEDflM2eIybsHGp5516CrAmnHagJBJ2su/Bxyg=; b=K2bXos4oZ2X3O5qZQcMVA+unpjmEogIP2fztC/ETJk3vamQ+zf+OTbubySW2GjiLwN fj7d847eU0CKjduoOyRbm79WgGQ/gxzeFhsOXUqYMKQNWTVf7qN447y1t1v74OWpOkin geyQzdRxm4DAnX9Oxe4TcaflntF4o3GZO3siGbY4X0teF7OkAP0rkJiGKBgFPP57ST+m L92D+qhc3UQ/rqdNCmcJWOMXKU/1rGjuHw00YnSCDFqsmN/Ebywz14KWJFzBiJSHyvBC xNknJs0prLkgP8MhJKFxZ/gSHPfoapWXmt2VU4bwVwPS6j+RBMIfqnu/m8dW5G6SjVmB vqZg== X-Gm-Message-State: APzg51DF4I0blzAfaymRgDYOnVQkBAvLfj/uOogCXz/xXFeigmsZGLdP uS9tQWu/HjIyzlskCebQlIUoZTpkLFxWLkmXj3uhdYEd X-Google-Smtp-Source: ANB0VdZC97qnbPN5rcW+BSWdXyyb8sz8+abOnq1yDyJ9tUocXUg/5YBk77xBr1qejByNX3oiModAfe2q4rfTOnB6jCI= X-Received: by 2002:aca:5d86:: with SMTP id r128-v6mr506127oib.243.1537502560455; Thu, 20 Sep 2018 21:02:40 -0700 (PDT) MIME-Version: 1.0 From: Steevan Rodrigues Date: Fri, 21 Sep 2018 09:32:35 +0530 Message-ID: Subject: PCI Express card driver load and unload takes too much time ( up to 30 minutes) To: freebsd-hackers@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Sep 2018 04:02:42 -0000 Hello Folks, We have a PCI express card for data processing to achieve 25 to 30 Gbps . Recently we have been facing a issue in one of the server at customer site. System information: Supermicro motherboard-X11DPH-TQ motherboard hw.model: Intel(R) Xeon(R) Gold 5115 CPU @ 2.40GHz ( Dual CPU with total 20 cores) 16 GB RAM In this system the same PCIe card works fine in RHEL 7.5 and the driver load and unload also works fine. Our driver usually takes about 20 seconds to load and approx 20 seconds to unload. However, on this particular system when FreeBSD ( tried with 11.1 and 11.2 Release) is used it takes about 2 to 4 minutes to load and about 8 to 30 minutes to unload. During unload it looks like the system freezes completely and I can not run any commands to find out what is happening . The same driver works fine in our lab servers Dell T620 ( Xeon 12 core CPUs) and desktops with FreeBSD 11.1 and 11.2 and 10.4 . Also I ran couple of Phoronix tests on this SuperMicro server. In one particular test I see that the time taken is too much. The test suite is OsBench. In this, the thread creation test shows average time taken to create threads is 9000 usec . On the other hand we have servers and desktops in our lab and in that this same thread creation takes only 20 to 30 usec . Any pointers about what could be wrong with the system or our PCIe card driver ? Thanks Steevan