From owner-freebsd-drivers@freebsd.org Tue Jan 22 09:32:22 2019 Return-Path: Delivered-To: freebsd-drivers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BCCFE14B5C26; Tue, 22 Jan 2019 09:32:22 +0000 (UTC) (envelope-from shreyankfbsd@gmail.com) Received: from mail-yb1-xb36.google.com (mail-yb1-xb36.google.com [IPv6:2607:f8b0:4864:20::b36]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 94F7A8307E; Tue, 22 Jan 2019 09:32:21 +0000 (UTC) (envelope-from shreyankfbsd@gmail.com) Received: by mail-yb1-xb36.google.com with SMTP id y7so8249704ybg.13; Tue, 22 Jan 2019 01:32:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to:cc; bh=50N+nEgDiRPbL/DP3FElDMi+xWaSrMEkL1zKIznrOqE=; b=pDzZphqLyZ2neIRxZOOvVoJTG8G+8D3YtIALlqUFFisrPli4O771sOlogA118MO7PH c9GNE+EPgX0VKc89tF1JchxzF3lkPLHRJwOPDJTlpB3yUY22OqfyV04hDyP7Y+3qppQW 9DkNybX501/kyPQJ2UzYhn/cdh9uGsVhpOSMTdeJ2H05M4vXXlMNBu5pyOArgN+Az1h6 hHTVzxVk1CNNTauHMLP3O0/Xj+uspxkZkc1YXIw+lx0mN02Lca0hBPLoO6876A4eQu94 BrN9aSGbsT9dG/akkx7r1Lja7u+Br5pFnpSBa4uWDB2kluqtu+MHAKaJINmHL8Kq1FJP V/BA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=50N+nEgDiRPbL/DP3FElDMi+xWaSrMEkL1zKIznrOqE=; b=UxLACAaGQOzqBZIzkMy1XE5ZVRWBwy9dbPr46ZyTrchRT5y8SGnH+t+GJMDEouOLel Zy0mXXK3ACsKBUBXkfGCXSzCyoziyJU/OPf+jbDoYtnWguRjBXwbrf10CWxqNSqx4PWH OAoy3Lu9pxztpdxnRJDqlKD0g0iCEFQRB5luLJwq+LVlOiTWicVwL75f9EFlhic5dXWY tGB5JWhdY/cEpgIbByMV6y29LP0r7eN+FtftgAUctQxz6xkk5cM5PI7E9F3Eu9X3oUjK lNOxjBa7PYWodqWkm0MuXWG2aKP9vKkCWGiH6TeGKRfkD+OAAkw2V85B/SlZE+4vveXp 2DPA== X-Gm-Message-State: AJcUukdM9PxrcweARjmqeiayt0h7WQV2mbCUb4GrXAqqeFvivj7zpMl/ 6x8r3FbLyh5xbYAZGZdzOcZhLCggQxj9jbP5v5C1 X-Google-Smtp-Source: ALg8bN7yTeGKJ8bWFvJ4Gv1nhBnvYXurUTKD0DrdNzSJSOG6F4YsED+bs/wk6tRY1BwdCtWOqLs8kDCAOOG7ZrnP4lM= X-Received: by 2002:a25:8209:: with SMTP id q9mr20266506ybk.21.1548149540897; Tue, 22 Jan 2019 01:32:20 -0800 (PST) MIME-Version: 1.0 From: shreyank amartya Date: Tue, 22 Jan 2019 15:02:09 +0530 Message-ID: Subject: PCIe device performance To: freebsd-hackers@freebsd.org Cc: freebsd-drivers@freebsd.org X-Rspamd-Queue-Id: 94F7A8307E X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=pDzZphqL; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of shreyankfbsd@gmail.com designates 2607:f8b0:4864:20::b36 as permitted sender) smtp.mailfrom=shreyankfbsd@gmail.com X-Spamd-Result: default: False [-6.37 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[6.3.b.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.55)[-0.555,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(-2.81)[ip: (-9.62), ipnet: 2607:f8b0::/32(-2.46), asn: 15169(-1.88), country: US(-0.08)]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-drivers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Writing device drivers for FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Jan 2019 09:32:23 -0000 Hi, I have a PCIe device BAR mapped to a particular region in KVA. I use memcpy to write into that region and measure the transfer rate. Recently, I was able to increase the transfer rate by setting the memory attribute of the BAR mapped region to VM_MEMATTR_WRITE_COMBINING. However, the transfer rate fluctuates wildly and I cannot get a deterministic value. What could be the cause for this? Thanks Shreyank Amartya From owner-freebsd-drivers@freebsd.org Tue Jan 22 13:18:18 2019 Return-Path: Delivered-To: freebsd-drivers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4C6E7148D282; Tue, 22 Jan 2019 13:18:18 +0000 (UTC) (envelope-from babupalit@gmail.com) Received: from mail-qk1-x735.google.com (mail-qk1-x735.google.com [IPv6:2607:f8b0:4864:20::735]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6FDC28C506; Tue, 22 Jan 2019 13:18:17 +0000 (UTC) (envelope-from babupalit@gmail.com) Received: by mail-qk1-x735.google.com with SMTP id y78so14140362qka.12; Tue, 22 Jan 2019 05:18:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=kvBNyxPA/ARzaT4W5l8p7ZX+Lo7eVuyS3Fxsx4ec36E=; b=KV8gU4DxQ8MzCIouRN5Na6lBgSbSAVHMAhTCc2Hokw/hE+zyGnj0fCrmLcU6zTxOZJ eLAUOB3So4sbaH7MNf4j5Qi4/vSHLOd8ZPjymfe7Rfv5yFb+UpoT5WAeJIaoURbLnukc moKGnvhdTLEHb6ea1y+fmNgGjNxEZc6XftyIZIXpcCr0Pg/FTNkL8vUg+2mlnBvb4c+K vWqQiGHHUkDiuQpypSVfwEtbT0BVjQV2vnRKbx4FzFI68N8SQmjUur4ZXV1KyRs7BOm3 iom26YzIydDXZKRHTTLUEmv8kpIbCe2tvFK4BdoNLis5BNQ9/LObRyAoYLo4WQ4f2UHG R0sg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=kvBNyxPA/ARzaT4W5l8p7ZX+Lo7eVuyS3Fxsx4ec36E=; b=WB4uRUAQWRc8iieDpXzd2YkgXt9crVgDf36nHF/Rw7AEZYpMUTdpLMFVoU0+msFSC1 1Bwt10MHthL5WeO9Aeb2C97ry6JXqdCbYPMSuLZrUPTAy0EY+VVAkJHfjlF0MrOcqhZr q8jKemq0NeUPRBFcFdX2vciJoBFJWYNnhXo2D4nqxrd1GTwU8PD/pQlXksduaNYU4ByG rOP9canfDvfkABJtkB+0F8Hv0zE7F30Xk9btzRWe+m4jxGCvN3bprClm2KFO6z6/wOfs 0DJdDIo+s26zEZncdEUikQR3lkQbrsQnvTRiPyBR6tqdoBhwK1fAXJskLVQZLD9pPu2L CJKg== X-Gm-Message-State: AJcUukevXm89tmBBm7bbPmQlVnE+iLYOrkwLlBQ4KZPvC+jtn2k7sWbe Ttg29OEeJNvwfXXglgKkpofJY4yi1LAb27WfzZj/g96FAQg= X-Google-Smtp-Source: ALg8bN7t8btdZlNTm9RKVcw1xwxLrjS3fOQvTKg5ZsTWvvrwggOBck1nlkvaIQoqGQcLjfNKKd/AZ0g0/9TcTe7eadU= X-Received: by 2002:a37:5257:: with SMTP id g84mr28251531qkb.76.1548163096819; Tue, 22 Jan 2019 05:18:16 -0800 (PST) MIME-Version: 1.0 From: Arpan Palit Date: Tue, 22 Jan 2019 18:48:05 +0530 Message-ID: Subject: "panic: softdep_deallocate_dependencies: dangling deps", while runing IO on mounted HDD and doing HDD hot-unplug. To: freebsd-hackers@freebsd.org, freebsd-drivers@freebsd.org X-Rspamd-Queue-Id: 6FDC28C506 X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=KV8gU4Dx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of babupalit@gmail.com designates 2607:f8b0:4864:20::735 as permitted sender) smtp.mailfrom=babupalit@gmail.com X-Spamd-Result: default: False [-6.72 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCVD_IN_DNSWL_NONE(0.00)[5.3.7.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.99)[-0.990,0]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2]; IP_SCORE(-2.72)[ip: (-9.20), ipnet: 2607:f8b0::/32(-2.46), asn: 15169(-1.88), country: US(-0.08)]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-drivers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Writing device drivers for FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Jan 2019 13:18:18 -0000 Hi, I am working on HDD hot-unplug "dangling deps" panic issue. Provided the following steps to recreate and observations when the issue hit. STEP 1. Installed stable/11 freeBSD branch with below commit head. ---------------------------------------------------------------------------------------------------------- commit 7b249ab3e16a3d41d0a58a43d7d89137a1c9ec00 (HEAD -> stable/11, origin/stable/11) Author: delphij Date: Tue Jan 22 04:20:52 2019 +0000 MFC r342856: Added support for the SIOCGI2C ioctl. ---------------------------------------------------------------------------------------------------------- Step 2. Attached HDD and mounted to local file system. Step 3. While IO is running to the mounted device; hot-unplug the device and issue umount command for the mounted device. Observations: =========== -> observed panic as b_ioflags is not to BIO_ERROR and also observed b_error is set to zero. backtrace: -------------- fsync: giving up on dirty (error = 6) 0xfffff8029cbda938: tag devfs, type VCHR usecount 1, writecount 0, refcount 15 rdev 0xfffff80247038400 flags (VI_DOOMED|VI_ACTIVE) v_object 0xfffff80247d320f0 ref 0 pages 95 cleanbuf 10 dirtybuf 2 lock type devfs: EXCL by thread 0xfffff8029c84d620 (pid 774, df, tid 100720) dev ada1p1 panic: softdep_deallocate_dependencies: dangling deps cpuid = 57 KDB: stack backtrace: #0 0xffffffff80b20d27 at kdb_backtrace+0x67 #1 0xffffffff80add3c7 at vpanic+0x177 #2 0xffffffff80add453 at panic+0x43 #3 0xffffffff80d84376 at softdep_deallocate_dependencies+0x76 #4 0xffffffff80b7cd2c at brelse+0x16c #5 0xffffffff80b9bc5d at flushbuflist+0x15d #6 0xffffffff80b9b891 at bufobj_invalbuf+0x81 #7 0xffffffff80b9f06e at vgonel+0x18e #8 0xffffffff80b9f68f at vgone+0x2f #9 0xffffffff809aba42 at devfs_delete+0x1a2 #10 0xffffffff809ac1e2 at devfs_populate_loop+0x2b2 #11 0xffffffff809abf1a at devfs_populate+0x4a #12 0xffffffff809b0dcc at devfs_populate_vp+0x8c #13 0xffffffff809afa0f at devfs_getattr+0x1f #14 0xffffffff810dc8a7 at VOP_GETATTR_APV+0xf7 #15 0xffffffff80bad553 at vn_stat+0xa3 #16 0xffffffff80bab44f at vn_statfile+0x4f #17 0xffffffff80a8a8a9 at kern_fstat+0xa9 -> Also you can find similar issue in the following PR. https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=225423 As I am working on the above issue, Can anyone please provide some solution/suggestion to go forward. Thanks, Arpan From owner-freebsd-drivers@freebsd.org Thu Jan 24 06:13:44 2019 Return-Path: Delivered-To: freebsd-drivers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EADA514C3E0F for ; Thu, 24 Jan 2019 06:13:43 +0000 (UTC) (envelope-from SAMI@info.szwgroup.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 4204383396 for ; Thu, 24 Jan 2019 06:13:43 +0000 (UTC) (envelope-from SAMI@info.szwgroup.com) Received: by mailman.ysv.freebsd.org (Postfix) id 0308E14C3E0E; Thu, 24 Jan 2019 06:13:43 +0000 (UTC) Delivered-To: drivers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B28BB14C3E0D for ; Thu, 24 Jan 2019 06:13:42 +0000 (UTC) (envelope-from SAMI@info.szwgroup.com) Received: from mx177.edm.easidm.com (mx177.edm.easidm.com [118.192.64.177]) by mx1.freebsd.org (Postfix) with ESMTP id 52BA983393 for ; Thu, 24 Jan 2019 06:13:37 +0000 (UTC) (envelope-from SAMI@info.szwgroup.com) From: =?utf-8?B?U0FNSSAyMDE5?= To: Reply-To: Subject: =?utf-8?B?5LiN6Imv6LWE5Lqn56iz5Lit5pyJ5Y2HIOS6n+mcgOaPkOWNh+acieaViOWkhOe9ruaJi+autSBJdCBpcyB1cmdlbnQgdG8gaW1wcm92ZSBlZmZlY3RpdmUgbWVhc3VyZXMgdG8gZGVhbCB3aXRoIG5vbi1wZXJmb3JtaW5nIGFzc2V0cw==?= X-EASEYEUID: 8070228-127646-625-6427 Precedence: bulk X-Easeye-ExpirationDate: 2019-01-31 13:35:25 X-PRECENDENCE: 0 X-Easeye-MailSeq: 45 X-DELAYHEADER: 0-0-1-0 Message-Id: <20190124054827.4389D5D33F8@mx177.edm.easidm.com> Date: Thu, 24 Jan 2019 13:48:27 +0800 (CST) X-Rspamd-Queue-Id: 52BA983393 X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of SAMI@info.szwgroup.com designates 118.192.64.177 as permitted sender) smtp.mailfrom=SAMI@info.szwgroup.com X-Spamd-Result: default: False [2.67 / 15.00]; HAS_REPLYTO(0.00)[brucez@szwgroup.com]; FROM_EXCESS_BASE64(1.50)[]; R_SPF_ALLOW(-0.20)[+ip4:118.192.64.0/24]; MV_CASE(0.50)[]; TO_DN_NONE(0.00)[]; MX_GOOD(-0.01)[cached: mx8.gmail.easeye.com.cn]; MIME_BASE64_TEXT(0.10)[]; RCVD_COUNT_ZERO(0.00)[0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; IP_SCORE(0.20)[asn: 4847(0.98), country: CN(0.04)]; ASN(0.00)[asn:4847, ipnet:118.192.64.0/19, country:CN]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.41)[-0.409,0]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PRECEDENCE_BULK(0.00)[]; DMARC_NA(0.00)[szwgroup.com]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; HAS_LIST_UNSUB(-0.01)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_SPAM_SHORT(0.11)[0.113,0]; NEURAL_SPAM_LONG(0.68)[0.677,0]; RCVD_IN_DNSWL_NONE(0.00)[177.64.192.118.list.dnswl.org : 127.0.10.0]; MIME_HTML_ONLY(0.20)[]; RCVD_TLS_ALL(0.00)[] MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-drivers@freebsd.org X-Mailman-Version: 2.1.29 List-Id: Writing device drivers for FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 24 Jan 2019 06:13:44 -0000