Date: Fri, 13 Nov 2020 17:38:21 +0100 From: martin@vx.sk To: Alexander Motin <mav@freebsd.org> Cc: src-committers@freebsd.org, svn-src-all@freebsd.org, svn-src-stable@freebsd.org, svn-src-stable-12@freebsd.org Subject: Re: svn commit: r367359 - stable/12/sys/dev/pci Message-ID: <20201113173821.Horde.jq1A9wp72tHUvM10uhYxhOq@mail.vx.sk> In-Reply-To: <202011050257.0A52veoR086637@repo.freebsd.org>
index | next in thread | previous in thread | raw e-mail
I am encountering a problem with hw.pci.enable_aspm: System: ASUS RS500A-E10-RS12U CPU: AMD EPYC 7502 32-Core. NVMe drive model: Micron 9300 PRO Number of NVMe drives: 10 Using X2APIC When hw.pci.enable_aspm is enabled, PCIe hot plug of Micron NVMe drives does not work (including detection on boot) and the system reports the following errors for the vast majority of the drives: Nov 13 15:11:30 xxx kernel: pcib9: Timed out waiting for Data Link Layer Active Nov 13 15:12:17 xxx kernel: pcib30: Timed out waiting for Data Link Layer Active Nov 13 15:12:44 xxx kernel: pcib29: Timed out waiting for Data Link Layer Active Nov 13 15:13:04 xxx kernel: pcib11: Timed out waiting for Data Link Layer Active ... Flipping the tunable back to 0 workarounds the problem. Reproduced both on latest head and stable/12. Best regards, mm Quoting Alexander Motin <mav@freebsd.org>: > Author: mav > Date: Thu Nov 5 02:57:40 2020 > New Revision: 367359 > URL: https://svnweb.freebsd.org/changeset/base/367359 > > Log: > MFC r364038: Enable hw.pci.enable_aspm tunable by default. > > While effects on power saving is only a guess, effects on hot-plug are > clearly visible. Lets try to enable it and see what happen. > > Modified: > stable/12/sys/dev/pci/pci.c > Directory Properties: > stable/12/ (props changed) > > Modified: stable/12/sys/dev/pci/pci.c > ============================================================================== > --- stable/12/sys/dev/pci/pci.c Thu Nov 5 02:12:33 2020 > (r367358) > +++ stable/12/sys/dev/pci/pci.c Thu Nov 5 02:57:40 2020 > (r367359) > @@ -411,7 +411,7 @@ static int pci_enable_ari = 1; > SYSCTL_INT(_hw_pci, OID_AUTO, enable_ari, CTLFLAG_RDTUN, &pci_enable_ari, > 0, "Enable support for PCIe Alternative RID Interpretation"); > > -int pci_enable_aspm; > +int pci_enable_aspm = 1; > SYSCTL_INT(_hw_pci, OID_AUTO, enable_aspm, CTLFLAG_RDTUN, > &pci_enable_aspm, 0, "Enable support for PCIe Active State Power > Management");help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20201113173821.Horde.jq1A9wp72tHUvM10uhYxhOq>