Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 24 Jun 2024 08:37:23 +0000
From:      bugzilla-noreply@freebsd.org
To:        pf@FreeBSD.org
Subject:   [Bug 279830] Using AMD EPYC 9374F 32-Core Processor, PF driver gives error when loading for more than 62 VFs
Message-ID:  <bug-279830-16861-clH3Vggc8I@https.bugs.freebsd.org/bugzilla/>
In-Reply-To: <bug-279830-16861@https.bugs.freebsd.org/bugzilla/>
References:  <bug-279830-16861@https.bugs.freebsd.org/bugzilla/>

next in thread | previous in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D279830

--- Comment #3 from vdubey@maxlinear.com ---
Hi Santiago, Thanks for the response.

I had added more verbose logging for my device.

When num_vfs=3D62. Below is the log:
dre_drv0: DRE_drvIovInit: Called with num_vfs 62.
pcib15: allocated memory range (0xf9000000-0xf93dffff) for rid 254 of dre_d=
rv0
dre_drv0: Lazy allocation of 0x3e0000 bytes rid 0x254 type 3 at 0xf9000000
pcib15: allocated memory range (0xf93e0000-0xf94d7fff) for rid 260 of dre_d=
rv0
dre_drv0: Lazy allocation of 0xf8000 bytes rid 0x260 type 3 at 0xf93e0000
pcib15: allocated memory range (0xf9500000-0xfb3fffff) for rid 264 of dre_d=
rv0
dre_drv0: Lazy allocation of 0x1f00000 bytes rid 0x264 type 3 at 0xf9500000
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D128
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 0.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D129
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 1.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D130
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 2.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D131
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 3.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D132
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 4.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D133
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 5.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D134
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 6.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D135
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 7.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D136
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 8.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D137
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 9.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D138
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 10.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D139
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 11.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D140
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 12.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D141
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 13.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D142
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 14.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D143
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 15.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D144
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 16.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D145
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 17.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D146
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 18.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D147
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 19.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D148
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 20.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D149
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 21.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D150
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 22.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D151
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 23.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D152
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 24.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D153
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 25.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D154
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 26.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D155
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 27.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D156
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 28.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D157
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 29.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D158
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 30.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D159
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 31.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D160
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 32.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D161
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 33.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D162
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 34.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D163
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 35.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D164
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 36.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D165
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 37.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D166
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 38.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D167
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 39.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D168
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 40.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D169
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 41.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D170
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 42.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D171
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 43.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D172
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 44.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D173
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 45.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D174
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 46.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D175
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 47.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D176
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 48.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D177
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 49.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D178
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 50.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D179
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 51.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D180
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 52.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D181
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 53.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D182
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 54.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D183
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 55.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D184
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 56.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D185
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 57.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D186
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 58.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D187
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 59.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D188
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 60.
found-> vendor=3D0x1e43, dev=3D0x8900, revid=3D0x00
        domain=3D0, bus=3D33, slot=3D0, func=3D189
        class=3D12-00-00, hdrtype=3D0x00, mfdev=3D0
        cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords)
        lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns)
        MSI supports 1 message, 64 bit, vector masks
        MSI-X supports 131 messages in map 0x1c
dre_drv0: DRE_drvIovAddVf: Called for vfnum 61.
ppt0 at device 0.128 numa-domain 0 on pci15
ppt0: attached
ppt1 at device 0.129 numa-domain 0 on pci15
ppt1: attached
ppt2 at device 0.130 numa-domain 0 on pci15
ppt2: attached
ppt3 at device 0.131 numa-domain 0 on pci15
ppt3: attached
ppt4 at device 0.132 numa-domain 0 on pci15
ppt4: attached
ppt5 at device 0.133 numa-domain 0 on pci15
ppt5: attached
ppt6 at device 0.134 numa-domain 0 on pci15
ppt6: attached
ppt7 at device 0.135 numa-domain 0 on pci15
ppt7: attached
ppt8 at device 0.136 numa-domain 0 on pci15
ppt8: attached
ppt9 at device 0.137 numa-domain 0 on pci15
ppt9: attached
ppt10 at device 0.138 numa-domain 0 on pci15
ppt10: attached
ppt11 at device 0.139 numa-domain 0 on pci15
ppt11: attached
ppt12 at device 0.140 numa-domain 0 on pci15
ppt12: attached
ppt13 at device 0.141 numa-domain 0 on pci15
ppt13: attached
ppt14 at device 0.142 numa-domain 0 on pci15
ppt14: attached
ppt15 at device 0.143 numa-domain 0 on pci15
ppt15: attached
ppt16 at device 0.144 numa-domain 0 on pci15
ppt16: attached
ppt17 at device 0.145 numa-domain 0 on pci15
ppt17: attached
ppt18 at device 0.146 numa-domain 0 on pci15
ppt18: attached
ppt19 at device 0.147 numa-domain 0 on pci15
ppt19: attached
ppt20 at device 0.148 numa-domain 0 on pci15
ppt20: attached
ppt21 at device 0.149 numa-domain 0 on pci15
ppt21: attached
ppt22 at device 0.150 numa-domain 0 on pci15
ppt22: attached
ppt23 at device 0.151 numa-domain 0 on pci15
ppt23: attached
ppt24 at device 0.152 numa-domain 0 on pci15
ppt24: attached
ppt25 at device 0.153 numa-domain 0 on pci15
ppt25: attached
ppt26 at device 0.154 numa-domain 0 on pci15
ppt26: attached
ppt27 at device 0.155 numa-domain 0 on pci15
ppt27: attached
ppt28 at device 0.156 numa-domain 0 on pci15
ppt28: attached
ppt29 at device 0.157 numa-domain 0 on pci15
ppt29: attached
ppt30 at device 0.158 numa-domain 0 on pci15
ppt30: attached
ppt31 at device 0.159 numa-domain 0 on pci15
ppt31: attached
ppt32 at device 0.160 numa-domain 0 on pci15
ppt32: attached
ppt33 at device 0.161 numa-domain 0 on pci15
ppt33: attached
ppt34 at device 0.162 numa-domain 0 on pci15
ppt34: attached
ppt35 at device 0.163 numa-domain 0 on pci15
ppt35: attached
ppt36 at device 0.164 numa-domain 0 on pci15
ppt36: attached
ppt37 at device 0.165 numa-domain 0 on pci15
ppt37: attached
ppt38 at device 0.166 numa-domain 0 on pci15
ppt38: attached
ppt39 at device 0.167 numa-domain 0 on pci15
ppt39: attached
ppt40 at device 0.168 numa-domain 0 on pci15
ppt40: attached
ppt41 at device 0.169 numa-domain 0 on pci15
ppt41: attached
ppt42 at device 0.170 numa-domain 0 on pci15
ppt42: attached
ppt43 at device 0.171 numa-domain 0 on pci15
ppt43: attached
ppt44 at device 0.172 numa-domain 0 on pci15
ppt44: attached
ppt45 at device 0.173 numa-domain 0 on pci15
ppt45: attached
ppt46 at device 0.174 numa-domain 0 on pci15
ppt46: attached
ppt47 at device 0.175 numa-domain 0 on pci15
ppt47: attached
ppt48 at device 0.176 numa-domain 0 on pci15
ppt48: attached
ppt49 at device 0.177 numa-domain 0 on pci15
ppt49: attached
ppt50 at device 0.178 numa-domain 0 on pci15
ppt50: attached
ppt51 at device 0.179 numa-domain 0 on pci15
ppt51: attached
ppt52 at device 0.180 numa-domain 0 on pci15
ppt52: attached
ppt53 at device 0.181 numa-domain 0 on pci15
ppt53: attached
ppt54 at device 0.182 numa-domain 0 on pci15
ppt54: attached
ppt55 at device 0.183 numa-domain 0 on pci15
ppt55: attached
ppt56 at device 0.184 numa-domain 0 on pci15
ppt56: attached
ppt57 at device 0.185 numa-domain 0 on pci15
ppt57: attached
ppt58 at device 0.186 numa-domain 0 on pci15
ppt58: attached
ppt59 at device 0.187 numa-domain 0 on pci15
ppt59: attached
ppt60 at device 0.188 numa-domain 0 on pci15
ppt60: attached
ppt61 at device 0.189 numa-domain 0 on pci15
ppt61: attached


But, when I set num_vfs=3D64, we get the following log:
dre_drv0: DRE_drvIovInit: Called with num_vfs 64.
pcib15: allocated memory range (0xf9000000-0xf93fffff) for rid 254 of dre_d=
rv0
dre_drv0: Lazy allocation of 0x400000 bytes rid 0x254 type 3 at 0xf9000000
pcib15: allocated memory range (0xf9400000-0xf94fffff) for rid 260 of dre_d=
rv0
dre_drv0: Lazy allocation of 0x100000 bytes rid 0x260 type 3 at 0xf9400000
pcib15: attempting to grow memory window for (0-0xffffffff,0x2000000)
        front candidate range: 0xf7000000-0xf8ffffff
        back candidate range: 0xfb580000-0xfd57ffff
dre_drv0: 0x2000000 bytes of rid 0x264 res 3 failed (0, 0xffffffffffffffff).
dre_drv0: DRE_drvIovUnInit: Called.

Can you give us an idea on what "attempting to grow memory window for
(0-0xffffffff,0x2000000)" is trying to do.

--=20
You are receiving this mail because:
You are the assignee for the bug.=



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-279830-16861-clH3Vggc8I>