Date: Sat, 30 Jul 2022 20:43:35 -0400 From: Aryeh Friedman <aryeh.friedman@gmail.com> To: David Christensen <dpchrist@holgerdanske.com> Cc: questions@freebsd.org Subject: Re: OT: Strange interaction between NIC, SSD and motherboard Message-ID: <CAGBxaXn2XKczLki0=hT%2BQrRxK%2BF0idkf_5YTUsmtKVUEU4b-gw@mail.gmail.com> In-Reply-To: <48992616-0875-4a9c-8f87-0b7dbb658ce7@holgerdanske.com> References: <CAGBxaXny=SNkQt3oVL3RCaXcAWLKWxHD-mx=rUsjFtxX7ECAwg@mail.gmail.com> <9b92958b-0b67-0622-f5ec-b145fb8b569c@holgerdanske.com> <CAGBxaX=UyReMCJKzwh%2BqktjQZFTbvfVW4as=TGY9UezK%2ButC=A@mail.gmail.com> <20220730090027.0c5705ab@archlinux> <CAFYkXj=UwVzHEzpK6TVifZYSX3msqb=LL3GVOGoHF9MEJ-hK%2BQ@mail.gmail.com> <20220730140413.3e7fc4c9@archlinux> <20220730141612.4e77eb84@archlinux> <CAGBxaX=_TaWDDhP54gOEQfqFjjd-FPrRdVAYwEiZuCdQOp8HFQ@mail.gmail.com> <20220730231809.5d21787f@archlinux> <CAGBxaXktvym5aikd%2BnGaYkQhs0BaEOaSSRjds7hB0%2Bx7oBFNZw@mail.gmail.com> <48992616-0875-4a9c-8f87-0b7dbb658ce7@holgerdanske.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Sat, Jul 30, 2022 at 7:55 PM David Christensen <dpchrist@holgerdanske.com> wrote: > > On 7/29/22 17:10, Aryeh Friedman wrote: > > >>> I have a MSI Motherboard (DMI info output below) and have two > >>> identical SSD's (one [sata0] with FreeBSD installed and Windows > >>> on the other [sata1]and then I bought a D-Link DGE-560T NIC > >>> (wired 10/100/1000) and soon I connected the NIC the machine > >>> could not see the FreeBSD drive at all (the BIOS that is) even > >>> after swapping cables and SATA connectors. As soon as I took > >>> the NIC out everything returned completely to normal. > > >>> ada0: <SATA SSD SBFM61.3> ACS-4 ATA SATA 3.x device > > >>> Base Board Information > >>> Manufacturer: Micro-Star International Co., Ltd > >>> Product Name: B450 TOMAHAWK (MS-7C02) > > > On Sat, Jul 30, 2022 at 5:18 PM Ralf Mardorf wrote: > > >> maybe the power supply is too weak to power the NIC and the two > >> SSDs or even the NIC and the FreeBSD SSD, without the Windows SSD. > >> The FreeBSD SSD might consume more mA or is somehow more prone to > >> unstable power or connected to another power cable harness, than > >> the Windows SSD. If so, it could explain that swapping SATA cables > >> and SATA ports doesn't change anything. It's not my best guess, > >> it's the only guess ;). Just a shot in the dark! > > > On 7/30/22 14:38, Aryeh Friedman wrote: > > > Almost certainly not the case since one of the tests I did was to > > completely disconnect (including power cables) the windows SSD and it > > still didn't see the FreeBSD one regardless of which cable and SATA > > connector I used > > > STFW motherboard > > https://www.msi.com/Motherboard/B450-TOMAHAWK Found nothing even remotely about this problem online > > > STFW NIC > > https://us.dlink.com/en/products/dge-560t-gigabit-desktop-pci-express-adapter I got it specifically because the back of the box said it was compatible with FreeBSD 7/8+ as to my version: FreeBSD neomarx 13.1-STABLE FreeBSD 13.1-STABLE #3 stable/13-n250682-58f49b7da7d: Fri May 6 00:51:39 EDT 2022 root@neomarx:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 And maybe dmesg will help: Copyright (c) 1992-2021 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.1-STABLE #3 stable/13-n250682-58f49b7da7d: Fri May 6 00:51:39 EDT 2022 root@neomarx:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303) VT(vga): resolution 640x480 CPU: AMD Ryzen 5 2600 Six-Core Processor (3400.18-MHz K8-class CPU) Origin="AuthenticAMD" Id=0x800f82 Family=0x17 Model=0x8 Stepping=2 Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT> Features2=0x7ed8320b<SSE3,PCLMULQDQ,MON,SSSE3,FMA,CX16,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND> AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM> AMD Features2=0x35c233ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,SKINIT,WDT,TCE,Topology,PCXC,PNXC,DBE,PL2I,MWAITX> Structured Extended Features=0x209c01a9<FSGSBASE,BMI1,AVX2,SMEP,BMI2,RDSEED,ADX,SMAP,CLFLUSHOPT,SHA> XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES> AMD Extended Feature Extensions ID EBX=0x1007<CLZERO,IRPerf,XSaveErPtr,IBPB> SVM: NP,NRIP,VClean,AFlush,DAssist,NAsids=32768 TSC: P-state invariant, performance statistics real memory = 25769803776 (24576 MB) avail memory = 24905269248 (23751 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <ALASKA A M I > FreeBSD/SMP: Multiprocessor System Detected: 12 CPUs FreeBSD/SMP: 1 package(s) x 2 cache groups x 3 core(s) x 2 hardware threads random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" random: unblocking device. ioapic0 <Version 2.1> irqs 0-23 ioapic1 <Version 2.1> irqs 24-55 Launching APs: 10 6 1 11 7 3 2 8 9 5 4 random: entropy device external interface kbd1 at kbdmux0 nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms 510.60.02 Wed Mar 16 11:03:12 UTC 2022 vtvga0: <VT VGA driver> smbios0: <System Management BIOS> at iomem 0xf05d0-0xf05ee smbios0: Version: 2.8, BCD Revision: 2.8 aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256> acpi0: <ALASKA A M I > acpi0: Power Button (fixed) cpu0: <ACPI CPU> on acpi0 attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff irq 0,8 on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 Event timer "HPET" frequency 14318180 Hz quality 350 Event timer "HPET1" frequency 14318180 Hz quality 350 Event timer "HPET2" frequency 14318180 Hz quality 350 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pci0: <base peripheral, IOMMU> at device 0.2 (no driver attached) pcib1: <ACPI PCI-PCI bridge> at device 1.3 on pci0 pci1: <ACPI PCI bus> on pcib1 xhci0: <XHCI (generic) USB 3.0 controller> mem 0xf73a0000-0xf73a7fff irq 32 at device 0.0 on pci1 xhci0: 32 bytes context size, 64-bit DMA usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 ahci0: <AHCI SATA controller> mem 0xf7380000-0xf739ffff irq 33 at device 0.1 on pci1 ahci0: AHCI v1.31 with 8 6Gbps ports, Port Multiplier supported ahcich0: <AHCI channel> at channel 0 on ahci0 ahcich1: <AHCI channel> at channel 1 on ahci0 ahcich4: <AHCI channel> at channel 4 on ahci0 ahcich5: <AHCI channel> at channel 5 on ahci0 pcib2: <ACPI PCI-PCI bridge> irq 34 at device 0.2 on pci1 pci2: <ACPI PCI bus> on pcib2 pcib3: <ACPI PCI-PCI bridge> irq 32 at device 0.0 on pci2 pci3: <ACPI PCI bus> on pcib3 pcib4: <ACPI PCI-PCI bridge> irq 33 at device 1.0 on pci2 pci4: <ACPI PCI bus> on pcib4 re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xf000-0xf0ff mem 0xf7204000-0xf7204fff,0xf7200000-0xf7203fff irq 33 at device 0.0 on pci4 re0: Using 1 MSI-X message re0: turning off MSI enable bit. re0: Chip rev. 0x54000000 re0: MAC rev. 0x00100000 miibus0: <MII bus> on re0 rgephy0: <RTL8251/8153 1000BASE-T media interface> PHY 1 on miibus0 rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow re0: Using defaults for TSO: 65518/35/2048 re0: Ethernet address: 00:d8:61:78:d4:9c re0: netmap queues/slots: TX 1/256, RX 1/256 pcib5: <ACPI PCI-PCI bridge> irq 32 at device 4.0 on pci2 pci5: <ACPI PCI bus> on pcib5 vgapci0: <VGA-compatible display> port 0xe000-0xe07f mem 0xf6000000-0xf6ffffff,0xe0000000-0xefffffff,0xf0000000-0xf1ffffff irq 32 at device 0.0 on pci5 nvidia0: <NVIDIA GeForce GT 1030> on vgapci0 vgapci0: child nvidia0 requested pci_enable_io vgapci0: child nvidia0 requested pci_enable_io vgapci0: Boot video device hdac0: <NVIDIA (0x0fb8) HDA Controller> mem 0xf7080000-0xf7083fff irq 33 at device 0.1 on pci5 pcib6: <ACPI PCI-PCI bridge> at device 7.1 on pci0 pci6: <ACPI PCI bus> on pcib6 pci6: <unknown> at device 0.0 (no driver attached) pci6: <encrypt/decrypt> at device 0.2 (no driver attached) xhci1: <XHCI (generic) USB 3.0 controller> mem 0xf7500000-0xf75fffff irq 37 at device 0.3 on pci6 xhci1: 64 bytes context size, 64-bit DMA usbus1 on xhci1 usbus1: 5.0Gbps Super Speed USB v3.0 pcib7: <ACPI PCI-PCI bridge> at device 8.1 on pci0 pci7: <ACPI PCI bus> on pcib7 pci7: <unknown> at device 0.0 (no driver attached) ahci1: <AMD KERNCZ AHCI SATA controller> mem 0xf7808000-0xf7808fff irq 42 at device 0.2 on pci7 ahci1: AHCI v1.31 with 1 6Gbps ports, Port Multiplier supported with FBS ahcich8: <AHCI channel> at channel 0 on ahci1 hdac1: <AMD X370 HDA Controller> mem 0xf7800000-0xf7807fff irq 43 at device 0.3 on pci7 isab0: <PCI-ISA bridge> at device 20.3 on pci0 isa0: <ISA bus> on isab0 acpi_button0: <Power Button> on acpi0 uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbdc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 14. hwpstate0: <Cool`n'Quiet 2.0> on cpu0 Timecounter "TSC-low" frequency 1699999108 Hz quality 1000 Timecounters tick every 1.000 msec hdacc0: <NVIDIA (0x0081) HDA CODEC> at cad 0 on hdac0 hdaa0: <NVIDIA (0x0081) Audio Function Group> at nid 1 on hdacc0 pcm0: <NVIDIA (0x0081) (HDMI/DP 8ch)> at nid 4 on hdaa0 pcm1: <NVIDIA (0x0081) (HDMI/DP 8ch)> at nid 5 on hdaa0 hdacc1: <Realtek ALC892 HDA CODEC> at cad 0 on hdac1 hdaa1: <Realtek ALC892 Audio Function Group> at nid 1 on hdacc1 pcm2: <Realtek ALC892 (Rear Analog 7.1/2.0)> at nid 20,22,21,23 and 24,26 on hdaa1 pcm3: <Realtek ALC892 (Front Analog)> at nid 27 and 25 on hdaa1 ada0 at ahcich0 bus 0 scbus0 target 0 lun 0 ada0: <SATA SSD SBFM61.3> ACS-4 ATA SATA 3.x device ada0: Serial Number 20070110240883 ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada0: Command Queueing enabled ada0: 976762MB (2000409264 512 byte sectors) ada1 at ahcich1 bus 0 scbus1 target 0 lun 0 ada1: <SATA SSD SBFM61.3> ACS-4 ATA SATA 3.x device ada1: Serial Number 19070910240135 ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes) ada1: Command Queueing enabled ada1: 976762MB (2000409264 512 byte sectors) Trying to mount root from ufs:/dev/ada1a [rw]... ugen1.1: <AMD XHCI root HUB> at usbus1 ugen0.1: <AMD XHCI root HUB> at usbus0 uhub0 on usbus1 uhub1 on usbus0 uhub0: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1 uhub1: <AMD XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 intsmb0: <AMD FCH SMBus Controller> at device 20.0 on pci0 smbus0: <System Management Bus> on intsmb0 acpi_wmi0: <ACPI-WMI mapping> on acpi0 acpi_wmi0: cannot find EC device acpi_wmi0: Embedded MOF found ACPI: \134AOD.WQBA: 1 arguments were passed to a non-method ACPI object (Buffer) (20201113/nsarguments-361) driver bug: Unable to set devclass (class: ppc devname: (unknown)) acpi_wmi1: <ACPI-WMI mapping> on acpi0 acpi_wmi1: cannot find EC device acpi_wmi2: <ACPI-WMI mapping> on acpi0 acpi_wmi2: cannot find EC device acpi_wmi2: Embedded MOF found ACPI: \134_SB.WMIC.WQBA: 1 arguments were passed to a non-method ACPI object (Buffer) (20201113/nsarguments-361) lo0: link state changed to UP re0: link state changed to DOWN uhub0: 8 ports with 8 removable, self powered uhub1: 22 ports with 22 removable, self powered ugen0.2: <vendor 0x0409 product 0x005a> at usbus0 uhub2 on uhub1 uhub2: <vendor 0x0409 product 0x005a, class 9/0, rev 2.00/1.00, addr 1> on usbus0 uhub2: 4 ports with 4 removable, self powered ugen0.3: <Logitech USB Keyboard> at usbus0 ukbd0 on uhub2 ukbd0: <USB Keyboard> on usbus0 kbd2 at ukbd0 re0: link state changed to UP ugen0.4: <Logitech USB Optical Mouse> at usbus0 uhid0 on uhub2 uhid0: <USB Keyboard> on usbus0 ums0 on uhub2 ums0: <Logitech USB Optical Mouse, class 0/0, rev 2.00/72.00, addr 3> on usbus0 ums0: 3 buttons and [XYZ] coordinates ID=0 > > > STFW SSD > > "SBFM61.3" appears to be firmware for various brands. What is the make > and model of the SSD's? Please provide URL. It is the store brand of MicroCenter: https://www.microcenter.com/product/508183/inland-professional-1tb-ssd-3d-nand-sata-30-6-gbps-25-inch-7mm-internal-solid-state-drive as you can see from the dmesg output above they only differ in serial number. I was unable to find info about who the OEM is. > > > What version and edition of Windows do you have? 10 with updates through about 2 weeks ago > > > What version and release of FreeBSD do you have? See above > > > Have you tested the power supply with a hardware power supply tester? Don't have access to one but I specifically overpowered the power supply under the assumption I would be adding stuff to the machine over time. > > > Have you disconnected and re-seated the power cables connected to the > motherboard? yes > > > Have you run memtest86+? Passed with flying colors > > > Are you confident in your SATA cables? Yes I even tried two brand new ones > > > If you disconnect everything from the motherboard except for the power > supply, CPU/ heatsink/ fan, memory modules, Windows SSD, keyboard, > mouse, and monitor, and connect the Windows SSD to each motherboard SATA > port in turn, does CMOS Setup see the SSD for every port? Does Windows > boot for every port? What are the results if you repeat these steps > using the FreeBSD SSD? Those are all the connectors I have on the machine (no on-board video so I have to leave the card in) There are 2 16 connector PCI-E slots that the NIC can plug into tried both of them with the same results as above. Yes Windows boots from all ports and FreeBSD is seen from none of them. FreeBSD (my default boot device) will boot from all of them if the NIC is taken out. If the NIC is not present it also will dual boot windows as normal on all ports. > > > If you connect the Windows SSD to the first SATA port and connect the > NIC to each motherboard PCIe slot in turn, does CMOS setup see the NIC > for every slot? Does Windows boot for every slot? Does the NIC work > for every slot? What are the results if you repeat these steps using > the FreeBSD SSD? The CMOS sees all devices in all ports *EXCEPT* the FreeBSD SSD when the NIC is installed. All devices are also 100% functional with the NIC in except of course not seeing FreeBSD at all. -- Aryeh M. Friedman, Lead Developer, http://www.PetiteCloud.org
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGBxaXn2XKczLki0=hT%2BQrRxK%2BF0idkf_5YTUsmtKVUEU4b-gw>