Date: Mon, 08 May 2023 19:14:21 +0000 From: bugzilla-noreply@freebsd.org To: stable@FreeBSD.org Subject: [Bug 246279] ciss device driver not allowing more than 48 drives to be detected by the CAM layer Message-ID: <bug-246279-1689-uqf570V0PK@https.bugs.freebsd.org/bugzilla/> In-Reply-To: <bug-246279-1689@https.bugs.freebsd.org/bugzilla/> References: <bug-246279-1689@https.bugs.freebsd.org/bugzilla/>
next in thread | previous in thread | raw e-mail | index | archive | help
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246279 --- Comment #23 from Peter Eriksson <pen@lysator.liu.se> --- First test on a server with two HP H241 HBA cards with just 5 disks (in two boxes) running FreeBSD 12.4 with the full ciss.c from Fabricator - works fi= ne.=20 Next I'll test it on another server with 140 disks on two H241 controllers = (70 in each enclosure). root@balur00:/boot # sysctl hw.ciss hw.ciss.force_interrupt: 0 hw.ciss.force_transport: 0 hw.ciss.nop_message_heartbeat: 0 hw.ciss.expose_hidden_physical: 0 hw.ciss.verbose: 2 hw.ciss.base_transfer_speed: 135168 hw.ciss.initiator_id: -1 root@balur00:/boot # egrep ciss /var/run/dmesg.boot=20 ciss0: <HP Smart Array H241> port 0x3000-0x30ff mem 0x95400000-0x954fffff,0x95500000-0x955003ff at device 0.0 numa-domain 0 on = pci5 ciss0: PERFORMANT Transport ciss0: Using 1 MSIX interrupt ciss0: using 1024 of 1024 available commands ciss0: 0 logical drives configured ciss0: firmware 7.00 ciss0: 1 SCSI channels ciss0: 0 FC channels ciss0: 0 enclosures ciss0: 0 expanders ciss0: maximum blocks: 65535 ciss0: controller clock: 18343 ciss0: 256 MB controller memory ciss0: signature 'CISS' ciss0: valence 3 ciss0: supported I/O methods 0x7f000147<READY,simple,performant> ciss0: active I/O method 0x5<performant> ciss0: 4G page base 0x00000000 ciss0: interrupt coalesce delay 0us ciss0: interrupt coalesce count 16 ciss0: max outstanding commands 1024 ciss0: bus types 0x200000 ciss0: server name 'CZ3729EX3D' ciss0: heartbeat 0xb7 ciss0: max logical volumes supported: 64 ciss0: max physical drives supported: 384 ciss0: max physical drives per logical volume: 128 ciss0: JBOD Support is Available ciss0: JBOD Mode is Enabled ciss0: 0 physical devices ciss0: max physical target id: 0 ciss0: 0 logical drives ciss1: <HP Smart Array H241> port 0x2000-0x20ff mem 0x95200000-0x952fffff,0x95300000-0x953003ff at device 0.0 numa-domain 0 on pci11 ciss1: PERFORMANT Transport ciss1: Using 1 MSIX interrupt ciss1: using 1024 of 1024 available commands ciss1: 0 logical drives configured ciss1: firmware 7.00 ciss1: 1 SCSI channels ciss1: 0 FC channels ciss1: 2 enclosures ciss1: 2 expanders ciss1: maximum blocks: 65535 ciss1: controller clock: 18486 ciss1: 256 MB controller memory ciss1: signature 'CISS' ciss1: valence 3 ciss1: supported I/O methods 0x7f000147<READY,simple,performant> ciss1: active I/O method 0x5<performant> ciss1: 4G page base 0x00000000 ciss1: interrupt coalesce delay 0us ciss1: interrupt coalesce count 16 ciss1: max outstanding commands 1024 ciss1: bus types 0x200000 ciss1: server name 'CZ3729EX3D' ciss1: heartbeat 0xb9 ciss1: max logical volumes supported: 64 ciss1: max physical drives supported: 384 ciss1: max physical drives per logical volume: 128 ciss1: JBOD Support is Available ciss1: JBOD Mode is Enabled ciss1: 7 physical devices ciss1: max physical target id: 120 ciss1: 0 logical drives Root mount waiting for:ses0 at ciss1 bus 33 scbus3 target 119 lun 0 ses1 at ciss1 bus 33 scbus3 target 120 lun 0 da2 at ciss1 bus 32 scbus2 target 83 lun 0 da3 at ciss1 bus 32 scbus2 target 84 lun 0 da4 at ciss1 bus 32 scbus2 target 85 lun 0 da1 at ciss1 bus 32 scbus2 target 50 lun 0 uhub3: da0 at ciss1 bus 32 scbus2 target 49 lun 0 root@balur00:/boot # cciss_vol_status -V /dev/ciss1 Controller: Smart HBA H241 Board ID: 0x21c8103c Logical drives: 0 Running firmware: 7.00 ROM firmware: 7.00 Physical drives: 5 connector 1E box 1 bay 34 HP MB010000JWAYK=20= =20=20=20=20=20=20 7PH8MXKG HPD5 OK connector 1E box 1 bay 35 HP MB010000JWAYK=20= =20=20=20=20=20=20 7PH4AJ9G HPD5 OK connector 2E box 1 bay 33 HP MB010000JWAYK=20= =20=20=20=20=20=20 7PH816MG HPD5 OK connector 2E box 1 bay 34 HP MB010000JWAYK=20= =20=20=20=20=20=20 7PH8G5PG HPD5 OK connector 2E box 1 bay 35 HP MB010000JWAYK=20= =20=20=20=20=20=20 7PGTUTHG HPD5 OK /dev/ciss1: (Smart HBA H241) Enclosure D6020 (S/N: 7CE714P009) on Bus 2, Physical Port 1E status: OK. /dev/ciss1: (Smart HBA H241) Enclosure D6020 (S/N: 7CE714P009) on Bus 3, Physical Port 2E status: OK. /dev/ciss1(Smart HBA H241:0): Non-Volatile Cache status: Cache configured: No root@balur00:/boot # sesutil -u /dev/ses0 show ses0: <HPE D6020 2.74>; ID: 5001438030884b80 Desc Dev Model Ident Size/Status {"Name":"Drive bay"} - - - = Not Installed {"Name":"DriveBay1"} - - - = Not Installed {"Name":"DriveBay2"} - - - = Not Installed {"Name":"DriveBay3"} - - - = Not Installed {"Name":"DriveBay4"} - - - = Not Installed {"Name":"DriveBay5"} - - - = Not Installed {"Name":"DriveBay6"} - - - = Not Installed {"Name":"DriveBay7"} - - - = Not Installed {"Name":"DriveBay8"} - - - = Not Installed {"Name":"DriveBay9"} - - - = Not Installed {"Name":"DriveBay10"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay11"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay12"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay13"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay14"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay15"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay16"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay17"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay18"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay19"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay20"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay21"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay22"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay23"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay24"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay25"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay26"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay27"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay28"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay29"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay30"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay31"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay32"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay33"} da2 HP MB010000JWAYK 7PH816MG=20=20= =20=20=20=20=20=20=20=20=20=20 10T {"Name":"DriveBay34"} da3 HP MB010000JWAYK 7PH8G5PG=20=20= =20=20=20=20=20=20=20=20=20=20 10T {"Name":"DriveBay35"} da4 HP MB010000JWAYK 7PGTUTHG=20=20= =20=20=20=20=20=20=20=20=20=20 10T Temperatures: {"Name":"Temperature sensor"} : 42 C, {"Name":"LocalIoModule-Sensor[0]"} : 31 C, {"Name":"LocalIoModule-Sensor[1= ]"}=20 : 38 C, {"Name":"LocalExpander-CpuSensor[0]"} : 42 C, {"Name":"PowerSupply[3]-InletSensor[0]"}: 28 C, {"Name":"PowerSupply[3]-Sensor[0]"} : 32 C, {"Name":"PowerSupply[4]-InletSensor[0]"}: 27 C, {"Name":"PowerSupply[4]-Sensor[0]"} : 31 C, {"Name":"Backplane-Sensor[0]"} = : 25 C, {"Name":"Backplane-Sensor[1]"} : 23 C, {"Name":"Backplane-Sensor[2]"= } : 24 C, {"Name":"Backplane-Sensor[3]"} : 27 C, {"Name":"Backplane-Sensor[4]"= } : 24 C, {"Name":"Backplane-Sensor[5]"} : 23 C, {"Name":"DisplayBoard-Sensor[= 0]"} : 25 C root@balur00:/boot # sesutil -u /dev/ses1 show ses1: <HPE D6020 2.74>; ID: 5001438030894600 Desc Dev Model Ident Size/Status {"Name":"Drive bay"} - - - = Not Installed {"Name":"DriveBay1"} - - - = Not Installed {"Name":"DriveBay2"} - - - = Not Installed {"Name":"DriveBay3"} - - - = Not Installed {"Name":"DriveBay4"} - - - = Not Installed {"Name":"DriveBay5"} - - - = Not Installed {"Name":"DriveBay6"} - - - = Not Installed {"Name":"DriveBay7"} - - - = Not Installed {"Name":"DriveBay8"} - - - = Not Installed {"Name":"DriveBay9"} - - - = Not Installed {"Name":"DriveBay10"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay11"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay12"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay13"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay14"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay15"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay16"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay17"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay18"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay19"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay20"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay21"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay22"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay23"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay24"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay25"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay26"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay27"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay28"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay29"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay30"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay31"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay32"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay33"} - - -=20=20=20=20=20= =20=20=20=20=20=20=20=20=20=20=20=20=20=20 Not Installed {"Name":"DriveBay34"} da0 HP MB010000JWAYK 7PH8MXKG=20=20= =20=20=20=20=20=20=20=20=20=20 10T {"Name":"DriveBay35"} da1 HP MB010000JWAYK 7PH4AJ9G=20=20= =20=20=20=20=20=20=20=20=20=20 10T Temperatures: {"Name":"Temperature sensor"} : 43 C, {"Name":"LocalIoModule-Sensor[0]"} : 34 C, {"Name":"LocalIoModule-Sensor[1= ]"}=20 : 39 C, {"Name":"LocalExpander-CpuSensor[0]"} : 43 C, {"Name":"PowerSupply[1]-InletSensor[0]"}: 32 C, {"Name":"PowerSupply[1]-Sensor[0]"} : 43 C, {"Name":"PowerSupply[2]-InletSensor[0]"}: 33 C, {"Name":"PowerSupply[2]-Sensor[0]"} : 38 C, {"Name":"Backplane-Sensor[0]"} = : 20 C, {"Name":"Backplane-Sensor[1]"} : 20 C, {"Name":"Backplane-Sensor[2]"= } : 22 C, {"Name":"Backplane-Sensor[3]"} : 23 C, {"Name":"Backplane-Sensor[4]"= } : 21 C, {"Name":"Backplane-Sensor[5]"} : 20 C, {"Name":"DisplayBoard-Sensor[= 0]"} : 18 C --=20 You are receiving this mail because: You are on the CC list for the bug.=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?bug-246279-1689-uqf570V0PK>