From nobody Sun Dec 5 02:27:41 2021 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6D9A41831FFE for ; Sun, 5 Dec 2021 02:36:35 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.org (uucp.dinoex.org [IPv6:2a0b:f840::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "uucp.dinoex.sub.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4J69g61Dv9z3FKW for ; Sun, 5 Dec 2021 02:36:34 +0000 (UTC) (envelope-from pmc@citylink.dinoex.sub.org) Received: from uucp.dinoex.sub.de (uucp.dinoex.org [185.220.148.12]) by uucp.dinoex.org (8.17.1/8.17.1) with ESMTPS id 1B52a5U4026731 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sun, 5 Dec 2021 03:36:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) X-MDaemon-Deliver-To: X-Authentication-Warning: uucp.dinoex.org: Host uucp.dinoex.org [185.220.148.12] claimed to be uucp.dinoex.sub.de Received: (from uucp@localhost) by uucp.dinoex.sub.de (8.17.1/8.17.1/Submit) with UUCP id 1B52a5XJ026730 for freebsd-stable@freebsd.org; Sun, 5 Dec 2021 03:36:05 +0100 (CET) (envelope-from pmc@citylink.dinoex.sub.org) Received: from gate.intra.daemon.contact (gate-e [192.168.98.2]) by citylink.dinoex.sub.de (8.16.1/8.16.1) with ESMTP id 1B52U8YZ037211 for ; Sun, 5 Dec 2021 03:30:08 +0100 (CET) (envelope-from peter@gate.intra.daemon.contact) Received: from gate.intra.daemon.contact (gate-e [192.168.98.2]) by gate.intra.daemon.contact (8.16.1/8.16.1) with ESMTPS id 1B52Rf3P035419 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sun, 5 Dec 2021 03:27:41 +0100 (CET) (envelope-from peter@gate.intra.daemon.contact) Received: (from peter@localhost) by gate.intra.daemon.contact (8.16.1/8.16.1/Submit) id 1B52RfSX035418 for freebsd-stable@freebsd.org; Sun, 5 Dec 2021 03:27:41 +0100 (CET) (envelope-from peter) Date: Sun, 5 Dec 2021 03:27:41 +0100 From: Peter To: freebsd-stable@freebsd.org Subject: 12.3: kernel crash when stopping disks Message-ID: List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable X-Milter: Spamilter (Reciever: uucp.dinoex.sub.de; Sender-ip: 185.220.148.12; Sender-helo: uucp.dinoex.sub.de;) X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.6.4 (uucp.dinoex.org [185.220.148.12]); Sun, 05 Dec 2021 03:36:08 +0100 (CET) X-Rspamd-Queue-Id: 4J69g61Dv9z3FKW X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of pmc@citylink.dinoex.sub.org designates 2a0b:f840::12 as permitted sender) smtp.mailfrom=pmc@citylink.dinoex.sub.org X-Spamd-Result: default: False [-3.12 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.91)[-0.913]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; NEURAL_HAM_SHORT(-0.90)[-0.902]; DMARC_NA(0.00)[sub.org]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:205376, ipnet:2a0b:f840::/32, country:DE]; RCVD_TLS_LAST(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hija, that one doesn' seem to like me.=20 Dec 5 01:08:14 edge gstopd[8837]: da0: 0@Sun Dec 5 01:08= :14 2021=20 Dec 5 01:08:25 edge gstopd[64139]: Error received from stop = unit command Dec 5 01:08:25 edge kernel: ahd0: Recovery Initiated - Card wa= s not paused Dec 5 01:08:25 edge kernel: >>>>>>>>>>>>>>>>>> Dump Card State= Begins <<<<<<<<<<<<<<<<< Dec 5 01:08:25 edge kernel: ahd0: Dumping Card State at progra= m address 0x7e Mode 0x22 Dec 5 01:08:25 edge kernel: INTSTAT[0x0] SELOID[0x0] SELID[0x2= 0] HS_MAILBOX[0x0]=20 Dec 5 01:08:25 edge kernel: INTCTL[0xc0] SEQINTSTAT[0x10] SAVE= D_MODE[0x11] DFFSTAT[0x33]=20 Dec 5 01:08:25 edge kernel: SCSISIGI[0x0] SCSIPHASE[0x0] SCSIB= US[0x0] LASTPHASE[0x1]=20 Dec 5 01:08:25 edge kernel: SCSISEQ0[0x0] SCSISEQ1[0x12] SEQCT= L0[0x0] SEQINTCTL[0x0]=20 Dec 5 01:08:25 edge kernel: SEQ_FLAGS[0xc0] SEQ_FLAGS2[0x0] QF= REEZE_COUNT[0x1b]=20 Dec 5 01:08:25 edge kernel: KERNEL_QFREEZE_COUNT[0x1b] MK_MESS= AGE_SCB[0xff00]=20 Dec 5 01:08:25 edge kernel: MK_MESSAGE_SCSIID[0xff] SSTAT0[0x0= ] SSTAT1[0x8] SSTAT2[0x0]=20 Dec 5 01:08:25 edge kernel: SSTAT3[0x0] PERRDIAG[0x0] SIMODE1[= 0xa4] LQISTAT0[0x0]=20 Dec 5 01:08:25 edge kernel: LQISTAT1[0x0] LQISTAT2[0x0] LQOSTA= T0[0x0] LQOSTAT1[0x0]=20 Dec 5 01:08:25 edge kernel: LQOSTAT2[0x0]=20 Dec 5 01:08:25 edge kernel:=20 Dec 5 01:08:25 edge kernel: SCB Count =3D 512 CMDS_PENDING =3D= 3 LASTSCB 0xf3 CURRSCB 0xf7 NEXTSCB 0xff00 Dec 5 01:08:25 edge kernel: qinstart =3D 17017 qinfifonext =3D= 17017 Dec 5 01:08:25 edge kernel: QINFIFO: Dec 5 01:08:25 edge kernel: WAITING_TID_QUEUES: Dec 5 01:08:25 edge kernel: Pending list: Dec 5 01:08:25 edge kernel: 247 FIFO_USE[0x0] SCB_CONTROL[0x64= ] SCB_SCSIID[0x7]=20 Dec 5 01:08:25 edge kernel: 499 FIFO_USE[0x0] SCB_CONTROL[0x64= ] SCB_SCSIID[0x7]=20 Dec 5 01:08:25 edge kernel: 252 FIFO_USE[0x0] SCB_CONTROL[0x66= ] SCB_SCSIID[0x7]=20 Dec 5 01:08:25 edge kernel: Total 3 Dec 5 01:08:25 edge kernel: Kernel Free SCB lists:=20 Dec 5 01:08:25 edge kernel: COLIDX[0]: 243 503 508=20 Dec 5 01:08:25 edge kernel: Any Device: 254 510 506 250 242 = 498 500 244 507 251 245 501 248 249 504 505 253 502 246 509 497 241 239 495= 240 496 255 511 494 493 492 491 490 489 488 487 486 485 484 483 482 481 48= 0 479 478 477 476 475 474 473 472 471 470 469 468 467 466 465 464 463 462 4= 61 460 459 458 457 456 455 454 453 452 451 450 449 448 447 446 445 444 443 = 442 441 440 439 438 437 436 435 434 433 432 431 430 429 428 427 426 425 424= 423 422 421 420 419 418 417 416 415 414 413 412 411 410 409 408 407 406 40= 5 404 403 402 401 400 399 398 397 396 395 394 393 392 391 390 389 388 387 3= 86 385 384 383 382 381 380 379 378 377 376 375 374 373 372 371 370 369 368 = 367 366 365 364 363 362 361 360 359 358 357 356 355 354 353 352 351 350 349= 348 347 346 345 344 343 342 341 340 339 338 337 336 335 334 333 332 331 33= 0 329 328 327 326 325 324 323 322 321 320 319 318 317 316 315 314 313 312 3= 11 310 309 308 307 306 305 304 303 302 301 300 299 298 297 296 295 294 293 = 292 291 290 289 288 287 286 285 284 283 282 281 280 279 278 277 276 275 274= 273 272 271 270 269 268 267 266 265 264 263 262 261 260 259 258 257 256 23= 8 237 236 235 234 233 232 231 230 229 228 227 226 225 224 223 222 221 220 2= 19 218 217 216 215 214 213 212 211 210 209 208 207 206 205 204 203 202 201 = 200 199 198 197 196 195 194 193 192 191 190 189 188 187 186 185 184 183 182= 181 180 179 178 177 176 175 174 173 172 171 170 169 168 167 166 165 164 16= 3 162 161 160 159 158 157 156 155 154 153 152 151 150 149 148 147 146 145 1= 44 143 142 141 140 139 138 137 136 135 134 133 132 131 130 129 128 127 126 = 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 110 109 108 107= 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 90 89 88 87 86 85 8= 4 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 66 65 64 63 62 61 60 5= 9 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 42 41 40 39 38 37 36 35 3= 4 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 18 17 16 15 14 13 12 11 10 9= 8 7 6 5 4 3 2 1 0=20 Dec 5 01:08:25 edge kernel: Sequencer Complete DMA-inprog list= :=20 Dec 5 01:08:25 edge kernel: Sequencer Complete list:=20 Dec 5 01:08:25 edge kernel: Sequencer DMA-Up and Complete list= :=20 Dec 5 01:08:25 edge kernel: Sequencer On QFreeze and Complete = list:=20 Dec 5 01:08:25 edge kernel:=20 Dec 5 01:08:25 edge syslogd: last message repeated 1 times Dec 5 01:08:25 edge kernel: ahd0: FIFO0 Free, LONGJMP =3D=3D 0= x826c, SCB 0x1fc Dec 5 01:08:25 edge kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCN= TRL[0x0] DFSTATUS[0x89]=20 Dec 5 01:08:25 edge kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0]= DFFSXFRCTL[0x0]=20 Dec 5 01:08:25 edge kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = =3D 0x00, SHCNT =3D 0x0=20 Dec 5 01:08:25 edge kernel: HADDR =3D 0x00, HCNT =3D 0x0 CCSGC= TL[0x10]=20 Dec 5 01:08:25 edge kernel:=20 Dec 5 01:08:25 edge kernel: ahd0: FIFO1 Free, LONGJMP =3D=3D 0= x8254, SCB 0xf7 Dec 5 01:08:25 edge kernel: SEQIMODE[0x3f] SEQINTSRC[0x0] DFCN= TRL[0x4] DFSTATUS[0x89]=20 Dec 5 01:08:25 edge kernel: SG_CACHE_SHADOW[0x2] SG_STATE[0x0]= DFFSXFRCTL[0x0]=20 Dec 5 01:08:25 edge kernel: SOFFCNT[0x0] MDFFSTAT[0x5] SHADDR = =3D 0x00, SHCNT =3D 0x0=20 Dec 5 01:08:25 edge kernel: HADDR =3D 0x00, HCNT =3D 0x0 CCSGC= TL[0x10]=20 Dec 5 01:08:25 edge kernel: LQIN: 0x8 0x0 0x1 0xfc 0x0 0x0 0x0= 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0=20 Dec 5 01:08:25 edge kernel: ahd0: LQISTATE =3D 0x0, LQOSTATE = =3D 0x0, OPTIONMODE =3D 0x52 Dec 5 01:08:25 edge kernel: ahd0: OS_SPACE_CNT =3D 0x20 MAXCMD= CNT =3D 0x1 Dec 5 01:08:25 edge kernel: ahd0: SAVED_SCSIID =3D 0x0 SAVED_L= UN =3D 0x0 Dec 5 01:08:25 edge kernel: SIMODE0[0xc]=20 Dec 5 01:08:25 edge kernel: CCSCBCTL[0x4]=20 Dec 5 01:08:25 edge kernel: ahd0: REG0 =3D=3D 0xf7, SINDEX =3D= 0x1e0, DINDEX =3D 0xe1 Dec 5 01:08:25 edge kernel: ahd0: SCBPTR =3D=3D 0xfff3, SCB_NE= XT =3D=3D 0xff00, SCB_NEXT2 =3D=3D 0xff1e Dec 5 01:08:25 edge kernel: CDB 28 0 0 9a d1 0 Dec 5 01:08:25 edge kernel: STACK: 0x20 0x0 0x0 0x0 0x0 0x0 0x= 0 0x0 Dec 5 01:08:25 edge kernel: <<<<<<<<<<<<<<<<< Dump Card State = Ends >>>>>>>>>>>>>>>>>> Dec 5 01:08:25 edge kernel: (pass0:ahd0:0:0:0): SCB 247 - time= d out Dec 5 01:08:25 edge kernel: (pass0:ahd0:0:0:0): Queuing a BDR = SCB Dec 5 01:08:25 edge kernel: (pass0:ahd0:0:0:0): Bus Device Res= et Message Sent Dec 5 01:08:25 edge kernel: (pass0:ahd0:0:0:0): no longer in t= imeout, status =3D 24b Dec 5 01:08:25 edge kernel: ahd0: Bus Device Reset on A:0. 3 S= CBs aborted Dec 5 01:08:25 edge gstopd[8837]: da1: 0@Sun Dec 5 01:08= :25 2021=20 Dec 5 01:08:35 edge gstopd[64691]: Unit stopped successfully Dec 5 01:08:35 edge gstopd[8837]: da2: 0@Sun Dec 5 01:08= :35 2021=20 Dec 5 01:08:37 edge kernel: (da0:ahd0:0:0:0): READ(10). CDB: 2= 8 00 00 9a d1 00 00 00 08 00=20 Dec 5 01:08:37 edge kernel: (da0:ahd0:0:0:0): CAM status: SCSI= Status Error Dec 5 01:08:37 edge kernel: (da0:ahd0:0:0:0): SCSI status: Che= ck Condition Dec 5 01:08:37 edge kernel: (da0:ahd0:0:0:0): SCSI sense: UNIT= ATTENTION asc:29,3 (Bus device reset function occurred) Dec 5 01:08:37 edge kernel: (da0:ahd0:0:0:0): Retrying command= (per sense data) And then in the vmcore: <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>> (pass0:ahd0:0:0:0): SCB 247 - timed out (pass0:ahd0:0:0:0): Queuing a BDR SCB (pass0:ahd0:0:0:0): Bus Device Reset Message Sent (pass0:ahd0:0:0:0): no longer in timeout, status =3D 24b ahd0: Bus Device Reset on A:0. 3 SCBs aborted (da0:ahd0:0:0:0): READ(10). CDB: 28 00 00 9a d1 00 00 00 08 00=20 (da0:ahd0:0:0:0): CAM status: SCSI Status Error (da0:ahd0:0:0:0): SCSI status: Check Condition (da0:ahd0:0:0:0): SCSI sense: UNIT ATTENTION asc:29,3 (Bus device reset fun= ction occurred) (da0:ahd0:0:0:0): Retrying command (per sense data) Fatal trap 12: page fault while in kernel mode cpuid =3D 1; apic id =3D 01 fault virtual address =3D 0x0 fault code =3D supervisor read data, page not present instruction pointer =3D 0x20:0xffffffff805cb396 stack pointer =3D 0x28:0xfffffe009b2f9a90 frame pointer =3D 0x28:0xfffffe009b2f9b10 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 11 (irq26: ahd0) trap number =3D 12 panic: page fault cpuid =3D 1 time =3D 1638662925 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe009b2f9= 750 vpanic() at vpanic+0x17b/frame 0xfffffe009b2f97a0 panic() at panic+0x43/frame 0xfffffe009b2f9800 trap_fatal() at trap_fatal+0x391/frame 0xfffffe009b2f9860 trap_pfault() at trap_pfault+0x4f/frame 0xfffffe009b2f98b0 trap() at trap+0x4cf/frame 0xfffffe009b2f99c0 calltrap() at calltrap+0x8/frame 0xfffffe009b2f99c0 --- trap 0xc, rip =3D 0xffffffff805cb396, rsp =3D 0xfffffe009b2f9a90, rbp = =3D 0xfffffe009b2f9b10 --- ahd_handle_seqint() at ahd_handle_seqint+0x706/frame 0xfffffe009b2f9b10 ahd_intr() at ahd_intr+0x154/frame 0xfffffe009b2f9b30 ahd_platform_intr() at ahd_platform_intr+0x39/frame 0xfffffe009b2f9b50 ithread_loop() at ithread_loop+0x241/frame 0xfffffe009b2f9bb0 fork_exit() at fork_exit+0x82/frame 0xfffffe009b2f9bf0 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe009b2f9bf0 --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- Uptime: 1h57m36s (da0:ahd0:0:0:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00= =20 (da0:ahd0:0:0:0): CAM status: Command timeout (da0:ahd0:0:0:0): Error 5, Retries exhausted (da0:ahd0:0:0:0): Synchronize cache failed (da1:ahd0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00= =20 (da1:ahd0:0:2:0): CAM status: Command timeout (da1:ahd0:0:2:0): Error 5, Retries exhausted (da1:ahd0:0:2:0): Synchronize cache failed (da2:ahd0:0:4:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00= =20 (da2:ahd0:0:4:0): CAM status: Command timeout (da2:ahd0:0:4:0): Error 5, Retries exhausted (da2:ahd0:0:4:0): Synchronize cache failed