From owner-freebsd-hardware@FreeBSD.ORG Tue Sep 30 10:55:04 2003 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4BB3D16A4B3 for ; Tue, 30 Sep 2003 10:55:04 -0700 (PDT) Received: from atlasta.net (wow.atlasta.net [12.129.13.20]) by mx1.FreeBSD.org (Postfix) with SMTP id 9BA9443FE5 for ; Tue, 30 Sep 2003 10:55:03 -0700 (PDT) (envelope-from drais@wow.atlasta.net) Received: (qmail 21910 invoked by uid 1068); 30 Sep 2003 17:55:03 -0000 Received: from localhost (sendmail-bs@127.0.0.1) by localhost with SMTP; 30 Sep 2003 17:55:03 -0000 Date: Tue, 30 Sep 2003 10:55:03 -0700 (PDT) From: David Raistrick To: hardware@freebsd.org Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Subject: SMP and Supermicro, problems! X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Sep 2003 17:55:04 -0000 Folks, My Supermicro 6023P-8R arrived and I've started working with it. 2 2.4Ghz 533FSB Xeons and 512 megs of ram. This has the X5DP8 motherboard. (e7501 chipset) Installed FreeBSD 4.8-RELEASE (development constraints currently restrict this to 4.8-R.) and everything is fine w/o SMP. Hyperthreading /disabled/ in the Bios and NOT enabled in the kernel. Added options SMP and APIC_IO to a generic kernel and rebuilt it. Rebooted to serious problems. I removed my PCI devices just to be sure, and still have the same problems. If anyone has suggestions please let me know. I'm also sending a copy of this message to Supermicro support. Details below: PhoenixBIOS 4.0 Release 6.0 Copyright 1985-2001 Phoenix Technologies Ltd. All Rights Reserved Supermicro X5DP8-G2/X5DPE-G2 BIOS Rev 1.4c The most common error message is: ahd0: Timedout SCB already complete. Interrupts may not be functioning. ahd0: Timedout SCB already complete. Interrupts may not be functioning. em0: watchdog timeout -- resetting em0: watchdog timeout -- resetting The machine usually freezes sometime during the boot, or just after boot, outputing these messages every few minutes. On some boots, I get this message before boot. It eventually repeats, boot never continuing (LONG error message): Waiting 15 seconds for SCSI devices to settle (probe3:ahd0:0:3:0): SCB 0xc - timed out >>>>>>>>>>>>>>>>>> Dump Card State Begins <<<<<<<<<<<<<<<<< ahd0: Dumping Card State at program address 0x10f Mode 0x33 Card was paused HS_MAILBOX[0x0] INTCTL[0x80]:(SWTMINTMASK) SEQINTSTAT[0x0] SAVED_MODE[0x11] DFFSTAT[0x33]:(CURRFIFO_NONE|FIFO0FREE|FIFO1FREE) SCSISIGI[0xb6]:(P_MESGOUT|REQI|BSYI|ATNI) SCSIPHASE[0x0] SCSIBUS[0xc0] LASTPHASE[0xa0]:(P_MESGOUT) SCSISEQ0[0x0] SCSISEQ1[0x12]:(ENAUTOATNP|ENRSELI) SEQCTL0[0x0] SEQINTCTL[0x0] SEQ_FLAGS[0x40]:(NO_CDB_SENT) SEQ_FLAGS2[0x0] SSTAT0[0x2]:(SPIORDY) SSTAT1[0x0] SSTAT2[0x0] SSTAT3[0x0] PERRDIAG[0x0] SIMODE1[0xac]:(ENSCSIPERR|ENBUSFREE|ENSCSIRST|ENSELTIMO) LQISTAT0[0x0] LQISTAT1[0x0] LQISTAT2[0x0] LQOSTAT0[0x0] LQOSTAT1[0x0] LQOSTAT2[0x0] SCB Count = 16 CMDS_PENDING = 1 LASTSCB 0xffff CURRSCB 0xc NEXTSCB 0x0 qinstart = 38 qinfifonext = 39 QINFIFO: 0xf WAITING_TID_QUEUES: Pending list: 15 FIFO_USE[0x0] SCB_CONTROL[0x40]:(DISCENB) SCB_SCSIID[0x7] 12 FIFO_USE[0x0] SCB_CONTROL[0x40]:(DISCENB) SCB_SCSIID[0x37] Total 2 Kernel Free SCB list: 9 1 2 3 4 5 6 7 8 10 11 13 14 0 Sequencer Complete DMA-inprog list: Sequencer Complete list: Sequencer DMA-Up and Complete list: ahd0: FIFO0 Free, LONGJMP == 0x80ff, SCB 0x0 SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVE SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL) SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0] SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0 HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10]:(SG_CACHE_AVAIL) ahd0: FIFO1 Free, LONGJMP == 0x8063, SCB 0xc SEQIMODE[0x3f]:(ENCFG4TCMD|ENCFG4ICMD|ENCFG4TSTAT|ENCFG4ISTAT|ENCFG4DATA|ENSAVE SEQINTSRC[0x0] DFCNTRL[0x0] DFSTATUS[0x89]:(FIFOEMP|HDONE|PRELOAD_AVAIL) SG_CACHE_SHADOW[0x2]:(LAST_SEG) SG_STATE[0x0] DFFSXFRCTL[0x0] SOFFCNT[0x0] MDFFSTAT[0x5]:(FIFOFREE|DLZERO) SHADDR = 0x00, SHCNT = 0x0 HADDR = 0x00, HCNT = 0x0 CCSGCTL[0x10]:(SG_CACHE_AVAIL) LQIN: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0 ahd0: LQISTATE = 0x0, LQOSTATE = 0x0, OPTIONMODE = 0x52 ahd0: OS_SPACE_CNT = 0x20 MAXCMDCNT = 0x0 SIMODE0[0xc]:(ENOVERRUN|ENIOERR) CCSCBCTL[0x4]:(CCSCBDIR) ahd0: REG0 == 0xc, SINDEX = 0x107, DINDEX = 0xe1 ahd0: SCBPTR == 0xc, SCB_NEXT == 0xff00, SCB_NEXT2 == 0xff12 CDB 0 0 0 0 0 0 STACK: 0x0 0x0 0x0 0x0 0x0 0x0 0x0 0x0 <<<<<<<<<<<<<<<<< Dump Card State Ends >>>>>>>>>>>>>>>>>> I have complete boot messages available if anyone needs them, and will be happy to supply any other information you folks need. FWIW, I tried a ~Aug 8 2003 -STABLE kernel with SMP enabled with identical results. --- david raistrick drais@atlasta.net http://www.expita.com/nomime.html