From owner-freebsd-stable Wed Jul 18 10:55:31 2001 Delivered-To: freebsd-stable@freebsd.org Received: from mail.squidge.com (ns1.squidge.com [195.10.252.5]) by hub.freebsd.org (Postfix) with ESMTP id 3AF3137B401 for ; Wed, 18 Jul 2001 10:55:11 -0700 (PDT) (envelope-from stewart@nameless-uk.com) Received: from saturn (host217-32-133-242.hg.mdip.bt.net [217.32.133.242]) (authenticated) by mail.squidge.com (8.11.3-MySQL/8.11.2) with ESMTP id f6IHstg06386 (using TLSv1/SSLv3 with cipher RC4-MD5 (128 bits) verified NO); Wed, 18 Jul 2001 18:55:02 +0100 (BST) (envelope-from stewart@nameless-uk.com) Reply-To: From: "Stewart Morgan" To: Cc: "'Greg Lehey'" Subject: PANIC in FFS -- Please HELP! Date: Wed, 18 Jul 2001 18:55:58 +0100 Organization: Nameless-UK Message-ID: <000001c10fb2$ed07a0e0$0f01000a@saturn> MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_NextPart_000_0001_01C10FBB.4ECD8F80" X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook, Build 10.0.2605 In-Reply-To: <20010710065655.Y80862@wantadilla.lemis.com> Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V5.50.4522.1200 Sender: owner-freebsd-stable@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG This is a multi-part message in MIME format. ------=_NextPart_000_0001_01C10FBB.4ECD8F80 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Hi, I have a system that will reproducibly panic with the entries below in my make.conf. I thought the problem was vinum related, but having purchased a h/ware raid solution and with Greg's help in tracking things down, I'm not so sure. Please find attached the trace from a debug kernel with these optimisations enabled, the kernel config (LAXMI{.DAT}) and a dmesg output. Any help appreciated! Stewart. --------------- CPUTYPE=i686 CFLAGS=-O -pipe -felide-constructors -mcpu=pentiumpro -march=pentiumpro -ffast-math -felide-constructors -fexpensive-optimizations -funroll-loops -funroll-all-loops -fmemoize-lookups -fsave-memoized -fno-strength-reduce CXXFLAGS+=-O -pipe -felide-constructors -mcpu=pentiumpro -march=pentiumpro -ffast-math -felide-constructors -fexpensive-optimizations -funroll-loops -funroll-all-loops -fmemoize-lookups -fsave-memoized -fno-strength-reduce COPTFLAGS=-O -pipe -felide-constructors -mcpu=pentiumpro -march=pentiumpro -ffast-math -felide-constructors -fexpensive-optimizations -funroll-loops -funroll-all-loops -fmemoize-lookups -fsave-memoized -fno-strength-reduce ------=_NextPart_000_0001_01C10FBB.4ECD8F80 Content-Type: text/plain; name="trace.txt" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="trace.txt" GNU gdb 4.18 Copyright 1998 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you = are welcome to change it and/or distribute copies of it under certain = conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for = details. This GDB was configured as "i386-unknown-freebsd"... IdlePTD 4558848 initial pcb at 3acf60 panicstr: from debugger panic messages: --- Fatal trap 12: page fault while in kernel mode fault virtual address =3D 0x4a fault code =3D supervisor read, page not present instruction pointer =3D 0x8:0xc02a22a3 stack pointer =3D 0x10:0xca1ebd14 frame pointer =3D 0x10:0xca1ebd34 code segment =3D base 0x0, limit 0xfffff, type 0x1b =3D DPL 0, pres 1, def32 1, gran 1 processor eflags =3D interrupt enabled, resume, IOPL =3D 0 current process =3D 359 (pax) interrupt mask =3D none panic: from debugger panic: from debugger Uptime: 6m37s dumping to dev #da/0x20001, offset 1310976 dump 127 126 125 124 123 122 121 120 119 118 117 116 115 114 113 112 111 = 110 109 108 107 106 105 104 103 102 101 100 99 98 97 96 95 94 93 92 91 = 90 89 88 87 86 85 84 83 82 81 80 79 78 77 76 75 74 73 72 71 70 69 68 67 = 66 65 64 63 62 61 60 59 58 57 56 55 54 53 52 51 50 49 48 47 46 45 44 43 = 42 41 40 39 38 37 36 35 34 33 32 31 30 29 28 27 26 25 24 23 22 21 20 19 = 18 17 16 15 14 13 12 11 10 9 8 7 6 5 4 3 2 1 0=20 --- #0 dumpsys () at ../../kern/kern_shutdown.c:472 472 if (dumping++) { (kgdb) bt #0 dumpsys () at ../../kern/kern_shutdown.c:472 #1 0xc019ba52 in boot (howto=3D0x104) at ../../kern/kern_shutdown.c:312 #2 0xc019bf89 in panic (fmt=3D0xc033f2f4 "from debugger") at = ../../kern/kern_shutdown.c:559 #3 0xc0155e55 in db_panic (addr=3D0xc02a22a3, have_addr=3D0x0, = count=3D0xffffffff, modif=3D0xca1ebb84 "") at ../../ddb/db_command.c:433 #4 0xc0155df6 in db_command (last_cmdp=3D0xc0383478, = cmd_table=3D0xc03832d8, aux_cmd_tablep=3D0xc03a6244) at ../../ddb/db_command.c:333 #5 0xc0155eba in db_command_loop () at ../../ddb/db_command.c:455 #6 0xc0158eff in db_trap (type=3D0xc, code=3D0x0) at = ../../ddb/db_trap.c:71 #7 0xc0308800 in kdb_trap (type=3D0xc, code=3D0x0, regs=3D0xca1ebcd4) = at ../../i386/i386/db_interface.c:158 #8 0xc0318504 in trap_fatal (frame=3D0xca1ebcd4, eva=3D0x4a) at = ../../i386/i386/trap.c:946 #9 0xc03181c5 in trap_pfault (frame=3D0xca1ebcd4, usermode=3D0x0, = eva=3D0x4a) at ../../i386/i386/trap.c:844 #10 0xc0317d2b in trap (frame=3D{tf_fs =3D 0x10, tf_es =3D 0xca1e0010, = tf_ds =3D 0x10, tf_edi =3D 0x19, tf_esi =3D 0xf65,=20 tf_ebp =3D 0xca1ebd34, tf_isp =3D 0xca1ebd00, tf_ebx =3D = 0xc14ec000, tf_edx =3D 0x1a, tf_ecx =3D 0x1e, tf_eax =3D 0x1d0,=20 tf_trapno =3D 0xc, tf_err =3D 0x0, tf_eip =3D 0xc02a22a3, tf_cs = =3D 0x8, tf_eflags =3D 0x10207, tf_esp =3D 0x0, tf_ss =3D 0x0}) at ../../i386/i386/trap.c:443 #11 0xc02a22a3 in ffs_blkpref (ip=3D0xc19d7800, lbn=3D0x100c, = indx=3D0x0, bap=3D0x0) at ../../ufs/ffs/ffs_alloc.c:709 #12 0xc02a549a in ffs_balloc (ap=3D0xca1ebe70) at = ../../ufs/ffs/ffs_balloc.c:250 #13 0xc02b0e3a in ffs_write (ap=3D0xca1ebea8) at vnode_if.h:1056 #14 0xc01dfc12 in vn_write (fp=3D0xc1a50ac0, uio=3D0xca1ebef0, = cred=3D0xc19d3100, flags=3D0x0, p=3D0xc8854860) at vnode_if.h:363 #15 0xc01af3bc in dofilewrite (p=3D0xc8854860, fp=3D0xc1a50ac0, = fd=3D0x6, buf=3D0x809dfc0, nbyte=3D0x2000,=20 offset=3D0xffffffffffffffff, flags=3D0x0) at ../../sys/file.h:162 #16 0xc01af2ab in write (p=3D0xc8854860, uap=3D0xca1ebf80) at = ../../kern/sys_generic.c:329 #17 0xc0318736 in syscall2 (frame=3D{tf_fs =3D 0x809002f, tf_es =3D = 0x2f, tf_ds =3D 0xbfbf002f, tf_edi =3D 0x809dfc0,=20 tf_esi =3D 0x2000, tf_ebp =3D 0xbfbfd60c, tf_isp =3D 0xca1ebfd4, = tf_ebx =3D 0x809dfc0, tf_edx =3D 0xbfbfd668,=20 tf_ecx =3D 0x2, tf_eax =3D 0x4, tf_trapno =3D 0x7, tf_err =3D 0x2, = tf_eip =3D 0x808c8f0, tf_cs =3D 0x1f, tf_eflags =3D 0x297,=20 tf_esp =3D 0xbfbfd5e0, tf_ss =3D 0x2f}) at = ../../i386/i386/trap.c:1150 #18 0xc0309285 in Xint0x80_syscall () #19 0x804c0b3 in ?? () #20 0x804abc9 in ?? () #21 0x8052d65 in ?? () #22 0x80481e2 in ?? () (kgdb)=20 ------=_NextPart_000_0001_01C10FBB.4ECD8F80 Content-Type: application/octet-stream; name="LAXMI.DMESG" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="LAXMI.DMESG" Copyright (c) 1992-2001 The FreeBSD Project.=0A= Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994=0A= The Regents of the University of California. All rights reserved.=0A= FreeBSD 4.3-STABLE #9: Fri Jun 15 11:30:25 GMT 2001=0A= root@laxmi.bristol.squidge.com:/usr/src/sys/compile/LAXMI=0A= Timecounter "i8254" frequency 1193077 Hz=0A= CPU: Pentium II/Pentium II Xeon/Celeron (400.87-MHz 686-class CPU)=0A= Origin =3D "GenuineIntel" Id =3D 0x665 Stepping =3D 5=0A= = Features=3D0x183fbff=0A= real memory =3D 134086656 (130944K bytes)=0A= sio0: gdb debugging port=0A= avail memory =3D 125460480 (122520K bytes)=0A= Preloaded elf kernel "kernel" at 0xc0431000.=0A= ccd0-3: Concatenated disk drivers=0A= VESA: v2.0, 4096k memory, flags:0x1, mode table:0xc03bcda2 (1000022)=0A= VESA: Cirrus Logic GD-546X VGA=0A= Pentium Pro MTRR support enabled=0A= apm0: on motherboard=0A= apm: found APM BIOS v1.2, connected at v1.2=0A= npx0: on motherboard=0A= npx0: INT 16 interface=0A= pcib0: on motherboard=0A= pci0: on pcib0=0A= pcib1: at device 1.0 on = pci0=0A= pci1: on pcib1=0A= pci1: at 0.0 irq 10=0A= isab0: at device 7.0 on pci0=0A= isa0: on isab0=0A= atapci0: port 0xffa0-0xffaf at device 7.1 = on pci0=0A= ata0: at 0x1f0 irq 14 on atapci0=0A= ata1: at 0x170 irq 15 on atapci0=0A= uhci0: at device 7.2 on pci0=0A= uhci0: Invalid irq 255=0A= uhci0: Please switch on USB support and switch PNP-OS to 'No' in BIOS=0A= device_probe_and_attach: uhci0 attach returned 6=0A= intpm0: port 0x440-0x44f irq = 9 at device 7.3 on pci0=0A= intpm0: I/O mapped 440=0A= intpm0: intr IRQ 9 enabled revision 0=0A= smbus0: on intsmb0=0A= smb0: on smbus0=0A= intpm0: PM I/O mapped 400 =0A= pcib2: at device 16.0 on pci0=0A= pci2: on pcib2=0A= fxp0: port 0xdf00-0xdf3f mem = 0xfe900000-0xfe9fffff,0xfeaff000-0xfeafffff irq 11 at device 5.0 on pci2=0A= fxp0: Ethernet address 00:02:b3:2a:1d:82=0A= inphy0: on miibus0=0A= inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto=0A= fxp1: port 0xdf80-0xdf9f mem = 0xfe700000-0xfe7fffff,0xff1ff000-0xff1fffff irq 9 at device 6.0 on pci2=0A= fxp1: Ethernet address 00:90:27:34:25:b1=0A= inphy1: on miibus1=0A= inphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto=0A= ahc0: port 0xe400-0xe4ff mem = 0xfebfe000-0xfebfefff irq 10 at device 18.0 on pci0=0A= aic7895C: Wide Channel A, SCSI Id=3D7, 32/255 SCBs=0A= ahc1: port 0xe800-0xe8ff mem = 0xfebff000-0xfebfffff irq 10 at device 18.1 on pci0=0A= aic7895C: Wide Channel B, SCSI Id=3D7, 32/255 SCBs=0A= fdc0: at port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on isa0=0A= fdc0: FIFO enabled, 8 bytes threshold=0A= fd0: <1440-KB 3.5" drive> on fdc0 drive 0=0A= atkbdc0: at port 0x60,0x64 on isa0=0A= atkbd0: irq 1 on atkbdc0=0A= vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0=0A= sc0: at flags 0x80 on isa0=0A= sc0: VGA <16 virtual consoles, flags=3D0x280>=0A= sio0 at port 0x3f8-0x3ff irq 4 flags 0x91 on isa0=0A= sio0: type 16550A=0A= sio1 at port 0x2f8-0x2ff irq 3 on isa0=0A= sio1: type 16550A=0A= ppc0: at port 0x378-0x37f irq 7 on isa0=0A= ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode=0A= ppc0: FIFO with 16/16/8 bytes threshold=0A= lpt0: on ppbus0=0A= lpt0: Interrupt-driven port=0A= IPv6 packet filtering initialized, default to accept, logging limited to = 100 packets/entry=0A= IP packet filtering initialized, divert enabled, rule-based forwarding = enabled, default to accept, logging limited to 100 packets/entry by = default=0A= IPsec: Initialized Security Association Processing.=0A= IP Filter: v3.4.16 initialized. Default =3D pass all, Logging =3D = enabled=0A= ad0: 39266MB [79780/16/63] at ata0-master tagged UDMA33=0A= ad2: 39266MB [79780/16/63] at ata1-master tagged UDMA33=0A= ad3: 39266MB [79780/16/63] at ata1-slave tagged UDMA33=0A= Waiting 8 seconds for SCSI devices to settle=0A= sa0 at ahc0 bus 0 target 4 lun 0=0A= sa0: Removable Sequential Access SCSI-2 = device =0A= sa0: 5.000MB/s transfers (5.000MHz, offset 8)=0A= da0 at ahc0 bus 0 target 0 lun 0=0A= da0: Fixed Direct Access SCSI-2 device =0A= da0: 40.000MB/s transfers (20.000MHz, offset 8, 16bit), Tagged Queueing = Enabled=0A= da0: 8683MB (17783240 512 byte sectors: 255H 63S/T 1106C)=0A= Mounting root from ufs:/dev/da0s1a=0A= ------=_NextPart_000_0001_01C10FBB.4ECD8F80 Content-Type: application/octet-stream; name="LAXMI.DAT" Content-Transfer-Encoding: quoted-printable Content-Disposition: attachment; filename="LAXMI.DAT" #########################################################################= ##############=0A= #########################################################################= ##############=0A= ## Configuration file for Apollo=0A= #########################################################################= ##############=0A= #########################################################################= ##############=0A= ident LAXMI=0A= =0A= =0A= #########################################################################= ##############=0A= # Generic options=0A= #########################################################################= ##############=0A= #=0A= options CLK_USE_I8254_CALIBRATION=0A= options CLK_USE_TSC_CALIBRATION=0A= options INCLUDE_CONFIG_FILE=0A= machine i386=0A= maxusers 128=0A= =0A= =0A= #########################################################################= ##############=0A= # Single CPU options=0A= #########################################################################= ##############=0A= #=0A= cpu I686_CPU=0A= =0A= =0A= #########################################################################= ##############=0A= # SMP options...=0A= #########################################################################= ##############=0A= #=0A= # To make an SMP kernel, the next two are needed=0A= #options SMP # Symmetric MultiProcessor Kernel=0A= #options APIC_IO # Symmetric (APIC) I/O=0A= # Optionally these may need tweaked, (defaults shown):=0A= #options NCPU=3D2 # number of CPUs=0A= #options NBUS=3D4 # number of busses=0A= #options NAPIC=3D1 # number of IO APICs=0A= #options NINTR=3D24 # number of INTs=0A= =0A= =0A= #########################################################################= ##############=0A= # File system support...=0A= #########################################################################= ##############=0A= #=0A= options FFS #Berkeley Fast Filesystem=0A= options FFS_ROOT #FFS usable as root device [keep this!]=0A= options CD9660=0A= options MSDOSFS=0A= options PROCFS=0A= options NFS #Network Filesystem=0A= options SOFTUPDATES=0A= #options PQ_CACHESIZE=3D1024 # Cache colouring=0A= =0A= =0A= #########################################################################= ##############=0A= # Kernel config options=0A= #########################################################################= ##############=0A= #=0A= options USERCONFIG #boot -c editor=0A= options VISUAL_USERCONFIG #visual boot -c editor=0A= options "COMPAT_43" #Compatible with BSD 4.3 [KEEP THIS!]=0A= options COMPAT_LINUX=0A= options P1003_1B #Posix P1003_1B real-time extensions=0A= options _KPOSIX_PRIORITY_SCHEDULING=0A= options _KPOSIX_VERSION=3D199309L=0A= config kernel=0A= =0A= #########################################################################= ##############=0A= # Debugging options=0A= #########################################################################= ##############=0A= #=0A= makeoptions DEBUG=3D-g=0A= options DDB=0A= #options DDB_UNATTENDED=0A= =0A= #########################################################################= ##############=0A= # Buses...=0A= #########################################################################= ##############=0A= #=0A= options AUTO_EOI_1=0A= # EOI_2 KILLS MACHINE!=0A= device isa=0A= device pci=0A= =0A= =0A= #########################################################################= ##############=0A= # Floppy drive...=0A= #########################################################################= ##############=0A= #=0A= device fdc0 at isa? port IO_FD1 irq 6 drq 2=0A= device fd0 at fdc0 drive 0=0A= =0A= =0A= #########################################################################= ##############=0A= # IDE stuff...=0A= #########################################################################= ##############=0A= #=0A= options ATA_STATIC_ID=0A= device ata0 at isa? port IO_WD1 irq 14=0A= device ata1 at isa? port IO_WD2 irq 15=0A= device ata=0A= device atadisk # ATA disk drives=0A= =0A= =0A= #########################################################################= ##############=0A= # SCSI stuff...=0A= #########################################################################= ##############=0A= #=0A= options SCSI_DELAY=3D8000 #Be pessimistic about Joe SCSI device=0A= options AHC_ALLOW_MEMIO=0A= device ahc=0A= device scbus=0A= device da=0A= device sa=0A= device cd=0A= device pass=0A= =0A= =0A= #########################################################################= ##############=0A= # Console etc...=0A= #########################################################################= ##############=0A= #=0A= makeoptions ATKBD_DFLT_KEYMAP=3Duk.iso.kbd=0A= options UCONSOLE=0A= options ATKBD_DFLT_KEYMAP=0A= options SC_NORM_ATTR=3D"(FG_YELLOW|BG_BLACK)"=0A= options SC_NORM_REV_ATTR=3D"(FG_BLACK|BG_LIGHTGREY)"=0A= options SC_KERNEL_CONS_ATTR=3D"(FG_LIGHTRED|BG_BLACK)"=0A= options SC_KERNEL_CONS_REV_ATTR=3D"(FG_BLACK|BG_RED)"=0A= options SC_NO_CUTPASTE=0A= options SC_NO_SYSMOUSE=0A= options SC_HISTORY_SIZE=3D4096=0A= #options SC_PIXEL_MODE=0A= options VESA=0A= options XSERVER # support for X server=0A= options MSGBUF_SIZE=3D40960=0A= =0A= device atkbdc0 at isa? port IO_KBD=0A= device atkbd0 at atkbdc? irq 1=0A= device psm0 at atkbdc? irq 12=0A= device vga0 at isa? port?=0A= device vga1 at isa? port?=0A= device sc0 at isa? flags 0x80=0A= device npx0 at nexus? port IO_NPX flags 0x0 irq 13=0A= pseudo-device splash=0A= =0A= =0A= #########################################################################= ##############=0A= # Power and system management...=0A= #########################################################################= ##############=0A= #=0A= device apm0 at nexus?=0A= device smb=0A= device smbus=0A= device iicbus=0A= device intpm=0A= device iicsmb=0A= device ichsmb=0A= =0A= =0A= #########################################################################= ##############=0A= # Serial ports for serial consoles...=0A= #########################################################################= ##############=0A= #=0A= options CONSPEED=3D9600=0A= device sio0 at isa? port "IO_COM1" flags 0x91 irq 4=0A= device sio1 at isa? port "IO_COM2" irq 3=0A= =0A= =0A= #########################################################################= ##############=0A= # Paralell ports...=0A= #########################################################################= ##############=0A= #=0A= device ppc0 at isa? port? irq 7=0A= device ppbus=0A= device lpt=0A= =0A= =0A= #########################################################################= ##############=0A= # USB devices...=0A= #########################################################################= ##############=0A= #=0A= device uhci=0A= device usb=0A= device uhid=0A= device ums=0A= device umass=0A= =0A= =0A= #########################################################################= ##############=0A= # Network card...=0A= #########################################################################= ##############=0A= #=0A= device miibus=0A= device fxp=0A= =0A= =0A= #########################################################################= ##############=0A= # Firewall stuff...=0A= #########################################################################= ##############=0A= #=0A= # IP Security and tweaks=0A= options IPSEC=0A= options IPSEC_ESP=0A= options PPP_BSDCOMP=0A= options PPP_DEFLATE=0A= options TCP_DROP_SYNFIN #drop TCP packets with SYN+FIN=0A= options ICMP_BANDLIM=0A= =0A= # IPv4=0A= options INET #InterNETworking=0A= options IPFIREWALL #firewall=0A= options IPFIREWALL_VERBOSE #print information about dropped packets=0A= options IPFIREWALL_FORWARD #enable transparent proxy support=0A= options IPFIREWALL_VERBOSE_LIMIT=3D100 #limit verbosity=0A= options IPFIREWALL_DEFAULT_TO_ACCEPT #allow everything by default=0A= =0A= # IPv6=0A= options INET6 #InterNETworking=0A= options IPV6FIREWALL #firewall=0A= options IPV6FIREWALL_VERBOSE #print information about dropped = packets=0A= options IPV6FIREWALL_VERBOSE_LIMIT=3D100 #limit verbosity=0A= options IPV6FIREWALL_DEFAULT_TO_ACCEPT #allow everything by default=0A= =0A= # Misc=0A= options IPDIVERT #divert sockets=0A= options IPFILTER #kernel ipfilter support=0A= options IPFILTER_LOG #ipfilter logging=0A= =0A= =0A= #########################################################################= ##############=0A= # Pseudo devices...=0A= #########################################################################= ##############=0A= #=0A= pseudo-device loop=0A= pseudo-device ether=0A= pseudo-device gzip=0A= pseudo-device bpf 4=0A= pseudo-device vn 4=0A= pseudo-device ccd 4=0A= pseudo-device ppp 1=0A= pseudo-device tun 1=0A= pseudo-device pty 64=0A= pseudo-device gif 4=0A= pseudo-device faith 1=0A= pseudo-device stf 1=0A= pseudo-device snp 2=0A= =0A= =0A= #########################################################################= ##############=0A= # Shared system resources...=0A= #########################################################################= ##############=0A= #=0A= options SYSVSHM=0A= options SYSVMSG=0A= options SYSVSEM=0A= ------=_NextPart_000_0001_01C10FBB.4ECD8F80-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-stable" in the body of the message