Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 24 Jul 2015 23:33:38 -0800
From:      "CK" <nibbana@gmx.us>
To:        <freebsd-questions@freebsd.org>
Subject:   Endless Data Loss
Message-ID:  <0MRCCJ-1ZUCcr1rAt-00UeQk@mail.gmx.com>

next in thread | raw e-mail | index | archive | help
Hi readers,

In the last 2 years, I have upgraded from 4.11 to 9.2 then 9.3
releases, and since upgrading to the 9 series, I have experienced
endless data loss - every time I reboot my computer, massive numbers
of files vanish - 20 - 50 - a lot.  And it's driving me crazy.
I don't expect to get any fixes here, but something is wrong
with the code - it's happening on ATA drives, USB flash drives,
a few of each kind.  So, it's definitely not a hardware problem.

I wrote about this 2 months ago or so, and was advised to run
a utility on my hard drives - and the utility showed some wear,
but this is happening on USB sticks and cards as well, and
has nothing to do with old ATA drive wear.

I searched Google for data loss on FreeBSD, and I see that many
others have this problem as well.  After 20 years, I am not keen
on switching away from FreeBSD, but the data loss is just killing me.
Every day, I am losing dozens of files.  I am backing up, but that
is not the best solution, because it's easy to backup and mirror
the data loss as well, and it's a pain to constantly have the
stress of not knowing if critical files exist or not, and
constantly matching directories/archives to see which are complete
and current.

FreeBSD forums blocks my access, possibly because I don't have a
high-speed connection, so I can't read the material there.  Sometimes
the loss is on newly created/saved files, sometimes on ancient files,
sometimes on ATA, sometimes on USB.  I can't find any pattern, other
than it always happens on a reboot, and it seems slightly worse
with SoftUpdates+Journaling.

I know this is not an easy thing to analyze, but I never ever
had these problems with 4.11 on the same hardware.  No problems
at all.  But with the 9 series, a problem with every reboot.

Any advice?

PS. One thing I notice is that if I ever ensure correct permissions
of the .sujournal files, but setting them to the same values that
they already have, upon reboot I get an error message to the effect
"timestamp on journal doesn't match last mount time", and then there
is a fallback to a full fsck, most always followed by some cleared
inodes and file loss.  Helpful hint or not, I don't know.

--

Copyright (c) 1992-2014 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
	The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.3-RELEASE #5: Sat Jul 18 23:07:35 AKDT 2015
    root@localhost.earthlink.net:/usr/obj/umass/src/sys/MYKERN i386
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: VIA Nehemiah (666.64-MHz 686-class CPU)
  Origin = "CentaurHauls"  Id = 0x698  Family = 0x6  Model = 0x9  Stepping = 8
  Features=0x381b83f<FPU,VME,DE,PSE,TSC,MSR,SEP,MTRR,PGE,CMOV,PAT,MMX,FXSR,SSE>
  VIA Padlock Features=0xdd<RNG,AES>
real memory  = 536870912 (512 MB)
avail memory = 482418688 (460 MB)
cryptosoft0: <software crypto> on motherboard
padlock0: <AES-CBC> on motherboard
acpi0: <VT9174 AWRDACPI> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, 1def0000 (3) failed
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x73 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
agp0: <VIA 862x (CLE266) host to PCI bridge> on hostb0
agp0: aperture size is 128M
pcib1: <PCI-PCI bridge> at device 1.0 on pci0
pci1: <PCI bus> on pcib1
vgapci0: <VGA-compatible display> mem 0xd8000000-0xdbffffff,0xdc000000-0xdcffffff irq 15 at device 0.0 on pci1
drm0: <VIA CLE266> on vgapci0
info: [drm] AGP at 0xd0000000 128MB
info: [drm] Initialized via 2.11.1 20070202
vgapci0: Boot video device
uhci0: <VIA 83C572 USB controller> port 0xd000-0xd01f irq 15 at device 16.0 on pci0
usbus0 on uhci0
uhci1: <VIA 83C572 USB controller> port 0xd400-0xd41f irq 5 at device 16.1 on pci0
usbus1 on uhci1
uhci2: <VIA 83C572 USB controller> port 0xd800-0xd81f irq 11 at device 16.2 on pci0
usbus2 on uhci2
ehci0: <VIA VT6202 USB 2.0 controller> mem 0xde000000-0xde0000ff irq 10 at device 16.3 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci0
isab0: <PCI-ISA bridge> at device 17.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <VIA 8235 UDMA133 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xdc00-0xdc0f at device 17.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
ata1: <ATA channel> at channel 1 on atapci0
pcm0: <VIA VT8235> port 0xe000-0xe0ff irq 11 at device 17.5 on pci0
pcm0: <ICEnsemble VT1616 AC97 Codec>
pcm0: <VIA DXS Enabled: DXS 4 / SGD 1 / REC 1>
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
ppc0: <Parallel port> port 0x378-0x37f irq 7 on acpi0
ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: Interrupt-driven port
ppi0: <Parallel I/O> on ppbus0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
atkbd0: [GIANT-LOCKED]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model Generic PS/2 mouse, device ID 0
orm0: <ISA Option ROM> at iomem 0xd0000-0xd7fff pnpid ORM0000 on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
acpi_throttle0: <ACPI CPU Throttling> on cpu0
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 480Mbps High Speed USB v2.0
ugen0.1: <VIA> at usbus0
uhub0: <VIA UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <VIA> at usbus1
uhub1: <VIA UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <VIA> at usbus2
uhub2: <VIA UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <VIA> at usbus3
uhub3: <VIA EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
ada0 at ata0 bus 0 scbus0 target 0 lun 0
ada0: <WDC WD400AB-22CDB0 22.04A22> ATA-5 device
ada0: Serial Number WD-WMA9T1222658
ada0: 100.000MB/s transfers (UDMA5, PIO 8192bytes)
ada0: 38166MB (78165360 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad0
Timecounter "TSC" frequency 666641179 Hz quality 800
Root mount waiting for: usbus3 usbus2 usbus1 usbus0
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
Root mount waiting for: usbus3
Root mount waiting for: usbus3
uhub3: 6 ports with 6 removable, self powered
Root mount waiting for: usbus3
ugen3.2: <vendor 0x05e3> at usbus3
uhub4: <vendor 0x05e3 USB2.0 Hub, class 9/0, rev 2.00/85.37, addr 2> on usbus3
uhub4: 4 ports with 4 removable, self powered
Root mount waiting for: usbus3
Root mount waiting for: usbus3
ugen3.3: <SanDisk> at usbus3
umass0: <SanDisk Cruzer Glide, class 0/0, rev 2.00/1.27, addr 3> on usbus3
da0 at umass-sim0 bus 0 scbus2 target 0 lun 0
da0: <SanDisk Cruzer Glide 1.27> Removable Direct Access SCSI-6 device
da0: Serial Number 4C530001640512116413
da0: 40.000MB/s transfers
da0: 29812MB (61056064 512 byte sectors: 255H 63S/T 3800C)
da0: quirks=0x2<NO_6_BYTE>
ugen3.4: <Generic> at usbus3
umass1: <Generic Flash Card ReaderWriter, class 0/0, rev 2.00/1.00, addr 4> on usbus3
Trying to mount root from ufs:/dev/ada0p2 [rw]...
da1 at umass-sim1 bus 1 scbus3 target 0 lun 0
da1: <Multiple Card  Reader 1.00> Removable Direct Access SCSI-0 device
da1: Serial Number 058F63666438
da1: 40.000MB/s transfers
da1: 30436MB (62333952 512 byte sectors: 255H 63S/T 3880C)
da1: quirks=0x2<NO_6_BYTE>
GEOM_ELI: Device ada0p3.eli created.
GEOM_ELI: Encryption: 3DES-CBC 192
GEOM_ELI:     Crypto: software
GEOM_ELI: Device ada0p4.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
tun0: link state changed to UP

cpu     I686_CPU
ident   MYKERN
options ATA_CAM                     # Handle legacy controllers with CAM
options CD9660                      # ISO 9660 Filesystem
options FFS                         # Berkeley Fast Filesystem
options GEOM_PART_GPT               # REQ'D FOR BOOTING!
options GEOM_ELI                    # Crypto Disks.
options INET                        # InterNETworking
#options INET6                      # IPv6 communications protocols
options PADLOCK_RNG                 # VIA Padlock RNG
options SCHED_ULE                   #
options SOFTUPDATES                 # Enable FFS soft updates support
options SYSVMSG                     # SYSV-style message queues
options SYSVSEM                     # SYSV-style semaphores
options SYSVSHM                     # SYSV-style shared memory
options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions

device  crypto      # cryptosoft0: <software crypto> on motherboard
device  padlock     # padlock0: <AES-CBC> on motherboard (Via C3/Eden/C7)
device  acpi        # acpi0: <VT9174 AWRDACPI> on motherboard
                    # acpi0: Power Button (fixed)
                    # acpi0: reservation of 0, a0000 (3) failed
                    # acpi0: reservation of 100000, 1def0000 (3) failed
                    # cpu0: <ACPI CPU> on acpi0
                    # attimer0: <AT timer>
                    #  port 0x40-0x43 irq 0 on acpi0
                    # Timecounter "i8254" frequency 1193182 Hz quality 0
                    # Event timer "i8254" frequency 1193182 Hz quality 100
                    # atrtc0: <AT realtime clock>
                    #  port 0x70-0x73 irq 8 on acpi0
                    # Event timer "RTC" frequency 32768 Hz quality 0
                    # Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
                    # acpi_timer0: <24-bit timer at 3.579545MHz>
                    #  port 0x408-0x40b on acpi0
                    # acpi_button0: <Power Button> on acpi0
                    # pcib0: <ACPI Host-PCI bridge>
                    #  port 0xcf8-0xcff on acpi0
                    # pci0: <ACPI PCI bus> on pcib0
                    # acpi_throttle0: <ACPI CPU Throttling> on cpu0
device  agp         # agp0: <VIA 862x (CLE266) host to PCI bridge> on hostb0
                    # agp0: aperture size is 128M
device  pci         # pcib1: <PCI-PCI bridge> at device 1.0 on pci0
                    # pci1: <PCI bus> on pcib1
                    # vgapci0: <VGA-compatible display>
                    #  mem 0xd8000000-0xdbffffff,0xdc000000-0xdcffff
device  drm         # drm0: <VIA CLE266> on vgapci0
device  viadrm      # info: [drm] AGP at 0xd0000000 128MB
                    # info: [drm] Initialized via 2.11.1 20070202
device  usb         #
device  uhci        # uhci0: <VIA 83C572 USB controller>
                    #  port 0xd000-0xd01f irq 11
                    #  at device 16.0 on pci0
                    #  on usbus0 on uhci0
                    # uhci1: <VIA 83C572 USB controller>
                    #  port 0xd400-0xd41f irq 3
                    #  at device 16.1 on pci0
                    #  on usbus1 on uhci1
                    # uhci2: <VIA 83C572 USB controller>
                    #  port 0xd800-0xd81f irq 10
                    #  at device 16.2 on pci0
                    #  on usbus2 on uhci2
device  ehci        # ehci0: <VIA VT6202 USB 2.0 controller>
                    #  mem 0xde000000-0xde0000ff irq 5
                    #  at device 16.3 on pci0
                    #  on pci0
                    # usbus3: EHCI version 1.0
                    # usbus3 on ehci0
device  scbus       # SCSI bus (required for ATA/SCSI)
device  pass        # Passthrough device (direct ATA/SCSI access)
device  ata         # atapci0: <VIA 8235 UDMA133 controller>
                    #  port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376
                    # ata0: <ATA channel> at channel 0 on atapci0
                    # ata1: <ATA channel> at channel 1 on atapci0
                    # ada0 at ata0 bus 0 scbus0 target 0 lun 0
                    # ada0: <WDC WD400AB-22CDB0 22.04A22> ATA-5 device
                    # ada0: 100.000MB/s transfers (UDMA5, PIO 8192 bytes)
device  sound       # Generic sound driver (required)
device  snd_via8233 # pcm0: <VIA VT8235>
                    #  port 0xe000-0xe0ff irq 10
                    #  at device 17.5 on pci0
                    # pcm0: <ICEnsemble VT1616 AC97 Codec>
                    # pcm0: <VIA DXS Enabled: DXS 4 / SGD 1 / REC 1>
device  uart        # uart0: <16550 or compatible>
                    #  port 0x3f8-0x3ff irq 4
                    #  flags 0x10 on acpi0
device  ppc         # ppc0: <Parallel port>
                    #  port 0x378-0x37f irq 7
                    #  on acpi0
                    # ppc0: Generic chipset (EPP/NIBBLE) in COMPATIBLE mode
device  ppbus       # ppbus0: <Parallel port bus> on ppc0
device  lpt         # lpt0: <Printer> on ppbus0, Interrupt-driven port
device  ppi         # <Parallel I/O> on ppbus0
device  atkbdc      # atkbdc0: <Keyboard controller (i8042)>
                    #  port 0x60,0x64 irq 1
                    #  on acpi0
device  atkbd       # atkbd0: <AT Keyboard> irq 1 on atkbdc0, [GIANT-LOCKED]
                    # kbd0 at atkbd0
device  psm         # psm0: <PS/2 Mouse> irq 12 on atkbdc0, [GIANT-LOCKED]
                    # psm0: model Generic PS/2 mouse, device ID 0
device  sc          # sc0: <System console> at flags 0x100 on isa0
                    # sc0: VGA <16 virtual consoles, flags=0x300>
device  vga         # vga0: <Generic ISA VGA> at
                    #  port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
#device  vr          # <VIA VT6102 Rhine II 10/100BaseTX>
                    #  port 0xe800-0xe8ff mem 0xde001000-0xde0010ff irq 11
                    #  at device 18.0 on pci0
                    # vr0: Quirks: 0x0
                    # vr0: Revision: 0x74
#device  miibus      # miibus0: <MII bus> on vr0
                    # ukphy0: <Generic IEEE 802.3u media interface>
                    #  PHY 1 on miibus0
                    # ukphy0:  none, 10baseT, 10baseT-FDX, 100baseTX,
                    #  100baseTX-FDX, auto, auto-flow
                    # vr0: Ethernet address: 00:40:63:df:10:d2
device  umass       # umass0: <Generic Flash Card ReaderWriter, class 0/0,
                    #  rev 2.00/1.00, addr 2> on usbus3
                    # umass0:  SCSI over Bulk-Only; quirks = 0x4001
                    # umass0:3:0:-1: Attached to scbus3
device  da          # da0 at umass-sim0 bus 0 scbus2 target 0 lun 0
                    # da0: <Multiple Card  Reader 1.00>
                    #  Removable Direct Access SCSI-0 device
                    # da0: 40.000MB/s transfers
                    # da0: 30436MB
                    # da0: quirks=0x2<NO_6_BYTE>
device  cd          # cd0 at ata1 bus 0 scbus1 target 0 lun 0
                    # cd0: <Memorex 52MAXX 3252AJ1 4WS2>
                    #  Removable CD-ROM SCSI-0 device
                    # cd0: 33.300MB/s transfers
                    #  (UDMA2, ATAPI 12 bytes, PIO 65534 bytes)
                    # cd0: cd present [274040 x 2048 byte records]

device  bpf         # Berkeley packet filter
device  ether       # Ethernet support
device  loop        # Network loopback
device  random      # Entropy device
device  splash      # Syscons saver
device  tun         # Packet tunnel




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?0MRCCJ-1ZUCcr1rAt-00UeQk>