Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 10 Jan 2004 23:25:16 -0500
From:      Tim Middleton <x@Vex.Net>
To:        freebsd-current@freebsd.org
Cc:        Stephen Corbesero <flash@cs.moravian.edu>
Subject:   Re: is vinum in current working for anyone
Message-ID:  <200401102325.16547.x@Vex.Net>
In-Reply-To: <20040110110001.GV7617@wantadilla.lemis.com>
References:  <200401061608.i06G8Gq14706@catwoman.cs.moravian.edu> <200401100021.02691.x@Vex.Net> <20040110110001.GV7617@wantadilla.lemis.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Saturday 10 January 2004 06:00, Greg 'groggy' Lehey wrote:
> > it's an interesting coincidence. And needless to say... i've removed
> > start_vinum="YES" from rc.conf just in case.

Greg, further to the email i sent you earlier, where i had resetconfig and 
re-created the raid5 config, I noticed a bit later the 3rd subdisk had gone 
away again. So this time I resetconfig, and did a clean init...

By merely doing vinum start and stop a number of times you will see below I 
can lose the 3rd subdisk. Below is a transcript of all commands issued. They 
are all simply "vinum start", "vinum stop", and "vinum l". There's some time 
gaps as i was distracted a few times. However, nothing else touched the vinum 
disk in between times, and the disk was never even mounted. You'll see in the 
first "vinum l" i was just completing the "init" (97% on the slowest 
subdisk). 

You'll see that after the second last vinum start that vinum still has a still 
knows about  /dev/ad2s1d, though raid5.p0.s2 has a status of crashed. Then 
the last stop/start then loses /dev/ad2s1d completely.

This post is a bit long; but decided to reply on the list in case anyone else 
testing this can duplicate/confirm, or shed more light on this. 

But first a snippet from my /var/log/messages from the same timespan (starting 
with the vinum resetconfig) which shows not good things... (malloc 
errors)....

==============================================================

Jan 10 22:17:07 bee kernel: vinum: CONFIGURATION OBLITERATED
Jan 10 22:17:16 bee kernel: vinum: exiting with malloc table inconsistency at 
0xc6c14800
 from vinumio.c:868
Jan 10 22:17:16 bee kernel: vinum: unloaded
Jan 10 22:17:18 bee kernel: vinum: loaded
Jan 10 22:17:18 bee kernel: vinum: reading configuration from
Jan 10 22:17:18 bee kernel: vinum_scandisk:  is unallocated
Jan 10 22:17:18 bee kernel: vinum: Can't read device , error 5
Jan 10 22:17:18 bee kernel: vinum: couldn't read configuration
Jan 10 22:17:33 bee kernel: vinum: drive a is up
Jan 10 22:17:33 bee kernel: vinum: drive b is up
Jan 10 22:17:33 bee kernel: vinum: drive c is up
Jan 10 22:17:51 bee kernel: vinum: raid5.p0.s0 is initializing by force
Jan 10 22:17:51 bee kernel: vinum: raid5.p0 is initializing
Jan 10 22:17:51 bee kernel: vinum: raid5.p0.s2 is initializing by force
Jan 10 22:17:51 bee kernel: vinum: raid5.p0.s1 is initializing by force
Jan 10 22:26:56 bee kernel: vinum: raid5.p0.s2 is initialized by force
Jan 10 22:26:56 bee kernel: vinum: raid5.p0.s2 is initialized
Jan 10 22:28:16 bee kernel: vinum: raid5.p0.s0 is initialized by force
Jan 10 22:28:16 bee kernel: vinum: raid5.p0.s0 is initialized
Jan 10 22:29:09 bee kernel: vinum: raid5.p0.s1 is initialized by force
Jan 10 22:29:09 bee kernel: vinum: raid5.p0.s0 is up
Jan 10 22:29:09 bee kernel: vinum: raid5.p0.s1 is up
Jan 10 22:29:09 bee kernel: vinum: raid5.p0.s2 is up
Jan 10 22:29:09 bee kernel: vinum: raid5.p0 is up
Jan 10 22:29:09 bee kernel: vinum: raid5 is up
Jan 10 22:29:09 bee kernel: vinum: raid5.p0.s1 is up
Jan 10 23:02:32 bee kernel: vinum: exiting with malloc table inconsistency at 
0xc6aff800
 from vinumio.c:868
Jan 10 23:02:32 bee kernel: vinum: unloaded
Jan 10 23:02:33 bee kernel: vinum: loaded
Jan 10 23:02:38 bee kernel: vinum: reading configuration from /dev/ad2s1d
Jan 10 23:02:38 bee kernel: vinum: updating configuration from /dev/ad1s3d
Jan 10 23:02:38 bee kernel: vinum: updating configuration from /dev/ad0s2d
Jan 10 23:02:41 bee kernel: vinum: already read config from c
Jan 10 23:02:41 bee kernel: vinum: already read config from b
Jan 10 23:02:41 bee kernel: vinum: already read config from a
Jan 10 23:02:41 bee kernel: vinum: no additional drives found
Jan 10 23:02:47 bee kernel: vinum: exiting with malloc table inconsistency at 
0xc7e75800
 from vinumio.c:868
Jan 10 23:02:47 bee kernel: vinum: unloaded
Jan 10 23:02:50 bee kernel: vinum: loaded
Jan 10 23:02:51 bee kernel: vinum: reading configuration from /dev/ad0s2d
Jan 10 23:02:51 bee kernel: vinum: raid5.p0.s2 is crashed
Jan 10 23:02:51 bee kernel: vinum: raid5.p0 is degraded
Jan 10 23:02:51 bee kernel: vinum: updating configuration from /dev/ad1s3d
Jan 10 23:02:51 bee kernel: vinum: updating configuration from /dev/ad1s3d
Jan 10 23:02:51 bee kernel: vinum: incompatible sector sizes.  raid5.p0.s2 has 
0 bytes,
raid5.p0 has 512 bytes.  Ignored.
Jan 10 23:02:54 bee kernel: vinum: exiting with malloc table inconsistency at 
0xc6c12800
 from vinumio.c:868
Jan 10 23:02:54 bee kernel: vinum: unloaded
Jan 10 23:02:56 bee kernel: vinum: loaded
Jan 10 23:02:59 bee kernel: vinum: reading configuration from /dev/ad0s2d
Jan 10 23:02:59 bee kernel: vinum: updating configuration from /dev/ad1s3d
Jan 10 23:02:59 bee kernel: vinum: updating configuration from /dev/ad2s1d
Jan 10 23:03:21 bee kernel: vinum: exiting with malloc table inconsistency at 
0xc70c2800
 from vinumio.c:868
Jan 10 23:03:21 bee kernel: vinum: unloaded
Jan 10 23:03:26 bee kernel: vinum: loaded
Jan 10 23:03:26 bee kernel: vinum: reading configuration from /dev/ad0s2d
Jan 10 23:03:26 bee kernel: vinum: updating configuration from /dev/ad1s3d
Jan 10 23:03:26 bee kernel: vinum: updating configuration from /dev/ad1s3d
Jan 10 23:03:26 bee kernel: vinum: incompatible sector sizes.  raid5.p0.s2 has 
0 bytes,
raid5.p0 has 512 bytes.  Ignored.

==============================================================

22:28:45 root@bee:~/work # vinum l
3 drives:
D a                     State: up       /dev/ad0s2d     A: 523/20473 MB (2%)
D b                     State: up       /dev/ad1s3d     A: 523/20473 MB (2%)
D c                     State: up       /dev/ad2s1d     A: 523/20473 MB (2%)

1 volumes:
V raid5                 State: down     Plexes:       1 Size:         38 GB

1 plexes:
P raid5.p0           R5 State: initializing     Subdisks:     3 Size:         
38 GB

3 subdisks:
S raid5.p0.s0           State: initialized      D: a            Size:         
19 GB
S raid5.p0.s1           State: I 97%    D: b            Size:         19 GB
S raid5.p0.s2           State: initialized      D: c            Size:         
19 GB
22:28:49 root@bee:~/work # vinum l
3 drives:
D a                     State: up       /dev/ad0s2d     A: 523/20473 MB (2%)
D b                     State: up       /dev/ad1s3d     A: 523/20473 MB (2%)
D c                     State: up       /dev/ad2s1d     A: 523/20473 MB (2%)

1 volumes:
V raid5                 State: up       Plexes:       1 Size:         38 GB

1 plexes:
P raid5.p0           R5 State: up       Subdisks:     3 Size:         38 GB

3 subdisks:
S raid5.p0.s0           State: up       D: a            Size:         19 GB
S raid5.p0.s1           State: up       D: b            Size:         19 GB
S raid5.p0.s2           State: up       D: c            Size:         19 GB
23:02:26 root@bee:~/work # vinum stop
vinum unloaded
23:02:31 root@bee:~/work # vinum l
0 drives:
0 volumes:
0 plexes:
0 subdisks:
23:02:33 root@bee:~/work # vinum start
23:02:38 root@bee:~/work # vinum l
3 drives:
D c                     State: up       /dev/ad2s1d     A: 523/20473 MB (2%)
D b                     State: up       /dev/ad1s3d     A: 523/20473 MB (2%)
D a                     State: up       /dev/ad0s2d     A: 523/20473 MB (2%)

1 volumes:
V raid5                 State: up       Plexes:       1 Size:         38 GB

1 plexes:
P raid5.p0           R5 State: up       Subdisks:     3 Size:         38 GB

3 subdisks:
S raid5.p0.s0           State: up       D: a            Size:         19 GB
S raid5.p0.s1           State: up       D: b            Size:         19 GB
S raid5.p0.s2           State: up       D: c            Size:         19 GB
23:02:39 root@bee:~/work # vinum start
** no additional drives found: No such file or directory
23:02:41 root@bee:~/work # vinum stop
vinum unloaded
23:02:47 root@bee:~/work # vinum start
23:02:51 root@bee:~/work # vinum stop
vinum unloaded
23:02:54 root@bee:~/work # vinum l
0 drives:
0 volumes:
0 plexes:
0 subdisks:
23:02:56 root@bee:~/work # vinum start
23:02:59 root@bee:~/work # vinum l
3 drives:
D c                     State: up       /dev/ad2s1d     A: 523/20473 MB (2%)
D b                     State: up       /dev/ad1s3d     A: 523/20473 MB (2%)
D a                     State: up       /dev/ad0s2d     A: 523/20473 MB (2%)

1 volumes:
V raid5                 State: up       Plexes:       1 Size:         38 GB

1 plexes:
P raid5.p0           R5 State: degraded Subdisks:     3 Size:         38 GB

3 subdisks:
S raid5.p0.s0           State: up       D: a            Size:         19 GB
S raid5.p0.s1           State: up       D: b            Size:         19 GB
S raid5.p0.s2           State: crashed  D: c            Size:         19 GB
23:03:01 root@bee:~/work # vinum stop
vinum unloaded
23:03:21 root@bee:~/work # vinum start
23:03:26 root@bee:~/work # vinum l
3 drives:
D b                     State: up       /dev/ad1s3d     A: 523/20473 MB (2%)
D a                     State: up       /dev/ad0s2d     A: 523/20473 MB (2%)
D c                     State: referenced       unknown A: 0/0 MB

1 volumes:
V raid5                 State: up       Plexes:       1 Size:         38 GB

1 plexes:
P raid5.p0           R5 State: degraded Subdisks:     3 Size:         38 GB

3 subdisks:
S raid5.p0.s0           State: up       D: a            Size:         19 GB
S raid5.p0.s1           State: up       D: b            Size:         19 GB
S raid5.p0.s2           State: crashed  D: c            Size:         19 GB
23:03:28 root@bee:~/work #

-- 
Tim Middleton | Cain Gang Ltd | Christianity didn't [...] for 20 centuries
x@veX.net     | www.Vex.Net   | [...] shit Hallmark before a live studio...



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?200401102325.16547.x>