Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 30 Apr 2010 16:33:16 +0200
From:      Ollivier Robert <roberto@keltia.freenix.fr>
To:        FreeBSD Current Users' list <freebsd-current@FreeBSD.ORG>
Subject:   rsync locks for very long periods (indefinitely?) when using suj over raid5
Message-ID:  <20100430143316.GA475@roberto-al.eurocontrol.fr>

next in thread | raw e-mail | index | archive | help
9.0-CURRENT as of two hours ago (with latest SUJ fixes then) running on a bi-Xeon @2.8 GHz (5 year old) w/ HT, 32-bit mode (no LM). 4 GB, no PAE

4 72 GB disks in a raid5 with gvinum, block size: 128 KB
UFS2 + SUJ, mounted async.

420 [15:40] root@vcs:/data# gvinum list
4 drives:
D gvinumdrive0          State: up	/dev/da2	A: 6/69459 MB (0%)
D gvinumdrive3          State: up	/dev/da5	A: 6/69459 MB (0%)
D gvinumdrive2          State: up	/dev/da4	A: 6/69459 MB (0%)
D gvinumdrive1          State: up	/dev/da3	A: 0/69452 MB (0%)

1 volume:
V data0                 State: up	Plexes:       1	Size:        203 GB

1 plex:
P data0.p0           R5 State: up	Subdisks:     4	Size:        203 GB

4 subdisks:
S data0.p0.s3           State: up	D: gvinumdrive3 Size:         67 GB
S data0.p0.s2           State: up	D: gvinumdrive2 Size:         67 GB
S data0.p0.s1           State: up	D: gvinumdrive1 Size:         67 GB
S data0.p0.s0           State: up	D: gvinumdrive0 Size:         67 GB


rsync from / (plain UFS2) to /data (UFS2+SUJ over raid5) locks in a matter of seconds. Stay in "getblk" state.

ps / show pcpu / show alllocks / show threads / show lockedvnods
http://sparc64.pastebin.com/NBNQJJXs

bt on rsync
http://sparc64.pastebin.com/cCZx0FU7

Kernel compiled with
INVARIANTS
INVARIANT_SUPPORT
WITNESS
WITNESS_SKIPSPIN

Anything else?

-- 
Ollivier ROBERT -=- FreeBSD: The Power to Serve! -=- roberto@keltia.freenix.fr
In memoriam to Ondine : http://ondine.keltia.net/




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20100430143316.GA475>