Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 20 Apr 2015 11:02:11 +0300
From:      =?UTF-8?B?0KHQtdC80ZHQvSDQodC10LzQuNC60LjQvQ==?= <semikin@alpha-it.ru>
To:        freebsd-bugs@freebsd.org
Subject:   trim load ssd on 100% zfs or geom bug?
Message-ID:  <CAOd6N9wBdk9bbw5aQJUW3sr7WkmiRtw%2BCS9wOsJ7=qfaTCWj3Q@mail.gmail.com>

next in thread | raw e-mail | index | archive | help
Hello.
I found a strange behavior with ssd drives trim perfomance.
I have zfs mirror on 2 ssd drives (ashift=12, aligment 4k).
When i migrate sql server to that storage i found that ssd become always
busy and having io queue lenth ~60, some count of read and write, and 128
bio_delele (trim) operations in gstat statiscs.
After much tests and googling i found sysctl varianle
vfs.zfs.vdev.trim_max_active with default value 64 that limit number of
active trim operations.
Problem appears when zfs continiously fill queue of drive by trim
operation(2 times in second).
If i change vfs.zfs.vdev.trim_max_active to 1000, zfs send 2000 trim
operations to drive per second and drive iops and busy level become to
normal state.
When i set vfs.zfs.vdev.trim_max_active to low number 8 device have 16
bio_delele
per second and device busy level become 100%.
I try to work with another partition on same drive(i thinking that it is
zfs bug) and found that such operation is also suffer so i concluded that
zfs have no guilt.
I try to determinate how freebsd calculate busy levels and find that it
data come fom geom (geom_stats_open geom_stats_snapshot_next
geom_stats_snapshot_get...)
So when device make 16 trim per second - it 100% busy, latency big, iops
slow.
When device make 2000 and more trims per second - device free, queue empty,
latency great.
So what is it? Bug or feature?
I also check device trim performance by UFS: my ssd drive can perform about
7000 trim operations per second with block size 64k(and more with less
block size). So probably zfs trim (by 128k) will perform 3000 trims, but i
can't generate so much trim activity to find exact value.

FreeBSD 10.1-RELEASE-p8
Regards, Semen



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOd6N9wBdk9bbw5aQJUW3sr7WkmiRtw%2BCS9wOsJ7=qfaTCWj3Q>