From owner-freebsd-fs@freebsd.org Sat Jan 21 09:47:09 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CACE5CB9DE3 for ; Sat, 21 Jan 2017 09:47:09 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id B76EA1CC5 for ; Sat, 21 Jan 2017 09:47:09 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: by mailman.ysv.freebsd.org (Postfix) id B6BFBCB9DE2; Sat, 21 Jan 2017 09:47:09 +0000 (UTC) Delivered-To: fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B6655CB9DE1 for ; Sat, 21 Jan 2017 09:47:09 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: from mail.sub.ru (mail.sub.ru [88.212.205.2]) by mx1.freebsd.org (Postfix) with SMTP id 4AF571CC2 for ; Sat, 21 Jan 2017 09:47:08 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: (qmail 1123 invoked from network); 21 Jan 2017 12:47:04 +0300 Received: from ppp109-252-90-166.pppoe.spdop.ru (ppp109-252-90-166.pppoe.spdop.ru [109.252.90.166]) by mail.sub.ru ([88.212.205.2]) with ESMTP via TCP; 31 Dec 1969 23:59:59 -0000 Subject: Re: Poor ZFS performance To: "D. E" , "fs@freebsd.org" References: <083391de-d153-e0f6-c453-63d95d3e1f55@webmail.sub.ru> From: Alex Povolotsky Message-ID: Date: Sat, 21 Jan 2017 12:47:04 +0300 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-Antivirus: avast! (VPS 170120-2, 20.01.2017), Outbound message X-Antivirus-Status: Clean X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jan 2017 09:47:09 -0000 So fetching data to, say, ST2000NM0055-1V4104, and than zfs send | zfs receive to Archive HDD will do the trick? Seems like the answer is "yes", I've got 3-4 times speed improvement. In an hour, I'll try partial transfer. What 8 Tb disk would you recommend for raidz? On 21.01.2017 12:26, D. E wrote: >> I'm writing lots of (tens of millions) relatively small files, hashing >> them out in three-level directory, 100 entries per level. > >> Speed is quite unsatisfying, about 2 millions files per day writing in >> 20 processes, that is, about one file per second for process. > > But that is to be expected, isn't it? You have chosen hardware which is *EXTREMELY* slow for non-contiguous write access. The Seagate Archive HDD is an SMR harddrive suitable for archive storage - not a generic PMR harddrive. So the Seagate Archive HDD is suitable for makings backups and writing huge files like 1TB images which you write from A to Z. SMR drives are notoriously slow when it comes to non-contiguous writes, such as writing small files. > > You can read warnings about SMR and the Seagate Archive HDD in particular everywhere on the web. Have you missed them? > > Slightly exaggerated: your SMR-drive is more like a tapestreamer than a real harddrive. It should be used to store enormous files and used for 'cold storage'. > > Read more about the Seagate Archive HDD on its website: http://www.seagate.com/enterprise-storage/hard-disk-drives/archive-hdd/ > > To be honest, it is the worst harddrive one can buy today for the purpose of regular storage (hot storage). For cold storage, such as backups like tapestreamers do the drive is decent, but not good by any means. 1,33TB per platter is disappointing for SMR considering the massive downsides. And some PMR drives are even cheaper per gigabyte than this SMR drive. So i strongly recommend against SMR at this time. > > Regards, > CiPHER >