From owner-freebsd-performance@freebsd.org Wed Mar 9 18:11:19 2016 Return-Path: Delivered-To: freebsd-performance@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 58823AC9C7E for ; Wed, 9 Mar 2016 18:11:19 +0000 (UTC) (envelope-from bounce+b6268b.851d16-freebsd-performance=freebsd.org@0x7f.co) Received: from rs224.mailgun.us (rs224.mailgun.us [209.61.151.224]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 17EA798A for ; Wed, 9 Mar 2016 18:11:18 +0000 (UTC) (envelope-from bounce+b6268b.851d16-freebsd-performance=freebsd.org@0x7f.co) DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=0x7f.co; q=dns/txt; s=mx; t=1457547077; h=Content-Type: To: From: Subject: Message-ID: Date: MIME-Version: Sender; bh=O/wDUjiICSyEohyxRLQY2bhDBjOsUbVr2ok05E8SybI=; b=V48+VXykKCH386c3zb1opoRk6PM9rB71C1fqu1ErsPzHWz7W82fjvwqLP9njYq2RHcEn+o3f RCNkf0mYGDkEngWIiCvPnDeuj9T9uXFOc/P+W/w6sqYKi/RfVtwYFKPZ9n2deziKq33i3Zqv 7HUyisAFzl8p7/tCP5Vw1zStaUo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=0x7f.co; s=mx; q=dns; h=Sender: MIME-Version: Date: Message-ID: Subject: From: To: Content-Type; b=YWuzBlsGlVtStbk4J2gi+ZAELeMhv0Az+gBS6uQX75BxuYhWD+J9ePb1YG9pN5LDMUuhLk +PO7wUTc1pEw4zg0TGwcRInvX9tjNpR4yViVM6QF5jshJAr8aagsrfJhgvkh6OT+25MRWEzm BgkLR68pzk2furdC4BN9a4p0s2OzY= Sender: freebsd@0x7f.co X-Mailgun-Sid: WyI2ZWE1NCIsICJmcmVlYnNkLXBlcmZvcm1hbmNlQGZyZWVic2Qub3JnIiwgIjg1MWQxNiJd Received: from mail-wm0-f48.google.com (mail-wm0-f48.google.com [74.125.82.48]) by mxa.mailgun.org with ESMTP id 56e06743.7fcba92639b0-in7; Wed, 09 Mar 2016 18:11:15 -0000 (UTC) Received: by mail-wm0-f48.google.com with SMTP id p65so203771754wmp.1 for ; Wed, 09 Mar 2016 10:11:14 -0800 (PST) X-Gm-Message-State: AD7BkJLiz+Mw7VXEFmZnukKcDnweEXPxS4tQLPRNz+czl7NrmOkeGVwynjFnFH/ZtvHc0ZATCmpH6y12No0YuQ== MIME-Version: 1.0 X-Received: by 10.194.23.37 with SMTP id j5mr35411289wjf.171.1457547073649; Wed, 09 Mar 2016 10:11:13 -0800 (PST) Received: by 10.28.174.145 with HTTP; Wed, 9 Mar 2016 10:11:13 -0800 (PST) Date: Wed, 9 Mar 2016 13:11:13 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: geli vs openssl, geli is much slower From: Anonymous To: freebsd-performance@freebsd.org Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2016 18:11:19 -0000 Hello All, The disk encryption on my NAS (RAIDZ1 + ZFS + GELI (aes-128-xts)) is running much slower than expected (80MB/S). It seems that GELI is much slower than openssl for aes-128-xts (and aes-128-cbc as well). The results might be similar for other ciphers, but I only verified aes-128-xts and aes-128-cbc. My NAS is running 9.3, but I was able to replicate on FreeBSD 10.2 (recent VM image) on a different machine (i7-4770HQ). * OpenSSL w/o AES-NI: OPENSSL_ia32cap="~0x200000200000000" openssl speed -elapsed -evp aes-128-xts type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes aes-128-xts 49702.86k 140889.72k 358413.11k 444357.17k 482859.72k * OpenSSL w/ AES-NI (not relevant, for demonstration purpose): openssl speed -elapsed -evp aes-128-xts type 16 bytes 64 bytes 256 bytes 1024 bytes 8192 bytes aes-128-xts 417564.07k 1253833.96k 2302266.40k 2993555.43k 3411513.42k * w/ gzero: dd if=/dev/zero of=/dev/gzero.eli bs=1m count=1000 1000+0 records in 1000+0 records out 1048576000 bytes transferred in 13.107259 secs (79999640 bytes/sec) geli is only seing 76MB/s (4k sector) while openssl (even at 1k sector sizes) is doing 433 MB/s. Am I comparing apples and oranges? Is this to be expected? NOTE: It should not be related to AES-NI since my processor (an X3450) doesn't support AES-NI, and I was seeing similar results. NOTE2: # uname -a FreeBSD 10.2-RELEASE FreeBSD 10.2-RELEASE #0 r286666: Wed Aug 12 15:26:37 UTC 2015 root at releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 # openssl version OpenSSL 1.0.1p-freebsd 9 Jul 2015