From owner-svn-src-all@freebsd.org Thu Apr 14 22:15:23 2016 Return-Path: Delivered-To: svn-src-all@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 64456ADA5F9 for ; Thu, 14 Apr 2016 22:15:23 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: from mail-qg0-x233.google.com (mail-qg0-x233.google.com [IPv6:2607:f8b0:400d:c04::233]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 18C3E11F9 for ; Thu, 14 Apr 2016 22:15:23 +0000 (UTC) (envelope-from shawn.webb@hardenedbsd.org) Received: by mail-qg0-x233.google.com with SMTP id f105so71900251qge.2 for ; Thu, 14 Apr 2016 15:15:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hardenedbsd-org.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to:user-agent; bh=lXc8YURCHn5SZMaUqTHXPIttkUHwSzlF+uoPSL5OXm8=; b=p5y7OyhqTbmY7h8NzDTtJ7H1EzidjmEdJ/MmdzbvJVSN2gGobO0lmz1wQQ9bKt7Coi VRqq1xo7+ritGGe4p3OQjofc25aAGHa/5n5gKMXgCtip/GzUzFu45wxwc947basB1H3v Go9HwjmHebtH+gUzwlqfAyTKX3+qzMYdrPVoJT+Iczp3YXlBIJFebO8w9XHSGPUdtFM/ vzFdCt6fQmvk5L3lZLhNROoQghDzFFHVFXRbxeDHrPctP6zqjUQFzr2Ag021zOiAcGsG JDKxWYryS0WDL+DzmzY8LXC05xxFBTWjofdLCFtQaqUKadzJS8zKR/C9fjnDkVZphLYQ 68nw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to:user-agent; bh=lXc8YURCHn5SZMaUqTHXPIttkUHwSzlF+uoPSL5OXm8=; b=S35OEIlWPcllWVnZfGOoYNs1ebhG8S2/pUG6VxjUQ6ZqkpfpyL4L/0ebZdToQpEcrZ PAJlyOD5qyNEZOfKJPtciEAs9mxICb9XKzVIu6HSvyA5PjHXapzuHO58O7VDCGErRLkr n3IW57/5m4jxGLw6YHBPHP35WW0tyDvu7LnzAppFX0x273FP4mlUnCUrRnUEGsdtV6IM SZFku3JYD6e01Vt4T5SOnTQYpiZFlUqdNG1z6NTqR0vVD23Hf0NnLvrgA9zvuOunJyfQ CI5Z2vvGJiRiSDu7h1YWiu6MMhytVjRpOWmEswuxIvyKx62j476cj/tsUwQ9zMgcn0PI tWZg== X-Gm-Message-State: AOPr4FXKcqOwA9hTIBKR0D3oJKTwhq0OOVcv1dM4JTx7k7e3jQhGCyC5+EBFJvkqFGQ66OvZ X-Received: by 10.140.94.167 with SMTP id g36mr21223266qge.1.1460672122254; Thu, 14 Apr 2016 15:15:22 -0700 (PDT) Received: from mutt-hardenedbsd (c-73-135-80-144.hsd1.md.comcast.net. [73.135.80.144]) by smtp.gmail.com with ESMTPSA id s85sm14794611qke.29.2016.04.14.15.15.20 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 14 Apr 2016 15:15:21 -0700 (PDT) Date: Thu, 14 Apr 2016 18:15:17 -0400 From: Shawn Webb To: Warner Losh Cc: Dmitry Morozovsky , "svn-src-head@freebsd.org" , "svn-src-all@freebsd.org" , src-committers , Warner Losh Subject: Re: svn commit: r298002 - in head/sys: cam cam/ata cam/scsi conf dev/ahci Message-ID: <20160414221517.GA66711@mutt-hardenedbsd> References: <201604142147.u3ELlwYo052010@repo.freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="dDRMvlgZJXvWKvBx" Content-Disposition: inline In-Reply-To: X-Operating-System: FreeBSD mutt-hardenedbsd 11.0-CURRENT-HBSD FreeBSD 11.0-CURRENT-HBSD X-PGP-Key: http://pgp.mit.edu/pks/lookup?op=vindex&search=0x6A84658F52456EEE User-Agent: Mutt/1.5.24 (2015-08-30) X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Apr 2016 22:15:23 -0000 --dDRMvlgZJXvWKvBx Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Apr 14, 2016 at 04:04:27PM -0600, Warner Losh wrote: > On Thu, Apr 14, 2016 at 3:54 PM, Dmitry Morozovsky wrote: >=20 > > Warner, > > > > On Thu, 14 Apr 2016, Warner Losh wrote: > > > > > Author: imp > > > Date: Thu Apr 14 21:47:58 2016 > > > New Revision: 298002 > > > URL: https://svnweb.freebsd.org/changeset/base/298002 > > > > > > Log: > > > New CAM I/O scheduler for FreeBSD. The default I/O scheduler is the > > same > > > > [snip] > > > > First, thanks so much for this quite a non-trivial work! > > What are the ways to enable this instead of deafult, and what ar the > > benefits > > and drawbacks? >=20 >=20 > You add CAM_NETFLIX_IOSCHED to your kernel config to enable it. Hmmm, > looking at the diff, perhaps I should add that to LINT. >=20 > In production, we use it for three things. First, our scheduler keeps a l= ot > more > statistics than the default one. These statistics are useful for us knowi= ng > when > a system is saturated and needs to shed load. Second, we favor reads over > writes because our workload, as you might imagine, is a read mostly work > load. > Finally, in some systems, we throttle the write throughput to the SSDs. T= he > SSDs > we buy can do 300MB/s write while serving 400MB/s read, but only for short > periods of time (long enough to do 10-20GB of traffic). After that, write > performance > drops, and read performance goes out the window. Experiments have shown t= hat > if we limit the write speed to no more than 30MB/s or so, then the garbage > collection the drive is doing won't adversely affect the read latency / > performance. Going on a tangent here, but related: As someone who is just barely stepping into the world of benchmarks and performance metrics, can you shed some light as to how you gained those metrics? I'd be extremely interested to learn. Thanks, --=20 Shawn Webb HardenedBSD GPG Key ID: 0x6A84658F52456EEE GPG Key Fingerprint: 2ABA B6BD EF6A F486 BE89 3D9E 6A84 658F 5245 6EEE --dDRMvlgZJXvWKvBx Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJXEBZzAAoJEGqEZY9SRW7uJl0P/2gIgto9LvTvKsF+cCC9zviA 0tdJUiZDQd5pYM5T2C/LW3bNjFebb/0gFrXrMXhxXzXIlseL5glYfdPe3rmiWLjl 9/TmaojeREhZWk406vVuB/ZAz82qG5aix+EltxrQp7ukdolEMajvm4DKM4K6Q0+t 2DdZ2YdtOnRGjPkcgHRYtzCzAfpOoCWPstohE8MLlWhrNl+RXOw6NB9tYxNjP0IB zPYz/9R4/DPhf3hRxLSr1OkIuhA1pqR0eN7Q9UpACYfAkrCz4KMGBgO1tU2e/26B Pqk+vGQO1OwLdNP4WHwqueC3gfbqB9yyJ1isDSlYaYhITFJynVw9MltLPXI3hNu0 lD8anIdQP9LhAeIJHFLZrYYq3zQ9Nl4zBWv93TCKHvyeot220wLcgBkXJx5Os9ko /Y8+YNeDogb/FI5+kwTPze5Rue+2Z/FnTpC77gvEkvF/AaaMtct9jDNL9DjYjHni 5YmgLzOaILrDET/BeV6jdNNcX/QMfIhfyXj0vYOfmd48+Aq0RgWG9N/pDGW8Wyla /Z7KZZAppxEwpQCVyw8TxCUTBLKMUhC8057jqcf83F/pBfRI6PrutwRAZG6qhfEp An6AlqxdUXpwVlHazDiCm6wGzClbnH+qV+8up1RNyvHdLCqJMYmXMCTZYOrqucnz pXENn6K4otp0rHrtwSUO =oDfk -----END PGP SIGNATURE----- --dDRMvlgZJXvWKvBx--