From owner-freebsd-arch Thu Nov 11 20:16:50 1999 Delivered-To: freebsd-arch@freebsd.org Received: from ns1.yes.no (ns1.yes.no [195.204.136.10]) by hub.freebsd.org (Postfix) with ESMTP id 2DF61154AD for ; Thu, 11 Nov 1999 20:16:36 -0800 (PST) (envelope-from eivind@bitbox.follo.net) Received: from bitbox.follo.net (bitbox.follo.net [195.204.143.218]) by ns1.yes.no (8.9.3/8.9.3) with ESMTP id FAA09543 for ; Fri, 12 Nov 1999 05:16:34 +0100 (CET) Received: (from eivind@localhost) by bitbox.follo.net (8.8.8/8.8.6) id FAA15823 for freebsd-arch@freebsd.org; Fri, 12 Nov 1999 05:16:34 +0100 (MET) Received: from nomis.simon-shapiro.org (nomis.simon-shapiro.org [209.86.126.163]) by hub.freebsd.org (Postfix) with SMTP id 95923154C7 for ; Thu, 11 Nov 1999 20:15:01 -0800 (PST) (envelope-from shimon@simon-shapiro.org) Received: (qmail 42339 invoked from network); 12 Nov 1999 04:15:00 -0000 Received: from localhost.simon-shapiro.org (HELO simon-shapiro.org) (127.0.0.1) by localhost.simon-shapiro.org with SMTP; 12 Nov 1999 04:15:00 -0000 Message-ID: <382B9444.44600C3@simon-shapiro.org> Date: Thu, 11 Nov 1999 23:15:00 -0500 From: Simon Shapiro Organization: Simon's Garage X-Mailer: Mozilla 4.6 [en] (X11; I; FreeBSD 3.3-STABLE i386) X-Accept-Language: en-US MIME-Version: 1.0 To: "Kenneth D. Merry" Cc: Randell Jesup , freebsd-arch@freebsd.org Subject: Re: I/O Evaluation Questions (Long but interesting!) References: <199911120400.VAA31700@panzer.kdm.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-arch@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG "Kenneth D. Merry" wrote: > > Simon Shapiro wrote... > > "Kenneth D. Merry" wrote: > > > > > > [ Simon: the "charset = " (i.e. nothing) line your mail makes my mailer > > > barf. You may want to adjust your character set. ] > > [ Am using Netscape Messenger. Know not how to do that > > (no relevant preference found :-( ] > > My best guess is, go to: > > Edit -> Preferences -> Navigator -> Languages > > And make sure you at least have English defined there. Also, go to: > > View -> Character Set > > And make sure you've got Western (ISO-8559-1) defined. How's that? (sorry for the spam...) > > > Simon Shapiro wrote... > > > > Randell Jesup wrote: > > > > > Unlikely, though, and very tricky. (Interesting idea, though - > > > > > pseudo-mmap.) They also could set up the DMA, and mark the pages in the > > > > > page table so that you'll fault if you try to access them, and then undo > > > > > the mark when the IO is done (or as each N pages of the IO is done make > > > > > those N pages accessible). There are many cute tricks here... > > > > > > > > > > What hardware do you have that gives 100MB/s or more??? > > > > > > > > (bragging corner: 167 read, 138 write :-) DPT PM3755U2B with > > > > 256MB of ECC cache in a Dell PowerEdge 1300/600. > > > > FreeBSD RELENG_3, single CPU running. > > > > > > How can you get speeds like that with just a 32-bit PCI bus? The specs for > > > the PowerEdge 1300 say it has 5 32-bit PCI slots: > > > > These numbers are for block devices. The kernel obviously > > caches some of this. I should look next time at emory usage; > > The machine has 1GB of memory. The dataset is about 15GB per > > array. > > Is that for random or sequential I/O? With sequential I/O, you would > probably blow away any caching effects. With random I/O, though, you might > get significant help from the cache, especially with that much RAM. Random, of course. To stay architectually minded, please consider these thoughts: Increasing the workers load in this test increases measured throughput (which is to be expected). However, past about 400 concurrent workers, performance declines rapidly. At about 600 the system simply goes nuts. Processes exit or hang solidly without any warnings. Must be some resources to be increased. How is the ftp.cdrom.com kernel configured? This may help me. > > I am getting about 120MB/Sec form the PCI > > bus. > > I can believe that. > > > Raw disks perfromance is totally throttled by physics; > > We are running at about 200% of Seagate specs. > > How can you run at 200% of the spec? Most of the time disk manufacturers > are even a little optimistic about their high end performance. I suspect caching on the disk. I also know the DPT firmware, while claiming not to do READ caching, does some very interesting things with sorting, queuing, tagging, etc. This is worth the difference. More or less. BTW, I am not looking at claimed benchmarks from the mfgs. I am looking at what tends to be accurately reported; Sek times, internal transfer rates, data sheets timing specs, etc. > > I am running into some strange situations. Perhaps some > > light can be shed; > > Sorry, no clue there. :-( Holds me and a bunch others back. > Ken > -- > Kenneth Merry > ken@kdm.org -- Sincerely Yours, Shimon@Simon-Shapiro.ORG 404.664.6401 Simon Shapiro Unwritten code has no bugs and executes at twice the speed of mouth To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-arch" in the body of the message