Date: Tue, 04 Mar 2003 11:41:21 -0800 From: Rick Jones <rick_jones2@hp.com> To: ia64@FreeBSD.ORG Subject: Re: initial netperf tests on rx2600 Message-ID: <3E650160.18B891D6@hp.com> References: <3E6401FD.E2B384E3@hp.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format. --------------10B7BF6B577D00E216820906 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit > BTW, what would be the "best" way for netperf to obtain programatic > CPU utilization figures. At present, it measures CPU util by taking > "idle rates" before a test and comparing them with during a test. > What api might netperf call to retrieve that sort of data? attached is a run of the "packet_byte_script" which I use to try to estimate per-packet and per-byte costs for stacks. the "L" in the CPU util column means that the "looper processes" (aka soaker) was used to measure CPU util during the test. You can see that the tests did not often hit the desired confidence intervals (having asked for a 5% interval with 99% confidence). I'm thinking that the use of a looper process was related to this, hence my desire to find something else - but not statistical - to take its place. rick jones -- Wisdom Teeth are impacted, people are affected by the effects of events. these opinions are mine, all mine; HP might not want them anyway... :) feel free to post, OR email to raj in cup.hp.com but NOT BOTH... --------------10B7BF6B577D00E216820906 Content-Type: text/plain; charset=us-ascii; name="rx2601_1GHz_fbsd5.0_core_to_rp2472_750MHz_cpu0_tg3.pab" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="rx2601_1GHz_fbsd5.0_core_to_rp2472_750MHz_cpu0_tg3.pab" ------------------------------------------------------ Testing with the following command line: ./netperf -l 20 -H 192.168.1.67 -t TCP_RR -c 617730 -C 7.47812e+08 -i 10,3 -I 99,5 -- -s 0 -S 0 and these settings for send sizes 1 16 32 64 128 256 512 1024 1460 1461 2920 2921 4380 4381 TCP REQUEST/RESPONSE TEST to 192.168.1.67 : +/-2.5% @ 99% conf. !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 12.8% !!! Remote CPU util : 1.5% Local /Remote Socket Size Request Resp. Elapsed Trans. CPU CPU S.dem S.dem Send Recv Size Size Time Rate local remote local remote bytes bytes bytes bytes secs. per sec % L % I us/Tr us/Tr 32768 65536 1 1 20.02 6779.48 19.73 8.82 29.109 26.008 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 8.9% !!! Remote CPU util : 1.4% 32768 65536 16 1 20.02 6780.05 19.47 8.90 28.714 26.250 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 10.9% !!! Remote CPU util : 1.6% 32768 65536 32 1 20.02 6779.62 19.76 8.90 29.147 26.246 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 7.2% !!! Remote CPU util : 1.3% 32768 65536 64 1 20.02 6778.09 19.67 8.94 29.022 26.386 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 9.2% !!! Remote CPU util : 1.9% 32768 65536 128 1 20.02 6775.70 19.89 9.02 29.357 26.611 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 7.9% !!! Remote CPU util : 1.7% 32768 65536 256 1 20.02 6761.37 19.93 9.09 29.480 26.875 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 1.6% !!! Local CPU util : 20.0% !!! Remote CPU util : 4.0% 32768 65536 512 1 20.02 3381.74 12.32 4.75 36.434 28.077 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 1.0% !!! Local CPU util : 16.7% !!! Remote CPU util : 2.8% 32768 65536 1024 1 20.02 3384.02 11.81 4.86 34.906 28.740 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 31.0% !!! Remote CPU util : 6.7% 32768 65536 1460 1 20.02 2267.46 7.78 3.47 34.320 30.625 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 18.1% !!! Remote CPU util : 3.5% 32768 65536 1461 1 20.02 2267.38 9.16 4.01 40.420 35.385 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 16.0% !!! Remote CPU util : 3.0% 32768 65536 2920 1 20.02 2267.49 10.44 4.77 46.049 42.035 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 19.1% !!! Remote CPU util : 1.8% 32768 65536 2921 1 20.02 2267.63 11.12 5.39 49.039 47.538 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 27.6% !!! Remote CPU util : 2.4% 32768 65536 4380 1 20.02 2267.32 10.98 5.82 48.442 51.316 32768 32768 32768 65536 4381 1 20.02 2267.25 12.36 6.40 54.517 56.443 32768 32768 ------------------------------------------------------ Testing with the following command line: ./netperf -l 20 -H 192.168.1.67 -t TCP_RR -c 617730 -C 7.47812e+08 -i 10,3 -I 99,5 -- -s 0 -S 0 and these settings for response sizes 1 16 32 64 128 256 512 1024 1460 1461 2920 2921 4380 4381 TCP REQUEST/RESPONSE TEST to 192.168.1.67 : +/-2.5% @ 99% conf. !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 12.2% !!! Remote CPU util : 2.3% Local /Remote Socket Size Request Resp. Elapsed Trans. CPU CPU S.dem S.dem Send Recv Size Size Time Rate local remote local remote bytes bytes bytes bytes secs. per sec % L % I us/Tr us/Tr 32768 65536 1 1 20.02 6779.80 19.56 8.84 28.848 26.068 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 13.1% !!! Remote CPU util : 2.1% 32768 65536 1 16 20.02 6779.34 20.16 8.91 29.738 26.282 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 12.2% !!! Remote CPU util : 1.0% 32768 65536 1 32 20.02 6778.63 19.75 8.90 29.141 26.249 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 8.8% !!! Remote CPU util : 1.4% 32768 65536 1 64 20.02 6778.66 19.60 8.83 28.918 26.051 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 9.2% !!! Remote CPU util : 2.9% 32768 65536 1 128 20.02 6775.18 20.36 8.94 30.056 26.391 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.2% !!! Local CPU util : 5.1% !!! Remote CPU util : 1.6% 32768 65536 1 256 20.02 6764.86 19.72 8.92 29.146 26.386 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 1.6% !!! Local CPU util : 11.0% !!! Remote CPU util : 4.0% 32768 65536 1 512 20.02 3382.19 11.72 4.70 34.653 27.785 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 1.6% !!! Local CPU util : 18.4% !!! Remote CPU util : 3.3% 32768 65536 1 1024 20.02 3376.75 13.32 4.80 39.453 28.409 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 20.5% !!! Remote CPU util : 7.9% 32768 65536 1 1460 20.02 2267.61 8.90 3.45 39.260 30.449 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 20.9% !!! Remote CPU util : 2.0% 32768 65536 1 1461 20.02 2267.56 10.48 4.93 46.213 43.471 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 17.6% !!! Remote CPU util : 2.0% 32768 65536 1 2920 20.02 2267.37 14.23 6.16 62.744 54.326 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.0% !!! Local CPU util : 11.3% !!! Remote CPU util : 1.8% 32768 65536 1 2921 20.02 2267.23 14.97 6.91 66.024 60.963 32768 32768 32768 65536 1 4380 20.02 2267.16 15.49 7.21 68.317 63.619 32768 32768 !!! WARNING !!! Desired confidence was not achieved within the specified iterations. !!! This implies that there was variability in the test environment that !!! must be investigated before going further. !!! Confidence intervals: Throughput : 0.1% !!! Local CPU util : 8.7% !!! Remote CPU util : 1.2% 32768 65536 1 4381 20.02 2266.94 17.38 8.63 76.654 76.099 32768 32768 ------------------------------------------------------ Testing with the following command line: ./netperf -l 20 -H 192.168.1.67 -t TCP_STREAM -c 617730 -C 7.47812e+08 -i 10,3 -I 99,5 -- -s 0 -S 0 and these settings for response sizes 1 16 32 64 128 256 512 1024 1460 1461 2920 2921 4380 4381 TCP STREAM TEST to 192.168.1.67 : +/-2.5% @ 99% conf. : nodelay Recv Send Send Utilization Service Demand Socket Socket Message Elapsed Send Recv Send Recv Size Size Size Time Throughput local remote local remote bytes bytes bytes secs. 10^6bits/s % L % I us/KB us/KB 32768 32768 1 20.02 0.62 78.65 48.03 10438.249 12746.943 32768 32768 16 20.02 9.36 76.02 47.06 665.169 823.589 32768 32768 32 20.02 18.41 74.27 46.11 330.449 410.291 32768 32768 64 20.04 35.24 71.44 44.17 166.096 205.359 32768 32768 128 20.02 68.50 74.40 43.40 88.977 103.819 32768 32768 256 20.02 122.86 70.02 40.25 46.689 53.675 32768 32768 512 20.03 229.41 67.64 39.22 24.156 28.013 32768 32768 1024 20.02 545.71 89.18 53.25 13.387 15.986 32768 32768 1460 20.02 524.13 51.96 37.13 8.121 11.606 32768 32768 1461 20.02 497.88 75.54 52.93 12.429 17.419 32768 32768 2920 20.02 524.01 49.54 35.45 7.745 11.085 32768 32768 2921 20.02 524.77 64.57 43.77 10.080 13.667 32768 32768 4380 20.02 523.93 48.57 32.78 7.594 10.252 32768 32768 4381 20.02 559.45 64.57 41.86 9.455 12.260 ------------------------------------------------------ ./netperf -l 120 -H 192.168.1.67 -t TCP_CRR -c 617730 -C 7.47812e+08 -i 10,3 -I 99,5 -- -s 0 -S 0 TCP Connect/Request/Response TEST to 192.168.1.67 : +/-2.5% @ 99% conf. Local /Remote Socket Size Request Resp. Elapsed Trans. CPU CPU S.dem S.dem Send Recv Size Size Time Rate local remote local remote bytes bytes bytes bytes secs. per sec % % us/Tr us/Tr 32768 65536 1 1 120.13 3382.71 36.19 23.95 106.984 70.808 32768 32768 # ./netperf -l 20 -H 192.168.1.67 -c 617730 -i 10,3 -I 99,5 -- -s 128K -S 128K -m 32K TCP STREAM TEST to 192.168.1.67 : +/-2.5% @ 99% conf. Recv Send Send Utilization Service Demand Socket Socket Message Elapsed Send Recv Send Recv Size Size Size Time Throughput local remote local remote bytes bytes bytes secs. 10^6bits/s % L % U us/KB us/KB 131072 131072 32768 20.02 909.39 81.58 -1.00 7.349 -1.000 --------------10B7BF6B577D00E216820906-- To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-ia64" in the body of the message
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3E650160.18B891D6>