User Tools

Site Tools

A PCRE internal error occured. This might be caused by a faulty plugin

fdtresults

====== FDT Results ====== Below we list a simple experiment that transfers a 478M file from a server with hostname "net-server-2" to a client with hostname "net-server-1" over a 1Gbps link. We assume FDT is installed on both machines in directory "~/fdt". Create the file and host the FDT server: <code> [net-test-2]# cd ~/fdt [net-test-2]# dd if=/dev/zero of=500-file.data bs=1MB count=500 [net-test-2]# md5sum 500-file.data [net-test-2]# ./fdtServer.sh </code> Use the client to copy the file from the server: <code> [net-test-1]# cd ~/fdt [net-test-1]# ./fdtClient.sh -pull -c net-test-2 500-file.data -d . [net-test-1]# md5sum 500-file.data </code> For this test with RTT of **0.010ms**, we have a transfer period of **16s**, or a throughput of **239Mbps**. Note that there is a BDP of 0.010ms * 1Gbps = **1.31072KB**. We had a Net In average of **450.251Mbps** and Avg: **450.251Mbps**, with Avg disk write of: **225.103Mbps**. Using the dummynet with a RTT set to **100ms**, we have a transfer period of **20s**, or a throughput of **191.2Mbps**. Note that there is a BDP of 100ms * 1Gbps = **12.8MB**. We had a Net In average of **309.842Mbps** and Avg: **398.217Mbps**, with Avg disk write of: **265.46Mbps**. By default FDT uses 4 parallel streams, now we will test the transfer with 8 parallel streams: <code> [net-test-1]# cd ~/fdt [net-test-1]# ./fdtClient.sh -pull -c net-test-2 500-file.data -d . -P 8 [net-test-1]# md5sum 500-file.data </code> Using the dummynet with a RTT set to **100ms**, we have a transfer period of **19s**, or a throughput of **201.3Mbps**. Note that there is a BDP of 100ms * 1Gbps = **12.8MB**. We had a Net In average of **796.343Mbps** and Avg: **796.343Mbps**, with Avg disk write of: **398.052Mbps**. ====== felCat4.2bit 806192 bytes, Mem-mem, 100ms RTT, 0 pkt loss ====== {{http://chart.apis.google.com/chart?chxl=1:%7c4%7c6%7c8%7c10%7c12&chxr=0,0,25&chxt=y,x&chbh=a&chs=300x225&cht=bvg&chco=A2C180&chds=0,25&chd=t:21.6,17.67,17,17.34,18&chtt=FDT+mem-mem%2C+806192+bytes&.png?}} <code> through dummynet wan2 788mb cat (4 streams) 1. 22/04 21:28:58 Net In: 501.667 Mb/s Avg: 501.667 Mb/s 22/04 21:29:03 Net In: 575.637 Mb/s Avg: 538.659 Mb/s Transfer period: 22s 2. 22/04 21:29:51 Net In: 558.462 Mb/s Avg: 558.462 Mb/s 22/04 21:29:56 Net In: 605.479 Mb/s Avg: 581.919 Mb/s 22/04 21:30:01 Net In: 150.615 Mb/s Avg: 438.170 Mb/s 100.00% ( 00s ) Transfer period: 21s 3. 22/04 21:30:59 Net In: 437.020 Mb/s Avg: 437.020 Mb/s 22/04 21:31:04 Net In: 567.302 Mb/s Avg: 502.161 Mb/s 22/04 21:31:09 Net In: 310.019 Mb/s Avg: 438.113 Mb/s1 Transfer period: 22s through dummynet wan2 788mb cat (6 streams) 1. 22/04 21:42:21 Net In: 784.635 Mb/s Avg: 784.635 Mb/s 22/04 21:42:26 Net In: 529.316 Mb/s Avg: 656.897 Mb/s Transfer period: 17s 2. 22/04 21:43:24 Net In: 723.623 Mb/s Avg: 723.623 Mb/s 22/04 21:43:29 Net In: 589.816 Mb/s Avg: 656.640 Mb/s Transfer period: 19s 3. 22/04 21:44:10 Net In: 814.112 Mb/s Avg: 814.112 Mb/s 22/04 21:44:15 Net In: 500.012 Mb/s Avg: 656.949 Mb/s Transfer period: 17s through dummynet wan2 788mb cat (8 streams) 1. 22/04 18:41:07 Net In: 805.100 Mb/s Avg: 805.100 Mb/s 22/04 18:41:12 Net In: 510.615 Mb/s Avg: 657.828 Mb/s Transfer period: 17s 2. 22/04 21:26:38 Net In: 818.788 Mb/s Avg: 818.788 Mb/s 22/04 21:26:43 Net In: 496.035 Mb/s Avg: 657.298 Mb/s Transfer period: 17s 3. 22/04 21:28:04 Net In: 843.213 Mb/s Avg: 843.213 Mb/s 22/04 21:28:09 Net In: 471.038 Mb/s Avg: 657.004 Mb/s Transfer period: 17s through dummynet wan2 788mb cat (10 streams) 1. 22/04 21:46:16 Net In: 794.490 Mb/s Avg: 794.490 Mb/s 22/04 21:46:21 Net In: 521.501 Mb/s Avg: 657.982 Mb/s Transfer period: 18s 2. 22/04 21:47:18 Net In: 799.751 Mb/s Avg: 799.751 Mb/s 22/04 21:47:23 Net In: 515.986 Mb/s Avg: 657.826 Mb/s Transfer period: 17s 3. 22/04 21:49:16 Net In: 815.398 Mb/s Avg: 815.398 Mb/s 22/04 21:49:21 Net In: 500.277 Mb/s Avg: 657.790 Mb/s Transfer period: 17s through dummynet wan2 788mb cat (12 streams) 1. 22/04 21:39:35 Net In: 759.637 Mb/s Avg: 759.637 Mb/s 22/04 21:39:40 Net In: 557.083 Mb/s Avg: 658.340 Mb/s Transfer period: 18s 2. 22/04 21:40:31 Net In: 778.779 Mb/s Avg: 778.779 Mb/s 22/04 21:40:36 Net In: 537.939 Mb/s Avg: 658.335 Mb/s Transfer period: 18s 3. 22/04 21:41:19 Net In: 775.203 Mb/s Avg: 775.203 Mb/s 22/04 21:41:24 Net In: 541.706 Mb/s Avg: 658.354 Mb/s Transfer period: 18s </code> ====== Homo sapien (3886166830 bytes), mem-mem, 100ms RTT 0% pkt loss ====== {{http://chart.apis.google.com/chart?chxl=1:%7c4%7c6%7c8%7c10%7c12&chxr=0,0,48&chxt=y,x&chbh=a&chs=300x225&cht=bvg&chco=A2C180&chds=0,48&chd=t:46,45,44,44,45&chtt=FDT+mem-mem%2C+3886166830+bytes&.png?}} We used the following tcp settings: <code> # Static Common Parameters net.ipv4.ip_forward = 0 net.ipv4.conf.default.rp_filter = 1 net.ipv4.conf.default.accept_source_route = 0 kernel.sysrq = 0 kernel.core_uses_pid = 1 net.ipv4.tcp_syncookies = 1 kernel.msgmnb = 65536 kernel.msgmax = 65536 kernel.shmmax = 68719476736 kernel.shmall = 4294967296 # Custom Parameters set by modSysctl net.core.rmem_max=16777216 net.core.wmem_max=16777216 net.ipv4.tcp_rmem=4096 87380 16777216 net.ipv4.tcp_wmem=4096 87380 16777216 net.core.netdev_max_backlog=30000 net.ipv4.tcp_congestion_control=htcp net.ipv4.tcp_window_scaling=1 </code> **4 parallel streams** <code> INFO: Requested window size -1. Using window size: 43690 25/04 19:05:45 Net In: 638.997 Mb/s Avg: 638.997 Mb/s 25/04 19:05:50 Net In: 919.210 Mb/s Avg: 779.096 Mb/s 25/04 19:05:55 Net In: 901.718 Mb/s Avg: 819.910 Mb/s 25/04 19:06:00 Net In: 848.939 Mb/s Avg: 827.166 Mb/s 53.26% ( 17s ) 25/04 19:06:05 Net In: 877.686 Mb/s Avg: 837.269 Mb/s 67.37% ( 12s ) 25/04 19:06:10 Net In: 911.560 Mb/s Avg: 849.649 Mb/s 82.05% ( 06s ) 25/04 19:06:15 Net In: 928.149 Mb/s Avg: 860.863 Mb/s 97.00% ( 01s ) 25/04 19:06:20 Net In: 184.508 Mb/s Avg: 776.310 Mb/s 100.00% ( 00s ) Transfer period: 46s </code> <code> $ fdtClient.sh -pull -c wan1 xenoMrna.fa -d . -P 4 -ss 16M &> output INFO: Requested window size 16777216. Using window size: 16777216 25/04 19:12:30 Net In: 553.170 Mb/s Avg: 553.170 Mb/s 25/04 19:12:35 Net In: 913.072 Mb/s Avg: 733.157 Mb/s 25/04 19:12:40 Net In: 882.125 Mb/s Avg: 782.761 Mb/s 25/04 19:12:45 Net In: 891.221 Mb/s Avg: 809.874 Mb/s 52.16% ( 18s ) 25/04 19:12:50 Net In: 937.617 Mb/s Avg: 835.426 Mb/s 67.24% ( 12s ) 25/04 19:12:55 Net In: 887.844 Mb/s Avg: 844.163 Mb/s 81.51% ( 06s ) 25/04 19:13:05 Net In: 250.629 Mb/s Avg: 776.319 Mb/s 100.00% ( 00s ) Transfer period: 46s </code> **6 parallel streams** <code> $ fdtClient.sh -pull -c wan1 xenoMrna.fa -d . -P 6 -ss 16M &> output INFO: Requested window size 16777216. Using window size: 16777216 25/04 19:17:02 Net In: 620.962 Mb/s Avg: 620.962 Mb/s 25/04 19:17:07 Net In: 937.863 Mb/s Avg: 779.444 Mb/s 25/04 19:17:12 Net In: 882.107 Mb/s Avg: 813.611 Mb/s 25/04 19:17:17 Net In: 925.178 Mb/s Avg: 841.501 Mb/s 54.15% ( 16s ) 25/04 19:17:22 Net In: 906.778 Mb/s Avg: 854.556 Mb/s 68.75% ( 11s ) 25/04 19:17:27 Net In: 940.835 Mb/s Avg: 868.935 Mb/s 83.91% ( 05s ) 25/04 19:17:32 Net In: 917.431 Mb/s Avg: 875.839 Mb/s 98.67% ( 00s ) 25/04 19:17:37 Net In: 78.803 Mb/s Avg: 776.215 Mb/s 100.00% ( 00s ) Transfer period: 45s </code> **8 parallel streams** <code> $ fdtClient.sh -pull -c wan1 xenoMrna.fa -d . -P 8 -ss 16M &> output INFO: Requested window size 16777216. Using window size: 16777216 25/04 19:19:23 Net In: 731.620 Mb/s Avg: 731.620 Mb/s 25/04 19:19:28 Net In: 923.054 Mb/s Avg: 827.283 Mb/s 25/04 19:19:33 Net In: 940.236 Mb/s Avg: 864.866 Mb/s 41.71% ( 20s ) 25/04 19:19:38 Net In: 934.248 Mb/s Avg: 882.210 Mb/s 56.74% ( 15s ) 25/04 19:19:43 Net In: 939.890 Mb/s Avg: 893.709 Mb/s 71.85% ( 09s ) 25/04 19:19:48 Net In: 925.560 Mb/s Avg: 898.987 Mb/s 86.75% ( 04s ) 25/04 19:19:53 Net In: 817.280 Mb/s Avg: 887.291 Mb/s 100.00% ( 00s ) Transfer period: 44s </code> **10 parallel streams** <code> $ fdtClient.sh -pull -c wan1 xenoMrna.fa -d . -P 10 -ss 16M &> output INFO: Requested window size 16777216. Using window size: 16777216 25/04 19:22:00 Net In: 796.676 Mb/s Avg: 796.676 Mb/s 25/04 19:22:05 Net In: 941.468 Mb/s Avg: 869.072 Mb/s 25/04 19:22:10 Net In: 935.531 Mb/s Avg: 891.160 Mb/s 42.93% ( 19s ) 25/04 19:22:15 Net In: 941.611 Mb/s Avg: 903.724 Mb/s 58.07% ( 14s ) 25/04 19:22:20 Net In: 941.628 Mb/s Avg: 911.266 Mb/s 73.20% ( 09s ) 25/04 19:22:25 Net In: 941.498 Mb/s Avg: 916.303 Mb/s 88.39% ( 03s ) 25/04 19:22:30 Net In: 714.755 Mb/s Avg: 887.495 Mb/s 100.00% ( 00s ) Transfer period: 44s </code> **12 parallel streams** <code> $ fdtClient.sh -pull -c wan1 xenoMrna.fa -d . -P 12 -ss 16M &> output INFO: Requested window size 16777216. Using window size: 16777216 25/04 19:24:30 Net In: 762.539 Mb/s Avg: 762.539 Mb/s 25/04 19:24:35 Net In: 935.799 Mb/s Avg: 849.119 Mb/s 25/04 19:24:40 Net In: 941.636 Mb/s Avg: 879.893 Mb/s 25/04 19:24:45 Net In: 930.253 Mb/s Avg: 892.438 Mb/s 57.28% ( 14s ) 25/04 19:24:50 Net In: 941.473 Mb/s Avg: 902.206 Mb/s 72.45% ( 09s ) 25/04 19:24:55 Net In: 938.589 Mb/s Avg: 908.270 Mb/s 87.53% ( 04s ) 25/04 19:25:00 Net In: 762.289 Mb/s Avg: 887.391 Mb/s 99.95% ( 00s ) 25/04 19:25:05 Net In: 2.241 Mb/s Avg: 776.736 Mb/s 100.00% ( 00s ) Transfer period: 45s </code> ====== Homo sapien (3886166830 bytes), disk-disk, 100ms RTT 0% pkt loss ====== **12 parallel streams (blocking io)** <code> INFO: Requested window size 16777216. Using window size: 16777216 25/04 19:30:24 Net In: 638.029 Mb/s Avg: 638.029 Mb/s 25/04 19:30:29 Net In: 936.605 Mb/s Avg: 787.268 Mb/s 25/04 19:30:34 Net In: 895.062 Mb/s Avg: 823.197 Mb/s 39.58% ( 22s ) 25/04 19:30:39 Net In: 902.941 Mb/s Avg: 843.090 Mb/s 54.10% ( 16s ) 25/04 19:30:44 Net In: 901.768 Mb/s Avg: 854.789 Mb/s 68.64% ( 11s ) 25/04 19:30:49 Net In: 938.986 Mb/s Avg: 868.792 Mb/s 83.75% ( 05s ) 25/04 19:30:54 Net In: 801.430 Mb/s Avg: 859.169 Mb/s 96.79% ( 01s ) 25/04 19:30:59 Net In: 199.810 Mb/s Avg: 776.736 Mb/s 100.00% ( 00s ) 25/04 19:31:04 Net In: 0.000 b/s Avg: 690.440 Mb/s 100.00% ( 00s ) 25/04 19:31:09 Net In: 0.000 b/s Avg: 621.414 Mb/s 100.00% ( 00s ) 25/04 19:31:14 Net In: 0.000 b/s Avg: 564.925 Mb/s 100.00% ( 00s ) 25/04 19:31:20 Net In: 0.000 b/s Avg: 512.903 Mb/s 100.00% ( 00s ) 25/04 19:31:25 Net In: 0.000 b/s Avg: 473.748 Mb/s 100.00% ( 00s ) Transfer period: 01m 10s </code>

fdtresults.txt · Last modified: 2011/04/26 02:33 by sbwood