Rapid_v0.9.4

1. Experiment Description

One rapid flow from smithfd-rapid22 to smithfd-rapid21 with no cross traffic on the link. Run two experiments for 5s with arithmatic averaging(avg_size= 8) and exponential moving averaging(alpha= 0.875) of pruned streams respectively.

2. Throughputs

(1) Arithmatic Averaging with avg_size = 8
When logging is turned off:

[  4]  0.0- 0.5 sec  2.41 MBytes  40.4 Mbits/sec
[  4]  0.5- 1.0 sec  22.2 MBytes   372 Mbits/sec
[  4]  1.0- 1.5 sec  37.2 MBytes   625 Mbits/sec
[  4]  1.5- 2.0 sec  51.8 MBytes   869 Mbits/sec
[  4]  2.0- 2.5 sec  55.7 MBytes   934 Mbits/sec
[  4]  2.5- 3.0 sec  55.9 MBytes   938 Mbits/sec
[  4]  3.0- 3.5 sec  55.9 MBytes   938 Mbits/sec
[  4]  3.5- 4.0 sec  50.6 MBytes   849 Mbits/sec
[  4]  4.0- 4.5 sec  43.1 MBytes   723 Mbits/sec
[  4]  4.5- 5.0 sec  46.0 MBytes   772 Mbits/sec
[  4]  5.0- 5.5 sec  55.9 MBytes   937 Mbits/sec
[  4]  5.5- 6.0 sec  52.4 MBytes   879 Mbits/sec
[  4]  6.0- 6.5 sec  46.9 MBytes   787 Mbits/sec
[  4]  6.5- 7.0 sec  45.3 MBytes   761 Mbits/sec
[  4]  7.0- 7.5 sec  46.3 MBytes   777 Mbits/sec
[  4]  7.5- 8.0 sec  40.0 MBytes   672 Mbits/sec
[  4]  8.0- 8.5 sec  55.5 MBytes   931 Mbits/sec
[  4]  8.5- 9.0 sec  55.9 MBytes   938 Mbits/sec
[  4]  9.0- 9.5 sec  55.9 MBytes   938 Mbits/sec
[  4]  9.5-10.0 sec  55.7 MBytes   934 Mbits/sec
[  4] 10.0-10.5 sec  45.8 MBytes   769 Mbits/sec
[  4] 10.5-11.0 sec  45.4 MBytes   761 Mbits/sec
[  4] 11.0-11.5 sec  46.6 MBytes   783 Mbits/sec
[  4] 11.5-12.0 sec  46.4 MBytes   778 Mbits/sec
[  4] 12.0-12.5 sec  46.5 MBytes   779 Mbits/sec
[  4] 12.5-13.0 sec  44.8 MBytes   752 Mbits/sec
[  4] 13.0-13.5 sec  45.0 MBytes   755 Mbits/sec
[  4] 13.5-14.0 sec  43.5 MBytes   731 Mbits/sec
[  4] 14.0-14.5 sec  44.6 MBytes   748 Mbits/sec
[  4] 14.5-15.0 sec  47.4 MBytes   796 Mbits/sec
[  4]  0.0-15.3 sec  1.38 GBytes   774 Mbits/sec

When logging is turned on:
[  4]  0.0- 0.5 sec  2.91 MBytes  48.9 Mbits/sec
[  4]  0.5- 1.0 sec  14.7 MBytes   246 Mbits/sec
[  4]  1.0- 1.5 sec  38.5 MBytes   647 Mbits/sec
[  4]  1.5- 2.0 sec  47.3 MBytes   793 Mbits/sec
[  4]  2.0- 2.5 sec  43.4 MBytes   728 Mbits/sec
[  4]  2.5- 3.0 sec  45.6 MBytes   764 Mbits/sec
[  4]  3.0- 3.5 sec  38.7 MBytes   649 Mbits/sec
[  4]  3.5- 4.0 sec  52.1 MBytes   875 Mbits/sec
[  4]  4.0- 4.5 sec  46.1 MBytes   774 Mbits/sec
[  4]  4.5- 5.0 sec  26.3 MBytes   442 Mbits/sec
[  4]  5.0- 5.5 sec  24.3 MBytes   408 Mbits/sec
[  4]  0.0- 5.6 sec   388 MBytes   580 Mbits/sec
(2) Exponential Moving Averaging with alpha = 1/8
When logging is turned off:
[  4]  0.0- 0.5 sec  2.92 MBytes  49.0 Mbits/sec
[  4]  0.5- 1.0 sec  16.9 MBytes   284 Mbits/sec
[  4]  1.0- 1.5 sec  47.1 MBytes   791 Mbits/sec
[  4]  1.5- 2.0 sec  41.5 MBytes   696 Mbits/sec
[  4]  2.0- 2.5 sec  53.4 MBytes   895 Mbits/sec
[  4]  2.5- 3.0 sec  40.8 MBytes   684 Mbits/sec
[  4]  3.0- 3.5 sec  30.8 MBytes   517 Mbits/sec
[  4]  3.5- 4.0 sec  36.6 MBytes   614 Mbits/sec
[  4]  4.0- 4.5 sec  51.1 MBytes   857 Mbits/sec
[  4]  4.5- 5.0 sec  43.3 MBytes   726 Mbits/sec
[  4]  5.0- 5.5 sec  55.9 MBytes   938 Mbits/sec
[  4]  5.5- 6.0 sec  38.7 MBytes   649 Mbits/sec
[  4]  6.0- 6.5 sec  50.6 MBytes   849 Mbits/sec
[  4]  6.5- 7.0 sec  48.7 MBytes   817 Mbits/sec
[  4]  7.0- 7.5 sec  52.8 MBytes   885 Mbits/sec
[  4]  7.5- 8.0 sec  38.4 MBytes   644 Mbits/sec
[  4]  8.0- 8.5 sec  47.8 MBytes   802 Mbits/sec
[  4]  8.5- 9.0 sec  44.0 MBytes   738 Mbits/sec
[  4]  9.0- 9.5 sec  51.6 MBytes   865 Mbits/sec
[  4]  9.5-10.0 sec  37.2 MBytes   624 Mbits/sec
[  4] 10.0-10.5 sec  50.8 MBytes   852 Mbits/sec
[  4] 10.5-11.0 sec  45.7 MBytes   767 Mbits/sec
[  4] 11.0-11.5 sec  27.6 MBytes   464 Mbits/sec
[  4] 11.5-12.0 sec  39.0 MBytes   655 Mbits/sec
[  4] 12.0-12.5 sec  41.2 MBytes   692 Mbits/sec
[  4] 12.5-13.0 sec  34.2 MBytes   573 Mbits/sec
[  4] 13.0-13.5 sec  46.9 MBytes   786 Mbits/sec
[  4] 13.5-14.0 sec  38.1 MBytes   639 Mbits/sec
[  4] 14.0-14.5 sec  39.4 MBytes   662 Mbits/sec
[  4] 14.5-15.0 sec  35.9 MBytes   603 Mbits/sec
[  4]  0.0-15.1 sec  1.21 GBytes   689 Mbits/sec

When logging is turned on:
[  4]  0.0- 0.5 sec  3.05 MBytes  51.2 Mbits/sec
[  4]  0.5- 1.0 sec  13.8 MBytes   231 Mbits/sec
[  4]  1.0- 1.5 sec  28.1 MBytes   471 Mbits/sec
[  4]  1.5- 2.0 sec  29.5 MBytes   495 Mbits/sec
[  4]  2.0- 2.5 sec  29.5 MBytes   495 Mbits/sec
[  4]  2.5- 3.0 sec  27.7 MBytes   465 Mbits/sec
[  4]  3.0- 3.5 sec  28.7 MBytes   481 Mbits/sec
[  4]  3.5- 4.0 sec  33.3 MBytes   558 Mbits/sec
[  4]  4.0- 4.5 sec  33.1 MBytes   556 Mbits/sec
[  4]  4.5- 5.0 sec  29.4 MBytes   494 Mbits/sec
[  4]  5.0- 5.5 sec  22.6 MBytes   380 Mbits/sec
[  4]  0.0- 5.6 sec   284 MBytes   427 Mbits/sec

3. AB_est analysis

(1) Arithmatic Averaging with avg_size = 8



For this experiment, the kernel log gets overwraped. So I failed to collect AB_est for all probe streams.

(2) Exponential Moving Averaging with alpha = 1/8




4. Possible problems when pruning or calculating abest:

1. If excursion starts from the first elements in the smoothed stream, then abest=size/gap/2. --> Yes. It means that the initial probing rate is too large.
2. The first sendgap/recevgap in the probe stream might be very large, which affects averaging results and AB_est. Should we ignore the first segment that got acked for each pstream? -- No. Already do normalization. So this is no the reason.
3. Checking sendgaps and recvgaps, I believe the receiver side noise is messing things up:
(1) For arithmatic averaging:
pid=300, abest=1000



pid= 325, valid excursion: 0-18, 30-39, abest= 885



(2) For exponential moving averaging:
pid= 817 valid excursion from 27-38 abest= 725



pid= 818 valid excursion from 0-39 abest= 452