Results and Conclusions » History » Version 20

GAY, Adrien, 12/15/2014 11:06 PM

1 2 Cuadro, Juan Pablo
h1. Results
2 1 Cuadro, Juan Pablo
3 5 Cuadro, Juan Pablo
In this section we present and analyze some results as well as some conclusions.
4 5 Cuadro, Juan Pablo
5 5 Cuadro, Juan Pablo
h2. Link Emulation
6 5 Cuadro, Juan Pablo
7 3 Cuadro, Juan Pablo
In order to test performance of ACM and compare it to a CCM, we generated a file containing a time series of Es/N0 values. These ranged from 25dB to 2dB and formed both a descending and ascending phase. This means that the link's Es/N0 value starts descending from 25dB down to 2dB and ascending back to 25dB afterwards. This was done in 0.5dB increments which last 10 seconds each. 
8 1 Cuadro, Juan Pablo
9 9 Cuadro, Juan Pablo
Performing this with the link emulator is quite easy since there is a software variant that allows for importing of time series. This is explained in the [[Link Emulation]] section. Since the ACM client (station) reports Es/N0 estimates to the ACM controller (HUB), we went ahead and compared both the emulation input as well as the reported values:
10 1 Cuadro, Juan Pablo
11 8 Cuadro, Juan Pablo
p=. !{width: 70%}1.png(.)!
12 1 Cuadro, Juan Pablo
13 3 Cuadro, Juan Pablo
Both overlap quite nicely although there seems to be some underestimation specially around 15dB. There also some spurious values which can lead to modcod parameters being changed quite rapidly.
14 1 Cuadro, Juan Pablo
15 3 Cuadro, Juan Pablo
tip. In order to reduce spurious modcod changes, it may be of interest to refer to fade prediction values in the ACM client configuration. These options, however, are not explained in the EL470 user manual.
16 1 Cuadro, Juan Pablo
17 4 Cuadro, Juan Pablo
We can also take a look at the modcod parameters:
18 4 Cuadro, Juan Pablo
19 4 Cuadro, Juan Pablo
notice. In the lab setup, maximum achievable modcod is 16APSK 8/9 while the minimum is QPSK 1/4.
20 4 Cuadro, Juan Pablo
21 8 Cuadro, Juan Pablo
p=. !{width: 70%}3.png(.)!
22 4 Cuadro, Juan Pablo
23 4 Cuadro, Juan Pablo
This is an interesting graph because it shows that in the event of degradations in link conditions, ACM responds by adjusting modulation and coding to best match performance. As we will see further on, in the case of CCM there is an outage and nothing can really be done until link conditions get better. 
24 4 Cuadro, Juan Pablo
25 4 Cuadro, Juan Pablo
26 3 Cuadro, Juan Pablo
h2. UDP traffic
27 3 Cuadro, Juan Pablo
28 13 GAY, Adrien
As stated in [[Measuring Tools and Scripts]] Iperf generated traffic will only be UDP since at this point we are only interested in an estimation of available channel capacity. Due to their inherent delay in transmitting messages, satellite links have very adverse effects on the way certain transport protocols such as TCP behave. This leads to low channel utilization and thus TCP is of very little interest when we want to measure actual channel capacity.  For more information on satellite links and its effects on TCP refer to "RFC2488: Enhancing TCP Over Satellite Channels using Standard Mechanisms":http://tools.ietf.org/html/rfc2488.
29 1 Cuadro, Juan Pablo
30 12 Cuadro, Juan Pablo
Now the question is what UDP datagram size to use and at what target bandwidth the HUB PC will generate traffic. Since modems are configured with a symbol rate of 512 Kbauds and the maximum achievable modulation scheme is 16APSK, an upper bound on achievable throughput is 512k x log ~2~ 16 = 2.048 Mbps. This is clearly the bottleneck since Ethernet communication between PCs and modem interfaces highly exceed this capacity. We tested this by generating traffic at 3Mbps with a UDP length of 8KB. However, results were not looking very good:
31 3 Cuadro, Juan Pablo
32 8 Cuadro, Juan Pablo
p=. !{width: 70%}0.png(.)!
33 3 Cuadro, Juan Pablo
34 1 Cuadro, Juan Pablo
The previous graph shows UDP throughput and the bitrate reported by the HUB modulator. Why weren't we getting a constant throughput? The answer is quite simple, generated UDP packets will be bigger than the link MTU and thus they will be fragmented in order to be sent. Since we are transmitting at a higher rate than the satellite link can handle, we will see losses in IP packets and throughput in the UDP layer will not be representative of channel capacity since the lower layer may discard packets for which fragments have not arrived. 
35 3 Cuadro, Juan Pablo
36 14 GAY, Adrien
To fix this, we resorted to generating UDP datagrams with a length of 1300B, this way we are under the MTU. We then proceeded run tests with ACM enabled. The first test will see modcod parameters vary according to the current Es/N0 as we saw previously. In addition to this test run, we also performed a few runs in CCM mode with different modulation and coding schemes.
37 1 Cuadro, Juan Pablo
38 3 Cuadro, Juan Pablo
notice. Running in ACM mode is mandatory since we need the ACM controller log values. However, CCM can be emulated by setting minimum and maximum modcod to the same value in the ACM controller configuration.
39 3 Cuadro, Juan Pablo
40 1 Cuadro, Juan Pablo
For CCM, 16APSK 3/4, 8PSK 3/4 and QPSK 3/4 were chosen. In the following graph we can see UDP throughput for all 4 tests. Note that CCM test runs only contain the descending portion of the time series, this is because after a certain value of Es/N0 throughput drops to zero.
41 1 Cuadro, Juan Pablo
42 8 Cuadro, Juan Pablo
p=. !{width: 70%}2.png(.)!
43 1 Cuadro, Juan Pablo
44 1 Cuadro, Juan Pablo
45 19 GAY, Adrien
By removing time dependency we can plot previous values against channel conditions. 
46 7 Cuadro, Juan Pablo
47 1 Cuadro, Juan Pablo
p=. !{width: 60%}4.png(.)! !{width: 60%}5.png(.)!
48 19 GAY, Adrien
49 20 GAY, Adrien
The hysterisis phenomenon described in section [[FlexACM]] can be clearly identified in the first graph above by comparing the ascending and descending phases of the channel emulation. If we take a look at the second graph, we can see that at some points CCM has a better throughput than ACM. While this may well be, considering throughput as the only metric to evaluate performance does not take into account PER(Packet Error Rate) which might be higher than the required QEF (quasi-error-free) working point by DVB-S2 (10 ^-5^ ). This is in fact what ACM seeks to do, it changes modulation and coding dynamically to ensure a certain QEF target.
50 8 Cuadro, Juan Pablo
51 8 Cuadro, Juan Pablo
52 8 Cuadro, Juan Pablo
h1. Conclusions
53 15 Cuadro, Juan Pablo
54 16 GAY, Adrien
In this project, analysis on the performance of ACM in DVB-S2 was carried out. The tests performed on our setup have provided us with results that highlight the importance of ACM in DVB-S2 as well as the potential for future satellite systems. ACM improves spectral efficiency substantially when favorable link conditions occur and link availability is also improved with respect to CCM. All of this is of paramount importance in satellite systems and ACM provides designers with more flexibity. We must note also that in order for ACM to function optimally, we must have a reliable Es/N0 estimator on the terminal. 
55 16 GAY, Adrien
56 17 GAY, Adrien
Our work has also shown the potential of software defined radio (SDR) platforms as means of channel emulation. SDR based link emulation provides a reliable testing environment for satellite links with very limited costs with respect to available off the shelf hardware solutions which typically cost well over 100K€. Its advantages are more than obvious in the academic world where institutions do not have the same financial means as their industrial counterparts.