# Statistical Properties of SNR for Compressed Measurements.

1. IntroductionCompressed sensing is proposed to recover the original signal from the compressed measurements [1]. Its key technologies consist of sparse representation, the design of the measurement matrix, and the recovery algorithm. Sparse representation of the signal is a premise and basis of compressed sensing, RIP of the measurement matrix can guarantee a unique solution of signal reconstruction mathematically [2], and the recovery algorithm finds the unique solution through different methods. Therefore, to some extent, compressed sensing is considered as a sampling technology similar to Shannon's sampling theorem. However, the signal is sampled according to the sparsity of the signal but not the bandwidth required by Shannon's sampling theorem. In other words, compressed sensing only extracts useful information but not the signal itself. Based on the these advantages, compressed sensing is viewed as a promising technology for many research fields, such as remote sensing, image processing, and wireless communication [3].

Currently, the wideband signal must be employed for wireless communication to satisfy the demand of high-rate data transmission, which brings many challenges for signal sampling devices, such as high sampling rate and cost. To cope with these difficulties, compressed sensing has been employed in many signal processing tasks of wireless communication, for example, channel estimation and spectrum sensing [4].

In the beginning, the communication signal is processed in accordance with standard technological process of compressed sensing [2,3]; thatis, the signal issampledbyvirtue of the measurement matrix to obtain the compressed measurements. And then, the original signal is reconstructed in terms of the recovery algorithm. Finally, the recovered signal is further manipulated to finish different signal processing tasks. It has been proved that the recovery algorithm has high computational complexity [2]. Nevertheless, some signal processing tasks, especially inference problems, have only concentrated on the decision results and the related parameters but not the signal itself, such as signal detection, signal classification, and signal parameters identification. The recovered signal is meaningless for the inference problem. That is to say, the reconstruction-based signal processing methods can not fully exploit the merits of compressed sensing. Consequently, the nonreconstruction framework of signal processing is presented [5, 6]. Under the nonreconstruction framework, the compressed measurements are directly employed to deal with the inference problem without resorting to a full-scale signal reconstruction.

It is widely recognized that the communication signal is inevitably corrupted by the noise. Consequently, the performances of these signal processing tasks have close relation with SNR of the compressed measurements, which involves the energy of the compressed noise and the compressed signal. In literature [7], the noise folding in compressed sensing is considered, and the relations of SNR of the compressed measurements and the compressed ratio N/M were derived. Here, N is the dimension of the signal and M is the number of the compressed measurements. And then, the impact of the noise folding on the wideband signal acquisition is discussed [8], and the relation of SNR of the compressed measurements and SNR of the recovered signal plus noise was studied. However, the statistical properties of the energy and SNR of the compressed measurements are not further investigated. It is well known that the statistical properties are important to investigate the performance of signal detection and signal parameters identification. Therefore, it is vital to derive the statistical properties of the energy and SNR of the compressed measurements for the performance analysis of signal processing.

Because the random measurement matrix is frequently utilized, the energy of the compressed signal and the energy of the compressed noise are the random variables. Further, the resulting SNR of the compressed measurements is also the random variable. Consequently, we first discuss the mean, the variance, probability density function (PDF), and cumulative distribution function (CDF) about the energy of the compressed signal and the energy of the compressed noise. After that, we derive the statistical properties of SNR of the compressed measurements, including the mean, the variance, PDF, and CDF. These results provide a foundation for the performance analysis of signal processing tasks.

2. Statistical Properties of Compressed Measurements and Their Quadratic Sum

For compressed sensing, the compressed measurements can be expressed as

y = [PHI] (s + n), (1)

where y [member of] [R.sup.M], [PHI] [member of] [R.sup.MxN], s [member of] [R.sup.N], and n [member of] [R.sup.N] denote the compressed measurements, the random measurement matrix, the signal vector with the sparsity K, and the noise vector, respectively. It is assumed that the signal and the noise are filtered by the band-pass filter before compressed sensing. Therefore, the noise folding problem may not be considered. Mathematically, the condition M [greater than or equal to] K [log.sub.2] (N/K) should be satisfied to recover the signal with high probability Specifically, the entries of y can be calculated as

[mathematical expression not reproducible]. (2)

Without loss of generality, we assume that the entries of the random measurement matrix are i.i.d. Gaussian random variables with mean zero and variance [[sigma].sup.2.sub.[empty set]], the entries of the noise vector are i.i.d. Gaussian random variables with mean zero and variance [[sigma].sup.2.sub.n], and the entries of the signal are i.i.d. random variables with mean zero and variance [[sigma].sup.2.sub.s]. The entries of the random measurement matrix, the noise vector, and the signal vector are also statistically independent of each other. Because their means are zero, they are also uncorrelated and orthogonal.

Let [s.sup.cs.sub.k] = [[summation].sup.N.sub.i=1] [[empty set].sub.ki]s(i) and [n.sup.cs.sub.k] = [[summation].sup.N.sub.i=1] [[empty set].sub.ki]n(i) denote the kth entry of the compressed signal and the compressed noise, respectively. We first analyze the statistical properties of [n.sup.cs.sub.k]. According to central limit theorem, [n.sup.cs.sub.k] can be considered as Gaussian random variable, whose mean is

[mathematical expression not reproducible]. (3)

Because the means of [[empty set].sub.ki] and n(i) are zero, the variance of [n.sup.cs.sub.k] is calculated as

[mathematical expression not reproducible]. (4)

After that, we compute the mean of [s.sup.cs.sub.k]:

[mathematical expression not reproducible]. (5)

Similarly, the variance of [s.sup.cs.sub.k] can be also calculated as

[mathematical expression not reproducible]. (6)

Therefore, the entries of the compressed measurements y are Gaussian random variables with mean zero and variance N[[sigma].sup.2.sub.[empty set]] ([[sigma].sup.2.sub.s] + [[sigma].sup.2.sub.n]).

The quadratic sum of the compressed signal is denoted as

[P.sub.s] = ([PHI]s, [PHI]s) = [M.summation over (k=1)][([s.sup.cs.sub.k]).sup.2]. (7)

The quadratic sum of the compressed signal follows the central Gamma distribution with M degrees of freedom. The corresponding mean and variance are calculated as

[mathematical expression not reproducible], (8)

[mathematical expression not reproducible]. (9)

Its scale and shape parameters are [mathematical expression not reproducible], respectively. Hence, [P.sub.s] can be represented as [mathematical expression not reproducible].

Next, we analyze the energy of the compressed noise, which is written as

[P.sub.n] = ([PHI]n, [PHI]n) = [M.summation over (k=1)] [([n.sup.cs.sub.k]).sup.2]. (10)

By analogy, the quadratic sum of the compressed noise also follows the central Gamma distribution with M degrees of freedom. The corresponding mean and variance are calculated as

[mathematical expression not reproducible], (11)

[mathematical expression not reproducible]. (12)

Similarly, its scale and shape parameters are [mathematical expression not reproducible], respectively Thus, [P.sub.n] is represented as [mathematical expression not reproducible].

3. The Statistical Properties of SNR

SNR of the compressed measurements is defined as

[SNR.sub.cs] = [P.sub.s]/[P.sub.n]. (13)

We now analyze the relation of [P.sub.s] and [P.sub.n]. Firstly, we calculate the mean of the product of the compressed signal and the compressed noise:

[mathematical expression not reproducible]. (14)

It can be seen that [N.sup.2] items are obtained when (14) is expanded, and each item consists of the entry of the noise and the entry of the random measurement matrix with mean zero. Because these entries are uncorrelated and independent, the resulting mean E[[s.sup.cs.sub.k][n.sup.cs.sub.r]] = 0, which means the orthogonality of [s.sup.cs.sub.k] and [n.sup.cs.sub.r]. Considering (3) and (5), we can observe that [s.sup.cs.sub.k] and [n.sup.cs.sub.r] are uncorrelated. Because the irrelevance and the independence are equivalent for Gaussian random variables, [s.sup.cs.sub.k] and [n.sup.cs.sub.r] are independent of each other. In a straight way, we can conclude that [P.sub.s] and [P.sub.n] are also independent. Based on these results, we calculate the mean of SNR:

E [[SNR.sub.cs]] = E [[P.sub.s]/[P.sub.n]] = E [[P.sub.s] E [1/[P.sub.n]]. (15)

Let X = [P.sub.n]/N[[sigma].sup.2.sub.[empty set]][[sigma].sup.2.sub.n]; we have [P.sub.n] = N[[sigma].sup.2.sub.[empty set]][[sigma].sup.2.sub.n]([P.sub.n]/N[[sigma].sup.2.sub.[empty set]][[sigma].sup.2.sub.n] = N[[sigma].sup.2.sub.[empty set]][[sigma].sup.2.sub.n]X. Combining with (10) and (11), we can obtain that X follows the Chi-square distribution with degrees of freedom M. Hence, the mean of the reciprocal of X can be calculated as

[mathematical expression not reproducible]. (16)

According to the relation between [P.sub.n] and X, we have

[mathematical expression not reproducible]. (17)

Substituting (8) and (17) into (15) yields

[mathematical expression not reproducible]. (18)

After that, we analyze the variance of SNR, which is viewed as the product of two random variables. By virtue of the property of the variance, we have

[mathematical expression not reproducible]. (19)

Now, we calculate the variance of 1/[P.sub.n]. According to the definition of the variance, we can obtain

[mathematical expression not reproducible]. (20)

The item E[[(1/X).sup.2]] can be calculated as

[mathematical expression not reproducible]. (21)

By substituting (21) and (16) into (20), we can compute the variance of 1/[P.sub.n]:

D[1/[P.sub.n]] = 1/[(N[[sigma].sup.2.sub.[empty set]][[sigma].sup.2.sub.n]).sup.2] 2/[(M - 2).sup.2] (M - 4). (22)

In terms of (8), (9), (17), and (22), (19) can be rewritten as

D[[SNR.sub.cs]] = [[sigma].sup.4.sub.s]/[[sigma].sup.4.sub.n] 4[M.sup.2] - 4M/[(M - 2).sup.2] (M - 4). (23)

Most importantly, probability density function (PDF) of SNR should be discussed. Because of the independence of [P.sub.s] and [mathematical expression not reproducible], pdf of the product of two random variables with the Gamma distribution can be expressed as

[mathematical expression not reproducible]. (24)

The corresponding cumulative distribution function (CDF) can be expressed as

[mathematical expression not reproducible], (25)

where [I.sub.q](*,*) is the regularized incomplete B function; that is, [I.sub.q](a, b) = B(q; a, b)/B(a, b), B(a, b) = [GAMMA](a)[GAMMA](b)/[GAMMA](a + b), and B(q; a, b) = [[integral].sup.q.sub.0] [t.sup.a-1] [(1 - t).sup.b-1] dt. Accordingly, (25) can be rewritten as

[mathematical expression not reproducible], (26)

where [sub.2][F.sub.1] (*, *; *; *) is the Hypergeometric function.

We can observe that the expressions of CDF and PDF are very complicated, so it is difficult to directly exploit them in practical scenarios. Generally, the number of the compressed measurements M is relatively large; thus the quadratic sum [P.sub.s] and [P.sub.n] can be also viewed as the Gaussian distribution in terms of central limit theorem [9]. Because of the independence of [P.sub.s] and 1/[P.sub.n], probability density function of SNR can be expressed as [10,11]

[mathematical expression not reproducible]. (27)

where u(x) = [mathematical expression not reproducible] dw.

The corresponding CDF is expressed as

[mathematical expression not reproducible], (28)

where [PHI]() is CDF of standard Gaussian random variable.

It can be seen that the resulting CDF and PDF are related with the sparsity K[M [greater than or equal to] K [log.sub.2] (N/K)], N dimension of signal, the variance of the signal, the variance of the noise, and the variance of the measurement matrix. Furthermore, CDF and PDF in Gaussian assumption are simpler than of the Gamma distribution.

It needs to be explained that we do not place any restrictions on the power range of the noise and the signal in the previous analysis, and the analysis result can be applied for any SNR. Hence, it is reasonable to not consider the dynamic range.

4. Simulation Results

To prove the theoretical analysis, some simulations are performed. Firstly, PDF of the energy of the compressed signal for different M is shown in Figure 1. The random variables following the binomial distribution are exploited as the signal, which is a common information model for the practical communication system. The mean and the variance of the binomial distribution are zero and 1, respectively; that is, [[sigma].sup.2.sub.s] = 1.

The simulation parameters are as follows: N = 512, M = 50,100,200. To remove the effect of the measurement matrix on the energy of the compressed signal and the compressed noise, the variance of each column of the measurement matrix [PHI] is set to 1/M; that is, D[[[empty set].sub.ki]] = 1/M. Combining with the mean and the variance of the binomial distribution, (8) and (9) can be simplified as

[mathematical expression not reproducible]. (29)

It can be demonstrated that the mean is fixed when M changes. In other words, the mean is independent of M. However, the variance is inversely proportional to M. Hence, the simulation result is consistent with the theoretical analysis (29).

For the noise, (11) and (12) can be rewritten as

[mathematical expression not reproducible]. (30)

Figure 2 shows the impact of the number of the compressed measurements on the statistical properties. It can be observed that the variation tendencies of the mean and the variance are the same as those of the compressed signal. It should be pointed out that the statistical properties experience some changes, but the energy of the noise approximates to the energy of the compressed noise because of RIP of the measurement matrix, which is also correct for the signal and the compressed signal.

Finally, SNR of the compressed measurements is demonstrated for the different number of the compressed measurements M in Figure 3. It can be observed that the mean of SNR approximates for different M due to M/(M - 2) [approximately equal to] 1, and the variance of SNR decreases with the increasing of M. Consequently, we conclude that these simulated results coincide with (18) and (23).

5. Conclusion

In the framework of compressed sensing, some statistical properties of the compressed signal and the compressed noise were calculated and analyzed, which mainly consist of the mean, variance, probability density function, and cumulative distribution function. It has been illustrated that these statistical properties vary when the signal and the noise are processed by compressed sensing. If the entries of the measurement matrix are normalized, the mean of the compressed signal and the compressed noise remains unchanged, but their variance inversely varies with the number of the compressed measurements M. Based on these results, the mean and the variance of SNR were achieved. And then, by the independence of the energy of the compressed signal and the compressed noise, we derived the closed-form expressions of probability density function and cumulative distribution function for the cases of the Gaussian and Gamma distribution.

http://dx.doi.org/10.1155/2016/3406731

Competing Interests

The authors declare that there is no conflict of interests regarding the publication of this article.

Acknowledgments

This work is supported by National Natural Science Foundation of China (NSFC) (61301101, 61671176).

References

[1] E. J. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information," IEEE Transactions on Information Theory, vol. 52, no. 2, pp. 489-509, 2006.

[2] M. L. Malloy and R. D. Nowak, "Near-optimal adaptive compressed sensing," IEEE Transactions on Information Theory, vol. 60, no. 7, pp. 4001-4012, 2014.

[3] L. Wang, K. Lu, and P. Liu, "Compressed sensing of a remote sensing image based on the priors of the reference image," IEEE Geoscience and Remote Sensing Letters, vol. 12, no. 4, pp. 736-740, 2015.

[4] Y. Wang, C. Guo, X. Sun, and C. Feng, "Time-efficient wideband spectrum sensing based on compressive sampling," in Proceedings of the 81st IEEE Vehicular Technology Conference (VTC Spring '15), pp. 1-5, Glasgow, UK, May 2015.

[5] S. Hong, "Direct spectrum sensing from compressed measurements," in Proceedings of the IEEE Military Communications Conference (MILCOM '10), pp. 1187-1192, November 2010.

[6] M. A. Davenport, P. T. Boufounos, M. B. Wakin, and R. G. Baraniuk, "Signal processing with compressive measurements," IEEE Journal on Selected Topics in Signal Processing, vol. 4, no. 2, pp. 445-460, 2010.

[7] E. Arias-Castro and Y. C. Eldar, "Noise folding in compressed sensing," IEEE Signal Processing Letters, vol. 18, no. 8, pp. 478-481, 2011.

[8] M. A. Davenport, J. N. Laska, J. R. Treichler, and R. G. Baraniuk, "The pros and cons of compressive sensing for wideband signal acquisition: noise folding versus dynamic range," IEEE Transactions on Signal Processing, vol. 60, no. 9, pp. 4628-4642, 2012.

[9] I. S. Gradshteyn and I. M. Ryzhik, Table of Integrals, Series, and Products, Elsevier, 7th edition, 2007.

[10] D. V. Hinkley, "On the ratio of two correlated normal random variables," Biometrika, vol. 56, pp. 635-639, 1969.

[11] A. Papoulis, Probability, Random Variables, and Stochastic Processes, McGraw-Hill Series in Electrical Engineering. Communications and Information Theory, McGraw-Hiil, New York, NY, USA, 2nd edition, 1984.

Yulong Gao, (1) Yanping Chen, (2) and Linxiao Su (1)

(1) Department of Communication Engineering, Harbin Institute of Technology, Harbin 150080, China

(2) School of Computer and Information Engineering, Harbin University of Commerce, Harbin 150028, China

Correspondence should be addressed to Yulong Gao; ylgao@hit.edu.cn

Received 14 April 2016; Accepted 5 September 2016

Academic Editor: Haipeng Peng

Caption: Figure 1: PDF of energy of compressed signal for M = 50, 100, 200.

Caption: Figure 2: PDF of energy of compressed noise for M = 0, 50, 100, 200.

Caption: Figure 3: PDF of SNR of compressed measurements for M = 0, 50, 100, 200.

Printer friendly Cite/link Email Feedback | |

Title Annotation: | Research Article |
---|---|

Author: | Gao, Yulong; Chen, Yanping; Su, Linxiao |

Publication: | Mathematical Problems in Engineering |

Date: | Jan 1, 2016 |

Words: | 3108 |

Previous Article: | Methods to Analyze Flexural Buckling of the Consequent Slabbed Rock Slope under Top Loading. |

Next Article: | On a Stochastic Lotka-Volterra Competitive System with Distributed Delay and General Levy Jumps. |

Topics: |