Monday, June 4, 2018

gaussian - MLE parameter estimation -- confusion regarding some terms in the pdf of complex normal r.v (Part 2)


This question is based on the application of the pdf which was an earlier question of mine asked here Confusion regarding pdf of circularly symmetric complex gaussian rv


If vCN(0,2σ2v) is a circularly complex Gaussian random variable which acts as the measurement noise in this model yn=A+vn

where y is the observation and A is a scalar unknown value which needs to be estimated. I am having a slight confusion whether there will be a 2 in the denominator of Eq(3) and Eq(4) with the exp(.) term. Based on the answer in the link, there should be no sqrt term with π in the denominator, if vCN(0,2σ2v). If vN(0,σ2v) then there is a sqrt term.


Can somebody please check if I have correctly written out the log-likelihood? I think I am missing a 2 in the denominator of exp[.] term in Eq(3) but I am not quite sure.


Thank you for your time and help.


Py(y1,y2,...,yN)=Nn=112πσ2vexp((ynA)H(ynA)2σ2v)


taking log =Nln(2πσ2v)1σ2v[[Nn=1(ynA)(ynA)H]].

=Nln(2πσ2v)12σ2v[Nn=1ynyHn2Nn=1ynA]12σ2v[Nn=1AAH]]



Answer



I looked this up on Wikipedia: A complex Gaussian random variable V=Re(V)+jIm(V) is said to be zero mean circularly symmetric CN(0,Γ) if the random vector [Re(V),Im(V)] is a Gaussian random vector with mean [0,0] and covariance matrix 12[Re(Γ)Im(Γ)Im(Γ)Re(Γ)]=12[2σ2v002σ2v]=[σ2v00σ2v].



For your question, you need to know how to write the density function of each of the Yi's. Since Yi=A+Vi, the random vector [Re(Yi),Im(Yi)] is a 2D Gaussian vector distributed according to N([Re(A)Im(A)],[σ2v00σ2v]) i.e. the density function can be written as 1σv2πexp((wRe(A))22σ2v)1σv2πexp((xIm(A))22σ2v)=12πσ2vexp((wRe(A))2+(xIm(A))22σ2v)=12πσ2vexp((yiA)¯(yiA)2σ2v)

where yi=w+jx is a "placeholder" for the complex random variable Yi and the "overbar" denotes complex conjugate i.e. ˉy=wjx.


Finally, we are ready to write the density function of the complex random vector [Y1,,YN]. We note that due to the circular symmetry of each of the components, it is same as the density of the real valued Gaussian random vector [Re(Y1),Im(Y1),,Re(YN),Im(YN)].


The likelihood function can now be written as p(Y1,,YN)=Ni=112πσ2vexp((yiA)¯(yiA)2σ2v)

and the negative-log-likelihood becomes logp(Y1,,YN)=Nlog(2πσ2v)+12σ2vNi=1(yiA)¯(yiA)=Nlog(2πσ2v)+12σ2vNi=1(yiA)¯(yiA)


No comments:

Post a Comment

periodic trends - Comparing radii in lithium, beryllium, magnesium, aluminium and sodium ions

Apparently the of last four, MgX2+ is closest in radius to LiX+. Is this true, and if so, why would a whole larger shell ($\ce{...