Main Page | Report this Page
 
   
Science Forum Index  »  Statistics - Math Forum  »  Unbiased estimator problem
Page 1 of 1    
Author Message
mark
Posted: Sat Apr 05, 2008 8:24 am
Guest
Problem:
Leaves of a plant are examined for insects and it is found that x_i
leaves have
precisely i insects (i=1,2,...;Sum (x_i) = N). The number of insects
per leaf is believed
to be Poisson, except that many leaves have no insects because they
are unsuitable for feeding and not merely because of the chance
variation allowed for by the Poisson distribution. The empty leaves
are therefore not counted. Show that:

(*) T=Sum_{i=2}^{infinity} (i*x_i)/N

is an unbiased estimator of the Poisson parameter \mu, and determine
its efficiency.
(End of problem)

------------------
My try:
Let i be random variable, i=number of insects on plant's leaf.

Does it mean that x_1 leaves have precisely 1 insect, x_2 leaves have
precisely 2 insects, and so on...?

Put Pr=Probability.

I think that we have that Pr(i) = ( 1-exp(-\mu) )^(-1)*exp(-\mu)*
\mu^i/i!, for i=1,2,3,...
Expectation: E_\mu(i) = \mu.

How one can calculate E_\mu(T)? What probability distributions have N
and x_i the number of leaves which have precisely i insects. Are x_i
and i independent?

I tried the following: (I fixed x_i and N but I do not know whether it
is correct)
E_\mu(T) = Sum_{i=2}^{infinity} ( E_\mu(i*x_i) )/N = (1/
N)*Sum_{i=2}^{infinity} (x_i*E_\mu(i))=
(1/N)*\mu*Sum_{i=2}^{infinity} x_i= \mu*(N-x_1)/N which is not equal
to \mu.


If in (*) we start i from 1 instead 2 and take

(2) T_0=Sum_{i=1}^{infinity} (i*x_i)/N

which is equal to average number of insects per one leaf,
under above assumptions (I fixed x_i and N but I do not know whether
it is correct) we have:

E_\mu(T_0) = Sum_{i=1}^{infinity} ( E_\mu(i*x_i) )/N = (1/
N)*Sum_{i=1}^{infinity} (x_i*E_\mu(i))=
(1/N)*\mu*Sum_{i=1}^{infinity} x_i= \mu*N/N = \mu but it seems to be
too simple.


Does anybody have some hints how to understand this problem and how to
solve it?

TIA

Mark
Jack Tomsky
Posted: Sat Apr 05, 2008 11:07 am
Guest
Quote:
Problem:
Leaves of a plant are examined for insects and it is
found that x_i
leaves have
precisely i insects (i=1,2,...;Sum (x_i) = N). The
number of insects
per leaf is believed
to be Poisson, except that many leaves have no
insects because they
are unsuitable for feeding and not merely because of
the chance
variation allowed for by the Poisson distribution.
The empty leaves
are therefore not counted. Show that:

(*) T=Sum_{i=2}^{infinity} (i*x_i)/N

is an unbiased estimator of the Poisson parameter
\mu, and determine
its efficiency.
(End of problem)

------------------
My try:
Let i be random variable, i=number of insects on
plant's leaf.

Does it mean that x_1 leaves have precisely 1 insect,
x_2 leaves have
precisely 2 insects, and so on...?

Put Pr=Probability.

I think that we have that Pr(i) = ( 1-exp(-\mu)
)^(-1)*exp(-\mu)*
\mu^i/i!, for i=1,2,3,...
Expectation: E_\mu(i) = \mu.

How one can calculate E_\mu(T)? What probability
distributions have N
and x_i the number of leaves which have precisely i
insects. Are x_i
and i independent?

I tried the following: (I fixed x_i and N but I do
not know whether it
is correct)
E_\mu(T) = Sum_{i=2}^{infinity} ( E_\mu(i*x_i) )/N =
(1/
N)*Sum_{i=2}^{infinity} (x_i*E_\mu(i))=
(1/N)*\mu*Sum_{i=2}^{infinity} x_i= \mu*(N-x_1)/N
which is not equal
to \mu.


If in (*) we start i from 1 instead 2 and take

(2) T_0=Sum_{i=1}^{infinity} (i*x_i)/N

which is equal to average number of insects per one
leaf,
under above assumptions (I fixed x_i and N but I do
not know whether
it is correct) we have:

E_\mu(T_0) = Sum_{i=1}^{infinity} ( E_\mu(i*x_i) )/N
= (1/
N)*Sum_{i=1}^{infinity} (x_i*E_\mu(i))=
(1/N)*\mu*Sum_{i=1}^{infinity} x_i= \mu*N/N = \mu but
it seems to be
too simple.


Does anybody have some hints how to understand this
problem and how to
solve it?

TIA

Mark



Since the counts are censored by excluding zero, we have for i>=1,

P(i) = (mu^i)*exp(-mu)/[i!*(1-exp(-mu)]

and E(xi) = N*P(i)

Summing for i>=2,

E(Sum(i*xi)/N)) = Sum(i*E(xi))/N = Sum(i*N*(u^i)*exp(-mu)/i!*(1-exp(-mu))*N) = [exp(-mu)/(1-exp(-mu)]*Sum((mu^i)/(i-1)!) = [exp(-mu)*mu/(1-exp(-mu)]*Sum((mu^(i-1))/(i-1)!) = [exp(-mu)*mu/(1-exp(-mu)]*[exp(mu)-1] = mu.

For the sake of brevity, I left out a few simple algebraic steps.

Jack
mark
Posted: Mon Apr 07, 2008 3:34 am
Guest
On Apr 5, 11:07 pm, Jack Tomsky <jtom...@ix.netcom.com> wrote:

Thanks.

Quote:
Since the counts are censored by excluding zero, we have for i>=1,

P(i) = (mu^i)*exp(-mu)/[i!*(1-exp(-mu)]

and E(xi) = N*P(i)

Could you give some precise explanation or maybe rigorous proof that
E(xi) = N*P(i)?

Quote:

Summing for i>=2,

E(Sum(i*xi)/N)) = Sum(i*E(xi))/N = Sum(i*N*(u^i)*exp(-mu)/i!*(1-exp(-mu))*N) = >[exp(-mu)/(1-exp(-mu)]*Sum((mu^i)/(i-1)!) = [exp(-mu)*mu/(1-exp(-mu)]*Sum((mu^(i-1))/(i-1)!) = >[exp(-mu)*mu/(1-exp(-mu)]*[exp(mu)-1] = mu.

Could you explain why E(i*xi) = i*E(xi)?

TIA

Mark

Quote:

For the sake of brevity, I left out a few simple algebraic steps.

Jack
Jack Tomsky
Posted: Mon Apr 07, 2008 5:14 am
Guest
Quote:
On Apr 5, 11:07 pm, Jack Tomsky
jtom...@ix.netcom.com> wrote:

Thanks.

Since the counts are censored by excluding zero, we
have for i>=1,

P(i) = (mu^i)*exp(-mu)/[i!*(1-exp(-mu)]

and E(xi) = N*P(i)

Could you give some precise explanation or maybe
rigorous proof that
E(xi) = N*P(i)?



P(i) is the probability that a particular leaf will have i insects. Since there are N leaves, the expected number of such leaves having i insects is P(i)+P(i)+...+P(i) or N*P(i)



Quote:


Summing for i>=2,

E(Sum(i*xi)/N)) = Sum(i*E(xi))/N =
Sum(i*N*(u^i)*exp(-mu)/i!*(1-exp(-mu))*N) =
[exp(-mu)/(1-exp(-mu)]*Sum((mu^i)/(i-1)!) =
[exp(-mu)*mu/(1-exp(-mu)]*Sum((mu^(i-1))/(i-1)!) =
[exp(-mu)*mu/(1-exp(-mu)]*[exp(mu)-1] = mu.

Could you explain why E(i*xi) = i*E(xi)?



i is a constant and xi is a random variable. Since i*xi is a multiple of a random variable, you can factor out the constant i. More generally, E(a+b*X) = a+b*E(X).

Jack



Quote:

TIA

Mark


For the sake of brevity, I left out a few simple
algebraic steps.

Jack
mark
Posted: Mon Apr 07, 2008 6:41 am
Guest
On Apr 7, 5:14 pm, Jack Tomsky <jtom...@ix.netcom.com> wrote:
Quote:
On Apr 5, 11:07 pm, Jack Tomsky
jtom...@ix.netcom.com> wrote:

Thanks.

Since the counts are censored by excluding zero, we
have for i>=1,

P(i) = (mu^i)*exp(-mu)/[i!*(1-exp(-mu)]

and E(xi) = N*P(i)

Could you give some precise explanation or maybe
rigorous proof that
E(xi) = N*P(i)?

P(i) is the probability that a particular leaf will have i insects. Since there are N leaves, the expected number of such leaves having i insects is P(i)+P(i)+...+P(i) or N*P(i)



Summing for i>=2,

E(Sum(i*xi)/N)) = Sum(i*E(xi))/N =
Sum(i*N*(u^i)*exp(-mu)/i!*(1-exp(-mu))*N) =
[exp(-mu)/(1-exp(-mu)]*Sum((mu^i)/(i-1)!) =
[exp(-mu)*mu/(1-exp(-mu)]*Sum((mu^(i-1))/(i-1)!) =
[exp(-mu)*mu/(1-exp(-mu)]*[exp(mu)-1] = mu.

Could you explain why E(i*xi) = i*E(xi)?

i is a constant and xi is a random variable. Since i*xi is a multiple of a random variable, you can factor out the constant i. More generally, E(a+b*X) = a+b*E(X).


Why i is a constant? In the formula Sum_{i=2}^infinity (i*xi)/N the
letter i denotes index but
we have that P(i) = mu^i/[i! (1-exp(-mu) ] so in my opinion xi but
also i are a random variables.
Could you please explain it?


TIA

Mark

Quote:

Jack



TIA

Mark

For the sake of brevity, I left out a few simple
algebraic steps.

Jack
Jack Tomsky
Posted: Mon Apr 07, 2008 8:23 am
Guest
Quote:
On Apr 7, 5:14 pm, Jack Tomsky
jtom...@ix.netcom.com> wrote:
On Apr 5, 11:07 pm, Jack Tomsky
jtom...@ix.netcom.com> wrote:

Thanks.

Since the counts are censored by excluding
zero, we
have for i>=1,

P(i) = (mu^i)*exp(-mu)/[i!*(1-exp(-mu)]

and E(xi) = N*P(i)

Could you give some precise explanation or maybe
rigorous proof that
E(xi) = N*P(i)?

P(i) is the probability that a particular leaf will
have i insects. Since there are N leaves, the
expected number of such leaves having i insects is
P(i)+P(i)+...+P(i) or N*P(i)



Summing for i>=2,

E(Sum(i*xi)/N)) = Sum(i*E(xi))/N =
Sum(i*N*(u^i)*exp(-mu)/i!*(1-exp(-mu))*N) =
[exp(-mu)/(1-exp(-mu)]*Sum((mu^i)/(i-1)!) =
[exp(-mu)*mu/(1-exp(-mu)]*Sum((mu^(i-1))/(i-1)!)
=
[exp(-mu)*mu/(1-exp(-mu)]*[exp(mu)-1] = mu.

Could you explain why E(i*xi) = i*E(xi)?

i is a constant and xi is a random variable. Since
i*xi is a multiple of a random variable, you can
factor out the constant i. More generally, E(a+b*X)
= a+b*E(X).


Why i is a constant? In the formula
Sum_{i=2}^infinity (i*xi)/N the
letter i denotes index but
we have that P(i) = mu^i/[i! (1-exp(-mu) ] so in my
opinion xi but
also i are a random variables.
Could you please explain it?




As the expected value is evaluated term by term by the sum, for each term, i is a specific index. For example, when i is specified as 10, then the only value that i can take is 10. For the next term, i is a different specific value; i.e., 11.

Jack


Quote:


TIA

Mark


Jack



TIA

Mark

For the sake of brevity, I left out a few
simple
algebraic steps.

Jack
mark
Posted: Thu Apr 10, 2008 7:19 am
Guest
On Apr 7, 8:23 pm, Jack Tomsky <jtom...@ix.netcom.com> wrote:
Quote:
P(i) is the probability that a particular leaf will
have i insects. Since there are N leaves, the
expected number of such leaves having i insects is
P(i)+P(i)+...+P(i) or N*P(i)

Summing for i>=2,

E(Sum(i*xi)/N)) = Sum(i*E(xi))/N =
Sum(i*N*(u^i)*exp(-mu)/i!*(1-exp(-mu))*N) =
[exp(-mu)/(1-exp(-mu)]*Sum((mu^i)/(i-1)!) =
[exp(-mu)*mu/(1-exp(-mu)]*Sum((mu^(i-1))/(i-1)!)
=
[exp(-mu)*mu/(1-exp(-mu)]*[exp(mu)-1] = mu.

Could you explain why E(i*xi) = i*E(xi)?

i is a constant and xi is a random variable. Since
i*xi is a multiple of a random variable, you can
factor out the constant i. More generally, E(a+b*X)
= a+b*E(X).

Why i is a constant? In the formula
Sum_{i=2}^infinity (i*xi)/N the
letter i denotes index but
we have that P(i) = mu^i/[i! (1-exp(-mu) ] so in my
opinion xi but
also i are a random variables.
Could you please explain it?

As the expected value is evaluated term by term by the sum, for each term, i is a specific index. For example, when i is specified as 10, then the only value that i can take is 10. For the next term, i is a different specific value; i.e., 11.

Thanks.

How one can compute efficiency of the unbiased estimator of the
Poisson parameter \mu:
(*) T=Sum_{i=2}^{infinity} (i*x_i)/N ?


I tried the following:

By definition
eff(T) = I_mu^(-1) / var(T), where
the Fisher information number I_mu = E_mu[ {[ln(x,mu)]'_mu}^2 ].
f'_mu denotes the partial derivative with respect to mu.

1.I tried to calculate I_mu.
let i = (i_1, i_2,...,i_N), where i_k = number of insects on k-th
leaf.

p(i_k, mu) = mu^i_k*exp(-mu) / [ (i_k)! (1-exp(-mu) ], i_k=1,2,3,...;
k=1,2,...,N

Now ln p(i,mu) =ln{ mu^( sum (i_k) )*exp(-N*mu) / [ (Product ((i_k)!))
* (1-exp(-mu))^N ]} =
sum(i_k)*ln(mu) -N*mu -ln(Product ((i_k)!)) -N*ln( 1-exp(-mu) ).

Now:
partial p(i,mu) / (partial mu) = sum(i_k)/mu - N - N*exp(-mu) / (1-
exp(-mu)) =
= sum(i_k)/mu -N/(1-exp(-mu) ).

Now I have to calculate

(**) E_mu[ {sum(i_k)/mu -N/(1-exp(-mu) )}^2 ],

but

I do not know the distribution of sum(i_k).

When i_k have the Poisson distribution with parameter mu then sum(i_k)
has
Poisson d. with parameter N*mu, but we have that i_k have
Poisson truncated (at zero) with parameter mu and I think that
sum(i_k) does not have
Poisson truncated with parameter N*mu (am I right?).

So I do not know how to calculate (**)
(it is rather easy when i_k have Poisson not truncated).

Does anybody have some hints how to solve that?

2. I tried to calculate var(T) the following way:

In my opinion x_i has bin(N,P(i)) (Am I right?):
p(x_i) = C_N^(x_i) * p(i)^(x_i)*(1-p(i) )^(N-x_i), x_i=0,1,2,...,N,
where p(i) = mu^i*exp(-mu) / [ i! (1-exp(-mu) ], i=1,2,3,...;

p(i)= probability that on specific leaf is found precisely i insects.


Now we have
E(x_i)=N*p(i)
and
var(x_i)=N*p(i)*(1-p(i) ).


Now because x_i are independent (am I right?) we have:

var(T)=(1/N^2)*sum( i^2*var(x_i) ) = (1/N^2)*sum( i^2*N*p(i)*(1-
p(i) ) ) =
= (1/N){ sum( i^2*p(i) - sum( i^2*[p(i)]^2 ) }

The sum sum( i^2*p(i) is very easy to calculate but the other sum
sum( i^2*[p(i)]^2 ) I do not how to calculate it.



Does anybody have some hints how to solve that?

TIA

Mark

Quote:

Jack
 
Page 1 of 1       All times are GMT - 5 Hours
The time now is Tue Oct 07, 2008 7:45 pm