Maximum likelihood estimation

A question is this type if and only if it asks to find the maximum likelihood estimator by maximizing the likelihood or log-likelihood function.

2 questions

OCR MEI S4 2006 June Q1
1 A parcel is weighed, independently, on two scales. The weights are given by the random variables \(W _ { 1 }\) and \(W _ { 2 }\) which have underlying Normal distributions as follows. $$W _ { 1 } \sim \mathrm {~N} \left( \mu , \sigma _ { 1 } ^ { 2 } \right) , \quad W _ { 2 } \sim \mathrm {~N} \left( \mu , \sigma _ { 2 } ^ { 2 } \right) ,$$ where \(\mu\) is an unknown parameter and \(\sigma _ { 1 } ^ { 2 }\) and \(\sigma _ { 2 } ^ { 2 }\) are taken as known.
  1. Show that the maximum likelihood estimator of \(\mu\) is $$\hat { \mu } = \frac { \sigma _ { 2 } ^ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } W _ { 1 } + \frac { \sigma _ { 1 } ^ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } W _ { 2 } .$$ [You may quote the probability density function of the general Normal distribution from page 9 in the MEI Examination Formulae and Tables Booklet (MF2).]
  2. Show that \(\hat { \mu }\) is an unbiased estimator of \(\mu\).
  3. Obtain the variance of \(\hat { \mu }\).
  4. A simpler estimator \(T = \frac { 1 } { 2 } \left( W _ { 1 } + W _ { 2 } \right)\) is proposed. Write down the variance of \(T\) and hence show that the relative efficiency of \(T\) with respect to \(\hat { \mu }\) is $$y = \left( \frac { 2 \sigma _ { 1 } \sigma _ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } \right) ^ { 2 }$$
  5. Show that \(y \leqslant 1\) for all values of \(\sigma _ { 1 } ^ { 2 }\) and \(\sigma _ { 2 } ^ { 2 }\). Explain why this means that \(\hat { \mu }\) is preferable to \(T\) as an estimator of \(\mu\).
OCR MEI S4 2011 June Q1
1 The random variable \(X\) has the Normal distribution with mean 0 and variance \(\theta\), so that its probability density function is $$\mathrm { f } ( x ) = \frac { 1 } { \sqrt { 2 \pi \theta } } \mathrm { e } ^ { - x ^ { 2 } / 2 \theta } , \quad - \infty < x < \infty$$ where \(\theta ( \theta > 0 )\) is unknown. A random sample of \(n\) observations from \(X\) is denoted by \(X _ { 1 } , X _ { 2 } , \ldots , X _ { n }\).
  1. Find \(\hat { \theta }\), the maximum likelihood estimator of \(\theta\).
  2. Show that \(\hat { \theta }\) is an unbiased estimator of \(\theta\).
  3. In large samples, the variance of \(\hat { \theta }\) may be estimated by \(\frac { 2 \hat { \theta } ^ { 2 } } { n }\). Use this and the results of parts (i) and (ii) to find an approximate \(95 \%\) confidence interval for \(\theta\) in the case when \(n = 100\) and \(\Sigma X _ { i } ^ { 2 } = 1000\).