OCR MEI S4 2006 June — Question 1 24 marks

Exam BoardOCR MEI
ModuleS4 (Statistics 4)
Year2006
SessionJune
Marks24
PaperDownload PDF ↗
Mark schemeDownload PDF ↗
TopicMoment generating functions
TypeMaximum likelihood estimation
DifficultyChallenging +1.2 This is a structured multi-part question on maximum likelihood estimation with clear signposting. Part (i) requires standard MLE calculus for normal distributions, parts (ii)-(iii) are routine expectation/variance calculations with linear combinations, part (iv) involves straightforward relative efficiency formula application, and part (v) requires proving an inequality (AM-GM or completing the square). While it covers several techniques and requires careful algebra, each step follows standard S4 procedures without requiring novel insight or particularly complex manipulation.
Spec5.05b Unbiased estimates: of population mean and variance5.05c Hypothesis test: normal distribution for population mean

1 A parcel is weighed, independently, on two scales. The weights are given by the random variables \(W _ { 1 }\) and \(W _ { 2 }\) which have underlying Normal distributions as follows. $$W _ { 1 } \sim \mathrm {~N} \left( \mu , \sigma _ { 1 } ^ { 2 } \right) , \quad W _ { 2 } \sim \mathrm {~N} \left( \mu , \sigma _ { 2 } ^ { 2 } \right) ,$$ where \(\mu\) is an unknown parameter and \(\sigma _ { 1 } ^ { 2 }\) and \(\sigma _ { 2 } ^ { 2 }\) are taken as known.
  1. Show that the maximum likelihood estimator of \(\mu\) is $$\hat { \mu } = \frac { \sigma _ { 2 } ^ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } W _ { 1 } + \frac { \sigma _ { 1 } ^ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } W _ { 2 } .$$ [You may quote the probability density function of the general Normal distribution from page 9 in the MEI Examination Formulae and Tables Booklet (MF2).]
  2. Show that \(\hat { \mu }\) is an unbiased estimator of \(\mu\).
  3. Obtain the variance of \(\hat { \mu }\).
  4. A simpler estimator \(T = \frac { 1 } { 2 } \left( W _ { 1 } + W _ { 2 } \right)\) is proposed. Write down the variance of \(T\) and hence show that the relative efficiency of \(T\) with respect to \(\hat { \mu }\) is $$y = \left( \frac { 2 \sigma _ { 1 } \sigma _ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } \right) ^ { 2 }$$
  5. Show that \(y \leqslant 1\) for all values of \(\sigma _ { 1 } ^ { 2 }\) and \(\sigma _ { 2 } ^ { 2 }\). Explain why this means that \(\hat { \mu }\) is preferable to \(T\) as an estimator of \(\mu\).

1 A parcel is weighed, independently, on two scales. The weights are given by the random variables $W _ { 1 }$ and $W _ { 2 }$ which have underlying Normal distributions as follows.

$$W _ { 1 } \sim \mathrm {~N} \left( \mu , \sigma _ { 1 } ^ { 2 } \right) , \quad W _ { 2 } \sim \mathrm {~N} \left( \mu , \sigma _ { 2 } ^ { 2 } \right) ,$$

where $\mu$ is an unknown parameter and $\sigma _ { 1 } ^ { 2 }$ and $\sigma _ { 2 } ^ { 2 }$ are taken as known.\\
(i) Show that the maximum likelihood estimator of $\mu$ is

$$\hat { \mu } = \frac { \sigma _ { 2 } ^ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } W _ { 1 } + \frac { \sigma _ { 1 } ^ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } W _ { 2 } .$$

[You may quote the probability density function of the general Normal distribution from page 9 in the MEI Examination Formulae and Tables Booklet (MF2).]\\
(ii) Show that $\hat { \mu }$ is an unbiased estimator of $\mu$.\\
(iii) Obtain the variance of $\hat { \mu }$.\\
(iv) A simpler estimator $T = \frac { 1 } { 2 } \left( W _ { 1 } + W _ { 2 } \right)$ is proposed. Write down the variance of $T$ and hence show that the relative efficiency of $T$ with respect to $\hat { \mu }$ is

$$y = \left( \frac { 2 \sigma _ { 1 } \sigma _ { 2 } } { \sigma _ { 1 } ^ { 2 } + \sigma _ { 2 } ^ { 2 } } \right) ^ { 2 }$$

(v) Show that $y \leqslant 1$ for all values of $\sigma _ { 1 } ^ { 2 }$ and $\sigma _ { 2 } ^ { 2 }$. Explain why this means that $\hat { \mu }$ is preferable to $T$ as an estimator of $\mu$.

\hfill \mbox{\textit{OCR MEI S4 2006 Q1 [24]}}