5 Henry is doing a sponsored cycle ride for charity. He needs to finish at noon on Sunday. He can ride up to 50 miles each day, except Sunday when he can ride at most 20 miles if he is to finish on time.
The total length of the ride is 95 miles so Henry has allowed 3 days for the ride. Henry will start his ride at \(A\) and travel through \(B , C , D\) and \(E\), in that order, and finish on Sunday at \(F\). He will stay overnight on Friday and Saturday at two of the places \(B , C , D\) and \(E\).
The distances between the places along the route are:
$$A - B = 30 \text { miles } , \quad B - C = 15 \text { miles } , \quad C - D = 35 \text { miles } , \quad D - E = 12 \text { miles } , \quad E - F = 3 \text { miles. }$$
To reach \(F\) on Sunday he must have reached at least \(D\) by Saturday night (since the distance from \(D\) to \(F\) is less than 20 miles but \(C\) to \(F\) is more than 20 miles.)
Henry wants to use dynamic programming to minimise the maximum distance that he cycles on any day.
The stages will be the days. The places where Henry stays overnight will be the states. Henry starts on Friday morning at \(A\) which has the (stage; state) label ( \(0 ; 0\) ). On Friday night he can either stay at \(B ( 1 ; 0 )\) or at \(C ( 1 ; 1 )\). Depending on where he stays on Friday night, he can spend Saturday night at \(D ( 2 ; 0 )\) or \(E ( 2 ; 1 )\). On Sunday he arrives at \(F ( 3 ; 0 )\).
[0pt]
- Use this information and the table below to draw a network, labelled with stages and states, to show the possible transitions between states. The arc weights should be the distances between the states. [2]
Henry uses dynamic programming, working backwards from stage 3, to find where he should stay overnight to give the route for which the maximum on any day is a minimum. His tabulation is shown below.
| Stage | State | Action | Working | Suboptimal minimax |
| \multirow[t]{2}{*}{2} | 0 | 0 | 15 | 15 |
| 1 | 0 | 3 | 3 |
| \multirow{3}{*}{1} | 0 | 0 | \(\max ( 50,15 )\) | 50 |
| \multirow[t]{2}{*}{1} | 0 | \(\max ( 35,15 )\) | \multirow[t]{2}{*}{35} |
| | 1 | \(\max ( 47,3 )\) | |
| \multirow[t]{2}{*}{0} | \multirow[t]{2}{*}{0} | 0 | \(\max ( 30,50 )\) | \multirow[b]{2}{*}{45} |
| | 1 | max(45, 35) | |
- (a) In the last row of the table, the action value is 1 . Explain what this tells you.
- (b) In the last row of the table, the working column is \(\max ( 45,35 )\). Explain where each of the values 45 and 35 comes from and how they relate to the (stage; state) values for this row and for a row from the next stage.
- Use the table to deduce where Henry should make his overnight stops to minimise the maximum distance that he cycles on any day. Explain how you obtained this solution from the table.
Henry is so pleased with his ride that he decides to do a longer ride. Again he will cycle up to 50 miles each day, except the last day when he will cycle at most 20 miles. He wants to complete the ride in five days, and he wants to minimise the maximum distance that he rides on any one day.
He will start at \(A\) and travel through \(B , C , D , E , F , G , H , I , J\) and \(K\), in that order, and finish at \(L\).
He will stay overnight on Wednesday, Thursday, Friday and Saturday at four of \(B , C , D , E , F , G , H , I , J\) and \(K\).
The distances between the places along the route are:
| \(A - B = 30\) miles, | \(B - C = 15\) miles, | \(C - D = 35\) miles, | \(D - E = 12\) miles, |
| \(E - F = 3\) miles, | \(F - G = 30\) miles, | \(G - H = 10\) miles, | \(H - I = 25\) miles, |
| \(I - J = 10\) miles, | \(J - K = 10\) miles, | \(K - L = 5\) miles. | |
- (a) Which is the furthest place from \(L\) that Henry must reach by Saturday night if he is to finish on time?
(b) Work backwards to deduce the furthest place from \(L\) that Henry must reach by Friday night, Thursday night and Wednesday night. - Find out where Henry could stay each night, and hence define appropriate states for each of stages 1, 2, 3 and 4 . (Note that not every place need correspond to a (stage; state) label.)
- Set up a dynamic programming tabulation, working backwards from stage 5, to minimise the maximum distance that Henry must ride on any one day. Where should he make his overnight stops?