Score trends

The first and last 50-episode means compare the start and end of the run. The orange line shows the trailing mean over up to 20 episodes. The vertical marker shows where ordinary epsilon reached zero, when observed. Look at scores before and after that marker when deciding how long to explore.