Definition: VSpeedY = round(vy * 4), where vy is bird vertical speed in px/frame.
Red means Q(Jump) is higher; Blue means Q(Stay) is higher. This is value preference (Q-value gap), not probability. X=tubeX, Y=diffY.
Gray=line of raw episode score. Red=line of moving average.