Policy Competition in Real-Time