Interesting enough, this is exactly what George Hotz on the AI podcast points out as the hardest part to getting to level 5 automation, all the counter factuals involved in the decision process.
I would suspect for true level 5 automation we will need a network protocol that broadcast each...