Maybe partner with the creator of the XXX simulator series, you could make some kind of "MMO" where each participants have to run errands the safest way possible while interacting with each other, and upload the training data. Some player could be randomly elected as "maverick" whose goal is to crash and cause accident, the other player would have to handle them.

And if driving in highway is a problem, why not use a test terrain complete with fog generator? With RC car representing pedestrian, other car, animal, ... feed the video first into an AR system and then give it to the neural net.

anyway good hack, I wish you well :)

email me (profile) if you need a simulated driver ;)