I hate that! We recursively delete .pyc files on django runservers in local development and before unit test runs in our CI environment because we got sick of being bit by exactly this error.
We've started running our runservers with pythondontwritebytecode=1 - I haven't noticed enough of a performance impact to change it back and it saves us remembering to delete pyc files before deploys.
You use runserver in production?
Definitely not! But we use it for testing locally, during which time we don't write pyc files which means we're less likely to have issues with that when we deploy to production.