The historian I spoke of mentioned this. He could back it up with pictures of them co-mingling extensively.
Is it to say no racism existed in that time period? Hardly. But far too often I've seen it painted that the south is deeply racist to this day. Generally I only tend to hear it from people who have never been. I say this as someone originally from the north.