Not so terrible an idea? Keith Rabois resignation from Square is example enough that you should be absurdly careful when mixing business and pleasure. If you're looking for casual hookups it's best to avoid people you may be connected to professionally.
http://news.ycombinator.com/item?id=5117719