Linkedin -> Connections tab -> filter by "connections only" -> find the one you wanna unfriend in the list and mouse over it -> "more" -> remove connection
That is just about as buried as I thought it would be if indeed it was possible. Classic LinkedIn, thanks!