As a patriotic Nigerian I feel insulted by your comment, it is like justifying theft because the victim may likely waste the stolen stuff, so he doesn't deserve them.
This is a hard problem (see the conflict in Israel) and there’s not any good solutions.
I’m sure as a patriotic Nigerian you feel strongly about their return, but it’s also important to realize that the patriotism is artificial in the first place.