This makes sense. One suggestion would be to add a "Click to hold" button, which will push the dialog pop-up into a corner, maybe in a condensed view, and allow you to select more items. Then you can do a selective comparison of multiple items at once.
"Click to hold" isn't a good name for the feature, but hopefully the idea makes sense.