Labor is what's gone in, use is the inherent/intrinsic value in the object, and exchange value is what people will trade in exchange for it. That's a bad summary, and there's a lot more to the dialectic examination of them.
Reading Capital (along with David Harvey's lectures) is worth it if you find these things interesting, it's a deep analysis of markets and capital.