1) I've heard many (non-physicist) people argue/think that the 2nd Law of Thermodynamics is a law in the sense that, say, General Relativity or Conservation of Energy is a law. That is not true. As explained here (http://physics.stackexchange.com/questions/4201/why-does-the...) the basic laws of physics are time-symmetric, i.e. there's no currently known fundamental reason that entropy behaves the way it does.
2) I've read this story 20+ times, yet each time it gets me. I think the force of the story comes not from the scientific predictions but from the poignant depiction of humanity's futile fight against oblivion. Aren't all monuments erected for this purpose? The fact that the story is very light on the tech details paradoxically increases its punch.
3) The described technology is a curious mix of far-sight and ridiculous backwardness: In describing harnessing the power of the Sun, Asimov may have had in mind something like a Dyson sphere, which Dyson described in 1960. However, the technicians still use a teletype to communicate with Multivac in 2061!
4) One thing that I think Asimov got wrong fundamentally is that researching the "final question" should have taken all of Multivac's CPU capacity. It's stupendous that Multivac just runs that question on a separate thread while doing everything else. The Hitchiker's Guide gets this right: when Arthur asks a very powerful AI (the Nutrimatic Drinks Dispenser) to make tea it totally paralyzes the machine.
5) I've never been able to find a good interpretation of Cosmic AC's response "NO PROBLEM IS INSOLUBLE IN ALL CONCEIVABLE CIRCUMSTANCES."