I've personally found that having the display on has been far and away the biggest battery drain on my phone. At least with the 3G. I haven't had enough time with the 3GS to know one way or the other.

My test was to have the iPod playing and periodically touching the screen to prevent it from going dark.