At least for spreadsheets get rid of it. I could see it being nice to remove all the junk chrome that Google puts around docs though. But if I'm viewing a spreadsheet, not being able to add to cells is useless.
also, if anyone wants a nicer icon i made @mattrossi's dribble shot (http://dribbble.com/shots/530208-Google-Drive-FREE-PSD?list=...) into an .icns file you can easily replace: http://dl.dropbox.com/u/8875810/google-drive-icon.icns