Last I checked, Apple rejects anything that duplicates the core functions included on the device. Those include web browsing, media playing and email.
Apple doesn't have a problem with third-party web browsers as long as they use the WebKit engine. Otherwise, the app would be implementing its own language interpreter and therefore be against the developer agreement.