It wouldn't be a problem if taxi's weren't limited by the government. Personally I think a taxi should be able to go wherever/whenever they want, even if that includes turning down fares or charging a surcharge to go somewhere they don't want to go.
If it's profitable to go from manhattan to brooklyn that need will be served, if it's not profitable then they need to raise the price - why should manhattan riders subsidize brooklyn?