I live here and I was under the impression that most tech businesses and startups crop up in Wellington, or "Silicon Welly" :)
The downsides are occasionally (OK, often) hideous weather and potential earthquake risks.
Auckland is a nice place but has horrible traffic, near-useless public transport for some areas and is about to go through a total shemozzle of a local government reshuffle, which may drag things back a bit.
How have the politics of New Zealand at the national level changed over the last decade? More or less business friendly?
At the time of my visit it seemed taxes were high but government was less corrupt than in most countries.
Despite that, we fairly consistently came out tops as a great place for small businesses (http://money.cnn.com/magazines/fsb/fsb_archive/2007/06/01/10...).
And also, our tax rates may seem high but overall taxation is quite low, especially compared to other countries (http://en.wikipedia.org/wiki/File:Income_Taxes_By_Country.sv...). Note that our corperate tax rate has dropped quite a bit since 2005.