The problem is that the strip malls are designed for access by car. That means being close to multi-laned expressways, at least in most of the suburbs. San Jose proper actually has a decent (for the US) public transit system, including Caltrain, the VTA light rail, and a bunch of buses. They're optimized for commuter service, though, and will only take you few interesting places.
The downtown area of San Jose, though, is pretty walkable and isn't too dull (sure, it's no San Francisco or London, but what is?) San Pedro Square has some nice restaurants, and you can head from there to the park and then up Paseo de San Antonio to the university and cute coffeeshops. If you're up for more of a trek (or a few more stops on the light rail) there's a decent little Japantown a little ways to the north as well.