Fisherman's Wharf is the most not-San Francisco part of SF. You know if there is a Hard Rock Cafe that you are not really where the locals dine.
Avoid downtown. Spend time exploring the Mission, the Castro, Japantiwn, the Richmond district, the sunset district.
Fire up Google maps and go and explore the orange areas scattered around the city.
For a more specific recommendation: start at Arsicault bakery and then head down Clement St from there.