If you use the iPhone app, it can sync your friend's pictures on Facebook with the corresponding contact in your address book. How does it do this? By having you upload all contacts to Facebook including their name, email address and phone number.
Your privacy is at the whim of those who you choose to communicate with, online or off.