If you are on H1B and you have a family in the country I think you need to be very careful about how you behave at work, and if your work situation sucks you better start looking for a new H1B sponsor. You can always complain later.