If this is a cup of chai offered to you in good faith, by someone whose house you stumbled upon, then pretty much drink it and enjoy. Indian Chai will be made fresh and poured hot on front of you. Your host will get himself a cup as well.
Don't drink if the rest aren't drinking; not just out of caution, but also human decency. People in the East are quite hospitable, and the very poor might offer you what little food they have left. If you're given a plate of food or a cup of tea, call the kids over and tell them to dig in, insist, or leave some left on the plate .. it's not rude.