Yeah, the bromine ion has half life in the body of some weeks, and can cause some neurologic problems,but the body eventually expels it away. I would be worried, but is, not in my primary list of food risk
Bromo alkanes are known alkylating agents. Some alkylating agents are carcinogenic. YMMV...