ICE agents are police officers and have all the powers that police officers have. They're under federal jurisdiction rather than state, county, or city. The only limitations are what does or does not fall under their jurisdiction. For instance, they don't have the power to enforce traffic laws (because those aren't federal), but they can certainly arrest you for breaking federal laws or detain you while investigating them.