You should have a drop-down for selecting a tool profile next to the drop-down for model selection. Select "Minimal" for no tools.

"New text thread" should also have no tools I believe.

https://zed.dev/docs/ai/agent-panel#profiles