If it is mostly your own tooling you may want to look at setting up a dev drive. It is supposed to be more optimized around workloads that would normally spin stuff like defender off the rails.
System -> Advanced ->
-> For developers -> Developer Mode [on]
-> Dev Drive -> Create Dev Drive