I no longer have my Tesla, but I stopped using AP before I sold the car, partly as a result of this behavior. And partly because phantom braking became pretty common for a number of overpasses we go under on our way to grandma's house, and it really scares the crap out of my wife & kids.
Aside from phantom braking, the best use case for AP, in my opinion, is to be a jerk and cruise in the middle lane of the freeway. It deals okay with that most of the time.
That's literally "trusting it".
As a human, you are attempting to learn the situations under which the car operates safely. You could be very conservative and say "it never works". The big problem is that the kinds of errors that occur in these systems are very different from the kinds of errors that humans expect. Even designers of autonomous systems can be surprised by emergent behavior. You say you can quickly learn the good and bad sides of it, however, that's not true. How much reliability do we expect from a system that, when it fails, leads to sever injury or death? ASIL-D is something like one failure in 10^9 hours [1]. That's 100,000 years.
You do not have that much experience with your Tesla, sorry. In principle, you might drive every waking hour for 10 years, never witness an accident, and you still not have an argument that passes even the most basic scrutiny for safety for critical systems. It could make a fatal mistake in the 11th year and that would not be a big surprise.
No one has that much experience with the ASIL-D components of any car. That's why I we must rely on regulation and standardization to help keep us safe. Safety isn't just "well I tried it a bunch under these conditions and didn't get hurt". And that's why what Tesla's strategy is reckless.
[1] https://en.wikipedia.org/wiki/Automotive_Safety_Integrity_Le...
Sometimes I wonder about the folks who think AP makes for a more relaxing drive. I think that's only true if the level of defensive driving it does matches well with the driver's innate driving style. I'm not prone to having close calls on the road because I avoid them well before they get exciting. I've ridden with people who just don't drive that way, though. They'd probably be okay with AP.
There must be quite a lot of false alarms to filter out...
Additionally I've experienced cases of "phantom braking" (https://www.cbsnews.com/news/automatic-emergency-braking-in-...) which doesn't instill confidence in those features.
Is it possible you have older autopilot hardware that runs different/older software?