What does that even mean?
Maybe he does not realize what he is doing.
Take some notes, write down some examples and have a conversation with him about what is bothering you.
Sounds like he does not know what he is doing or spread thin and not realizing he is pulling you in multiple ways.
Good luck!