I know you don't go to them every day but you aren't required to go to all of your teams' agile ceremonies (standups, etc.). They can be handled by the teams and their scrum master, which would be covered by your sync with the SM and your team members. That frees up some time, if you need it. Personally, I'm a big fan of managers being so busy managing that they don't have time for work. Keeps them from writing code. ;-)