I am not saying you are doing <X> wrong, but I am always amazed how many mangers want to do Agile, and at the same time don't understand that means not doing waterfall. They are completely different methodologies.

https://www.atlassian.com/agile/project-management/project-m...

Also your scrum master should be sheltering you from some of the distractions you are describing.