I think you’re overthinking it. The first definition in the Oxford Dictionary for “actually” equates it with “really”, a substitution which works fine here.
1. as the truth or facts of a situation; really.
"we must pay attention to what young people are actually doing"