If you let other people see that you viewed their profile then LinkedIn will let you see who viewed your profile.
So yeah your theory seems most likely unless OP had Private Mode turned on for his profile (then they wouldn't be able to see that he saw their profile regardless of whether or not they have LinkedIn Pro).