I feel like those are idiosyncrasies that feed into eachother i.e. you need to have 2 notations for same sound just because other decisions made it so there is no extra info passed other than in b vs #
So alternative notation could still make it clearer/"mathematic" but would essentialy need to include all of that, and for that as you said, you need people with wide experience about music and for them, they already are fine with standard notation so for them it wouldn't be an improvement because nicer learning curve doesn't matter once you learned it.
Classical keyboard layout is kinda similiar in opposite way here; beginner can just slap some white keys and get something musical and they can learn from there, while various chromatic keyboard layouts might have some nice benefits (chords being "same shape" regardless of where you play them), it is harder to start on it.