And then when you click on some Google service it always logs you in with a wrong account. Good luck trying to add something to calendar by clicking to a link.
If you really want to keep them separated, you should just use Chrome's multi user accounts or their equivalent in other browsers.
Actually, you explained the problem without noticing it: "It just uses the first account you logged in with." Maybe it should be default account? Because "first account" will always change in round robin fashion because cookies will expire first for the newer account (which is second) and then after you login it will become first.
I guess it might not work well if you click a random link somewhere with two accounts open simultaneously, although I have a bit of sympathy for them there because that does seem kinda tricky to solve.