just disable auto-upload and then manually upload the ones you want to. There is a setting to share your immich library with someone else. Between those two features, you should get something close to what you want.
I just want one click albums. Apparently this is the hill I'll die on.