Of the many factors you are not considering, albedo affects how much solar radiation (not all of it visible) is reflected back into space.
Albedo is an important factor, but there is actually very much uncertainty about human influence on earths albedo, and at any rate the effect seems to be pretty small. Humans' effect on CO2 on the other hand is extremely well-established and much greater, which is why it's logical to focus on it.