The reason it took 4 months is because I don't think classic RDS can upgrade databases online. You'll either need to failover or have a few minutes of downtime. This is no different to on-prem.

Aurora might be a different situation, not sure.