Memory latency is 20-50 % worse, but that doesn't mean 20-50 % lower FPS. What it does mean is in CPU limited scenarios Ryzen CPUs currently cannot touch Intel's CPUs. Even several year old high end Intel parts outperform Ryzens there, even if the Ryzen part in question has better single threaded throughput (i.e. Cinebench).

At the 3600 price point this is largely irrelevant though, since you will be GPU limited by way of budget anyway.