Wouldn't be so sure about it, having lived in Taiwan for many years, a lot of my friends there people leaving HK and setting up a new base in Taiwan. The writing is similar (both HK and Taiwan are far from China's simplified Chinese), the spoken language has a lot of commonalities (bunch of dialects in Taiwan that are closer), and the culture & mindset is very close. Not totally a surprise as Taiwan has a lot of dissidents who left China in earlier conflicts, for quite a while back.
So yeah, from personal experience, Hongkongers fit right in coming to Taiwan.