Source? I've never got that impression as an English person. I consider it to be non-specific. However, if you're in a place like Southall or Bradford then the "Asian" people around you are indeed more likely to be south Asian.