"Get a job with the associated temporary residence permit"

I'm not familiar with Poland specifically but this is generally the insurmountable barrier for most folks. Remember not everyone is a dev! "Sick person who works at Best Buy and drives for Lyft on the side" is going to have a really hard time with that step.

Generally speaking, employers need to make a reasonable enough case that they couldn't get an EU person to do the job, and there are often income minimums, specified in-need fields, etc. .

So it's definitely not impossible (I did it), but for the sort of person getting told "if you don't like it you can 'git out" it's an issue.