This is exactly what we do where I work. We send them a small problem that any competent person can solve in 15-30 mins in Python/Java/C++. It is amazing what an effective filter this is and submitted results range from fully tested code, innovative O(1) solutions down to code submitted in MS Word that gives the wrong answer.
As a front line filter it is cheap, simple and revealing.