Advantages:
1) Candidates can virtually choose any language, framework, libraries or IDEs to solve the challenge. (Since they are developing on localhost with their own setup)
2) Because of 1) you need not limit your challenge to be overly algorithmic. You can for example ask questions like 'Pick the most popular article on hacker news today'
Disadvantages: Limited to candidates who can develop a web application