Ship Harness Bench – Same prompt, same model, different harnesses

grigio.github.io

1 pointgrigio3 comments

Really interesting experiment. Are there any other variables which could have been missed though?

Also memory could be a thing for complex open prompts. But creativity is a mix of model, context, harness

tldr: probably browser usage skill is the most important thing