408 karma · joined August 13, 2018
Yes the current agent-qa is agentic testing not a bug finder, because bug finder is mostly a token guzzler spends millions of them and it finds nothing. So we aim to solve it with the first principles, will release soon.
We built agent-qa (https://github.com/vostride/agent-qa), an open-source self-improving QA agent. The harness becomes outdated every 3 to 6 months. Unfortunately, the big players are unable to maneuver their ships and are already outdated—even Momentic.
It would be great to see Momentic's benchmark on neutral benches, not the ones created by themselves.
We at Vostride have benchmarked agent-qa and are already leading on many:
- #1 on AndroidWorld benchmark (https://vostride.com/benchmark/android-world)
- AppControlBench - https://vostride.com/benchmark/app-control-bench
Checkout agent-qa at https://vostride.com/
GitHub - https://github.com/vostride/agent-qa
---
Hi, We identified unauthorized access to a legacy system that we were in the process of decommissioning. Third party provider keys (eg OpenAI, Anthropic) saved in your workspace may have been exposed. Please revoke and replace those keys through the relevant provider’s dashboard, update any applications using them, and review recent usage for unexpected activity.
We’re sorry this happened and will follow up with any updates.