It can pass easy leetcodes. Here's a transcript of it solving an easy leetcode problem, and I also asked it for additional test cases.
There was another problem I tried where it gave an almost correct answer. Fixing the answer from then was probably faster than if I had to do from scratch.