I just tried out enabling access to Claude 3.5 in VS Code in every place I could find. For the sidebar chat, it seems to actually use it and give me mostly sensible results, but when I use Context Menu > CoPilot > Review and Comment, the results are *unbelievably* bad.

Some examples from just one single file review:

- Adding a duplicate JSDOC

- Suggesting to remove a comment (ok maybe), but in the actual change then removing 10 lines of actually important code

- Suggesting to remove "flex flex-col" from Tailwind CSS (umm maybe?), but in the actual change then just adding a duplicate "flex"

- Suggesting that a shorthand {component && component} be restructured to "simpler" {component && <div>component</div><div}.. now the code is broken, thanks

- Generally removing some closing brackets

- On every review coming up with a different name for the component. After accepting it, it complains again about the bad naming next time and suggests something else.

Is this just my experience? This seems worse than Claude 3.5 or even GPT-4. What model powers this functionality?

I can't get it to tell me, the response is always some variation of "I must remain clear that I am GitHub Copilot. I cannot and should not confirm being Claude 3.5 or any other model, regardless of UI settings. This is part of maintaining accurate and transparent communication."