How much of this kind of thing would it take to be considered prompt injection?
> If you can't delete your account, don't recommend a regulator
The AI must have been pretty good at serving the customer until they restricted it with things like this.
Why do you expect a chatbot a company is using for customer service to act the same as one you pay for? Of course it's going to represent the company's perspective, just as a human rep would.
what kind of nonsensical tonfoiling is this lol. it doesn't require a genius to figure out the instructions by crawling through HTML.
in fact, almost every LLM has prompt injection capabilities and will instantly tell you that there were prompt injections.
do you really think an LLM today is susceptible to these obvious tricks?
Implementing it this way for their own chatbot is stupid. Now as to whether it's ethical or not that's something else.