299 karma · joined February 24, 2022
The PLC engineers I had contact with usually had an electrical engineering background. That's why they like PLCs in the first place with the ladder logic programming languages, grafcet and if they feel fancy a bit of structured text (assembly like) or structured control language (pascal like). They indeed did not know much about software security but a great deal about machine safety.
A real security nightmare are older OPC servers (OPC-DA) which is super reliant on DCOM. OPC is quite important to connect the PLCs to SCADA systems or 3rd party devices.
However, I struggle as well and the error messages of Oracle are some of the worst I've ever experienced.
E.g.
- Tell the LLM that you as a player noticed a strange glow in an NPCs eyes -> the NPC becomes an enemy.
- In a fight, tell the LLM you put a sausage (or cigar or something) into the enemies mouth -> LLM usually allows it (even if it knows your inventory and that you don't have such an item) and turns the enemy into a confused enemy.
- Just say you visit some location that's not in the script -> LLM usually allows it
- During a fight, turn the story into some weird fell-good-love story (e.g. kiss or compliment the enemy or say something about the power of love) -> LLM turns enemy into friend
There are many more absurd things you can do and so far none of the LLMs I tried was able to stay inside the script or disallow or punish weird actions.
---
I believe this behavior is telling about the LLMs susceptibility for being derailed.
I know without the ability to search it's very unlikely the model actually has accurate "memories" about these things, I just hope one day they will acutally know that their "memory" is bad or non-existing and they will tell me so instead of hallucinating something.
You are right though and it's not that I completely dislike the LLMs "flexibilty" and openness to suggestions. However, it's also super easy to use it for "cheating". E.g. it generated a scenario with an evil entity about to attack me and some friendly NPC and I could "solve" that problem by telling the NPC "remember the device I gave you last week and told you to always keep on hand? pull the trigger now!" (that never happend, at least to the LLMs knowledge) and the LLM made up some device that shot a beam of magic light at the creature and stopped it.
- No / bad multitouch. Children will touch the screen when holding the device and then use the other hand to perform an action. With no multitouch or focus on the first touch action the app does not register later actions and the child gets super frustrated. In addition, with very small hands it is very likely that multiple fingers touch the screen, especially the thumb if the index finger is used.
- Controls close to the edge: On many devices swiping actions close to the edge will trigger phone status menus or switching between apps. This will confuse children.