Confusingly, this page implies that you always need Flyer + Operator ID even for <250g drones.
https://www.caa.co.uk/Consumers/Unmanned-aircraft/Recreation...
https://www.caa.co.uk/Consumers/Unmanned-aircraft/Recreation...
I agree the rules are annoyingly confusing and the information is spread piecemeal over multiple documents. They should fix that.