I think you'd need to be violating some other rule of rust to do that. e.g., single mutable access.