> grep any user's FileVault password from the page file
I'm not sure if this necessitates physical access.
A filevault password is useless unless you have root/physical access. If it's mounted by the system, then filesystem ACLs will still be in effect. Otherwise you need root to read raw block devices.