Thanks!
For anyone interested this is what I ended up with to fly around:
<a-entity
camera
look-controls="pointerLockEnabled: true;"
wasd-controls="enabled: true; fly: true; acceleration: 3000;"
></a-entity>