Any Airpods connect directly to the AppleTV. You don't need the remote, phone or an app at all.
If you're using wired headphones then a $20 Bluetooth dongle will do the same.
If you're using wired headphones then a $20 Bluetooth dongle will do the same.