This is my primary use case for Newpipe. There is another workaround by using desktop mode in Firefox Android.
How badly Mozilla messed up with Firefox on Android is worth another topic, however.
[0] https://addons.mozilla.org/it/android/addon/video-background...