For those who want to try it a real world version of this, the BirdClef 2024 competition is currently running:
https://www.kaggle.com/competitions/birdclef-2024
Lots more I can say here - I've been working on problems in bioacoustics for years - but for now will just leave a link to some work on using bird song embeddings from last year.