I copied my 10.X whatever Jellyfin 3 times. So I basically setup 3 identical Jellyfin instances. I then upgraded each of them to the latest version. 2 of them upgraded but had horrible performance. The third one finally works the way it should. I have no idea why that worked but after seeing tons of comments that were basically "Idk mine just works" or "idk mine just sucks" it seemed worth doing.
So, maybe try that.
To be clear I didn't copy the libraries. Just the Jellyfin docker data.
Their new database is just bad.
I'm currently sitting at 35k~ tracks, primarily FLAC with some 320kbps mp3 sprinkled in. I also use Jellyfin for anime and have a LOT of shows on there. Haven't noticed any issues yet, so I'm curious where your tipping point was.
I have about 32k tracks and I’m obsessively making this product as fast and beautiful as I can. Email me if you have problems with it and I will resolve them.