It would've been interesting to compare models with larger context windows, e.g. Gemini with 1m+ tokens and Claude Opus. Otherwise, the title maybe should've been Financial Statement Analysis with GPT-4.
I jest - a well contained and specified context is important for a paper.
But also, questions like "it would be interesting to also try this other thing" is how new papers get written.