Nice walkthrough and interesting findings! The difference between the MoE and the dense models seems to be bigger than what benchmarks report. It makes sense because a small gain in toll planning and handling can have a large influence on results.
10 karma · joined June 20, 2014
https://aws.amazon.com/blogs/aws/anthropics-claude-3-5-sonne...