Anthropic Introduces Claude 2.1 with 200K Context Window

https://www.anthropic.com/index/claude-2-1 might be a better link

That sounds plenty, are these windows usual though? Don't the models start to lose attention at some point, so if you fill up the entire 200k you don't always get the output you asked for?