Streaming parsers are key when dealing with XML files this big. Used to have a C# parser that would parse about 1 TB of XML per day the biggest files were > 200GB.
It was impossible with out rewriting everything to use a SAX style parser.
It was impossible with out rewriting everything to use a SAX style parser.
This category is generally called "pull parsers" (as opposed to SAX-style event-driven parsers)