I couldn't imagine trying to read Wolfe with English as a second language — definitely commendable! One thing I'd recommend if you're giving it another go is to read the chapters, then listen to Alzabo Soup (the podcast) afterwards. It's a spoiler-light discussion of the book, and they highlight a lot of things I missed on the first read.
Another recommendation is to try the Book of the Long Sun series instead. I actually recommend that to folks more frequently if they aren't sci-fi readers. I think it's a bit more approachable in terms of language, and the tone is very different. There's also no character like Severian in that series, which I think is a good thing.