In terms of shallow natural language processing, some pretty simple observations can lead to a lot of bang for the buck.
One project I completed was able to really excel at keyword matching simply by building a huge dictionary of words, in a literal sense: a dictionary of contextually relevant words to a phrase, generated by very large texts.
I think baby steps are the key to getting further with NLP. For reference: http://nlp.stanford.edu/fsnlp/