Lucene's pretty great. The segments file model even works pretty well with S3.