caching + simpler models for classification / triage should reduce the load on the big model.