You don't need to and probably shouldn't remove the outliers from your dataset. You can easily query it with:

  SELECT * FROM series WHERE is_anomaly = f;

If you want you can wrap a (materialized) view around this.