Often you can prune parameters as well. You might be able to cut that down by a factor of 10 without any noticeable loss in accuracy.