Ok, then that's what you should ask for. Ask for a more even distribution of resources.
If you single out the elimination of a specific program as a proxy for what you really want, you shouldn't be surprised when the discourse fixates on your targeting that program -- especially when it's a program for gifted students. By doing that you've made it very easy for your opponents to portray you as someone who would rather bring all students down to the same level than allow differences in ability to be cultivated.