I don't know much about celestial mechanics, but Newtonian conservation of energy should mean that not only did we 'boop the Sun', but we also pushed the Sun a tiny, tiny, tiny bit away from where it was. I wonder if that would be measurable.
"For New Horizons to speed up, of course, Jupiter must slow down. "That's conservation of energy," he says. But no one will notice. The change in Jupiter's orbit around the Sun due to the flyby is fantastically small. New Horizons will absorb about 1/1025 of Jupiter's orbital energy. That's like "taking a single drop out of the ocean," says Farquhar. "
[1] https://www.nasa.gov/mission_pages/newhorizons/news/jupiter_...
Of course, it's supposed to say 1/10²⁵, which is quite different.
It's measurable, if you've got a long enough time scale.