Gemini can and does send everything to Google.
Apple's challenge is they want to maintain privacy, which means doing everything on-device.
Which is currently slower than the servers that others can bring to the table - because they already grab every piece of data you have.