It isn't really learning, if it's just regurgitating whole function bodies. I use Copilot a lot, and definitely see whole functions being spit out, that were presumably written by a person somewhere.
Definitely an issue...but not as simple as copy and paste.
I can't use co-pilot because if I am stealing someone else's copyrighted code I'm in trouble from a legal standpoint.