I did notice that - even though I'm using a pixel 3a now I'm waiting for full reviews and some understanding of why they embargoed the phone reviews before deciding to buy.
The fix was to slowly scrape all the fluff out with a needle (I am sure there are better ways).
This is of course assuming your issue isn't anything electronic.