That's enough. Most people will be happy to hire or recommend people they've had positive (read: not negative) work experiences with.
To you, you may seem introvert and invisible. But to someone else you may be a professional who doesn't waste time on banter and who will get the job done without rocking the boat.
Just contact people you've worked with before, you'd be surprised at how they remember you.