Yes. Similarly with Muslims too. It makes getting financing for things that need loans (e.g. houses) trickier and sometimes open to exploitation:

https://en.wikipedia.org/wiki/Riba