You're able to use plain old .css files in a React project, which a lot of people do, using something like css-in-js or tailwind is a choice.
CSS modules still run through a build and bundling step which, in my opinion, kicks it out of the "I'm just using CSS" camp.