Here's one way to think about _why_ it sounds wrong. "Physically based" would mean that "physically" is the answer to the question "How is it based?" To a native English speaker, that question sounds odd. A more natural question is "What is it based on?" To answer that question, you need a noun: "It's based on physics." Hence the construct "physics-based," like "evidence-based medicine" or "merit-based scholarships."
Secondly, "physically" is an adverb. This means it is grammatically correct for it to preceed "based" if used as a verb. If "based" could only be used as an adjective, then you're right, "physics based rendering" would be more correct.
Anybody more knowledgeable feel free to correct me!
incredibly entertaining movie
But, fwiw, to my eyeballs “Physics based rendering techniques,” because it uses the word Physics, as in the whole big field of study, looks like it is a Physics text that happens to include a bit of rendering.
“Physically based rendering techniques” seems like it is a work about rendering techniques, which will draw a lot from physics.