The traditional distinction is that a constant has the same value each time an expression referencing the constant is evaluated (hence a compiler for example can apply constant propagation), whereas the value of a variable referenced in an expression may be different each time the expression is evaluated. The most common example is a local variable, which, even if immutable, will often have a different value for each invocation of the containing function. This is most obvious for function parameters.
With constants, you could replace each occurrence of the constant with its actual value in the program code, without changing the program semantics. With variables you generally cannot do that, because the value will vary at runtime.
Constants can be in ROM, variables need to be in RAM.