To ruby folks, it's like faster ruby. What is the appeal to Scala folks? As formerly a Scala folk, it hasn't had much interest to me (but I have no negative feelings about it either, it has always been a "cool another language" to me)
Elixir brings style to Erlang/OTP.
Comparing to Ruby is apples to oranges because Ruby's concurrency and operational foundation is weak. The better comparison is Erlang/OTP vs JVM, where JVM gets the edge on optimized performance, and Erlang/OTP gets the edge on concurrency & tooling. The appeal for Scala folk would be if you don't care about the JVM compatibility or raw performance, and want an opinionated ecosystem built from the ground up around the actor model.
Pro-tip: If you can't write a GenServer in Elixir from scratch, along with understanding all of the differences between casts and calls, you probably don't understand the actor model (at least how it's used in Elixir) very well.