I had the same doubt early on, I had asked Claude and checked this:

https://docs.rs/sqlx/latest/sqlx/macro.query.html#offline-mo...

Looks like we are supposed to check them into version control.