This is really interesting! Seems on a similar ballpark as graphenedata. How do they compare?
9 karma · joined May 21, 2021
This week dbt acquired SDF (conversation here: https://news.ycombinator.com/item?id=42697764), and now Tobiko acquires Quary, another data tool built in Rust.
Excited to see how this will impact the compile times (and developer experience in general) of sqlmesh
Can't help to think that that if a Fivetran sync fails, the problem would come back.
Maybe a more sensitive solution is to take the last modified date of all of the sources and use the oldest one as the cutoff, that way you wouldn't be afraid of your relationship tests failing if the sync failed too, although I reckon that this solution assumes that your sync frequency is equal for all of your sources