1ewish

I've used GitHub Pages for a long time to serve sites for free, notably https://asciiflow.com, however I have recently moved it and other sites to CloudFlare Pages - it's also got a very generous free tier and many other useful features that GH pages lacks. Setup is simple - https://github.com/lewish/asciiflow/blob/main/.github%2Fwork...

GitHub Actions is just great, and I think people overlook again how much you can do for free! As the author highlights, I use it for running workflows on a schedule, which you can use to rebuild static sites hourly, so they aren't so static after all.

Ok thank you! I think I can see how I am wrong now and why it doesn't actually make a difference.

What am I missing here? It states:

> On the equator, every day of the year is exactly 12 hours long

But surely that is not true, as the Earth's rotation is tilted. Is this supposed to be a year round average? Despite calling out more advanced corrections one can make, this doesn't seem to be mentioned anywhere?

Whilst it is not framed as such, there are some interesting high level takeaways in here for AI, particularly around e.g program synthesis/induction and ARC.

I think Wolfram could contribute a lot if he shifted his focus towards these domains.

I believe this is part of Wolfram's general point around computational irreducibility - there are none.

A UI for building data transformations (SQl queries) isn't on our immediate roadmap, but we have thought about it.

We are taking a bit of a bet here that the industry is moving towards SQL, and we see a growing interesting in analysts wanting to learn it.

Moat: Always a concern! Short term we think most of our unique value comes from the collaborative web development experience which is not OSS currently. Also staying platform agnostic is important to us. Longer term, we have some plans which without going into details mostly focuses on building value around a community and our SQL ecosystem, but not ready to get into details just yet.

Dataform still requires you to move your data to a single place where it can be queried together, whether that's S3 with Presto, Redshift spectrum, or something else.

There are lots of great products for moving data like this, Stitch, Fivetran are both great and we've used them ourselves, but they don't help you manage complex data transformation processes.

Yup, the warehouse or query engine does the heavy lifting, we do the orchestration and make easier to develop these pipelines.

Great question :)

1. Speed. We wanted compilation to really, really fast. 2. In all honesty we just weren't big fans of Jinja, having used it for quite a while. JS templating is OK out the box, and we are considering React like syntax in the future. 3. Love it or hate it, NPM packages are pretty easy to work with and we are working on a number of packages at the moment. 4. When you start to look at things like UDFs and Cloud functions which enables some really cool use cases, JS seems to be prevailing (in Snowflake and BigQuery at least).

I will admit though that we do usually get a bit of a shocked reply when people hear it's not Python!

On-prem: Right now our IDE is only available as SaaS, although we will be looking at this in the near future. You can develop and test projects with the CLI and deploy them yourself but no tutorials for setting this up beyond the basics yet: https://docs.dataform.co/guides/command-line-interface/

Warehouse support: Athena/Presto and Azure are top of mind. I've not come across ClickHouse before but I'll definitely add it to our tracker!

Possibly controversial, but I don't believe there are that many situations in data analytics where you really need realtime/streaming analytics. It usually comes at the cost of significant additional complexity and maintenance, that ultimately hurts reproducibility and agility.

Having said that, we are working on triggering table builds from watching changes to consumed data sets, which paired with an incremental table build would allow you to reliably achieve latency of under a few minutes.

CTO here, What are you after? :)

Athena/Presto, Azure are next in our sights.