Hacker News Reader

HNHacker News

Top New Best Ask Show Jobs

Comment by akalitenya | Hacker News Reader

Parent Full thread

akalitenya·

Mprove creates permanent derived tables in BigQuery if the user wants it.

But you can't use BigQuery for OLTP.

View on HN

No - I'm talking about MySQL being needed as a dependency.

https://github.com/mprove-io/mprove/blob/master/deploy/docke...

Can you not use biquery database itself. Create tables for your internal use instead of MySQL ?

The MySQL image specified in the docker-compose file you mentioned. It is used for the internal data of the Mprove application (users, projects, members, etc.). Each user action in the web client (angular) can initiate several queries to this database through an backend request. Delays here are crucial. network latency - so you need to keep the database as close as possible to your server side, read / write delays - for queries such as finding a user / setting a username / creating a member, etc.

Hmm..I would prefer to not have it. In production, managing database persistence is very hard. Especially when you go down the kubernetes road.

I would take higher latency, but avoid pulling in a whole database infrastructure.

Plus a huge number of us use postgresql..so that becomes another set of a mess. I would strongly urge you to do this on the same bigquery database that you would connect to anyways.

Bigquery exists only in Google Cloud. This is a columnar database like Redshift. It is not designed for fast processing small queries that are necessary to support the operation of any application. Its main feature is that it can scale the execution of heavy analytical queries between 10,000 nodes transparently for the end user. Users have no control over Bigquery instances. This is super cost effective cloud analytical database as a service to be used as centralized data warehouse for company of any size.

Reply on news.ycombinator.com