pacuna

Nice!

Sounds kind of similar to CMU's Peloton.

I don't think people choose to be psychopaths, they just are.

AWS CLI APIs in general are very clean and intuitive to follow through their help menus.

In my experience, learning something hard without applying it to a real problem during several weeks or months, spending hours trying to solve weird errors is impossible.

Keep in mind that learn something is very different to understand something. Maybe I understand functional programming, but if I haven't worked on a real project that uses a functional programming language, I probably suck at it.

Nice resources. Mostly focused on the Big Data aspects of data engineering. I would also suggest to check out some advanced SQL and ETL books or courses.

Pretty excited to see Fintual on that list. It's the first Chilean startup that got accepted.

I was thinking the same thing. I believe with the latest changes in the algorithm this should be even harder.

your link points to the data warehouse toolkit, not the ETL one.

Build a web scrapper and save some raw data in somewhere like S3. Then run some job on top of that data to get aggregated measures and save them somewhere. I built a project[1] like this and learned a lot in the process. I used airflow to run the scrapping tasks, save the data in S3, use AWS Athena to run queries and load data into Redshift. I did all of this just to learn more about Airflow and some AWS tools.

[1] https://skills.technology/data-engineer

yes. It uses schema-on-read so it doesn't support indices as far as I know. And yeah, it scans through the data using the schema you define previously

The serverless capabilities is the big plus IMO. You pay for query. If you go with a typical OLAP system like redshift you need a cluster with a minimum number of machines I believe.

I think it compares more with something like BigQuery but if you already have your data in S3 maybe you get a more well integrated system if you stick with AWS tools.

I would say you're using the closest (not really) comparison

Doesn't work well in Fedora 28 running on Wayland which is my environment.

An app that shows the most demanded technologies for a lot of different IT careers: https://skills.technology/software-developer

Iterm is probably the only thing I miss from MacOS when I'm on my Linux machine.

Designing Data‑Intensive Applications. For Data Engineering

Yes, and besides they have other tools gaining traction, like F# which I've heard good things about.

Oh man, probably never. Too many big companies depend on MS stack I guess.

True. But it's also important to know what they do with the data. We all knew that FB had our data. What we didn't know is that it was being used to do unethical stuff by companies like Cambridge Analytica.

no, not really

I've been using Mailspring for a couple of months now on Linux and it's been a very good experience. I think it's better than Thunderbird if you are more used to webmail clients.

Damn, I had trouble finding more than 3 degrees

For me it would be Fedora using Gnome

Does anyone know where I can find podcasts to improve German?

good luck with that

- Fooled by randomness by Nassim Taleb

- Sapiens by Yuval Harari

- The invention of nature by Andrea Wulf

- The subtle art of not giving a f*ck by Mark Manson

- Philosophy of Science: Very Short Introduction by Samir Okasha

You mentioned several different topics which would take a long time to learn. I could help you with a Ruby path:

- Learn the basics of Ruby (what's happening behind the API)

- Learn the basics of Rails (what's happening behind the API)

- Read Ruby under a microscope (what's going on closer to the hardware)

- Learn the basics of cloud computing (AWS for example for the more arcane aspects of network infrastructure)

You could pick other language and find similar resources for those. Also there's ton of material out there for all of these topics. Good luck.

This year I went to Rails conf in Phoenix and Ruby conf in NOLA. Both were great. Excellent organization and a good variety of topics (I don't develop exclusively with Ruby/Rails).

Probably something custom made with .NET Framework. Try the builtlwith extension.