I agree! I have not had the opportunity to work at Google or Facebook but at my current job I always take up forsaken projects as that usually has a lot of up potential and very less down potential. Everybody wants to work on the shining new tech but no one wants to work on that maintenance project which is actually is creating those new tech opportunities in the first place.
This is very subjective advice. You could also endup with very patchy inorganically grown software when you dont do any upfront design. It depends on the scale of your project.
If you are adding a minor feature to the product vs if you are creating the datamodel of a new product.
I would only show the datamodel once I have run enough experiments to make sure that it can support the next couple of years of application software
This becomes more difficult when you have dont adjust for variables like out of work pressure. For example, the year that I had a kid, my performance was not the best. It took me an year to adjust but now I have bounced back. I wonder how this would have played out in Amazon or similar companies.
I would also take a look at MDX which comes from Microsoft for classical analytical processing workloads. I feel that it provides a nice way to think of data in terms of dimensions/attributes and hierarchies and measures as it gives a good way to think of what to aggregate vs what fields to use to do that aggregation.
SQL is feels a little more generic and it would be nice for it to have a little more schema aware specifically for analytical workloads.
Shout out to Netlify. I use it to power my personal webpage using Jekyll and its a delight to work with and the documentation is spot on.
The deployment is very straightforward and gives me a good amount of control.
So true!
The comments section feels like the people who shout or whistle while watching a movie in a theater.
Moreover, I find the videos which have commenting turned off much more enjoyable.
I have stopped using emacs from the last 5 years since I had problems with its key bindings. My left little finger ended up paying the price as that is what I use for control key. I still miss org-mode which I used for more than 10 years.
It is one huge reason why I kept coming back to emacs even after all the hurt.
From then on, I used sublime and now vscode to do text editing and an IDE like IntelliJ for development. My left little finger has gotten a lot better.
The state of Gujarat in India prohibits the consumption of alcohol. A lot of its cities are considered to the safest for woman in India.
While alcohol is available illegally, its consumption is still frowned upon.
This relative safety is sometimes correlated with Gujarat being a dry state. I tried to search for any studies but could not find any so it may just be a coincidence. I have lived in Gujarat and the night life is very family friendly and usually involves lots of street food instead of bars and restaurants!
I am so jealous. I always wanted to do a PhD and was even accepted to a good program.
Ended up not going as I could not gather up the courage to leave my job behind.
I sincerely hope the experience getting the physics doctorate was all that he had imagined!
I would also recommend "Database Internals: A Deep Dive into How Distributed Data Systems Work" which gives a good overview of the implementation of a database. I felt that closer to an engineers perspective
I loved my etymotics ER when I had them. Forgot which one it was. I have yet to find a quality sounding in-ears( tried a few without success) . I have moved to AirPods Pro for their convenience but those etymotics were great.
I have had success reaching larger corporations using Facebook. I use it strictly as a directory of contacts both personal and professional. I never look to it for casual content consumption. I have hackernews and sometimes reddit for that.
Analytical loads deal with very large datasets in the order of terabytes even after you compress them. These workloads dont change much so keeping them in the heap eventually results in long processing pauses because JVM tries to recover this memory.
However, in most cases, this data is not meant to be garbage collected. For transactions, once you have persisted the data, it should be garbage collected so the pattern works.
There are a lot of other aspects that I can probably think of but the above one is the most important in my mind.
Some of it is what you mentioned about training and hiring costs that but mostly its this creation of the narrative that it will scale someday in the future. This is usually done by that engineer(s) and they are good at selling so a different opinion is ignored or frowned upon by the leadership.
I have now seen this anti pattern in multiple places now
I work in the Analytics space and been mostly on Java and I am so glad that other people feel the same.
At this point, people have become afraid of suggesting something other than Spark.
I see something written in Rust to be much better at problems like this.
I love the JVM but it works well with transactional workloads and starts showing its age when its dealing with analytical loads.
The worst thing is then people start doing weak references and weird off the heap processing usually by a senior engineer but really defeats the purpose of the JVM
When I think about it, the practices detailed in the article may backfire by decreasing productivity.
Its too much like a manager standing behind you and judging your every keystroke.
I am wondering how much of such non replicated studies leaks into the decisions and recommendations by federal organizations like the CDC or ECDC or WHO.
It creeps me out to think that some organizations adopted some of the ideas outlined in this person's book.