HNHacker News
TopNewBestAskShowJobs

manish_gill

1,516 karma · joined October 18, 2011

Software

https://parallelthoughts.xyz

https://twitter.com/mgill25

submissionscomments
manish_gill··on PSA: One of the FANGs [sic] is about to internally implode
Interviewed a candidate last month who was leaving Amazon (downgrading his salary as well) because acc to him, working there was having a big impact on his mental health.
manish_gill··on Ask HN: Gmail account security
Just signed up. Your idea appeals to me. Hope I can take it for a spin soon!
manish_gill··on Ask HN: Who is hiring? (January 2022)
Can you share your CV with me? Please find my contact info in the profile.
manish_gill··on Ask HN: Who is hiring? (January 2022)
Apologies for the late reply.

Interview process is 3 parts:

1. We do a semi-technical first call with you - getting to know your professional and technical experience, what you're looking for, presenting the team, and some high level design/architecture thinking.

2. If we want to proceed, we send you a coding challenge (Easy/Med/Hard all 3 types of problems - and the time setting is relatively relaxed). You can take that on your own time.

3. If you clear that, then it's just getting to know all of the team. Everyone talks to you/get to know you/tell you about the role etc. This is time consuming but not heavy on the technical side.

That's it. Then we make a decision.

We also have a team member in the US, so really, for the right candidate, we are flexible about the location. But it's really the exception rather than the rule, so we are leaning EU first right now unfortunately. But that shouldn't discourage you from applying!

manish_gill··on Ask HN: Who is hiring? (January 2022)
TomTom | Full Time | Berlin/Germany, Amsterdam/Netherlands | DevOps, Data Engineer, Full-Stack Software Engineer ONSITE | VISA/REMOTE possible | https://tomtom.com

My team at TomTom is hiring Senior Software Engineers to work on a Global-Scale Traffic Prediction System. It's a pretty cool setup and work-life balance is great. We work on very large scale traffic data - the code you write will produce what drivers see on their navigation systems.

We're doing Scala / Java / Python / Spark / Terraform / Azure / Github Actions

At least in my team, the focus is on solving problems - so if you can solve a problem using $YourFavoriteTech, and help onboard the rest of the team, you'll get the freedom to do so.

Combination of Data/ML Engineers, Data Scientists, and Full Stack Engineers. We have the entire Machine Learning life cycle - from labelling to prediction.

Job spec says Amsterdam and Berlin, but I think we're pretty flexible if you're anywhere, and you're good.

Positions:

- Senior Software Engineer https://www.tomtom.com/careers/jobdetails/JR0009102/sr-softw...

- Senior Data Engineer https://www.tomtom.com/careers/jobdetails/JR0009122/sr-data-...

- Full Stack Software Engineer (Java/JVM) https://www.tomtom.com/careers/jobdetails/JR0007891/full-sta...

Feel free to send me an email. Contact Information is in my profile.

manish_gill··on An Algorithm for Passing Programming Interviews (2020)
Why do you call it cheating? Did the candidate actively copy a solution by deception or were they just very well prepared - to the point that they quickly recognised and solved the problem which they had seen before?

Perhaps I should throw out my CLRS and Skiena and invent everything in those books from scratch?

It's an Arms race because people like you have turned it into one. You're not solving Nobel prize winning problems, so stop expecting people to magically invent on the spot novel algorithms for things they've never seen before.

Some people are good at it and some are not.

manish_gill··on macOS Setup after 15 Years of Linux
As a recent convert from Alacritty to Kitty, I can confirm this. Kitty blew Alacritty out of the water in the first 10 mins of my experience with it.

Like holy crap, it's a very well written and well thought out piece of software. And it's fast. I'm all about the Rust hype, but Kitty reduced latency drastically.

manish_gill··on The Big DevOps Misunderstanding
You'll find plethora of learning documentation, but by far, the one talk/presentation that made it click for me was this one: https://kube-decon.carson-anderson.com/
manish_gill··on The Big DevOps Misunderstanding
One can write good and bad code in any language. It just so happens that our daily driver - procedural or functional languages, happen to be ones where a Software Engineer's mental model + Existing tooling is evolved enough to make understanding it _easier_ (as opposed to just easy).

The problem with DSLs and Config languages is that someone will inevitably try to use them in a way they are not designed to be used, and then circumvent the way you're "supposed to" do things. Not only do you lose all the advances in tooling, but people will end up reinventing things that already exist in the other languages.

PS: Of course, I'll pick Static Typing every time.

manish_gill··on The Big DevOps Misunderstanding
Yeah, I think the difference is that I was

a) Learning K8s and Helm Concepts (both different things)

b) Reading/Debugging K8s and Helm YAML (both different things)

c) Ending up at Helm Chart Configs (another config)

d) Figuring out how to set all this to helm me deploy the solution I needed and customize it acc to my needs

...all within the span of a few weeks.

So by the time I got to some GitHub repos which were using Jsonnet, I was basically done. I'm sure it has its uses and given enough time and experience, I can see how to utilize it more effectively.

manish_gill··on The Big DevOps Misunderstanding
Dhall looks interesting. Thanks!

I went into the rabbithole of terraform/HCL and came up with Terragrunt to do dynamic code generation. Combining it together with generous use of `make` keeps me sane, but it's not a long term solution.

Even now, there are things within the system where the boundaries should be separate, but they aren't.

We literally got exhausted and burned out writing our automation, and decided to leave it as it is and then slowly build it up over the next few months. :/

PS: You're 100% right re K8s/YAML. It feels like everything in the Kubernetes world is optimized for writing the code just once. Which, of course, is easy if you already know how all the various bits fit together (true in any system).

But Reading/Debugging kubernetes world is a dreadful experience.

Edit: typo

manish_gill··on The Big DevOps Misunderstanding
Ah, CDKTF seems to be the Pulumi equivalent for Terraform. I think I remember seeing it.

We're far too invested into Terraform at this point to learn yet another tool. Oh well. Hopefully the next time I have to implement something like this, K8s ecosystem would also have similar tools (or maybe I just missed something)

manish_gill··on The Big DevOps Misunderstanding
I had to basically give up my full time role as a Data Engineer who is supposed to solve "big data" problems (Storage, Streaming, Machine Learning pipelines) etc, and had to solely focus on DevOps because there was no other expert in the team.

We (a colleague and I) basically learned Terraform, then Kubernetes, and then Helm in an extremely stressful environment. I wouldn't recommend that to most people. (Also, I can hear "you don't need k8s", but tbh, it makes the difficult things possible, and that's what we needed).

I've done Ops in bare-metal environments before, and at least there, even if there were new skills to learn, the environment just wasn't so hostile for beginners, and the learning curve was simpler.

The YAML (or heaven forbid, jsonnet) does *not* help. TBH, I'm convinced if the IaC bits were done in a regular Java/Go/Rust SDK style instead of mixing and matching YAML glued together via labels and tags, I would have had a much easier time.

The positive side of that is that now the IaC bits are mature enough that even the Data Scientists in our team write their own Terraform code, and I've upskilled myself quite a lot. I'm slowly going back to solving Storage/Data/ML issues, which I enjoy a lot more.

Maybe I'm just becoming a cranky Software Dev as I enter my 30s. I do _not_ enjoy reading YAML.

manish_gill··on The Little Book of Rust Macros
By co-incidence, I started reading the updated version of this book today! Fantastic resource.

Question to experienced Rust people: What are some cool use-cases that you've seen for Macros?

manish_gill··on How I Use Notion
Yak Shaving, probably.
manish_gill··on How trains could replace planes in Europe
Heh. Funnily enough, My partner and I missed an FEX from Gesundbrunnen a couple of weeks ago (it's 3 stations from where we live). Because the transition time b/w S-bahn exit and FEX entry was 1 minute, clearly not enough time to find the correct platform and arrive there to board.

Of course, one guy was prepared and literally _ran_ to the FEX. We walked and then waited 30 mins for the next one to arrive. :)

manish_gill··on Ask HN: What you up to? (Who doesn't want to be hired?)
Had been feeling quite frustrated with work lately. Corporate inertia at the same time as "move fast" in a DS/Eng setup combined with a re-org going on. Add zero devops + an "incident" as cherry on top. I'd been stretching myself thin trying to do "everything", and do "everything right". To the point that it started impacting my personal life.

Took a vacation to Rome and Venice, and just 5 days away from home were enough to decompress. Feeling really good now.

Wish I had more time for open source contributions, but marriage + work are almost leaving no time at all. Got something going but the big tasks require a lot more dedicated effort.

Now thinking of new places to go on vacation in Southern Europe to escape from the cold :)

manish_gill··on The rise of never-ending job interviews
Unique questions? What's there to be so proud of in selecting questions? Are you playing jeopardy with the candidates careers? Enticing the candidates to moving on and not answering questions in what is probably the biggest interview in their life? "Quickly!"?

> Some candidates make it hard because they want to keep persevering, keep thinking

Yeah, amazing that some candidates want to demonstrate their perseverance even in face of problems that they find challenging. Crazy right?

manish_gill··on Zig cc: A drop-in replacement for GCC/Clang (2020)
I literally started learning Zig today after watching a talk on youtube by Andrew Kelly. The drop-in C compiler replacement lured me.

But what surprised me immediately and the thing I'm absolutely loving is the error handling (https://twitter.com/mgill25/status/1416720958988210177) and the comptime features.

I've done Rust and while I love what it's doing, getting into low-level C-world without the overhead of a language like Rust feels liberating.

manish_gill··on I made a mistake with Terraform and Azure made it worse
What was actually needed here was a Resource Lock on the Resource Group in question.
manish_gill··on Ask HN: How can I/we make the most of a hot job market?
Question to anyone who knows better: Can people in EU take advantage of this somehow? US compensation is _crazy_ relative to what I make in Berlin for example. 2-3x or more for Senior/Staff level positions. I'm not an EU citizen, so I'm not even sure how to apply for the best possible positions in US-based companies.
manish_gill··on Google Cloud vs. AWS Onboarding Comparison
I literally had the opposite experience - a couple of years ago I was leading a data team designing a cloud-based solution and migrating the company from bare metal.

*AWS* - Lots of sales calls, but eventually redirected us to a "partner", who came up with basically a lift-and-shift.

*GCP* - The Regional Business Head was in direct contact. We were provided almost limitless access to a very helpful and experienced Customer Engineer - who spent _weeks_ with us, designing architecture, doing presentations, giving us learning material and eventually was instrumental in my team's increased capability and skill level to do the new infra design. Both came to visit the office several times. Eventually more senior engineers got involved.

We were also repeatedly given generous credit extensions. And best of all - there was a GCP summit in the country, during which I literally had a sit-down with PMs from a lot of GCP's product offerings - including Spanner, BigTable. 1:1 video calls with PMs from FileStore, Dataflow and BigQuery as well as early access to some key features.

Worth noting that we were hardly a "big" customer, or a huge money spender. Perhaps it was the technical challenge that interested them, or perhaps the reputation of the company/founder in the region. Whatever it was, I've had great experience with GCP.

manish_gill··on Many use cases don’t require Kafka (2019)
The interesting part is that indeed, the people who write these articles are usually building large scale systems, writing books, newsletters and building companies for them, and then telling everyone else how they don't need it.

Of course engineers have a tendency to over-engineer solutions. I don't think anyone is surprised by that. But this "oh you don't need it, I've used it at <bigcorp>, and you're not that" thinking just rubs me wrong. Especially when it's backed up by hollow arguments like the ones in this post.

manish_gill··on Many use cases don’t require Kafka (2019)
The general trend in these posts (and tweet storms) is the same - pick any technology and then preach the wisdom of not using it because "You're not Google", or "You won't need it". It's a great tactic as it puts the speaker in a position of judgement, and they can freely share their opinions on some architecture, without getting any pushback from the creators of said architecture. Quite a one-sided affair that makes you look like you know everything. It's, frankly, elitist.

This entire article can be surmised by "You don't need Kafka because the throughput seems to be low". To which the retort can be many: they might be building for the future - to integrate more systems, they might have fan-out use cases, they might want to have a log to replay in case of disasters - so on and so forth. All well documented and very valid use cases of Kafka.

But of course, "You don't need Kafka" because <reasons>.

manish_gill··on Statement on Google’s conduct by founder of CelebrityNetWorth.com (2019) [pdf]
I have Zero respect for the Google engineers and PMs who worked on this project, scraping content without attributing to the original source, and subsequent change in the search ranking of the original source.

A very bad taste in the mouth indeed.

manish_gill··on Ask HN: What weird or hard problems are you trying to solve?
I'd love to. Hit me at me@manishgill.com :)
manish_gill··on Ask HN: What weird or hard problems are you trying to solve?
If this can allow me to write complex SQL (lots of JOINs, Multiple CTEs building on top of each other, Analytic functions etc), then I'm definitely interested. I've created an SQL generation engine in the past and can definitely appreciate how hard the problem is.
manish_gill··on Ask HN: Did you take any fresh MOOCs as of 2020?
The labs I've done so far came with their own test scripts and they are good enough, IMO :)
manish_gill··on Ask HN: Did you take any fresh MOOCs as of 2020?
This course is incredible. If anyone who had a hand in putting it together is reading, they have my thanks for putting out such an incredible course. I've done 2 labs and 5-6 lectures of this course so far and I find it absolutely worth it. I just wish I were a bit more disciplined about it (the pandemic made a lot of things harder for me). My goal is to eventually finish it and then make my own version of the Distributed KV store (perhaps in Rust?), and then perhaps even do a good Databases courses.

So far, it's allowed me to dive deep into how Map Reduce works, I even presented GFS in a local Distributed Systems group, and was able to understand Raft. I'm currently doing Raft labs (which is when the Pandemic happened). I've designed some sharding schemes in my previous company and worked a lot on Streaming systems but learning the theory behind everything is amazing.

If there are people here who would like to put a serious joint effort into doing this course, I would absolutely 100% be interested in it. Doing this alone from my apartment in a foreign country gets a bit tricky vs doing it in a group setting. :)

manish_gill··on Ask HN: Am I the longest-serving programmer – 57 years and counting?
Do you think it was worth it? Did you like the program?
← PreviousPage 3 of 15Next →