4,493 karma · joined March 8, 2009
This is quite the ad hominem. I may have missed it, but I'm not sure where OP said anything about density or housing. Is there something wrong with not wanting the city that you love to be invaded by the human version of a swarm of locusts?
(Hi Michael!)
Does the contemporary New York Economy connect people around the world and put all the worlds knowledge at your fingertips? Oh no, they just wreck the economy as a whole and feed us garbage like how they create value through “liquidity.”
How about the Washington DC economy? You know, the old joyful military-industrial complex that sucks in taxpayer money and converts it into dead civilians in the Middle East.
Or maybe the other geographically centralized titan of the US, The Texas Economy? You know, the one responsible for many of the major geopolitical conflicts in recent history that is also a huge part of what is turning the only planet we have into an unlivable hellscape.
And as far as I can tell the whole SoftBank funded fake tech masquerade thing is starting to melt down, so?
EDIT: ugh. Still early for us slackers on the West coast to do basic math.
Oh, and thanks for the middle school economics lesson.
If a food delivery company doubles their fees from 10% to 20% and the restaurant cuts its price proportionally, do you really say the delivery price is the same?
The total cost remains the same but the value the customer receives from the delivery service per dollar spent has been cut in half.
EDIT: confirmed by an AWS employee here https://twitter.com/_msw_/status/1201924979647905792
If the write to Kafka fails, it re-positions itself in the input topic stream based on the offset annotation in the output topic's last message. The write never went to RocksDB, so it won't be considered a duplicate.
Recovering from a failed RocksDB write is more complicated. The output topic's last message will have an offset that will effectively be beyond the accumulated state in RocksDB. Transactionally the last input topic offset for each committed message is written to RocksDB alongside it. The recovery process uses this offset as a starting point when consuming the input topic. During this process, messages aren't published into the output topic until the offset read from the output topic is reached.
It's done at ingest time because Segment has a completely different use case. Message data fans out over multiple downstream systems, some of which distribute this data to systems outside of our control. However, if I were in Mixpanel's shoes, I'd probably do it how they're describing it here.