If you require high throughput and have a high duration then partitioning/distribution are the normal solution.
444 karma · joined November 16, 2018
If you require high throughput and have a high duration then partitioning/distribution are the normal solution.
Your dynamodb solution isn't foolproof. It has throughput limited to the partition granularity -> in your case the lambda name. It's also relatively expensive and fairly slow to query in bulk (DDB is designed for OLTP).
I don't have direct experience here, but I expect slapping grafana on top of any disk basked source is likely to be cheaper, faster, and have better ergonomics. Once your logging is too much for a disk to handle (this will be later than you would've outgrown ddb, but before you would've outgrown cloudwatch) then you can bring something fancy in.
1. I could never fully understand how all the google products integrated with each other.
2. The guys we talked to at google were often unable to recommend which product was correct for our use case (it seemed like there were multiple entry points but they all funneled back to one or two common sources)
3. Many of the integrations we wanted to do had no clear criteria for whether google would accept you or not. This led to us wasting lots of time.
4. Our whole company focused on an integration with google for 6-9months. When we were validating our implementation google pulled out, citing antitrust concerns. A few months later they announced a product that competed with us. As google is a big org I'm not really sure if this was coordinated on their side.
The need to act as world police (re uyghurs, taiwan) can be a game for the major powers.
> Keating said the “great sin” China had committed in the eyes of the west was developing its economy to equal the size of the US
This is somewhat supported by some of the wikileaks releases, but it's a little hard to disentangle if the economy is the sin or just an intensifier.
> At the lunch, Mrs Clinton confided in Mr Rudd about America's fears about China's rapid economic rise and Beijing's multibillion-dollar store of US debt, asking Mr Rudd: ''How do you deal toughly with your banker?''
https://www.smh.com.au/national/explosive-wiki-rudd-cable-20...
https://www.theguardian.com/australia-news/2023/mar/15/paul-...
I am not an expert on any of the above.
A language with a GC (like go) typically isn't a good fit for a 3d engine. Almost all serious engines are C++, at least for the core code, for that reason.
https://www.politico.com/story/2017/03/donna-brazile-hillary...
> WikiLeaks wins top Australian journalism prize... The Walkley Award is one of a number of journalism prizes won by WikiLeaks in recent years, including Amnesty International’s UK Media Award and the acclaimed Martha Gellhorn Prize. The latter award is given to journalists who reveal “an unpalatable truth that exposes establishment propaganda.” These prizes undermine the Obama administration’s claims that Assange is not a journalist and that the publication of thousands of secret US diplomatic and military cables is illegal.
Most notably, the UK-US extradition treaty, which has exemptions for political offenses (e.g. espionage), has been found not to apply.
This article is decent https://theconversation.com/julian-assange-how-british-extra..., but from the middle of the trial. Craig Murray's blog is also a good source of info.
> He was granted asylum by Ecuador in August 2012[10] on the grounds of political persecution and fears he might be extradited to the United States.[11]
It seems to me like the Trump administration simply mainted the status quo of what came before them. One theory could be the timing of the charges was more aligned with Ecuador changing PM/kicking Assange out of the embassy. https://thegrayzone.com/2019/04/14/lenin-moreno-julian-assan...
2) There's plenty of bullshit that can be used to cheat an employee out of their options. One example here [1].
[1] https://techcrunch.com/2011/06/26/skypes-worthless-employee-...
Fast forward four years of toil with multiple cycles of doubling and then halving headcount as well as endless leadership changes. We are now on our fourth CTO in as many years. On the upside things are starting to look up! The newest sales team have worked out how to sell the original product we built, not the bells and whistles we pivoted to on the wisdom of the overpaid CPO. We can now celebrate as we have about a year's worth of runway and can confidently project being cash flow positive in about six months.
The new ex-FAANG CTO earning three times as much as anyone in the original team has great news! As a result of the positive development we are now able to hire an extra development team in South America! This shouldn't cost us too much and they can start on the next greenfield effort. The existing developers need not worry about being replaced as the existing team has all of the experience with the money making side of the business, and besides the new devs will be working on a parallel offering anyway.
Four weeks later and we've onboarded two offshore devs. The VCs have demanded we cut our burn rate and my position is being made redundant. I have 90 days to exercise but my options are underwater, both when compared to the funds we raised a few months ago and also the FMV. Essentially to buy them now I would be worse off than someone walking straight off the street.
I hope that you're correct however.
I thought I could count on the charismatic leader to save my bacon by only calling on them for help when when things are visibly on fire and my own minor charisma hasn't been enough. In the end the leader didn't show up and now I've got a HR complaint against me for following up consistently when the fire didn't get put out. The whole thing has been fairly stressful because I'm struggling to understand the particular social dynamics, my best guess is it's just power protecting power, but I am naive/delusional enough to want to believe there is more to it. Now I'm taking a month off from work to try and unwind a bit.
All of that was just a long way of saying that you never know when you'll need to call on your stress/conflict managing skills, so best to keep them sharp at all times. I thought my skills were already good, but that was quickly revealed as false when challenged by tougher opponents :).
Even if the data is valuable, as far as I know there are no backdoors available to tiktok that aren't available to other apps (e.g any tencent game). The security model at the os level seems to be the proper place to ensure privacy, and the witch hunt against tik tok seems to only exist because it is popular.
- Prioritizing is hard, so avoid wasting brain cycles deciding how important your bugs are
- It encourages all of your team to get things right the first time, because if they don't they know they will be going back to fix it immediately.
- If you want to create a culture of quality then it's an obvious first step.
- It saves time in the long term by addressing problems when you have the most context and by avoiding building hack upon hack upon hack
In extreme cases you can relax the policy, but be aware that if you don't quickly correct course then things will be permanently worse. Also accept that hard external deadlines are not suited to this approach, but using triage some of that can be mitigated.
We also had a few issues where aurora was giving us *incorrect query results* and aws support were not helpful. Most of the issues were denied, even with simple reproductions, and then got fixed years later (~2-3) after we had given up. We still use it today but stay away from cutting edge features, unusual query patterns, and high volume use cases.
Having said all that, SQL still seems like the correct choice for getting an MVP out quickly.
All of the tech youtubers have been making similar points lately (LTT, GamersNexus, HardwareUnboxed).
Data centre does seem to be in AMD's favour at the moment, but I don't know enough about the space to know if their advantages will be long lived.
I don't know much about your application but the fact that you can mitigate the problem by scaling the number of workers suggests that the order requirements might actually be fairly weak. As a worst case outcome you may be able to push all events interdependent to the one with an error to a DLQ using a temporary blacklisting mechanism, but by that stage I think I would just prefer better testing.
My intuition is that in your given example (stock prices) smoothing would probably be doing yourself a disservice as it would hide the optimal hour or day of the week to make purchases/sales.
Is it mostly related to the timeframe of your analysis and needing to trade off near term precision for longer term precision?
This is not the exact link I was looking for but goes into it somewhat https://www.ycombinator.com/library/3Z-advice-for-companies-...