For sure but most of that innovation pre-super shoes was optimizing the runner, not the shoes
43 karma · joined June 18, 2021
Based on the quote below, next thing we will see is a "constructors championship" similar to F1 for winning shoe constructor in the 'major' marathons :-(.
" This dominance continued in 2024, with adidas athletes wearing Adizero models winning six out of 12 World Major Marathons – more than any other brand."
and yes, of course i race in super shoes :-).
This team is doing a good job. They use problems that were created in last 30days to avoid training set leakage. https://swe-rebench.com/
I live in the that space (between tower and the city) and the local neighbourhood group (HANC) is ridiculously NIMBY. rezoning is happening but it's slow going...
When trying to deploy llms in with larger context windows constrained environments 2 things start to hurt: a) increased memory footprint for longer KV cache b) increased decode speed due to longer context window. this paper addresses a) only, which is useful, but we are still left with b) (right?)
https://finance.yahoo.com/news/microsoft-stock-receives-rare...
OpenAI could just build their own framework for internal use that works well on their silicon (see Jax+tpu)
Their starting point? Triton plus some triton libs. Jax chipped away at TF like this, and no reason why Triton can’t do the same to PyTorch.
Now we just need to solve the remaining 90%: firmware, software, security, virtualization, …, …